2023-07-21T21:45:47.249 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T21:45:47.250 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} --name rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi --verbose --archive /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719 -- /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719/orig.config.yaml 2023-07-21T21:45:47.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:45:47.392 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719 branch: wip-rishabh-2023Jul13-base-2 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} email: null first_in_suite: false job_id: '7347719' kernel: flavor: default kdb: true sha1: c685da6f56cc77f2cfb9c4221be3960522616caf ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-rishabh-2023Jul13-base-2 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Jul13-base-2 sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Jul13-base-2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi049.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 79491cb69dd37a1eafb93b3471998174bdfa2fd9 timestamp: 2023-07-21_21:30:53 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-21T21:45:47.392 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa; will attempt to use it 2023-07-21T21:45:47.393 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks 2023-07-21T21:45:47.393 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-21T21:45:47.395 INFO:teuthology.task.internal:Checking packages... 2023-07-21T21:45:47.423 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea' 2023-07-21T21:45:47.423 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-21T21:45:47.423 INFO:teuthology.packaging:ref: None 2023-07-21T21:45:47.424 INFO:teuthology.packaging:tag: None 2023-07-21T21:45:47.424 INFO:teuthology.packaging:branch: wip-rishabh-2023Jul13-base-2 2023-07-21T21:45:47.424 INFO:teuthology.packaging:sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T21:45:47.424 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-rishabh-2023Jul13-base-2 2023-07-21T21:45:48.088 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4735-gbffe049d-1focal 2023-07-21T21:45:48.088 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-21T21:45:48.096 INFO:teuthology.task.internal:no buildpackages task found 2023-07-21T21:45:48.097 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-21T21:45:48.131 INFO:teuthology.task.internal:Saving configuration 2023-07-21T21:45:48.147 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-21T21:45:48.181 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T21:45:48.209 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:37:25.916606', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-21T21:45:48.231 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:37:25.914676', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-21T21:45:48.231 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-21T21:45:48.237 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-21T21:45:48.237 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-21T21:45:48.237 INFO:teuthology.run_tasks:Running task console_log... 2023-07-21T21:45:48.347 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffa122504c0>, signals=[15]) 2023-07-21T21:45:48.349 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-21T21:45:48.354 INFO:teuthology.task.internal:Opening connections... 2023-07-21T21:45:48.354 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T21:45:48.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:45:48.409 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T21:45:48.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:45:48.458 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-21T21:45:48.464 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2023-07-21T21:45:48.494 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2023-07-21T21:45:48.495 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-07-21T21:45:48.541 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Ubuntu" 2023-07-21T21:45:48.542 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-21T21:45:48.542 INFO:teuthology.orchestra.run.smithi049.stdout:ID=ubuntu 2023-07-21T21:45:48.542 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE=debian 2023-07-21T21:45:48.542 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-21T21:45:48.542 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="20.04" 2023-07-21T21:45:48.542 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-21T21:45:48.542 INFO:teuthology.orchestra.run.smithi049.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-21T21:45:48.543 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-21T21:45:48.543 INFO:teuthology.orchestra.run.smithi049.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-21T21:45:48.543 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_CODENAME=focal 2023-07-21T21:45:48.543 INFO:teuthology.orchestra.run.smithi049.stdout:UBUNTU_CODENAME=focal 2023-07-21T21:45:48.544 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-07-21T21:45:48.574 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2023-07-21T21:45:48.581 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2023-07-21T21:45:48.581 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2023-07-21T21:45:48.586 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Ubuntu" 2023-07-21T21:45:48.586 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-21T21:45:48.586 INFO:teuthology.orchestra.run.smithi150.stdout:ID=ubuntu 2023-07-21T21:45:48.587 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE=debian 2023-07-21T21:45:48.587 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-21T21:45:48.587 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="20.04" 2023-07-21T21:45:48.587 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-21T21:45:48.587 INFO:teuthology.orchestra.run.smithi150.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-21T21:45:48.587 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-21T21:45:48.587 INFO:teuthology.orchestra.run.smithi150.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-21T21:45:48.588 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_CODENAME=focal 2023-07-21T21:45:48.588 INFO:teuthology.orchestra.run.smithi150.stdout:UBUNTU_CODENAME=focal 2023-07-21T21:45:48.588 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2023-07-21T21:45:48.615 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-21T21:45:48.624 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-21T21:45:48.657 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-21T21:45:48.657 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2023-07-21T21:45:48.659 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2023-07-21T21:45:48.665 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-21T21:45:48.706 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-21T21:45:48.707 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2023-07-21T21:45:48.709 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2023-07-21T21:45:48.734 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-21T21:45:48.806 INFO:teuthology.run_tasks:Running task kernel... 2023-07-21T21:45:48.822 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'} 2023-07-21T21:45:48.823 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}}, timeout 300 2023-07-21T21:45:48.824 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-21T21:45:48.824 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-21T21:45:48.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T21:45:48.830 DEBUG:teuthology.task.kernel:sha1 for mon.a is c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:45:48.830 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "c685da6f56cc77f2cfb9c4221be3960522616caf"... 2023-07-21T21:45:48.830 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2023-07-21T21:45:48.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T21:45:48.832 DEBUG:teuthology.task.kernel:sha1 for mon.b is c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:45:48.832 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "c685da6f56cc77f2cfb9c4221be3960522616caf"... 2023-07-21T21:45:48.832 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2023-07-21T21:45:48.838 INFO:teuthology.orchestra.run.smithi049.stdout:5.4.0-124-generic 2023-07-21T21:45:48.838 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:45:48.839 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-21T21:45:48.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:45:48.879 INFO:teuthology.orchestra.run.smithi150.stdout:5.4.0-124-generic 2023-07-21T21:45:48.879 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:45:48.879 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-21T21:45:48.880 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:45:49.320 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-07-21T21:45:49.321 DEBUG:teuthology.orchestra.run.smithi049:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-21T21:45:49.342 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-07-21T21:45:49.374 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-07-21T21:45:49.374 DEBUG:teuthology.orchestra.run.smithi150:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-21T21:45:49.397 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-07-21T21:45:49.459 INFO:teuthology.orchestra.run.smithi049.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-21T21:45:49.461 DEBUG:teuthology.orchestra.run.smithi049:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-21T21:45:49.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-21T21:45:49.503 DEBUG:teuthology.orchestra.run.smithi049:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-21T21:45:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-21T21:45:49.511 DEBUG:teuthology.orchestra.run.smithi150:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-21T21:45:49.592 DEBUG:teuthology.orchestra.run.smithi150:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-21T21:45:49.609 DEBUG:teuthology.orchestra.run.smithi150:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-21T21:52:34.089 INFO:teuthology.orchestra.run.smithi049.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-21T21:52:34.090 INFO:teuthology.orchestra.run.smithi049.stderr: * [new branch] main -> origin/main 2023-07-21T21:52:34.141 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190312 -> 20190312 2023-07-21T21:52:34.142 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190416 -> 20190416 2023-07-21T21:52:34.142 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190514 -> 20190514 2023-07-21T21:52:34.142 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190618 -> 20190618 2023-07-21T21:52:34.142 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190717 -> 20190717 2023-07-21T21:52:34.142 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190815 -> 20190815 2023-07-21T21:52:34.143 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190923 -> 20190923 2023-07-21T21:52:34.143 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20191022 -> 20191022 2023-07-21T21:52:34.144 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20191215 -> 20191215 2023-07-21T21:52:34.144 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200122 -> 20200122 2023-07-21T21:52:34.145 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200316 -> 20200316 2023-07-21T21:52:34.145 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200421 -> 20200421 2023-07-21T21:52:34.145 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200519 -> 20200519 2023-07-21T21:52:34.145 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200619 -> 20200619 2023-07-21T21:52:34.145 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200721 -> 20200721 2023-07-21T21:52:34.145 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200817 -> 20200817 2023-07-21T21:52:34.146 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200918 -> 20200918 2023-07-21T21:52:34.146 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20201022 -> 20201022 2023-07-21T21:52:34.146 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20201118 -> 20201118 2023-07-21T21:52:34.146 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20201218 -> 20201218 2023-07-21T21:52:34.146 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210208 -> 20210208 2023-07-21T21:52:34.146 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210315 -> 20210315 2023-07-21T21:52:34.146 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210511 -> 20210511 2023-07-21T21:52:34.147 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210716 -> 20210716 2023-07-21T21:52:34.147 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210818 -> 20210818 2023-07-21T21:52:34.149 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210919 -> 20210919 2023-07-21T21:52:34.149 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20211027 -> 20211027 2023-07-21T21:52:34.150 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20211216 -> 20211216 2023-07-21T21:52:34.150 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220209 -> 20220209 2023-07-21T21:52:34.150 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220310 -> 20220310 2023-07-21T21:52:34.150 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220411 -> 20220411 2023-07-21T21:52:34.150 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220509 -> 20220509 2023-07-21T21:52:34.150 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220610 -> 20220610 2023-07-21T21:52:34.150 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220708 -> 20220708 2023-07-21T21:52:34.151 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220815 -> 20220815 2023-07-21T21:52:34.151 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220913 -> 20220913 2023-07-21T21:52:34.151 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20221012 -> 20221012 2023-07-21T21:52:34.151 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20221109 -> 20221109 2023-07-21T21:52:34.151 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20221214 -> 20221214 2023-07-21T21:52:34.151 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230117 -> 20230117 2023-07-21T21:52:34.151 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230210 -> 20230210 2023-07-21T21:52:34.152 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230310 -> 20230310 2023-07-21T21:52:34.152 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230404 -> 20230404 2023-07-21T21:52:34.152 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230515 -> 20230515 2023-07-21T21:52:34.152 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230625 -> 20230625 2023-07-21T21:52:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:Updating files: 48% (1444/2977) Updating files: 49% (1459/2977) Updating files: 50% (1489/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1954/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 81% (2430/2977) Updating files: 82% (2442/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-21T21:52:37.534 INFO:teuthology.orchestra.run.smithi049.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-21T21:52:37.550 INFO:teuthology.task.kernel:Downloading kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.a... 2023-07-21T21:52:37.551 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:52:43.106 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ 2023-07-21T21:52:43.106 DEBUG:teuthology.orchestra.run.smithi049:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ --input-file=- 2023-07-21T21:52:43.109 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi049.front.sepia.ceph.com to complete... 2023-07-21T21:53:02.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21 21:53:02 URL:https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb [38851044/38851044] -> "/tmp/linux-image.deb" [1] 2023-07-21T21:53:02.624 INFO:teuthology.orchestra.run.smithi049.stderr:FINISHED --2023-07-21 21:53:02-- 2023-07-21T21:53:02.624 INFO:teuthology.orchestra.run.smithi049.stderr:Total wall clock time: 19s 2023-07-21T21:53:02.624 INFO:teuthology.orchestra.run.smithi049.stderr:Downloaded: 1 files, 37M in 19s (1.97 MB/s) 2023-07-21T21:53:02.625 INFO:teuthology.task.kernel:Installing kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.a... 2023-07-21T21:53:02.626 DEBUG:teuthology.orchestra.run.smithi049:> sudo dpkg -i /tmp/linux-image.deb 2023-07-21T21:53:02.853 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-image-6.5.0-rc1-gc685da6f56cc. 2023-07-21T21:53:05.036 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-07-21T21:53:05.041 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-21T21:53:05.845 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-21T21:53:15.741 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-21T21:53:15.863 INFO:teuthology.orchestra.run.smithi049.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:53:31.487 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub' 2023-07-21T21:53:31.497 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-21T21:53:31.527 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2023-07-21T21:53:31.833 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:53:31.861 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:53:32.243 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-21T21:53:32.255 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-21T21:53:34.004 INFO:teuthology.orchestra.run.smithi049.stderr:done 2023-07-21T21:53:34.188 DEBUG:teuthology.orchestra.run.smithi049:> dpkg-deb -c /tmp/linux-image.deb 2023-07-21T21:53:34.197 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./ 2023-07-21T21:53:34.198 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./boot/ 2023-07-21T21:53:34.198 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 4380308 2023-07-20 12:16 ./boot/System.map-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:53:34.213 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 168433 2023-07-20 12:16 ./boot/config-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:53:34.214 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11280224 2023-07-20 12:16 ./boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:53:34.235 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/ 2023-07-21T21:53:34.236 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/ 2023-07-21T21:53:34.236 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/postinst.d/ 2023-07-21T21:53:34.236 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/postrm.d/ 2023-07-21T21:53:34.236 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/preinst.d/ 2023-07-21T21:53:34.236 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/prerm.d/ 2023-07-21T21:53:34.237 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/ 2023-07-21T21:53:34.237 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/ 2023-07-21T21:53:34.237 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/ 2023-07-21T21:53:34.237 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/ 2023-07-21T21:53:34.237 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/ 2023-07-21T21:53:34.237 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/ 2023-07-21T21:53:34.237 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ 2023-07-21T21:53:34.237 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 490385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-21T21:53:34.240 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-21T21:53:34.240 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-21T21:53:34.240 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-21T21:53:34.240 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 93113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-21T21:53:34.240 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 106729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-21T21:53:34.240 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 152241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-21T21:53:34.241 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-21T21:53:34.241 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-21T21:53:34.241 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 83889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-21T21:53:34.241 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-21T21:53:34.241 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-21T21:53:34.241 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-21T21:53:34.241 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-21T21:53:34.242 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-21T21:53:34.242 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-21T21:53:34.242 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-21T21:53:34.242 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-21T21:53:34.242 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-21T21:53:34.242 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-21T21:53:34.242 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/ 2023-07-21T21:53:34.243 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/ 2023-07-21T21:53:34.243 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/ 2023-07-21T21:53:34.243 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-21T21:53:34.243 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpuid.ko 2023-07-21T21:53:34.243 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/msr.ko 2023-07-21T21:53:34.243 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/ 2023-07-21T21:53:34.243 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 348417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-21T21:53:34.243 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 972641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-21T21:53:34.244 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2273145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm.ko 2023-07-21T21:53:34.252 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ 2023-07-21T21:53:34.253 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/af_alg.ko 2023-07-21T21:53:34.253 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_hash.ko 2023-07-21T21:53:34.253 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_skcipher.ko 2023-07-21T21:53:34.253 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ansi_cprng.ko 2023-07-21T21:53:34.253 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/anubis.ko 2023-07-21T21:53:34.253 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/arc4.ko 2023-07-21T21:53:34.253 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/ 2023-07-21T21:53:34.254 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-21T21:53:34.254 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/ 2023-07-21T21:53:34.254 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_memcpy.ko 2023-07-21T21:53:34.254 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_pq.ko 2023-07-21T21:53:34.254 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-21T21:53:34.254 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_tx.ko 2023-07-21T21:53:34.254 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_xor.ko 2023-07-21T21:53:34.255 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/raid6test.ko 2023-07-21T21:53:34.255 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authenc.ko 2023-07-21T21:53:34.255 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authencesn.ko 2023-07-21T21:53:34.255 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blake2b_generic.ko 2023-07-21T21:53:34.255 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_common.ko 2023-07-21T21:53:34.255 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_generic.ko 2023-07-21T21:53:34.256 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/camellia_generic.ko 2023-07-21T21:53:34.256 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast5_generic.ko 2023-07-21T21:53:34.256 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast6_generic.ko 2023-07-21T21:53:34.256 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast_common.ko 2023-07-21T21:53:34.256 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ccm.ko 2023-07-21T21:53:34.256 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cmac.ko 2023-07-21T21:53:34.257 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crc32_generic.ko 2023-07-21T21:53:34.257 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cryptd.ko 2023-07-21T21:53:34.257 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_engine.ko 2023-07-21T21:53:34.257 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_simd.ko 2023-07-21T21:53:34.257 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_user.ko 2023-07-21T21:53:34.257 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cts.ko 2023-07-21T21:53:34.258 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/des_generic.ko 2023-07-21T21:53:34.258 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/dh_generic.ko 2023-07-21T21:53:34.258 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/echainiv.ko 2023-07-21T21:53:34.258 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/essiv.ko 2023-07-21T21:53:34.258 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/fcrypt.ko 2023-07-21T21:53:34.258 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/khazad.ko 2023-07-21T21:53:34.258 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lrw.ko 2023-07-21T21:53:34.258 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4.ko 2023-07-21T21:53:34.259 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4hc.ko 2023-07-21T21:53:34.259 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/md4.ko 2023-07-21T21:53:34.259 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/michael_mic.ko 2023-07-21T21:53:34.259 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcbc.ko 2023-07-21T21:53:34.259 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcrypt.ko 2023-07-21T21:53:34.259 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/rmd160.ko 2023-07-21T21:53:34.260 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/seed.ko 2023-07-21T21:53:34.260 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/serpent_generic.ko 2023-07-21T21:53:34.260 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 149193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tcrypt.ko 2023-07-21T21:53:34.260 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tea.ko 2023-07-21T21:53:34.260 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_common.ko 2023-07-21T21:53:34.260 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_generic.ko 2023-07-21T21:53:34.260 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/vmac.ko 2023-07-21T21:53:34.261 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/wp512.ko 2023-07-21T21:53:34.261 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xcbc.ko 2023-07-21T21:53:34.261 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xor.ko 2023-07-21T21:53:34.261 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xts.ko 2023-07-21T21:53:34.261 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xxhash_generic.ko 2023-07-21T21:53:34.261 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ 2023-07-21T21:53:34.261 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ 2023-07-21T21:53:34.262 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_extlog.ko 2023-07-21T21:53:34.262 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-21T21:53:34.262 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_pad.ko 2023-07-21T21:53:34.262 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/ 2023-07-21T21:53:34.262 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/einj.ko 2023-07-21T21:53:34.262 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ec_sys.ko 2023-07-21T21:53:34.263 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/platform_profile.ko 2023-07-21T21:53:34.263 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbs.ko 2023-07-21T21:53:34.263 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbshc.ko 2023-07-21T21:53:34.263 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/video.ko 2023-07-21T21:53:34.263 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ 2023-07-21T21:53:34.264 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/acard-ahci.ko 2023-07-21T21:53:34.264 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 88625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci.ko 2023-07-21T21:53:34.264 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci_platform.ko 2023-07-21T21:53:34.265 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 87841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci.ko 2023-07-21T21:53:34.265 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci_platform.ko 2023-07-21T21:53:34.265 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_acpi.ko 2023-07-21T21:53:34.265 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ali.ko 2023-07-21T21:53:34.266 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_amd.ko 2023-07-21T21:53:34.266 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_artop.ko 2023-07-21T21:53:34.266 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atiixp.ko 2023-07-21T21:53:34.267 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atp867x.ko 2023-07-21T21:53:34.267 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd640.ko 2023-07-21T21:53:34.267 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd64x.ko 2023-07-21T21:53:34.267 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cypress.ko 2023-07-21T21:53:34.268 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_efar.ko 2023-07-21T21:53:34.268 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt366.ko 2023-07-21T21:53:34.268 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt37x.ko 2023-07-21T21:53:34.268 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-21T21:53:34.269 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-21T21:53:34.269 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it8213.ko 2023-07-21T21:53:34.269 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it821x.ko 2023-07-21T21:53:34.269 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_jmicron.ko 2023-07-21T21:53:34.269 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_legacy.ko 2023-07-21T21:53:34.270 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_marvell.ko 2023-07-21T21:53:34.270 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_mpiix.ko 2023-07-21T21:53:34.270 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_netcell.ko 2023-07-21T21:53:34.270 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ninja32.ko 2023-07-21T21:53:34.270 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87410.ko 2023-07-21T21:53:34.270 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87415.ko 2023-07-21T21:53:34.270 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_oldpiix.ko 2023-07-21T21:53:34.271 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_opti.ko 2023-07-21T21:53:34.271 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_optidma.ko 2023-07-21T21:53:34.271 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pcmcia.ko 2023-07-21T21:53:34.271 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-21T21:53:34.271 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-21T21:53:34.271 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_piccolo.ko 2023-07-21T21:53:34.271 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_radisys.ko 2023-07-21T21:53:34.272 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rdc.ko 2023-07-21T21:53:34.272 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rz1000.ko 2023-07-21T21:53:34.272 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sch.ko 2023-07-21T21:53:34.272 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_serverworks.ko 2023-07-21T21:53:34.272 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sil680.ko 2023-07-21T21:53:34.272 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sl82c105.ko 2023-07-21T21:53:34.273 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_triflex.ko 2023-07-21T21:53:34.273 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_via.ko 2023-07-21T21:53:34.273 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pdc_adma.ko 2023-07-21T21:53:34.273 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_inic162x.ko 2023-07-21T21:53:34.273 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 83225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_mv.ko 2023-07-21T21:53:34.273 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_nv.ko 2023-07-21T21:53:34.273 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_promise.ko 2023-07-21T21:53:34.274 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_qstor.ko 2023-07-21T21:53:34.274 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil.ko 2023-07-21T21:53:34.274 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil24.ko 2023-07-21T21:53:34.274 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sis.ko 2023-07-21T21:53:34.274 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_svw.ko 2023-07-21T21:53:34.274 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sx4.ko 2023-07-21T21:53:34.274 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_uli.ko 2023-07-21T21:53:34.274 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_via.ko 2023-07-21T21:53:34.275 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_vsc.ko 2023-07-21T21:53:34.275 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ 2023-07-21T21:53:34.275 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ks0108.ko 2023-07-21T21:53:34.275 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/ 2023-07-21T21:53:34.275 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 124457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/bcma.ko 2023-07-21T21:53:34.275 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/ 2023-07-21T21:53:34.275 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/ 2023-07-21T21:53:34.276 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 113705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/aoe.ko 2023-07-21T21:53:34.276 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/ 2023-07-21T21:53:34.276 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 968433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/drbd.ko 2023-07-21T21:53:34.329 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 173201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/floppy.ko 2023-07-21T21:53:34.329 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/ 2023-07-21T21:53:34.330 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 94297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-21T21:53:34.330 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 115345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/nbd.ko 2023-07-21T21:53:34.330 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/ 2023-07-21T21:53:34.330 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 110361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/null_blk.ko 2023-07-21T21:53:34.330 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 98225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/pktcdvd.ko 2023-07-21T21:53:34.330 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 257529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/rbd.ko 2023-07-21T21:53:34.331 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/ 2023-07-21T21:53:34.331 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 98129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-21T21:53:34.331 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/ 2023-07-21T21:53:34.331 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/zram.ko 2023-07-21T21:53:34.331 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ 2023-07-21T21:53:34.331 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/applicom.ko 2023-07-21T21:53:34.331 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hangcheck-timer.ko 2023-07-21T21:53:34.332 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/ 2023-07-21T21:53:34.332 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-21T21:53:34.332 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-21T21:53:34.332 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-21T21:53:34.332 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/via-rng.ko 2023-07-21T21:53:34.332 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-21T21:53:34.332 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ 2023-07-21T21:53:34.333 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-21T21:53:34.333 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 150665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-21T21:53:34.333 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-21T21:53:34.333 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 139057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-21T21:53:34.333 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-21T21:53:34.333 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-21T21:53:34.333 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/lp.ko 2023-07-21T21:53:34.334 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/ 2023-07-21T21:53:34.334 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 84121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/mwave.ko 2023-07-21T21:53:34.334 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/nvram.ko 2023-07-21T21:53:34.334 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ppdev.ko 2023-07-21T21:53:34.334 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tlclk.ko 2023-07-21T21:53:34.334 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/ 2023-07-21T21:53:34.334 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-21T21:53:34.334 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-21T21:53:34.335 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-21T21:53:34.335 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-21T21:53:34.335 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-21T21:53:34.335 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-21T21:53:34.335 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-21T21:53:34.335 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/ 2023-07-21T21:53:34.335 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-21T21:53:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-21T21:53:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-21T21:53:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/ 2023-07-21T21:53:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-palmas.ko 2023-07-21T21:53:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-si5351.ko 2023-07-21T21:53:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-twl6040.ko 2023-07-21T21:53:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-wm831x.ko 2023-07-21T21:53:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/ 2023-07-21T21:53:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-21T21:53:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-21T21:53:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-21T21:53:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ 2023-07-21T21:53:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ 2023-07-21T21:53:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-21T21:53:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 234473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp.ko 2023-07-21T21:53:34.338 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/ 2023-07-21T21:53:34.338 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/ 2023-07-21T21:53:34.338 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-21T21:53:34.338 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 408489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-21T21:53:34.338 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-21T21:53:34.338 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-21T21:53:34.338 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-aes.ko 2023-07-21T21:53:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-sha.ko 2023-07-21T21:53:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/ 2023-07-21T21:53:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-21T21:53:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/ 2023-07-21T21:53:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/dca.ko 2023-07-21T21:53:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ 2023-07-21T21:53:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/ 2023-07-21T21:53:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-21T21:53:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ 2023-07-21T21:53:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 122641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-21T21:53:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ 2023-07-21T21:53:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/amd64_edac.ko 2023-07-21T21:53:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/e752x_edac.ko 2023-07-21T21:53:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 63617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/edac_mce_amd.ko 2023-07-21T21:53:34.341 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3000_edac.ko 2023-07-21T21:53:34.341 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3200_edac.ko 2023-07-21T21:53:34.341 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5100_edac.ko 2023-07-21T21:53:34.341 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5400_edac.ko 2023-07-21T21:53:34.341 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7300_edac.ko 2023-07-21T21:53:34.341 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7core_edac.ko 2023-07-21T21:53:34.341 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i82975x_edac.ko 2023-07-21T21:53:34.342 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ie31200_edac.ko 2023-07-21T21:53:34.342 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/sb_edac.ko 2023-07-21T21:53:34.342 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/x38_edac.ko 2023-07-21T21:53:34.342 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/ 2023-07-21T21:53:34.342 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-gpio.ko 2023-07-21T21:53:34.342 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max14577.ko 2023-07-21T21:53:34.343 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max77693.ko 2023-07-21T21:53:34.343 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max8997.ko 2023-07-21T21:53:34.343 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-palmas.ko 2023-07-21T21:53:34.343 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-21T21:53:34.343 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-21T21:53:34.343 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/ 2023-07-21T21:53:34.343 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-21T21:53:34.343 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/ 2023-07-21T21:53:34.344 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-21T21:53:34.344 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-21T21:53:34.344 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/ 2023-07-21T21:53:34.344 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-21T21:53:34.344 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-21T21:53:34.344 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-arizona.ko 2023-07-21T21:53:34.344 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9052.ko 2023-07-21T21:53:34.345 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9055.ko 2023-07-21T21:53:34.345 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-dln2.ko 2023-07-21T21:53:34.345 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 77849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-21T21:53:34.345 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-generic.ko 2023-07-21T21:53:34.345 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ich.ko 2023-07-21T21:53:34.345 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-21T21:53:34.345 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-kempld.ko 2023-07-21T21:53:34.346 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-21T21:53:34.346 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max7300.ko 2023-07-21T21:53:34.346 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max730x.ko 2023-07-21T21:53:34.346 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max732x.ko 2023-07-21T21:53:34.346 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-21T21:53:34.346 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-21T21:53:34.347 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-21T21:53:34.347 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-21T21:53:34.347 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch.ko 2023-07-21T21:53:34.347 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-21T21:53:34.348 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-21T21:53:34.348 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-21T21:53:34.348 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-21T21:53:34.348 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-21T21:53:34.349 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-vx855.ko 2023-07-21T21:53:34.349 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-21T21:53:34.349 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-21T21:53:34.349 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-21T21:53:34.350 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/ 2023-07-21T21:53:34.350 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-a4tech.ko 2023-07-21T21:53:34.350 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-apple.ko 2023-07-21T21:53:34.351 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-appleir.ko 2023-07-21T21:53:34.351 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-aureal.ko 2023-07-21T21:53:34.351 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-axff.ko 2023-07-21T21:53:34.351 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-belkin.ko 2023-07-21T21:53:34.352 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cherry.ko 2023-07-21T21:53:34.352 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-chicony.ko 2023-07-21T21:53:34.352 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cp2112.ko 2023-07-21T21:53:34.353 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cypress.ko 2023-07-21T21:53:34.353 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-dr.ko 2023-07-21T21:53:34.353 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elecom.ko 2023-07-21T21:53:34.354 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elo.ko 2023-07-21T21:53:34.354 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-emsff.ko 2023-07-21T21:53:34.354 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ezkey.ko 2023-07-21T21:53:34.354 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gaff.ko 2023-07-21T21:53:34.355 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-generic.ko 2023-07-21T21:53:34.355 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gt683r.ko 2023-07-21T21:53:34.355 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gyration.ko 2023-07-21T21:53:34.355 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-21T21:53:34.356 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-21T21:53:34.356 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtekff.ko 2023-07-21T21:53:34.356 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-hyperv.ko 2023-07-21T21:53:34.357 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-icade.ko 2023-07-21T21:53:34.357 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kensington.ko 2023-07-21T21:53:34.357 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-keytouch.ko 2023-07-21T21:53:34.357 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kye.ko 2023-07-21T21:53:34.358 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lcpower.ko 2023-07-21T21:53:34.358 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-led.ko 2023-07-21T21:53:34.358 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lenovo.ko 2023-07-21T21:53:34.358 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lg-g15.ko 2023-07-21T21:53:34.359 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-21T21:53:34.359 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-21T21:53:34.359 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech.ko 2023-07-21T21:53:34.360 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-magicmouse.ko 2023-07-21T21:53:34.360 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-microsoft.ko 2023-07-21T21:53:34.360 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-monterey.ko 2023-07-21T21:53:34.361 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-multitouch.ko 2023-07-21T21:53:34.361 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ntrig.ko 2023-07-21T21:53:34.361 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ortek.ko 2023-07-21T21:53:34.361 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-penmount.ko 2023-07-21T21:53:34.362 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-petalynx.ko 2023-07-21T21:53:34.362 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-picolcd.ko 2023-07-21T21:53:34.362 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-pl.ko 2023-07-21T21:53:34.363 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-plantronics.ko 2023-07-21T21:53:34.363 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-primax.ko 2023-07-21T21:53:34.363 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-rmi.ko 2023-07-21T21:53:34.364 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-21T21:53:34.364 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-common.ko 2023-07-21T21:53:34.364 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-21T21:53:34.364 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-21T21:53:34.365 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-21T21:53:34.365 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-21T21:53:34.365 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-21T21:53:34.365 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-21T21:53:34.365 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-21T21:53:34.366 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-21T21:53:34.366 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-21T21:53:34.366 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat.ko 2023-07-21T21:53:34.366 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-saitek.ko 2023-07-21T21:53:34.367 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-samsung.ko 2023-07-21T21:53:34.367 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-21T21:53:34.367 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sjoy.ko 2023-07-21T21:53:34.368 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sony.ko 2023-07-21T21:53:34.368 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-speedlink.ko 2023-07-21T21:53:34.368 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-steelseries.ko 2023-07-21T21:53:34.368 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sunplus.ko 2023-07-21T21:53:34.368 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-21T21:53:34.368 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tivo.ko 2023-07-21T21:53:34.369 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tmff.ko 2023-07-21T21:53:34.369 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-topseed.ko 2023-07-21T21:53:34.369 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-twinhan.ko 2023-07-21T21:53:34.369 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-uclogic.ko 2023-07-21T21:53:34.369 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-waltop.ko 2023-07-21T21:53:34.369 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 143585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-wiimote.ko 2023-07-21T21:53:34.370 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-xinmo.ko 2023-07-21T21:53:34.370 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zpff.ko 2023-07-21T21:53:34.370 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zydacron.ko 2023-07-21T21:53:34.370 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 267713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid.ko 2023-07-21T21:53:34.370 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/uhid.ko 2023-07-21T21:53:34.370 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/ 2023-07-21T21:53:34.371 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-21T21:53:34.371 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-21T21:53:34.371 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-21T21:53:34.371 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 217401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/wacom.ko 2023-07-21T21:53:34.371 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/ 2023-07-21T21:53:34.371 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 63497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_balloon.ko 2023-07-21T21:53:34.371 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_utils.ko 2023-07-21T21:53:34.372 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 301449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_vmbus.ko 2023-07-21T21:53:34.372 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ 2023-07-21T21:53:34.372 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru.ko 2023-07-21T21:53:34.372 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru3.ko 2023-07-21T21:53:34.372 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-21T21:53:34.372 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7414.ko 2023-07-21T21:53:34.372 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7418.ko 2023-07-21T21:53:34.373 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adc128d818.ko 2023-07-21T21:53:34.373 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1025.ko 2023-07-21T21:53:34.373 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 97977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1026.ko 2023-07-21T21:53:34.373 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1029.ko 2023-07-21T21:53:34.373 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1031.ko 2023-07-21T21:53:34.373 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm9240.ko 2023-07-21T21:53:34.373 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ads7828.ko 2023-07-21T21:53:34.374 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7410.ko 2023-07-21T21:53:34.374 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7411.ko 2023-07-21T21:53:34.374 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 74433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7462.ko 2023-07-21T21:53:34.374 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7470.ko 2023-07-21T21:53:34.374 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7475.ko 2023-07-21T21:53:34.374 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7x10.ko 2023-07-21T21:53:34.374 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/amc6821.ko 2023-07-21T21:53:34.375 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/applesmc.ko 2023-07-21T21:53:34.375 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asb100.ko 2023-07-21T21:53:34.375 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asc7621.ko 2023-07-21T21:53:34.375 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-21T21:53:34.375 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/atxp1.ko 2023-07-21T21:53:34.375 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/coretemp.ko 2023-07-21T21:53:34.375 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-21T21:53:34.375 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-21T21:53:34.376 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-21T21:53:34.376 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 99601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dme1737.ko 2023-07-21T21:53:34.376 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds1621.ko 2023-07-21T21:53:34.376 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds620.ko 2023-07-21T21:53:34.376 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc1403.ko 2023-07-21T21:53:34.376 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc2103.ko 2023-07-21T21:53:34.376 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc6w201.ko 2023-07-21T21:53:34.377 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71805f.ko 2023-07-21T21:53:34.377 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 94457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71882fg.ko 2023-07-21T21:53:34.377 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f75375s.ko 2023-07-21T21:53:34.377 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fam15h_power.ko 2023-07-21T21:53:34.377 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fschmd.ko 2023-07-21T21:53:34.377 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g760a.ko 2023-07-21T21:53:34.377 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g762.ko 2023-07-21T21:53:34.377 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl518sm.ko 2023-07-21T21:53:34.378 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl520sm.ko 2023-07-21T21:53:34.378 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hih6130.ko 2023-07-21T21:53:34.378 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-21T21:53:34.378 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5500_temp.ko 2023-07-21T21:53:34.378 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5k_amb.ko 2023-07-21T21:53:34.378 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmaem.ko 2023-07-21T21:53:34.378 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmpex.ko 2023-07-21T21:53:34.379 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina209.ko 2023-07-21T21:53:34.379 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina2xx.ko 2023-07-21T21:53:34.379 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 129217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/it87.ko 2023-07-21T21:53:34.379 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/jc42.ko 2023-07-21T21:53:34.379 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k10temp.ko 2023-07-21T21:53:34.379 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k8temp.ko 2023-07-21T21:53:34.379 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lineage-pem.ko 2023-07-21T21:53:34.380 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm63.ko 2023-07-21T21:53:34.380 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm73.ko 2023-07-21T21:53:34.380 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm75.ko 2023-07-21T21:53:34.380 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm77.ko 2023-07-21T21:53:34.380 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm78.ko 2023-07-21T21:53:34.380 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm80.ko 2023-07-21T21:53:34.381 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm83.ko 2023-07-21T21:53:34.381 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm85.ko 2023-07-21T21:53:34.381 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm87.ko 2023-07-21T21:53:34.381 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm90.ko 2023-07-21T21:53:34.381 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm92.ko 2023-07-21T21:53:34.381 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm93.ko 2023-07-21T21:53:34.381 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95234.ko 2023-07-21T21:53:34.382 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95241.ko 2023-07-21T21:53:34.382 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95245.ko 2023-07-21T21:53:34.382 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc2945.ko 2023-07-21T21:53:34.382 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4151.ko 2023-07-21T21:53:34.382 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4215.ko 2023-07-21T21:53:34.382 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4222.ko 2023-07-21T21:53:34.383 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4245.ko 2023-07-21T21:53:34.383 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4260.ko 2023-07-21T21:53:34.383 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4261.ko 2023-07-21T21:53:34.383 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max16065.ko 2023-07-21T21:53:34.383 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1619.ko 2023-07-21T21:53:34.383 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1668.ko 2023-07-21T21:53:34.383 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max197.ko 2023-07-21T21:53:34.384 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6639.ko 2023-07-21T21:53:34.384 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6650.ko 2023-07-21T21:53:34.384 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6697.ko 2023-07-21T21:53:34.384 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-21T21:53:34.384 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mcp3021.ko 2023-07-21T21:53:34.384 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-21T21:53:34.385 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6683.ko 2023-07-21T21:53:34.385 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 116737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775-core.ko 2023-07-21T21:53:34.385 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775.ko 2023-07-21T21:53:34.385 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct7802.ko 2023-07-21T21:53:34.385 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 82337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87360.ko 2023-07-21T21:53:34.385 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87427.ko 2023-07-21T21:53:34.385 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pcf8591.ko 2023-07-21T21:53:34.386 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ 2023-07-21T21:53:34.386 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-21T21:53:34.386 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-21T21:53:34.386 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-21T21:53:34.386 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-21T21:53:34.386 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-21T21:53:34.386 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-21T21:53:34.386 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-21T21:53:34.387 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-21T21:53:34.387 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-21T21:53:34.387 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-21T21:53:34.387 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-21T21:53:34.387 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-21T21:53:34.387 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/powr1220.ko 2023-07-21T21:53:34.387 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5627.ko 2023-07-21T21:53:34.388 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5636.ko 2023-07-21T21:53:34.388 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-21T21:53:34.388 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht15.ko 2023-07-21T21:53:34.388 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht21.ko 2023-07-21T21:53:34.388 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/shtc1.ko 2023-07-21T21:53:34.388 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sis5595.ko 2023-07-21T21:53:34.388 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smm665.ko 2023-07-21T21:53:34.389 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47b397.ko 2023-07-21T21:53:34.389 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m1.ko 2023-07-21T21:53:34.389 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m192.ko 2023-07-21T21:53:34.389 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/thmc50.ko 2023-07-21T21:53:34.389 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp102.ko 2023-07-21T21:53:34.389 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp103.ko 2023-07-21T21:53:34.389 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp401.ko 2023-07-21T21:53:34.390 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp421.ko 2023-07-21T21:53:34.390 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via-cputemp.ko 2023-07-21T21:53:34.390 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via686a.ko 2023-07-21T21:53:34.390 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt1211.ko 2023-07-21T21:53:34.390 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt8231.ko 2023-07-21T21:53:34.390 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627ehf.ko 2023-07-21T21:53:34.390 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627hf.ko 2023-07-21T21:53:34.391 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83781d.ko 2023-07-21T21:53:34.391 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 63289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83791d.ko 2023-07-21T21:53:34.391 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83792d.ko 2023-07-21T21:53:34.391 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 101457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83793.ko 2023-07-21T21:53:34.391 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 119505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83795.ko 2023-07-21T21:53:34.391 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l785ts.ko 2023-07-21T21:53:34.391 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l786ng.ko 2023-07-21T21:53:34.392 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-21T21:53:34.392 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-21T21:53:34.392 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/ 2023-07-21T21:53:34.392 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/ 2023-07-21T21:53:34.392 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-21T21:53:34.393 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-21T21:53:34.393 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/ 2023-07-21T21:53:34.393 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-21T21:53:34.393 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-21T21:53:34.393 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-21T21:53:34.393 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-21T21:53:34.394 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-21T21:53:34.394 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-21T21:53:34.394 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-21T21:53:34.394 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-21T21:53:34.394 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-21T21:53:34.394 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-21T21:53:34.395 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-21T21:53:34.395 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-21T21:53:34.395 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-21T21:53:34.395 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-21T21:53:34.395 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-21T21:53:34.395 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-21T21:53:34.395 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-21T21:53:34.395 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-21T21:53:34.396 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-21T21:53:34.396 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-21T21:53:34.396 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-21T21:53:34.396 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-21T21:53:34.396 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-21T21:53:34.396 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-21T21:53:34.396 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-21T21:53:34.397 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-21T21:53:34.397 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-21T21:53:34.397 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-21T21:53:34.397 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-21T21:53:34.397 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-21T21:53:34.397 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-21T21:53:34.397 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-21T21:53:34.397 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-21T21:53:34.398 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-21T21:53:34.398 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-21T21:53:34.398 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-21T21:53:34.398 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-21T21:53:34.398 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-mux.ko 2023-07-21T21:53:34.398 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-smbus.ko 2023-07-21T21:53:34.398 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-stub.ko 2023-07-21T21:53:34.399 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/ 2023-07-21T21:53:34.399 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-21T21:53:34.399 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-21T21:53:34.399 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-21T21:53:34.399 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ 2023-07-21T21:53:34.399 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ 2023-07-21T21:53:34.399 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 273641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-21T21:53:34.400 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 876913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_core.ko 2023-07-21T21:53:34.400 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-21T21:53:34.400 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 324145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-21T21:53:34.400 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 97961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-21T21:53:34.400 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 279321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-21T21:53:34.400 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-21T21:53:34.400 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ 2023-07-21T21:53:34.401 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-21T21:53:34.401 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 492561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-21T21:53:34.401 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/ 2023-07-21T21:53:34.401 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 419217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-21T21:53:34.401 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/ 2023-07-21T21:53:34.401 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 739705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-21T21:53:34.401 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ 2023-07-21T21:53:34.402 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 296649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-21T21:53:34.402 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-21T21:53:34.402 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 153681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-21T21:53:34.402 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/ 2023-07-21T21:53:34.402 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 169017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-21T21:53:34.402 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ 2023-07-21T21:53:34.403 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-21T21:53:34.403 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 263177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-21T21:53:34.403 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ 2023-07-21T21:53:34.403 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-21T21:53:34.403 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ 2023-07-21T21:53:34.403 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 111993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-21T21:53:34.403 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ 2023-07-21T21:53:34.404 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 129081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-21T21:53:34.404 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ 2023-07-21T21:53:34.404 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 129553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-21T21:53:34.404 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ 2023-07-21T21:53:34.404 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/evbug.ko 2023-07-21T21:53:34.404 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ff-memless.ko 2023-07-21T21:53:34.404 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ 2023-07-21T21:53:34.405 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-21T21:53:34.405 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-21T21:53:34.405 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/gameport.ko 2023-07-21T21:53:34.405 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/lightning.ko 2023-07-21T21:53:34.405 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ns558.ko 2023-07-21T21:53:34.405 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/joydev.ko 2023-07-21T21:53:34.405 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/ 2023-07-21T21:53:34.406 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-21T21:53:34.406 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-21T21:53:34.406 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-21T21:53:34.406 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-21T21:53:34.406 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-21T21:53:34.406 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-21T21:53:34.407 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-21T21:53:34.407 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8323.ko 2023-07-21T21:53:34.407 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8333.ko 2023-07-21T21:53:34.407 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-21T21:53:34.407 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-21T21:53:34.407 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-21T21:53:34.407 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-21T21:53:34.407 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-21T21:53:34.408 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-21T21:53:34.408 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt1070.ko 2023-07-21T21:53:34.408 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt2160.ko 2023-07-21T21:53:34.408 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-21T21:53:34.408 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/stowaway.ko 2023-07-21T21:53:34.408 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-21T21:53:34.408 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-21T21:53:34.409 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-21T21:53:34.409 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-21T21:53:34.409 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-21T21:53:34.409 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/matrix-keymap.ko 2023-07-21T21:53:34.410 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/ 2023-07-21T21:53:34.410 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/appletouch.ko 2023-07-21T21:53:34.410 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/bcm5974.ko 2023-07-21T21:53:34.410 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 123681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/cyapatp.ko 2023-07-21T21:53:34.411 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-21T21:53:34.411 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-21T21:53:34.411 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 335849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/psmouse.ko 2023-07-21T21:53:34.412 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/sermouse.ko 2023-07-21T21:53:34.412 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-21T21:53:34.412 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-21T21:53:34.412 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-21T21:53:34.413 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/ 2023-07-21T21:53:34.413 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 109849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-21T21:53:34.413 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ 2023-07-21T21:53:34.413 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/altera_ps2.ko 2023-07-21T21:53:34.414 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/arc_ps2.ko 2023-07-21T21:53:34.414 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ct82c710.ko 2023-07-21T21:53:34.414 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-21T21:53:34.415 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/parkbd.ko 2023-07-21T21:53:34.415 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/pcips2.ko 2023-07-21T21:53:34.415 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ps2mult.ko 2023-07-21T21:53:34.415 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serio_raw.ko 2023-07-21T21:53:34.415 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serport.ko 2023-07-21T21:53:34.416 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/sparse-keymap.ko 2023-07-21T21:53:34.416 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/ 2023-07-21T21:53:34.416 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/ 2023-07-21T21:53:34.416 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-21T21:53:34.416 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/ 2023-07-21T21:53:34.417 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-88pm860x.ko 2023-07-21T21:53:34.417 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-adp5520.ko 2023-07-21T21:53:34.417 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-bd2802.ko 2023-07-21T21:53:34.417 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-blinkm.ko 2023-07-21T21:53:34.417 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da903x.ko 2023-07-21T21:53:34.418 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da9052.ko 2023-07-21T21:53:34.418 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-gpio.ko 2023-07-21T21:53:34.418 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3530.ko 2023-07-21T21:53:34.418 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3533.ko 2023-07-21T21:53:34.419 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm355x.ko 2023-07-21T21:53:34.419 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3642.ko 2023-07-21T21:53:34.419 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp3944.ko 2023-07-21T21:53:34.420 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp8788.ko 2023-07-21T21:53:34.420 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-max8997.ko 2023-07-21T21:53:34.420 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-mc13783.ko 2023-07-21T21:53:34.420 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-21T21:53:34.421 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca9532.ko 2023-07-21T21:53:34.421 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca955x.ko 2023-07-21T21:53:34.421 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca963x.ko 2023-07-21T21:53:34.421 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-ss4200.ko 2023-07-21T21:53:34.422 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-tca6507.ko 2023-07-21T21:53:34.422 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-21T21:53:34.422 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm8350.ko 2023-07-21T21:53:34.423 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ 2023-07-21T21:53:34.423 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-21T21:53:34.423 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-21T21:53:34.423 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-21T21:53:34.424 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-21T21:53:34.424 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-21T21:53:34.424 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-21T21:53:34.425 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-21T21:53:34.425 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-21T21:53:34.425 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/ 2023-07-21T21:53:34.425 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/ 2023-07-21T21:53:34.426 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 655473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/bcache.ko 2023-07-21T21:53:34.426 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bio-prison.ko 2023-07-21T21:53:34.426 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bufio.ko 2023-07-21T21:53:34.426 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache-smq.ko 2023-07-21T21:53:34.427 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 155993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache.ko 2023-07-21T21:53:34.427 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 107049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-crypt.ko 2023-07-21T21:53:34.427 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-delay.ko 2023-07-21T21:53:34.428 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-era.ko 2023-07-21T21:53:34.428 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-flakey.ko 2023-07-21T21:53:34.428 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log-userspace.ko 2023-07-21T21:53:34.428 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log.ko 2023-07-21T21:53:34.429 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-mirror.ko 2023-07-21T21:53:34.429 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-multipath.ko 2023-07-21T21:53:34.429 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-queue-length.ko 2023-07-21T21:53:34.430 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-raid.ko 2023-07-21T21:53:34.430 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-region-hash.ko 2023-07-21T21:53:34.430 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-round-robin.ko 2023-07-21T21:53:34.430 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-service-time.ko 2023-07-21T21:53:34.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 109593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-snapshot.ko 2023-07-21T21:53:34.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-switch.ko 2023-07-21T21:53:34.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 181585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-thin-pool.ko 2023-07-21T21:53:34.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-verity.ko 2023-07-21T21:53:34.432 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-zero.ko 2023-07-21T21:53:34.432 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/faulty.ko 2023-07-21T21:53:34.432 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/linear.ko 2023-07-21T21:53:34.433 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/multipath.ko 2023-07-21T21:53:34.433 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/ 2023-07-21T21:53:34.433 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 199937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-21T21:53:34.434 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid0.ko 2023-07-21T21:53:34.434 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 112609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid1.ko 2023-07-21T21:53:34.434 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 160553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid10.ko 2023-07-21T21:53:34.434 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 396153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid456.ko 2023-07-21T21:53:34.435 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/ 2023-07-21T21:53:34.435 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/ 2023-07-21T21:53:34.435 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 178113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptbase.ko 2023-07-21T21:53:34.435 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 63385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptctl.ko 2023-07-21T21:53:34.435 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptfc.ko 2023-07-21T21:53:34.435 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptlan.ko 2023-07-21T21:53:34.436 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 123305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptsas.ko 2023-07-21T21:53:34.436 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 79017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptscsih.ko 2023-07-21T21:53:34.436 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptspi.ko 2023-07-21T21:53:34.436 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ 2023-07-21T21:53:34.436 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm800.ko 2023-07-21T21:53:34.436 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm805.ko 2023-07-21T21:53:34.436 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm80x.ko 2023-07-21T21:53:34.437 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona-i2c.ko 2023-07-21T21:53:34.437 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 123721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona.ko 2023-07-21T21:53:34.437 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/bcm590xx.ko 2023-07-21T21:53:34.437 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-21T21:53:34.437 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/dln2.ko 2023-07-21T21:53:34.438 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/janz-cmodio.ko 2023-07-21T21:53:34.438 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/kempld-core.ko 2023-07-21T21:53:34.438 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-core.ko 2023-07-21T21:53:34.438 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-21T21:53:34.438 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lp3943.ko 2023-07-21T21:53:34.438 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_ich.ko 2023-07-21T21:53:34.439 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_sch.ko 2023-07-21T21:53:34.439 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/max8907.ko 2023-07-21T21:53:34.439 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-21T21:53:34.439 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-21T21:53:34.439 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/menf21bmc.ko 2023-07-21T21:53:34.439 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-21T21:53:34.439 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-21T21:53:34.440 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633.ko 2023-07-21T21:53:34.440 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-21T21:53:34.440 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/retu-mfd.ko 2023-07-21T21:53:34.440 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/si476x-core.ko 2023-07-21T21:53:34.440 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/sm501.ko 2023-07-21T21:53:34.440 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-21T21:53:34.441 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps65010.ko 2023-07-21T21:53:34.441 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps6507x.ko 2023-07-21T21:53:34.441 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/viperboard.ko 2023-07-21T21:53:34.441 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/vx855.ko 2023-07-21T21:53:34.441 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wl1273-core.ko 2023-07-21T21:53:34.441 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wm8994.ko 2023-07-21T21:53:34.441 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ 2023-07-21T21:53:34.442 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-21T21:53:34.442 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot.ko 2023-07-21T21:53:34.442 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/ 2023-07-21T21:53:34.442 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-21T21:53:34.442 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds9802als.ko 2023-07-21T21:53:34.442 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds990x.ko 2023-07-21T21:53:34.442 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/bh1770glc.ko 2023-07-21T21:53:34.443 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/ 2023-07-21T21:53:34.443 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-21T21:53:34.443 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/core.ko 2023-07-21T21:53:34.443 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/ 2023-07-21T21:53:34.443 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/cb710.ko 2023-07-21T21:53:34.443 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ds1682.ko 2023-07-21T21:53:34.443 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/dummy-irq.ko 2023-07-21T21:53:34.444 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/ 2023-07-21T21:53:34.444 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/echo.ko 2023-07-21T21:53:34.444 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/ 2023-07-21T21:53:34.444 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/at24.ko 2023-07-21T21:53:34.444 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-21T21:53:34.445 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-21T21:53:34.445 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/max6875.ko 2023-07-21T21:53:34.445 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/enclosure.ko 2023-07-21T21:53:34.446 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/ 2023-07-21T21:53:34.446 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 152137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-21T21:53:34.446 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hmc6352.ko 2023-07-21T21:53:34.446 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hpilo.ko 2023-07-21T21:53:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ 2023-07-21T21:53:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-21T21:53:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ics932s401.ko 2023-07-21T21:53:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29003.ko 2023-07-21T21:53:34.448 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29020.ko 2023-07-21T21:53:34.448 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/ 2023-07-21T21:53:34.448 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-21T21:53:34.449 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-21T21:53:34.449 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/ 2023-07-21T21:53:34.449 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-me.ko 2023-07-21T21:53:34.450 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-txe.ko 2023-07-21T21:53:34.450 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 309857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei.ko 2023-07-21T21:53:34.450 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/phantom.ko 2023-07-21T21:53:34.450 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/ 2023-07-21T21:53:34.451 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 74905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-21T21:53:34.451 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_7xx1.ko 2023-07-21T21:53:34.451 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_core.ko 2023-07-21T21:53:34.452 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tsl2550.ko 2023-07-21T21:53:34.452 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_balloon.ko 2023-07-21T21:53:34.452 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/ 2023-07-21T21:53:34.452 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 183857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-21T21:53:34.453 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ 2023-07-21T21:53:34.453 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/ 2023-07-21T21:53:34.453 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 487801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/bonding.ko 2023-07-21T21:53:34.453 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/ 2023-07-21T21:53:34.453 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/ 2023-07-21T21:53:34.454 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 106009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-21T21:53:34.454 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-21T21:53:34.454 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-21T21:53:34.455 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-21T21:53:34.455 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 452481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-21T21:53:34.455 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dummy.ko 2023-07-21T21:53:34.455 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/eql.ko 2023-07-21T21:53:34.455 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ 2023-07-21T21:53:34.456 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/ 2023-07-21T21:53:34.456 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-21T21:53:34.456 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-21T21:53:34.456 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 130489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-21T21:53:34.456 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-21T21:53:34.456 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ 2023-07-21T21:53:34.457 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-21T21:53:34.457 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-21T21:53:34.457 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-21T21:53:34.457 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 99113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-21T21:53:34.457 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/ 2023-07-21T21:53:34.457 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-21T21:53:34.458 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/ 2023-07-21T21:53:34.458 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-21T21:53:34.458 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/ 2023-07-21T21:53:34.458 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-21T21:53:34.458 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/ 2023-07-21T21:53:34.458 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-21T21:53:34.458 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/ 2023-07-21T21:53:34.459 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-21T21:53:34.459 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-21T21:53:34.459 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 87345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-21T21:53:34.459 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/ 2023-07-21T21:53:34.459 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-21T21:53:34.459 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 97321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-21T21:53:34.460 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-21T21:53:34.460 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 104585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-21T21:53:34.460 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-21T21:53:34.460 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 90257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-21T21:53:34.460 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-21T21:53:34.460 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-21T21:53:34.461 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-21T21:53:34.461 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/ 2023-07-21T21:53:34.461 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-21T21:53:34.461 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 176881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-21T21:53:34.461 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-21T21:53:34.462 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1422209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-21T21:53:34.462 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 128377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-21T21:53:34.462 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-21T21:53:34.463 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 132289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-21T21:53:34.463 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 312145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-21T21:53:34.463 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/ 2023-07-21T21:53:34.463 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-21T21:53:34.464 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 323601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-21T21:53:34.464 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/ 2023-07-21T21:53:34.464 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-21T21:53:34.464 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 193433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-21T21:53:34.465 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-21T21:53:34.465 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 347641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-21T21:53:34.465 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-21T21:53:34.466 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1044145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-21T21:53:34.466 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-21T21:53:34.466 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 166113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-21T21:53:34.467 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-21T21:53:34.467 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-21T21:53:34.467 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/ 2023-07-21T21:53:34.467 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-21T21:53:34.468 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 204329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-21T21:53:34.468 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/ 2023-07-21T21:53:34.468 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-21T21:53:34.469 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-21T21:53:34.469 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-21T21:53:34.469 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 141161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-21T21:53:34.469 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-21T21:53:34.470 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-21T21:53:34.470 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-21T21:53:34.470 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/ 2023-07-21T21:53:34.470 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-21T21:53:34.470 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-21T21:53:34.471 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dnet.ko 2023-07-21T21:53:34.471 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-21T21:53:34.471 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/ 2023-07-21T21:53:34.472 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-21T21:53:34.472 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 281329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-21T21:53:34.472 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ethoc.ko 2023-07-21T21:53:34.472 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fealnx.ko 2023-07-21T21:53:34.473 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/ 2023-07-21T21:53:34.473 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-21T21:53:34.473 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ 2023-07-21T21:53:34.473 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 90465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-21T21:53:34.474 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-21T21:53:34.474 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 295713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-21T21:53:34.474 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-21T21:53:34.474 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 584249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-21T21:53:34.474 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-21T21:53:34.474 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 246321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-21T21:53:34.475 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-21T21:53:34.475 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 923969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-21T21:53:34.475 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-21T21:53:34.475 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 298097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-21T21:53:34.475 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/ 2023-07-21T21:53:34.475 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 514889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-21T21:53:34.475 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-21T21:53:34.476 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 93593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-21T21:53:34.476 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-21T21:53:34.476 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 734297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-21T21:53:34.476 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-21T21:53:34.476 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 151841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-21T21:53:34.476 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 86921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/jme.ko 2023-07-21T21:53:34.476 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/ 2023-07-21T21:53:34.477 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-21T21:53:34.477 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-21T21:53:34.477 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 122681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-21T21:53:34.558 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/ 2023-07-21T21:53:34.558 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-21T21:53:34.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 727433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-21T21:53:34.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 280513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-21T21:53:34.559 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-21T21:53:34.559 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-21T21:53:34.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1095817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-21T21:53:34.559 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ 2023-07-21T21:53:34.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-21T21:53:34.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-21T21:53:34.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-21T21:53:34.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 95665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-21T21:53:34.560 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/ 2023-07-21T21:53:34.561 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-21T21:53:34.561 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-21T21:53:34.561 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ 2023-07-21T21:53:34.561 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-21T21:53:34.561 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-21T21:53:34.561 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/ 2023-07-21T21:53:34.562 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 150905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-21T21:53:34.562 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/ 2023-07-21T21:53:34.562 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 136785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-21T21:53:34.562 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/ 2023-07-21T21:53:34.562 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-21T21:53:34.562 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-21T21:53:34.563 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/ 2023-07-21T21:53:34.563 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-21T21:53:34.563 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 227113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-21T21:53:34.563 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 87081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-21T21:53:34.563 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-21T21:53:34.563 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 671393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-21T21:53:34.563 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/ 2023-07-21T21:53:34.564 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-21T21:53:34.564 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/ 2023-07-21T21:53:34.564 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-21T21:53:34.564 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 83921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-21T21:53:34.564 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-21T21:53:34.564 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 190089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-21T21:53:34.564 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/ 2023-07-21T21:53:34.565 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-21T21:53:34.565 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 104241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-21T21:53:34.565 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/ 2023-07-21T21:53:34.565 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 952881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-21T21:53:34.565 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/ 2023-07-21T21:53:34.565 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-21T21:53:34.566 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/ 2023-07-21T21:53:34.566 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-21T21:53:34.566 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 63273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-21T21:53:34.566 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/ 2023-07-21T21:53:34.566 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-21T21:53:34.566 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-21T21:53:34.567 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-21T21:53:34.567 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-21T21:53:34.567 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/ 2023-07-21T21:53:34.567 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-21T21:53:34.567 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-21T21:53:34.567 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-21T21:53:34.567 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-21T21:53:34.567 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 481681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-21T21:53:34.568 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/ 2023-07-21T21:53:34.568 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 103321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-21T21:53:34.568 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 166121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-21T21:53:34.568 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-21T21:53:34.568 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-21T21:53:34.568 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/ 2023-07-21T21:53:34.569 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-21T21:53:34.569 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/ 2023-07-21T21:53:34.569 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 86465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-21T21:53:34.569 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/ 2023-07-21T21:53:34.569 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-21T21:53:34.570 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 83681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-21T21:53:34.570 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/ 2023-07-21T21:53:34.570 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-21T21:53:34.570 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-21T21:53:34.570 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/ 2023-07-21T21:53:34.570 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-21T21:53:34.570 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/ 2023-07-21T21:53:34.571 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/defxx.ko 2023-07-21T21:53:34.571 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/ 2023-07-21T21:53:34.571 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 216977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-21T21:53:34.571 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 77401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/geneve.ko 2023-07-21T21:53:34.571 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/ 2023-07-21T21:53:34.571 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 235593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-21T21:53:34.571 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/ 2023-07-21T21:53:34.571 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-21T21:53:34.572 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ifb.ko 2023-07-21T21:53:34.572 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ 2023-07-21T21:53:34.572 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 83737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-21T21:53:34.572 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvlan.ko 2023-07-21T21:53:34.572 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvtap.ko 2023-07-21T21:53:34.572 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/ 2023-07-21T21:53:34.573 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-21T21:53:34.573 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-21T21:53:34.573 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-21T21:53:34.573 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-21T21:53:34.573 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio.ko 2023-07-21T21:53:34.573 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mii.ko 2023-07-21T21:53:34.574 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/netconsole.ko 2023-07-21T21:53:34.574 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/nlmon.ko 2023-07-21T21:53:34.574 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/ 2023-07-21T21:53:34.574 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-21T21:53:34.574 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-21T21:53:34.574 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ 2023-07-21T21:53:34.574 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/amd.ko 2023-07-21T21:53:34.575 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-21T21:53:34.575 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-21T21:53:34.575 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm87xx.ko 2023-07-21T21:53:34.575 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/broadcom.ko 2023-07-21T21:53:34.575 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/cicada.ko 2023-07-21T21:53:34.575 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/davicom.ko 2023-07-21T21:53:34.575 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/et1011c.ko 2023-07-21T21:53:34.576 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/icplus.ko 2023-07-21T21:53:34.576 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/lxt.ko 2023-07-21T21:53:34.576 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/marvell.ko 2023-07-21T21:53:34.576 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 75713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/micrel.ko 2023-07-21T21:53:34.576 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/national.ko 2023-07-21T21:53:34.576 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 97265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/phylink.ko 2023-07-21T21:53:34.576 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/qsemi.ko 2023-07-21T21:53:34.577 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/realtek.ko 2023-07-21T21:53:34.577 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/smsc.ko 2023-07-21T21:53:34.577 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ste10Xp.ko 2023-07-21T21:53:34.577 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/vitesse.ko 2023-07-21T21:53:34.577 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/ 2023-07-21T21:53:34.577 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/plip.ko 2023-07-21T21:53:34.577 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ 2023-07-21T21:53:34.578 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-21T21:53:34.578 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_async.ko 2023-07-21T21:53:34.578 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-21T21:53:34.578 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-21T21:53:34.578 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-21T21:53:34.578 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppoe.ko 2023-07-21T21:53:34.578 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppox.ko 2023-07-21T21:53:34.578 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pptp.ko 2023-07-21T21:53:34.579 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sb1000.ko 2023-07-21T21:53:34.579 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/ 2023-07-21T21:53:34.579 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/slip.ko 2023-07-21T21:53:34.579 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sungem_phy.ko 2023-07-21T21:53:34.579 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 64889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/tap.ko 2023-07-21T21:53:34.579 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/ 2023-07-21T21:53:34.579 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 105961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team.ko 2023-07-21T21:53:34.580 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-21T21:53:34.580 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-21T21:53:34.580 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-21T21:53:34.580 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_random.ko 2023-07-21T21:53:34.580 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-21T21:53:34.580 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 88193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/veth.ko 2023-07-21T21:53:34.581 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/ 2023-07-21T21:53:34.581 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 120497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-21T21:53:34.581 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/ 2023-07-21T21:53:34.581 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 290665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/vxlan.ko 2023-07-21T21:53:34.581 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/ 2023-07-21T21:53:34.581 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 143801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-21T21:53:34.581 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ 2023-07-21T21:53:34.581 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ntb.ko 2023-07-21T21:53:34.582 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/ 2023-07-21T21:53:34.582 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/ 2023-07-21T21:53:34.582 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 266561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme-core.ko 2023-07-21T21:53:34.582 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 101937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme.ko 2023-07-21T21:53:34.582 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/ 2023-07-21T21:53:34.582 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 133817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport.ko 2023-07-21T21:53:34.582 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_cs.ko 2023-07-21T21:53:34.583 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 84337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_pc.ko 2023-07-21T21:53:34.583 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_serial.ko 2023-07-21T21:53:34.583 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/ 2023-07-21T21:53:34.583 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/ 2023-07-21T21:53:34.583 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-21T21:53:34.584 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-21T21:53:34.584 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-21T21:53:34.584 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/pci-stub.ko 2023-07-21T21:53:34.584 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/xen-pcifront.ko 2023-07-21T21:53:34.584 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/ 2023-07-21T21:53:34.585 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/i82092.ko 2023-07-21T21:53:34.585 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 145785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia.ko 2023-07-21T21:53:34.585 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-21T21:53:34.585 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-21T21:53:34.585 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pd6729.ko 2023-07-21T21:53:34.585 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 112913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-21T21:53:34.586 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/ 2023-07-21T21:53:34.586 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/ 2023-07-21T21:53:34.586 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-21T21:53:34.586 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/ 2023-07-21T21:53:34.586 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-21T21:53:34.586 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/ 2023-07-21T21:53:34.586 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/ 2023-07-21T21:53:34.587 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-21T21:53:34.587 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/ 2023-07-21T21:53:34.587 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/ 2023-07-21T21:53:34.587 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-21T21:53:34.587 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-21T21:53:34.587 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-21T21:53:34.587 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-21T21:53:34.587 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-21T21:53:34.588 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-21T21:53:34.588 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-21T21:53:34.588 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ 2023-07-21T21:53:34.588 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-21T21:53:34.588 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acerhdf.ko 2023-07-21T21:53:34.588 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-21T21:53:34.588 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-21T21:53:34.589 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-21T21:53:34.589 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 106873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-21T21:53:34.589 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-21T21:53:34.589 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-21T21:53:34.589 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-21T21:53:34.589 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-21T21:53:34.589 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-21T21:53:34.590 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/hdaps.ko 2023-07-21T21:53:34.590 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-21T21:53:34.590 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/ 2023-07-21T21:53:34.590 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-21T21:53:34.590 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-21T21:53:34.590 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel_ips.ko 2023-07-21T21:53:34.590 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-21T21:53:34.590 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-21T21:53:34.591 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-21T21:53:34.591 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-21T21:53:34.591 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-21T21:53:34.591 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-21T21:53:34.591 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-21T21:53:34.591 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-21T21:53:34.591 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-21T21:53:34.592 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi.ko 2023-07-21T21:53:34.592 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/ 2023-07-21T21:53:34.592 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ 2023-07-21T21:53:34.592 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-21T21:53:34.592 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-21T21:53:34.592 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-21T21:53:34.592 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-21T21:53:34.592 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-21T21:53:34.593 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-21T21:53:34.593 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9030_battery.ko 2023-07-21T21:53:34.593 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9052-battery.ko 2023-07-21T21:53:34.593 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-21T21:53:34.593 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-21T21:53:34.593 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-21T21:53:34.593 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-21T21:53:34.593 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/gpio-charger.ko 2023-07-21T21:53:34.594 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-21T21:53:34.594 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-21T21:53:34.594 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max14577_charger.ko 2023-07-21T21:53:34.594 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17040_battery.ko 2023-07-21T21:53:34.594 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17042_battery.ko 2023-07-21T21:53:34.594 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8903_charger.ko 2023-07-21T21:53:34.594 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8925_power.ko 2023-07-21T21:53:34.595 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-21T21:53:34.595 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/sbs-battery.ko 2023-07-21T21:53:34.595 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/test_power.ko 2023-07-21T21:53:34.595 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-21T21:53:34.595 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-21T21:53:34.595 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_power.ko 2023-07-21T21:53:34.595 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm8350_power.ko 2023-07-21T21:53:34.595 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/ 2023-07-21T21:53:34.596 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-21T21:53:34.596 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-21T21:53:34.596 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/ 2023-07-21T21:53:34.596 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/ 2023-07-21T21:53:34.596 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-21T21:53:34.596 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-21T21:53:34.596 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps_parport.ko 2023-07-21T21:53:34.596 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/pps_core.ko 2023-07-21T21:53:34.597 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ 2023-07-21T21:53:34.597 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp.ko 2023-07-21T21:53:34.597 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp_kvm.ko 2023-07-21T21:53:34.597 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/ 2023-07-21T21:53:34.597 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-21T21:53:34.597 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-21T21:53:34.597 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-21T21:53:34.598 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-21T21:53:34.598 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9052.ko 2023-07-21T21:53:34.598 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9055.ko 2023-07-21T21:53:34.598 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9063.ko 2023-07-21T21:53:34.598 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-21T21:53:34.598 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-21T21:53:34.598 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-21T21:53:34.598 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-21T21:53:34.599 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-21T21:53:34.599 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-21T21:53:34.599 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-21T21:53:34.599 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-21T21:53:34.599 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-21T21:53:34.599 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-em3027.ko 2023-07-21T21:53:34.599 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-21T21:53:34.599 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-21T21:53:34.600 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-21T21:53:34.600 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-21T21:53:34.600 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-21T21:53:34.600 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-21T21:53:34.600 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-21T21:53:34.600 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-21T21:53:34.600 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max6900.ko 2023-07-21T21:53:34.601 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8907.ko 2023-07-21T21:53:34.601 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8925.ko 2023-07-21T21:53:34.601 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8997.ko 2023-07-21T21:53:34.601 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8998.ko 2023-07-21T21:53:34.601 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-21T21:53:34.601 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-21T21:53:34.601 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-palmas.ko 2023-07-21T21:53:34.601 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-21T21:53:34.602 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-21T21:53:34.602 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-21T21:53:34.602 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-21T21:53:34.602 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-21T21:53:34.602 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-21T21:53:34.602 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-21T21:53:34.602 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-21T21:53:34.602 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-21T21:53:34.603 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-21T21:53:34.603 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-21T21:53:34.603 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-21T21:53:34.603 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-21T21:53:34.603 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-21T21:53:34.603 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-21T21:53:34.603 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-21T21:53:34.604 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-21T21:53:34.604 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-21T21:53:34.604 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-x1205.ko 2023-07-21T21:53:34.604 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ 2023-07-21T21:53:34.604 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 77617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-9xxx.ko 2023-07-21T21:53:34.604 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-sas.ko 2023-07-21T21:53:34.604 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-xxxx.ko 2023-07-21T21:53:34.604 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 135169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/BusLogic.ko 2023-07-21T21:53:34.605 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/a100u2w.ko 2023-07-21T21:53:34.605 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/ 2023-07-21T21:53:34.605 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 272353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-21T21:53:34.605 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/advansys.ko 2023-07-21T21:53:34.605 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/ 2023-07-21T21:53:34.605 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 356265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-21T21:53:34.605 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 295801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-21T21:53:34.605 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/ 2023-07-21T21:53:34.606 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 189321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-21T21:53:34.606 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/am53c974.ko 2023-07-21T21:53:34.606 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/ 2023-07-21T21:53:34.606 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 106569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-21T21:53:34.606 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/atp870u.ko 2023-07-21T21:53:34.606 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/ 2023-07-21T21:53:34.606 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 246897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-21T21:53:34.607 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/ 2023-07-21T21:53:34.607 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1172185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/bfa.ko 2023-07-21T21:53:34.607 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/ 2023-07-21T21:53:34.607 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 237169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-21T21:53:34.607 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/ 2023-07-21T21:53:34.607 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 115393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-21T21:53:34.607 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ch.ko 2023-07-21T21:53:34.607 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/ 2023-07-21T21:53:34.608 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 308889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-21T21:53:34.608 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/ 2023-07-21T21:53:34.608 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-21T21:53:34.608 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 76193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-21T21:53:34.608 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-21T21:53:34.608 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 101449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-21T21:53:34.608 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 146785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-21T21:53:34.608 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 75529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dc395x.ko 2023-07-21T21:53:34.609 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dmx3191d.ko 2023-07-21T21:53:34.609 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/ 2023-07-21T21:53:34.609 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 212401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-21T21:53:34.609 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esp_scsi.ko 2023-07-21T21:53:34.609 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/ 2023-07-21T21:53:34.609 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-21T21:53:34.609 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 158193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-21T21:53:34.609 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fdomain.ko 2023-07-21T21:53:34.610 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/ 2023-07-21T21:53:34.610 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 261913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/fnic.ko 2023-07-21T21:53:34.610 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 201793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hpsa.ko 2023-07-21T21:53:34.610 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hptiop.ko 2023-07-21T21:53:34.610 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hv_storvsc.ko 2023-07-21T21:53:34.610 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/imm.ko 2023-07-21T21:53:34.610 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/initio.ko 2023-07-21T21:53:34.611 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 266521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ipr.ko 2023-07-21T21:53:34.611 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 101881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ips.ko 2023-07-21T21:53:34.611 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/ 2023-07-21T21:53:34.611 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 317249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/isci.ko 2023-07-21T21:53:34.611 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-21T21:53:34.611 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-21T21:53:34.611 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/ 2023-07-21T21:53:34.611 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 314961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/libfc.ko 2023-07-21T21:53:34.612 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 145569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi.ko 2023-07-21T21:53:34.612 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-21T21:53:34.612 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/ 2023-07-21T21:53:34.612 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 217209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/libsas.ko 2023-07-21T21:53:34.612 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/ 2023-07-21T21:53:34.612 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2192449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-21T21:53:34.612 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/ 2023-07-21T21:53:34.613 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-21T21:53:34.613 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-21T21:53:34.613 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 310729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-21T21:53:34.613 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 84697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid.ko 2023-07-21T21:53:34.613 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/ 2023-07-21T21:53:34.613 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 659577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-21T21:53:34.613 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/ 2023-07-21T21:53:34.613 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 119929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-21T21:53:34.614 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvumi.ko 2023-07-21T21:53:34.614 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/ 2023-07-21T21:53:34.614 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-21T21:53:34.614 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-21T21:53:34.614 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-21T21:53:34.614 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-21T21:53:34.614 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/ 2023-07-21T21:53:34.614 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 364257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-21T21:53:34.615 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 123489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pmcraid.ko 2023-07-21T21:53:34.615 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ppa.ko 2023-07-21T21:53:34.615 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla1280.ko 2023-07-21T21:53:34.615 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/ 2023-07-21T21:53:34.615 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1860025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-21T21:53:34.615 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 85313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-21T21:53:34.615 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/ 2023-07-21T21:53:34.615 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 558865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-21T21:53:34.616 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qlogicfas408.ko 2023-07-21T21:53:34.616 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/raid_class.ko 2023-07-21T21:53:34.616 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 238801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_debug.ko 2023-07-21T21:53:34.616 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 173921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-21T21:53:34.616 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 278865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-21T21:53:34.616 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 97705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-21T21:53:34.616 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-21T21:53:34.617 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-21T21:53:34.617 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ses.ko 2023-07-21T21:53:34.617 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 115849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/st.ko 2023-07-21T21:53:34.617 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/stex.ko 2023-07-21T21:53:34.617 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-21T21:53:34.617 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 162121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-21T21:53:34.617 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/virtio_scsi.ko 2023-07-21T21:53:34.617 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-21T21:53:34.618 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/wd719x.ko 2023-07-21T21:53:34.618 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/xen-scsifront.ko 2023-07-21T21:53:34.618 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ 2023-07-21T21:53:34.618 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 129417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ssb.ko 2023-07-21T21:53:34.618 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/ 2023-07-21T21:53:34.618 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/ 2023-07-21T21:53:34.618 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 739089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-21T21:53:34.618 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/ 2023-07-21T21:53:34.619 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-21T21:53:34.619 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_file.ko 2023-07-21T21:53:34.619 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_iblock.ko 2023-07-21T21:53:34.619 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 931721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_mod.ko 2023-07-21T21:53:34.619 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_pscsi.ko 2023-07-21T21:53:34.619 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 122545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_user.ko 2023-07-21T21:53:34.619 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/ 2023-07-21T21:53:34.620 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 75641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-21T21:53:34.620 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/ 2023-07-21T21:53:34.620 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/ 2023-07-21T21:53:34.620 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-21T21:53:34.620 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-21T21:53:34.620 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-21T21:53:34.620 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-21T21:53:34.620 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-21T21:53:34.621 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-21T21:53:34.621 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-21T21:53:34.621 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-21T21:53:34.621 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-21T21:53:34.621 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-21T21:53:34.621 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-21T21:53:34.621 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-21T21:53:34.621 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-21T21:53:34.622 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-21T21:53:34.622 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-21T21:53:34.622 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-21T21:53:34.622 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-21T21:53:34.622 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ 2023-07-21T21:53:34.622 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ 2023-07-21T21:53:34.622 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-21T21:53:34.623 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/moxa.ko 2023-07-21T21:53:34.623 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/mxser.ko 2023-07-21T21:53:34.623 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 107545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_gsm.ko 2023-07-21T21:53:34.623 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_hdlc.ko 2023-07-21T21:53:34.623 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/nozomi.ko 2023-07-21T21:53:34.623 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/ 2023-07-21T21:53:34.623 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/ 2023-07-21T21:53:34.623 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-21T21:53:34.624 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-21T21:53:34.624 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-21T21:53:34.624 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_uart.ko 2023-07-21T21:53:34.624 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/arc_uart.ko 2023-07-21T21:53:34.624 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-21T21:53:34.624 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/ 2023-07-21T21:53:34.624 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 103017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-21T21:53:34.625 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/rp2.ko 2023-07-21T21:53:34.625 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-21T21:53:34.625 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/synclink_gt.ko 2023-07-21T21:53:34.625 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/ 2023-07-21T21:53:34.625 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ 2023-07-21T21:53:34.625 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 536617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-21T21:53:34.625 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ 2023-07-21T21:53:34.625 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-21T21:53:34.626 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-21T21:53:34.626 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/ 2023-07-21T21:53:34.626 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio.ko 2023-07-21T21:53:34.626 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_aec.ko 2023-07-21T21:53:34.626 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_cif.ko 2023-07-21T21:53:34.626 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-21T21:53:34.626 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_mf624.ko 2023-07-21T21:53:34.626 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_netx.ko 2023-07-21T21:53:34.627 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pci_generic.ko 2023-07-21T21:53:34.627 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-21T21:53:34.627 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_sercos3.ko 2023-07-21T21:53:34.627 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/ 2023-07-21T21:53:34.627 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/ 2023-07-21T21:53:34.627 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-21T21:53:34.627 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ 2023-07-21T21:53:34.627 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 143785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-21T21:53:34.628 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-21T21:53:34.628 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-21T21:53:34.628 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-21T21:53:34.628 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/ 2023-07-21T21:53:34.628 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 85457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-acm.ko 2023-07-21T21:53:34.628 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-21T21:53:34.628 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usblp.ko 2023-07-21T21:53:34.628 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usbtmc.ko 2023-07-21T21:53:34.629 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ 2023-07-21T21:53:34.629 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ulpi.ko 2023-07-21T21:53:34.629 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/ 2023-07-21T21:53:34.629 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-21T21:53:34.629 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/ 2023-07-21T21:53:34.629 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-21T21:53:34.629 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-21T21:53:34.630 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 445801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-21T21:53:34.630 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/ 2023-07-21T21:53:34.630 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/ 2023-07-21T21:53:34.630 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-21T21:53:34.630 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-21T21:53:34.630 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-21T21:53:34.630 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-21T21:53:34.630 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-21T21:53:34.631 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-21T21:53:34.631 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 92377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-21T21:53:34.631 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-21T21:53:34.631 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 122073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-21T21:53:34.631 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-21T21:53:34.631 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-21T21:53:34.631 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-21T21:53:34.631 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-21T21:53:34.632 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 85841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-21T21:53:34.632 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-21T21:53:34.632 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-21T21:53:34.632 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-21T21:53:34.632 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/ 2023-07-21T21:53:34.632 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-21T21:53:34.632 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-21T21:53:34.633 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-21T21:53:34.633 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-21T21:53:34.633 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-21T21:53:34.633 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-21T21:53:34.633 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-21T21:53:34.633 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-21T21:53:34.633 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-21T21:53:34.633 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-21T21:53:34.634 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-21T21:53:34.634 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-21T21:53:34.634 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-21T21:53:34.634 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-21T21:53:34.634 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 161233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-21T21:53:34.634 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/ 2023-07-21T21:53:34.634 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-21T21:53:34.634 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-21T21:53:34.635 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 157665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-21T21:53:34.635 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-21T21:53:34.635 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-21T21:53:34.635 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-21T21:53:34.635 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-21T21:53:34.635 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 76033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-21T21:53:34.635 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 75057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-21T21:53:34.635 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-21T21:53:34.636 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 65793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-21T21:53:34.636 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-21T21:53:34.636 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-21T21:53:34.636 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 156033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-21T21:53:34.636 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ 2023-07-21T21:53:34.636 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-21T21:53:34.636 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-21T21:53:34.637 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 87337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-21T21:53:34.637 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-21T21:53:34.637 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-21T21:53:34.637 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811_cs.ko 2023-07-21T21:53:34.637 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-21T21:53:34.637 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-21T21:53:34.637 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/ 2023-07-21T21:53:34.637 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/mdc800.ko 2023-07-21T21:53:34.638 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/microtek.ko 2023-07-21T21:53:34.638 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ 2023-07-21T21:53:34.638 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/adutux.ko 2023-07-21T21:53:34.638 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/appledisplay.ko 2023-07-21T21:53:34.638 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-21T21:53:34.638 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cytherm.ko 2023-07-21T21:53:34.638 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ehset.ko 2023-07-21T21:53:34.638 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi26.ko 2023-07-21T21:53:34.639 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi62.ko 2023-07-21T21:53:34.639 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ezusb.ko 2023-07-21T21:53:34.639 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/idmouse.ko 2023-07-21T21:53:34.639 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/iowarrior.ko 2023-07-21T21:53:34.639 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-21T21:53:34.639 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ldusb.ko 2023-07-21T21:53:34.639 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/legousbtower.ko 2023-07-21T21:53:34.639 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/lvstest.ko 2023-07-21T21:53:34.640 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/ 2023-07-21T21:53:34.640 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 64841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-21T21:53:34.640 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-21T21:53:34.640 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usb3503.ko 2023-07-21T21:53:34.640 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usblcd.ko 2023-07-21T21:53:34.640 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-21T21:53:34.640 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbtest.ko 2023-07-21T21:53:34.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/uss720.ko 2023-07-21T21:53:34.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/yurex.ko 2023-07-21T21:53:34.641 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/ 2023-07-21T21:53:34.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/usbmon.ko 2023-07-21T21:53:34.641 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/ 2023-07-21T21:53:34.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 301521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-21T21:53:34.641 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/ 2023-07-21T21:53:34.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-generic.ko 2023-07-21T21:53:34.642 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-21T21:53:34.642 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-21T21:53:34.642 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-21T21:53:34.642 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ 2023-07-21T21:53:34.642 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/aircable.ko 2023-07-21T21:53:34.642 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ark3116.ko 2023-07-21T21:53:34.642 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-21T21:53:34.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ch341.ko 2023-07-21T21:53:34.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cp210x.ko 2023-07-21T21:53:34.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cyberjack.ko 2023-07-21T21:53:34.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-21T21:53:34.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-21T21:53:34.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/empeg.ko 2023-07-21T21:53:34.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/f81232.ko 2023-07-21T21:53:34.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 175145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-21T21:53:34.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-21T21:53:34.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 137105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-21T21:53:34.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 124673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_ti.ko 2023-07-21T21:53:34.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipaq.ko 2023-07-21T21:53:34.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipw.ko 2023-07-21T21:53:34.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ir-usb.ko 2023-07-21T21:53:34.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-21T21:53:34.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 107417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan.ko 2023-07-21T21:53:34.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-21T21:53:34.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-21T21:53:34.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-21T21:53:34.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mct_u232.ko 2023-07-21T21:53:34.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/metro-usb.ko 2023-07-21T21:53:34.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7720.ko 2023-07-21T21:53:34.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7840.ko 2023-07-21T21:53:34.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mxuport.ko 2023-07-21T21:53:34.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/navman.ko 2023-07-21T21:53:34.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/omninet.ko 2023-07-21T21:53:34.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/opticon.ko 2023-07-21T21:53:34.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 189729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/option.ko 2023-07-21T21:53:34.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/oti6858.ko 2023-07-21T21:53:34.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/pl2303.ko 2023-07-21T21:53:34.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcaux.ko 2023-07-21T21:53:34.647 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcserial.ko 2023-07-21T21:53:34.647 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/quatech2.ko 2023-07-21T21:53:34.647 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/safe_serial.ko 2023-07-21T21:53:34.647 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/sierra.ko 2023-07-21T21:53:34.647 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-21T21:53:34.647 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ssu100.ko 2023-07-21T21:53:34.647 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/symbolserial.ko 2023-07-21T21:53:34.647 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-21T21:53:34.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-21T21:53:34.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_debug.ko 2023-07-21T21:53:34.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-21T21:53:34.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usbserial.ko 2023-07-21T21:53:34.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/visor.ko 2023-07-21T21:53:34.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/whiteheat.ko 2023-07-21T21:53:34.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-21T21:53:34.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-21T21:53:34.649 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ 2023-07-21T21:53:34.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/uas.ko 2023-07-21T21:53:34.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-21T21:53:34.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-21T21:53:34.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-21T21:53:34.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-21T21:53:34.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-21T21:53:34.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-21T21:53:34.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-21T21:53:34.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-karma.ko 2023-07-21T21:53:34.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-21T21:53:34.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-21T21:53:34.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-21T21:53:34.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-21T21:53:34.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-21T21:53:34.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 180017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/usb-storage.ko 2023-07-21T21:53:34.651 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/ 2023-07-21T21:53:34.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-21T21:53:34.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-21T21:53:34.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 105401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-21T21:53:34.651 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/ 2023-07-21T21:53:34.651 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/ 2023-07-21T21:53:34.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 153697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-21T21:53:34.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-21T21:53:34.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio.ko 2023-07-21T21:53:34.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 75137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-21T21:53:34.652 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/ 2023-07-21T21:53:34.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 113889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost.ko 2023-07-21T21:53:34.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-21T21:53:34.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_net.ko 2023-07-21T21:53:34.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 86521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_scsi.ko 2023-07-21T21:53:34.653 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/ 2023-07-21T21:53:34.653 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/ 2023-07-21T21:53:34.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-21T21:53:34.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-21T21:53:34.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-21T21:53:34.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-21T21:53:34.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-21T21:53:34.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/apple_bl.ko 2023-07-21T21:53:34.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-21T21:53:34.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/bd6107.ko 2023-07-21T21:53:34.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-21T21:53:34.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-21T21:53:34.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-21T21:53:34.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-21T21:53:34.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lcd.ko 2023-07-21T21:53:34.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-21T21:53:34.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-21T21:53:34.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-21T21:53:34.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-21T21:53:34.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-21T21:53:34.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-21T21:53:34.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-21T21:53:34.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-21T21:53:34.656 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/ 2023-07-21T21:53:34.656 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ 2023-07-21T21:53:34.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2482.ko 2023-07-21T21:53:34.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2490.ko 2023-07-21T21:53:34.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-21T21:53:34.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-21T21:53:34.656 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/ 2023-07-21T21:53:34.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-21T21:53:34.657 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-21T21:53:34.657 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-21T21:53:34.657 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-21T21:53:34.657 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-21T21:53:34.657 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-21T21:53:34.657 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-21T21:53:34.657 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-21T21:53:34.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-21T21:53:34.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-21T21:53:34.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-21T21:53:34.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/wire.ko 2023-07-21T21:53:34.658 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ 2023-07-21T21:53:34.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/acquirewdt.ko 2023-07-21T21:53:34.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/advantechwdt.ko 2023-07-21T21:53:34.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-21T21:53:34.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-21T21:53:34.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-21T21:53:34.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-21T21:53:34.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-21T21:53:34.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-21T21:53:34.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/dw_wdt.ko 2023-07-21T21:53:34.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-21T21:53:34.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-21T21:53:34.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/hpwdt.ko 2023-07-21T21:53:34.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/i6300esb.ko 2023-07-21T21:53:34.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-21T21:53:34.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-21T21:53:34.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ib700wdt.ko 2023-07-21T21:53:34.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ibmasr.ko 2023-07-21T21:53:34.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-21T21:53:34.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-21T21:53:34.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it87_wdt.ko 2023-07-21T21:53:34.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-21T21:53:34.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/machzwd.ko 2023-07-21T21:53:34.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-21T21:53:34.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-21T21:53:34.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/nv_tco.ko 2023-07-21T21:53:34.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-21T21:53:34.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-21T21:53:34.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-21T21:53:34.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-21T21:53:34.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/retu_wdt.ko 2023-07-21T21:53:34.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-21T21:53:34.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-21T21:53:34.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-21T21:53:34.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-21T21:53:34.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-21T21:53:34.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-21T21:53:34.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/softdog.ko 2023-07-21T21:53:34.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-21T21:53:34.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-21T21:53:34.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/via_wdt.ko 2023-07-21T21:53:34.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-21T21:53:34.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-21T21:53:34.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-21T21:53:34.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-21T21:53:34.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wdt_pci.ko 2023-07-21T21:53:34.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-21T21:53:34.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-21T21:53:34.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/xen_wdt.ko 2023-07-21T21:53:34.664 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/ 2023-07-21T21:53:34.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-evtchn.ko 2023-07-21T21:53:34.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntalloc.ko 2023-07-21T21:53:34.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntdev.ko 2023-07-21T21:53:34.665 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/ 2023-07-21T21:53:34.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 176417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-21T21:53:34.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-privcmd.ko 2023-07-21T21:53:34.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-scsiback.ko 2023-07-21T21:53:34.665 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/ 2023-07-21T21:53:34.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-21T21:53:34.666 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ 2023-07-21T21:53:34.666 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/ 2023-07-21T21:53:34.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 165697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/9p.ko 2023-07-21T21:53:34.666 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/ 2023-07-21T21:53:34.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/adfs.ko 2023-07-21T21:53:34.666 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/ 2023-07-21T21:53:34.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 162617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/affs.ko 2023-07-21T21:53:34.667 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/ 2023-07-21T21:53:34.667 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 931937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/kafs.ko 2023-07-21T21:53:34.667 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/ 2023-07-21T21:53:34.667 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/autofs4.ko 2023-07-21T21:53:34.667 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/ 2023-07-21T21:53:34.667 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 64481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/befs.ko 2023-07-21T21:53:34.667 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/ 2023-07-21T21:53:34.668 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/bfs.ko 2023-07-21T21:53:34.668 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/binfmt_misc.ko 2023-07-21T21:53:34.668 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/ 2023-07-21T21:53:34.668 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 3468681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/btrfs.ko 2023-07-21T21:53:34.668 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/ 2023-07-21T21:53:34.669 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 305745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/cachefiles.ko 2023-07-21T21:53:34.669 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ 2023-07-21T21:53:34.669 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1312545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ceph.ko 2023-07-21T21:53:34.669 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/ 2023-07-21T21:53:34.669 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/coda.ko 2023-07-21T21:53:34.669 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/ 2023-07-21T21:53:34.669 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/configfs.ko 2023-07-21T21:53:34.669 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/ 2023-07-21T21:53:34.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/cramfs.ko 2023-07-21T21:53:34.670 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/ 2023-07-21T21:53:34.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 633825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/dlm.ko 2023-07-21T21:53:34.670 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/ 2023-07-21T21:53:34.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/efs.ko 2023-07-21T21:53:34.670 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/ 2023-07-21T21:53:34.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1500513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/f2fs.ko 2023-07-21T21:53:34.670 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/ 2023-07-21T21:53:34.671 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/msdos.ko 2023-07-21T21:53:34.671 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/ 2023-07-21T21:53:34.671 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/freevxfs.ko 2023-07-21T21:53:34.671 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/ 2023-07-21T21:53:34.671 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 226505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/fscache.ko 2023-07-21T21:53:34.671 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/ 2023-07-21T21:53:34.671 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/cuse.ko 2023-07-21T21:53:34.672 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/ 2023-07-21T21:53:34.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1226249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/gfs2.ko 2023-07-21T21:53:34.672 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/ 2023-07-21T21:53:34.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 141241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/hfs.ko 2023-07-21T21:53:34.672 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/ 2023-07-21T21:53:34.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 221553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/hfsplus.ko 2023-07-21T21:53:34.672 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/ 2023-07-21T21:53:34.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 193577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/hpfs.ko 2023-07-21T21:53:34.673 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/ 2023-07-21T21:53:34.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 74393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/isofs.ko 2023-07-21T21:53:34.673 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/ 2023-07-21T21:53:34.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 420745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/jfs.ko 2023-07-21T21:53:34.673 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/ 2023-07-21T21:53:34.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 279041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/lockd.ko 2023-07-21T21:53:34.673 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/ 2023-07-21T21:53:34.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 87897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/minix.ko 2023-07-21T21:53:34.674 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/ 2023-07-21T21:53:34.674 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 124697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/netfs.ko 2023-07-21T21:53:34.674 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/ 2023-07-21T21:53:34.674 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/ 2023-07-21T21:53:34.674 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-21T21:53:34.674 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/ 2023-07-21T21:53:34.674 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-21T21:53:34.675 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/ 2023-07-21T21:53:34.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 117705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-21T21:53:34.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1053889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfs.ko 2023-07-21T21:53:34.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv2.ko 2023-07-21T21:53:34.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 119801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv3.ko 2023-07-21T21:53:34.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2041809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv4.ko 2023-07-21T21:53:34.675 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/ 2023-07-21T21:53:34.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/grace.ko 2023-07-21T21:53:34.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/nfs_acl.ko 2023-07-21T21:53:34.676 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/ 2023-07-21T21:53:34.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1504993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/nfsd.ko 2023-07-21T21:53:34.676 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/ 2023-07-21T21:53:34.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 591417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/nilfs2.ko 2023-07-21T21:53:34.676 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/ 2023-07-21T21:53:34.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-celtic.ko 2023-07-21T21:53:34.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-centeuro.ko 2023-07-21T21:53:34.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-croatian.ko 2023-07-21T21:53:34.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-cyrillic.ko 2023-07-21T21:53:34.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-gaelic.ko 2023-07-21T21:53:34.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-greek.ko 2023-07-21T21:53:34.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-iceland.ko 2023-07-21T21:53:34.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-inuit.ko 2023-07-21T21:53:34.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-roman.ko 2023-07-21T21:53:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-romanian.ko 2023-07-21T21:53:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-turkish.ko 2023-07-21T21:53:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_ascii.ko 2023-07-21T21:53:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1250.ko 2023-07-21T21:53:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1251.ko 2023-07-21T21:53:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1255.ko 2023-07-21T21:53:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp737.ko 2023-07-21T21:53:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp775.ko 2023-07-21T21:53:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp850.ko 2023-07-21T21:53:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp852.ko 2023-07-21T21:53:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp855.ko 2023-07-21T21:53:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp857.ko 2023-07-21T21:53:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp860.ko 2023-07-21T21:53:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp861.ko 2023-07-21T21:53:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp862.ko 2023-07-21T21:53:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp863.ko 2023-07-21T21:53:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp864.ko 2023-07-21T21:53:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp865.ko 2023-07-21T21:53:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp866.ko 2023-07-21T21:53:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp869.ko 2023-07-21T21:53:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp874.ko 2023-07-21T21:53:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 94137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp932.ko 2023-07-21T21:53:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 142673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp936.ko 2023-07-21T21:53:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 165745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp949.ko 2023-07-21T21:53:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 118121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp950.ko 2023-07-21T21:53:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_euc-jp.ko 2023-07-21T21:53:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-1.ko 2023-07-21T21:53:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-13.ko 2023-07-21T21:53:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-14.ko 2023-07-21T21:53:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-15.ko 2023-07-21T21:53:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-2.ko 2023-07-21T21:53:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-3.ko 2023-07-21T21:53:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-4.ko 2023-07-21T21:53:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-5.ko 2023-07-21T21:53:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-6.ko 2023-07-21T21:53:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-7.ko 2023-07-21T21:53:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-9.ko 2023-07-21T21:53:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-r.ko 2023-07-21T21:53:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-ru.ko 2023-07-21T21:53:34.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-u.ko 2023-07-21T21:53:34.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_utf8.ko 2023-07-21T21:53:34.683 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ 2023-07-21T21:53:34.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 219073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ntfs.ko 2023-07-21T21:53:34.683 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ 2023-07-21T21:53:34.683 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ 2023-07-21T21:53:34.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 244177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-21T21:53:34.683 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ 2023-07-21T21:53:34.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 440785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-21T21:53:34.684 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ 2023-07-21T21:53:34.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-21T21:53:34.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2589569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2.ko 2023-07-21T21:53:34.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-21T21:53:34.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-21T21:53:34.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-21T21:53:34.685 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/ 2023-07-21T21:53:34.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/omfs.ko 2023-07-21T21:53:34.685 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/ 2023-07-21T21:53:34.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 336473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/overlay.ko 2023-07-21T21:53:34.685 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ 2023-07-21T21:53:34.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ramoops.ko 2023-07-21T21:53:34.685 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/ 2023-07-21T21:53:34.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/qnx4.ko 2023-07-21T21:53:34.686 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/ 2023-07-21T21:53:34.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/qnx6.ko 2023-07-21T21:53:34.686 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/ 2023-07-21T21:53:34.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_tree.ko 2023-07-21T21:53:34.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v1.ko 2023-07-21T21:53:34.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v2.ko 2023-07-21T21:53:34.686 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/ 2023-07-21T21:53:34.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 530697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/reiserfs.ko 2023-07-21T21:53:34.687 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/ 2023-07-21T21:53:34.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/romfs.ko 2023-07-21T21:53:34.687 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/ 2023-07-21T21:53:34.687 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/ 2023-07-21T21:53:34.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2658777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/cifs.ko 2023-07-21T21:53:34.687 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/ 2023-07-21T21:53:34.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_arc4.ko 2023-07-21T21:53:34.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_md4.ko 2023-07-21T21:53:34.688 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/ 2023-07-21T21:53:34.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 134313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/squashfs.ko 2023-07-21T21:53:34.688 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/ 2023-07-21T21:53:34.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/sysv.ko 2023-07-21T21:53:34.688 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/ 2023-07-21T21:53:34.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 248049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/udf.ko 2023-07-21T21:53:34.688 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ 2023-07-21T21:53:34.689 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 160857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ufs.ko 2023-07-21T21:53:34.689 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/ 2023-07-21T21:53:34.689 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 3998129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/xfs.ko 2023-07-21T21:53:34.689 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/ 2023-07-21T21:53:34.689 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/ 2023-07-21T21:53:34.689 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 74865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/locktorture.ko 2023-07-21T21:53:34.689 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/ 2023-07-21T21:53:34.689 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/test_udelay.ko 2023-07-21T21:53:34.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/torture.ko 2023-07-21T21:53:34.690 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ 2023-07-21T21:53:34.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc-itu-t.ko 2023-07-21T21:53:34.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc7.ko 2023-07-21T21:53:34.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc8.ko 2023-07-21T21:53:34.690 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/ 2023-07-21T21:53:34.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libarc4.ko 2023-07-21T21:53:34.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libdes.ko 2023-07-21T21:53:34.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/interval_tree_test.ko 2023-07-21T21:53:34.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/libcrc32c.ko 2023-07-21T21:53:34.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lru_cache.ko 2023-07-21T21:53:34.691 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/ 2023-07-21T21:53:34.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4_compress.ko 2023-07-21T21:53:34.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4hc_compress.ko 2023-07-21T21:53:34.691 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/ 2023-07-21T21:53:34.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/cordic.ko 2023-07-21T21:53:34.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/memory-notifier-error-inject.ko 2023-07-21T21:53:34.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/notifier-error-inject.ko 2023-07-21T21:53:34.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/percpu_test.ko 2023-07-21T21:53:34.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/pm-notifier-error-inject.ko 2023-07-21T21:53:34.692 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/ 2023-07-21T21:53:34.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 143433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/raid6_pq.ko 2023-07-21T21:53:34.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/rbtree_test.ko 2023-07-21T21:53:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/ 2023-07-21T21:53:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-21T21:53:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-kstrtox.ko 2023-07-21T21:53:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-string_helpers.ko 2023-07-21T21:53:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 4760825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_bpf.ko 2023-07-21T21:53:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_firmware.ko 2023-07-21T21:53:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_module.ko 2023-07-21T21:53:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_user_copy.ko 2023-07-21T21:53:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_bm.ko 2023-07-21T21:53:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_fsm.ko 2023-07-21T21:53:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_kmp.ko 2023-07-21T21:53:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/ 2023-07-21T21:53:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/xz_dec_test.ko 2023-07-21T21:53:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/ 2023-07-21T21:53:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/hwpoison-inject.ko 2023-07-21T21:53:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ 2023-07-21T21:53:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/ 2023-07-21T21:53:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/6lowpan.ko 2023-07-21T21:53:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_dest.ko 2023-07-21T21:53:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_fragment.ko 2023-07-21T21:53:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_hop.ko 2023-07-21T21:53:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-21T21:53:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_mobility.ko 2023-07-21T21:53:34.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_routing.ko 2023-07-21T21:53:34.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_udp.ko 2023-07-21T21:53:34.696 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/ 2023-07-21T21:53:34.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/garp.ko 2023-07-21T21:53:34.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/mrp.ko 2023-07-21T21:53:34.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/p8022.ko 2023-07-21T21:53:34.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/psnap.ko 2023-07-21T21:53:34.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/stp.ko 2023-07-21T21:53:34.697 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/ 2023-07-21T21:53:34.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/8021q.ko 2023-07-21T21:53:34.697 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/ 2023-07-21T21:53:34.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 198417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet.ko 2023-07-21T21:53:34.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_fd.ko 2023-07-21T21:53:34.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_rdma.ko 2023-07-21T21:53:34.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_virtio.ko 2023-07-21T21:53:34.698 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/ 2023-07-21T21:53:34.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 652553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/batman-adv.ko 2023-07-21T21:53:34.698 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/ 2023-07-21T21:53:34.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 63825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/br_netfilter.ko 2023-07-21T21:53:34.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 772505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/bridge.ko 2023-07-21T21:53:34.698 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ 2023-07-21T21:53:34.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-21T21:53:34.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-21T21:53:34.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-21T21:53:34.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-21T21:53:34.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-21T21:53:34.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-21T21:53:34.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-21T21:53:34.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-21T21:53:34.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-21T21:53:34.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-21T21:53:34.700 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-21T21:53:34.700 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-21T21:53:34.700 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-21T21:53:34.700 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-21T21:53:34.700 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-21T21:53:34.700 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-21T21:53:34.700 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-21T21:53:34.700 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-21T21:53:34.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-21T21:53:34.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-21T21:53:34.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtables.ko 2023-07-21T21:53:34.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-21T21:53:34.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-21T21:53:34.701 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/ 2023-07-21T21:53:34.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1046417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/libceph.ko 2023-07-21T21:53:34.702 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/ 2023-07-21T21:53:34.702 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 124793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/pktgen.ko 2023-07-21T21:53:34.702 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/ 2023-07-21T21:53:34.702 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 194321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp.ko 2023-07-21T21:53:34.702 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_diag.ko 2023-07-21T21:53:34.702 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv4.ko 2023-07-21T21:53:34.702 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv6.ko 2023-07-21T21:53:34.702 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/ 2023-07-21T21:53:34.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 390297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/dsa_core.ko 2023-07-21T21:53:34.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_brcm.ko 2023-07-21T21:53:34.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_dsa.ko 2023-07-21T21:53:34.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_none.ko 2023-07-21T21:53:34.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_trailer.ko 2023-07-21T21:53:34.703 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/ 2023-07-21T21:53:34.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/hsr.ko 2023-07-21T21:53:34.703 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ 2023-07-21T21:53:34.704 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ 2023-07-21T21:53:34.704 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-21T21:53:34.704 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 254601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154.ko 2023-07-21T21:53:34.704 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-21T21:53:34.704 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ 2023-07-21T21:53:34.704 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ah4.ko 2023-07-21T21:53:34.704 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/esp4.ko 2023-07-21T21:53:34.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/fou.ko 2023-07-21T21:53:34.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/gre.ko 2023-07-21T21:53:34.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/inet_diag.ko 2023-07-21T21:53:34.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_gre.ko 2023-07-21T21:53:34.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_tunnel.ko 2023-07-21T21:53:34.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_vti.ko 2023-07-21T21:53:34.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipcomp.ko 2023-07-21T21:53:34.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipip.ko 2023-07-21T21:53:34.706 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ 2023-07-21T21:53:34.706 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-21T21:53:34.706 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-21T21:53:34.706 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-21T21:53:34.706 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-21T21:53:34.706 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-21T21:53:34.706 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-21T21:53:34.706 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-21T21:53:34.707 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-21T21:53:34.707 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-21T21:53:34.707 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-21T21:53:34.707 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-21T21:53:34.707 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-21T21:53:34.707 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-21T21:53:34.707 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-21T21:53:34.708 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-21T21:53:34.708 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-21T21:53:34.708 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-21T21:53:34.708 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-21T21:53:34.708 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-21T21:53:34.708 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-21T21:53:34.708 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-21T21:53:34.708 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-21T21:53:34.709 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-21T21:53:34.709 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-21T21:53:34.709 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-21T21:53:34.709 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_bic.ko 2023-07-21T21:53:34.709 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_dctcp.ko 2023-07-21T21:53:34.709 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_diag.ko 2023-07-21T21:53:34.709 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_highspeed.ko 2023-07-21T21:53:34.709 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_htcp.ko 2023-07-21T21:53:34.710 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_hybla.ko 2023-07-21T21:53:34.710 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_illinois.ko 2023-07-21T21:53:34.710 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_lp.ko 2023-07-21T21:53:34.710 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_scalable.ko 2023-07-21T21:53:34.710 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_vegas.ko 2023-07-21T21:53:34.710 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_veno.ko 2023-07-21T21:53:34.710 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_westwood.ko 2023-07-21T21:53:34.710 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_yeah.ko 2023-07-21T21:53:34.711 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tunnel4.ko 2023-07-21T21:53:34.711 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_diag.ko 2023-07-21T21:53:34.711 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_tunnel.ko 2023-07-21T21:53:34.711 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-21T21:53:34.711 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ 2023-07-21T21:53:34.711 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ah6.ko 2023-07-21T21:53:34.711 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/esp6.ko 2023-07-21T21:53:34.712 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/fou6.ko 2023-07-21T21:53:34.712 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_gre.ko 2023-07-21T21:53:34.712 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 92817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_tunnel.ko 2023-07-21T21:53:34.712 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-21T21:53:34.712 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_vti.ko 2023-07-21T21:53:34.712 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ipcomp6.ko 2023-07-21T21:53:34.712 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/mip6.ko 2023-07-21T21:53:34.712 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ 2023-07-21T21:53:34.713 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-21T21:53:34.713 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-21T21:53:34.713 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-21T21:53:34.713 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-21T21:53:34.713 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-21T21:53:34.713 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-21T21:53:34.713 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-21T21:53:34.714 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-21T21:53:34.714 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-21T21:53:34.714 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-21T21:53:34.714 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-21T21:53:34.714 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-21T21:53:34.714 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-21T21:53:34.714 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-21T21:53:34.714 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-21T21:53:34.715 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-21T21:53:34.715 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-21T21:53:34.715 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-21T21:53:34.715 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-21T21:53:34.715 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-21T21:53:34.715 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-21T21:53:34.715 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-21T21:53:34.716 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-21T21:53:34.716 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-21T21:53:34.716 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-21T21:53:34.716 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/sit.ko 2023-07-21T21:53:34.716 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/tunnel6.ko 2023-07-21T21:53:34.716 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-21T21:53:34.716 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/ 2023-07-21T21:53:34.716 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 82929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/af_key.ko 2023-07-21T21:53:34.717 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/ 2023-07-21T21:53:34.717 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_core.ko 2023-07-21T21:53:34.717 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-21T21:53:34.717 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_eth.ko 2023-07-21T21:53:34.717 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip.ko 2023-07-21T21:53:34.717 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip6.ko 2023-07-21T21:53:34.717 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_netlink.ko 2023-07-21T21:53:34.717 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ppp.ko 2023-07-21T21:53:34.718 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/ 2023-07-21T21:53:34.718 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/lapb.ko 2023-07-21T21:53:34.718 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/ 2023-07-21T21:53:34.718 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc.ko 2023-07-21T21:53:34.718 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 267017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc2.ko 2023-07-21T21:53:34.718 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/ 2023-07-21T21:53:34.718 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 291041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/mac802154.ko 2023-07-21T21:53:34.718 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/ 2023-07-21T21:53:34.719 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/mpls_gso.ko 2023-07-21T21:53:34.719 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ 2023-07-21T21:53:34.719 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ 2023-07-21T21:53:34.719 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 119649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set.ko 2023-07-21T21:53:34.719 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-21T21:53:34.719 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-21T21:53:34.719 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-21T21:53:34.720 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-21T21:53:34.720 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 103121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-21T21:53:34.720 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 104593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-21T21:53:34.720 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 105129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-21T21:53:34.720 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 114393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-21T21:53:34.720 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-21T21:53:34.720 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 111161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-21T21:53:34.720 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 114673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-21T21:53:34.721 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 114329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-21T21:53:34.721 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 113217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-21T21:53:34.721 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 116217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-21T21:53:34.721 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-21T21:53:34.721 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ 2023-07-21T21:53:34.721 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 412481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-21T21:53:34.721 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-21T21:53:34.721 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-21T21:53:34.722 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-21T21:53:34.722 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-21T21:53:34.722 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-21T21:53:34.722 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-21T21:53:34.722 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-21T21:53:34.722 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-21T21:53:34.722 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-21T21:53:34.723 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-21T21:53:34.723 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-21T21:53:34.723 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-21T21:53:34.723 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-21T21:53:34.723 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conncount.ko 2023-07-21T21:53:34.723 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 408689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack.ko 2023-07-21T21:53:34.723 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-21T21:53:34.723 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-21T21:53:34.724 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-21T21:53:34.724 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 118145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-21T21:53:34.724 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-21T21:53:34.724 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-21T21:53:34.724 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-21T21:53:34.724 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-21T21:53:34.724 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-21T21:53:34.724 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-21T21:53:34.725 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-21T21:53:34.725 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-21T21:53:34.725 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-21T21:53:34.725 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 88513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table.ko 2023-07-21T21:53:34.725 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-21T21:53:34.725 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_log_syslog.ko 2023-07-21T21:53:34.725 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 95353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat.ko 2023-07-21T21:53:34.726 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-21T21:53:34.726 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-21T21:53:34.726 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_irc.ko 2023-07-21T21:53:34.726 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_sip.ko 2023-07-21T21:53:34.726 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-21T21:53:34.726 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-21T21:53:34.726 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 592185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_tables.ko 2023-07-21T21:53:34.726 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink.ko 2023-07-21T21:53:34.727 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-21T21:53:34.727 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-21T21:53:34.727 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_log.ko 2023-07-21T21:53:34.727 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-21T21:53:34.727 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-21T21:53:34.727 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_chain_nat.ko 2023-07-21T21:53:34.727 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_compat.ko 2023-07-21T21:53:34.727 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_ct.ko 2023-07-21T21:53:34.728 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-21T21:53:34.728 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fib.ko 2023-07-21T21:53:34.728 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-21T21:53:34.728 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_hash.ko 2023-07-21T21:53:34.728 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_limit.ko 2023-07-21T21:53:34.728 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_log.ko 2023-07-21T21:53:34.728 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_masq.ko 2023-07-21T21:53:34.729 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_nat.ko 2023-07-21T21:53:34.729 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_numgen.ko 2023-07-21T21:53:34.729 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_osf.ko 2023-07-21T21:53:34.729 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_queue.ko 2023-07-21T21:53:34.729 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_redir.ko 2023-07-21T21:53:34.729 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject.ko 2023-07-21T21:53:34.729 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject_inet.ko 2023-07-21T21:53:34.729 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_socket.ko 2023-07-21T21:53:34.730 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_synproxy.ko 2023-07-21T21:53:34.730 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_tproxy.ko 2023-07-21T21:53:34.730 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/x_tables.ko 2023-07-21T21:53:34.730 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_AUDIT.ko 2023-07-21T21:53:34.730 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-21T21:53:34.730 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-21T21:53:34.730 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-21T21:53:34.730 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CT.ko 2023-07-21T21:53:34.731 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_DSCP.ko 2023-07-21T21:53:34.731 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HL.ko 2023-07-21T21:53:34.731 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HMARK.ko 2023-07-21T21:53:34.731 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-21T21:53:34.731 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LED.ko 2023-07-21T21:53:34.731 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LOG.ko 2023-07-21T21:53:34.731 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-21T21:53:34.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NETMAP.ko 2023-07-21T21:53:34.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFLOG.ko 2023-07-21T21:53:34.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-21T21:53:34.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_RATEEST.ko 2023-07-21T21:53:34.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-21T21:53:34.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_SECMARK.ko 2023-07-21T21:53:34.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-21T21:53:34.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-21T21:53:34.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TEE.ko 2023-07-21T21:53:34.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TPROXY.ko 2023-07-21T21:53:34.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TRACE.ko 2023-07-21T21:53:34.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_addrtype.ko 2023-07-21T21:53:34.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_bpf.ko 2023-07-21T21:53:34.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cgroup.ko 2023-07-21T21:53:34.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cluster.ko 2023-07-21T21:53:34.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_comment.ko 2023-07-21T21:53:34.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connbytes.ko 2023-07-21T21:53:34.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlabel.ko 2023-07-21T21:53:34.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlimit.ko 2023-07-21T21:53:34.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connmark.ko 2023-07-21T21:53:34.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_conntrack.ko 2023-07-21T21:53:34.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cpu.ko 2023-07-21T21:53:34.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dccp.ko 2023-07-21T21:53:34.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_devgroup.ko 2023-07-21T21:53:34.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dscp.ko 2023-07-21T21:53:34.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ecn.ko 2023-07-21T21:53:34.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_esp.ko 2023-07-21T21:53:34.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hashlimit.ko 2023-07-21T21:53:34.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_helper.ko 2023-07-21T21:53:34.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hl.ko 2023-07-21T21:53:34.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipcomp.ko 2023-07-21T21:53:34.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_iprange.ko 2023-07-21T21:53:34.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipvs.ko 2023-07-21T21:53:34.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_l2tp.ko 2023-07-21T21:53:34.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_length.ko 2023-07-21T21:53:34.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_limit.ko 2023-07-21T21:53:34.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mac.ko 2023-07-21T21:53:34.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mark.ko 2023-07-21T21:53:34.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_multiport.ko 2023-07-21T21:53:34.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nat.ko 2023-07-21T21:53:34.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nfacct.ko 2023-07-21T21:53:34.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_osf.ko 2023-07-21T21:53:34.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_owner.ko 2023-07-21T21:53:34.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_physdev.ko 2023-07-21T21:53:34.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_pkttype.ko 2023-07-21T21:53:34.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_policy.ko 2023-07-21T21:53:34.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_quota.ko 2023-07-21T21:53:34.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_rateest.ko 2023-07-21T21:53:34.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_realm.ko 2023-07-21T21:53:34.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_recent.ko 2023-07-21T21:53:34.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_sctp.ko 2023-07-21T21:53:34.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_set.ko 2023-07-21T21:53:34.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_socket.ko 2023-07-21T21:53:34.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_state.ko 2023-07-21T21:53:34.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_statistic.ko 2023-07-21T21:53:34.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_string.ko 2023-07-21T21:53:34.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpmss.ko 2023-07-21T21:53:34.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpudp.ko 2023-07-21T21:53:34.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_time.ko 2023-07-21T21:53:34.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_u32.ko 2023-07-21T21:53:34.740 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/ 2023-07-21T21:53:34.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/netlink_diag.ko 2023-07-21T21:53:34.740 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/ 2023-07-21T21:53:34.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/nsh.ko 2023-07-21T21:53:34.740 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/ 2023-07-21T21:53:34.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 379545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/openvswitch.ko 2023-07-21T21:53:34.741 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-geneve.ko 2023-07-21T21:53:34.741 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-gre.ko 2023-07-21T21:53:34.741 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-vxlan.ko 2023-07-21T21:53:34.741 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/ 2023-07-21T21:53:34.741 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/af_packet_diag.ko 2023-07-21T21:53:34.741 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/ 2023-07-21T21:53:34.741 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 109961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/phonet.ko 2023-07-21T21:53:34.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/pn_pep.ko 2023-07-21T21:53:34.742 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/ 2023-07-21T21:53:34.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 252825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds.ko 2023-07-21T21:53:34.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 165081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_rdma.ko 2023-07-21T21:53:34.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_tcp.ko 2023-07-21T21:53:34.742 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/ 2023-07-21T21:53:34.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 820137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/rxrpc.ko 2023-07-21T21:53:34.742 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/ 2023-07-21T21:53:34.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_csum.ko 2023-07-21T21:53:34.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_gact.ko 2023-07-21T21:53:34.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_ipt.ko 2023-07-21T21:53:34.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_mirred.ko 2023-07-21T21:53:34.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_nat.ko 2023-07-21T21:53:34.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_pedit.ko 2023-07-21T21:53:34.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_police.ko 2023-07-21T21:53:34.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_simple.ko 2023-07-21T21:53:34.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_skbedit.ko 2023-07-21T21:53:34.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_vlan.ko 2023-07-21T21:53:34.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_basic.ko 2023-07-21T21:53:34.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_bpf.ko 2023-07-21T21:53:34.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_cgroup.ko 2023-07-21T21:53:34.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_flow.ko 2023-07-21T21:53:34.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_fw.ko 2023-07-21T21:53:34.745 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_route.ko 2023-07-21T21:53:34.745 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_u32.ko 2023-07-21T21:53:34.745 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_cmp.ko 2023-07-21T21:53:34.745 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_ipset.ko 2023-07-21T21:53:34.745 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_meta.ko 2023-07-21T21:53:34.745 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_nbyte.ko 2023-07-21T21:53:34.745 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_text.ko 2023-07-21T21:53:34.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_u32.ko 2023-07-21T21:53:34.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_choke.ko 2023-07-21T21:53:34.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_codel.ko 2023-07-21T21:53:34.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_drr.ko 2023-07-21T21:53:34.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq.ko 2023-07-21T21:53:34.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq_codel.ko 2023-07-21T21:53:34.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_gred.ko 2023-07-21T21:53:34.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hfsc.ko 2023-07-21T21:53:34.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hhf.ko 2023-07-21T21:53:34.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 65793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_htb.ko 2023-07-21T21:53:34.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_ingress.ko 2023-07-21T21:53:34.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio.ko 2023-07-21T21:53:34.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio_lib.ko 2023-07-21T21:53:34.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_multiq.ko 2023-07-21T21:53:34.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_netem.ko 2023-07-21T21:53:34.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_pie.ko 2023-07-21T21:53:34.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_plug.ko 2023-07-21T21:53:34.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_prio.ko 2023-07-21T21:53:34.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_qfq.ko 2023-07-21T21:53:34.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_red.ko 2023-07-21T21:53:34.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfb.ko 2023-07-21T21:53:34.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfq.ko 2023-07-21T21:53:34.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_tbf.ko 2023-07-21T21:53:34.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_teql.ko 2023-07-21T21:53:34.749 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/ 2023-07-21T21:53:34.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 930369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp.ko 2023-07-21T21:53:34.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp_diag.ko 2023-07-21T21:53:34.749 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/ 2023-07-21T21:53:34.749 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/ 2023-07-21T21:53:34.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 335569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-21T21:53:34.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-21T21:53:34.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1514649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/sunrpc.ko 2023-07-21T21:53:34.750 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/ 2023-07-21T21:53:34.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 707401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-21T21:53:34.750 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/ 2023-07-21T21:53:34.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/diag.ko 2023-07-21T21:53:34.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 862233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/tipc.ko 2023-07-21T21:53:34.751 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/ 2023-07-21T21:53:34.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/unix_diag.ko 2023-07-21T21:53:34.751 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/ 2023-07-21T21:53:34.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 84841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-21T21:53:34.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-21T21:53:34.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 95985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock.ko 2023-07-21T21:53:34.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-21T21:53:34.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-21T21:53:34.752 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/ 2023-07-21T21:53:34.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/x25.ko 2023-07-21T21:53:34.752 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/ 2023-07-21T21:53:34.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_algo.ko 2023-07-21T21:53:34.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-21T21:53:34.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_user.ko 2023-07-21T21:53:34.753 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/ 2023-07-21T21:53:34.753 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/ 2023-07-21T21:53:34.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/irqbypass.ko 2023-07-21T21:53:34.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 638200 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias 2023-07-21T21:53:34.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 623896 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias.bin 2023-07-21T21:53:34.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7656 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin 2023-07-21T21:53:34.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.alias.bin 2023-07-21T21:53:34.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9821 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.bin 2023-07-21T21:53:34.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69903 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.modinfo 2023-07-21T21:53:34.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 146449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep 2023-07-21T21:53:34.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 232695 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep.bin 2023-07-21T21:53:34.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 210 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.devname 2023-07-21T21:53:34.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72754 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.order 2023-07-21T21:53:34.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 879 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.softdep 2023-07-21T21:53:34.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 252883 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols 2023-07-21T21:53:34.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 307884 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols.bin 2023-07-21T21:53:34.755 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/ 2023-07-21T21:53:34.755 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/ 2023-07-21T21:53:34.755 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/doc/ 2023-07-21T21:53:34.755 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/ 2023-07-21T21:53:34.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 173 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/changelog.Debian.gz 2023-07-21T21:53:34.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 691 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/copyright 2023-07-21T21:53:34.757 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:53:34.757 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:53:34.757 DEBUG:teuthology.orchestra.run.smithi049:> egrep '(submenu|menuentry.*6.5.0-rc1-gc685da6f56cc).*{' /boot/grub/grub.cfg 2023-07-21T21:53:34.764 INFO:teuthology.orchestra.run.smithi049.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-21T21:53:34.764 INFO:teuthology.orchestra.run.smithi049.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-21T21:53:34.764 INFO:teuthology.orchestra.run.smithi049.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-21T21:53:34.765 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-21T21:53:34.765 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:53:34.765 DEBUG:teuthology.orchestra.run.smithi049:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-21T21:53:34.767 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi049.front.sepia.ceph.com to complete... 2023-07-21T21:53:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub' 2023-07-21T21:53:35.342 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-21T21:53:35.352 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2023-07-21T21:53:35.607 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:53:35.619 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:53:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-21T21:53:35.985 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-21T21:53:36.738 INFO:teuthology.orchestra.run.smithi049.stderr:done 2023-07-21T21:54:07.859 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-07-21T21:54:07.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-07-21T21:54:07.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:54:13.179 INFO:teuthology.orchestra.run.smithi150.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-21T21:54:13.179 INFO:teuthology.orchestra.run.smithi150.stderr: * [new branch] main -> origin/main 2023-07-21T21:54:13.231 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20190312 -> 20190312 2023-07-21T21:54:13.232 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20190416 -> 20190416 2023-07-21T21:54:13.232 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20190514 -> 20190514 2023-07-21T21:54:13.232 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20190618 -> 20190618 2023-07-21T21:54:13.232 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20190717 -> 20190717 2023-07-21T21:54:13.234 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20190815 -> 20190815 2023-07-21T21:54:13.234 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20190923 -> 20190923 2023-07-21T21:54:13.234 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20191022 -> 20191022 2023-07-21T21:54:13.235 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20191215 -> 20191215 2023-07-21T21:54:13.235 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20200122 -> 20200122 2023-07-21T21:54:13.235 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20200316 -> 20200316 2023-07-21T21:54:13.235 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20200421 -> 20200421 2023-07-21T21:54:13.235 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20200519 -> 20200519 2023-07-21T21:54:13.235 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20200619 -> 20200619 2023-07-21T21:54:13.236 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20200721 -> 20200721 2023-07-21T21:54:13.236 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20200817 -> 20200817 2023-07-21T21:54:13.236 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20200918 -> 20200918 2023-07-21T21:54:13.236 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20201022 -> 20201022 2023-07-21T21:54:13.236 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20201118 -> 20201118 2023-07-21T21:54:13.237 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20201218 -> 20201218 2023-07-21T21:54:13.237 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20210208 -> 20210208 2023-07-21T21:54:13.237 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20210315 -> 20210315 2023-07-21T21:54:13.237 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20210511 -> 20210511 2023-07-21T21:54:13.237 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20210716 -> 20210716 2023-07-21T21:54:13.237 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20210818 -> 20210818 2023-07-21T21:54:13.237 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20210919 -> 20210919 2023-07-21T21:54:13.237 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20211027 -> 20211027 2023-07-21T21:54:13.238 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20211216 -> 20211216 2023-07-21T21:54:13.239 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20220209 -> 20220209 2023-07-21T21:54:13.239 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20220310 -> 20220310 2023-07-21T21:54:13.239 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20220411 -> 20220411 2023-07-21T21:54:13.239 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20220509 -> 20220509 2023-07-21T21:54:13.240 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20220610 -> 20220610 2023-07-21T21:54:13.240 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20220708 -> 20220708 2023-07-21T21:54:13.240 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20220815 -> 20220815 2023-07-21T21:54:13.240 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20220913 -> 20220913 2023-07-21T21:54:13.240 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20221012 -> 20221012 2023-07-21T21:54:13.240 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20221109 -> 20221109 2023-07-21T21:54:13.240 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20221214 -> 20221214 2023-07-21T21:54:13.241 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20230117 -> 20230117 2023-07-21T21:54:13.241 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20230210 -> 20230210 2023-07-21T21:54:13.241 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20230310 -> 20230310 2023-07-21T21:54:13.241 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20230404 -> 20230404 2023-07-21T21:54:13.241 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20230515 -> 20230515 2023-07-21T21:54:13.241 INFO:teuthology.orchestra.run.smithi150.stderr: * [new tag] 20230625 -> 20230625 2023-07-21T21:54:16.475 INFO:teuthology.orchestra.run.smithi150.stderr:Updating files: 50% (1501/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1956/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 82% (2442/2977) Updating files: 82% (2450/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-21T21:54:16.479 INFO:teuthology.orchestra.run.smithi150.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-21T21:54:16.494 INFO:teuthology.task.kernel:Downloading kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.b... 2023-07-21T21:54:16.495 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:54:17.000 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ 2023-07-21T21:54:17.001 DEBUG:teuthology.orchestra.run.smithi150:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ --input-file=- 2023-07-21T21:54:17.003 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi150.front.sepia.ceph.com to complete... 2023-07-21T21:54:24.703 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21 21:54:24 URL:https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb [38851044/38851044] -> "/tmp/linux-image.deb" [1] 2023-07-21T21:54:24.703 INFO:teuthology.orchestra.run.smithi150.stderr:FINISHED --2023-07-21 21:54:24-- 2023-07-21T21:54:24.704 INFO:teuthology.orchestra.run.smithi150.stderr:Total wall clock time: 7.7s 2023-07-21T21:54:24.704 INFO:teuthology.orchestra.run.smithi150.stderr:Downloaded: 1 files, 37M in 7.2s (5.14 MB/s) 2023-07-21T21:54:24.705 INFO:teuthology.task.kernel:Installing kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.b... 2023-07-21T21:54:24.706 DEBUG:teuthology.orchestra.run.smithi150:> sudo dpkg -i /tmp/linux-image.deb 2023-07-21T21:54:25.026 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-image-6.5.0-rc1-gc685da6f56cc. 2023-07-21T21:54:26.812 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-07-21T21:54:26.817 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-21T21:54:27.017 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-21T21:54:29.952 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-21T21:54:30.073 INFO:teuthology.orchestra.run.smithi150.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:54:31.408 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-07-21T21:54:40.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-07-21T21:54:40.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:54:48.496 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-07-21T21:54:54.298 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub' 2023-07-21T21:54:54.309 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-21T21:54:54.336 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2023-07-21T21:54:54.693 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:54:54.721 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:54:55.142 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-21T21:54:55.154 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-21T21:54:57.227 INFO:teuthology.orchestra.run.smithi150.stderr:done 2023-07-21T21:54:57.412 DEBUG:teuthology.orchestra.run.smithi150:> dpkg-deb -c /tmp/linux-image.deb 2023-07-21T21:54:57.422 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./ 2023-07-21T21:54:57.422 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./boot/ 2023-07-21T21:54:57.422 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 4380308 2023-07-20 12:16 ./boot/System.map-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:54:57.436 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 168433 2023-07-20 12:16 ./boot/config-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:54:57.437 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11280224 2023-07-20 12:16 ./boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:54:57.458 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/ 2023-07-21T21:54:57.458 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/ 2023-07-21T21:54:57.458 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/postinst.d/ 2023-07-21T21:54:57.459 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/postrm.d/ 2023-07-21T21:54:57.459 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/preinst.d/ 2023-07-21T21:54:57.459 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/prerm.d/ 2023-07-21T21:54:57.459 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/ 2023-07-21T21:54:57.459 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/ 2023-07-21T21:54:57.459 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/ 2023-07-21T21:54:57.459 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/ 2023-07-21T21:54:57.460 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/ 2023-07-21T21:54:57.460 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/ 2023-07-21T21:54:57.460 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ 2023-07-21T21:54:57.460 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 490385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-21T21:54:57.462 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-21T21:54:57.463 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-21T21:54:57.463 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-21T21:54:57.463 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 93113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-21T21:54:57.464 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 106729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-21T21:54:57.464 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 152241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-21T21:54:57.464 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-21T21:54:57.464 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-21T21:54:57.465 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 83889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-21T21:54:57.465 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-21T21:54:57.465 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 47225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-21T21:54:57.465 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 47209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-21T21:54:57.466 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-21T21:54:57.466 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-21T21:54:57.466 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-21T21:54:57.467 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 58585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-21T21:54:57.467 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 50497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-21T21:54:57.467 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-21T21:54:57.467 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-21T21:54:57.468 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/ 2023-07-21T21:54:57.468 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/ 2023-07-21T21:54:57.468 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/ 2023-07-21T21:54:57.469 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-21T21:54:57.469 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpuid.ko 2023-07-21T21:54:57.469 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/msr.ko 2023-07-21T21:54:57.469 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/ 2023-07-21T21:54:57.470 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 348417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-21T21:54:57.470 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 972641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-21T21:54:57.470 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 2273145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm.ko 2023-07-21T21:54:57.480 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ 2023-07-21T21:54:57.481 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 53521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/af_alg.ko 2023-07-21T21:54:57.481 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_hash.ko 2023-07-21T21:54:57.481 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_skcipher.ko 2023-07-21T21:54:57.481 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ansi_cprng.ko 2023-07-21T21:54:57.481 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/anubis.ko 2023-07-21T21:54:57.481 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/arc4.ko 2023-07-21T21:54:57.482 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/ 2023-07-21T21:54:57.482 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-21T21:54:57.482 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/ 2023-07-21T21:54:57.482 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_memcpy.ko 2023-07-21T21:54:57.482 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_pq.ko 2023-07-21T21:54:57.482 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-21T21:54:57.482 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_tx.ko 2023-07-21T21:54:57.483 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_xor.ko 2023-07-21T21:54:57.483 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/raid6test.ko 2023-07-21T21:54:57.483 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authenc.ko 2023-07-21T21:54:57.483 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authencesn.ko 2023-07-21T21:54:57.483 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blake2b_generic.ko 2023-07-21T21:54:57.483 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_common.ko 2023-07-21T21:54:57.483 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_generic.ko 2023-07-21T21:54:57.484 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/camellia_generic.ko 2023-07-21T21:54:57.484 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast5_generic.ko 2023-07-21T21:54:57.484 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast6_generic.ko 2023-07-21T21:54:57.484 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast_common.ko 2023-07-21T21:54:57.484 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ccm.ko 2023-07-21T21:54:57.484 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cmac.ko 2023-07-21T21:54:57.485 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crc32_generic.ko 2023-07-21T21:54:57.485 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 46961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cryptd.ko 2023-07-21T21:54:57.485 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_engine.ko 2023-07-21T21:54:57.485 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_simd.ko 2023-07-21T21:54:57.485 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_user.ko 2023-07-21T21:54:57.485 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cts.ko 2023-07-21T21:54:57.485 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/des_generic.ko 2023-07-21T21:54:57.485 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/dh_generic.ko 2023-07-21T21:54:57.486 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/echainiv.ko 2023-07-21T21:54:57.486 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/essiv.ko 2023-07-21T21:54:57.486 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/fcrypt.ko 2023-07-21T21:54:57.486 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/khazad.ko 2023-07-21T21:54:57.486 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lrw.ko 2023-07-21T21:54:57.486 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4.ko 2023-07-21T21:54:57.486 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4hc.ko 2023-07-21T21:54:57.487 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/md4.ko 2023-07-21T21:54:57.487 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/michael_mic.ko 2023-07-21T21:54:57.487 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcbc.ko 2023-07-21T21:54:57.487 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcrypt.ko 2023-07-21T21:54:57.487 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/rmd160.ko 2023-07-21T21:54:57.487 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/seed.ko 2023-07-21T21:54:57.487 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/serpent_generic.ko 2023-07-21T21:54:57.488 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 149193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tcrypt.ko 2023-07-21T21:54:57.488 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tea.ko 2023-07-21T21:54:57.488 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_common.ko 2023-07-21T21:54:57.488 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_generic.ko 2023-07-21T21:54:57.488 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/vmac.ko 2023-07-21T21:54:57.488 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/wp512.ko 2023-07-21T21:54:57.488 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xcbc.ko 2023-07-21T21:54:57.489 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xor.ko 2023-07-21T21:54:57.489 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xts.ko 2023-07-21T21:54:57.489 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xxhash_generic.ko 2023-07-21T21:54:57.489 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ 2023-07-21T21:54:57.489 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ 2023-07-21T21:54:57.489 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_extlog.ko 2023-07-21T21:54:57.490 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-21T21:54:57.490 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_pad.ko 2023-07-21T21:54:57.490 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/ 2023-07-21T21:54:57.490 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/einj.ko 2023-07-21T21:54:57.490 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ec_sys.ko 2023-07-21T21:54:57.490 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/platform_profile.ko 2023-07-21T21:54:57.491 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbs.ko 2023-07-21T21:54:57.491 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbshc.ko 2023-07-21T21:54:57.491 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 100401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/video.ko 2023-07-21T21:54:57.491 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ 2023-07-21T21:54:57.491 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/acard-ahci.ko 2023-07-21T21:54:57.491 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 88625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci.ko 2023-07-21T21:54:57.491 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci_platform.ko 2023-07-21T21:54:57.492 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 87841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci.ko 2023-07-21T21:54:57.492 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci_platform.ko 2023-07-21T21:54:57.492 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_acpi.ko 2023-07-21T21:54:57.492 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ali.ko 2023-07-21T21:54:57.492 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_amd.ko 2023-07-21T21:54:57.492 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_artop.ko 2023-07-21T21:54:57.492 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atiixp.ko 2023-07-21T21:54:57.493 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atp867x.ko 2023-07-21T21:54:57.493 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd640.ko 2023-07-21T21:54:57.493 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd64x.ko 2023-07-21T21:54:57.493 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cypress.ko 2023-07-21T21:54:57.493 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_efar.ko 2023-07-21T21:54:57.494 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt366.ko 2023-07-21T21:54:57.494 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt37x.ko 2023-07-21T21:54:57.494 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-21T21:54:57.495 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-21T21:54:57.495 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it8213.ko 2023-07-21T21:54:57.495 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it821x.ko 2023-07-21T21:54:57.495 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_jmicron.ko 2023-07-21T21:54:57.496 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_legacy.ko 2023-07-21T21:54:57.496 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_marvell.ko 2023-07-21T21:54:57.496 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_mpiix.ko 2023-07-21T21:54:57.496 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_netcell.ko 2023-07-21T21:54:57.497 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ninja32.ko 2023-07-21T21:54:57.497 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87410.ko 2023-07-21T21:54:57.497 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87415.ko 2023-07-21T21:54:57.498 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_oldpiix.ko 2023-07-21T21:54:57.498 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_opti.ko 2023-07-21T21:54:57.498 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_optidma.ko 2023-07-21T21:54:57.498 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pcmcia.ko 2023-07-21T21:54:57.498 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-21T21:54:57.498 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-21T21:54:57.499 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_piccolo.ko 2023-07-21T21:54:57.499 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_radisys.ko 2023-07-21T21:54:57.499 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rdc.ko 2023-07-21T21:54:57.499 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rz1000.ko 2023-07-21T21:54:57.499 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sch.ko 2023-07-21T21:54:57.499 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_serverworks.ko 2023-07-21T21:54:57.500 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sil680.ko 2023-07-21T21:54:57.500 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sl82c105.ko 2023-07-21T21:54:57.500 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_triflex.ko 2023-07-21T21:54:57.500 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_via.ko 2023-07-21T21:54:57.500 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pdc_adma.ko 2023-07-21T21:54:57.500 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_inic162x.ko 2023-07-21T21:54:57.500 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 83225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_mv.ko 2023-07-21T21:54:57.501 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 70537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_nv.ko 2023-07-21T21:54:57.501 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_promise.ko 2023-07-21T21:54:57.501 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_qstor.ko 2023-07-21T21:54:57.501 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil.ko 2023-07-21T21:54:57.501 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil24.ko 2023-07-21T21:54:57.501 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sis.ko 2023-07-21T21:54:57.501 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_svw.ko 2023-07-21T21:54:57.501 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 44721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sx4.ko 2023-07-21T21:54:57.502 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_uli.ko 2023-07-21T21:54:57.502 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_via.ko 2023-07-21T21:54:57.502 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_vsc.ko 2023-07-21T21:54:57.502 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ 2023-07-21T21:54:57.502 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ks0108.ko 2023-07-21T21:54:57.502 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/ 2023-07-21T21:54:57.502 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 124457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/bcma.ko 2023-07-21T21:54:57.503 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/ 2023-07-21T21:54:57.503 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/ 2023-07-21T21:54:57.503 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 113705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/aoe.ko 2023-07-21T21:54:57.503 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/ 2023-07-21T21:54:57.503 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 968433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/drbd.ko 2023-07-21T21:54:57.503 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 173201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/floppy.ko 2023-07-21T21:54:57.503 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/ 2023-07-21T21:54:57.503 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 94297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-21T21:54:57.504 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 115345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/nbd.ko 2023-07-21T21:54:57.504 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/ 2023-07-21T21:54:57.504 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 110361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/null_blk.ko 2023-07-21T21:54:57.504 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 98225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/pktcdvd.ko 2023-07-21T21:54:57.504 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 257529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/rbd.ko 2023-07-21T21:54:57.504 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/ 2023-07-21T21:54:57.504 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 98129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-21T21:54:57.505 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/ 2023-07-21T21:54:57.505 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 60201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/zram.ko 2023-07-21T21:54:57.505 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ 2023-07-21T21:54:57.505 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/applicom.ko 2023-07-21T21:54:57.505 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hangcheck-timer.ko 2023-07-21T21:54:57.505 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/ 2023-07-21T21:54:57.505 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-21T21:54:57.506 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-21T21:54:57.506 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-21T21:54:57.506 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/via-rng.ko 2023-07-21T21:54:57.506 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-21T21:54:57.506 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ 2023-07-21T21:54:57.506 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-21T21:54:57.506 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 150665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-21T21:54:57.506 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-21T21:54:57.507 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 139057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-21T21:54:57.507 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 70833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-21T21:54:57.507 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 53609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-21T21:54:57.507 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/lp.ko 2023-07-21T21:54:57.507 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/ 2023-07-21T21:54:57.507 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 84121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/mwave.ko 2023-07-21T21:54:57.507 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/nvram.ko 2023-07-21T21:54:57.508 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ppdev.ko 2023-07-21T21:54:57.508 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tlclk.ko 2023-07-21T21:54:57.508 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/ 2023-07-21T21:54:57.508 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-21T21:54:57.508 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-21T21:54:57.508 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-21T21:54:57.508 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-21T21:54:57.509 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-21T21:54:57.509 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-21T21:54:57.509 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-21T21:54:57.509 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/ 2023-07-21T21:54:57.509 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-21T21:54:57.509 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 50945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-21T21:54:57.509 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-21T21:54:57.509 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/ 2023-07-21T21:54:57.510 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-palmas.ko 2023-07-21T21:54:57.510 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 47849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-si5351.ko 2023-07-21T21:54:57.510 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-twl6040.ko 2023-07-21T21:54:57.510 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-wm831x.ko 2023-07-21T21:54:57.510 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/ 2023-07-21T21:54:57.510 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-21T21:54:57.511 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-21T21:54:57.511 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-21T21:54:57.511 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ 2023-07-21T21:54:57.511 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ 2023-07-21T21:54:57.511 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 70785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-21T21:54:57.512 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 234473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp.ko 2023-07-21T21:54:57.512 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/ 2023-07-21T21:54:57.512 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/ 2023-07-21T21:54:57.512 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-21T21:54:57.512 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 408489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-21T21:54:57.559 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-21T21:54:57.559 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-21T21:54:57.559 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-aes.ko 2023-07-21T21:54:57.560 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-sha.ko 2023-07-21T21:54:57.560 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/ 2023-07-21T21:54:57.560 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 68937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-21T21:54:57.560 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/ 2023-07-21T21:54:57.560 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/dca.ko 2023-07-21T21:54:57.560 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ 2023-07-21T21:54:57.561 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/ 2023-07-21T21:54:57.561 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-21T21:54:57.561 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ 2023-07-21T21:54:57.561 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 122641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-21T21:54:57.561 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ 2023-07-21T21:54:57.561 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 80273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/amd64_edac.ko 2023-07-21T21:54:57.561 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/e752x_edac.ko 2023-07-21T21:54:57.561 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 63617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/edac_mce_amd.ko 2023-07-21T21:54:57.562 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3000_edac.ko 2023-07-21T21:54:57.562 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3200_edac.ko 2023-07-21T21:54:57.562 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5100_edac.ko 2023-07-21T21:54:57.562 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5400_edac.ko 2023-07-21T21:54:57.562 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7300_edac.ko 2023-07-21T21:54:57.562 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 52025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7core_edac.ko 2023-07-21T21:54:57.562 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i82975x_edac.ko 2023-07-21T21:54:57.563 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ie31200_edac.ko 2023-07-21T21:54:57.563 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 56809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/sb_edac.ko 2023-07-21T21:54:57.563 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/x38_edac.ko 2023-07-21T21:54:57.563 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/ 2023-07-21T21:54:57.563 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-gpio.ko 2023-07-21T21:54:57.563 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max14577.ko 2023-07-21T21:54:57.563 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max77693.ko 2023-07-21T21:54:57.564 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max8997.ko 2023-07-21T21:54:57.564 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-palmas.ko 2023-07-21T21:54:57.564 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-21T21:54:57.564 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-21T21:54:57.564 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/ 2023-07-21T21:54:57.564 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-21T21:54:57.564 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/ 2023-07-21T21:54:57.565 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-21T21:54:57.565 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-21T21:54:57.565 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/ 2023-07-21T21:54:57.565 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-21T21:54:57.565 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-21T21:54:57.565 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-arizona.ko 2023-07-21T21:54:57.565 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9052.ko 2023-07-21T21:54:57.566 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9055.ko 2023-07-21T21:54:57.566 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-dln2.ko 2023-07-21T21:54:57.566 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 77849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-21T21:54:57.566 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-generic.ko 2023-07-21T21:54:57.566 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ich.ko 2023-07-21T21:54:57.567 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-21T21:54:57.567 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-kempld.ko 2023-07-21T21:54:57.567 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-21T21:54:57.567 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max7300.ko 2023-07-21T21:54:57.567 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max730x.ko 2023-07-21T21:54:57.567 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max732x.ko 2023-07-21T21:54:57.568 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-21T21:54:57.568 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 46761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-21T21:54:57.568 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-21T21:54:57.568 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-21T21:54:57.568 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch.ko 2023-07-21T21:54:57.568 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-21T21:54:57.568 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-21T21:54:57.568 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-21T21:54:57.569 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-21T21:54:57.569 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-21T21:54:57.569 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-vx855.ko 2023-07-21T21:54:57.569 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-21T21:54:57.569 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-21T21:54:57.569 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-21T21:54:57.569 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/ 2023-07-21T21:54:57.570 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-a4tech.ko 2023-07-21T21:54:57.570 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 39081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-apple.ko 2023-07-21T21:54:57.570 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-appleir.ko 2023-07-21T21:54:57.570 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-aureal.ko 2023-07-21T21:54:57.570 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-axff.ko 2023-07-21T21:54:57.570 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-belkin.ko 2023-07-21T21:54:57.570 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cherry.ko 2023-07-21T21:54:57.571 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-chicony.ko 2023-07-21T21:54:57.571 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 59145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cp2112.ko 2023-07-21T21:54:57.571 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cypress.ko 2023-07-21T21:54:57.571 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-dr.ko 2023-07-21T21:54:57.571 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elecom.ko 2023-07-21T21:54:57.571 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elo.ko 2023-07-21T21:54:57.571 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-emsff.ko 2023-07-21T21:54:57.572 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ezkey.ko 2023-07-21T21:54:57.572 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gaff.ko 2023-07-21T21:54:57.572 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-generic.ko 2023-07-21T21:54:57.572 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gt683r.ko 2023-07-21T21:54:57.572 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gyration.ko 2023-07-21T21:54:57.572 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-21T21:54:57.572 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-21T21:54:57.573 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtekff.ko 2023-07-21T21:54:57.573 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-hyperv.ko 2023-07-21T21:54:57.573 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-icade.ko 2023-07-21T21:54:57.573 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kensington.ko 2023-07-21T21:54:57.573 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-keytouch.ko 2023-07-21T21:54:57.573 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kye.ko 2023-07-21T21:54:57.573 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lcpower.ko 2023-07-21T21:54:57.573 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-led.ko 2023-07-21T21:54:57.574 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 42297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lenovo.ko 2023-07-21T21:54:57.574 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lg-g15.ko 2023-07-21T21:54:57.574 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 57809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-21T21:54:57.574 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 100897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-21T21:54:57.574 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 80993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech.ko 2023-07-21T21:54:57.574 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-magicmouse.ko 2023-07-21T21:54:57.574 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-microsoft.ko 2023-07-21T21:54:57.575 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-monterey.ko 2023-07-21T21:54:57.575 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 50153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-multitouch.ko 2023-07-21T21:54:57.575 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ntrig.ko 2023-07-21T21:54:57.575 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ortek.ko 2023-07-21T21:54:57.575 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-penmount.ko 2023-07-21T21:54:57.575 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-petalynx.ko 2023-07-21T21:54:57.575 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 72937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-picolcd.ko 2023-07-21T21:54:57.576 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-pl.ko 2023-07-21T21:54:57.576 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-plantronics.ko 2023-07-21T21:54:57.576 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-primax.ko 2023-07-21T21:54:57.576 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-rmi.ko 2023-07-21T21:54:57.576 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-21T21:54:57.576 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-common.ko 2023-07-21T21:54:57.576 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-21T21:54:57.577 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-21T21:54:57.577 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-21T21:54:57.577 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-21T21:54:57.577 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-21T21:54:57.577 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-21T21:54:57.577 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-21T21:54:57.577 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-21T21:54:57.577 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-21T21:54:57.578 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat.ko 2023-07-21T21:54:57.578 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-saitek.ko 2023-07-21T21:54:57.578 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-samsung.ko 2023-07-21T21:54:57.578 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-21T21:54:57.578 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sjoy.ko 2023-07-21T21:54:57.578 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sony.ko 2023-07-21T21:54:57.578 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-speedlink.ko 2023-07-21T21:54:57.579 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-steelseries.ko 2023-07-21T21:54:57.579 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sunplus.ko 2023-07-21T21:54:57.579 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-21T21:54:57.579 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tivo.ko 2023-07-21T21:54:57.579 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tmff.ko 2023-07-21T21:54:57.579 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-topseed.ko 2023-07-21T21:54:57.579 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-twinhan.ko 2023-07-21T21:54:57.579 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 71457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-uclogic.ko 2023-07-21T21:54:57.580 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-waltop.ko 2023-07-21T21:54:57.580 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 143585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-wiimote.ko 2023-07-21T21:54:57.580 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-xinmo.ko 2023-07-21T21:54:57.580 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zpff.ko 2023-07-21T21:54:57.580 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zydacron.ko 2023-07-21T21:54:57.580 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 267713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid.ko 2023-07-21T21:54:57.580 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/uhid.ko 2023-07-21T21:54:57.581 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/ 2023-07-21T21:54:57.581 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 125721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-21T21:54:57.581 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-21T21:54:57.581 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-21T21:54:57.581 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 217401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/wacom.ko 2023-07-21T21:54:57.581 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/ 2023-07-21T21:54:57.581 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 63497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_balloon.ko 2023-07-21T21:54:57.582 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 89609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_utils.ko 2023-07-21T21:54:57.582 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 301449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_vmbus.ko 2023-07-21T21:54:57.582 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ 2023-07-21T21:54:57.582 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 66593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru.ko 2023-07-21T21:54:57.582 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 61393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru3.ko 2023-07-21T21:54:57.582 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-21T21:54:57.582 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7414.ko 2023-07-21T21:54:57.583 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7418.ko 2023-07-21T21:54:57.583 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adc128d818.ko 2023-07-21T21:54:57.583 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1025.ko 2023-07-21T21:54:57.583 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 97977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1026.ko 2023-07-21T21:54:57.583 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1029.ko 2023-07-21T21:54:57.583 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 45553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1031.ko 2023-07-21T21:54:57.583 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm9240.ko 2023-07-21T21:54:57.583 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ads7828.ko 2023-07-21T21:54:57.584 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7410.ko 2023-07-21T21:54:57.584 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7411.ko 2023-07-21T21:54:57.584 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 74433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7462.ko 2023-07-21T21:54:57.584 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 39585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7470.ko 2023-07-21T21:54:57.584 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 67929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7475.ko 2023-07-21T21:54:57.584 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7x10.ko 2023-07-21T21:54:57.585 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 39073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/amc6821.ko 2023-07-21T21:54:57.585 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 55265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/applesmc.ko 2023-07-21T21:54:57.585 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 49913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asb100.ko 2023-07-21T21:54:57.585 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 58617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asc7621.ko 2023-07-21T21:54:57.585 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-21T21:54:57.585 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/atxp1.ko 2023-07-21T21:54:57.585 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/coretemp.ko 2023-07-21T21:54:57.585 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-21T21:54:57.586 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-21T21:54:57.586 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 44465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-21T21:54:57.586 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 99601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dme1737.ko 2023-07-21T21:54:57.586 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds1621.ko 2023-07-21T21:54:57.586 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds620.ko 2023-07-21T21:54:57.586 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc1403.ko 2023-07-21T21:54:57.586 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc2103.ko 2023-07-21T21:54:57.587 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc6w201.ko 2023-07-21T21:54:57.587 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 66985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71805f.ko 2023-07-21T21:54:57.587 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 94457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71882fg.ko 2023-07-21T21:54:57.587 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 41401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f75375s.ko 2023-07-21T21:54:57.587 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fam15h_power.ko 2023-07-21T21:54:57.587 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 55433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fschmd.ko 2023-07-21T21:54:57.587 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g760a.ko 2023-07-21T21:54:57.588 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g762.ko 2023-07-21T21:54:57.588 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 46801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl518sm.ko 2023-07-21T21:54:57.588 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 45529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl520sm.ko 2023-07-21T21:54:57.588 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hih6130.ko 2023-07-21T21:54:57.588 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-21T21:54:57.588 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5500_temp.ko 2023-07-21T21:54:57.588 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5k_amb.ko 2023-07-21T21:54:57.589 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmaem.ko 2023-07-21T21:54:57.589 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmpex.ko 2023-07-21T21:54:57.589 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina209.ko 2023-07-21T21:54:57.589 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina2xx.ko 2023-07-21T21:54:57.589 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 129217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/it87.ko 2023-07-21T21:54:57.589 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/jc42.ko 2023-07-21T21:54:57.589 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k10temp.ko 2023-07-21T21:54:57.589 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k8temp.ko 2023-07-21T21:54:57.590 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lineage-pem.ko 2023-07-21T21:54:57.590 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 48601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm63.ko 2023-07-21T21:54:57.590 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm73.ko 2023-07-21T21:54:57.590 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm75.ko 2023-07-21T21:54:57.590 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm77.ko 2023-07-21T21:54:57.590 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm78.ko 2023-07-21T21:54:57.590 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm80.ko 2023-07-21T21:54:57.591 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm83.ko 2023-07-21T21:54:57.591 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 72833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm85.ko 2023-07-21T21:54:57.591 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 46153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm87.ko 2023-07-21T21:54:57.591 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm90.ko 2023-07-21T21:54:57.591 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm92.ko 2023-07-21T21:54:57.591 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 108841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm93.ko 2023-07-21T21:54:57.591 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95234.ko 2023-07-21T21:54:57.591 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95241.ko 2023-07-21T21:54:57.592 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95245.ko 2023-07-21T21:54:57.592 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc2945.ko 2023-07-21T21:54:57.592 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4151.ko 2023-07-21T21:54:57.592 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4215.ko 2023-07-21T21:54:57.592 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4222.ko 2023-07-21T21:54:57.592 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4245.ko 2023-07-21T21:54:57.592 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4260.ko 2023-07-21T21:54:57.593 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4261.ko 2023-07-21T21:54:57.593 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max16065.ko 2023-07-21T21:54:57.593 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1619.ko 2023-07-21T21:54:57.593 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1668.ko 2023-07-21T21:54:57.593 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max197.ko 2023-07-21T21:54:57.593 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6639.ko 2023-07-21T21:54:57.593 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6650.ko 2023-07-21T21:54:57.593 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6697.ko 2023-07-21T21:54:57.594 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-21T21:54:57.594 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mcp3021.ko 2023-07-21T21:54:57.594 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-21T21:54:57.594 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 44129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6683.ko 2023-07-21T21:54:57.594 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 116737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775-core.ko 2023-07-21T21:54:57.594 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 60705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775.ko 2023-07-21T21:54:57.594 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 59737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct7802.ko 2023-07-21T21:54:57.595 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 82337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87360.ko 2023-07-21T21:54:57.595 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 54433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87427.ko 2023-07-21T21:54:57.595 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pcf8591.ko 2023-07-21T21:54:57.595 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ 2023-07-21T21:54:57.595 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-21T21:54:57.595 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-21T21:54:57.595 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-21T21:54:57.595 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-21T21:54:57.596 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-21T21:54:57.596 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-21T21:54:57.596 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-21T21:54:57.596 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 81841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-21T21:54:57.596 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-21T21:54:57.596 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-21T21:54:57.596 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-21T21:54:57.597 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-21T21:54:57.597 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/powr1220.ko 2023-07-21T21:54:57.597 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5627.ko 2023-07-21T21:54:57.597 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5636.ko 2023-07-21T21:54:57.597 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-21T21:54:57.597 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht15.ko 2023-07-21T21:54:57.597 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht21.ko 2023-07-21T21:54:57.598 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/shtc1.ko 2023-07-21T21:54:57.598 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sis5595.ko 2023-07-21T21:54:57.598 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smm665.ko 2023-07-21T21:54:57.598 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47b397.ko 2023-07-21T21:54:57.598 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 39193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m1.ko 2023-07-21T21:54:57.598 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m192.ko 2023-07-21T21:54:57.598 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/thmc50.ko 2023-07-21T21:54:57.598 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp102.ko 2023-07-21T21:54:57.599 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp103.ko 2023-07-21T21:54:57.599 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp401.ko 2023-07-21T21:54:57.599 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp421.ko 2023-07-21T21:54:57.599 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via-cputemp.ko 2023-07-21T21:54:57.599 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 41945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via686a.ko 2023-07-21T21:54:57.599 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 52457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt1211.ko 2023-07-21T21:54:57.599 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt8231.ko 2023-07-21T21:54:57.599 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 57513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627ehf.ko 2023-07-21T21:54:57.600 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 78873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627hf.ko 2023-07-21T21:54:57.600 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 71345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83781d.ko 2023-07-21T21:54:57.600 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 63289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83791d.ko 2023-07-21T21:54:57.600 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 71321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83792d.ko 2023-07-21T21:54:57.600 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 101457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83793.ko 2023-07-21T21:54:57.600 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 119505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83795.ko 2023-07-21T21:54:57.600 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l785ts.ko 2023-07-21T21:54:57.601 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l786ng.ko 2023-07-21T21:54:57.601 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-21T21:54:57.601 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-21T21:54:57.601 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/ 2023-07-21T21:54:57.601 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/ 2023-07-21T21:54:57.601 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-21T21:54:57.601 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-21T21:54:57.602 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/ 2023-07-21T21:54:57.602 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-21T21:54:57.602 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-21T21:54:57.602 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-21T21:54:57.602 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-21T21:54:57.602 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-21T21:54:57.602 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-21T21:54:57.603 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-21T21:54:57.603 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 6929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-21T21:54:57.603 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-21T21:54:57.603 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 48553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-21T21:54:57.603 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-21T21:54:57.603 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-21T21:54:57.603 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-21T21:54:57.603 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-21T21:54:57.604 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-21T21:54:57.604 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 62729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-21T21:54:57.604 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-21T21:54:57.604 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 47889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-21T21:54:57.604 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-21T21:54:57.604 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-21T21:54:57.604 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-21T21:54:57.605 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-21T21:54:57.605 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-21T21:54:57.605 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-21T21:54:57.605 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 47241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-21T21:54:57.605 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-21T21:54:57.605 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-21T21:54:57.605 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-21T21:54:57.606 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-21T21:54:57.606 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-21T21:54:57.606 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-21T21:54:57.606 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-21T21:54:57.606 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-21T21:54:57.606 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-21T21:54:57.606 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-21T21:54:57.607 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-21T21:54:57.607 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 47593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-21T21:54:57.607 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-mux.ko 2023-07-21T21:54:57.607 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-smbus.ko 2023-07-21T21:54:57.607 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-stub.ko 2023-07-21T21:54:57.607 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/ 2023-07-21T21:54:57.607 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-21T21:54:57.607 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-21T21:54:57.608 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-21T21:54:57.608 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ 2023-07-21T21:54:57.608 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ 2023-07-21T21:54:57.608 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 273641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-21T21:54:57.608 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 876913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_core.ko 2023-07-21T21:54:57.608 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 69321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-21T21:54:57.608 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 324145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-21T21:54:57.609 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 97961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-21T21:54:57.609 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 279321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-21T21:54:57.609 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 66177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-21T21:54:57.609 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ 2023-07-21T21:54:57.609 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-21T21:54:57.609 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 492561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-21T21:54:57.609 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/ 2023-07-21T21:54:57.610 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 419217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-21T21:54:57.610 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/ 2023-07-21T21:54:57.610 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 739705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-21T21:54:57.610 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ 2023-07-21T21:54:57.610 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 296649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-21T21:54:57.610 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-21T21:54:57.610 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 153681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-21T21:54:57.611 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/ 2023-07-21T21:54:57.611 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 169017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-21T21:54:57.611 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ 2023-07-21T21:54:57.611 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-21T21:54:57.611 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 263177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-21T21:54:57.611 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ 2023-07-21T21:54:57.611 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 100225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-21T21:54:57.611 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ 2023-07-21T21:54:57.612 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 111993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-21T21:54:57.612 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ 2023-07-21T21:54:57.612 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 129081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-21T21:54:57.612 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ 2023-07-21T21:54:57.612 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 129553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-21T21:54:57.612 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ 2023-07-21T21:54:57.612 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/evbug.ko 2023-07-21T21:54:57.613 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ff-memless.ko 2023-07-21T21:54:57.613 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ 2023-07-21T21:54:57.613 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-21T21:54:57.613 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-21T21:54:57.613 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 41217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/gameport.ko 2023-07-21T21:54:57.613 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/lightning.ko 2023-07-21T21:54:57.613 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ns558.ko 2023-07-21T21:54:57.613 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 41825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/joydev.ko 2023-07-21T21:54:57.614 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/ 2023-07-21T21:54:57.614 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-21T21:54:57.614 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-21T21:54:57.614 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-21T21:54:57.614 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-21T21:54:57.614 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-21T21:54:57.614 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-21T21:54:57.615 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-21T21:54:57.615 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8323.ko 2023-07-21T21:54:57.615 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8333.ko 2023-07-21T21:54:57.615 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-21T21:54:57.615 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-21T21:54:57.615 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-21T21:54:57.615 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-21T21:54:57.616 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-21T21:54:57.616 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-21T21:54:57.616 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt1070.ko 2023-07-21T21:54:57.616 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt2160.ko 2023-07-21T21:54:57.616 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-21T21:54:57.616 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/stowaway.ko 2023-07-21T21:54:57.616 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-21T21:54:57.616 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-21T21:54:57.617 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-21T21:54:57.617 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-21T21:54:57.617 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-21T21:54:57.617 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/matrix-keymap.ko 2023-07-21T21:54:57.617 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/ 2023-07-21T21:54:57.617 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/appletouch.ko 2023-07-21T21:54:57.617 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/bcm5974.ko 2023-07-21T21:54:57.618 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 123681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/cyapatp.ko 2023-07-21T21:54:57.618 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 89449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-21T21:54:57.618 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-21T21:54:57.618 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 335849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/psmouse.ko 2023-07-21T21:54:57.618 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/sermouse.ko 2023-07-21T21:54:57.618 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-21T21:54:57.618 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-21T21:54:57.619 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-21T21:54:57.619 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/ 2023-07-21T21:54:57.619 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 109849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-21T21:54:57.619 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ 2023-07-21T21:54:57.619 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/altera_ps2.ko 2023-07-21T21:54:57.619 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/arc_ps2.ko 2023-07-21T21:54:57.619 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ct82c710.ko 2023-07-21T21:54:57.620 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-21T21:54:57.620 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/parkbd.ko 2023-07-21T21:54:57.620 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/pcips2.ko 2023-07-21T21:54:57.620 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ps2mult.ko 2023-07-21T21:54:57.620 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serio_raw.ko 2023-07-21T21:54:57.620 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serport.ko 2023-07-21T21:54:57.620 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/sparse-keymap.ko 2023-07-21T21:54:57.620 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/ 2023-07-21T21:54:57.621 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/ 2023-07-21T21:54:57.621 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-21T21:54:57.621 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/ 2023-07-21T21:54:57.621 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-88pm860x.ko 2023-07-21T21:54:57.621 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-adp5520.ko 2023-07-21T21:54:57.621 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 59753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-bd2802.ko 2023-07-21T21:54:57.621 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-blinkm.ko 2023-07-21T21:54:57.622 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da903x.ko 2023-07-21T21:54:57.622 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da9052.ko 2023-07-21T21:54:57.622 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-gpio.ko 2023-07-21T21:54:57.622 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3530.ko 2023-07-21T21:54:57.622 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3533.ko 2023-07-21T21:54:57.622 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm355x.ko 2023-07-21T21:54:57.622 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3642.ko 2023-07-21T21:54:57.623 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp3944.ko 2023-07-21T21:54:57.623 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp8788.ko 2023-07-21T21:54:57.623 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-max8997.ko 2023-07-21T21:54:57.623 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-mc13783.ko 2023-07-21T21:54:57.623 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-21T21:54:57.623 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca9532.ko 2023-07-21T21:54:57.623 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca955x.ko 2023-07-21T21:54:57.624 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca963x.ko 2023-07-21T21:54:57.624 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-ss4200.ko 2023-07-21T21:54:57.624 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-tca6507.ko 2023-07-21T21:54:57.624 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-21T21:54:57.624 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm8350.ko 2023-07-21T21:54:57.624 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ 2023-07-21T21:54:57.624 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-21T21:54:57.624 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-21T21:54:57.625 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-21T21:54:57.625 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-21T21:54:57.625 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-21T21:54:57.625 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-21T21:54:57.625 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-21T21:54:57.625 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-21T21:54:57.625 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/ 2023-07-21T21:54:57.626 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/ 2023-07-21T21:54:57.626 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 655473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/bcache.ko 2023-07-21T21:54:57.626 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bio-prison.ko 2023-07-21T21:54:57.626 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 89601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bufio.ko 2023-07-21T21:54:57.626 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 47465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache-smq.ko 2023-07-21T21:54:57.626 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 155993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache.ko 2023-07-21T21:54:57.626 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 107049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-crypt.ko 2023-07-21T21:54:57.626 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-delay.ko 2023-07-21T21:54:57.627 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 53897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-era.ko 2023-07-21T21:54:57.627 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-flakey.ko 2023-07-21T21:54:57.627 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 41593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log-userspace.ko 2023-07-21T21:54:57.627 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log.ko 2023-07-21T21:54:57.627 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 49545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-mirror.ko 2023-07-21T21:54:57.627 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 78017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-multipath.ko 2023-07-21T21:54:57.627 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-queue-length.ko 2023-07-21T21:54:57.628 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 70769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-raid.ko 2023-07-21T21:54:57.628 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-region-hash.ko 2023-07-21T21:54:57.628 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-round-robin.ko 2023-07-21T21:54:57.628 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-service-time.ko 2023-07-21T21:54:57.628 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 109593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-snapshot.ko 2023-07-21T21:54:57.628 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-switch.ko 2023-07-21T21:54:57.628 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 181585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-thin-pool.ko 2023-07-21T21:54:57.629 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-verity.ko 2023-07-21T21:54:57.629 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-zero.ko 2023-07-21T21:54:57.629 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/faulty.ko 2023-07-21T21:54:57.629 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/linear.ko 2023-07-21T21:54:57.629 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/multipath.ko 2023-07-21T21:54:57.629 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/ 2023-07-21T21:54:57.629 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 199937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-21T21:54:57.629 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid0.ko 2023-07-21T21:54:57.630 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 112609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid1.ko 2023-07-21T21:54:57.630 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 160553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid10.ko 2023-07-21T21:54:57.630 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 396153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid456.ko 2023-07-21T21:54:57.630 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/ 2023-07-21T21:54:57.630 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/ 2023-07-21T21:54:57.630 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 178113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptbase.ko 2023-07-21T21:54:57.630 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 63385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptctl.ko 2023-07-21T21:54:57.631 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 44649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptfc.ko 2023-07-21T21:54:57.631 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptlan.ko 2023-07-21T21:54:57.631 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 123305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptsas.ko 2023-07-21T21:54:57.631 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 79017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptscsih.ko 2023-07-21T21:54:57.631 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 53081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptspi.ko 2023-07-21T21:54:57.631 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ 2023-07-21T21:54:57.631 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm800.ko 2023-07-21T21:54:57.632 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm805.ko 2023-07-21T21:54:57.632 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm80x.ko 2023-07-21T21:54:57.632 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona-i2c.ko 2023-07-21T21:54:57.632 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 123721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona.ko 2023-07-21T21:54:57.632 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/bcm590xx.ko 2023-07-21T21:54:57.632 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-21T21:54:57.632 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/dln2.ko 2023-07-21T21:54:57.632 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/janz-cmodio.ko 2023-07-21T21:54:57.633 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 53585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/kempld-core.ko 2023-07-21T21:54:57.633 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-core.ko 2023-07-21T21:54:57.633 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-21T21:54:57.633 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lp3943.ko 2023-07-21T21:54:57.633 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 54569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_ich.ko 2023-07-21T21:54:57.633 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_sch.ko 2023-07-21T21:54:57.633 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/max8907.ko 2023-07-21T21:54:57.633 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-21T21:54:57.634 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-21T21:54:57.634 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/menf21bmc.ko 2023-07-21T21:54:57.634 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-21T21:54:57.634 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-21T21:54:57.634 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633.ko 2023-07-21T21:54:57.634 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-21T21:54:57.634 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/retu-mfd.ko 2023-07-21T21:54:57.635 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 80425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/si476x-core.ko 2023-07-21T21:54:57.635 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 48441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/sm501.ko 2023-07-21T21:54:57.635 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-21T21:54:57.635 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps65010.ko 2023-07-21T21:54:57.635 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps6507x.ko 2023-07-21T21:54:57.635 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/viperboard.ko 2023-07-21T21:54:57.635 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/vx855.ko 2023-07-21T21:54:57.635 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wl1273-core.ko 2023-07-21T21:54:57.636 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 44345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wm8994.ko 2023-07-21T21:54:57.636 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ 2023-07-21T21:54:57.636 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-21T21:54:57.636 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 48489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot.ko 2023-07-21T21:54:57.636 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/ 2023-07-21T21:54:57.636 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 46585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-21T21:54:57.636 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds9802als.ko 2023-07-21T21:54:57.637 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds990x.ko 2023-07-21T21:54:57.637 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 45593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/bh1770glc.ko 2023-07-21T21:54:57.637 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/ 2023-07-21T21:54:57.637 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-21T21:54:57.637 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/core.ko 2023-07-21T21:54:57.637 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/ 2023-07-21T21:54:57.637 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/cb710.ko 2023-07-21T21:54:57.637 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ds1682.ko 2023-07-21T21:54:57.638 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/dummy-irq.ko 2023-07-21T21:54:57.638 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/ 2023-07-21T21:54:57.638 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/echo.ko 2023-07-21T21:54:57.638 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/ 2023-07-21T21:54:57.638 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/at24.ko 2023-07-21T21:54:57.638 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-21T21:54:57.638 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-21T21:54:57.639 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/max6875.ko 2023-07-21T21:54:57.639 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/enclosure.ko 2023-07-21T21:54:57.639 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/ 2023-07-21T21:54:57.639 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 152137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-21T21:54:57.639 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hmc6352.ko 2023-07-21T21:54:57.639 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hpilo.ko 2023-07-21T21:54:57.639 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ 2023-07-21T21:54:57.639 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 72601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-21T21:54:57.640 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ics932s401.ko 2023-07-21T21:54:57.640 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29003.ko 2023-07-21T21:54:57.640 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29020.ko 2023-07-21T21:54:57.640 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/ 2023-07-21T21:54:57.640 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 42585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-21T21:54:57.640 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-21T21:54:57.640 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/ 2023-07-21T21:54:57.641 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 125209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-me.ko 2023-07-21T21:54:57.641 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 56521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-txe.ko 2023-07-21T21:54:57.641 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 309857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei.ko 2023-07-21T21:54:57.641 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/phantom.ko 2023-07-21T21:54:57.641 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/ 2023-07-21T21:54:57.641 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 74905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-21T21:54:57.641 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_7xx1.ko 2023-07-21T21:54:57.641 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_core.ko 2023-07-21T21:54:57.642 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tsl2550.ko 2023-07-21T21:54:57.642 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 48673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_balloon.ko 2023-07-21T21:54:57.642 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/ 2023-07-21T21:54:57.642 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 183857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-21T21:54:57.642 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ 2023-07-21T21:54:57.642 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/ 2023-07-21T21:54:57.642 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 487801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/bonding.ko 2023-07-21T21:54:57.642 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/ 2023-07-21T21:54:57.643 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/ 2023-07-21T21:54:57.643 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 106009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-21T21:54:57.643 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-21T21:54:57.643 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-21T21:54:57.643 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-21T21:54:57.643 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 452481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-21T21:54:57.644 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dummy.ko 2023-07-21T21:54:57.644 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/eql.ko 2023-07-21T21:54:57.644 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ 2023-07-21T21:54:57.644 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/ 2023-07-21T21:54:57.644 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 45785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-21T21:54:57.644 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 42105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-21T21:54:57.644 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 130489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-21T21:54:57.644 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 68785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-21T21:54:57.645 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ 2023-07-21T21:54:57.645 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-21T21:54:57.645 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 59689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-21T21:54:57.645 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-21T21:54:57.645 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 99113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-21T21:54:57.645 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/ 2023-07-21T21:54:57.645 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 54521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-21T21:54:57.646 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/ 2023-07-21T21:54:57.646 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 69145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-21T21:54:57.646 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/ 2023-07-21T21:54:57.646 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 59521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-21T21:54:57.646 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/ 2023-07-21T21:54:57.646 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 41393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-21T21:54:57.646 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/ 2023-07-21T21:54:57.646 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 54545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-21T21:54:57.647 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 49225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-21T21:54:57.647 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 87345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-21T21:54:57.647 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/ 2023-07-21T21:54:57.647 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-21T21:54:57.647 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 97321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-21T21:54:57.647 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-21T21:54:57.647 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 104585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-21T21:54:57.647 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-21T21:54:57.648 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 90257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-21T21:54:57.648 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-21T21:54:57.648 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 81505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-21T21:54:57.648 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 69713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-21T21:54:57.648 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/ 2023-07-21T21:54:57.648 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 78401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-21T21:54:57.648 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 176881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-21T21:54:57.649 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-21T21:54:57.649 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 1422209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-21T21:54:57.649 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 128377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-21T21:54:57.649 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-21T21:54:57.649 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 132289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-21T21:54:57.649 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 312145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-21T21:54:57.649 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/ 2023-07-21T21:54:57.650 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-21T21:54:57.650 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 323601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-21T21:54:57.650 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/ 2023-07-21T21:54:57.650 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-21T21:54:57.650 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 193433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-21T21:54:57.650 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-21T21:54:57.650 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 347641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-21T21:54:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-21T21:54:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 1044145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-21T21:54:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-21T21:54:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 166113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-21T21:54:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-21T21:54:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-21T21:54:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/ 2023-07-21T21:54:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-21T21:54:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 204329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-21T21:54:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/ 2023-07-21T21:54:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-21T21:54:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 69449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-21T21:54:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 61489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-21T21:54:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 141161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-21T21:54:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-21T21:54:57.653 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 62865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-21T21:54:57.653 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-21T21:54:57.653 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/ 2023-07-21T21:54:57.653 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 60873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-21T21:54:57.653 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 62833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-21T21:54:57.653 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 45721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dnet.ko 2023-07-21T21:54:57.653 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-21T21:54:57.653 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/ 2023-07-21T21:54:57.654 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-21T21:54:57.654 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 281329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-21T21:54:57.654 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 49505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ethoc.ko 2023-07-21T21:54:57.654 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fealnx.ko 2023-07-21T21:54:57.654 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/ 2023-07-21T21:54:57.654 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 45281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-21T21:54:57.655 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ 2023-07-21T21:54:57.655 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 90465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-21T21:54:57.655 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-21T21:54:57.655 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 295713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-21T21:54:57.655 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-21T21:54:57.655 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 584249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-21T21:54:57.655 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-21T21:54:57.655 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 246321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-21T21:54:57.656 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-21T21:54:57.656 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 923969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-21T21:54:57.656 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-21T21:54:57.656 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 298097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-21T21:54:57.656 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/ 2023-07-21T21:54:57.656 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 514889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-21T21:54:57.656 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-21T21:54:57.656 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 93593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-21T21:54:57.657 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-21T21:54:57.657 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 734297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-21T21:54:57.657 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-21T21:54:57.657 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 151841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-21T21:54:57.657 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 86921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/jme.ko 2023-07-21T21:54:57.657 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/ 2023-07-21T21:54:57.657 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-21T21:54:57.658 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 102385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-21T21:54:57.658 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 122681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-21T21:54:57.658 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/ 2023-07-21T21:54:57.658 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-21T21:54:57.658 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 727433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-21T21:54:57.658 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 280513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-21T21:54:57.658 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-21T21:54:57.659 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-21T21:54:57.659 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 1095817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-21T21:54:57.659 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ 2023-07-21T21:54:57.659 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 53041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-21T21:54:57.659 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-21T21:54:57.659 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-21T21:54:57.659 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 95665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-21T21:54:57.660 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/ 2023-07-21T21:54:57.660 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-21T21:54:57.660 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 108809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-21T21:54:57.660 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ 2023-07-21T21:54:57.660 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 73377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-21T21:54:57.660 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 47713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-21T21:54:57.660 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/ 2023-07-21T21:54:57.661 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 150905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-21T21:54:57.661 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/ 2023-07-21T21:54:57.661 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 136785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-21T21:54:57.661 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/ 2023-07-21T21:54:57.661 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 50481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-21T21:54:57.661 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 43145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-21T21:54:57.661 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/ 2023-07-21T21:54:57.661 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-21T21:54:57.662 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 227113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-21T21:54:57.662 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 87081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-21T21:54:57.662 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-21T21:54:57.662 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 671393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-21T21:54:57.730 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/ 2023-07-21T21:54:57.730 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 43017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-21T21:54:57.730 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/ 2023-07-21T21:54:57.731 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 67385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-21T21:54:57.731 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 83921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-21T21:54:57.731 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-21T21:54:57.731 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 190089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-21T21:54:57.731 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/ 2023-07-21T21:54:57.731 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-21T21:54:57.732 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 104241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-21T21:54:57.732 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/ 2023-07-21T21:54:57.732 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 952881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-21T21:54:57.732 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/ 2023-07-21T21:54:57.732 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 47177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-21T21:54:57.732 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/ 2023-07-21T21:54:57.732 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 54809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-21T21:54:57.733 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 63273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-21T21:54:57.733 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/ 2023-07-21T21:54:57.733 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 61537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-21T21:54:57.733 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 67129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-21T21:54:57.733 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 73345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-21T21:54:57.734 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 68209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-21T21:54:57.734 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/ 2023-07-21T21:54:57.734 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-21T21:54:57.734 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-21T21:54:57.734 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-21T21:54:57.734 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-21T21:54:57.734 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 481681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-21T21:54:57.734 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/ 2023-07-21T21:54:57.735 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 103321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-21T21:54:57.735 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 166121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-21T21:54:57.735 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 66473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-21T21:54:57.735 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 78737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-21T21:54:57.735 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/ 2023-07-21T21:54:57.735 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 49993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-21T21:54:57.735 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/ 2023-07-21T21:54:57.736 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 86465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-21T21:54:57.736 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/ 2023-07-21T21:54:57.736 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 80257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-21T21:54:57.736 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 83681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-21T21:54:57.736 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/ 2023-07-21T21:54:57.736 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 46241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-21T21:54:57.736 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-21T21:54:57.737 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/ 2023-07-21T21:54:57.737 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 60041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-21T21:54:57.737 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/ 2023-07-21T21:54:57.737 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 41001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/defxx.ko 2023-07-21T21:54:57.737 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/ 2023-07-21T21:54:57.737 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 216977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-21T21:54:57.737 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 77401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/geneve.ko 2023-07-21T21:54:57.737 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/ 2023-07-21T21:54:57.738 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 235593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-21T21:54:57.738 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/ 2023-07-21T21:54:57.738 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-21T21:54:57.738 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ifb.ko 2023-07-21T21:54:57.738 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ 2023-07-21T21:54:57.738 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 83737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-21T21:54:57.738 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 62065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvlan.ko 2023-07-21T21:54:57.739 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvtap.ko 2023-07-21T21:54:57.739 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/ 2023-07-21T21:54:57.739 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-21T21:54:57.739 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-21T21:54:57.739 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-21T21:54:57.739 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-21T21:54:57.739 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio.ko 2023-07-21T21:54:57.740 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mii.ko 2023-07-21T21:54:57.740 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 41697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/netconsole.ko 2023-07-21T21:54:57.740 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/nlmon.ko 2023-07-21T21:54:57.740 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/ 2023-07-21T21:54:57.740 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-21T21:54:57.740 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-21T21:54:57.740 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ 2023-07-21T21:54:57.741 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/amd.ko 2023-07-21T21:54:57.741 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 50097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-21T21:54:57.741 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 43273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-21T21:54:57.741 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm87xx.ko 2023-07-21T21:54:57.741 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 41337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/broadcom.ko 2023-07-21T21:54:57.741 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/cicada.ko 2023-07-21T21:54:57.741 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/davicom.ko 2023-07-21T21:54:57.741 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/et1011c.ko 2023-07-21T21:54:57.742 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/icplus.ko 2023-07-21T21:54:57.742 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/lxt.ko 2023-07-21T21:54:57.742 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 78185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/marvell.ko 2023-07-21T21:54:57.742 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 75713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/micrel.ko 2023-07-21T21:54:57.742 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/national.ko 2023-07-21T21:54:57.742 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 97265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/phylink.ko 2023-07-21T21:54:57.743 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/qsemi.ko 2023-07-21T21:54:57.743 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 49553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/realtek.ko 2023-07-21T21:54:57.743 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/smsc.ko 2023-07-21T21:54:57.743 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ste10Xp.ko 2023-07-21T21:54:57.743 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/vitesse.ko 2023-07-21T21:54:57.743 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/ 2023-07-21T21:54:57.743 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 43465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/plip.ko 2023-07-21T21:54:57.743 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ 2023-07-21T21:54:57.744 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-21T21:54:57.744 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_async.ko 2023-07-21T21:54:57.744 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-21T21:54:57.744 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-21T21:54:57.744 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-21T21:54:57.744 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 42545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppoe.ko 2023-07-21T21:54:57.744 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppox.ko 2023-07-21T21:54:57.745 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pptp.ko 2023-07-21T21:54:57.745 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sb1000.ko 2023-07-21T21:54:57.745 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/ 2023-07-21T21:54:57.745 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 42513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/slip.ko 2023-07-21T21:54:57.745 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sungem_phy.ko 2023-07-21T21:54:57.745 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 64889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/tap.ko 2023-07-21T21:54:57.745 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/ 2023-07-21T21:54:57.746 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 105961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team.ko 2023-07-21T21:54:57.746 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-21T21:54:57.746 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-21T21:54:57.746 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-21T21:54:57.746 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_random.ko 2023-07-21T21:54:57.746 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-21T21:54:57.746 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 88193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/veth.ko 2023-07-21T21:54:57.747 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/ 2023-07-21T21:54:57.747 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 120497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-21T21:54:57.747 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/ 2023-07-21T21:54:57.747 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 290665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/vxlan.ko 2023-07-21T21:54:57.747 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/ 2023-07-21T21:54:57.747 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 143801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-21T21:54:57.747 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ 2023-07-21T21:54:57.748 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ntb.ko 2023-07-21T21:54:57.748 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/ 2023-07-21T21:54:57.748 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/ 2023-07-21T21:54:57.748 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 266561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme-core.ko 2023-07-21T21:54:57.748 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 101937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme.ko 2023-07-21T21:54:57.748 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/ 2023-07-21T21:54:57.749 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 133817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport.ko 2023-07-21T21:54:57.749 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_cs.ko 2023-07-21T21:54:57.749 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 84337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_pc.ko 2023-07-21T21:54:57.749 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_serial.ko 2023-07-21T21:54:57.749 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/ 2023-07-21T21:54:57.749 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/ 2023-07-21T21:54:57.749 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-21T21:54:57.750 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-21T21:54:57.750 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-21T21:54:57.750 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/pci-stub.ko 2023-07-21T21:54:57.750 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 47377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/xen-pcifront.ko 2023-07-21T21:54:57.750 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/ 2023-07-21T21:54:57.750 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/i82092.ko 2023-07-21T21:54:57.750 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 145785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia.ko 2023-07-21T21:54:57.751 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 62081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-21T21:54:57.751 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-21T21:54:57.751 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pd6729.ko 2023-07-21T21:54:57.751 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 112913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-21T21:54:57.751 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/ 2023-07-21T21:54:57.751 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/ 2023-07-21T21:54:57.751 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-21T21:54:57.752 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/ 2023-07-21T21:54:57.752 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-21T21:54:57.752 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/ 2023-07-21T21:54:57.752 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/ 2023-07-21T21:54:57.752 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 71521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-21T21:54:57.752 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/ 2023-07-21T21:54:57.752 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/ 2023-07-21T21:54:57.753 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 50889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-21T21:54:57.753 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-21T21:54:57.753 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-21T21:54:57.753 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-21T21:54:57.753 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-21T21:54:57.753 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-21T21:54:57.753 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-21T21:54:57.753 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ 2023-07-21T21:54:57.754 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 67097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-21T21:54:57.754 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 39145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acerhdf.ko 2023-07-21T21:54:57.754 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-21T21:54:57.754 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 59665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-21T21:54:57.754 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-21T21:54:57.754 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 106873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-21T21:54:57.755 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-21T21:54:57.755 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 49121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-21T21:54:57.755 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-21T21:54:57.755 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-21T21:54:57.755 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-21T21:54:57.755 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/hdaps.ko 2023-07-21T21:54:57.755 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-21T21:54:57.756 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/ 2023-07-21T21:54:57.756 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-21T21:54:57.756 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-21T21:54:57.756 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 43521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel_ips.ko 2023-07-21T21:54:57.756 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-21T21:54:57.756 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-21T21:54:57.756 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-21T21:54:57.757 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 42329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-21T21:54:57.757 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-21T21:54:57.757 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-21T21:54:57.757 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-21T21:54:57.757 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-21T21:54:57.757 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-21T21:54:57.757 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 57665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi.ko 2023-07-21T21:54:57.758 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/ 2023-07-21T21:54:57.758 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ 2023-07-21T21:54:57.758 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-21T21:54:57.758 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-21T21:54:57.758 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 55057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-21T21:54:57.758 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 53993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-21T21:54:57.758 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-21T21:54:57.759 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-21T21:54:57.759 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9030_battery.ko 2023-07-21T21:54:57.759 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9052-battery.ko 2023-07-21T21:54:57.759 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-21T21:54:57.759 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-21T21:54:57.759 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-21T21:54:57.759 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-21T21:54:57.760 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/gpio-charger.ko 2023-07-21T21:54:57.760 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-21T21:54:57.760 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-21T21:54:57.760 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max14577_charger.ko 2023-07-21T21:54:57.760 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17040_battery.ko 2023-07-21T21:54:57.760 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17042_battery.ko 2023-07-21T21:54:57.760 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8903_charger.ko 2023-07-21T21:54:57.761 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8925_power.ko 2023-07-21T21:54:57.761 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-21T21:54:57.761 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/sbs-battery.ko 2023-07-21T21:54:57.761 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/test_power.ko 2023-07-21T21:54:57.761 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-21T21:54:57.761 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-21T21:54:57.762 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_power.ko 2023-07-21T21:54:57.762 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm8350_power.ko 2023-07-21T21:54:57.762 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/ 2023-07-21T21:54:57.762 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 57737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-21T21:54:57.762 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-21T21:54:57.762 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/ 2023-07-21T21:54:57.762 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/ 2023-07-21T21:54:57.763 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-21T21:54:57.763 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-21T21:54:57.763 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps_parport.ko 2023-07-21T21:54:57.763 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 41921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/pps_core.ko 2023-07-21T21:54:57.763 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ 2023-07-21T21:54:57.763 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 66385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp.ko 2023-07-21T21:54:57.763 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp_kvm.ko 2023-07-21T21:54:57.763 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/ 2023-07-21T21:54:57.764 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-21T21:54:57.764 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-21T21:54:57.764 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-21T21:54:57.764 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-21T21:54:57.764 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9052.ko 2023-07-21T21:54:57.764 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9055.ko 2023-07-21T21:54:57.764 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9063.ko 2023-07-21T21:54:57.765 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-21T21:54:57.765 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 68577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-21T21:54:57.765 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-21T21:54:57.765 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-21T21:54:57.765 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-21T21:54:57.765 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-21T21:54:57.765 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-21T21:54:57.765 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-21T21:54:57.766 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-21T21:54:57.766 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-em3027.ko 2023-07-21T21:54:57.766 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-21T21:54:57.766 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-21T21:54:57.766 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-21T21:54:57.766 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-21T21:54:57.766 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-21T21:54:57.767 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-21T21:54:57.767 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-21T21:54:57.767 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-21T21:54:57.767 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max6900.ko 2023-07-21T21:54:57.767 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8907.ko 2023-07-21T21:54:57.767 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8925.ko 2023-07-21T21:54:57.767 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8997.ko 2023-07-21T21:54:57.768 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8998.ko 2023-07-21T21:54:57.768 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-21T21:54:57.768 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-21T21:54:57.768 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-palmas.ko 2023-07-21T21:54:57.768 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-21T21:54:57.768 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-21T21:54:57.768 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-21T21:54:57.768 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-21T21:54:57.769 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-21T21:54:57.769 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-21T21:54:57.769 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-21T21:54:57.769 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-21T21:54:57.769 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-21T21:54:57.769 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-21T21:54:57.769 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-21T21:54:57.770 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-21T21:54:57.770 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-21T21:54:57.770 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-21T21:54:57.770 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-21T21:54:57.770 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-21T21:54:57.770 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-21T21:54:57.770 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-21T21:54:57.770 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-x1205.ko 2023-07-21T21:54:57.771 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ 2023-07-21T21:54:57.771 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 77617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-9xxx.ko 2023-07-21T21:54:57.771 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 57665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-sas.ko 2023-07-21T21:54:57.771 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 55169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-xxxx.ko 2023-07-21T21:54:57.771 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 135169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/BusLogic.ko 2023-07-21T21:54:57.771 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/a100u2w.ko 2023-07-21T21:54:57.771 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/ 2023-07-21T21:54:57.772 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 272353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-21T21:54:57.772 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 100617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/advansys.ko 2023-07-21T21:54:57.772 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/ 2023-07-21T21:54:57.772 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 356265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-21T21:54:57.772 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 295801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-21T21:54:57.772 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/ 2023-07-21T21:54:57.772 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 189321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-21T21:54:57.772 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/am53c974.ko 2023-07-21T21:54:57.773 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/ 2023-07-21T21:54:57.773 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 106569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-21T21:54:57.773 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/atp870u.ko 2023-07-21T21:54:57.773 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/ 2023-07-21T21:54:57.773 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 246897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-21T21:54:57.773 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/ 2023-07-21T21:54:57.773 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 1172185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/bfa.ko 2023-07-21T21:54:57.774 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/ 2023-07-21T21:54:57.774 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 237169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-21T21:54:57.774 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/ 2023-07-21T21:54:57.774 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 115393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-21T21:54:57.774 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ch.ko 2023-07-21T21:54:57.774 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/ 2023-07-21T21:54:57.774 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 308889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-21T21:54:57.774 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/ 2023-07-21T21:54:57.775 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-21T21:54:57.775 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 76193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-21T21:54:57.775 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-21T21:54:57.775 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 101449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-21T21:54:57.775 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 146785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-21T21:54:57.775 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 75529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dc395x.ko 2023-07-21T21:54:57.775 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dmx3191d.ko 2023-07-21T21:54:57.776 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/ 2023-07-21T21:54:57.776 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 212401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-21T21:54:57.776 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 60489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esp_scsi.ko 2023-07-21T21:54:57.776 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/ 2023-07-21T21:54:57.776 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 78289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-21T21:54:57.776 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 158193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-21T21:54:57.776 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fdomain.ko 2023-07-21T21:54:57.777 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/ 2023-07-21T21:54:57.777 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 261913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/fnic.ko 2023-07-21T21:54:57.777 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 201793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hpsa.ko 2023-07-21T21:54:57.777 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hptiop.ko 2023-07-21T21:54:57.777 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 49065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hv_storvsc.ko 2023-07-21T21:54:57.777 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/imm.ko 2023-07-21T21:54:57.777 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 44057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/initio.ko 2023-07-21T21:54:57.777 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 266521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ipr.ko 2023-07-21T21:54:57.778 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 101881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ips.ko 2023-07-21T21:54:57.778 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/ 2023-07-21T21:54:57.778 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 317249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/isci.ko 2023-07-21T21:54:57.778 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-21T21:54:57.778 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 52897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-21T21:54:57.778 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/ 2023-07-21T21:54:57.778 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 314961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/libfc.ko 2023-07-21T21:54:57.779 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 145569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi.ko 2023-07-21T21:54:57.779 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 53521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-21T21:54:57.779 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/ 2023-07-21T21:54:57.779 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 217209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/libsas.ko 2023-07-21T21:54:57.779 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/ 2023-07-21T21:54:57.779 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 2192449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-21T21:54:57.779 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/ 2023-07-21T21:54:57.779 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 73545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-21T21:54:57.780 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-21T21:54:57.780 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 310729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-21T21:54:57.780 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 84697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid.ko 2023-07-21T21:54:57.780 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/ 2023-07-21T21:54:57.780 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 659577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-21T21:54:57.780 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/ 2023-07-21T21:54:57.780 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 119929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-21T21:54:57.781 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 78153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvumi.ko 2023-07-21T21:54:57.781 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/ 2023-07-21T21:54:57.781 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 81601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-21T21:54:57.781 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-21T21:54:57.781 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-21T21:54:57.781 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-21T21:54:57.781 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/ 2023-07-21T21:54:57.781 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 364257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-21T21:54:57.782 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 123489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pmcraid.ko 2023-07-21T21:54:57.782 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ppa.ko 2023-07-21T21:54:57.782 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 55345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla1280.ko 2023-07-21T21:54:57.782 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/ 2023-07-21T21:54:57.782 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 1860025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-21T21:54:57.782 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 85313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-21T21:54:57.782 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/ 2023-07-21T21:54:57.783 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 558865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-21T21:54:57.783 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qlogicfas408.ko 2023-07-21T21:54:57.783 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/raid_class.ko 2023-07-21T21:54:57.783 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 238801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_debug.ko 2023-07-21T21:54:57.783 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 173921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-21T21:54:57.783 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 278865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-21T21:54:57.783 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 97705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-21T21:54:57.783 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 73881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-21T21:54:57.784 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 44993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-21T21:54:57.784 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ses.ko 2023-07-21T21:54:57.784 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 115849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/st.ko 2023-07-21T21:54:57.784 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 46825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/stex.ko 2023-07-21T21:54:57.784 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-21T21:54:57.784 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 162121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-21T21:54:57.784 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 42361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/virtio_scsi.ko 2023-07-21T21:54:57.785 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 50297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-21T21:54:57.785 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/wd719x.ko 2023-07-21T21:54:57.785 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 50025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/xen-scsifront.ko 2023-07-21T21:54:57.785 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ 2023-07-21T21:54:57.785 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 129417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ssb.ko 2023-07-21T21:54:57.785 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/ 2023-07-21T21:54:57.785 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/ 2023-07-21T21:54:57.785 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 739089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-21T21:54:57.786 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/ 2023-07-21T21:54:57.786 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 49985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-21T21:54:57.786 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 39713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_file.ko 2023-07-21T21:54:57.786 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 42961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_iblock.ko 2023-07-21T21:54:57.786 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 931721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_mod.ko 2023-07-21T21:54:57.786 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 44321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_pscsi.ko 2023-07-21T21:54:57.786 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 122545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_user.ko 2023-07-21T21:54:57.787 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/ 2023-07-21T21:54:57.787 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 75641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-21T21:54:57.787 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/ 2023-07-21T21:54:57.787 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/ 2023-07-21T21:54:57.787 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-21T21:54:57.787 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-21T21:54:57.787 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-21T21:54:57.787 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-21T21:54:57.788 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-21T21:54:57.788 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-21T21:54:57.788 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-21T21:54:57.788 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-21T21:54:57.788 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-21T21:54:57.788 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-21T21:54:57.788 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-21T21:54:57.789 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-21T21:54:57.789 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-21T21:54:57.789 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-21T21:54:57.789 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-21T21:54:57.789 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-21T21:54:57.789 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-21T21:54:57.789 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ 2023-07-21T21:54:57.790 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ 2023-07-21T21:54:57.790 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 78073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-21T21:54:57.790 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 57881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/moxa.ko 2023-07-21T21:54:57.790 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 50793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/mxser.ko 2023-07-21T21:54:57.790 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 107545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_gsm.ko 2023-07-21T21:54:57.790 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_hdlc.ko 2023-07-21T21:54:57.790 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 68137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/nozomi.ko 2023-07-21T21:54:57.790 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/ 2023-07-21T21:54:57.791 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/ 2023-07-21T21:54:57.791 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-21T21:54:57.791 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 59497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-21T21:54:57.791 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-21T21:54:57.791 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_uart.ko 2023-07-21T21:54:57.791 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/arc_uart.ko 2023-07-21T21:54:57.792 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 72193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-21T21:54:57.792 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/ 2023-07-21T21:54:57.792 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 103017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-21T21:54:57.792 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/rp2.ko 2023-07-21T21:54:57.792 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 52073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-21T21:54:57.792 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 100185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/synclink_gt.ko 2023-07-21T21:54:57.792 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/ 2023-07-21T21:54:57.793 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ 2023-07-21T21:54:57.793 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 536617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-21T21:54:57.793 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ 2023-07-21T21:54:57.793 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-21T21:54:57.793 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-21T21:54:57.793 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/ 2023-07-21T21:54:57.793 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 44585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio.ko 2023-07-21T21:54:57.793 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_aec.ko 2023-07-21T21:54:57.794 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_cif.ko 2023-07-21T21:54:57.794 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-21T21:54:57.794 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_mf624.ko 2023-07-21T21:54:57.794 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_netx.ko 2023-07-21T21:54:57.794 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pci_generic.ko 2023-07-21T21:54:57.794 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-21T21:54:57.794 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_sercos3.ko 2023-07-21T21:54:57.794 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/ 2023-07-21T21:54:57.795 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/ 2023-07-21T21:54:57.795 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 73273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-21T21:54:57.795 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ 2023-07-21T21:54:57.795 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 143785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-21T21:54:57.795 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-21T21:54:57.795 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-21T21:54:57.796 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-21T21:54:57.796 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/ 2023-07-21T21:54:57.796 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 85457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-acm.ko 2023-07-21T21:54:57.796 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-21T21:54:57.796 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 47465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usblp.ko 2023-07-21T21:54:57.796 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 89833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usbtmc.ko 2023-07-21T21:54:57.796 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ 2023-07-21T21:54:57.796 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ulpi.ko 2023-07-21T21:54:57.797 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/ 2023-07-21T21:54:57.797 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-21T21:54:57.797 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/ 2023-07-21T21:54:57.797 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-21T21:54:57.797 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-21T21:54:57.797 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 445801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-21T21:54:57.797 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/ 2023-07-21T21:54:57.798 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/ 2023-07-21T21:54:57.798 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 60089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-21T21:54:57.798 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-21T21:54:57.798 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-21T21:54:57.798 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 42649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-21T21:54:57.798 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-21T21:54:57.798 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-21T21:54:57.798 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 92377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-21T21:54:57.799 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-21T21:54:57.799 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 122073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-21T21:54:57.799 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 57921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-21T21:54:57.799 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-21T21:54:57.799 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-21T21:54:57.799 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 57705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-21T21:54:57.799 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 85841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-21T21:54:57.800 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-21T21:54:57.800 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 58433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-21T21:54:57.800 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 67337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-21T21:54:57.800 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/ 2023-07-21T21:54:57.800 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-21T21:54:57.800 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-21T21:54:57.801 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-21T21:54:57.801 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-21T21:54:57.801 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-21T21:54:57.801 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-21T21:54:57.801 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-21T21:54:57.801 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-21T21:54:57.801 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-21T21:54:57.801 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-21T21:54:57.802 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-21T21:54:57.802 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-21T21:54:57.802 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 62153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-21T21:54:57.802 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-21T21:54:57.802 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 161233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-21T21:54:57.802 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/ 2023-07-21T21:54:57.802 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-21T21:54:57.803 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-21T21:54:57.803 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 157665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-21T21:54:57.803 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-21T21:54:57.803 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 52993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-21T21:54:57.803 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 69689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-21T21:54:57.803 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 56009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-21T21:54:57.804 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 76033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-21T21:54:57.804 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 75057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-21T21:54:57.804 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 73153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-21T21:54:57.804 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 65793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-21T21:54:57.804 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 66073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-21T21:54:57.804 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 81489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-21T21:54:57.804 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 156033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-21T21:54:57.805 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ 2023-07-21T21:54:57.805 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-21T21:54:57.805 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 80097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-21T21:54:57.805 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 87337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-21T21:54:57.805 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 78849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-21T21:54:57.805 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-21T21:54:57.805 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811_cs.ko 2023-07-21T21:54:57.805 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-21T21:54:57.806 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-21T21:54:57.806 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/ 2023-07-21T21:54:57.806 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/mdc800.ko 2023-07-21T21:54:57.806 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/microtek.ko 2023-07-21T21:54:57.806 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ 2023-07-21T21:54:57.806 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 41841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/adutux.ko 2023-07-21T21:54:57.806 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/appledisplay.ko 2023-07-21T21:54:57.806 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-21T21:54:57.807 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cytherm.ko 2023-07-21T21:54:57.807 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ehset.ko 2023-07-21T21:54:57.807 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi26.ko 2023-07-21T21:54:57.807 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi62.ko 2023-07-21T21:54:57.807 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ezusb.ko 2023-07-21T21:54:57.807 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/idmouse.ko 2023-07-21T21:54:57.808 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/iowarrior.ko 2023-07-21T21:54:57.808 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-21T21:54:57.808 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ldusb.ko 2023-07-21T21:54:57.808 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/legousbtower.ko 2023-07-21T21:54:57.808 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/lvstest.ko 2023-07-21T21:54:57.808 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/ 2023-07-21T21:54:57.808 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 64841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-21T21:54:57.808 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-21T21:54:57.809 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usb3503.ko 2023-07-21T21:54:57.809 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usblcd.ko 2023-07-21T21:54:57.809 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-21T21:54:57.809 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 70873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbtest.ko 2023-07-21T21:54:57.809 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 41945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/uss720.ko 2023-07-21T21:54:57.809 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/yurex.ko 2023-07-21T21:54:57.809 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/ 2023-07-21T21:54:57.810 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 73185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/usbmon.ko 2023-07-21T21:54:57.810 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/ 2023-07-21T21:54:57.810 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 301521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-21T21:54:57.810 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/ 2023-07-21T21:54:57.810 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-generic.ko 2023-07-21T21:54:57.810 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-21T21:54:57.810 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-21T21:54:57.810 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-21T21:54:57.811 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ 2023-07-21T21:54:57.811 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/aircable.ko 2023-07-21T21:54:57.811 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ark3116.ko 2023-07-21T21:54:57.811 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-21T21:54:57.811 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ch341.ko 2023-07-21T21:54:57.811 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 70209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cp210x.ko 2023-07-21T21:54:57.812 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cyberjack.ko 2023-07-21T21:54:57.812 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 57937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-21T21:54:57.812 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 49753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-21T21:54:57.812 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/empeg.ko 2023-07-21T21:54:57.812 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 43897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/f81232.ko 2023-07-21T21:54:57.812 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 175145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-21T21:54:57.812 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 52713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-21T21:54:57.812 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 137105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-21T21:54:57.813 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 124673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_ti.ko 2023-07-21T21:54:57.813 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 67769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipaq.ko 2023-07-21T21:54:57.813 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipw.ko 2023-07-21T21:54:57.813 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ir-usb.ko 2023-07-21T21:54:57.813 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 57937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-21T21:54:57.813 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 107417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan.ko 2023-07-21T21:54:57.813 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-21T21:54:57.814 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-21T21:54:57.814 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-21T21:54:57.814 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mct_u232.ko 2023-07-21T21:54:57.814 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/metro-usb.ko 2023-07-21T21:54:57.814 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 66489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7720.ko 2023-07-21T21:54:57.814 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 78113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7840.ko 2023-07-21T21:54:57.814 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 56593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mxuport.ko 2023-07-21T21:54:57.815 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/navman.ko 2023-07-21T21:54:57.815 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/omninet.ko 2023-07-21T21:54:57.815 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/opticon.ko 2023-07-21T21:54:57.815 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 189729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/option.ko 2023-07-21T21:54:57.815 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/oti6858.ko 2023-07-21T21:54:57.815 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 54313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/pl2303.ko 2023-07-21T21:54:57.815 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcaux.ko 2023-07-21T21:54:57.815 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcserial.ko 2023-07-21T21:54:57.816 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/quatech2.ko 2023-07-21T21:54:57.816 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/safe_serial.ko 2023-07-21T21:54:57.816 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 51297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/sierra.ko 2023-07-21T21:54:57.816 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-21T21:54:57.816 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ssu100.ko 2023-07-21T21:54:57.816 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/symbolserial.ko 2023-07-21T21:54:57.816 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 61337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-21T21:54:57.817 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-21T21:54:57.817 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_debug.ko 2023-07-21T21:54:57.817 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-21T21:54:57.817 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 125505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usbserial.ko 2023-07-21T21:54:57.817 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/visor.ko 2023-07-21T21:54:57.817 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/whiteheat.ko 2023-07-21T21:54:57.817 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-21T21:54:57.818 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-21T21:54:57.818 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ 2023-07-21T21:54:57.818 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 52913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/uas.ko 2023-07-21T21:54:57.818 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-21T21:54:57.818 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-21T21:54:57.818 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-21T21:54:57.818 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-21T21:54:57.818 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-21T21:54:57.819 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-21T21:54:57.819 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-21T21:54:57.819 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-karma.ko 2023-07-21T21:54:57.819 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-21T21:54:57.819 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-21T21:54:57.819 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-21T21:54:57.819 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-21T21:54:57.819 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-21T21:54:57.820 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 180017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/usb-storage.ko 2023-07-21T21:54:57.820 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/ 2023-07-21T21:54:57.820 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 67457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-21T21:54:57.820 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 71345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-21T21:54:57.820 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 105401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-21T21:54:57.820 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/ 2023-07-21T21:54:57.820 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/ 2023-07-21T21:54:57.821 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 153697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-21T21:54:57.821 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-21T21:54:57.821 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 100569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio.ko 2023-07-21T21:54:57.821 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 75137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-21T21:54:57.821 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/ 2023-07-21T21:54:57.821 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 113889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost.ko 2023-07-21T21:54:57.821 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-21T21:54:57.821 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 58137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_net.ko 2023-07-21T21:54:57.822 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 86521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_scsi.ko 2023-07-21T21:54:57.822 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/ 2023-07-21T21:54:57.822 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/ 2023-07-21T21:54:57.822 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-21T21:54:57.822 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-21T21:54:57.823 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-21T21:54:57.823 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-21T21:54:57.823 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 39993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-21T21:54:57.823 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/apple_bl.ko 2023-07-21T21:54:57.823 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-21T21:54:57.823 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/bd6107.ko 2023-07-21T21:54:57.823 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-21T21:54:57.824 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-21T21:54:57.824 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-21T21:54:57.824 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-21T21:54:57.824 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lcd.ko 2023-07-21T21:54:57.824 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-21T21:54:57.824 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-21T21:54:57.824 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-21T21:54:57.824 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-21T21:54:57.825 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-21T21:54:57.825 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-21T21:54:57.825 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-21T21:54:57.825 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-21T21:54:57.825 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/ 2023-07-21T21:54:57.825 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ 2023-07-21T21:54:57.825 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2482.ko 2023-07-21T21:54:57.826 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2490.ko 2023-07-21T21:54:57.826 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-21T21:54:57.826 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-21T21:54:57.826 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/ 2023-07-21T21:54:57.826 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-21T21:54:57.826 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-21T21:54:57.826 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-21T21:54:57.827 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-21T21:54:57.827 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-21T21:54:57.827 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-21T21:54:57.827 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-21T21:54:57.827 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-21T21:54:57.827 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-21T21:54:57.827 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-21T21:54:57.827 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 56425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-21T21:54:57.828 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 102657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/wire.ko 2023-07-21T21:54:57.828 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ 2023-07-21T21:54:57.828 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/acquirewdt.ko 2023-07-21T21:54:57.828 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/advantechwdt.ko 2023-07-21T21:54:57.828 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-21T21:54:57.828 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-21T21:54:57.828 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-21T21:54:57.829 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-21T21:54:57.829 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-21T21:54:57.829 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-21T21:54:57.829 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/dw_wdt.ko 2023-07-21T21:54:57.829 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-21T21:54:57.829 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-21T21:54:57.829 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/hpwdt.ko 2023-07-21T21:54:57.829 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/i6300esb.ko 2023-07-21T21:54:57.830 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-21T21:54:57.830 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-21T21:54:57.830 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ib700wdt.ko 2023-07-21T21:54:57.830 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ibmasr.ko 2023-07-21T21:54:57.830 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-21T21:54:57.830 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-21T21:54:57.831 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it87_wdt.ko 2023-07-21T21:54:57.831 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-21T21:54:57.831 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/machzwd.ko 2023-07-21T21:54:57.831 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-21T21:54:57.831 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-21T21:54:57.831 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/nv_tco.ko 2023-07-21T21:54:57.831 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-21T21:54:57.831 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-21T21:54:57.832 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-21T21:54:57.832 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-21T21:54:57.832 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/retu_wdt.ko 2023-07-21T21:54:57.832 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-21T21:54:57.832 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-21T21:54:57.832 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-21T21:54:57.832 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-21T21:54:57.833 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-21T21:54:57.833 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-21T21:54:57.833 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/softdog.ko 2023-07-21T21:54:57.833 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-21T21:54:57.833 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-21T21:54:57.833 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/via_wdt.ko 2023-07-21T21:54:57.833 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-21T21:54:57.833 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-21T21:54:57.834 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-21T21:54:57.834 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-21T21:54:57.834 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wdt_pci.ko 2023-07-21T21:54:57.834 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-21T21:54:57.834 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-21T21:54:57.834 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/xen_wdt.ko 2023-07-21T21:54:57.835 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/ 2023-07-21T21:54:57.835 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-evtchn.ko 2023-07-21T21:54:57.835 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntalloc.ko 2023-07-21T21:54:57.835 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 47841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntdev.ko 2023-07-21T21:54:57.835 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/ 2023-07-21T21:54:57.835 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 176417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-21T21:54:57.835 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-privcmd.ko 2023-07-21T21:54:57.836 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 71321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-scsiback.ko 2023-07-21T21:54:57.836 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/ 2023-07-21T21:54:57.836 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-21T21:54:57.836 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ 2023-07-21T21:54:57.836 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/ 2023-07-21T21:54:57.836 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 165697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/9p.ko 2023-07-21T21:54:57.836 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/ 2023-07-21T21:54:57.837 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 60881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/adfs.ko 2023-07-21T21:54:57.837 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/ 2023-07-21T21:54:57.837 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 162617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/affs.ko 2023-07-21T21:54:57.837 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/ 2023-07-21T21:54:57.837 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 931937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/kafs.ko 2023-07-21T21:54:57.837 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/ 2023-07-21T21:54:57.837 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 100937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/autofs4.ko 2023-07-21T21:54:57.838 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/ 2023-07-21T21:54:57.838 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 64481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/befs.ko 2023-07-21T21:54:57.838 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/ 2023-07-21T21:54:57.838 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/bfs.ko 2023-07-21T21:54:57.838 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/binfmt_misc.ko 2023-07-21T21:54:57.838 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/ 2023-07-21T21:54:57.838 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 3468681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/btrfs.ko 2023-07-21T21:54:57.839 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/ 2023-07-21T21:54:57.839 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 305745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/cachefiles.ko 2023-07-21T21:54:57.839 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ 2023-07-21T21:54:57.839 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 1312545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ceph.ko 2023-07-21T21:54:57.839 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/ 2023-07-21T21:54:57.839 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 100321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/coda.ko 2023-07-21T21:54:57.839 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/ 2023-07-21T21:54:57.840 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 108073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/configfs.ko 2023-07-21T21:54:57.840 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/ 2023-07-21T21:54:57.840 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/cramfs.ko 2023-07-21T21:54:57.840 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/ 2023-07-21T21:54:57.840 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 633825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/dlm.ko 2023-07-21T21:54:57.840 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/ 2023-07-21T21:54:57.840 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/efs.ko 2023-07-21T21:54:57.840 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/ 2023-07-21T21:54:57.841 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 1500513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/f2fs.ko 2023-07-21T21:54:57.841 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/ 2023-07-21T21:54:57.841 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/msdos.ko 2023-07-21T21:54:57.841 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/ 2023-07-21T21:54:57.841 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 42457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/freevxfs.ko 2023-07-21T21:54:57.841 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/ 2023-07-21T21:54:57.841 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 226505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/fscache.ko 2023-07-21T21:54:57.842 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/ 2023-07-21T21:54:57.842 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/cuse.ko 2023-07-21T21:54:57.842 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/ 2023-07-21T21:54:57.842 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 1226249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/gfs2.ko 2023-07-21T21:54:57.842 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/ 2023-07-21T21:54:57.842 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 141241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/hfs.ko 2023-07-21T21:54:57.842 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/ 2023-07-21T21:54:57.843 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 221553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/hfsplus.ko 2023-07-21T21:54:57.843 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/ 2023-07-21T21:54:57.843 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 193577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/hpfs.ko 2023-07-21T21:54:57.843 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/ 2023-07-21T21:54:57.843 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 74393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/isofs.ko 2023-07-21T21:54:57.843 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/ 2023-07-21T21:54:57.843 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 420745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/jfs.ko 2023-07-21T21:54:57.843 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/ 2023-07-21T21:54:57.844 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 279041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/lockd.ko 2023-07-21T21:54:57.844 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/ 2023-07-21T21:54:57.844 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 87897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/minix.ko 2023-07-21T21:54:57.844 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/ 2023-07-21T21:54:57.844 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 124697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/netfs.ko 2023-07-21T21:54:57.844 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/ 2023-07-21T21:54:57.844 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/ 2023-07-21T21:54:57.845 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 81521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-21T21:54:57.845 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/ 2023-07-21T21:54:57.845 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 59425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-21T21:54:57.845 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/ 2023-07-21T21:54:57.845 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 117705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-21T21:54:57.845 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 1053889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfs.ko 2023-07-21T21:54:57.845 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 66089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv2.ko 2023-07-21T21:54:57.846 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 119801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv3.ko 2023-07-21T21:54:57.846 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 2041809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv4.ko 2023-07-21T21:54:57.846 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/ 2023-07-21T21:54:57.846 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/grace.ko 2023-07-21T21:54:57.846 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/nfs_acl.ko 2023-07-21T21:54:57.846 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/ 2023-07-21T21:54:57.846 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 1504993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/nfsd.ko 2023-07-21T21:54:57.847 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/ 2023-07-21T21:54:57.847 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 591417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/nilfs2.ko 2023-07-21T21:54:57.847 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/ 2023-07-21T21:54:57.847 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-celtic.ko 2023-07-21T21:54:57.847 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-centeuro.ko 2023-07-21T21:54:57.847 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-croatian.ko 2023-07-21T21:54:57.847 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-cyrillic.ko 2023-07-21T21:54:57.847 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-gaelic.ko 2023-07-21T21:54:57.848 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-greek.ko 2023-07-21T21:54:57.848 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-iceland.ko 2023-07-21T21:54:57.848 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-inuit.ko 2023-07-21T21:54:57.848 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-roman.ko 2023-07-21T21:54:57.848 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-romanian.ko 2023-07-21T21:54:57.848 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-turkish.ko 2023-07-21T21:54:57.848 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_ascii.ko 2023-07-21T21:54:57.849 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1250.ko 2023-07-21T21:54:57.849 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1251.ko 2023-07-21T21:54:57.849 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1255.ko 2023-07-21T21:54:57.849 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp737.ko 2023-07-21T21:54:57.849 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp775.ko 2023-07-21T21:54:57.849 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp850.ko 2023-07-21T21:54:57.849 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp852.ko 2023-07-21T21:54:57.850 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp855.ko 2023-07-21T21:54:57.850 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp857.ko 2023-07-21T21:54:57.850 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp860.ko 2023-07-21T21:54:57.850 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp861.ko 2023-07-21T21:54:57.850 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp862.ko 2023-07-21T21:54:57.850 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp863.ko 2023-07-21T21:54:57.850 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp864.ko 2023-07-21T21:54:57.850 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp865.ko 2023-07-21T21:54:57.851 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp866.ko 2023-07-21T21:54:57.851 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp869.ko 2023-07-21T21:54:57.851 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp874.ko 2023-07-21T21:54:57.851 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 94137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp932.ko 2023-07-21T21:54:57.851 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 142673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp936.ko 2023-07-21T21:54:57.851 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 165745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp949.ko 2023-07-21T21:54:57.851 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 118121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp950.ko 2023-07-21T21:54:57.852 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_euc-jp.ko 2023-07-21T21:54:57.852 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-1.ko 2023-07-21T21:54:57.852 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-13.ko 2023-07-21T21:54:57.852 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-14.ko 2023-07-21T21:54:57.852 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-15.ko 2023-07-21T21:54:57.852 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-2.ko 2023-07-21T21:54:57.852 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-3.ko 2023-07-21T21:54:57.853 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-4.ko 2023-07-21T21:54:57.853 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-5.ko 2023-07-21T21:54:57.853 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-6.ko 2023-07-21T21:54:57.853 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-7.ko 2023-07-21T21:54:57.853 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-9.ko 2023-07-21T21:54:57.853 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-r.ko 2023-07-21T21:54:57.853 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-ru.ko 2023-07-21T21:54:57.854 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-u.ko 2023-07-21T21:54:57.854 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_utf8.ko 2023-07-21T21:54:57.854 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ 2023-07-21T21:54:57.854 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 219073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ntfs.ko 2023-07-21T21:54:57.854 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ 2023-07-21T21:54:57.854 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ 2023-07-21T21:54:57.854 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 244177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-21T21:54:57.854 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ 2023-07-21T21:54:57.855 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 440785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-21T21:54:57.855 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ 2023-07-21T21:54:57.855 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 53841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-21T21:54:57.855 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 2589569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2.ko 2023-07-21T21:54:57.855 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-21T21:54:57.855 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-21T21:54:57.855 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-21T21:54:57.855 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/ 2023-07-21T21:54:57.856 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 52569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/omfs.ko 2023-07-21T21:54:57.856 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/ 2023-07-21T21:54:57.856 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 336473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/overlay.ko 2023-07-21T21:54:57.856 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ 2023-07-21T21:54:57.856 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 54609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ramoops.ko 2023-07-21T21:54:57.856 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/ 2023-07-21T21:54:57.856 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/qnx4.ko 2023-07-21T21:54:57.857 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/ 2023-07-21T21:54:57.857 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 46649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/qnx6.ko 2023-07-21T21:54:57.857 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/ 2023-07-21T21:54:57.857 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_tree.ko 2023-07-21T21:54:57.857 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v1.ko 2023-07-21T21:54:57.857 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v2.ko 2023-07-21T21:54:57.857 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/ 2023-07-21T21:54:57.857 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 530697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/reiserfs.ko 2023-07-21T21:54:57.858 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/ 2023-07-21T21:54:57.858 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/romfs.ko 2023-07-21T21:54:57.858 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/ 2023-07-21T21:54:57.858 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/ 2023-07-21T21:54:57.858 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 2658777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/cifs.ko 2023-07-21T21:54:57.858 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/ 2023-07-21T21:54:57.858 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_arc4.ko 2023-07-21T21:54:57.858 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_md4.ko 2023-07-21T21:54:57.859 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/ 2023-07-21T21:54:57.859 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 134313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/squashfs.ko 2023-07-21T21:54:57.859 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/ 2023-07-21T21:54:57.859 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 89737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/sysv.ko 2023-07-21T21:54:57.859 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/ 2023-07-21T21:54:57.859 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 248049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/udf.ko 2023-07-21T21:54:57.859 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ 2023-07-21T21:54:57.860 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 160857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ufs.ko 2023-07-21T21:54:57.860 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/ 2023-07-21T21:54:57.860 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 3998129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/xfs.ko 2023-07-21T21:54:57.860 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/ 2023-07-21T21:54:57.860 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/ 2023-07-21T21:54:57.860 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 74865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/locktorture.ko 2023-07-21T21:54:57.860 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/ 2023-07-21T21:54:57.860 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/test_udelay.ko 2023-07-21T21:54:57.861 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 58473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/torture.ko 2023-07-21T21:54:57.861 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ 2023-07-21T21:54:57.861 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 6833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc-itu-t.ko 2023-07-21T21:54:57.861 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 6529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc7.ko 2023-07-21T21:54:57.861 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc8.ko 2023-07-21T21:54:57.861 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/ 2023-07-21T21:54:57.861 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libarc4.ko 2023-07-21T21:54:57.862 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libdes.ko 2023-07-21T21:54:57.862 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/interval_tree_test.ko 2023-07-21T21:54:57.862 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/libcrc32c.ko 2023-07-21T21:54:57.862 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lru_cache.ko 2023-07-21T21:54:57.862 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/ 2023-07-21T21:54:57.862 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4_compress.ko 2023-07-21T21:54:57.862 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4hc_compress.ko 2023-07-21T21:54:57.862 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/ 2023-07-21T21:54:57.863 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 6617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/cordic.ko 2023-07-21T21:54:57.863 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/memory-notifier-error-inject.ko 2023-07-21T21:54:57.863 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/notifier-error-inject.ko 2023-07-21T21:54:57.863 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/percpu_test.ko 2023-07-21T21:54:57.863 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/pm-notifier-error-inject.ko 2023-07-21T21:54:57.863 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/ 2023-07-21T21:54:57.863 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 143433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/raid6_pq.ko 2023-07-21T21:54:57.863 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/rbtree_test.ko 2023-07-21T21:54:57.864 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/ 2023-07-21T21:54:57.864 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-21T21:54:57.864 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-kstrtox.ko 2023-07-21T21:54:57.864 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-string_helpers.ko 2023-07-21T21:54:57.864 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 4760825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_bpf.ko 2023-07-21T21:54:57.864 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 49081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_firmware.ko 2023-07-21T21:54:57.865 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 6369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_module.ko 2023-07-21T21:54:57.865 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_user_copy.ko 2023-07-21T21:54:57.865 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_bm.ko 2023-07-21T21:54:57.865 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_fsm.ko 2023-07-21T21:54:57.865 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_kmp.ko 2023-07-21T21:54:57.865 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/ 2023-07-21T21:54:57.865 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/xz_dec_test.ko 2023-07-21T21:54:57.865 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/ 2023-07-21T21:54:57.866 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/hwpoison-inject.ko 2023-07-21T21:54:57.866 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ 2023-07-21T21:54:57.866 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/ 2023-07-21T21:54:57.866 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 55737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/6lowpan.ko 2023-07-21T21:54:57.866 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_dest.ko 2023-07-21T21:54:57.866 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_fragment.ko 2023-07-21T21:54:57.866 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_hop.ko 2023-07-21T21:54:57.866 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 6985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-21T21:54:57.867 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_mobility.ko 2023-07-21T21:54:57.867 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_routing.ko 2023-07-21T21:54:57.867 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_udp.ko 2023-07-21T21:54:57.867 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/ 2023-07-21T21:54:57.867 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/garp.ko 2023-07-21T21:54:57.867 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/mrp.ko 2023-07-21T21:54:57.868 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/p8022.ko 2023-07-21T21:54:57.868 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/psnap.ko 2023-07-21T21:54:57.868 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/stp.ko 2023-07-21T21:54:57.868 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/ 2023-07-21T21:54:57.868 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 81017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/8021q.ko 2023-07-21T21:54:57.868 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/ 2023-07-21T21:54:57.868 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 198417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet.ko 2023-07-21T21:54:57.869 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_fd.ko 2023-07-21T21:54:57.869 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_rdma.ko 2023-07-21T21:54:57.869 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_virtio.ko 2023-07-21T21:54:57.869 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/ 2023-07-21T21:54:57.869 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 652553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/batman-adv.ko 2023-07-21T21:54:57.869 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/ 2023-07-21T21:54:57.869 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 63825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/br_netfilter.ko 2023-07-21T21:54:57.869 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 772505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/bridge.ko 2023-07-21T21:54:57.870 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ 2023-07-21T21:54:57.870 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-21T21:54:57.870 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-21T21:54:57.870 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-21T21:54:57.870 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-21T21:54:57.870 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-21T21:54:57.870 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-21T21:54:57.870 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-21T21:54:57.871 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-21T21:54:57.871 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-21T21:54:57.871 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-21T21:54:57.871 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-21T21:54:57.871 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-21T21:54:57.871 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-21T21:54:57.871 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-21T21:54:57.872 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-21T21:54:57.872 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-21T21:54:57.872 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-21T21:54:57.872 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-21T21:54:57.872 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-21T21:54:57.872 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-21T21:54:57.872 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 55937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtables.ko 2023-07-21T21:54:57.872 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-21T21:54:57.873 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-21T21:54:57.873 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/ 2023-07-21T21:54:57.873 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 1046417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/libceph.ko 2023-07-21T21:54:57.873 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/ 2023-07-21T21:54:57.873 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 124793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/pktgen.ko 2023-07-21T21:54:57.873 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/ 2023-07-21T21:54:57.873 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 194321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp.ko 2023-07-21T21:54:57.874 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_diag.ko 2023-07-21T21:54:57.874 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 56945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv4.ko 2023-07-21T21:54:57.874 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 59457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv6.ko 2023-07-21T21:54:57.874 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/ 2023-07-21T21:54:57.874 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 390297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/dsa_core.ko 2023-07-21T21:54:57.874 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_brcm.ko 2023-07-21T21:54:57.874 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_dsa.ko 2023-07-21T21:54:57.874 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_none.ko 2023-07-21T21:54:57.875 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_trailer.ko 2023-07-21T21:54:57.875 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/ 2023-07-21T21:54:57.875 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 100257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/hsr.ko 2023-07-21T21:54:57.875 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ 2023-07-21T21:54:57.875 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ 2023-07-21T21:54:57.875 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 45169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-21T21:54:57.875 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 254601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154.ko 2023-07-21T21:54:57.876 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 47265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-21T21:54:57.876 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ 2023-07-21T21:54:57.876 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ah4.ko 2023-07-21T21:54:57.876 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/esp4.ko 2023-07-21T21:54:57.876 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 48345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/fou.ko 2023-07-21T21:54:57.876 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/gre.ko 2023-07-21T21:54:57.876 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 48529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/inet_diag.ko 2023-07-21T21:54:57.876 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 60529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_gre.ko 2023-07-21T21:54:57.877 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 61281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_tunnel.ko 2023-07-21T21:54:57.877 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_vti.ko 2023-07-21T21:54:57.877 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipcomp.ko 2023-07-21T21:54:57.877 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipip.ko 2023-07-21T21:54:57.877 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ 2023-07-21T21:54:57.877 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-21T21:54:57.877 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-21T21:54:57.877 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-21T21:54:57.878 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 41601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-21T21:54:57.878 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-21T21:54:57.878 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-21T21:54:57.878 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-21T21:54:57.878 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-21T21:54:57.878 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-21T21:54:57.878 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-21T21:54:57.879 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-21T21:54:57.879 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-21T21:54:57.879 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-21T21:54:57.879 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-21T21:54:57.879 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-21T21:54:57.879 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-21T21:54:57.879 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-21T21:54:57.879 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-21T21:54:57.880 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-21T21:54:57.880 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-21T21:54:57.880 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-21T21:54:57.880 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-21T21:54:57.880 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-21T21:54:57.880 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-21T21:54:57.880 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-21T21:54:57.881 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_bic.ko 2023-07-21T21:54:57.881 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_dctcp.ko 2023-07-21T21:54:57.881 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_diag.ko 2023-07-21T21:54:57.881 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_highspeed.ko 2023-07-21T21:54:57.881 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_htcp.ko 2023-07-21T21:54:57.881 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_hybla.ko 2023-07-21T21:54:57.881 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_illinois.ko 2023-07-21T21:54:57.881 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_lp.ko 2023-07-21T21:54:57.882 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_scalable.ko 2023-07-21T21:54:57.882 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_vegas.ko 2023-07-21T21:54:57.882 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_veno.ko 2023-07-21T21:54:57.882 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_westwood.ko 2023-07-21T21:54:57.882 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_yeah.ko 2023-07-21T21:54:57.882 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tunnel4.ko 2023-07-21T21:54:57.883 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_diag.ko 2023-07-21T21:54:57.883 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 41577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_tunnel.ko 2023-07-21T21:54:57.883 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-21T21:54:57.883 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ 2023-07-21T21:54:57.883 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ah6.ko 2023-07-21T21:54:57.883 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 39537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/esp6.ko 2023-07-21T21:54:57.883 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/fou6.ko 2023-07-21T21:54:57.883 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 80793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_gre.ko 2023-07-21T21:54:57.884 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 92817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_tunnel.ko 2023-07-21T21:54:57.884 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-21T21:54:57.884 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 54001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_vti.ko 2023-07-21T21:54:57.884 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ipcomp6.ko 2023-07-21T21:54:57.884 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/mip6.ko 2023-07-21T21:54:57.884 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ 2023-07-21T21:54:57.884 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 42209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-21T21:54:57.885 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-21T21:54:57.885 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-21T21:54:57.885 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-21T21:54:57.885 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-21T21:54:57.885 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-21T21:54:57.885 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-21T21:54:57.885 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-21T21:54:57.885 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-21T21:54:57.886 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-21T21:54:57.886 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-21T21:54:57.886 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-21T21:54:57.886 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-21T21:54:57.886 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-21T21:54:57.886 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-21T21:54:57.886 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-21T21:54:57.886 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-21T21:54:57.887 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-21T21:54:57.887 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-21T21:54:57.887 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-21T21:54:57.887 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-21T21:54:57.887 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-21T21:54:57.887 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-21T21:54:57.888 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-21T21:54:57.888 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-21T21:54:57.888 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 73161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/sit.ko 2023-07-21T21:54:57.888 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/tunnel6.ko 2023-07-21T21:54:57.888 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-21T21:54:57.888 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/ 2023-07-21T21:54:57.888 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 82929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/af_key.ko 2023-07-21T21:54:57.888 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/ 2023-07-21T21:54:57.889 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 125873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_core.ko 2023-07-21T21:54:57.889 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-21T21:54:57.889 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 25865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_eth.ko 2023-07-21T21:54:57.889 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip.ko 2023-07-21T21:54:57.889 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip6.ko 2023-07-21T21:54:57.889 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_netlink.ko 2023-07-21T21:54:57.889 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 53153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ppp.ko 2023-07-21T21:54:57.890 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/ 2023-07-21T21:54:57.890 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 48065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/lapb.ko 2023-07-21T21:54:57.890 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/ 2023-07-21T21:54:57.890 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc.ko 2023-07-21T21:54:57.890 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 267017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc2.ko 2023-07-21T21:54:57.890 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/ 2023-07-21T21:54:57.890 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 291041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/mac802154.ko 2023-07-21T21:54:57.891 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/ 2023-07-21T21:54:57.891 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/mpls_gso.ko 2023-07-21T21:54:57.891 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ 2023-07-21T21:54:57.891 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ 2023-07-21T21:54:57.891 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 119649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set.ko 2023-07-21T21:54:57.891 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-21T21:54:57.891 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-21T21:54:57.892 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-21T21:54:57.892 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 102033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-21T21:54:57.892 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 103121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-21T21:54:57.892 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 104593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-21T21:54:57.892 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 105129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-21T21:54:57.892 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 114393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-21T21:54:57.892 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 61161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-21T21:54:57.893 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 111161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-21T21:54:57.893 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 114673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-21T21:54:57.893 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 114329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-21T21:54:57.893 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 113217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-21T21:54:57.893 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 116217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-21T21:54:57.893 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-21T21:54:57.893 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ 2023-07-21T21:54:57.893 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 412481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-21T21:54:57.894 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-21T21:54:57.894 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-21T21:54:57.894 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-21T21:54:57.894 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-21T21:54:57.894 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-21T21:54:57.894 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-21T21:54:57.894 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-21T21:54:57.895 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-21T21:54:57.895 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-21T21:54:57.895 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-21T21:54:57.895 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-21T21:54:57.895 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-21T21:54:57.895 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-21T21:54:57.895 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 48897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conncount.ko 2023-07-21T21:54:57.896 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 408689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack.ko 2023-07-21T21:54:57.896 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-21T21:54:57.896 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-21T21:54:57.896 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-21T21:54:57.896 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 118145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-21T21:54:57.896 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-21T21:54:57.896 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-21T21:54:57.896 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 108393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-21T21:54:57.897 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-21T21:54:57.897 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-21T21:54:57.897 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 66641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-21T21:54:57.897 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-21T21:54:57.897 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-21T21:54:57.897 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-21T21:54:57.897 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 88513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table.ko 2023-07-21T21:54:57.898 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-21T21:54:57.898 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_log_syslog.ko 2023-07-21T21:54:57.898 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 95353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat.ko 2023-07-21T21:54:57.898 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-21T21:54:57.898 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-21T21:54:57.898 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_irc.ko 2023-07-21T21:54:57.898 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_sip.ko 2023-07-21T21:54:57.898 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-21T21:54:57.899 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 44025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-21T21:54:57.899 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 592185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_tables.ko 2023-07-21T21:54:57.899 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 43873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink.ko 2023-07-21T21:54:57.899 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-21T21:54:57.899 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-21T21:54:57.899 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 39905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_log.ko 2023-07-21T21:54:57.899 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-21T21:54:57.900 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 49673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-21T21:54:57.900 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_chain_nat.ko 2023-07-21T21:54:57.900 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_compat.ko 2023-07-21T21:54:57.900 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 40721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_ct.ko 2023-07-21T21:54:57.900 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-21T21:54:57.900 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fib.ko 2023-07-21T21:54:57.900 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-21T21:54:57.900 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_hash.ko 2023-07-21T21:54:57.901 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_limit.ko 2023-07-21T21:54:57.901 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_log.ko 2023-07-21T21:54:57.901 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_masq.ko 2023-07-21T21:54:57.901 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_nat.ko 2023-07-21T21:54:57.901 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_numgen.ko 2023-07-21T21:54:57.901 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_osf.ko 2023-07-21T21:54:57.901 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_queue.ko 2023-07-21T21:54:57.902 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_redir.ko 2023-07-21T21:54:57.902 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject.ko 2023-07-21T21:54:57.902 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject_inet.ko 2023-07-21T21:54:57.902 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_socket.ko 2023-07-21T21:54:57.902 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_synproxy.ko 2023-07-21T21:54:57.902 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_tproxy.ko 2023-07-21T21:54:57.902 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 89329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/x_tables.ko 2023-07-21T21:54:57.902 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_AUDIT.ko 2023-07-21T21:54:57.903 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-21T21:54:57.903 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-21T21:54:57.903 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-21T21:54:57.903 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 18169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CT.ko 2023-07-21T21:54:57.903 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_DSCP.ko 2023-07-21T21:54:57.903 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HL.ko 2023-07-21T21:54:57.903 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HMARK.ko 2023-07-21T21:54:57.903 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 38857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-21T21:54:57.904 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LED.ko 2023-07-21T21:54:57.904 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LOG.ko 2023-07-21T21:54:57.904 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-21T21:54:57.904 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NETMAP.ko 2023-07-21T21:54:57.904 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFLOG.ko 2023-07-21T21:54:57.904 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-21T21:54:57.904 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_RATEEST.ko 2023-07-21T21:54:57.905 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-21T21:54:57.905 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 14337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_SECMARK.ko 2023-07-21T21:54:57.905 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-21T21:54:57.905 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-21T21:54:57.905 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TEE.ko 2023-07-21T21:54:57.905 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TPROXY.ko 2023-07-21T21:54:57.905 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TRACE.ko 2023-07-21T21:54:57.905 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_addrtype.ko 2023-07-21T21:54:57.906 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_bpf.ko 2023-07-21T21:54:57.906 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cgroup.ko 2023-07-21T21:54:57.906 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cluster.ko 2023-07-21T21:54:57.906 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_comment.ko 2023-07-21T21:54:57.906 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connbytes.ko 2023-07-21T21:54:57.906 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlabel.ko 2023-07-21T21:54:57.906 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlimit.ko 2023-07-21T21:54:57.906 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connmark.ko 2023-07-21T21:54:57.907 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_conntrack.ko 2023-07-21T21:54:57.907 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cpu.ko 2023-07-21T21:54:57.907 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dccp.ko 2023-07-21T21:54:57.907 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_devgroup.ko 2023-07-21T21:54:57.907 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dscp.ko 2023-07-21T21:54:57.907 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ecn.ko 2023-07-21T21:54:57.907 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_esp.ko 2023-07-21T21:54:57.908 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 43457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hashlimit.ko 2023-07-21T21:54:57.908 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_helper.ko 2023-07-21T21:54:57.908 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hl.ko 2023-07-21T21:54:57.908 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipcomp.ko 2023-07-21T21:54:57.908 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_iprange.ko 2023-07-21T21:54:57.908 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipvs.ko 2023-07-21T21:54:57.908 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_l2tp.ko 2023-07-21T21:54:57.909 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_length.ko 2023-07-21T21:54:57.909 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_limit.ko 2023-07-21T21:54:57.909 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mac.ko 2023-07-21T21:54:57.909 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mark.ko 2023-07-21T21:54:57.909 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_multiport.ko 2023-07-21T21:54:57.909 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nat.ko 2023-07-21T21:54:57.909 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nfacct.ko 2023-07-21T21:54:57.909 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_osf.ko 2023-07-21T21:54:57.910 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_owner.ko 2023-07-21T21:54:57.910 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_physdev.ko 2023-07-21T21:54:57.910 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_pkttype.ko 2023-07-21T21:54:57.910 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_policy.ko 2023-07-21T21:54:57.910 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_quota.ko 2023-07-21T21:54:57.910 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_rateest.ko 2023-07-21T21:54:57.910 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_realm.ko 2023-07-21T21:54:57.910 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_recent.ko 2023-07-21T21:54:57.911 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_sctp.ko 2023-07-21T21:54:57.911 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 30089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_set.ko 2023-07-21T21:54:57.911 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_socket.ko 2023-07-21T21:54:57.911 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_state.ko 2023-07-21T21:54:57.911 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_statistic.ko 2023-07-21T21:54:57.911 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_string.ko 2023-07-21T21:54:57.911 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 8553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpmss.ko 2023-07-21T21:54:57.912 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpudp.ko 2023-07-21T21:54:57.912 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_time.ko 2023-07-21T21:54:57.912 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_u32.ko 2023-07-21T21:54:57.912 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/ 2023-07-21T21:54:57.912 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/netlink_diag.ko 2023-07-21T21:54:57.912 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/ 2023-07-21T21:54:57.912 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 12425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/nsh.ko 2023-07-21T21:54:57.912 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/ 2023-07-21T21:54:57.913 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 379545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/openvswitch.ko 2023-07-21T21:54:57.913 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-geneve.ko 2023-07-21T21:54:57.913 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-gre.ko 2023-07-21T21:54:57.913 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 11793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-vxlan.ko 2023-07-21T21:54:57.913 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/ 2023-07-21T21:54:57.913 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/af_packet_diag.ko 2023-07-21T21:54:57.913 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/ 2023-07-21T21:54:57.913 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 109961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/phonet.ko 2023-07-21T21:54:57.914 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 54761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/pn_pep.ko 2023-07-21T21:54:57.914 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/ 2023-07-21T21:54:57.914 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 252825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds.ko 2023-07-21T21:54:57.914 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 165081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_rdma.ko 2023-07-21T21:54:57.914 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 67241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_tcp.ko 2023-07-21T21:54:57.914 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/ 2023-07-21T21:54:57.914 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 820137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/rxrpc.ko 2023-07-21T21:54:57.915 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/ 2023-07-21T21:54:57.915 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_csum.ko 2023-07-21T21:54:57.915 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_gact.ko 2023-07-21T21:54:57.915 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_ipt.ko 2023-07-21T21:54:57.915 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 34057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_mirred.ko 2023-07-21T21:54:57.915 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_nat.ko 2023-07-21T21:54:57.915 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 43817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_pedit.ko 2023-07-21T21:54:57.915 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_police.ko 2023-07-21T21:54:57.916 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_simple.ko 2023-07-21T21:54:57.916 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_skbedit.ko 2023-07-21T21:54:57.916 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 36057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_vlan.ko 2023-07-21T21:54:57.916 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_basic.ko 2023-07-21T21:54:57.916 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_bpf.ko 2023-07-21T21:54:57.916 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_cgroup.ko 2023-07-21T21:54:57.916 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_flow.ko 2023-07-21T21:54:57.916 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_fw.ko 2023-07-21T21:54:57.917 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 37953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_route.ko 2023-07-21T21:54:57.917 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 59217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_u32.ko 2023-07-21T21:54:57.917 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_cmp.ko 2023-07-21T21:54:57.917 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_ipset.ko 2023-07-21T21:54:57.917 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_meta.ko 2023-07-21T21:54:57.917 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_nbyte.ko 2023-07-21T21:54:57.917 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_text.ko 2023-07-21T21:54:57.918 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_u32.ko 2023-07-21T21:54:57.918 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 21649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_choke.ko 2023-07-21T21:54:57.918 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_codel.ko 2023-07-21T21:54:57.918 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_drr.ko 2023-07-21T21:54:57.918 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 33609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq.ko 2023-07-21T21:54:57.918 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq_codel.ko 2023-07-21T21:54:57.918 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_gred.ko 2023-07-21T21:54:57.918 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 48409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hfsc.ko 2023-07-21T21:54:57.919 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hhf.ko 2023-07-21T21:54:57.919 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 65793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_htb.ko 2023-07-21T21:54:57.919 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 16065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_ingress.ko 2023-07-21T21:54:57.919 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 29809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio.ko 2023-07-21T21:54:57.919 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio_lib.ko 2023-07-21T21:54:57.919 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_multiq.ko 2023-07-21T21:54:57.919 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 35601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_netem.ko 2023-07-21T21:54:57.919 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_pie.ko 2023-07-21T21:54:57.920 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_plug.ko 2023-07-21T21:54:57.920 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 24729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_prio.ko 2023-07-21T21:54:57.920 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 47617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_qfq.ko 2023-07-21T21:54:57.920 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 32953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_red.ko 2023-07-21T21:54:57.920 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 26881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfb.ko 2023-07-21T21:54:57.920 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 31425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfq.ko 2023-07-21T21:54:57.920 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 28897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_tbf.ko 2023-07-21T21:54:57.921 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 27729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_teql.ko 2023-07-21T21:54:57.921 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/ 2023-07-21T21:54:57.921 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 930369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp.ko 2023-07-21T21:54:57.921 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 19033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp_diag.ko 2023-07-21T21:54:57.921 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/ 2023-07-21T21:54:57.921 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/ 2023-07-21T21:54:57.921 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 335569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-21T21:54:57.921 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 61833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-21T21:54:57.922 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 1514649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/sunrpc.ko 2023-07-21T21:54:57.922 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/ 2023-07-21T21:54:57.922 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 707401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-21T21:54:57.922 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/ 2023-07-21T21:54:57.922 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/diag.ko 2023-07-21T21:54:57.922 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 862233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/tipc.ko 2023-07-21T21:54:57.922 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/ 2023-07-21T21:54:57.922 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/unix_diag.ko 2023-07-21T21:54:57.923 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/ 2023-07-21T21:54:57.923 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 84841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-21T21:54:57.923 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 68033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-21T21:54:57.923 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 95985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock.ko 2023-07-21T21:54:57.923 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 10705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-21T21:54:57.923 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 17521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-21T21:54:57.923 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/ 2023-07-21T21:54:57.924 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 125097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/x25.ko 2023-07-21T21:54:57.924 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/ 2023-07-21T21:54:57.924 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 22657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_algo.ko 2023-07-21T21:54:57.924 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 20705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-21T21:54:57.924 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 102265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_user.ko 2023-07-21T21:54:57.924 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/ 2023-07-21T21:54:57.924 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/ 2023-07-21T21:54:57.925 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 15513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/irqbypass.ko 2023-07-21T21:54:57.925 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 638200 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias 2023-07-21T21:54:57.926 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 623896 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias.bin 2023-07-21T21:54:57.927 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 7656 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin 2023-07-21T21:54:57.927 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 23361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.alias.bin 2023-07-21T21:54:57.927 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 9821 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.bin 2023-07-21T21:54:57.927 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 69903 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.modinfo 2023-07-21T21:54:57.927 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 146449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep 2023-07-21T21:54:57.927 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 232695 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep.bin 2023-07-21T21:54:57.927 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 210 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.devname 2023-07-21T21:54:57.928 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 72754 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.order 2023-07-21T21:54:57.928 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 879 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.softdep 2023-07-21T21:54:57.928 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 252883 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols 2023-07-21T21:54:57.928 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 307884 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols.bin 2023-07-21T21:54:57.928 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/ 2023-07-21T21:54:57.928 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/ 2023-07-21T21:54:57.928 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/doc/ 2023-07-21T21:54:57.929 INFO:teuthology.orchestra.run.smithi150.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/ 2023-07-21T21:54:57.929 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 173 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/changelog.Debian.gz 2023-07-21T21:54:57.929 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r-- root/root 691 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/copyright 2023-07-21T21:54:57.930 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:54:57.930 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:54:57.930 DEBUG:teuthology.orchestra.run.smithi150:> egrep '(submenu|menuentry.*6.5.0-rc1-gc685da6f56cc).*{' /boot/grub/grub.cfg 2023-07-21T21:54:57.938 INFO:teuthology.orchestra.run.smithi150.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-21T21:54:57.938 INFO:teuthology.orchestra.run.smithi150.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-21T21:54:57.938 INFO:teuthology.orchestra.run.smithi150.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-21T21:54:57.939 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-21T21:54:57.939 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:54:57.939 DEBUG:teuthology.orchestra.run.smithi150:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-21T21:54:57.981 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi150.front.sepia.ceph.com to complete... 2023-07-21T21:54:58.662 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub' 2023-07-21T21:54:58.671 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-21T21:54:58.685 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2023-07-21T21:54:58.965 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:54:58.977 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:54:59.360 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-21T21:54:59.372 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-21T21:55:00.397 INFO:teuthology.orchestra.run.smithi150.stderr:done 2023-07-21T21:55:00.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-07-21T21:55:00.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:55:08.560 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-07-21T21:55:23.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-07-21T21:55:23.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:55:35.513 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-07-21T21:55:35.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-07-21T21:55:35.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:55:42.064 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-07-21T21:55:44.592 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-21T21:55:53.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-07-21T21:55:53.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:56:00.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-07-21T21:56:00.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:56:05.073 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-21T21:56:05.328 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-07-21T21:56:06.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-07-21T21:56:06.061 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.5.0-rc1-gc685da6f56cc"... 2023-07-21T21:56:06.061 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2023-07-21T21:56:06.126 INFO:teuthology.orchestra.run.smithi049.stdout:6.5.0-rc1-gc685da6f56cc 2023-07-21T21:56:06.126 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-gc685da6f56cc vs 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:56:06.126 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-21T21:56:06.127 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-21T21:56:07.127 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-07-21T21:56:07.128 DEBUG:teuthology.orchestra.run.smithi049:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-21T21:56:07.243 INFO:teuthology.orchestra.run.smithi049.stdout:ttyS1 2023-07-21T21:56:07.302 DEBUG:teuthology.parallel:result is None 2023-07-21T21:56:17.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-07-21T21:56:17.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:56:42.992 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-21T21:56:57.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-07-21T21:56:57.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:57:03.238 DEBUG:teuthology.orchestra.run.smithi150:> true 2023-07-21T21:57:03.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-07-21T21:57:03.975 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.5.0-rc1-gc685da6f56cc"... 2023-07-21T21:57:03.976 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2023-07-21T21:57:04.032 INFO:teuthology.orchestra.run.smithi150.stdout:6.5.0-rc1-gc685da6f56cc 2023-07-21T21:57:04.032 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-gc685da6f56cc vs 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:57:04.032 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-21T21:57:04.033 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-21T21:57:05.033 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-07-21T21:57:05.034 DEBUG:teuthology.orchestra.run.smithi150:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-21T21:57:05.145 INFO:teuthology.orchestra.run.smithi150.stdout:ttyS1 2023-07-21T21:57:05.197 DEBUG:teuthology.parallel:result is None 2023-07-21T21:57:05.198 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-21T21:57:05.207 INFO:teuthology.task.internal:Creating test directory... 2023-07-21T21:57:05.207 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-21T21:57:05.216 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-21T21:57:05.234 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-21T21:57:05.250 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-21T21:57:05.301 INFO:teuthology.task.internal:Creating archive directory... 2023-07-21T21:57:05.301 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-21T21:57:05.310 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-21T21:57:05.342 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-21T21:57:05.357 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-21T21:57:05.358 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-21T21:57:05.391 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-21T21:57:05.434 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T21:57:05.438 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T21:57:05.457 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T21:57:05.460 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T21:57:05.465 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-21T21:57:05.473 INFO:teuthology.task.internal:Configuring sudo... 2023-07-21T21:57:05.474 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-21T21:57:05.510 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-21T21:57:05.547 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-21T21:57:05.558 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-21T21:57:05.558 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-21T21:57:05.591 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-21T21:57:05.613 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T21:57:05.666 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T21:57:05.731 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T21:57:05.732 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-21T21:57:05.813 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T21:57:05.833 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T21:57:05.899 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T21:57:05.899 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-21T21:57:05.986 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2023-07-21T21:57:05.993 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2023-07-21T21:57:06.152 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-21T21:57:06.160 INFO:teuthology.task.internal:Starting timer... 2023-07-21T21:57:06.160 INFO:teuthology.run_tasks:Running task pcp... 2023-07-21T21:57:06.190 INFO:teuthology.run_tasks:Running task selinux... 2023-07-21T21:57:06.238 DEBUG:teuthology.task.selinux:Excluding smithi049: OS 'ubuntu' does not support SELinux 2023-07-21T21:57:06.238 DEBUG:teuthology.task.selinux:Excluding smithi150: OS 'ubuntu' does not support SELinux 2023-07-21T21:57:06.239 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-21T21:57:06.239 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-07-21T21:57:06.239 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-21T21:57:06.239 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-21T21:57:06.293 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-21T21:57:06.300 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-21T21:57:06.442 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-21T21:57:06.472 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-21T21:57:06.473 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com,smithi150.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-21T22:04:55.012 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com')] 2023-07-21T22:04:55.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-07-21T22:04:55.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:04:55.123 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-07-21T22:04:55.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-07-21T22:04:55.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-07-21T22:04:55.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:04:55.463 DEBUG:teuthology.orchestra.run.smithi150:> true 2023-07-21T22:04:55.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-07-21T22:04:55.712 INFO:teuthology.run_tasks:Running task clock... 2023-07-21T22:04:55.722 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-21T22:04:55.723 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-21T22:04:55.723 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T22:04:55.731 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-21T22:04:55.731 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T22:04:55.798 INFO:teuthology.orchestra.run.smithi049.stdout:21 Jul 22:04:55 ntpd[22003]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-07-21T22:04:55.798 INFO:teuthology.orchestra.run.smithi049.stdout:21 Jul 22:04:55 ntpd[22003]: Command line: ntpd -gq 2023-07-21T22:04:55.799 INFO:teuthology.orchestra.run.smithi049.stdout:21 Jul 22:04:55 ntpd[22003]: proto: precision = 0.057 usec (-24) 2023-07-21T22:04:55.799 INFO:teuthology.orchestra.run.smithi049.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-21T22:04:55.800 INFO:teuthology.orchestra.run.smithi049.stdout:21 Jul 22:04:55 ntpd[22003]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-21T22:04:55.800 INFO:teuthology.orchestra.run.smithi049.stdout:21 Jul 22:04:55 ntpd[22003]: restrict ::: KOD does nothing without LIMITED. 2023-07-21T22:04:55.800 INFO:teuthology.orchestra.run.smithi049.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-21T22:04:55.801 INFO:teuthology.orchestra.run.smithi049.stdout:21 Jul 22:04:55 ntpd[22003]: Listen and drop on 0 v6wildcard [::]:123 2023-07-21T22:04:55.801 INFO:teuthology.orchestra.run.smithi049.stdout:21 Jul 22:04:55 ntpd[22003]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-21T22:04:55.801 INFO:teuthology.orchestra.run.smithi049.stdout:21 Jul 22:04:55 ntpd[22003]: Listen normally on 2 lo 127.0.0.1:123 2023-07-21T22:04:55.802 INFO:teuthology.orchestra.run.smithi049.stdout:21 Jul 22:04:55 ntpd[22003]: Listen normally on 3 ens1f0 172.21.15.49:123 2023-07-21T22:04:55.802 INFO:teuthology.orchestra.run.smithi049.stdout:21 Jul 22:04:55 ntpd[22003]: Listen normally on 4 lo [::1]:123 2023-07-21T22:04:55.802 INFO:teuthology.orchestra.run.smithi049.stdout:21 Jul 22:04:55 ntpd[22003]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1566%4]:123 2023-07-21T22:04:55.802 INFO:teuthology.orchestra.run.smithi049.stdout:21 Jul 22:04:55 ntpd[22003]: Listening on routing socket on fd #22 for interface updates 2023-07-21T22:04:55.835 INFO:teuthology.orchestra.run.smithi150.stdout:21 Jul 22:04:55 ntpd[22114]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-07-21T22:04:55.836 INFO:teuthology.orchestra.run.smithi150.stdout:21 Jul 22:04:55 ntpd[22114]: Command line: ntpd -gq 2023-07-21T22:04:55.838 INFO:teuthology.orchestra.run.smithi150.stdout:21 Jul 22:04:55 ntpd[22114]: proto: precision = 0.041 usec (-24) 2023-07-21T22:04:55.838 INFO:teuthology.orchestra.run.smithi150.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-21T22:04:55.838 INFO:teuthology.orchestra.run.smithi150.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-21T22:04:55.839 INFO:teuthology.orchestra.run.smithi150.stdout:21 Jul 22:04:55 ntpd[22114]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-21T22:04:55.839 INFO:teuthology.orchestra.run.smithi150.stdout:21 Jul 22:04:55 ntpd[22114]: restrict ::: KOD does nothing without LIMITED. 2023-07-21T22:04:55.839 INFO:teuthology.orchestra.run.smithi150.stdout:21 Jul 22:04:55 ntpd[22114]: Listen and drop on 0 v6wildcard [::]:123 2023-07-21T22:04:55.840 INFO:teuthology.orchestra.run.smithi150.stdout:21 Jul 22:04:55 ntpd[22114]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-21T22:04:55.840 INFO:teuthology.orchestra.run.smithi150.stdout:21 Jul 22:04:55 ntpd[22114]: Listen normally on 2 lo 127.0.0.1:123 2023-07-21T22:04:55.840 INFO:teuthology.orchestra.run.smithi150.stdout:21 Jul 22:04:55 ntpd[22114]: Listen normally on 3 enp3s0f1 172.21.15.150:123 2023-07-21T22:04:55.840 INFO:teuthology.orchestra.run.smithi150.stdout:21 Jul 22:04:55 ntpd[22114]: Listen normally on 4 lo [::1]:123 2023-07-21T22:04:55.840 INFO:teuthology.orchestra.run.smithi150.stdout:21 Jul 22:04:55 ntpd[22114]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e35%5]:123 2023-07-21T22:04:55.840 INFO:teuthology.orchestra.run.smithi150.stdout:21 Jul 22:04:55 ntpd[22114]: Listening on routing socket on fd #22 for interface updates 2023-07-21T22:04:56.798 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:56 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:04:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:56 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:04:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:56 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:04:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:56 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:04:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:56 ntpd[22003]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:04:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:56 ntpd[22003]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:04:56.836 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:04:56 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:04:56.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:04:56 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:04:57.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:57 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:04:57.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:57 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:04:57.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:57 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:04:57.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:57 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:04:57.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:57 ntpd[22003]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:04:57.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:57 ntpd[22003]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:04:58.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:58 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:04:58.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:58 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:04:58.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:58 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:04:58.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:58 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:04:58.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:58 ntpd[22003]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:04:58.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:58 ntpd[22003]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:04:58.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:04:58 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:04:58.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:04:58 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:04:58.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:04:58 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:04:58.838 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:04:58 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:04:58.838 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:04:58 ntpd[22114]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:04:58.838 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:04:58 ntpd[22114]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:04:59.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:59 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:04:59.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:59 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:04:59.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:59 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:04:59.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:59 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:04:59.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:59 ntpd[22003]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:04:59.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:04:59 ntpd[22003]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:04:59.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:04:59 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:04:59.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:04:59 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:04:59.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:04:59 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:04:59.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:04:59 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:04:59.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:04:59 ntpd[22114]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:04:59.838 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:04:59 ntpd[22114]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:05:00.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:00 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:00.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:00 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:00.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:00 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:00.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:00 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:00.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:00 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:00.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:00 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:00.801 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:00 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:00.801 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:00 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:00.801 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:00 ntpd[22003]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:05:00.801 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:00 ntpd[22003]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:05:00.801 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:00 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:00.801 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:00 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:00.802 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:00 ntpd[22003]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:05:00.802 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:00 ntpd[22003]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:05:00.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:00 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:00.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:00 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:00.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:00 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:00.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:00 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:00.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:00 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:00.838 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:00 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:00.838 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:00 ntpd[22114]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:05:00.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:00 ntpd[22114]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:05:00.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:00 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:00.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:00 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:00.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:00 ntpd[22114]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:05:00.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:00 ntpd[22114]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:05:01.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:01 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:01.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:01 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:01.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:01 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:01.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:01 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:01.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:01 ntpd[22003]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:05:01.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:01 ntpd[22003]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:05:01.836 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:01 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:01.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:01 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:01.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:01 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:01.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:01 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:01.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:01 ntpd[22114]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:05:01.838 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:01 ntpd[22114]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:05:02.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:02 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:02.799 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:02 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:02.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:02 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:02.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:02 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:02.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:02 ntpd[22003]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:02.800 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:02 ntpd[22003]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:02.801 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:02 ntpd[22003]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:05:02.801 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:02 ntpd[22003]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:05:02.801 INFO:teuthology.orchestra.run.smithi049.stdout:21 Jul 22:05:02 ntpd[22003]: ntpd: time slew -0.002190 s 2023-07-21T22:05:02.801 INFO:teuthology.orchestra.run.smithi049.stdout:ntpd: time slew -0.002190s 2023-07-21T22:05:02.802 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:02 ntpd[22003]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-21T22:05:02.802 INFO:teuthology.orchestra.run.smithi049.stderr:21 Jul 22:05:02 ntpd[22003]: can't open /var/log/ntpstats/loopstats.20230721: Permission denied 2023-07-21T22:05:02.838 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:02 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:02.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:02 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:02.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:02 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:02.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:02 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:02.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:02 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:02.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:02 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:02.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:02 ntpd[22114]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:05:02.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:02 ntpd[22114]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:05:02.840 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:02 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:02.840 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:02 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:02.840 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:02 ntpd[22114]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:05:02.840 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:02 ntpd[22114]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:05:02.942 INFO:teuthology.orchestra.run.smithi049.stdout: remote refid st t when poll reach delay offset jitter 2023-07-21T22:05:02.942 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================== 2023-07-21T22:05:02.942 INFO:teuthology.orchestra.run.smithi049.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T22:05:02.942 INFO:teuthology.orchestra.run.smithi049.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T22:05:02.942 INFO:teuthology.orchestra.run.smithi049.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T22:05:02.943 INFO:teuthology.orchestra.run.smithi049.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T22:05:03.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:03 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:03.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:03 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:03.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:03 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:03.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:03 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:03.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:03 ntpd[22114]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:05:03.838 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:03 ntpd[22114]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:05:04.836 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:04 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:04.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:04 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:04.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:04 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:04.837 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:04 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:04.838 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:04 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:04.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:04 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:04.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:04 ntpd[22114]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:05:04.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:04 ntpd[22114]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:05:04.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:04 ntpd[22114]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:05:04.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:04 ntpd[22114]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:05:04.839 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:04 ntpd[22114]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:05:04.840 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:04 ntpd[22114]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:05:04.840 INFO:teuthology.orchestra.run.smithi150.stdout:21 Jul 22:05:04 ntpd[22114]: ntpd: time slew +0.001335 s 2023-07-21T22:05:04.840 INFO:teuthology.orchestra.run.smithi150.stdout:ntpd: time slew +0.001335s 2023-07-21T22:05:04.841 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:04 ntpd[22114]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-21T22:05:04.841 INFO:teuthology.orchestra.run.smithi150.stderr:21 Jul 22:05:04 ntpd[22114]: can't open /var/log/ntpstats/loopstats.20230721: Permission denied 2023-07-21T22:05:04.984 INFO:teuthology.orchestra.run.smithi150.stdout: remote refid st t when poll reach delay offset jitter 2023-07-21T22:05:04.984 INFO:teuthology.orchestra.run.smithi150.stdout:============================================================================== 2023-07-21T22:05:04.984 INFO:teuthology.orchestra.run.smithi150.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T22:05:04.985 INFO:teuthology.orchestra.run.smithi150.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T22:05:04.985 INFO:teuthology.orchestra.run.smithi150.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T22:05:04.985 INFO:teuthology.orchestra.run.smithi150.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T22:05:04.986 INFO:teuthology.run_tasks:Running task install... 2023-07-21T22:05:04.996 DEBUG:teuthology.task.install:project ceph 2023-07-21T22:05:04.997 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea'}} 2023-07-21T22:05:04.997 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea'} 2023-07-21T22:05:04.998 INFO:teuthology.task.install:Using flavor: default 2023-07-21T22:05:05.003 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-21T22:05:05.004 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-21T22:05:05.004 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-key list | grep Ceph 2023-07-21T22:05:05.005 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-key list | grep Ceph 2023-07-21T22:05:05.235 INFO:teuthology.orchestra.run.smithi150.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-07-21T22:05:05.265 INFO:teuthology.orchestra.run.smithi049.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-07-21T22:05:05.382 INFO:teuthology.orchestra.run.smithi150.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-21T22:05:05.383 INFO:teuthology.orchestra.run.smithi150.stdout:uid [ unknown] Ceph.com (release key) 2023-07-21T22:05:05.384 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-21T22:05:05.384 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-21T22:05:05.386 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:05:10.394 INFO:teuthology.orchestra.run.smithi049.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-21T22:05:10.394 INFO:teuthology.orchestra.run.smithi049.stdout:uid [ unknown] Ceph.com (release key) 2023-07-21T22:05:10.394 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-21T22:05:10.395 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-21T22:05:10.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:05:10.961 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default/ 2023-07-21T22:05:10.961 INFO:teuthology.task.install.deb:Package version is 18.0.0-4735-gbffe049d-1focal 2023-07-21T22:05:15.971 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default/ 2023-07-21T22:05:15.972 INFO:teuthology.task.install.deb:Package version is 18.0.0-4735-gbffe049d-1focal 2023-07-21T22:05:16.510 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:05:16.511 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-21T22:05:16.525 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:05:16.526 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-21T22:05:16.545 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2023-07-21T22:05:16.563 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get update 2023-07-21T22:05:17.102 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-21T22:05:17.103 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-07-21T22:05:17.115 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-21T22:05:17.116 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-07-21T22:05:17.196 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-07-21T22:05:17.197 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-07-21T22:05:17.307 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-07-21T22:05:17.310 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-07-21T22:05:17.373 INFO:teuthology.orchestra.run.smithi049.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal InRelease 2023-07-21T22:05:17.374 INFO:teuthology.orchestra.run.smithi150.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal InRelease 2023-07-21T22:05:17.496 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-07-21T22:05:17.496 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-07-21T22:05:17.635 INFO:teuthology.orchestra.run.smithi150.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal Release.gpg 2023-07-21T22:05:17.637 INFO:teuthology.orchestra.run.smithi049.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal Release.gpg 2023-07-21T22:05:17.763 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-07-21T22:05:17.765 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-07-21T22:05:17.917 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main i386 Packages [3,405 B] 2023-07-21T22:05:17.930 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main i386 Packages [3,405 B] 2023-07-21T22:05:18.543 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 28.4 kB in 2s (17.1 kB/s) 2023-07-21T22:05:18.598 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 28.4 kB in 2s (16.6 kB/s) 2023-07-21T22:05:19.740 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2023-07-21T22:05:19.778 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4735-gbffe049d-1focal cephadm=18.0.0-4735-gbffe049d-1focal ceph-mds=18.0.0-4735-gbffe049d-1focal ceph-mgr=18.0.0-4735-gbffe049d-1focal ceph-common=18.0.0-4735-gbffe049d-1focal ceph-fuse=18.0.0-4735-gbffe049d-1focal ceph-test=18.0.0-4735-gbffe049d-1focal ceph-volume=18.0.0-4735-gbffe049d-1focal radosgw=18.0.0-4735-gbffe049d-1focal python3-rados=18.0.0-4735-gbffe049d-1focal python3-rgw=18.0.0-4735-gbffe049d-1focal python3-cephfs=18.0.0-4735-gbffe049d-1focal python3-rbd=18.0.0-4735-gbffe049d-1focal libcephfs2=18.0.0-4735-gbffe049d-1focal libcephfs-dev=18.0.0-4735-gbffe049d-1focal librados2=18.0.0-4735-gbffe049d-1focal librbd1=18.0.0-4735-gbffe049d-1focal rbd-fuse=18.0.0-4735-gbffe049d-1focal python3-cephfs=18.0.0-4735-gbffe049d-1focal cephfs-shell=18.0.0-4735-gbffe049d-1focal cephfs-top=18.0.0-4735-gbffe049d-1focal cephfs-mirror=18.0.0-4735-gbffe049d-1focal 2023-07-21T22:05:19.838 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2023-07-21T22:05:19.884 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4735-gbffe049d-1focal cephadm=18.0.0-4735-gbffe049d-1focal ceph-mds=18.0.0-4735-gbffe049d-1focal ceph-mgr=18.0.0-4735-gbffe049d-1focal ceph-common=18.0.0-4735-gbffe049d-1focal ceph-fuse=18.0.0-4735-gbffe049d-1focal ceph-test=18.0.0-4735-gbffe049d-1focal ceph-volume=18.0.0-4735-gbffe049d-1focal radosgw=18.0.0-4735-gbffe049d-1focal python3-rados=18.0.0-4735-gbffe049d-1focal python3-rgw=18.0.0-4735-gbffe049d-1focal python3-cephfs=18.0.0-4735-gbffe049d-1focal python3-rbd=18.0.0-4735-gbffe049d-1focal libcephfs2=18.0.0-4735-gbffe049d-1focal libcephfs-dev=18.0.0-4735-gbffe049d-1focal librados2=18.0.0-4735-gbffe049d-1focal librbd1=18.0.0-4735-gbffe049d-1focal rbd-fuse=18.0.0-4735-gbffe049d-1focal python3-cephfs=18.0.0-4735-gbffe049d-1focal cephfs-shell=18.0.0-4735-gbffe049d-1focal cephfs-top=18.0.0-4735-gbffe049d-1focal cephfs-mirror=18.0.0-4735-gbffe049d-1focal 2023-07-21T22:05:19.894 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2023-07-21T22:05:20.004 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2023-07-21T22:05:20.088 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2023-07-21T22:05:20.089 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2023-07-21T22:05:20.199 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2023-07-21T22:05:20.200 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2023-07-21T22:05:20.274 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2023-07-21T22:05:20.275 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-21T22:05:20.275 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-21T22:05:20.275 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2023-07-21T22:05:20.275 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-21T22:05:20.276 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-07-21T22:05:20.277 INFO:teuthology.orchestra.run.smithi150.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-07-21T22:05:20.277 INFO:teuthology.orchestra.run.smithi150.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-07-21T22:05:20.277 INFO:teuthology.orchestra.run.smithi150.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-07-21T22:05:20.277 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-07-21T22:05:20.277 INFO:teuthology.orchestra.run.smithi150.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-21T22:05:20.277 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-21T22:05:20.277 INFO:teuthology.orchestra.run.smithi150.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-21T22:05:20.278 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-07-21T22:05:20.278 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-07-21T22:05:20.278 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-07-21T22:05:20.278 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-07-21T22:05:20.278 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-07-21T22:05:20.278 INFO:teuthology.orchestra.run.smithi150.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-21T22:05:20.278 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-07-21T22:05:20.279 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-07-21T22:05:20.279 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-07-21T22:05:20.279 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-21T22:05:20.279 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-21T22:05:20.280 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-21T22:05:20.280 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-21T22:05:20.280 INFO:teuthology.orchestra.run.smithi150.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-21T22:05:20.281 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2023-07-21T22:05:20.281 INFO:teuthology.orchestra.run.smithi150.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-07-21T22:05:20.281 INFO:teuthology.orchestra.run.smithi150.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-07-21T22:05:20.281 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-07-21T22:05:20.281 INFO:teuthology.orchestra.run.smithi150.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-07-21T22:05:20.282 INFO:teuthology.orchestra.run.smithi150.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-07-21T22:05:20.282 INFO:teuthology.orchestra.run.smithi150.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-07-21T22:05:20.282 INFO:teuthology.orchestra.run.smithi150.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-07-21T22:05:20.282 INFO:teuthology.orchestra.run.smithi150.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-07-21T22:05:20.283 INFO:teuthology.orchestra.run.smithi150.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-07-21T22:05:20.283 INFO:teuthology.orchestra.run.smithi150.stdout:Recommended packages: 2023-07-21T22:05:20.283 INFO:teuthology.orchestra.run.smithi150.stdout: btrfs-tools 2023-07-21T22:05:20.385 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2023-07-21T22:05:20.386 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-21T22:05:20.386 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-21T22:05:20.386 INFO:teuthology.orchestra.run.smithi049.stdout:The following additional packages will be installed: 2023-07-21T22:05:20.386 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-21T22:05:20.387 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-07-21T22:05:20.387 INFO:teuthology.orchestra.run.smithi049.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-07-21T22:05:20.387 INFO:teuthology.orchestra.run.smithi049.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-07-21T22:05:20.387 INFO:teuthology.orchestra.run.smithi049.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-07-21T22:05:20.388 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-07-21T22:05:20.388 INFO:teuthology.orchestra.run.smithi049.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-21T22:05:20.388 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-21T22:05:20.388 INFO:teuthology.orchestra.run.smithi049.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-21T22:05:20.388 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-07-21T22:05:20.388 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-07-21T22:05:20.388 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-07-21T22:05:20.389 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-07-21T22:05:20.389 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-07-21T22:05:20.389 INFO:teuthology.orchestra.run.smithi049.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-21T22:05:20.389 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-07-21T22:05:20.389 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-07-21T22:05:20.389 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-07-21T22:05:20.389 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-21T22:05:20.389 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-21T22:05:20.390 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-21T22:05:20.390 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-21T22:05:20.390 INFO:teuthology.orchestra.run.smithi049.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-21T22:05:20.390 INFO:teuthology.orchestra.run.smithi049.stdout:Suggested packages: 2023-07-21T22:05:20.391 INFO:teuthology.orchestra.run.smithi049.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-07-21T22:05:20.391 INFO:teuthology.orchestra.run.smithi049.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-07-21T22:05:20.391 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-07-21T22:05:20.391 INFO:teuthology.orchestra.run.smithi049.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-07-21T22:05:20.391 INFO:teuthology.orchestra.run.smithi049.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-07-21T22:05:20.391 INFO:teuthology.orchestra.run.smithi049.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-07-21T22:05:20.391 INFO:teuthology.orchestra.run.smithi049.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-07-21T22:05:20.392 INFO:teuthology.orchestra.run.smithi049.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-07-21T22:05:20.392 INFO:teuthology.orchestra.run.smithi049.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-07-21T22:05:20.392 INFO:teuthology.orchestra.run.smithi049.stdout:Recommended packages: 2023-07-21T22:05:20.392 INFO:teuthology.orchestra.run.smithi049.stdout: btrfs-tools 2023-07-21T22:05:20.477 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2023-07-21T22:05:20.478 INFO:teuthology.orchestra.run.smithi150.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-21T22:05:20.478 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-21T22:05:20.478 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-21T22:05:20.479 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-07-21T22:05:20.479 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-07-21T22:05:20.479 INFO:teuthology.orchestra.run.smithi150.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-07-21T22:05:20.479 INFO:teuthology.orchestra.run.smithi150.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-07-21T22:05:20.479 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-07-21T22:05:20.479 INFO:teuthology.orchestra.run.smithi150.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-21T22:05:20.479 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-21T22:05:20.480 INFO:teuthology.orchestra.run.smithi150.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-21T22:05:20.480 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-07-21T22:05:20.480 INFO:teuthology.orchestra.run.smithi150.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-07-21T22:05:20.480 INFO:teuthology.orchestra.run.smithi150.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-07-21T22:05:20.481 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-21T22:05:20.481 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-21T22:05:20.481 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-21T22:05:20.481 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-21T22:05:20.481 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-07-21T22:05:20.481 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-07-21T22:05:20.482 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-21T22:05:20.482 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-21T22:05:20.482 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-21T22:05:20.482 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-21T22:05:20.482 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-21T22:05:20.482 INFO:teuthology.orchestra.run.smithi150.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-07-21T22:05:20.483 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages will be upgraded: 2023-07-21T22:05:20.483 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 librbd1 2023-07-21T22:05:20.602 INFO:teuthology.orchestra.run.smithi049.stdout:The following NEW packages will be installed: 2023-07-21T22:05:20.603 INFO:teuthology.orchestra.run.smithi049.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-21T22:05:20.603 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-21T22:05:20.603 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-21T22:05:20.603 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-07-21T22:05:20.603 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-07-21T22:05:20.604 INFO:teuthology.orchestra.run.smithi049.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-07-21T22:05:20.604 INFO:teuthology.orchestra.run.smithi049.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-07-21T22:05:20.605 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-07-21T22:05:20.605 INFO:teuthology.orchestra.run.smithi049.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-21T22:05:20.605 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-21T22:05:20.605 INFO:teuthology.orchestra.run.smithi049.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-21T22:05:20.605 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-07-21T22:05:20.605 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-07-21T22:05:20.605 INFO:teuthology.orchestra.run.smithi049.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-07-21T22:05:20.606 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-21T22:05:20.606 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-21T22:05:20.606 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-21T22:05:20.606 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-21T22:05:20.606 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-07-21T22:05:20.606 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-07-21T22:05:20.606 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-21T22:05:20.606 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-21T22:05:20.607 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-21T22:05:20.607 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-21T22:05:20.607 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-21T22:05:20.607 INFO:teuthology.orchestra.run.smithi049.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-07-21T22:05:20.607 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages will be upgraded: 2023-07-21T22:05:20.608 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 librbd1 2023-07-21T22:05:20.746 INFO:teuthology.orchestra.run.smithi150.stdout:2 upgraded, 116 newly installed, 0 to remove and 210 not upgraded. 2023-07-21T22:05:20.747 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 210 MB of archives. 2023-07-21T22:05:20.747 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 1,039 MB of additional disk space will be used. 2023-07-21T22:05:20.747 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-07-21T22:05:20.850 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-07-21T22:05:20.895 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-07-21T22:05:20.993 INFO:teuthology.orchestra.run.smithi049.stdout:2 upgraded, 116 newly installed, 0 to remove and 210 not upgraded. 2023-07-21T22:05:20.993 INFO:teuthology.orchestra.run.smithi049.stdout:Need to get 210 MB of archives. 2023-07-21T22:05:20.993 INFO:teuthology.orchestra.run.smithi049.stdout:After this operation, 1,039 MB of additional disk space will be used. 2023-07-21T22:05:20.993 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-07-21T22:05:21.048 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-07-21T22:05:21.155 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-4735-gbffe049d-1focal [3,431 kB] 2023-07-21T22:05:21.156 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-07-21T22:05:21.221 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-07-21T22:05:21.224 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-07-21T22:05:21.244 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-07-21T22:05:21.288 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-4735-gbffe049d-1focal [3,431 kB] 2023-07-21T22:05:21.327 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-07-21T22:05:21.481 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-07-21T22:05:21.599 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-07-21T22:05:21.612 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-07-21T22:05:21.649 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-07-21T22:05:21.660 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-07-21T22:05:21.661 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-07-21T22:05:21.669 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-07-21T22:05:21.671 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-07-21T22:05:21.691 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-07-21T22:05:21.692 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-07-21T22:05:21.721 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-07-21T22:05:21.782 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-07-21T22:05:21.814 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-07-21T22:05:21.816 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-07-21T22:05:21.817 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-07-21T22:05:21.820 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-21T22:05:21.820 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-07-21T22:05:21.820 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-07-21T22:05:21.821 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-07-21T22:05:21.823 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-07-21T22:05:21.823 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-07-21T22:05:21.837 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-07-21T22:05:21.942 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-07-21T22:05:21.943 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-07-21T22:05:21.954 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-07-21T22:05:21.954 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-07-21T22:05:21.955 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-07-21T22:05:21.955 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-07-21T22:05:21.956 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-07-21T22:05:21.957 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-07-21T22:05:21.960 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-07-21T22:05:21.963 INFO:teuthology.orchestra.run.smithi150.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-07-21T22:05:22.074 INFO:teuthology.orchestra.run.smithi150.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-07-21T22:05:22.080 INFO:teuthology.orchestra.run.smithi150.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-07-21T22:05:22.084 INFO:teuthology.orchestra.run.smithi150.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-07-21T22:05:22.084 INFO:teuthology.orchestra.run.smithi150.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-07-21T22:05:22.085 INFO:teuthology.orchestra.run.smithi150.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-21T22:05:22.086 INFO:teuthology.orchestra.run.smithi150.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-07-21T22:05:22.179 INFO:teuthology.orchestra.run.smithi150.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-07-21T22:05:22.182 INFO:teuthology.orchestra.run.smithi150.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-07-21T22:05:22.186 INFO:teuthology.orchestra.run.smithi150.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-07-21T22:05:22.187 INFO:teuthology.orchestra.run.smithi150.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-07-21T22:05:22.274 INFO:teuthology.orchestra.run.smithi150.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-07-21T22:05:22.384 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-07-21T22:05:22.405 INFO:teuthology.orchestra.run.smithi049.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-07-21T22:05:22.455 INFO:teuthology.orchestra.run.smithi049.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-07-21T22:05:22.472 INFO:teuthology.orchestra.run.smithi049.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-07-21T22:05:22.619 INFO:teuthology.orchestra.run.smithi150.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-07-21T22:05:22.701 INFO:teuthology.orchestra.run.smithi150.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-07-21T22:05:22.703 INFO:teuthology.orchestra.run.smithi150.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-07-21T22:05:22.733 INFO:teuthology.orchestra.run.smithi150.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-07-21T22:05:22.734 INFO:teuthology.orchestra.run.smithi150.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-07-21T22:05:22.753 INFO:teuthology.orchestra.run.smithi150.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-07-21T22:05:22.754 INFO:teuthology.orchestra.run.smithi150.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-07-21T22:05:22.755 INFO:teuthology.orchestra.run.smithi150.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-07-21T22:05:22.757 INFO:teuthology.orchestra.run.smithi150.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-07-21T22:05:22.757 INFO:teuthology.orchestra.run.smithi150.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-07-21T22:05:22.789 INFO:teuthology.orchestra.run.smithi049.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-07-21T22:05:22.814 INFO:teuthology.orchestra.run.smithi150.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-07-21T22:05:22.815 INFO:teuthology.orchestra.run.smithi150.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-07-21T22:05:22.855 INFO:teuthology.orchestra.run.smithi150.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-4735-gbffe049d-1focal [3,989 kB] 2023-07-21T22:05:22.921 INFO:teuthology.orchestra.run.smithi150.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-07-21T22:05:22.927 INFO:teuthology.orchestra.run.smithi150.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-07-21T22:05:22.930 INFO:teuthology.orchestra.run.smithi150.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-07-21T22:05:22.933 INFO:teuthology.orchestra.run.smithi150.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-07-21T22:05:22.934 INFO:teuthology.orchestra.run.smithi150.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-07-21T22:05:22.938 INFO:teuthology.orchestra.run.smithi150.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-07-21T22:05:22.941 INFO:teuthology.orchestra.run.smithi150.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-07-21T22:05:22.942 INFO:teuthology.orchestra.run.smithi150.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-07-21T22:05:23.036 INFO:teuthology.orchestra.run.smithi150.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-07-21T22:05:23.039 INFO:teuthology.orchestra.run.smithi150.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-07-21T22:05:23.124 INFO:teuthology.orchestra.run.smithi150.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-07-21T22:05:23.258 INFO:teuthology.orchestra.run.smithi150.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-07-21T22:05:23.259 INFO:teuthology.orchestra.run.smithi150.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-07-21T22:05:23.260 INFO:teuthology.orchestra.run.smithi150.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-07-21T22:05:23.260 INFO:teuthology.orchestra.run.smithi150.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-07-21T22:05:23.261 INFO:teuthology.orchestra.run.smithi150.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-07-21T22:05:23.262 INFO:teuthology.orchestra.run.smithi150.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-07-21T22:05:23.360 INFO:teuthology.orchestra.run.smithi150.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-07-21T22:05:23.360 INFO:teuthology.orchestra.run.smithi150.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-21T22:05:23.361 INFO:teuthology.orchestra.run.smithi150.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-07-21T22:05:23.365 INFO:teuthology.orchestra.run.smithi150.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-07-21T22:05:23.421 INFO:teuthology.orchestra.run.smithi049.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-4735-gbffe049d-1focal [3,989 kB] 2023-07-21T22:05:23.458 INFO:teuthology.orchestra.run.smithi150.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-07-21T22:05:23.461 INFO:teuthology.orchestra.run.smithi150.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-07-21T22:05:23.463 INFO:teuthology.orchestra.run.smithi150.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-07-21T22:05:23.469 INFO:teuthology.orchestra.run.smithi150.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-07-21T22:05:23.470 INFO:teuthology.orchestra.run.smithi150.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-07-21T22:05:23.494 INFO:teuthology.orchestra.run.smithi049.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-07-21T22:05:23.531 INFO:teuthology.orchestra.run.smithi049.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-07-21T22:05:23.779 INFO:teuthology.orchestra.run.smithi150.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-4735-gbffe049d-1focal [725 kB] 2023-07-21T22:05:23.884 INFO:teuthology.orchestra.run.smithi150.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-4735-gbffe049d-1focal [377 kB] 2023-07-21T22:05:23.887 INFO:teuthology.orchestra.run.smithi049.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-07-21T22:05:23.903 INFO:teuthology.orchestra.run.smithi049.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-07-21T22:05:23.974 INFO:teuthology.orchestra.run.smithi150.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-4735-gbffe049d-1focal [22.5 kB] 2023-07-21T22:05:23.976 INFO:teuthology.orchestra.run.smithi150.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-4735-gbffe049d-1focal [191 kB] 2023-07-21T22:05:23.981 INFO:teuthology.orchestra.run.smithi049.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-07-21T22:05:23.982 INFO:teuthology.orchestra.run.smithi150.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-4735-gbffe049d-1focal [48.4 kB] 2023-07-21T22:05:23.983 INFO:teuthology.orchestra.run.smithi150.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-4735-gbffe049d-1focal [355 kB] 2023-07-21T22:05:23.988 INFO:teuthology.orchestra.run.smithi150.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-4735-gbffe049d-1focal [6,766 kB] 2023-07-21T22:05:23.990 INFO:teuthology.orchestra.run.smithi049.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-07-21T22:05:23.995 INFO:teuthology.orchestra.run.smithi049.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-07-21T22:05:23.999 INFO:teuthology.orchestra.run.smithi049.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-07-21T22:05:24.016 INFO:teuthology.orchestra.run.smithi049.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-21T22:05:24.018 INFO:teuthology.orchestra.run.smithi049.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-07-21T22:05:24.336 INFO:teuthology.orchestra.run.smithi049.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-07-21T22:05:24.960 INFO:teuthology.orchestra.run.smithi049.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-07-21T22:05:24.962 INFO:teuthology.orchestra.run.smithi049.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-4735-gbffe049d-1focal [725 kB] 2023-07-21T22:05:25.007 INFO:teuthology.orchestra.run.smithi049.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-07-21T22:05:25.055 INFO:teuthology.orchestra.run.smithi150.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-4735-gbffe049d-1focal [103 kB] 2023-07-21T22:05:25.064 INFO:teuthology.orchestra.run.smithi150.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-4735-gbffe049d-1focal [466 kB] 2023-07-21T22:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-07-21T22:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-4735-gbffe049d-1focal [25.6 MB] 2023-07-21T22:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-4735-gbffe049d-1focal [377 kB] 2023-07-21T22:05:25.278 INFO:teuthology.orchestra.run.smithi049.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-07-21T22:05:25.299 INFO:teuthology.orchestra.run.smithi049.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-4735-gbffe049d-1focal [22.5 kB] 2023-07-21T22:05:25.300 INFO:teuthology.orchestra.run.smithi049.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-07-21T22:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-4735-gbffe049d-1focal [191 kB] 2023-07-21T22:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-4735-gbffe049d-1focal [48.4 kB] 2023-07-21T22:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-4735-gbffe049d-1focal [355 kB] 2023-07-21T22:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-4735-gbffe049d-1focal [6,766 kB] 2023-07-21T22:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-07-21T22:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-07-21T22:05:25.545 INFO:teuthology.orchestra.run.smithi049.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-07-21T22:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-07-21T22:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-07-21T22:05:25.933 INFO:teuthology.orchestra.run.smithi049.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-07-21T22:05:26.739 INFO:teuthology.orchestra.run.smithi049.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-07-21T22:05:26.763 INFO:teuthology.orchestra.run.smithi049.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-07-21T22:05:26.850 INFO:teuthology.orchestra.run.smithi049.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-07-21T22:05:26.929 INFO:teuthology.orchestra.run.smithi049.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-07-21T22:05:26.946 INFO:teuthology.orchestra.run.smithi049.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-07-21T22:05:26.957 INFO:teuthology.orchestra.run.smithi049.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-21T22:05:26.963 INFO:teuthology.orchestra.run.smithi049.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-07-21T22:05:27.014 INFO:teuthology.orchestra.run.smithi049.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-07-21T22:05:27.053 INFO:teuthology.orchestra.run.smithi049.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-07-21T22:05:27.074 INFO:teuthology.orchestra.run.smithi049.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-07-21T22:05:27.432 INFO:teuthology.orchestra.run.smithi049.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-07-21T22:05:27.819 INFO:teuthology.orchestra.run.smithi049.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-07-21T22:05:28.637 INFO:teuthology.orchestra.run.smithi150.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-4735-gbffe049d-1focal [11.0 MB] 2023-07-21T22:05:28.797 INFO:teuthology.orchestra.run.smithi049.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-4735-gbffe049d-1focal [103 kB] 2023-07-21T22:05:28.799 INFO:teuthology.orchestra.run.smithi049.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-4735-gbffe049d-1focal [466 kB] 2023-07-21T22:05:28.902 INFO:teuthology.orchestra.run.smithi049.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-4735-gbffe049d-1focal [25.6 MB] 2023-07-21T22:05:29.233 INFO:teuthology.orchestra.run.smithi150.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-4735-gbffe049d-1focal [223 kB] 2023-07-21T22:05:29.240 INFO:teuthology.orchestra.run.smithi150.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4735-gbffe049d-1focal [133 kB] 2023-07-21T22:05:29.269 INFO:teuthology.orchestra.run.smithi150.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-4735-gbffe049d-1focal [1,553 kB] 2023-07-21T22:05:29.330 INFO:teuthology.orchestra.run.smithi150.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-4735-gbffe049d-1focal [9,388 kB] 2023-07-21T22:05:29.360 INFO:teuthology.orchestra.run.smithi049.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-07-21T22:05:29.459 INFO:teuthology.orchestra.run.smithi049.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-07-21T22:05:29.463 INFO:teuthology.orchestra.run.smithi049.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-07-21T22:05:29.542 INFO:teuthology.orchestra.run.smithi049.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-07-21T22:05:29.543 INFO:teuthology.orchestra.run.smithi049.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-07-21T22:05:29.544 INFO:teuthology.orchestra.run.smithi049.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-07-21T22:05:29.544 INFO:teuthology.orchestra.run.smithi049.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-07-21T22:05:29.545 INFO:teuthology.orchestra.run.smithi049.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-07-21T22:05:29.546 INFO:teuthology.orchestra.run.smithi049.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-07-21T22:05:29.778 INFO:teuthology.orchestra.run.smithi150.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-4735-gbffe049d-1focal [31.3 MB] 2023-07-21T22:05:29.868 INFO:teuthology.orchestra.run.smithi049.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-07-21T22:05:30.511 INFO:teuthology.orchestra.run.smithi049.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-07-21T22:05:30.538 INFO:teuthology.orchestra.run.smithi049.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-07-21T22:05:30.593 INFO:teuthology.orchestra.run.smithi049.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-07-21T22:05:30.909 INFO:teuthology.orchestra.run.smithi049.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-07-21T22:05:31.002 INFO:teuthology.orchestra.run.smithi049.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-07-21T22:05:31.062 INFO:teuthology.orchestra.run.smithi049.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-07-21T22:05:31.079 INFO:teuthology.orchestra.run.smithi049.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-07-21T22:05:31.164 INFO:teuthology.orchestra.run.smithi049.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-07-21T22:05:31.237 INFO:teuthology.orchestra.run.smithi049.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-07-21T22:05:31.240 INFO:teuthology.orchestra.run.smithi049.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-07-21T22:05:31.819 INFO:teuthology.orchestra.run.smithi049.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-07-21T22:05:32.538 INFO:teuthology.orchestra.run.smithi049.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-07-21T22:05:32.627 INFO:teuthology.orchestra.run.smithi049.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-07-21T22:05:33.196 INFO:teuthology.orchestra.run.smithi049.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-07-21T22:05:33.197 INFO:teuthology.orchestra.run.smithi049.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-07-21T22:05:33.198 INFO:teuthology.orchestra.run.smithi049.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-07-21T22:05:33.199 INFO:teuthology.orchestra.run.smithi049.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-07-21T22:05:33.199 INFO:teuthology.orchestra.run.smithi049.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-07-21T22:05:33.201 INFO:teuthology.orchestra.run.smithi049.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-07-21T22:05:33.278 INFO:teuthology.orchestra.run.smithi049.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-07-21T22:05:33.279 INFO:teuthology.orchestra.run.smithi049.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-21T22:05:33.558 INFO:teuthology.orchestra.run.smithi049.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-07-21T22:05:33.853 INFO:teuthology.orchestra.run.smithi049.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-07-21T22:05:34.219 INFO:teuthology.orchestra.run.smithi049.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-07-21T22:05:34.302 INFO:teuthology.orchestra.run.smithi049.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-07-21T22:05:34.325 INFO:teuthology.orchestra.run.smithi049.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-07-21T22:05:34.434 INFO:teuthology.orchestra.run.smithi049.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-07-21T22:05:34.457 INFO:teuthology.orchestra.run.smithi049.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-07-21T22:05:38.365 INFO:teuthology.orchestra.run.smithi150.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-4735-gbffe049d-1focal [3,812 B] 2023-07-21T22:05:38.365 INFO:teuthology.orchestra.run.smithi150.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-4735-gbffe049d-1focal [834 kB] 2023-07-21T22:05:38.438 INFO:teuthology.orchestra.run.smithi150.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-4735-gbffe049d-1focal [2,299 kB] 2023-07-21T22:05:38.599 INFO:teuthology.orchestra.run.smithi150.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-4735-gbffe049d-1focal [217 kB] 2023-07-21T22:05:38.602 INFO:teuthology.orchestra.run.smithi150.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-4735-gbffe049d-1focal [124 kB] 2023-07-21T22:05:38.606 INFO:teuthology.orchestra.run.smithi150.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-4735-gbffe049d-1focal [1,776 kB] 2023-07-21T22:05:38.693 INFO:teuthology.orchestra.run.smithi150.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4735-gbffe049d-1focal [7,881 kB] 2023-07-21T22:05:39.051 INFO:teuthology.orchestra.run.smithi049.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-4735-gbffe049d-1focal [11.0 MB] 2023-07-21T22:05:39.060 INFO:teuthology.orchestra.run.smithi150.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-4735-gbffe049d-1focal [3,932 B] 2023-07-21T22:05:39.060 INFO:teuthology.orchestra.run.smithi150.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-4735-gbffe049d-1focal [50.9 MB] 2023-07-21T22:05:40.194 INFO:teuthology.orchestra.run.smithi049.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-4735-gbffe049d-1focal [223 kB] 2023-07-21T22:05:40.197 INFO:teuthology.orchestra.run.smithi049.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4735-gbffe049d-1focal [133 kB] 2023-07-21T22:05:40.199 INFO:teuthology.orchestra.run.smithi049.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-4735-gbffe049d-1focal [1,553 kB] 2023-07-21T22:05:40.315 INFO:teuthology.orchestra.run.smithi049.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-4735-gbffe049d-1focal [9,388 kB] 2023-07-21T22:05:41.155 INFO:teuthology.orchestra.run.smithi049.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-4735-gbffe049d-1focal [31.3 MB] 2023-07-21T22:05:41.760 INFO:teuthology.orchestra.run.smithi150.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-4735-gbffe049d-1focal [220 kB] 2023-07-21T22:05:41.762 INFO:teuthology.orchestra.run.smithi150.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-4735-gbffe049d-1focal [256 kB] 2023-07-21T22:05:41.773 INFO:teuthology.orchestra.run.smithi150.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-4735-gbffe049d-1focal [23.3 kB] 2023-07-21T22:05:41.774 INFO:teuthology.orchestra.run.smithi150.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-4735-gbffe049d-1focal [12.9 kB] 2023-07-21T22:05:41.780 INFO:teuthology.orchestra.run.smithi150.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-4735-gbffe049d-1focal [28.0 kB] 2023-07-21T22:05:41.781 INFO:teuthology.orchestra.run.smithi150.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-4735-gbffe049d-1focal [13.8 MB] 2023-07-21T22:05:42.893 INFO:teuthology.orchestra.run.smithi150.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-4735-gbffe049d-1focal [97.4 kB] 2023-07-21T22:05:43.790 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 210 MB in 22s (9,352 kB/s) 2023-07-21T22:05:43.968 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-21T22:05:44.039 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107758 files and directories currently installed.) 2023-07-21T22:05:44.042 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-07-21T22:05:44.089 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-07-21T22:05:44.417 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-21T22:05:44.429 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-07-21T22:05:44.458 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-21T22:05:44.609 INFO:teuthology.orchestra.run.smithi049.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-4735-gbffe049d-1focal [3,812 B] 2023-07-21T22:05:44.636 INFO:teuthology.orchestra.run.smithi049.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-4735-gbffe049d-1focal [834 kB] 2023-07-21T22:05:44.676 INFO:teuthology.orchestra.run.smithi049.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-4735-gbffe049d-1focal [2,299 kB] 2023-07-21T22:05:44.820 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cmd2. 2023-07-21T22:05:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-07-21T22:05:44.842 INFO:teuthology.orchestra.run.smithi049.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-4735-gbffe049d-1focal [217 kB] 2023-07-21T22:05:44.847 INFO:teuthology.orchestra.run.smithi049.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-4735-gbffe049d-1focal [124 kB] 2023-07-21T22:05:44.860 INFO:teuthology.orchestra.run.smithi049.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-4735-gbffe049d-1focal [1,776 kB] 2023-07-21T22:05:44.878 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-07-21T22:05:45.018 INFO:teuthology.orchestra.run.smithi049.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4735-gbffe049d-1focal [7,881 kB] 2023-07-21T22:05:45.239 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-07-21T22:05:45.252 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-07-21T22:05:45.356 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-21T22:05:45.642 INFO:teuthology.orchestra.run.smithi049.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-4735-gbffe049d-1focal [3,932 B] 2023-07-21T22:05:45.642 INFO:teuthology.orchestra.run.smithi049.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-4735-gbffe049d-1focal [50.9 MB] 2023-07-21T22:05:45.735 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-21T22:05:45.754 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-07-21T22:05:45.785 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-21T22:05:46.163 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-21T22:05:46.182 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-07-21T22:05:46.229 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-21T22:05:46.741 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-21T22:05:46.760 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-21T22:05:46.823 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T22:05:47.378 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-21T22:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-21T22:05:47.469 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T22:05:47.865 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-21T22:05:47.883 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-21T22:05:47.922 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T22:05:48.360 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-07-21T22:05:48.379 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-07-21T22:05:48.413 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-21T22:05:48.867 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../010-librbd1_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:05:48.989 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librbd1 (18.0.0-4735-gbffe049d-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-21T22:05:49.767 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../011-librados2_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:05:49.891 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librados2 (18.0.0-4735-gbffe049d-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-21T22:05:50.653 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcephfs2. 2023-07-21T22:05:50.672 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:05:50.747 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcephfs2 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:05:51.799 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rados. 2023-07-21T22:05:51.819 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../013-python3-rados_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:05:51.856 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rados (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:05:52.259 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-21T22:05:52.279 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:05:52.317 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-ceph-argparse (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:05:52.604 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cephfs. 2023-07-21T22:05:52.622 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:05:52.662 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cephfs (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:05:53.057 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-21T22:05:53.076 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:05:53.123 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-ceph-common (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:05:53.527 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-prettytable. 2023-07-21T22:05:53.546 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-07-21T22:05:53.593 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-07-21T22:05:53.921 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rbd. 2023-07-21T22:05:53.939 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:05:53.979 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rbd (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:05:54.001 INFO:teuthology.orchestra.run.smithi049.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-4735-gbffe049d-1focal [220 kB] 2023-07-21T22:05:54.003 INFO:teuthology.orchestra.run.smithi049.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-4735-gbffe049d-1focal [256 kB] 2023-07-21T22:05:54.098 INFO:teuthology.orchestra.run.smithi049.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-4735-gbffe049d-1focal [23.3 kB] 2023-07-21T22:05:54.116 INFO:teuthology.orchestra.run.smithi049.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-4735-gbffe049d-1focal [12.9 kB] 2023-07-21T22:05:54.118 INFO:teuthology.orchestra.run.smithi049.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-4735-gbffe049d-1focal [28.0 kB] 2023-07-21T22:05:54.119 INFO:teuthology.orchestra.run.smithi049.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-4735-gbffe049d-1focal [13.8 MB] 2023-07-21T22:05:54.407 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-07-21T22:05:54.426 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-07-21T22:05:54.465 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-21T22:05:54.810 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-07-21T22:05:54.823 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-07-21T22:05:54.888 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-07-21T22:05:55.246 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-21T22:05:55.259 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-07-21T22:05:55.296 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-21T22:05:55.707 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librgw2. 2023-07-21T22:05:55.720 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../022-librgw2_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:05:55.765 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librgw2 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:05:56.970 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rgw. 2023-07-21T22:05:56.987 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:05:57.036 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rgw (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:05:57.112 INFO:teuthology.orchestra.run.smithi049.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-4735-gbffe049d-1focal [97.4 kB] 2023-07-21T22:05:57.455 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liboath0. 2023-07-21T22:05:57.474 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-07-21T22:05:57.522 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-07-21T22:05:57.883 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libradosstriper1. 2023-07-21T22:05:57.902 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:05:57.941 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libradosstriper1 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:05:58.120 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 210 MB in 37s (5,734 kB/s) 2023-07-21T22:05:58.288 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-21T22:05:58.365 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107758 files and directories currently installed.) 2023-07-21T22:05:58.368 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-07-21T22:05:58.442 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-07-21T22:05:58.478 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-common. 2023-07-21T22:05:58.498 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../026-ceph-common_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:05:58.536 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-common (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:05:58.796 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-21T22:05:58.814 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-07-21T22:05:58.878 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-21T22:05:59.190 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cmd2. 2023-07-21T22:05:59.202 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-07-21T22:05:59.239 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-07-21T22:05:59.634 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-07-21T22:05:59.654 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-07-21T22:05:59.758 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-21T22:06:00.154 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-21T22:06:00.166 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-07-21T22:06:00.238 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-21T22:06:00.599 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-21T22:06:00.612 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-07-21T22:06:00.674 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-21T22:06:01.128 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-21T22:06:01.146 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-21T22:06:01.150 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-base. 2023-07-21T22:06:01.163 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../027-ceph-base_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:01.207 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T22:06:01.235 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-base (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:01.765 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-21T22:06:01.783 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-21T22:06:01.823 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T22:06:02.217 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-21T22:06:02.230 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-21T22:06:02.267 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T22:06:02.680 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-21T22:06:02.698 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-07-21T22:06:02.712 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-07-21T22:06:02.725 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-07-21T22:06:02.738 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-07-21T22:06:02.762 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-21T22:06:03.111 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../010-librbd1_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:03.117 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-natsort. 2023-07-21T22:06:03.136 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-07-21T22:06:03.175 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-07-21T22:06:03.207 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librbd1 (18.0.0-4735-gbffe049d-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-21T22:06:03.562 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-logutils. 2023-07-21T22:06:03.581 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-07-21T22:06:03.620 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-07-21T22:06:03.923 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../011-librados2_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:03.942 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-21T22:06:03.960 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-07-21T22:06:04.000 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-07-21T22:06:04.044 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librados2 (18.0.0-4735-gbffe049d-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-21T22:06:04.336 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-mako. 2023-07-21T22:06:04.355 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-07-21T22:06:04.394 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-21T22:06:04.791 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcephfs2. 2023-07-21T22:06:04.810 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:04.814 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-21T22:06:04.832 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-21T22:06:04.849 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcephfs2 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:04.872 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-21T22:06:05.233 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-21T22:06:05.244 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rados. 2023-07-21T22:06:05.251 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-07-21T22:06:05.263 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../013-python3-rados_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:05.291 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-07-21T22:06:05.302 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rados (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:05.602 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webob. 2023-07-21T22:06:05.623 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-07-21T22:06:05.694 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-07-21T22:06:05.702 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-21T22:06:05.722 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:05.760 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-ceph-argparse (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:06.055 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cephfs. 2023-07-21T22:06:06.063 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-soupsieve. 2023-07-21T22:06:06.075 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:06.076 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-07-21T22:06:06.104 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cephfs (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:06.113 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-21T22:06:06.491 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-bs4. 2023-07-21T22:06:06.499 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-21T22:06:06.504 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-07-21T22:06:06.518 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:06.549 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-07-21T22:06:06.557 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-ceph-common (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:06.953 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-prettytable. 2023-07-21T22:06:06.971 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-07-21T22:06:06.977 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-waitress. 2023-07-21T22:06:06.990 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-07-21T22:06:07.016 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-07-21T22:06:07.033 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-21T22:06:07.289 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rbd. 2023-07-21T22:06:07.308 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:07.347 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rbd (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:07.414 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-tempita. 2023-07-21T22:06:07.433 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-07-21T22:06:07.472 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-07-21T22:06:07.691 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-07-21T22:06:07.703 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-07-21T22:06:07.741 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-21T22:06:07.809 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-paste. 2023-07-21T22:06:07.828 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-07-21T22:06:07.883 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-07-21T22:06:08.178 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-07-21T22:06:08.198 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-07-21T22:06:08.211 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-21T22:06:08.230 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-07-21T22:06:08.236 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-07-21T22:06:08.270 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-07-21T22:06:08.624 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-21T22:06:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-21T22:06:08.643 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-07-21T22:06:08.658 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-07-21T22:06:08.680 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-07-21T22:06:08.731 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-21T22:06:09.050 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webtest. 2023-07-21T22:06:09.070 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-07-21T22:06:09.108 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-07-21T22:06:09.117 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librgw2. 2023-07-21T22:06:09.137 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../022-librgw2_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:09.200 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librgw2 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:09.495 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pecan. 2023-07-21T22:06:09.514 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-07-21T22:06:09.552 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-07-21T22:06:09.941 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-21T22:06:09.959 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-07-21T22:06:10.040 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-21T22:06:10.152 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rgw. 2023-07-21T22:06:10.165 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:10.202 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rgw (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:10.393 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-21T22:06:10.407 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:10.451 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:10.739 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liboath0. 2023-07-21T22:06:10.758 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-07-21T22:06:10.797 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-07-21T22:06:10.923 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-21T22:06:10.942 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:10.981 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:11.158 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libradosstriper1. 2023-07-21T22:06:11.178 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:11.216 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libradosstriper1 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:11.368 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cryptography. 2023-07-21T22:06:11.387 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-07-21T22:06:11.425 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-21T22:06:11.736 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-common. 2023-07-21T22:06:11.755 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../026-ceph-common_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:11.794 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-common (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:11.830 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-openssl. 2023-07-21T22:06:11.848 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-07-21T22:06:11.887 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-07-21T22:06:12.299 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr. 2023-07-21T22:06:12.318 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:12.357 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:12.902 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mon. 2023-07-21T22:06:12.921 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:12.960 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mon (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:14.247 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-osd. 2023-07-21T22:06:14.267 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:14.305 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-osd (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:14.434 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-base. 2023-07-21T22:06:14.454 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../027-ceph-base_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:14.514 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-base (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:15.980 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-21T22:06:15.993 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-07-21T22:06:16.030 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-07-21T22:06:16.442 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-natsort. 2023-07-21T22:06:16.462 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-07-21T22:06:16.500 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-07-21T22:06:16.895 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-logutils. 2023-07-21T22:06:16.914 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-07-21T22:06:16.953 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-07-21T22:06:17.025 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph. 2023-07-21T22:06:17.044 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../053-ceph_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:17.091 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:17.331 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-21T22:06:17.350 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-07-21T22:06:17.389 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-07-21T22:06:17.469 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-fuse. 2023-07-21T22:06:17.488 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:17.527 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-fuse (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:17.742 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-mako. 2023-07-21T22:06:17.755 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-07-21T22:06:17.792 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-21T22:06:18.014 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mds. 2023-07-21T22:06:18.032 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:18.071 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mds (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:18.237 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-21T22:06:18.250 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-21T22:06:18.287 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-21T22:06:18.648 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-21T22:06:18.649 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephadm. 2023-07-21T22:06:18.661 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-07-21T22:06:18.662 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../056-cephadm_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:18.698 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-07-21T22:06:18.707 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephadm (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:19.059 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-webob. 2023-07-21T22:06:19.060 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-21T22:06:19.073 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-07-21T22:06:19.078 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-07-21T22:06:19.110 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-07-21T22:06:19.117 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-07-21T22:06:19.512 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-soupsieve. 2023-07-21T22:06:19.513 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jinja2. 2023-07-21T22:06:19.531 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-07-21T22:06:19.532 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-07-21T22:06:19.570 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-21T22:06:19.571 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-07-21T22:06:19.924 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-21T22:06:19.932 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-bs4. 2023-07-21T22:06:19.943 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:19.951 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-07-21T22:06:19.989 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-07-21T22:06:20.015 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:20.386 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-21T22:06:20.403 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-07-21T22:06:20.410 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-waitress. 2023-07-21T22:06:20.430 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-07-21T22:06:20.443 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-21T22:06:20.474 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-21T22:06:20.796 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jwt. 2023-07-21T22:06:20.814 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-07-21T22:06:20.854 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-21T22:06:20.879 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-tempita. 2023-07-21T22:06:20.899 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-07-21T22:06:20.937 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-07-21T22:06:21.216 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-21T22:06:21.235 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-07-21T22:06:21.273 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-21T22:06:21.299 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-paste. 2023-07-21T22:06:21.318 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-07-21T22:06:21.356 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-07-21T22:06:21.560 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjs-underscore. 2023-07-21T22:06:21.579 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-07-21T22:06:21.643 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-21T22:06:21.719 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-21T22:06:21.738 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-07-21T22:06:21.776 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-07-21T22:06:21.945 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-07-21T22:06:21.963 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-07-21T22:06:22.003 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-21T22:06:22.155 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-21T22:06:22.174 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-07-21T22:06:22.212 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-07-21T22:06:22.381 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-routes. 2023-07-21T22:06:22.400 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-07-21T22:06:22.439 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-07-21T22:06:22.591 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-webtest. 2023-07-21T22:06:22.610 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-07-21T22:06:22.649 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-07-21T22:06:22.800 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-21T22:06:22.813 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:22.850 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:23.027 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pecan. 2023-07-21T22:06:23.046 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-07-21T22:06:23.085 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-07-21T22:06:23.429 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-decorator. 2023-07-21T22:06:23.448 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-07-21T22:06:23.487 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-07-21T22:06:23.498 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-21T22:06:23.518 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-07-21T22:06:23.556 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-21T22:06:23.856 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-07-21T22:06:23.875 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-07-21T22:06:23.914 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-21T22:06:23.943 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-21T22:06:23.962 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:24.000 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:24.259 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-scipy. 2023-07-21T22:06:24.278 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-07-21T22:06:24.367 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-07-21T22:06:24.456 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-21T22:06:24.475 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:24.514 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:24.884 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cryptography. 2023-07-21T22:06:24.903 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-07-21T22:06:24.941 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-21T22:06:25.362 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-openssl. 2023-07-21T22:06:25.382 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-07-21T22:06:25.419 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-07-21T22:06:25.825 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-07-21T22:06:25.845 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-07-21T22:06:25.848 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr. 2023-07-21T22:06:25.867 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:25.892 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-21T22:06:25.906 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mon. 2023-07-21T22:06:26.471 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:26.509 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mon (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:26.524 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-joblib. 2023-07-21T22:06:26.539 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-07-21T22:06:26.578 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-07-21T22:06:26.999 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-sklearn. 2023-07-21T22:06:27.018 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-07-21T22:06:27.081 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-21T22:06:27.854 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-osd. 2023-07-21T22:06:27.874 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:27.912 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-osd (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:28.065 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-21T22:06:28.084 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:28.131 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:29.351 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cachetools. 2023-07-21T22:06:29.371 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-07-21T22:06:29.409 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-07-21T22:06:29.745 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-21T22:06:29.764 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-07-21T22:06:29.836 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-07-21T22:06:30.206 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-21T22:06:30.226 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-07-21T22:06:30.264 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-21T22:06:30.649 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph. 2023-07-21T22:06:30.667 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rsa. 2023-07-21T22:06:30.668 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../053-ceph_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:30.687 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-07-21T22:06:30.707 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:30.725 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rsa (4.0-3) ... 2023-07-21T22:06:31.034 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-fuse. 2023-07-21T22:06:31.054 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:31.120 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-google-auth. 2023-07-21T22:06:31.125 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-fuse (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:31.139 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-07-21T22:06:31.178 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-07-21T22:06:31.548 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-blinker. 2023-07-21T22:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-07-21T22:06:31.595 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mds. 2023-07-21T22:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-21T22:06:31.615 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:31.653 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mds (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:31.942 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-oauthlib. 2023-07-21T22:06:31.962 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-07-21T22:06:32.025 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-21T22:06:32.257 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephadm. 2023-07-21T22:06:32.276 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../056-cephadm_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:32.314 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephadm (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:32.539 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-21T22:06:32.559 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-07-21T22:06:32.597 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-21T22:06:32.709 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-21T22:06:32.729 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-07-21T22:06:32.767 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-07-21T22:06:32.934 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-websocket. 2023-07-21T22:06:32.952 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-07-21T22:06:32.992 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-07-21T22:06:33.170 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jinja2. 2023-07-21T22:06:33.190 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-07-21T22:06:33.261 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-07-21T22:06:33.354 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-21T22:06:33.373 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-07-21T22:06:33.412 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-07-21T22:06:33.632 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-21T22:06:33.651 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:33.689 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:34.076 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-21T22:06:34.092 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-21T22:06:34.095 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-07-21T22:06:34.111 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:34.125 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-21T22:06:34.192 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:34.553 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-21T22:06:34.572 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-07-21T22:06:34.587 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jwt. 2023-07-21T22:06:34.606 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-07-21T22:06:34.611 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-07-21T22:06:34.644 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-21T22:06:35.014 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-21T22:06:35.023 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-21T22:06:35.027 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-07-21T22:06:35.042 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-21T22:06:35.072 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-21T22:06:35.081 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-21T22:06:35.367 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libjs-underscore. 2023-07-21T22:06:35.386 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-07-21T22:06:35.425 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-21T22:06:35.431 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package jq. 2023-07-21T22:06:35.446 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-21T22:06:35.489 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-07-21T22:06:35.761 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-07-21T22:06:35.780 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-07-21T22:06:35.808 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package socat. 2023-07-21T22:06:35.818 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-21T22:06:35.824 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-07-21T22:06:35.866 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking socat (1.7.3.3-2) ... 2023-07-21T22:06:36.205 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-routes. 2023-07-21T22:06:36.223 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-07-21T22:06:36.228 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package xmlstarlet. 2023-07-21T22:06:36.244 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-07-21T22:06:36.263 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-07-21T22:06:36.286 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-07-21T22:06:36.658 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-21T22:06:36.678 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:36.682 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-test. 2023-07-21T22:06:36.700 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../090-ceph-test_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:36.716 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:36.740 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-test (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:37.278 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-decorator. 2023-07-21T22:06:37.295 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-07-21T22:06:37.356 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-07-21T22:06:37.682 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-07-21T22:06:37.702 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-07-21T22:06:37.740 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-21T22:06:38.118 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-scipy. 2023-07-21T22:06:38.138 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-07-21T22:06:38.175 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-07-21T22:06:39.610 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-07-21T22:06:39.628 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-07-21T22:06:39.684 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-21T22:06:40.296 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-joblib. 2023-07-21T22:06:40.316 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-07-21T22:06:40.354 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-07-21T22:06:40.783 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-sklearn. 2023-07-21T22:06:40.803 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-07-21T22:06:40.841 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-21T22:06:40.987 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-volume. 2023-07-21T22:06:41.002 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:41.044 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-volume (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:41.517 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-21T22:06:41.533 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:41.574 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephfs-mirror (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:41.674 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-21T22:06:41.694 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:41.732 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:41.990 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-colorama. 2023-07-21T22:06:42.006 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-07-21T22:06:42.047 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-07-21T22:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephfs-shell. 2023-07-21T22:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:42.383 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephfs-shell (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:42.720 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephfs-top. 2023-07-21T22:06:42.737 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:42.777 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephfs-top (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:43.010 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cachetools. 2023-07-21T22:06:43.030 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-07-21T22:06:43.068 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-07-21T22:06:43.087 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package fonts-mathjax. 2023-07-21T22:06:43.105 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-21T22:06:43.145 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-21T22:06:43.437 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-21T22:06:43.457 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-07-21T22:06:43.495 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-07-21T22:06:43.715 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-21T22:06:43.731 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:43.773 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcephfs-dev (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:43.907 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-21T22:06:43.927 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-07-21T22:06:43.965 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-21T22:06:44.218 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package nvme-cli. 2023-07-21T22:06:44.234 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-07-21T22:06:44.311 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-07-21T22:06:44.368 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rsa. 2023-07-21T22:06:44.388 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-07-21T22:06:44.426 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rsa (4.0-3) ... 2023-07-21T22:06:44.673 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-21T22:06:44.684 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-07-21T22:06:44.723 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-07-21T22:06:44.804 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-google-auth. 2023-07-21T22:06:44.824 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-07-21T22:06:44.862 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-07-21T22:06:45.101 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjs-mathjax. 2023-07-21T22:06:45.118 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-21T22:06:45.192 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-21T22:06:45.257 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-blinker. 2023-07-21T22:06:45.276 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-07-21T22:06:45.315 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-21T22:06:45.634 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-oauthlib. 2023-07-21T22:06:45.648 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-07-21T22:06:45.684 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-21T22:06:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-21T22:06:46.137 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-07-21T22:06:46.181 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-21T22:06:46.543 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-websocket. 2023-07-21T22:06:46.563 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-07-21T22:06:46.601 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-07-21T22:06:46.980 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-21T22:06:46.993 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-07-21T22:06:47.038 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-07-21T22:06:47.222 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-natsort-doc. 2023-07-21T22:06:47.239 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-07-21T22:06:47.279 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-07-21T22:06:47.643 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-21T22:06:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:47.692 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-atomicwrites. 2023-07-21T22:06:47.708 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-07-21T22:06:47.726 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:47.749 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-07-21T22:06:48.071 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-21T22:06:48.090 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-07-21T22:06:48.095 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-attr. 2023-07-21T22:06:48.111 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-07-21T22:06:48.153 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-07-21T22:06:48.154 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-07-21T22:06:48.531 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webencodings. 2023-07-21T22:06:48.541 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-21T22:06:48.548 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-07-21T22:06:48.559 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-21T22:06:48.588 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-21T22:06:48.623 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-21T22:06:48.918 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package jq. 2023-07-21T22:06:48.925 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-html5lib. 2023-07-21T22:06:48.938 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-21T22:06:48.942 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-07-21T22:06:48.976 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-07-21T22:06:49.008 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-07-21T22:06:49.288 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package socat. 2023-07-21T22:06:49.307 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-07-21T22:06:49.345 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking socat (1.7.3.3-2) ... 2023-07-21T22:06:49.378 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-07-21T22:06:49.395 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-07-21T22:06:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-21T22:06:49.699 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package xmlstarlet. 2023-07-21T22:06:49.719 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-07-21T22:06:49.757 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-07-21T22:06:49.907 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-packaging. 2023-07-21T22:06:49.923 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-07-21T22:06:49.964 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-packaging (20.3-1) ... 2023-07-21T22:06:50.226 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-test. 2023-07-21T22:06:50.246 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../090-ceph-test_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:50.283 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-test (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:50.334 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pastescript. 2023-07-21T22:06:50.351 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-07-21T22:06:50.392 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-21T22:06:50.787 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pluggy. 2023-07-21T22:06:50.803 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-07-21T22:06:50.845 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-07-21T22:06:51.227 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-psutil. 2023-07-21T22:06:51.243 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-07-21T22:06:51.284 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-07-21T22:06:51.646 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-py. 2023-07-21T22:06:51.666 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-07-21T22:06:51.728 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-07-21T22:06:52.091 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-21T22:06:52.109 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-07-21T22:06:52.148 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-21T22:06:52.535 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pytest. 2023-07-21T22:06:52.553 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-07-21T22:06:52.592 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-07-21T22:06:52.971 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-simplejson. 2023-07-21T22:06:52.990 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-07-21T22:06:53.029 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-21T22:06:53.383 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-21T22:06:53.401 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-07-21T22:06:53.441 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-21T22:06:54.153 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package radosgw. 2023-07-21T22:06:54.170 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../116-radosgw_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:54.214 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking radosgw (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:54.579 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-volume. 2023-07-21T22:06:54.599 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:54.637 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-volume (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:55.076 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-21T22:06:55.095 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:55.133 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephfs-mirror (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:55.520 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-colorama. 2023-07-21T22:06:55.539 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-07-21T22:06:55.577 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-07-21T22:06:55.634 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package rbd-fuse. 2023-07-21T22:06:55.652 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:55.692 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking rbd-fuse (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:55.905 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephfs-shell. 2023-07-21T22:06:55.926 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:55.963 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephfs-shell (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:56.045 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-attr (19.3.0-2) ... 2023-07-21T22:06:56.251 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephfs-top. 2023-07-21T22:06:56.271 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-4735-gbffe049d-1focal_all.deb ... 2023-07-21T22:06:56.333 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephfs-top (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:56.430 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-07-21T22:06:56.589 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-21T22:06:56.619 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package fonts-mathjax. 2023-07-21T22:06:56.639 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-21T22:06:56.677 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-21T22:06:56.718 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-07-21T22:06:56.936 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephadm (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:57.251 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-21T22:06:57.271 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:06:57.309 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcephfs-dev (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:06:57.711 INFO:teuthology.orchestra.run.smithi150.stdout:Adding system user cephadm....done 2023-07-21T22:06:57.746 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package nvme-cli. 2023-07-21T22:06:57.766 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-07-21T22:06:57.837 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-07-21T22:06:58.224 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-21T22:06:58.235 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-21T22:06:58.244 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-07-21T22:06:58.281 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-07-21T22:06:58.368 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-21T22:06:58.710 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libjs-mathjax. 2023-07-21T22:06:58.728 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-21T22:06:58.759 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-21T22:06:58.828 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-21T22:06:59.188 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-21T22:06:59.339 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-07-21T22:06:59.464 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-07-21T22:06:59.883 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-07-21T22:07:00.385 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-21T22:07:00.769 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-07-21T22:07:00.938 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-natsort-doc. 2023-07-21T22:07:00.961 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-07-21T22:07:01.005 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-07-21T22:07:01.137 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-07-21T22:07:01.408 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-atomicwrites. 2023-07-21T22:07:01.428 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-07-21T22:07:01.465 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-07-21T22:07:01.521 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-21T22:07:01.811 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-attr. 2023-07-21T22:07:01.831 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-07-21T22:07:01.864 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-21T22:07:01.876 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-07-21T22:07:02.215 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-ceph-argparse (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:02.263 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-webencodings. 2023-07-21T22:07:02.284 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-07-21T22:07:02.329 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-21T22:07:02.625 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-21T22:07:02.699 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-html5lib. 2023-07-21T22:07:02.720 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-07-21T22:07:02.751 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-07-21T22:07:02.765 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-07-21T22:07:03.102 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-07-21T22:07:03.177 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-07-21T22:07:03.198 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-07-21T22:07:03.243 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-21T22:07:03.470 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-21T22:07:03.747 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-packaging. 2023-07-21T22:07:03.767 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-07-21T22:07:03.805 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-packaging (20.3-1) ... 2023-07-21T22:07:03.814 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-21T22:07:03.941 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-07-21T22:07:04.392 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-07-21T22:07:04.475 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pastescript. 2023-07-21T22:07:04.496 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-07-21T22:07:04.532 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-21T22:07:04.785 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-07-21T22:07:04.920 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pluggy. 2023-07-21T22:07:04.941 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-07-21T22:07:04.986 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-07-21T22:07:05.120 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-21T22:07:05.365 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-psutil. 2023-07-21T22:07:05.386 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-07-21T22:07:05.431 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-07-21T22:07:05.529 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-07-21T22:07:05.826 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-py. 2023-07-21T22:07:05.847 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-07-21T22:07:05.892 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-07-21T22:07:05.905 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-07-21T22:07:06.271 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-21T22:07:06.292 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-07-21T22:07:06.326 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-07-21T22:07:06.336 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-21T22:07:06.702 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-packaging (20.3-1) ... 2023-07-21T22:07:06.709 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pytest. 2023-07-21T22:07:06.729 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-07-21T22:07:06.778 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-07-21T22:07:07.070 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-07-21T22:07:07.190 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-simplejson. 2023-07-21T22:07:07.195 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-21T22:07:07.210 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-07-21T22:07:07.248 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-21T22:07:07.321 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-21T22:07:07.584 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-21T22:07:07.604 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-07-21T22:07:07.667 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-21T22:07:07.673 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-07-21T22:07:08.149 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-07-21T22:07:08.379 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package radosgw. 2023-07-21T22:07:08.399 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../116-radosgw_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:07:08.470 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking radosgw (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:08.528 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-21T22:07:08.987 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-21T22:07:09.431 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up socat (1.7.3.3-2) ... 2023-07-21T22:07:09.557 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-ceph-common (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:09.948 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package rbd-fuse. 2023-07-21T22:07:09.969 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-4735-gbffe049d-1focal_amd64.deb ... 2023-07-21T22:07:10.000 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T22:07:10.014 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking rbd-fuse (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:10.143 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-07-21T22:07:10.393 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-attr (19.3.0-2) ... 2023-07-21T22:07:10.610 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-21T22:07:10.754 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-07-21T22:07:10.769 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-07-21T22:07:10.879 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-21T22:07:10.895 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-07-21T22:07:11.005 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-07-21T22:07:11.244 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephadm (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:11.255 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-21T22:07:11.664 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T22:07:11.791 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-21T22:07:11.958 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-07-21T22:07:11.995 INFO:teuthology.orchestra.run.smithi049.stdout:Adding system user cephadm....done 2023-07-21T22:07:12.209 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-21T22:07:12.326 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-21T22:07:12.393 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-07-21T22:07:12.736 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-07-21T22:07:12.755 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-21T22:07:13.087 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-21T22:07:13.090 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-21T22:07:13.215 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-07-21T22:07:13.229 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-21T22:07:13.366 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-07-21T22:07:13.580 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-07-21T22:07:13.776 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-07-21T22:07:13.931 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-21T22:07:14.304 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-21T22:07:14.341 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-07-21T22:07:14.663 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-07-21T22:07:14.723 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-07-21T22:07:15.056 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-07-21T22:07:15.060 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-07-21T22:07:15.211 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-21T22:07:15.457 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-21T22:07:15.587 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-07-21T22:07:15.808 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-21T22:07:16.047 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-21T22:07:16.167 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-ceph-argparse (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:16.206 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-21T22:07:16.341 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-07-21T22:07:16.535 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-21T22:07:16.667 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-07-21T22:07:16.775 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-21T22:07:17.021 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-07-21T22:07:17.118 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-07-21T22:07:17.405 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-21T22:07:17.748 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-21T22:07:17.899 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-07-21T22:07:18.358 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-07-21T22:07:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-07-21T22:07:18.940 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-21T22:07:19.075 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-07-21T22:07:19.110 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-21T22:07:19.534 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-07-21T22:07:19.537 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-07-21T22:07:19.902 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-07-21T22:07:19.921 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-07-21T22:07:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T22:07:20.339 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-07-21T22:07:20.412 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-07-21T22:07:20.708 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-packaging (20.3-1) ... 2023-07-21T22:07:20.822 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-21T22:07:21.077 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-07-21T22:07:21.203 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-21T22:07:21.224 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-07-21T22:07:21.329 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-21T22:07:21.692 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-21T22:07:21.713 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-07-21T22:07:22.093 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-21T22:07:22.198 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-07-21T22:07:22.566 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-21T22:07:23.004 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-21T22:07:23.373 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-21T22:07:23.473 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up socat (1.7.3.3-2) ... 2023-07-21T22:07:23.501 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-07-21T22:07:23.598 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-ceph-common (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:23.627 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-07-21T22:07:23.770 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rsa (4.0-3) ... 2023-07-21T22:07:24.017 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T22:07:24.154 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-21T22:07:24.184 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-07-21T22:07:24.280 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-07-21T22:07:24.619 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-21T22:07:24.665 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-21T22:07:24.754 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-07-21T22:07:24.881 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-07-21T22:07:25.016 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-21T22:07:25.241 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-21T22:07:25.400 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-07-21T22:07:25.650 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T22:07:25.784 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-21T22:07:25.878 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librados2 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:25.935 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-07-21T22:07:26.139 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-07-21T22:07:26.265 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librgw2 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:26.379 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-07-21T22:07:26.391 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:26.550 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcephfs2 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:26.685 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-routes (2.4.1-2) ... 2023-07-21T22:07:26.738 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-07-21T22:07:27.048 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libradosstriper1 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:27.123 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-21T22:07:27.207 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-07-21T22:07:27.398 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-21T22:07:27.576 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librbd1 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:27.743 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-modules-core (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:27.758 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-07-21T22:07:27.869 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-fuse (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:28.127 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-21T22:07:28.127 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-21T22:07:28.159 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-21T22:07:28.535 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-07-21T22:07:28.960 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-07-21T22:07:29.087 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcephfs-dev (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:29.213 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rados (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:29.279 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-07-21T22:07:29.364 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephfs-top (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:29.406 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-21T22:07:29.490 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-07-21T22:07:29.840 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-07-21T22:07:30.316 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-21T22:07:30.476 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-21T22:07:30.602 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-07-21T22:07:30.628 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rbd (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:30.754 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up rbd-fuse (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:30.915 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rgw (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:31.011 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-21T22:07:31.041 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cephfs (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:31.184 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephfs-shell (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:31.318 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-common (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:31.362 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-07-21T22:07:31.923 INFO:teuthology.orchestra.run.smithi150.stdout:Adding group ceph....done 2023-07-21T22:07:32.365 INFO:teuthology.orchestra.run.smithi150.stdout:Adding system user ceph....done 2023-07-21T22:07:32.622 INFO:teuthology.orchestra.run.smithi150.stdout:Setting system user ceph properties....done 2023-07-21T22:07:32.651 INFO:teuthology.orchestra.run.smithi150.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-21T22:07:32.831 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-21T22:07:33.201 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-21T22:07:33.327 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-07-21T22:07:33.363 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-21T22:07:33.803 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-07-21T22:07:34.180 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-07-21T22:07:34.272 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephfs-mirror (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:34.534 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-21T22:07:34.534 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-21T22:07:34.539 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T22:07:34.962 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-07-21T22:07:35.390 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-test (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:35.391 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-21T22:07:35.516 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up radosgw (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:35.809 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-07-21T22:07:35.835 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-21T22:07:35.835 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-21T22:07:36.286 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-21T22:07:36.696 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-21T22:07:37.092 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-base (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:37.590 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-21T22:07:37.967 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-21T22:07:38.126 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-07-21T22:07:38.261 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-07-21T22:07:38.387 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rsa (4.0-3) ... 2023-07-21T22:07:38.436 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mds (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:38.757 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-21T22:07:38.758 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-21T22:07:38.788 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-21T22:07:38.939 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-07-21T22:07:39.307 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-21T22:07:39.613 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:39.700 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-21T22:07:39.888 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-21T22:07:39.888 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-21T22:07:40.159 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-07-21T22:07:40.636 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librados2 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:40.731 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-osd (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:40.881 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-07-21T22:07:40.999 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librgw2 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:41.166 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:41.292 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcephfs2 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:41.419 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-routes (2.4.1-2) ... 2023-07-21T22:07:41.535 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-21T22:07:41.535 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-21T22:07:41.795 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libradosstriper1 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:41.921 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-07-21T22:07:42.289 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librbd1 (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:42.382 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:42.415 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-modules-core (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:42.508 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:42.574 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-fuse (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:42.668 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mon (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:42.842 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-21T22:07:42.842 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-21T22:07:42.926 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-21T22:07:42.927 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-21T22:07:43.709 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcephfs-dev (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:43.777 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-cephadm (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:43.852 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rados (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:43.963 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:43.986 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephfs-top (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:44.088 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-dashboard (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:44.107 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-07-21T22:07:44.273 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-volume (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:44.400 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-21T22:07:44.585 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-21T22:07:45.070 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-21T22:07:45.387 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rbd (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:45.513 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up rbd-fuse (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:45.672 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rgw (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:45.815 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cephfs (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:45.949 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephfs-shell (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:46.100 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-common (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:46.774 INFO:teuthology.orchestra.run.smithi049.stdout:Adding group ceph....done 2023-07-21T22:07:47.264 INFO:teuthology.orchestra.run.smithi049.stdout:Adding system user ceph....done 2023-07-21T22:07:47.520 INFO:teuthology.orchestra.run.smithi049.stdout:Setting system user ceph properties....done 2023-07-21T22:07:47.553 INFO:teuthology.orchestra.run.smithi049.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-21T22:07:47.755 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-21T22:07:48.311 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-21T22:07:49.245 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephfs-mirror (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:49.512 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-21T22:07:49.512 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-21T22:07:50.306 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-07-21T22:07:50.363 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-test (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:50.489 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up radosgw (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:50.841 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-21T22:07:50.841 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-21T22:07:51.086 INFO:teuthology.orchestra.run.smithi150.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-21T22:07:51.091 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-21T22:07:51.218 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2023-07-21T22:07:51.422 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2023-07-21T22:07:51.422 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2023-07-21T22:07:51.606 INFO:teuthology.orchestra.run.smithi150.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-07-21T22:07:51.607 INFO:teuthology.orchestra.run.smithi150.stdout:flex is already the newest version (2.6.4-6.2). 2023-07-21T22:07:51.607 INFO:teuthology.orchestra.run.smithi150.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-07-21T22:07:51.607 INFO:teuthology.orchestra.run.smithi150.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-07-21T22:07:51.608 INFO:teuthology.orchestra.run.smithi150.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-07-21T22:07:51.608 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2023-07-21T22:07:51.609 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-21T22:07:51.610 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-21T22:07:51.610 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2023-07-21T22:07:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-07-21T22:07:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 libuuid1 2023-07-21T22:07:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: modemmanager network-manager-pptp postgresql-12 postgresql-client-12 2023-07-21T22:07:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-07-21T22:07:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: wpasupplicant 2023-07-21T22:07:51.611 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2023-07-21T22:07:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-07-21T22:07:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-07-21T22:07:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: libengine-pkcs11-openssl 2023-07-21T22:07:51.703 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2023-07-21T22:07:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-07-21T22:07:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-07-21T22:07:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-07-21T22:07:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-07-21T22:07:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-07-21T22:07:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-21T22:07:51.705 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages will be upgraded: 2023-07-21T22:07:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: libssl1.1 libuuid1 util-linux uuid-dev 2023-07-21T22:07:51.926 INFO:teuthology.orchestra.run.smithi150.stdout:4 upgraded, 31 newly installed, 0 to remove and 206 not upgraded. 2023-07-21T22:07:51.927 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 25.1 MB of archives. 2023-07-21T22:07:51.927 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-07-21T22:07:51.927 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-07-21T22:07:52.057 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-base (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:52.555 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-21T22:07:52.682 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-07-21T22:07:52.685 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-07-21T22:07:52.686 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-07-21T22:07:52.792 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-07-21T22:07:52.795 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-07-21T22:07:52.804 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-07-21T22:07:52.810 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-07-21T22:07:52.811 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-07-21T22:07:52.815 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-07-21T22:07:52.818 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-07-21T22:07:52.995 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-07-21T22:07:53.083 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-07-21T22:07:53.389 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-07-21T22:07:53.396 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-07-21T22:07:53.408 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mds (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:53.517 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.15-0ubuntu0.20.04.1 [116 kB] 2023-07-21T22:07:53.541 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-07-21T22:07:53.627 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-07-21T22:07:53.627 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-07-21T22:07:53.687 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-21T22:07:53.688 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-21T22:07:53.729 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-07-21T22:07:53.730 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-07-21T22:07:53.763 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-07-21T22:07:53.980 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-07-21T22:07:54.612 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:54.751 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-07-21T22:07:54.763 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-07-21T22:07:54.763 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-07-21T22:07:54.765 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-07-21T22:07:54.767 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.15-0ubuntu0.20.04.1 [1,052 kB] 2023-07-21T22:07:54.810 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-07-21T22:07:54.813 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.15-0ubuntu0.20.04.1 [13.5 MB] 2023-07-21T22:07:54.891 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-21T22:07:54.892 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-21T22:07:55.263 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-07-21T22:07:55.264 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-07-21T22:07:55.264 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-07-21T22:07:55.451 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-07-21T22:07:55.672 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-07-21T22:07:55.722 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-osd (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:56.337 INFO:teuthology.orchestra.run.smithi150.stdout:Preconfiguring packages ... 2023-07-21T22:07:56.534 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-21T22:07:56.534 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-21T22:07:56.596 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 25.1 MB in 4s (6,168 kB/s) 2023-07-21T22:07:56.896 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-21T22:07:56.900 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-21T22:07:57.108 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-21T22:07:57.406 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:57.532 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:57.683 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mon (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:57.979 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-21T22:07:57.979 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-21T22:07:58.770 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-07-21T22:07:58.827 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-cephadm (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:58.969 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:59.120 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-dashboard (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:59.271 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-volume (18.0.0-4735-gbffe049d-1focal) ... 2023-07-21T22:07:59.398 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-21T22:07:59.600 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-21T22:08:00.092 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-21T22:08:00.707 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-21T22:08:00.710 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-21T22:08:00.891 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-21T22:08:01.303 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-21T22:08:01.514 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-21T22:08:01.871 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-07-21T22:08:02.456 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-21T22:08:02.460 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-07-21T22:08:02.623 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-07-21T22:08:03.177 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-21T22:08:03.197 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-07-21T22:08:03.235 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-07-21T22:08:03.647 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package dump. 2023-07-21T22:08:03.667 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-07-21T22:08:03.705 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking dump (0.4b46-6) ... 2023-07-21T22:08:04.033 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package indent. 2023-07-21T22:08:04.054 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-07-21T22:08:04.099 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking indent (2.2.12-1) ... 2023-07-21T22:08:04.461 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-21T22:08:04.482 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-07-21T22:08:04.519 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-07-21T22:08:04.906 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-21T22:08:04.920 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-07-21T22:08:05.074 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-07-21T22:08:05.386 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-21T22:08:05.406 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-07-21T22:08:05.412 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-07-21T22:08:05.444 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-07-21T22:08:05.872 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-21T22:08:05.893 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:08:05.939 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T22:08:06.233 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-21T22:08:06.253 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:08:06.325 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T22:08:06.574 INFO:teuthology.orchestra.run.smithi049.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-21T22:08:06.580 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-21T22:08:06.689 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-21T22:08:06.706 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:08:06.713 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2023-07-21T22:08:06.744 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T22:08:06.916 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2023-07-21T22:08:06.917 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2023-07-21T22:08:07.114 INFO:teuthology.orchestra.run.smithi049.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-07-21T22:08:07.115 INFO:teuthology.orchestra.run.smithi049.stdout:flex is already the newest version (2.6.4-6.2). 2023-07-21T22:08:07.115 INFO:teuthology.orchestra.run.smithi049.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-07-21T22:08:07.115 INFO:teuthology.orchestra.run.smithi049.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-07-21T22:08:07.115 INFO:teuthology.orchestra.run.smithi049.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-07-21T22:08:07.115 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2023-07-21T22:08:07.116 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-21T22:08:07.116 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-21T22:08:07.116 INFO:teuthology.orchestra.run.smithi049.stdout:The following additional packages will be installed: 2023-07-21T22:08:07.116 INFO:teuthology.orchestra.run.smithi049.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-07-21T22:08:07.117 INFO:teuthology.orchestra.run.smithi049.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 libuuid1 2023-07-21T22:08:07.117 INFO:teuthology.orchestra.run.smithi049.stdout: modemmanager network-manager-pptp postgresql-12 postgresql-client-12 2023-07-21T22:08:07.117 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-07-21T22:08:07.117 INFO:teuthology.orchestra.run.smithi049.stdout: wpasupplicant 2023-07-21T22:08:07.118 INFO:teuthology.orchestra.run.smithi049.stdout:Suggested packages: 2023-07-21T22:08:07.118 INFO:teuthology.orchestra.run.smithi049.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-07-21T22:08:07.119 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-07-21T22:08:07.119 INFO:teuthology.orchestra.run.smithi049.stdout: libengine-pkcs11-openssl 2023-07-21T22:08:07.172 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-21T22:08:07.193 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-07-21T22:08:07.218 INFO:teuthology.orchestra.run.smithi049.stdout:The following NEW packages will be installed: 2023-07-21T22:08:07.219 INFO:teuthology.orchestra.run.smithi049.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-07-21T22:08:07.219 INFO:teuthology.orchestra.run.smithi049.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-07-21T22:08:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-07-21T22:08:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-07-21T22:08:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-07-21T22:08:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-21T22:08:07.221 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages will be upgraded: 2023-07-21T22:08:07.221 INFO:teuthology.orchestra.run.smithi049.stdout: libssl1.1 libuuid1 util-linux uuid-dev 2023-07-21T22:08:07.230 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-07-21T22:08:07.558 INFO:teuthology.orchestra.run.smithi049.stdout:4 upgraded, 31 newly installed, 0 to remove and 206 not upgraded. 2023-07-21T22:08:07.558 INFO:teuthology.orchestra.run.smithi049.stdout:Need to get 25.1 MB of archives. 2023-07-21T22:08:07.558 INFO:teuthology.orchestra.run.smithi049.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-07-21T22:08:07.559 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-07-21T22:08:07.617 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-21T22:08:07.637 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-07-21T22:08:07.675 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-07-21T22:08:08.103 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-21T22:08:08.122 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../12-libpq5_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-21T22:08:08.162 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T22:08:08.564 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-21T22:08:08.586 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:08:08.631 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T22:08:08.748 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-07-21T22:08:08.752 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-07-21T22:08:08.753 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-07-21T22:08:08.933 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-07-21T22:08:08.939 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-07-21T22:08:08.953 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-07-21T22:08:08.965 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-07-21T22:08:08.965 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-07-21T22:08:08.971 INFO:teuthology.orchestra.run.smithi049.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-07-21T22:08:08.980 INFO:teuthology.orchestra.run.smithi049.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-07-21T22:08:08.983 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-21T22:08:09.003 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:08:09.066 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T22:08:09.302 INFO:teuthology.orchestra.run.smithi049.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-07-21T22:08:09.361 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-21T22:08:09.382 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-07-21T22:08:09.427 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-21T22:08:09.459 INFO:teuthology.orchestra.run.smithi049.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-07-21T22:08:10.023 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-21T22:08:10.041 INFO:teuthology.orchestra.run.smithi049.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-07-21T22:08:10.044 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-07-21T22:08:10.054 INFO:teuthology.orchestra.run.smithi049.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-07-21T22:08:10.126 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-07-21T22:08:10.293 INFO:teuthology.orchestra.run.smithi049.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.15-0ubuntu0.20.04.1 [116 kB] 2023-07-21T22:08:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-07-21T22:08:10.491 INFO:teuthology.orchestra.run.smithi049.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-07-21T22:08:10.492 INFO:teuthology.orchestra.run.smithi049.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-07-21T22:08:10.543 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package modemmanager. 2023-07-21T22:08:10.562 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:08:10.621 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T22:08:10.681 INFO:teuthology.orchestra.run.smithi049.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-07-21T22:08:10.681 INFO:teuthology.orchestra.run.smithi049.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-07-21T22:08:10.743 INFO:teuthology.orchestra.run.smithi049.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-07-21T22:08:11.151 INFO:teuthology.orchestra.run.smithi049.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-07-21T22:08:11.324 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package wpasupplicant. 2023-07-21T22:08:11.344 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-07-21T22:08:11.382 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-07-21T22:08:11.937 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package network-manager. 2023-07-21T22:08:11.958 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-07-21T22:08:12.051 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-07-21T22:08:12.538 INFO:teuthology.orchestra.run.smithi049.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-07-21T22:08:12.554 INFO:teuthology.orchestra.run.smithi049.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-07-21T22:08:12.556 INFO:teuthology.orchestra.run.smithi049.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-07-21T22:08:12.557 INFO:teuthology.orchestra.run.smithi049.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-07-21T22:08:12.559 INFO:teuthology.orchestra.run.smithi049.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.15-0ubuntu0.20.04.1 [1,052 kB] 2023-07-21T22:08:12.620 INFO:teuthology.orchestra.run.smithi049.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-07-21T22:08:12.642 INFO:teuthology.orchestra.run.smithi049.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.15-0ubuntu0.20.04.1 [13.5 MB] 2023-07-21T22:08:12.888 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ppp. 2023-07-21T22:08:12.906 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-07-21T22:08:13.370 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-07-21T22:08:13.586 INFO:teuthology.orchestra.run.smithi049.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-07-21T22:08:13.586 INFO:teuthology.orchestra.run.smithi049.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-07-21T22:08:13.586 INFO:teuthology.orchestra.run.smithi049.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-07-21T22:08:13.741 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package pptp-linux. 2023-07-21T22:08:13.762 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-07-21T22:08:13.807 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-07-21T22:08:13.887 INFO:teuthology.orchestra.run.smithi049.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-07-21T22:08:14.219 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-21T22:08:14.233 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-07-21T22:08:14.252 INFO:teuthology.orchestra.run.smithi049.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-07-21T22:08:14.309 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-07-21T22:08:14.672 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-21T22:08:14.693 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-07-21T22:08:14.730 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-07-21T22:08:14.991 INFO:teuthology.orchestra.run.smithi049.stdout:Preconfiguring packages ... 2023-07-21T22:08:15.110 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-client-12. 2023-07-21T22:08:15.131 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../24-postgresql-client-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-21T22:08:15.168 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T22:08:15.228 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 25.1 MB in 7s (3,482 kB/s) 2023-07-21T22:08:15.559 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-21T22:08:15.563 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-21T22:08:15.781 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-21T22:08:15.831 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-common. 2023-07-21T22:08:15.850 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-07-21T22:08:15.922 INFO:teuthology.orchestra.run.smithi150.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-21T22:08:15.950 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-07-21T22:08:16.496 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-12. 2023-07-21T22:08:16.517 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../26-postgresql-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-21T22:08:16.569 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T22:08:17.570 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-07-21T22:08:18.216 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql. 2023-07-21T22:08:18.237 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-07-21T22:08:18.324 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-07-21T22:08:18.601 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-client. 2023-07-21T22:08:18.621 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-07-21T22:08:18.659 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-07-21T22:08:18.962 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-21T22:08:18.982 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-07-21T22:08:19.020 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-07-21T22:08:19.280 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-21T22:08:19.301 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-07-21T22:08:19.338 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-07-21T22:08:19.564 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-21T22:08:19.567 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-21T22:08:19.723 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-21T22:08:19.775 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-21T22:08:19.795 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-07-21T22:08:19.854 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-07-21T22:08:20.201 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-21T22:08:20.253 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-07-21T22:08:20.381 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-21T22:08:20.514 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-21T22:08:20.782 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-07-21T22:08:20.891 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T22:08:21.050 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-07-21T22:08:21.176 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-07-21T22:08:21.304 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-07-21T22:08:21.523 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-21T22:08:21.526 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-07-21T22:08:21.665 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-07-21T22:08:21.770 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-21T22:08:21.770 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-21T22:08:22.244 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-21T22:08:22.265 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-07-21T22:08:22.310 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-07-21T22:08:22.690 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T22:08:22.713 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package dump. 2023-07-21T22:08:22.734 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-07-21T22:08:22.779 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking dump (0.4b46-6) ... 2023-07-21T22:08:23.125 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package indent. 2023-07-21T22:08:23.146 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-07-21T22:08:23.328 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking indent (2.2.12-1) ... 2023-07-21T22:08:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-21T22:08:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-07-21T22:08:23.727 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-07-21T22:08:24.115 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-21T22:08:24.136 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-07-21T22:08:24.172 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-07-21T22:08:24.492 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-21T22:08:24.513 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-07-21T22:08:24.550 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-07-21T22:08:24.828 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-21T22:08:24.928 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-21T22:08:24.946 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-07-21T22:08:24.948 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:08:24.986 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T22:08:25.072 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-07-21T22:08:25.198 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-07-21T22:08:25.323 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-21T22:08:25.339 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:08:25.380 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T22:08:25.775 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-21T22:08:25.796 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:08:25.841 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T22:08:26.261 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-21T22:08:26.282 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-07-21T22:08:26.319 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-07-21T22:08:26.723 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-21T22:08:26.743 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-07-21T22:08:26.781 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-07-21T22:08:26.816 INFO:teuthology.orchestra.run.smithi150.stdout:Adding user postgres to group ssl-cert 2023-07-21T22:08:27.178 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:08:27.179 INFO:teuthology.orchestra.run.smithi150.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-21T22:08:27.225 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-21T22:08:27.246 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../12-libpq5_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-21T22:08:27.283 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T22:08:27.663 INFO:teuthology.orchestra.run.smithi150.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-21T22:08:27.663 INFO:teuthology.orchestra.run.smithi150.stdout:Removing obsolete dictionary files: 2023-07-21T22:08:27.695 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-21T22:08:27.716 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:08:27.753 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T22:08:28.131 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-21T22:08:28.151 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:08:28.189 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T22:08:28.191 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-21T22:08:28.491 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-21T22:08:28.512 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-07-21T22:08:28.558 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-21T22:08:29.095 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-21T22:08:29.109 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-07-21T22:08:29.186 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-07-21T22:08:29.558 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-21T22:08:29.615 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package modemmanager. 2023-07-21T22:08:29.635 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:08:29.695 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T22:08:29.717 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-07-21T22:08:29.843 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-07-21T22:08:29.969 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-07-21T22:08:30.095 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-07-21T22:08:30.362 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package wpasupplicant. 2023-07-21T22:08:30.381 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-07-21T22:08:30.420 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-07-21T22:08:31.042 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package network-manager. 2023-07-21T22:08:31.056 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-07-21T22:08:31.147 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-07-21T22:08:31.715 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-07-21T22:08:31.991 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ppp. 2023-07-21T22:08:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-07-21T22:08:32.158 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up dump (0.4b46-6) ... 2023-07-21T22:08:32.265 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-21T22:08:32.335 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T22:08:32.485 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-07-21T22:08:32.494 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-07-21T22:08:32.629 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up indent (2.2.12-1) ... 2023-07-21T22:08:32.747 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-07-21T22:08:32.940 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-07-21T22:08:32.995 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package pptp-linux. 2023-07-21T22:08:33.009 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-07-21T22:08:33.053 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-07-21T22:08:33.099 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T22:08:33.457 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-21T22:08:33.477 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-07-21T22:08:33.553 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-07-21T22:08:33.609 INFO:teuthology.orchestra.run.smithi150.stdout:Creating new PostgreSQL cluster 12/main ... 2023-07-21T22:08:33.641 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-07-21T22:08:33.709 INFO:teuthology.orchestra.run.smithi150.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-21T22:08:33.710 INFO:teuthology.orchestra.run.smithi150.stdout:This user must also own the server process. 2023-07-21T22:08:33.710 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:08:33.710 INFO:teuthology.orchestra.run.smithi150.stdout:The database cluster will be initialized with locale "en_US". 2023-07-21T22:08:33.710 INFO:teuthology.orchestra.run.smithi150.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-21T22:08:33.710 INFO:teuthology.orchestra.run.smithi150.stdout:The default text search configuration will be set to "english". 2023-07-21T22:08:33.710 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:08:33.710 INFO:teuthology.orchestra.run.smithi150.stdout:Data page checksums are disabled. 2023-07-21T22:08:33.711 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:08:33.711 INFO:teuthology.orchestra.run.smithi150.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-07-21T22:08:33.713 INFO:teuthology.orchestra.run.smithi150.stdout:creating subdirectories ... ok 2023-07-21T22:08:33.714 INFO:teuthology.orchestra.run.smithi150.stdout:selecting dynamic shared memory implementation ... posix 2023-07-21T22:08:33.749 INFO:teuthology.orchestra.run.smithi150.stdout:selecting default max_connections ... 100 2023-07-21T22:08:33.799 INFO:teuthology.orchestra.run.smithi150.stdout:selecting default shared_buffers ... 128MB 2023-07-21T22:08:33.821 INFO:teuthology.orchestra.run.smithi150.stdout:selecting default time zone ... Etc/UTC 2023-07-21T22:08:33.822 INFO:teuthology.orchestra.run.smithi150.stdout:creating configuration files ... ok 2023-07-21T22:08:33.943 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-21T22:08:33.964 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-07-21T22:08:34.001 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-07-21T22:08:34.014 INFO:teuthology.orchestra.run.smithi150.stdout:running bootstrap script ... ok 2023-07-21T22:08:34.389 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-client-12. 2023-07-21T22:08:34.409 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../24-postgresql-client-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-21T22:08:34.439 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T22:08:34.657 INFO:teuthology.orchestra.run.smithi150.stdout:performing post-bootstrap initialization ... ok 2023-07-21T22:08:35.118 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-common. 2023-07-21T22:08:35.134 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-07-21T22:08:35.211 INFO:teuthology.orchestra.run.smithi049.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-21T22:08:35.238 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-07-21T22:08:35.251 INFO:teuthology.orchestra.run.smithi150.stdout:syncing data to disk ... ok 2023-07-21T22:08:35.252 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:08:35.252 INFO:teuthology.orchestra.run.smithi150.stdout:Success. You can now start the database server using: 2023-07-21T22:08:35.252 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:08:35.252 INFO:teuthology.orchestra.run.smithi150.stdout: pg_ctlcluster 12 main start 2023-07-21T22:08:35.252 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:08:35.775 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-12. 2023-07-21T22:08:35.789 INFO:teuthology.orchestra.run.smithi150.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-07-21T22:08:35.789 INFO:teuthology.orchestra.run.smithi150.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-07-21T22:08:35.790 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../26-postgresql-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-21T22:08:35.872 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T22:08:35.984 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-21T22:08:37.912 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql. 2023-07-21T22:08:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-07-21T22:08:37.970 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-07-21T22:08:38.255 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-client. 2023-07-21T22:08:38.276 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-07-21T22:08:38.338 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-07-21T22:08:38.599 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-21T22:08:38.620 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-07-21T22:08:38.657 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-07-21T22:08:38.968 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-21T22:08:38.989 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-07-21T22:08:39.034 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-07-21T22:08:39.471 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-21T22:08:39.493 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-07-21T22:08:39.561 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-07-21T22:08:39.590 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T22:08:39.716 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-07-21T22:08:39.884 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-07-21T22:08:39.979 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-07-21T22:08:40.010 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-07-21T22:08:40.210 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-21T22:08:40.670 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T22:08:40.796 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-07-21T22:08:40.921 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-07-21T22:08:41.072 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-07-21T22:08:41.283 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:08:41.283 INFO:teuthology.orchestra.run.smithi150.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-21T22:08:41.283 INFO:teuthology.orchestra.run.smithi150.stdout:which means they are currently configured by ifupdown: 2023-07-21T22:08:41.283 INFO:teuthology.orchestra.run.smithi150.stdout:- enp3s0f1 2023-07-21T22:08:41.283 INFO:teuthology.orchestra.run.smithi150.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-21T22:08:41.284 INFO:teuthology.orchestra.run.smithi150.stdout:remove their configuration from /etc/network/interfaces. 2023-07-21T22:08:41.284 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:08:41.515 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-21T22:08:41.515 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-21T22:08:41.516 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-21T22:08:42.040 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-21T22:08:42.442 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T22:08:43.020 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-21T22:08:44.005 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T22:08:44.139 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-07-21T22:08:44.291 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-07-21T22:08:44.450 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-07-21T22:08:44.576 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T22:08:44.647 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-21T22:08:44.702 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T22:08:44.764 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-07-21T22:08:44.836 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T22:08:44.890 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-07-21T22:08:45.041 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-07-21T22:08:45.192 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-21T22:08:45.193 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-21T22:08:46.172 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-07-21T22:08:46.290 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-21T22:08:46.305 INFO:teuthology.orchestra.run.smithi049.stdout:Adding user postgres to group ssl-cert 2023-07-21T22:08:46.425 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-21T22:08:46.617 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-21T22:08:46.693 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:08:46.693 INFO:teuthology.orchestra.run.smithi049.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-21T22:08:47.143 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-21T22:08:47.194 INFO:teuthology.orchestra.run.smithi049.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-21T22:08:47.194 INFO:teuthology.orchestra.run.smithi049.stdout:Removing obsolete dictionary files: 2023-07-21T22:08:47.735 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-21T22:08:49.150 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-21T22:08:49.268 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-07-21T22:08:49.402 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-07-21T22:08:49.570 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-07-21T22:08:49.696 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-07-21T22:08:50.954 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-07-21T22:08:51.393 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up dump (0.4b46-6) ... 2023-07-21T22:08:51.506 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-21T22:08:51.570 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T22:08:51.696 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-07-21T22:08:51.863 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up indent (2.2.12-1) ... 2023-07-21T22:08:52.006 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-07-21T22:08:52.215 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-07-21T22:08:52.341 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T22:08:52.914 INFO:teuthology.orchestra.run.smithi049.stdout:Creating new PostgreSQL cluster 12/main ... 2023-07-21T22:08:52.942 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-07-21T22:08:53.008 INFO:teuthology.orchestra.run.smithi049.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-21T22:08:53.008 INFO:teuthology.orchestra.run.smithi049.stdout:This user must also own the server process. 2023-07-21T22:08:53.008 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:08:53.008 INFO:teuthology.orchestra.run.smithi049.stdout:The database cluster will be initialized with locale "en_US". 2023-07-21T22:08:53.009 INFO:teuthology.orchestra.run.smithi049.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-21T22:08:53.009 INFO:teuthology.orchestra.run.smithi049.stdout:The default text search configuration will be set to "english". 2023-07-21T22:08:53.009 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:08:53.009 INFO:teuthology.orchestra.run.smithi049.stdout:Data page checksums are disabled. 2023-07-21T22:08:53.009 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:08:53.009 INFO:teuthology.orchestra.run.smithi049.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-07-21T22:08:53.012 INFO:teuthology.orchestra.run.smithi049.stdout:creating subdirectories ... ok 2023-07-21T22:08:53.012 INFO:teuthology.orchestra.run.smithi049.stdout:selecting dynamic shared memory implementation ... posix 2023-07-21T22:08:53.048 INFO:teuthology.orchestra.run.smithi049.stdout:selecting default max_connections ... 100 2023-07-21T22:08:53.093 INFO:teuthology.orchestra.run.smithi049.stdout:selecting default shared_buffers ... 128MB 2023-07-21T22:08:53.116 INFO:teuthology.orchestra.run.smithi049.stdout:selecting default time zone ... Etc/UTC 2023-07-21T22:08:53.117 INFO:teuthology.orchestra.run.smithi049.stdout:creating configuration files ... ok 2023-07-21T22:08:53.314 INFO:teuthology.orchestra.run.smithi049.stdout:running bootstrap script ... ok 2023-07-21T22:08:54.011 INFO:teuthology.orchestra.run.smithi049.stdout:performing post-bootstrap initialization ... ok 2023-07-21T22:08:54.583 INFO:teuthology.orchestra.run.smithi049.stdout:syncing data to disk ... ok 2023-07-21T22:08:54.584 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:08:54.584 INFO:teuthology.orchestra.run.smithi049.stdout:Success. You can now start the database server using: 2023-07-21T22:08:54.584 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:08:54.584 INFO:teuthology.orchestra.run.smithi049.stdout: pg_ctlcluster 12 main start 2023-07-21T22:08:54.584 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:08:55.140 INFO:teuthology.orchestra.run.smithi049.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-07-21T22:08:55.140 INFO:teuthology.orchestra.run.smithi049.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-07-21T22:08:55.363 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-21T22:08:59.058 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T22:08:59.184 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-07-21T22:08:59.385 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-07-21T22:08:59.511 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-07-21T22:09:00.298 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-07-21T22:09:00.414 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-07-21T22:09:00.696 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:00.696 INFO:teuthology.orchestra.run.smithi049.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-21T22:09:00.696 INFO:teuthology.orchestra.run.smithi049.stdout:which means they are currently configured by ifupdown: 2023-07-21T22:09:00.696 INFO:teuthology.orchestra.run.smithi049.stdout:- ens1f0 2023-07-21T22:09:00.697 INFO:teuthology.orchestra.run.smithi049.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-21T22:09:00.697 INFO:teuthology.orchestra.run.smithi049.stdout:remove their configuration from /etc/network/interfaces. 2023-07-21T22:09:00.697 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:00.928 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-21T22:09:01.489 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-21T22:09:01.590 INFO:teuthology.orchestra.run.smithi150.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-21T22:09:01.597 DEBUG:teuthology.parallel:result is None 2023-07-21T22:09:02.447 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-21T22:09:03.439 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T22:09:03.573 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-07-21T22:09:03.733 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-07-21T22:09:03.884 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-07-21T22:09:04.010 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T22:09:04.136 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T22:09:04.295 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T22:09:04.619 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-21T22:09:04.619 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-21T22:09:05.657 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-07-21T22:09:05.765 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-21T22:09:05.900 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-21T22:09:06.102 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-21T22:09:06.603 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-21T22:09:20.106 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-07-21T22:09:20.215 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-07-21T22:09:21.453 INFO:teuthology.orchestra.run.smithi049.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-21T22:09:21.458 DEBUG:teuthology.parallel:result is None 2023-07-21T22:09:21.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:09:22.721 DEBUG:teuthology.orchestra.run.smithi049:> dpkg-query -W -f '${Version}' ceph 2023-07-21T22:09:22.757 INFO:teuthology.orchestra.run.smithi049.stdout:18.0.0-4735-gbffe049d-1focal 2023-07-21T22:09:22.758 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4735-gbffe049d-1focal 2023-07-21T22:09:22.758 INFO:teuthology.task.install:The correct ceph version 18.0.0-4735-gbffe049d-1focal is installed. 2023-07-21T22:09:22.759 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:09:28.241 DEBUG:teuthology.orchestra.run.smithi150:> dpkg-query -W -f '${Version}' ceph 2023-07-21T22:09:28.285 INFO:teuthology.orchestra.run.smithi150.stdout:18.0.0-4735-gbffe049d-1focal 2023-07-21T22:09:28.285 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4735-gbffe049d-1focal 2023-07-21T22:09:28.285 INFO:teuthology.task.install:The correct ceph version 18.0.0-4735-gbffe049d-1focal is installed. 2023-07-21T22:09:28.286 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-21T22:09:28.286 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:09:28.287 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-21T22:09:28.323 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:09:28.324 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-21T22:09:28.367 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-21T22:09:28.368 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:09:28.368 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2023-07-21T22:09:28.403 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-21T22:09:28.482 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:09:28.483 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2023-07-21T22:09:28.516 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-21T22:09:28.593 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-21T22:09:28.593 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:09:28.594 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-21T22:09:28.627 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-21T22:09:28.703 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:09:28.704 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-21T22:09:28.737 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-21T22:09:28.817 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-21T22:09:28.817 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:09:28.818 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2023-07-21T22:09:28.852 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-21T22:09:28.924 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:09:28.925 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2023-07-21T22:09:28.957 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-21T22:09:29.033 INFO:teuthology.run_tasks:Running task ceph... 2023-07-21T22:09:29.110 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-21T22:09:29.111 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /var/log/ceph 2023-07-21T22:09:29.118 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2023-07-21T22:09:29.150 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-21T22:09:29.151 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-21T22:09:29.200 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-21T22:09:29.233 INFO:tasks.ceph:Creating extra log directories... 2023-07-21T22:09:29.234 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-21T22:09:29.283 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-21T22:09:29.327 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-21T22:09:29.327 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-21T22:09:29.327 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-21T22:09:29.328 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:09:29.328 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-21T22:09:29.379 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-21T22:09:29.513 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:09:29.513 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-21T22:09:29.533 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-21T22:09:29.666 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-21T22:09:29.666 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-21T22:09:29.667 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719', 'branch': 'wip-rishabh-2023Jul13-base-2', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm}', 'email': None, 'first_in_suite': False, 'job_id': '7347719', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Jul13-base-2'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Jul13-base-2', 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Jul13-base-2', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi049.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=', 'smithi150.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '79491cb69dd37a1eafb93b3471998174bdfa2fd9', 'timestamp': '2023-07-21_21:30:53', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-21T22:09:29.667 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-21T22:09:29.675 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-21T22:09:29.692 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/run/ceph 2023-07-21T22:09:29.736 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2023-07-21T22:09:29.776 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:09:29.776 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2023-07-21T22:09:29.824 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-21T22:09:29.824 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2023-07-21T22:09:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-21T22:09:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:09:29.889 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 493 Links: 1 2023-07-21T22:09:29.889 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:09:29.889 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-07-21 22:02:59.194749508 +0000 2023-07-21T22:09:29.890 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-07-21 22:02:58.726754398 +0000 2023-07-21T22:09:29.890 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-07-21 22:02:58.726754398 +0000 2023-07-21T22:09:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-07-21T22:09:29.890 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-21T22:09:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-07-21T22:09:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-07-21T22:09:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.00061502 s, 832 kB/s 2023-07-21T22:09:29.963 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-21T22:09:30.030 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2023-07-21T22:09:30.092 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-21T22:09:30.093 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:09:30.093 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 499 Links: 1 2023-07-21T22:09:30.093 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:09:30.093 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-07-21 22:03:00.006740545 +0000 2023-07-21T22:09:30.093 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-07-21 22:02:59.506746064 +0000 2023-07-21T22:09:30.093 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-07-21 22:02:59.506746064 +0000 2023-07-21T22:09:30.094 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-07-21T22:09:30.094 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-21T22:09:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-07-21T22:09:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-07-21T22:09:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000408646 s, 1.3 MB/s 2023-07-21T22:09:30.168 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-21T22:09:30.233 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2023-07-21T22:09:30.295 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-21T22:09:30.296 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:09:30.296 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 506 Links: 1 2023-07-21T22:09:30.296 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:09:30.296 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-07-21 22:03:00.818731582 +0000 2023-07-21T22:09:30.296 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-07-21 22:03:00.306737234 +0000 2023-07-21T22:09:30.297 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-07-21 22:03:00.306737234 +0000 2023-07-21T22:09:30.297 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-07-21T22:09:30.297 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-21T22:09:30.369 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-07-21T22:09:30.369 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-07-21T22:09:30.370 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000397029 s, 1.3 MB/s 2023-07-21T22:09:30.371 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-21T22:09:30.436 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2023-07-21T22:09:30.495 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-21T22:09:30.496 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:09:30.496 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 512 Links: 1 2023-07-21T22:09:30.496 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:09:30.496 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-07-21 22:03:01.626722663 +0000 2023-07-21T22:09:30.496 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-07-21 22:03:01.122728226 +0000 2023-07-21T22:09:30.496 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-07-21 22:03:01.122728226 +0000 2023-07-21T22:09:30.497 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-07-21T22:09:30.497 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-21T22:09:30.569 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-07-21T22:09:30.569 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-07-21T22:09:30.569 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000569717 s, 899 kB/s 2023-07-21T22:09:30.571 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-21T22:09:30.636 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T22:09:30.636 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:09:30.637 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2023-07-21T22:09:30.654 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-21T22:09:30.655 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2023-07-21T22:09:30.714 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-21T22:09:30.715 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:09:30.715 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 492 Links: 1 2023-07-21T22:09:30.715 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:09:30.715 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-07-21 22:02:56.164396884 +0000 2023-07-21T22:09:30.715 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-07-21 22:02:56.160396976 +0000 2023-07-21T22:09:30.716 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-07-21 22:02:56.160396976 +0000 2023-07-21T22:09:30.716 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2023-07-21T22:09:30.716 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-21T22:09:30.787 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-07-21T22:09:30.787 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-07-21T22:09:30.787 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000576603 s, 888 kB/s 2023-07-21T22:09:30.789 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-21T22:09:30.857 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2023-07-21T22:09:30.919 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-21T22:09:30.919 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:09:30.919 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 498 Links: 1 2023-07-21T22:09:30.919 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:09:30.919 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-07-21 22:02:57.436367549 +0000 2023-07-21T22:09:30.919 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-07-21 22:02:56.952378711 +0000 2023-07-21T22:09:30.920 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-07-21 22:02:56.952378711 +0000 2023-07-21T22:09:30.920 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2023-07-21T22:09:30.920 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-21T22:09:30.991 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-07-21T22:09:30.991 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-07-21T22:09:30.992 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000741003 s, 691 kB/s 2023-07-21T22:09:30.993 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-21T22:09:31.061 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2023-07-21T22:09:31.123 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-21T22:09:31.123 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:09:31.123 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 503 Links: 1 2023-07-21T22:09:31.123 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:09:31.124 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-07-21 22:02:58.184350300 +0000 2023-07-21T22:09:31.124 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-07-21 22:02:57.704361369 +0000 2023-07-21T22:09:31.124 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-07-21 22:02:57.704361369 +0000 2023-07-21T22:09:31.124 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2023-07-21T22:09:31.125 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-21T22:09:31.199 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-07-21T22:09:31.199 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-07-21T22:09:31.199 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000582284 s, 879 kB/s 2023-07-21T22:09:31.201 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-21T22:09:31.269 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2023-07-21T22:09:31.334 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-21T22:09:31.335 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:09:31.335 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 511 Links: 1 2023-07-21T22:09:31.335 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:09:31.335 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-07-21 22:02:58.956332496 +0000 2023-07-21T22:09:31.335 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-07-21 22:02:58.468343751 +0000 2023-07-21T22:09:31.336 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-07-21 22:02:58.468343751 +0000 2023-07-21T22:09:31.336 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2023-07-21T22:09:31.336 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-21T22:09:31.407 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-07-21T22:09:31.407 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-07-21T22:09:31.407 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000689257 s, 743 kB/s 2023-07-21T22:09:31.409 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-21T22:09:31.482 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T22:09:31.482 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-21T22:09:31.482 INFO:tasks.ceph:Generating config... 2023-07-21T22:09:31.484 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-21T22:09:31.484 INFO:tasks.ceph:[client] debug client = 20 2023-07-21T22:09:31.484 INFO:tasks.ceph:[client] debug ms = 1 2023-07-21T22:09:31.484 INFO:tasks.ceph:[client] pid file = 2023-07-21T22:09:31.485 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-21T22:09:31.485 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-21T22:09:31.485 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-21T22:09:31.486 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-21T22:09:31.486 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-21T22:09:31.486 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-21T22:09:31.486 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-21T22:09:31.487 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-21T22:09:31.487 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-21T22:09:31.487 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-21T22:09:31.488 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-21T22:09:31.488 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-21T22:09:31.488 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-21T22:09:31.488 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-21T22:09:31.488 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-21T22:09:31.489 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-21T22:09:31.489 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-21T22:09:31.489 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-21T22:09:31.489 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-21T22:09:31.489 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-21T22:09:31.490 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-07-21T22:09:31.490 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-07-21T22:09:31.490 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-21T22:09:31.491 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-21T22:09:31.491 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-07-21T22:09:31.492 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-21T22:09:31.492 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-21T22:09:31.493 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-21T22:09:31.493 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-21T22:09:31.494 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-21T22:09:31.494 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-21T22:09:31.495 INFO:tasks.ceph:Setting up mon.a... 2023-07-21T22:09:31.495 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-21T22:09:31.567 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.keyring 2023-07-21T22:09:31.704 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-21T22:09:31.782 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-21T22:09:31.812 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.49'), ('mon.b', '172.21.15.150'), ('mon.c', '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]')] 2023-07-21T22:09:31.813 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.49,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-21T22:09:31.814 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:09:31.814 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-21T22:09:31.871 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.49 --add b 172.21.15.150 --addv c '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:09:31.986 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:09:31.987 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: generated fsid c1346180-e695-42c2-8f5b-b72be8101116 2023-07-21T22:09:31.987 INFO:teuthology.orchestra.run.smithi049.stdout:setting min_mon_release = pacific 2023-07-21T22:09:31.987 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 0 2023-07-21T22:09:31.987 INFO:teuthology.orchestra.run.smithi049.stdout:fsid c1346180-e695-42c2-8f5b-b72be8101116 2023-07-21T22:09:31.987 INFO:teuthology.orchestra.run.smithi049.stdout:last_changed 2023-07-21T22:09:31.947480+0000 2023-07-21T22:09:31.988 INFO:teuthology.orchestra.run.smithi049.stdout:created 2023-07-21T22:09:31.947480+0000 2023-07-21T22:09:31.988 INFO:teuthology.orchestra.run.smithi049.stdout:min_mon_release 16 (pacific) 2023-07-21T22:09:31.988 INFO:teuthology.orchestra.run.smithi049.stdout:election_strategy: 1 2023-07-21T22:09:31.988 INFO:teuthology.orchestra.run.smithi049.stdout:0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2023-07-21T22:09:31.989 INFO:teuthology.orchestra.run.smithi049.stdout:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2023-07-21T22:09:31.989 INFO:teuthology.orchestra.run.smithi049.stdout:2: [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] mon.c 2023-07-21T22:09:31.989 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-21T22:09:31.990 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-21T22:09:32.007 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c1346180-e695-42c2-8f5b-b72be8101116... 2023-07-21T22:09:32.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-21T22:09:32.060 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-21T22:09:32.132 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2023-07-21T22:09:32.133 INFO:teuthology.orchestra.run.smithi049.stdout: chdir = "" 2023-07-21T22:09:32.133 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-21T22:09:32.133 INFO:teuthology.orchestra.run.smithi049.stdout: auth supported = cephx 2023-07-21T22:09:32.133 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.133 INFO:teuthology.orchestra.run.smithi049.stdout: filestore xattr use omap = true 2023-07-21T22:09:32.133 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.133 INFO:teuthology.orchestra.run.smithi049.stdout: mon clock drift allowed = 1.000 2023-07-21T22:09:32.134 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.134 INFO:teuthology.orchestra.run.smithi049.stdout: osd crush chooseleaf type = 0 2023-07-21T22:09:32.134 INFO:teuthology.orchestra.run.smithi049.stdout: auth debug = true 2023-07-21T22:09:32.134 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.134 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on old message = true 2023-07-21T22:09:32.134 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on bug = true 2023-07-21T22:09:32.134 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.134 INFO:teuthology.orchestra.run.smithi049.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-21T22:09:32.135 INFO:teuthology.orchestra.run.smithi049.stdout: mon pg warn max object skew = 0 2023-07-21T22:09:32.135 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.135 INFO:teuthology.orchestra.run.smithi049.stdout: # disable pg_autoscaler by default for new pools 2023-07-21T22:09:32.135 INFO:teuthology.orchestra.run.smithi049.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-21T22:09:32.135 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.135 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default size = 2 2023-07-21T22:09:32.135 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.135 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow primary affinity = true 2023-07-21T22:09:32.136 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow pg remap = true 2023-07-21T22:09:32.136 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on legacy crush tunables = false 2023-07-21T22:09:32.136 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on crush straw calc version zero = false 2023-07-21T22:09:32.136 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on no sortbitwise = false 2023-07-21T22:09:32.136 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on osd down out interval zero = false 2023-07-21T22:09:32.136 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on too few osds = false 2023-07-21T22:09:32.136 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-21T22:09:32.137 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-21T22:09:32.137 INFO:teuthology.orchestra.run.smithi049.stdout: mon_allow_pool_size_one = true 2023-07-21T22:09:32.137 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.137 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-21T22:09:32.137 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.137 INFO:teuthology.orchestra.run.smithi049.stdout: osd default data pool replay window = 5 2023-07-21T22:09:32.137 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.137 INFO:teuthology.orchestra.run.smithi049.stdout: mon allow pool delete = true 2023-07-21T22:09:32.138 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.138 INFO:teuthology.orchestra.run.smithi049.stdout: mon cluster log file level = debug 2023-07-21T22:09:32.138 INFO:teuthology.orchestra.run.smithi049.stdout: debug asserts on shutdown = true 2023-07-21T22:09:32.138 INFO:teuthology.orchestra.run.smithi049.stdout: mon health detail to clog = false 2023-07-21T22:09:32.138 INFO:teuthology.orchestra.run.smithi049.stdout: mon host = "172.21.15.49,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2023-07-21T22:09:32.138 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = c1346180-e695-42c2-8f5b-b72be8101116 2023-07-21T22:09:32.138 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.139 INFO:teuthology.orchestra.run.smithi049.stdout:[osd] 2023-07-21T22:09:32.139 INFO:teuthology.orchestra.run.smithi049.stdout: osd journal size = 100 2023-07-21T22:09:32.139 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.139 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub load threshold = 5.0 2023-07-21T22:09:32.139 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub max interval = 600 2023-07-21T22:09:32.139 INFO:teuthology.orchestra.run.smithi049.stdout: osd mclock profile = high_recovery_ops 2023-07-21T22:09:32.139 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.139 INFO:teuthology.orchestra.run.smithi049.stdout: osd recover clone overlap = true 2023-07-21T22:09:32.140 INFO:teuthology.orchestra.run.smithi049.stdout: osd recovery max chunk = 1048576 2023-07-21T22:09:32.140 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.140 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug shutdown = true 2023-07-21T22:09:32.140 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug op order = true 2023-07-21T22:09:32.140 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug verify stray on activate = true 2023-07-21T22:09:32.140 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.140 INFO:teuthology.orchestra.run.smithi049.stdout: osd open classes on start = true 2023-07-21T22:09:32.140 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug pg log writeout = true 2023-07-21T22:09:32.141 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.141 INFO:teuthology.orchestra.run.smithi049.stdout: osd deep scrub update digest min age = 30 2023-07-21T22:09:32.141 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.141 INFO:teuthology.orchestra.run.smithi049.stdout: osd map max advance = 10 2023-07-21T22:09:32.141 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.141 INFO:teuthology.orchestra.run.smithi049.stdout: journal zero on create = true 2023-07-21T22:09:32.141 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.142 INFO:teuthology.orchestra.run.smithi049.stdout: filestore ondisk finisher threads = 3 2023-07-21T22:09:32.142 INFO:teuthology.orchestra.run.smithi049.stdout: filestore apply finisher threads = 3 2023-07-21T22:09:32.142 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.142 INFO:teuthology.orchestra.run.smithi049.stdout: bdev debug aio = true 2023-07-21T22:09:32.142 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug misdirected ops = true 2023-07-21T22:09:32.142 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore block size = 96636764160 2023-07-21T22:09:32.142 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore fsck on mount = True 2023-07-21T22:09:32.142 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluefs = 20 2023-07-21T22:09:32.143 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluestore = 20 2023-07-21T22:09:32.143 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-07-21T22:09:32.143 INFO:teuthology.orchestra.run.smithi049.stdout: debug osd = 20 2023-07-21T22:09:32.143 INFO:teuthology.orchestra.run.smithi049.stdout: debug rocksdb = 10 2023-07-21T22:09:32.143 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd backfillfull_ratio = 0.85 2023-07-21T22:09:32.143 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd full ratio = 0.9 2023-07-21T22:09:32.143 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd nearfull ratio = 0.8 2023-07-21T22:09:32.143 INFO:teuthology.orchestra.run.smithi049.stdout: osd failsafe full ratio = 0.95 2023-07-21T22:09:32.144 INFO:teuthology.orchestra.run.smithi049.stdout: osd objectstore = bluestore 2023-07-21T22:09:32.144 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2023-07-21T22:09:32.144 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.144 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr] 2023-07-21T22:09:32.144 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-07-21T22:09:32.144 INFO:teuthology.orchestra.run.smithi049.stdout: debug mgr = 20 2023-07-21T22:09:32.144 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2023-07-21T22:09:32.144 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2023-07-21T22:09:32.145 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2023-07-21T22:09:32.145 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2023-07-21T22:09:32.145 INFO:teuthology.orchestra.run.smithi049.stdout: mgr/telemetry/nag = false 2023-07-21T22:09:32.145 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.145 INFO:teuthology.orchestra.run.smithi049.stdout:[mon] 2023-07-21T22:09:32.145 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-07-21T22:09:32.145 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2023-07-21T22:09:32.146 INFO:teuthology.orchestra.run.smithi049.stdout: debug paxos = 20 2023-07-21T22:09:32.146 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2023-07-21T22:09:32.146 INFO:teuthology.orchestra.run.smithi049.stdout: mon data avail warn = 5 2023-07-21T22:09:32.146 INFO:teuthology.orchestra.run.smithi049.stdout: mon mgr mkfs grace = 240 2023-07-21T22:09:32.146 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2023-07-21T22:09:32.146 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd reporter subtree level = osd 2023-07-21T22:09:32.146 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd prime pg temp = true 2023-07-21T22:09:32.146 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2023-07-21T22:09:32.147 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.147 INFO:teuthology.orchestra.run.smithi049.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-21T22:09:32.147 INFO:teuthology.orchestra.run.smithi049.stdout: auth mon ticket ttl = 660 # 11m 2023-07-21T22:09:32.147 INFO:teuthology.orchestra.run.smithi049.stdout: auth service ticket ttl = 240 # 4m 2023-07-21T22:09:32.147 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.147 INFO:teuthology.orchestra.run.smithi049.stdout: # don't complain about insecure global_id in the test suite 2023-07-21T22:09:32.147 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-21T22:09:32.147 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-21T22:09:32.148 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.148 INFO:teuthology.orchestra.run.smithi049.stdout: # 1m isn't quite enough 2023-07-21T22:09:32.148 INFO:teuthology.orchestra.run.smithi049.stdout: mon_down_mkfs_grace = 2m 2023-07-21T22:09:32.148 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.148 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_filestore_osds = false 2023-07-21T22:09:32.148 INFO:teuthology.orchestra.run.smithi049.stdout: mon op complaint time = 120 2023-07-21T22:09:32.148 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:09:32.149 INFO:teuthology.orchestra.run.smithi049.stdout:[client] 2023-07-21T22:09:32.149 INFO:teuthology.orchestra.run.smithi049.stdout: rgw cache enabled = true 2023-07-21T22:09:32.149 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable ops log = true 2023-07-21T22:09:32.149 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable usage log = true 2023-07-21T22:09:32.149 INFO:teuthology.orchestra.run.smithi049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-21T22:09:32.149 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-21T22:09:32.149 INFO:teuthology.orchestra.run.smithi049.stdout: client mount timeout = 600 2023-07-21T22:09:32.149 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2023-07-21T22:09:32.150 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-07-21T22:09:32.150 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = "" 2023-07-21T22:09:32.150 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2023-07-21T22:09:32.150 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2023-07-21T22:09:32.150 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.a] 2023-07-21T22:09:32.150 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.b] 2023-07-21T22:09:32.150 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.c] 2023-07-21T22:09:32.150 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2023-07-21T22:09:32.151 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2023-07-21T22:09:32.151 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2023-07-21T22:09:32.151 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2023-07-21T22:09:32.151 INFO:teuthology.orchestra.run.smithi049.stdout:[mds] 2023-07-21T22:09:32.151 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds = 20 2023-07-21T22:09:32.151 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds balancer = 20 2023-07-21T22:09:32.151 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-07-21T22:09:32.151 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug frag = True 2023-07-21T22:09:32.152 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug scatterstat = True 2023-07-21T22:09:32.152 INFO:teuthology.orchestra.run.smithi049.stdout: mds op complaint time = 180 2023-07-21T22:09:32.152 INFO:teuthology.orchestra.run.smithi049.stdout: mds verify scatter = True 2023-07-21T22:09:32.152 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2023-07-21T22:09:32.152 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2023-07-21T22:09:32.152 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2023-07-21T22:09:32.153 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2023-07-21T22:09:32.153 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2023-07-21T22:09:32.153 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-21T22:09:32.153 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2023-07-21T22:09:32.153 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.154 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2023-07-21T22:09:32.154 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.154 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2023-07-21T22:09:32.154 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.154 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2023-07-21T22:09:32.154 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2023-07-21T22:09:32.154 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.154 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2023-07-21T22:09:32.155 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2023-07-21T22:09:32.155 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.155 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-21T22:09:32.155 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2023-07-21T22:09:32.155 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.155 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2023-07-21T22:09:32.155 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-21T22:09:32.156 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.156 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2023-07-21T22:09:32.156 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.156 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2023-07-21T22:09:32.156 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2023-07-21T22:09:32.156 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2023-07-21T22:09:32.156 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2023-07-21T22:09:32.156 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2023-07-21T22:09:32.157 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2023-07-21T22:09:32.157 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2023-07-21T22:09:32.157 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-21T22:09:32.157 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-21T22:09:32.157 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2023-07-21T22:09:32.157 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.157 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-21T22:09:32.157 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.158 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2023-07-21T22:09:32.158 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.158 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2023-07-21T22:09:32.158 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.158 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2023-07-21T22:09:32.159 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2023-07-21T22:09:32.159 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2023-07-21T22:09:32.159 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.49,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2023-07-21T22:09:32.159 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = c1346180-e695-42c2-8f5b-b72be8101116 2023-07-21T22:09:32.159 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.159 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2023-07-21T22:09:32.159 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2023-07-21T22:09:32.160 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.160 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2023-07-21T22:09:32.160 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2023-07-21T22:09:32.160 INFO:teuthology.orchestra.run.smithi150.stdout: osd mclock profile = high_recovery_ops 2023-07-21T22:09:32.160 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.160 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2023-07-21T22:09:32.160 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2023-07-21T22:09:32.160 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.161 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2023-07-21T22:09:32.161 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2023-07-21T22:09:32.161 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2023-07-21T22:09:32.161 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.161 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2023-07-21T22:09:32.161 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2023-07-21T22:09:32.161 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.161 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2023-07-21T22:09:32.162 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.162 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2023-07-21T22:09:32.162 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.162 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2023-07-21T22:09:32.162 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.162 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2023-07-21T22:09:32.163 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2023-07-21T22:09:32.163 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.163 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2023-07-21T22:09:32.163 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2023-07-21T22:09:32.163 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore block size = 96636764160 2023-07-21T22:09:32.163 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore fsck on mount = True 2023-07-21T22:09:32.164 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluefs = 20 2023-07-21T22:09:32.164 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluestore = 20 2023-07-21T22:09:32.164 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-07-21T22:09:32.164 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 20 2023-07-21T22:09:32.164 INFO:teuthology.orchestra.run.smithi150.stdout: debug rocksdb = 10 2023-07-21T22:09:32.164 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd backfillfull_ratio = 0.85 2023-07-21T22:09:32.164 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd full ratio = 0.9 2023-07-21T22:09:32.164 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd nearfull ratio = 0.8 2023-07-21T22:09:32.165 INFO:teuthology.orchestra.run.smithi150.stdout: osd failsafe full ratio = 0.95 2023-07-21T22:09:32.165 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = bluestore 2023-07-21T22:09:32.165 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2023-07-21T22:09:32.165 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.165 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2023-07-21T22:09:32.165 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-07-21T22:09:32.165 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2023-07-21T22:09:32.165 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2023-07-21T22:09:32.166 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2023-07-21T22:09:32.166 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2023-07-21T22:09:32.166 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2023-07-21T22:09:32.166 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2023-07-21T22:09:32.166 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.166 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2023-07-21T22:09:32.166 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-07-21T22:09:32.167 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2023-07-21T22:09:32.167 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2023-07-21T22:09:32.167 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2023-07-21T22:09:32.167 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2023-07-21T22:09:32.167 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2023-07-21T22:09:32.167 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2023-07-21T22:09:32.167 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2023-07-21T22:09:32.167 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2023-07-21T22:09:32.168 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2023-07-21T22:09:32.168 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.168 INFO:teuthology.orchestra.run.smithi150.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-21T22:09:32.168 INFO:teuthology.orchestra.run.smithi150.stdout: auth mon ticket ttl = 660 # 11m 2023-07-21T22:09:32.168 INFO:teuthology.orchestra.run.smithi150.stdout: auth service ticket ttl = 240 # 4m 2023-07-21T22:09:32.168 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.168 INFO:teuthology.orchestra.run.smithi150.stdout: # don't complain about insecure global_id in the test suite 2023-07-21T22:09:32.168 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-21T22:09:32.169 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-21T22:09:32.169 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.169 INFO:teuthology.orchestra.run.smithi150.stdout: # 1m isn't quite enough 2023-07-21T22:09:32.169 INFO:teuthology.orchestra.run.smithi150.stdout: mon_down_mkfs_grace = 2m 2023-07-21T22:09:32.169 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.169 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_filestore_osds = false 2023-07-21T22:09:32.169 INFO:teuthology.orchestra.run.smithi150.stdout: mon op complaint time = 120 2023-07-21T22:09:32.170 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-21T22:09:32.170 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2023-07-21T22:09:32.170 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2023-07-21T22:09:32.170 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2023-07-21T22:09:32.170 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2023-07-21T22:09:32.170 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-21T22:09:32.170 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-21T22:09:32.170 INFO:teuthology.orchestra.run.smithi150.stdout: client mount timeout = 600 2023-07-21T22:09:32.171 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2023-07-21T22:09:32.171 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-07-21T22:09:32.171 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = "" 2023-07-21T22:09:32.171 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2023-07-21T22:09:32.171 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2023-07-21T22:09:32.171 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2023-07-21T22:09:32.171 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2023-07-21T22:09:32.171 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2023-07-21T22:09:32.172 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2023-07-21T22:09:32.172 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2023-07-21T22:09:32.172 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2023-07-21T22:09:32.172 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2023-07-21T22:09:32.172 INFO:teuthology.orchestra.run.smithi150.stdout:[mds] 2023-07-21T22:09:32.172 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds = 20 2023-07-21T22:09:32.172 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds balancer = 20 2023-07-21T22:09:32.172 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-07-21T22:09:32.173 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug frag = True 2023-07-21T22:09:32.173 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug scatterstat = True 2023-07-21T22:09:32.173 INFO:teuthology.orchestra.run.smithi150.stdout: mds op complaint time = 180 2023-07-21T22:09:32.173 INFO:teuthology.orchestra.run.smithi150.stdout: mds verify scatter = True 2023-07-21T22:09:32.173 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2023-07-21T22:09:32.173 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2023-07-21T22:09:32.173 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2023-07-21T22:09:32.175 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-21T22:09:32.175 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-21T22:09:32.265 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-21T22:09:32.266 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:09:32.266 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-21T22:09:32.283 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:09:32.283 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-21T22:09:32.347 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:09:32.348 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:09:32.349 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-21T22:09:32.349 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-21T22:09:32.457 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:09:32.457 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:09:32.519 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:09:32.519 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:09:32.519 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-21T22:09:32.520 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-21T22:09:32.581 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:09:32.582 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:09:32.642 INFO:tasks.ceph:Setting up mon nodes... 2023-07-21T22:09:32.644 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-21T22:09:32.645 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-21T22:09:32.749 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-21T22:09:32.757 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-21T22:09:32.856 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-21T22:09:32.881 INFO:tasks.ceph:Setting up mds nodes... 2023-07-21T22:09:32.881 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-21T22:09:32.976 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-21T22:09:32.982 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-21T22:09:33.016 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-21T22:09:33.162 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-21T22:09:33.169 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-21T22:09:33.202 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-21T22:09:33.306 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-21T22:09:33.313 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-21T22:09:33.346 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-21T22:09:33.483 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-21T22:09:33.490 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-21T22:09:33.523 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-21T22:09:33.523 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-21T22:09:33.598 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-21T22:09:33.628 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-21T22:09:33.703 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-21T22:09:33.732 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-21T22:09:33.806 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-21T22:09:33.835 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-21T22:09:33.909 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-21T22:09:33.936 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-21T22:09:33.936 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-21T22:09:33.937 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-21T22:09:33.972 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T22:09:33.973 INFO:tasks.ceph:role: osd.0 2023-07-21T22:09:33.973 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:09:33.973 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-21T22:09:34.089 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:09:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:09:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:09:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 2023-07-21T22:09:34.090 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:09:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:09:34.090 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:09:34.090 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:09:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:09:34.091 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:09:34.094 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-07-21T22:09:34.095 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-21T22:09:34.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-21T22:09:34.165 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:09:34.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:09:34.166 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-21T22:09:34.251 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T22:09:34.251 INFO:tasks.ceph:role: osd.1 2023-07-21T22:09:34.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:09:34.251 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-21T22:09:34.364 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:09:34.365 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:09:34.365 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:09:34.365 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 2023-07-21T22:09:34.366 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:09:34.366 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:09:34.366 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:09:34.367 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:09:34.367 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:09:34.367 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:09:34.370 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-07-21T22:09:34.370 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-21T22:09:34.415 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-21T22:09:34.481 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:09:34.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:09:34.483 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-21T22:09:34.564 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T22:09:34.565 INFO:tasks.ceph:role: osd.2 2023-07-21T22:09:34.565 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:09:34.565 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-21T22:09:34.675 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:09:34.676 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:09:34.676 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:09:34.676 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 2023-07-21T22:09:34.676 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:09:34.676 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:09:34.676 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:09:34.676 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:09:34.677 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:09:34.677 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:09:34.681 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-07-21T22:09:34.681 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-21T22:09:34.726 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-21T22:09:34.794 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:09:34.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:09:34.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-21T22:09:34.874 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T22:09:34.874 INFO:tasks.ceph:role: osd.3 2023-07-21T22:09:34.874 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:09:34.875 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-21T22:09:34.991 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:09:34.991 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:09:34.991 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:09:34.992 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 2023-07-21T22:09:34.992 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:09:34.992 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:09:34.992 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:09:34.992 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:09:34.992 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:09:34.992 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:09:34.996 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-07-21T22:09:34.997 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-21T22:09:35.037 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-21T22:09:35.105 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:09:35.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:09:35.108 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:09:35.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:35.223+0000 7f425388b700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-21T22:09:35.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:35.223+0000 7f425388b700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-21T22:09:35.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:35.223+0000 7f425388b700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-21T22:09:35.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:35.223+0000 7f425388b700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-21T22:09:35.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:35.223+0000 7f425388b700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-21T22:09:35.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:35.227+0000 7f425388b700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-21T22:09:38.356 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-21T22:09:38.393 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:09:38.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:38.479+0000 7f0aad15f700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-21T22:09:38.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:38.479+0000 7f0aad15f700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-21T22:09:38.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:38.479+0000 7f0aad15f700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-21T22:09:38.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:38.479+0000 7f0aad15f700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-21T22:09:38.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:38.479+0000 7f0aad15f700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-21T22:09:38.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:38.479+0000 7f0aad15f700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-21T22:09:41.575 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-21T22:09:41.605 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:09:41.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:41.691+0000 7fcdb8bc2700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-21T22:09:41.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:41.691+0000 7fcdb8bc2700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-21T22:09:41.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:41.691+0000 7fcdb8bc2700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-21T22:09:41.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:41.691+0000 7fcdb8bc2700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-21T22:09:41.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:41.691+0000 7fcdb8bc2700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-21T22:09:41.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:41.695+0000 7fcdb8bc2700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-21T22:09:44.804 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-21T22:09:44.837 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:09:44.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:44.923+0000 7f3c0e5d9700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-21T22:09:44.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:44.923+0000 7f3c0e5d9700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-21T22:09:44.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:44.923+0000 7f3c0e5d9700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-21T22:09:44.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:44.923+0000 7f3c0e5d9700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-21T22:09:44.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:44.923+0000 7f3c0e5d9700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-21T22:09:44.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:09:44.927+0000 7f3c0e5d9700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-21T22:09:48.037 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-21T22:09:48.073 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-21T22:09:48.109 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T22:09:48.109 INFO:tasks.ceph:role: osd.4 2023-07-21T22:09:48.109 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:09:48.110 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-21T22:09:48.680 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:09:48.681 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:09:48.681 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:09:48.681 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2023-07-21T22:09:48.681 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:09:48.682 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:09:48.682 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:09:48.682 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:09:48.682 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:09:48.682 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:09:48.684 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2023-07-21T22:09:48.685 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-21T22:09:48.813 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-21T22:09:48.837 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:09:48.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:09:48.838 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-21T22:09:48.914 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T22:09:48.915 INFO:tasks.ceph:role: osd.5 2023-07-21T22:09:48.915 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:09:48.915 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-21T22:09:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:09:49.464 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:09:49.464 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:09:49.465 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2023-07-21T22:09:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:09:49.465 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:09:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:09:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:09:49.466 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:09:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:09:49.470 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2023-07-21T22:09:49.470 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-21T22:09:49.542 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-21T22:09:49.560 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:09:49.560 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:09:49.561 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-21T22:09:49.644 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T22:09:49.644 INFO:tasks.ceph:role: osd.6 2023-07-21T22:09:49.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:09:49.645 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-21T22:09:50.178 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:09:50.178 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:09:50.178 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:09:50.179 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2023-07-21T22:09:50.179 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:09:50.179 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:09:50.179 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:09:50.179 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:09:50.179 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:09:50.179 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:09:50.185 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2023-07-21T22:09:50.185 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-21T22:09:50.290 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-21T22:09:50.311 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:09:50.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:09:50.313 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-21T22:09:50.393 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T22:09:50.393 INFO:tasks.ceph:role: osd.7 2023-07-21T22:09:50.393 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:09:50.394 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-21T22:09:50.981 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:09:50.981 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:09:50.981 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:09:50.982 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2023-07-21T22:09:50.982 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:09:50.982 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:09:50.982 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:09:50.982 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:09:50.982 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:09:50.983 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:09:50.986 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2023-07-21T22:09:50.987 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-21T22:09:51.113 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-21T22:09:51.133 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:09:51.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:09:51.134 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:09:51.302 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:51.259+0000 7f4f83245700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-21T22:09:51.306 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:51.263+0000 7f4f83245700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-21T22:09:51.306 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:51.263+0000 7f4f83245700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-21T22:09:51.306 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:51.263+0000 7f4f83245700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-21T22:09:51.306 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:51.263+0000 7f4f83245700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-21T22:09:51.309 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:51.267+0000 7f4f83245700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-21T22:09:54.407 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-21T22:09:54.441 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:09:54.567 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:54.523+0000 7fc0c29c2700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-21T22:09:54.569 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:54.527+0000 7fc0c29c2700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-21T22:09:54.569 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:54.527+0000 7fc0c29c2700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-21T22:09:54.569 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:54.527+0000 7fc0c29c2700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-21T22:09:54.569 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:54.527+0000 7fc0c29c2700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-21T22:09:54.572 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:54.527+0000 7fc0c29c2700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-21T22:09:57.628 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-21T22:09:57.662 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:09:57.794 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:57.751+0000 7f73f6493700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-21T22:09:57.794 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:57.751+0000 7f73f6493700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-21T22:09:57.795 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:57.751+0000 7f73f6493700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-21T22:09:57.795 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:57.751+0000 7f73f6493700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-21T22:09:57.795 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:57.751+0000 7f73f6493700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-21T22:09:57.797 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:09:57.755+0000 7f73f6493700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-21T22:09:59.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:09:59.676 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:10:00.860 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-21T22:10:00.895 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:10:01.022 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:00.979+0000 7f606c53a700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-21T22:10:01.023 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:00.979+0000 7f606c53a700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-21T22:10:01.023 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:00.979+0000 7f606c53a700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-21T22:10:01.024 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:00.979+0000 7f606c53a700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-21T22:10:01.024 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:00.979+0000 7f606c53a700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-21T22:10:01.026 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:00.983+0000 7f606c53a700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-21T22:10:04.078 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-21T22:10:04.111 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-21T22:10:04.111 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:04.112 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-21T22:10:04.156 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:04.156 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-21T22:10:04.231 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:04.231 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-21T22:10:04.308 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:04.309 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-21T22:10:04.380 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:04.381 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-21T22:10:04.455 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:04.455 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-21T22:10:04.532 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:04.532 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-21T22:10:04.612 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:10:04.612 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-21T22:10:04.646 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:10:04.647 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-21T22:10:04.725 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:10:04.726 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-21T22:10:04.802 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:10:04.803 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-21T22:10:04.874 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:10:04.875 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-21T22:10:04.953 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:10:04.954 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-21T22:10:05.033 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:10:05.034 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-21T22:10:05.109 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:05.110 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-21T22:10:05.132 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:05.132 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-21T22:10:05.192 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:10:05.192 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-21T22:10:05.211 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:10:05.211 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-21T22:10:05.275 INFO:tasks.ceph:Adding keys to all mons... 2023-07-21T22:10:05.276 DEBUG:teuthology.orchestra.run.smithi049:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-21T22:10:05.282 DEBUG:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-21T22:10:05.328 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.y] 2023-07-21T22:10:05.328 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAcArtkbrpZKhAATgNLjLrjiq5kGV5kD5a61g== 2023-07-21T22:10:05.328 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2023-07-21T22:10:05.328 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAcArtk9UDlNxAAfGvmHDNUYOtexEgfEkEmbw== 2023-07-21T22:10:05.329 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2023-07-21T22:10:05.329 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtkBfhVBxAAWPmw5Kgh9IAwd3x6ONx/3Q== 2023-07-21T22:10:05.329 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.0] 2023-07-21T22:10:05.329 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAfArtkXyOTDRAA6+dWJD8HAjbKOVKNMmU47w== 2023-07-21T22:10:05.329 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.1] 2023-07-21T22:10:05.329 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAiArtkK1XVHBAAfg3u9BuD16Nqvd4aSxkHrQ== 2023-07-21T22:10:05.329 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.2] 2023-07-21T22:10:05.330 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAlArtkqCt+KRAAYL2UpqU5lgci033misJwCw== 2023-07-21T22:10:05.330 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.3] 2023-07-21T22:10:05.330 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAoArtk3rxoNxAAcTy+TyE877c3ygcSSYR4Fw== 2023-07-21T22:10:05.330 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.x] 2023-07-21T22:10:05.330 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAcArtkP5msMBAAmy/OTWL5IKQObiHS6qGHug== 2023-07-21T22:10:05.330 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2023-07-21T22:10:05.331 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtkQifxDxAANHRBlqFItDR5CjqajW6gvQ== 2023-07-21T22:10:05.331 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2023-07-21T22:10:05.331 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtkJYR+GhAAoQnle9Wp4nO/t7tXuW7QRg== 2023-07-21T22:10:05.331 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.4] 2023-07-21T22:10:05.332 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAvArtkKVmkDxAAvnbiPrBm8CsqtltAiYvBLA== 2023-07-21T22:10:05.332 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.5] 2023-07-21T22:10:05.332 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAyArtkVZZ4HxAAh/a+roCiNHjhfWBgQglK9w== 2023-07-21T22:10:05.332 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.6] 2023-07-21T22:10:05.332 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA1ArtkqvL1LBAAyR54RZM2jeJkacFJYYSg4w== 2023-07-21T22:10:05.332 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.7] 2023-07-21T22:10:05.332 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA4ArtkE0qJOhAAoVsMETcdMCOVJu1LeodZaQ== 2023-07-21T22:10:05.333 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2023-07-21T22:10:05.333 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtkU5ZaIRAAchCJhuM71+rGOBHBlX77wA== 2023-07-21T22:10:05.333 INFO:teuthology.orchestra.run.smithi049.stdout:[client.2] 2023-07-21T22:10:05.333 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtkyk2fJxAAnJF1MTnXB6u+gAzfn4Db3g== 2023-07-21T22:10:05.333 INFO:teuthology.orchestra.run.smithi049.stdout:[client.1] 2023-07-21T22:10:05.333 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtkehK+LRAALlZYibBiTgcHfl7suRYhcQ== 2023-07-21T22:10:05.333 INFO:teuthology.orchestra.run.smithi049.stdout:[client.3] 2023-07-21T22:10:05.334 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtks6bXMxAAcFY848luRxhQPSE+99Q5qg== 2023-07-21T22:10:05.351 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2023-07-21T22:10:05.351 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAcArtkbrpZKhAATgNLjLrjiq5kGV5kD5a61g== 2023-07-21T22:10:05.352 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2023-07-21T22:10:05.352 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAcArtk9UDlNxAAfGvmHDNUYOtexEgfEkEmbw== 2023-07-21T22:10:05.352 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2023-07-21T22:10:05.352 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAdArtkBfhVBxAAWPmw5Kgh9IAwd3x6ONx/3Q== 2023-07-21T22:10:05.352 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2023-07-21T22:10:05.352 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAfArtkXyOTDRAA6+dWJD8HAjbKOVKNMmU47w== 2023-07-21T22:10:05.352 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2023-07-21T22:10:05.353 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAiArtkK1XVHBAAfg3u9BuD16Nqvd4aSxkHrQ== 2023-07-21T22:10:05.353 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2023-07-21T22:10:05.353 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAlArtkqCt+KRAAYL2UpqU5lgci033misJwCw== 2023-07-21T22:10:05.353 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.3] 2023-07-21T22:10:05.353 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAoArtk3rxoNxAAcTy+TyE877c3ygcSSYR4Fw== 2023-07-21T22:10:05.353 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2023-07-21T22:10:05.353 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAcArtkP5msMBAAmy/OTWL5IKQObiHS6qGHug== 2023-07-21T22:10:05.354 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2023-07-21T22:10:05.354 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAdArtkQifxDxAANHRBlqFItDR5CjqajW6gvQ== 2023-07-21T22:10:05.354 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2023-07-21T22:10:05.354 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAdArtkJYR+GhAAoQnle9Wp4nO/t7tXuW7QRg== 2023-07-21T22:10:05.354 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2023-07-21T22:10:05.354 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAvArtkKVmkDxAAvnbiPrBm8CsqtltAiYvBLA== 2023-07-21T22:10:05.354 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.5] 2023-07-21T22:10:05.354 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAyArtkVZZ4HxAAh/a+roCiNHjhfWBgQglK9w== 2023-07-21T22:10:05.355 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.6] 2023-07-21T22:10:05.355 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQA1ArtkqvL1LBAAyR54RZM2jeJkacFJYYSg4w== 2023-07-21T22:10:05.355 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2023-07-21T22:10:05.355 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQA4ArtkE0qJOhAAoVsMETcdMCOVJu1LeodZaQ== 2023-07-21T22:10:05.355 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2023-07-21T22:10:05.355 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAdArtkU5ZaIRAAchCJhuM71+rGOBHBlX77wA== 2023-07-21T22:10:05.355 INFO:teuthology.orchestra.run.smithi150.stdout:[client.2] 2023-07-21T22:10:05.355 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAdArtkyk2fJxAAnJF1MTnXB6u+gAzfn4Db3g== 2023-07-21T22:10:05.356 INFO:teuthology.orchestra.run.smithi150.stdout:[client.1] 2023-07-21T22:10:05.356 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAdArtkehK+LRAALlZYibBiTgcHfl7suRYhcQ== 2023-07-21T22:10:05.356 INFO:teuthology.orchestra.run.smithi150.stdout:[client.3] 2023-07-21T22:10:05.356 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAdArtks6bXMxAAcFY848luRxhQPSE+99Q5qg== 2023-07-21T22:10:05.357 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T22:10:05.384 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T22:10:05.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:10:05.494 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:10:05.581 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:10:05.588 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:10:05.675 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:05.682 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:05.766 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:05.773 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:05.856 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:05.863 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:05.948 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:05.955 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:06.040 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T22:10:06.047 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T22:10:06.130 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:10:06.136 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:10:06.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:10:06.228 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:10:06.314 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:06.321 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:06.401 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:06.407 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:06.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:06.497 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:06.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:06.584 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:10:06.668 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:10:06.675 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:10:06.772 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:10:06.780 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:10:06.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:10:06.875 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:10:06.958 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:10:06.965 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:10:07.052 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-21T22:10:07.053 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-21T22:10:07.090 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-21T22:10:07.247 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-21T22:10:07.281 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-21T22:10:07.317 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-21T22:10:07.465 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-21T22:10:07.500 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-21T22:10:07.583 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-21T22:10:07.736 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-21T22:10:07.772 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:10:07.779 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:10:07.831 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-21T22:10:07.831 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-21T22:10:07.832 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-21T22:10:07.839 INFO:tasks.ceph.mon.a:Started 2023-07-21T22:10:07.840 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-21T22:10:07.840 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-21T22:10:07.879 INFO:tasks.ceph.mon.b:Started 2023-07-21T22:10:07.879 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-21T22:10:07.880 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-21T22:10:07.885 INFO:tasks.ceph.mon.c:Started 2023-07-21T22:10:07.885 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-21T22:10:07.885 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-21T22:10:07.886 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-21T22:10:07.893 INFO:tasks.ceph.mgr.y:Started 2023-07-21T22:10:07.893 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-21T22:10:07.894 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-21T22:10:07.899 INFO:tasks.ceph.mgr.x:Started 2023-07-21T22:10:07.899 INFO:tasks.ceph:Setting crush tunables to default 2023-07-21T22:10:07.899 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd crush tunables default 2023-07-21T22:10:08.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.014+0000 7f054d369700 1 Processor -- start 2023-07-21T22:10:08.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.014+0000 7f054d369700 1 -- start start 2023-07-21T22:10:08.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.018+0000 7f054d369700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f05480cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:08.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.018+0000 7f054d369700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f05480afbd0 0x7f05480b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:08.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.018+0000 7f054d369700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054815c120 con 0x7f05480ccc00 2023-07-21T22:10:08.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.018+0000 7f054d369700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05480ccfd0 con 0x7f05480afbd0 2023-07-21T22:10:08.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.018+0000 7f054d369700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05480b0590 con 0x7f054815bbd0 2023-07-21T22:10:08.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.018+0000 7f0546ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f05480ccc00 0x7f05480cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:47354/0 (socket says 172.21.15.49:47354) 2023-07-21T22:10:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.018+0000 7f0546ffd700 1 -- 172.21.15.49:0/2463515292 learned_addr learned my addr 172.21.15.49:0/2463515292 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.018+0000 7f05477fe700 1 --2- 172.21.15.49:0/2463515292 >> v2:172.21.15.49:3300/0 conn(0x7f05480afbd0 0x7f05480b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.018+0000 7f05467fc700 1 --2- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f05480cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:08.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.018+0000 7f05477fe700 1 -- 172.21.15.49:0/2463515292 >> v2:172.21.15.49:3300/0 conn(0x7f05480afbd0 msgr2=0x7f05480b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-21T22:10:08.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.018+0000 7f05477fe700 1 -- 172.21.15.49:0/2463515292 >> v2:172.21.15.49:3300/0 conn(0x7f05480afbd0 msgr2=0x7f05480b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T22:10:08.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.022+0000 7f05477fe700 1 --2- 172.21.15.49:0/2463515292 >> v2:172.21.15.49:3300/0 conn(0x7f05480afbd0 0x7f05480b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T22:10:08.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.022+0000 7f05467fc700 1 -- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 msgr2=0x7f05480cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-21T22:10:08.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.022+0000 7f05467fc700 1 -- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 msgr2=0x7f05480cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T22:10:08.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.022+0000 7f05467fc700 1 --2- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f05480cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T22:10:08.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.022+0000 7f05467fc700 1 --2- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f05480cbc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:10:08.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.022+0000 7f05477fe700 1 --2- 172.21.15.49:0/2463515292 >> v2:172.21.15.49:3300/0 conn(0x7f05480afbd0 0x7f05480b0050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:10:08.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.210+0000 7f0545ffb700 1 -- 172.21.15.49:0/2463515292 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729189372 0 0) 0x7f054815c120 con 0x7f05480ccc00 2023-07-21T22:10:08.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.210+0000 7f0545ffb700 1 -- 172.21.15.49:0/2463515292 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05300035d0 con 0x7f05480ccc00 2023-07-21T22:10:08.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0545ffb700 1 -- 172.21.15.49:0/2463515292 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1649948125 0 0) 0x7f05300035d0 con 0x7f05480ccc00 2023-07-21T22:10:08.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0545ffb700 1 -- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 msgr2=0x7f05480cbc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:10:08.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0545ffb700 1 --2- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f05480cbc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:08.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0545ffb700 1 -- 172.21.15.49:0/2463515292 >> v2:172.21.15.49:3300/0 conn(0x7f05480afbd0 msgr2=0x7f05480b0050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:10:08.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0545ffb700 1 --2- 172.21.15.49:0/2463515292 >> v2:172.21.15.49:3300/0 conn(0x7f05480afbd0 0x7f05480b0050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:08.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0545ffb700 1 -- 172.21.15.49:0/2463515292 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054815c400 con 0x7f05480ccc00 2023-07-21T22:10:08.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0545ffb700 1 -- 172.21.15.49:0/2463515292 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f0538001670 con 0x7f05480ccc00 2023-07-21T22:10:08.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0545ffb700 1 -- 172.21.15.49:0/2463515292 >> v1:172.21.15.150:6789/0 conn(0x7f05480ccc00 legacy=0x7f05480cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:08.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0545ffb700 1 --2- 172.21.15.49:0/2463515292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0530003a20 0x7f0530003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:08.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0545ffb700 1 --2- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f0530004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:08.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0545ffb700 1 --2- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0530004db0 0x7f0530005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:08.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0545ffb700 1 -- 172.21.15.49:0/2463515292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480ccfd0 con 0x7f0530003a20 2023-07-21T22:10:08.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0545ffb700 1 -- 172.21.15.49:0/2463515292 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480b0590 con 0x7f0530004db0 2023-07-21T22:10:08.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0545ffb700 1 -- 172.21.15.49:0/2463515292 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053000cc70 con 0x7f054815bbd0 2023-07-21T22:10:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f0546ffd700 1 --2- 172.21.15.49:0/2463515292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0530003a20 0x7f0530003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f05467fc700 1 --2- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f0530004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.214+0000 7f05477fe700 1 --2- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0530004db0 0x7f0530005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.218+0000 7f05467fc700 1 -- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0530004db0 msgr2=0x7f0530005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.218+0000 7f05467fc700 1 --2- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0530004db0 0x7f0530005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.218+0000 7f05467fc700 1 -- 172.21.15.49:0/2463515292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0530003a20 msgr2=0x7f0530003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.218+0000 7f05467fc700 1 --2- 172.21.15.49:0/2463515292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0530003a20 0x7f0530003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.218+0000 7f05467fc700 1 -- 172.21.15.49:0/2463515292 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05300035d0 con 0x7f054815bbd0 2023-07-21T22:10:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.218+0000 7f05467fc700 1 --2- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f0530004870 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f053c009870 tx=0x7f05300058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7f465803c98e287 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:08.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.222+0000 7f0545ffb700 1 -- 172.21.15.49:0/2463515292 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c00c070 con 0x7f054815bbd0 2023-07-21T22:10:08.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.222+0000 7f0545ffb700 1 -- 172.21.15.49:0/2463515292 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c013610 con 0x7f054815bbd0 2023-07-21T22:10:08.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.222+0000 7f0545ffb700 1 -- 172.21.15.49:0/2463515292 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c0139c0 con 0x7f054815bbd0 2023-07-21T22:10:08.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.222+0000 7f054d369700 1 -- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 msgr2=0x7f0530004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:08.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.222+0000 7f054d369700 1 --2- 172.21.15.49:0/2463515292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f0530004870 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f053c009870 tx=0x7f05300058a0 comp rx=0 tx=0).stop 2023-07-21T22:10:08.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.222+0000 7f05477fe700 1 -- 172.21.15.49:0/2463515292 reap_dead start 2023-07-21T22:10:08.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.222+0000 7f054d369700 1 -- 172.21.15.49:0/2463515292 shutdown_connections 2023-07-21T22:10:08.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.222+0000 7f054d369700 1 -- 172.21.15.49:0/2463515292 >> 172.21.15.49:0/2463515292 conn(0x7f05480ce0d0 msgr2=0x7f05480ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:08.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.222+0000 7f054d369700 1 -- 172.21.15.49:0/2463515292 shutdown_connections 2023-07-21T22:10:08.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.222+0000 7f054d369700 1 -- 172.21.15.49:0/2463515292 wait complete. 2023-07-21T22:10:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.226+0000 7f054d369700 1 Processor -- start 2023-07-21T22:10:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.226+0000 7f054d369700 1 -- start start 2023-07-21T22:10:08.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.226+0000 7f054d369700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f054814a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:08.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.226+0000 7f054d369700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05480c7ae0 0x7f0548157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:08.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f054d369700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480c7f30 0x7f0548157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:08.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f054d369700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480c4cc0 con 0x7f05480c7f30 2023-07-21T22:10:08.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f054d369700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480c4040 con 0x7f05480c7ae0 2023-07-21T22:10:08.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f054d369700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05480c4320 con 0x7f054815bbd0 2023-07-21T22:10:08.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f0546ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f054814a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:08.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f0546ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f054814a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:40128/0 (socket says 172.21.15.49:40128) 2023-07-21T22:10:08.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f0546ffd700 1 -- 172.21.15.49:0/1454351943 learned_addr learned my addr 172.21.15.49:0/1454351943 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:08.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f05467fc700 1 --2- 172.21.15.49:0/1454351943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05480c7ae0 0x7f0548157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:08.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f05477fe700 1 --2- 172.21.15.49:0/1454351943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480c7f30 0x7f0548157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:08.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f05467fc700 1 -- 172.21.15.49:0/1454351943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 msgr2=0x7f054814a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f05467fc700 1 --2- 172.21.15.49:0/1454351943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f054814a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f05467fc700 1 -- 172.21.15.49:0/1454351943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480c7f30 msgr2=0x7f0548157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f05467fc700 1 --2- 172.21.15.49:0/1454351943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480c7f30 0x7f0548157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f05467fc700 1 -- 172.21.15.49:0/1454351943 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05480c4600 con 0x7f05480c7ae0 2023-07-21T22:10:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f0546ffd700 1 --2- 172.21.15.49:0/1454351943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f054814a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f05467fc700 1 --2- 172.21.15.49:0/1454351943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05480c7ae0 0x7f0548157620 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f053c009100 tx=0x7f053c0047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:08.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f052f7fe700 1 -- 172.21.15.49:0/1454351943 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c013b90 con 0x7f05480c7ae0 2023-07-21T22:10:08.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f052f7fe700 1 -- 172.21.15.49:0/1454351943 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c013cf0 con 0x7f05480c7ae0 2023-07-21T22:10:08.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f052f7fe700 1 -- 172.21.15.49:0/1454351943 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c003900 con 0x7f05480c7ae0 2023-07-21T22:10:08.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f054d369700 1 -- 172.21.15.49:0/1454351943 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05480c48e0 con 0x7f05480c7ae0 2023-07-21T22:10:08.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.230+0000 7f054d369700 1 -- 172.21.15.49:0/1454351943 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05480c3c80 con 0x7f05480c7ae0 2023-07-21T22:10:08.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.234+0000 7f052f7fe700 1 -- 172.21.15.49:0/1454351943 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f053c026440 con 0x7f05480c7ae0 2023-07-21T22:10:08.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.234+0000 7f052f7fe700 1 -- 172.21.15.49:0/1454351943 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f053c003d60 con 0x7f05480c7ae0 2023-07-21T22:10:08.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.234+0000 7f054d369700 1 -- 172.21.15.49:0/1454351943 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054804dcb0 con 0x7f05480c7ae0 2023-07-21T22:10:08.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.238+0000 7f052f7fe700 1 -- 172.21.15.49:0/1454351943 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f053c02b020 con 0x7f05480c7ae0 2023-07-21T22:10:08.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.310+0000 7f054d369700 1 -- 172.21.15.49:0/1454351943 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f05480c4460 con 0x7f05480c7ae0 2023-07-21T22:10:08.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.322+0000 7f052f7fe700 1 -- 172.21.15.49:0/1454351943 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f05480c4460 con 0x7f05480c7ae0 2023-07-21T22:10:08.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.326+0000 7f054d369700 1 -- 172.21.15.49:0/1454351943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05480c7ae0 msgr2=0x7f0548157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:08.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.326+0000 7f054d369700 1 --2- 172.21.15.49:0/1454351943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05480c7ae0 0x7f0548157620 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f053c009100 tx=0x7f053c0047e0 comp rx=0 tx=0).stop 2023-07-21T22:10:08.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.326+0000 7f054d369700 1 -- 172.21.15.49:0/1454351943 shutdown_connections 2023-07-21T22:10:08.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.326+0000 7f054d369700 1 --2- 172.21.15.49:0/1454351943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480c7f30 0x7f0548157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:08.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.326+0000 7f054d369700 1 --2- 172.21.15.49:0/1454351943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05480c7ae0 0x7f0548157620 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:08.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.326+0000 7f054d369700 1 --2- 172.21.15.49:0/1454351943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f054815bbd0 0x7f054814a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:08.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.326+0000 7f054d369700 1 -- 172.21.15.49:0/1454351943 >> 172.21.15.49:0/1454351943 conn(0x7f05480ce0d0 msgr2=0x7f054806cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:08.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.326+0000 7f054d369700 1 -- 172.21.15.49:0/1454351943 shutdown_connections 2023-07-21T22:10:08.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:08.326+0000 7f054d369700 1 -- 172.21.15.49:0/1454351943 wait complete. 2023-07-21T22:10:08.375 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2023-07-21T22:10:08.392 INFO:tasks.ceph:check_enable_crimson: False 2023-07-21T22:10:08.393 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-21T22:10:08.393 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:08.393 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-21T22:10:08.428 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:08.428 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-21T22:10:08.488 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:08.442+0000 7f1ee38912c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:10:08.493 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:08.451+0000 7eff1d32d2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:10:08.502 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:08.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-21T22:10:08.578 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:08.579 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-21T22:10:08.655 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:10:08.655 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-21T22:10:08.688 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:10:08.688 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-21T22:10:08.759 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:10:08.760 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-21T22:10:08.834 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:10:08.834 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-21T22:10:08.909 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 4e8ae3f3-eb66-441d-911f-afef828ff0b2 0 2023-07-21T22:10:09.126 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.083+0000 7f5e09e2f700 1 Processor -- start 2023-07-21T22:10:09.126 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.083+0000 7f5e09e2f700 1 -- start start 2023-07-21T22:10:09.127 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.083+0000 7f5e09e2f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e040b19b0 0x7f5e040ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:09.128 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.083+0000 7f5e09e2f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e041607a0 con 0x7f5e040b4630 2023-07-21T22:10:09.128 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.083+0000 7f5e09e2f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0415f8b0 con 0x7f5e0415bf20 2023-07-21T22:10:09.128 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.083+0000 7f5e09e2f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040ceda0 con 0x7f5e040b19b0 2023-07-21T22:10:09.128 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.083+0000 7f5e0962e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e040b19b0 0x7f5e040ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:09.128 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.083+0000 7f5e0962e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e040b19b0 0x7f5e040ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:37350/0 (socket says 172.21.15.150:37350) 2023-07-21T22:10:09.129 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.083+0000 7f5e0962e700 1 -- 172.21.15.150:0/4082182682 learned_addr learned my addr 172.21.15.150:0/4082182682 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-07-21T22:10:09.129 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.083+0000 7f5e0962e700 1 -- 172.21.15.150:0/4082182682 >> v1:172.21.15.150:6789/0 conn(0x7f5e0415bf20 legacy=0x7f5e040b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.130 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.083+0000 7f5e0962e700 1 -- 172.21.15.150:0/4082182682 >> v1:172.21.15.49:6789/0 conn(0x7f5e040b4630 legacy=0x7f5e040d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:09.130 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.083+0000 7f5e0962e700 1 -- 172.21.15.150:0/4082182682 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0415fb90 con 0x7f5e040b19b0 2023-07-21T22:10:09.130 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.087+0000 7f5e0962e700 1 --2- 172.21.15.150:0/4082182682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e040b19b0 0x7f5e040ce860 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009e80 tx=0x7f5dfc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ea3cc40ece017ef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:09.130 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.087+0000 7f5e037fe700 1 -- 172.21.15.150:0/4082182682 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00e070 con 0x7f5e040b19b0 2023-07-21T22:10:09.130 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.087+0000 7f5e037fe700 1 -- 172.21.15.150:0/4082182682 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc00b9c0 con 0x7f5e040b19b0 2023-07-21T22:10:09.130 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.087+0000 7f5e037fe700 1 -- 172.21.15.150:0/4082182682 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00bd70 con 0x7f5e040b19b0 2023-07-21T22:10:09.131 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.087+0000 7f5e09e2f700 1 -- 172.21.15.150:0/4082182682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e040b19b0 msgr2=0x7f5e040ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.131 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.087+0000 7f5e09e2f700 1 --2- 172.21.15.150:0/4082182682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e040b19b0 0x7f5e040ce860 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009e80 tx=0x7f5dfc00b330 comp rx=0 tx=0).stop 2023-07-21T22:10:09.132 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.087+0000 7f5e09e2f700 1 -- 172.21.15.150:0/4082182682 shutdown_connections 2023-07-21T22:10:09.132 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.087+0000 7f5e09e2f700 1 --2- 172.21.15.150:0/4082182682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e040b19b0 0x7f5e040ce860 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.132 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.087+0000 7f5e09e2f700 1 -- 172.21.15.150:0/4082182682 >> 172.21.15.150:0/4082182682 conn(0x7f5e040cef20 msgr2=0x7f5e040cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:09.132 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.087+0000 7f5e09e2f700 1 -- 172.21.15.150:0/4082182682 shutdown_connections 2023-07-21T22:10:09.132 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.087+0000 7f5e09e2f700 1 -- 172.21.15.150:0/4082182682 wait complete. 2023-07-21T22:10:09.134 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e09e2f700 1 Processor -- start 2023-07-21T22:10:09.134 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e09e2f700 1 -- start start 2023-07-21T22:10:09.135 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e09e2f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e040b19b0 0x7f5e040cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:09.136 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e09e2f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e040b4630 0x7f5e040b7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:09.136 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e09e2f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e0415bf20 0x7f5e041f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:09.136 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e09e2f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040b7cb0 con 0x7f5e040b4630 2023-07-21T22:10:09.136 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e09e2f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040b84a0 con 0x7f5e040b19b0 2023-07-21T22:10:09.136 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e09e2f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0415cd10 con 0x7f5e0415bf20 2023-07-21T22:10:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e08e2d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e040b19b0 0x7f5e040cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e08e2d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e040b19b0 0x7f5e040cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38036/0 (socket says 172.21.15.150:38036) 2023-07-21T22:10:09.139 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e08e2d700 1 -- 172.21.15.150:0/3011540048 learned_addr learned my addr 172.21.15.150:0/3011540048 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-07-21T22:10:09.139 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e0962e700 1 --2- 172.21.15.150:0/3011540048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e0415bf20 0x7f5e041f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:09.139 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e03fff700 1 --2- 172.21.15.150:0/3011540048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e040b4630 0x7f5e040b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e08e2d700 1 -- 172.21.15.150:0/3011540048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e0415bf20 msgr2=0x7f5e041f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e08e2d700 1 --2- 172.21.15.150:0/3011540048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e0415bf20 0x7f5e041f4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e08e2d700 1 -- 172.21.15.150:0/3011540048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e040b4630 msgr2=0x7f5e040b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.141 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e08e2d700 1 --2- 172.21.15.150:0/3011540048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e040b4630 0x7f5e040b7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.141 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.091+0000 7f5e08e2d700 1 -- 172.21.15.150:0/3011540048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc009b30 con 0x7f5e040b19b0 2023-07-21T22:10:09.141 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.095+0000 7f5e08e2d700 1 --2- 172.21.15.150:0/3011540048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e040b19b0 0x7f5e040cc1b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5df800c530 tx=0x7f5df800c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:09.142 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.095+0000 7f5e017fa700 1 -- 172.21.15.150:0/3011540048 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df80052d0 con 0x7f5e040b19b0 2023-07-21T22:10:09.142 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.095+0000 7f5e017fa700 1 -- 172.21.15.150:0/3011540048 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df8005430 con 0x7f5e040b19b0 2023-07-21T22:10:09.142 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.095+0000 7f5e09e2f700 1 -- 172.21.15.150:0/3011540048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e040b7ee0 con 0x7f5e040b19b0 2023-07-21T22:10:09.142 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.095+0000 7f5e017fa700 1 -- 172.21.15.150:0/3011540048 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df80055a0 con 0x7f5e040b19b0 2023-07-21T22:10:09.142 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.095+0000 7f5e09e2f700 1 -- 172.21.15.150:0/3011540048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0415c9a0 con 0x7f5e040b19b0 2023-07-21T22:10:09.142 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.095+0000 7f5e017fa700 1 -- 172.21.15.150:0/3011540048 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5df8003be0 con 0x7f5e040b19b0 2023-07-21T22:10:09.142 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.095+0000 7f5e017fa700 1 -- 172.21.15.150:0/3011540048 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5df80127b0 con 0x7f5e040b19b0 2023-07-21T22:10:09.143 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.095+0000 7f5e09e2f700 1 -- 172.21.15.150:0/3011540048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0415c800 con 0x7f5e040b19b0 2023-07-21T22:10:09.144 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.099+0000 7f5e017fa700 1 -- 172.21.15.150:0/3011540048 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5e0415c800 con 0x7f5e040b19b0 2023-07-21T22:10:09.249 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.203+0000 7f5e09e2f700 1 -- 172.21.15.150:0/3011540048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4e8ae3f3-eb66-441d-911f-afef828ff0b2", "id": 0} v 0) v1 -- 0x7f5e04160120 con 0x7f5e040b19b0 2023-07-21T22:10:09.251 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:09.206+0000 7f1ee38912c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:10:09.265 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.219+0000 7f5e017fa700 1 -- 172.21.15.150:0/3011540048 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4e8ae3f3-eb66-441d-911f-afef828ff0b2", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5df8021060 con 0x7f5e040b19b0 2023-07-21T22:10:09.265 INFO:teuthology.orchestra.run.smithi150.stdout:0 2023-07-21T22:10:09.266 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.223+0000 7f5e09e2f700 1 -- 172.21.15.150:0/3011540048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e040b19b0 msgr2=0x7f5e040cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.266 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.223+0000 7f5e09e2f700 1 --2- 172.21.15.150:0/3011540048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e040b19b0 0x7f5e040cc1b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5df800c530 tx=0x7f5df800c840 comp rx=0 tx=0).stop 2023-07-21T22:10:09.267 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.223+0000 7f5e09e2f700 1 -- 172.21.15.150:0/3011540048 shutdown_connections 2023-07-21T22:10:09.267 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.223+0000 7f5e09e2f700 1 --2- 172.21.15.150:0/3011540048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e040b4630 0x7f5e040b7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.267 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.223+0000 7f5e09e2f700 1 --2- 172.21.15.150:0/3011540048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e0415bf20 0x7f5e041f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.267 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.223+0000 7f5e09e2f700 1 --2- 172.21.15.150:0/3011540048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e040b19b0 0x7f5e040cc1b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.267 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.223+0000 7f5e09e2f700 1 -- 172.21.15.150:0/3011540048 >> 172.21.15.150:0/3011540048 conn(0x7f5e040cef20 msgr2=0x7f5e041564c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:09.267 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.223+0000 7f5e09e2f700 1 -- 172.21.15.150:0/3011540048 shutdown_connections 2023-07-21T22:10:09.267 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.223+0000 7f5e09e2f700 1 -- 172.21.15.150:0/3011540048 wait complete. 2023-07-21T22:10:09.273 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:09.227+0000 7eff1d32d2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:10:09.285 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new eb981216-329e-438e-b4ba-1fce054d11b8 1 2023-07-21T22:10:09.339 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:09.294+0000 7f1ee38912c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:10:09.364 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:09.319+0000 7eff1d32d2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:10:09.449 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.407+0000 7f3502f0a700 1 Processor -- start 2023-07-21T22:10:09.450 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.407+0000 7f3502f0a700 1 -- start start 2023-07-21T22:10:09.453 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3502f0a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f34fc15bf20 0x7f34fc0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:09.453 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3502f0a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f34fc0b4630 0x7f34fc0d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:09.453 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3502f0a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34fc1607a0 con 0x7f34fc0b19b0 2023-07-21T22:10:09.454 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3502f0a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34fc0ceda0 con 0x7f34fc0b4630 2023-07-21T22:10:09.454 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3502f0a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34fc15f8b0 con 0x7f34fc15bf20 2023-07-21T22:10:09.454 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3501f08700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f34fc15bf20 0x7f34fc0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3501f08700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f34fc15bf20 0x7f34fc0ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38046/0 (socket says 172.21.15.150:38046) 2023-07-21T22:10:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3501f08700 1 -- 172.21.15.150:0/3406463308 learned_addr learned my addr 172.21.15.150:0/3406463308 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-07-21T22:10:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3502709700 1 --2- 172.21.15.150:0/3406463308 >> v2:172.21.15.49:3300/0 conn(0x7f34fc0b4630 0x7f34fc0d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3501f08700 1 -- 172.21.15.150:0/3406463308 >> v2:172.21.15.49:3300/0 conn(0x7f34fc0b4630 msgr2=0x7f34fc0d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3501f08700 1 --2- 172.21.15.150:0/3406463308 >> v2:172.21.15.49:3300/0 conn(0x7f34fc0b4630 0x7f34fc0d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3501f08700 1 -- 172.21.15.150:0/3406463308 >> v1:172.21.15.49:6789/0 conn(0x7f34fc0b19b0 legacy=0x7f34fc0b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:09.455 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3501f08700 1 -- 172.21.15.150:0/3406463308 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc15fb90 con 0x7f34fc15bf20 2023-07-21T22:10:09.456 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3501f08700 1 --2- 172.21.15.150:0/3406463308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34fc15bf20 0x7f34fc0ce860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0732d0 tx=0x7f34f8009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6623de80613b8203 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3500f06700 1 -- 172.21.15.150:0/3406463308 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8004230 con 0x7f34fc15bf20 2023-07-21T22:10:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3500f06700 1 -- 172.21.15.150:0/3406463308 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f8004390 con 0x7f34fc15bf20 2023-07-21T22:10:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3500f06700 1 -- 172.21.15.150:0/3406463308 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80036c0 con 0x7f34fc15bf20 2023-07-21T22:10:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3502f0a700 1 -- 172.21.15.150:0/3406463308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34fc15bf20 msgr2=0x7f34fc0ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3502f0a700 1 --2- 172.21.15.150:0/3406463308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34fc15bf20 0x7f34fc0ce860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0732d0 tx=0x7f34f8009bf0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.457 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3502f0a700 1 -- 172.21.15.150:0/3406463308 shutdown_connections 2023-07-21T22:10:09.458 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3502f0a700 1 --2- 172.21.15.150:0/3406463308 >> v2:172.21.15.49:3300/0 conn(0x7f34fc0b4630 0x7f34fc0d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.458 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3502f0a700 1 --2- 172.21.15.150:0/3406463308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34fc15bf20 0x7f34fc0ce860 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.458 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.411+0000 7f3502f0a700 1 -- 172.21.15.150:0/3406463308 >> 172.21.15.150:0/3406463308 conn(0x7f34fc0cef20 msgr2=0x7f34fc0cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:09.458 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.415+0000 7f3502f0a700 1 -- 172.21.15.150:0/3406463308 shutdown_connections 2023-07-21T22:10:09.458 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.415+0000 7f3502f0a700 1 -- 172.21.15.150:0/3406463308 wait complete. 2023-07-21T22:10:09.460 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.415+0000 7f3502f0a700 1 Processor -- start 2023-07-21T22:10:09.460 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.415+0000 7f3502f0a700 1 -- start start 2023-07-21T22:10:09.462 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3502f0a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34fc0b19b0 0x7f34fc159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:09.462 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3502f0a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34fc0b4630 0x7f34fc1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:09.463 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3502f0a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34fc15bf20 0x7f34fc159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:09.463 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3502f0a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0c9cd0 con 0x7f34fc0b19b0 2023-07-21T22:10:09.463 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3502f0a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc15a660 con 0x7f34fc0b4630 2023-07-21T22:10:09.463 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3502f0a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc15a940 con 0x7f34fc15bf20 2023-07-21T22:10:09.464 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3502709700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34fc15bf20 0x7f34fc159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:09.466 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3501707700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34fc0b4630 0x7f34fc1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:09.466 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3501f08700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34fc0b19b0 0x7f34fc159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:09.467 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3502709700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34fc15bf20 0x7f34fc159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:37366/0 (socket says 172.21.15.150:37366) 2023-07-21T22:10:09.467 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3502709700 1 -- 172.21.15.150:0/2900772844 learned_addr learned my addr 172.21.15.150:0/2900772844 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-07-21T22:10:09.467 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3501f08700 1 -- 172.21.15.150:0/2900772844 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34fc15bf20 msgr2=0x7f34fc159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.468 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3501f08700 1 --2- 172.21.15.150:0/2900772844 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34fc15bf20 0x7f34fc159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.468 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3501f08700 1 -- 172.21.15.150:0/2900772844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34fc0b4630 msgr2=0x7f34fc1596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.468 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3501f08700 1 --2- 172.21.15.150:0/2900772844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34fc0b4630 0x7f34fc1596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.469 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3501f08700 1 -- 172.21.15.150:0/2900772844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f8009570 con 0x7f34fc0b19b0 2023-07-21T22:10:09.469 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3501f08700 1 --2- 172.21.15.150:0/2900772844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34fc0b19b0 0x7f34fc159190 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f34f8015000 tx=0x7f34f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:09.469 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f34f27fc700 1 -- 172.21.15.150:0/2900772844 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8003d00 con 0x7f34fc0b19b0 2023-07-21T22:10:09.469 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f34f27fc700 1 -- 172.21.15.150:0/2900772844 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f801f070 con 0x7f34fc0b19b0 2023-07-21T22:10:09.470 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f3502f0a700 1 -- 172.21.15.150:0/2900772844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34fc0c9610 con 0x7f34fc0b19b0 2023-07-21T22:10:09.470 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.419+0000 7f34f27fc700 1 -- 172.21.15.150:0/2900772844 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8003ea0 con 0x7f34fc0b19b0 2023-07-21T22:10:09.470 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.423+0000 7f3502f0a700 1 -- 172.21.15.150:0/2900772844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34fc15a150 con 0x7f34fc0b19b0 2023-07-21T22:10:09.470 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.423+0000 7f34f27fc700 1 -- 172.21.15.150:0/2900772844 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f34f8021030 con 0x7f34fc0b19b0 2023-07-21T22:10:09.471 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.423+0000 7f34f27fc700 1 -- 172.21.15.150:0/2900772844 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f34f801b8a0 con 0x7f34fc0b19b0 2023-07-21T22:10:09.472 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.423+0000 7f3502f0a700 1 -- 172.21.15.150:0/2900772844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34fc0c9440 con 0x7f34fc0b19b0 2023-07-21T22:10:09.473 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.431+0000 7f34f27fc700 1 -- 172.21.15.150:0/2900772844 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f34f801b440 con 0x7f34fc0b19b0 2023-07-21T22:10:09.523 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:09.478+0000 7f1ee38912c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:10:09.555 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:09.511+0000 7eff1d32d2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:10:09.578 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.535+0000 7f3502f0a700 1 -- 172.21.15.150:0/2900772844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eb981216-329e-438e-b4ba-1fce054d11b8", "id": 1} v 0) v1 -- 0x7f34fc0c9440 con 0x7f34fc0b19b0 2023-07-21T22:10:09.586 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.543+0000 7f34f27fc700 1 -- 172.21.15.150:0/2900772844 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eb981216-329e-438e-b4ba-1fce054d11b8", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f34f800bce0 con 0x7f34fc0b19b0 2023-07-21T22:10:09.587 INFO:teuthology.orchestra.run.smithi150.stdout:1 2023-07-21T22:10:09.589 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.543+0000 7f3502f0a700 1 -- 172.21.15.150:0/2900772844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34fc0b19b0 msgr2=0x7f34fc159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.589 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.543+0000 7f3502f0a700 1 --2- 172.21.15.150:0/2900772844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34fc0b19b0 0x7f34fc159190 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f34f8015000 tx=0x7f34f8004770 comp rx=0 tx=0).stop 2023-07-21T22:10:09.589 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.543+0000 7f3502f0a700 1 -- 172.21.15.150:0/2900772844 shutdown_connections 2023-07-21T22:10:09.589 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.543+0000 7f3502f0a700 1 --2- 172.21.15.150:0/2900772844 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34fc15bf20 0x7f34fc159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.589 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.543+0000 7f3502f0a700 1 --2- 172.21.15.150:0/2900772844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34fc0b4630 0x7f34fc1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.589 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.543+0000 7f3502f0a700 1 --2- 172.21.15.150:0/2900772844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34fc0b19b0 0x7f34fc159190 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.590 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.543+0000 7f3502f0a700 1 -- 172.21.15.150:0/2900772844 >> 172.21.15.150:0/2900772844 conn(0x7f34fc0cef20 msgr2=0x7f34fc0b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:09.590 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.547+0000 7f3502f0a700 1 -- 172.21.15.150:0/2900772844 shutdown_connections 2023-07-21T22:10:09.590 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.547+0000 7f3502f0a700 1 -- 172.21.15.150:0/2900772844 wait complete. 2023-07-21T22:10:09.606 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 36326d9d-4157-4bd4-adc3-d0ae7ea8efc7 2 2023-07-21T22:10:09.769 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.723+0000 7f2ad9981700 1 Processor -- start 2023-07-21T22:10:09.769 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.727+0000 7f2ad9981700 1 -- start start 2023-07-21T22:10:09.771 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.727+0000 7f2ad9981700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2ad40cb2f0 0x7f2ad40ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:09.771 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.727+0000 7f2ad9981700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad40ca190 con 0x7f2ad40b3a50 2023-07-21T22:10:09.771 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.727+0000 7f2ad9981700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad4159fd0 con 0x7f2ad415e380 2023-07-21T22:10:09.772 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.727+0000 7f2ad9981700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad415d6e0 con 0x7f2ad40cb2f0 2023-07-21T22:10:09.772 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.727+0000 7f2ad27fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2ad40cb2f0 0x7f2ad40ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:09.773 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.727+0000 7f2ad2ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f2ad415e380 0x7f2ad40cabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:36932/0 (socket says 172.21.15.150:36932) 2023-07-21T22:10:09.773 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.727+0000 7f2ad2ffd700 1 -- 172.21.15.150:0/1197890102 learned_addr learned my addr 172.21.15.150:0/1197890102 (peer_addr_for_me v1:172.21.15.150:0/0) 2023-07-21T22:10:09.773 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.727+0000 7f2ad27fc700 1 -- 172.21.15.150:0/1197890102 >> v1:172.21.15.150:6789/0 conn(0x7f2ad415e380 legacy=0x7f2ad40cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.773 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.727+0000 7f2ad27fc700 1 -- 172.21.15.150:0/1197890102 >> v1:172.21.15.49:6789/0 conn(0x7f2ad40b3a50 legacy=0x7f2ad40ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.773 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.727+0000 7f2ad27fc700 1 -- 172.21.15.150:0/1197890102 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad40ca900 con 0x7f2ad40cb2f0 2023-07-21T22:10:09.773 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.727+0000 7f2ad1ffb700 1 -- 172.21.15.150:0/1197890102 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026088533 0 0) 0x7f2ad4159fd0 con 0x7f2ad415e380 2023-07-21T22:10:09.774 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.731+0000 7f2ad27fc700 1 --2- 172.21.15.150:0/1197890102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ad40cb2f0 0x7f2ad40ce160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009840 tx=0x7f2ac8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89678e4fb5f7f70 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:09.774 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.731+0000 7f2ad1ffb700 1 -- 172.21.15.150:0/1197890102 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8005e50 con 0x7f2ad40cb2f0 2023-07-21T22:10:09.774 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.731+0000 7f2ad1ffb700 1 -- 172.21.15.150:0/1197890102 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac8006030 con 0x7f2ad40cb2f0 2023-07-21T22:10:09.775 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.731+0000 7f2ad1ffb700 1 -- 172.21.15.150:0/1197890102 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac80063c0 con 0x7f2ad40cb2f0 2023-07-21T22:10:09.775 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.731+0000 7f2ad9981700 1 -- 172.21.15.150:0/1197890102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ad40cb2f0 msgr2=0x7f2ad40ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.775 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.731+0000 7f2ad9981700 1 --2- 172.21.15.150:0/1197890102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ad40cb2f0 0x7f2ad40ce160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009840 tx=0x7f2ac8009b50 comp rx=0 tx=0).stop 2023-07-21T22:10:09.775 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.731+0000 7f2ad9981700 1 -- 172.21.15.150:0/1197890102 shutdown_connections 2023-07-21T22:10:09.776 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.731+0000 7f2ad9981700 1 --2- 172.21.15.150:0/1197890102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ad40cb2f0 0x7f2ad40ce160 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.776 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.731+0000 7f2ad9981700 1 -- 172.21.15.150:0/1197890102 >> 172.21.15.150:0/1197890102 conn(0x7f2ad406e960 msgr2=0x7f2ad406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:09.776 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.731+0000 7f2ad9981700 1 -- 172.21.15.150:0/1197890102 shutdown_connections 2023-07-21T22:10:09.776 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.731+0000 7f2ad9981700 1 -- 172.21.15.150:0/1197890102 wait complete. 2023-07-21T22:10:09.777 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad9981700 1 Processor -- start 2023-07-21T22:10:09.777 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad9981700 1 -- start start 2023-07-21T22:10:09.779 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad9981700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ad40b3a50 0x7f2ad414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:09.779 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad9981700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ad40cb2f0 0x7f2ad415c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:09.779 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad9981700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ad415e380 0x7f2ad415cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:09.779 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad9981700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4158870 con 0x7f2ad40b3a50 2023-07-21T22:10:09.779 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad9981700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4157cf0 con 0x7f2ad415e380 2023-07-21T22:10:09.780 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad9981700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4157fd0 con 0x7f2ad40cb2f0 2023-07-21T22:10:09.781 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad37fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ad415e380 0x7f2ad415cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:09.781 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad27fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ad40cb2f0 0x7f2ad415c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:09.782 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad37fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ad415e380 0x7f2ad415cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38074/0 (socket says 172.21.15.150:38074) 2023-07-21T22:10:09.782 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad37fe700 1 -- 172.21.15.150:0/3694414678 learned_addr learned my addr 172.21.15.150:0/3694414678 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-07-21T22:10:09.782 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad2ffd700 1 --2- 172.21.15.150:0/3694414678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ad40b3a50 0x7f2ad414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:09.782 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad37fe700 1 -- 172.21.15.150:0/3694414678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ad40cb2f0 msgr2=0x7f2ad415c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.782 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad37fe700 1 --2- 172.21.15.150:0/3694414678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ad40cb2f0 0x7f2ad415c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.782 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad37fe700 1 -- 172.21.15.150:0/3694414678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ad40b3a50 msgr2=0x7f2ad414dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.783 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad37fe700 1 --2- 172.21.15.150:0/3694414678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ad40b3a50 0x7f2ad414dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.783 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad37fe700 1 -- 172.21.15.150:0/3694414678 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8009450 con 0x7f2ad415e380 2023-07-21T22:10:09.783 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.735+0000 7f2ad37fe700 1 --2- 172.21.15.150:0/3694414678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ad415e380 0x7f2ad415cab0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00cb50 tx=0x7f2acc00ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:09.783 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.739+0000 7f2abbfff700 1 -- 172.21.15.150:0/3694414678 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc003c20 con 0x7f2ad415e380 2023-07-21T22:10:09.783 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.739+0000 7f2ad9981700 1 -- 172.21.15.150:0/3694414678 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad41582b0 con 0x7f2ad415e380 2023-07-21T22:10:09.783 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.739+0000 7f2abbfff700 1 -- 172.21.15.150:0/3694414678 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc003d80 con 0x7f2ad415e380 2023-07-21T22:10:09.783 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.739+0000 7f2abbfff700 1 -- 172.21.15.150:0/3694414678 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00aa20 con 0x7f2ad415e380 2023-07-21T22:10:09.783 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.739+0000 7f2ad9981700 1 -- 172.21.15.150:0/3694414678 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad414e4f0 con 0x7f2ad415e380 2023-07-21T22:10:09.784 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.739+0000 7f2abbfff700 1 -- 172.21.15.150:0/3694414678 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2acc0050d0 con 0x7f2ad415e380 2023-07-21T22:10:09.784 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.739+0000 7f2abbfff700 1 -- 172.21.15.150:0/3694414678 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f2acc0057a0 con 0x7f2ad415e380 2023-07-21T22:10:09.784 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.739+0000 7f2ad9981700 1 -- 172.21.15.150:0/3694414678 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad414e680 con 0x7f2ad415e380 2023-07-21T22:10:09.786 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.743+0000 7f2abbfff700 1 -- 172.21.15.150:0/3694414678 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2acc005380 con 0x7f2ad415e380 2023-07-21T22:10:09.796 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:09.750+0000 7f1ee38912c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:10:09.833 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:09.791+0000 7eff1d32d2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:10:09.873 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:09.826+0000 7f1ee38912c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:10:09.886 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.843+0000 7f2ad9981700 1 -- 172.21.15.150:0/3694414678 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "36326d9d-4157-4bd4-adc3-d0ae7ea8efc7", "id": 2} v 0) v1 -- 0x7f2ad404dd50 con 0x7f2ad415e380 2023-07-21T22:10:09.897 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.855+0000 7f2abbfff700 1 -- 172.21.15.150:0/3694414678 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "36326d9d-4157-4bd4-adc3-d0ae7ea8efc7", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2acc0055a0 con 0x7f2ad415e380 2023-07-21T22:10:09.898 INFO:teuthology.orchestra.run.smithi150.stdout:2 2023-07-21T22:10:09.899 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.855+0000 7f2ad9981700 1 -- 172.21.15.150:0/3694414678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ad415e380 msgr2=0x7f2ad415cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:09.899 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.855+0000 7f2ad9981700 1 --2- 172.21.15.150:0/3694414678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ad415e380 0x7f2ad415cab0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00cb50 tx=0x7f2acc00ce60 comp rx=0 tx=0).stop 2023-07-21T22:10:09.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.855+0000 7f2ad9981700 1 -- 172.21.15.150:0/3694414678 shutdown_connections 2023-07-21T22:10:09.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.855+0000 7f2ad9981700 1 --2- 172.21.15.150:0/3694414678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ad415e380 0x7f2ad415cab0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.855+0000 7f2ad9981700 1 --2- 172.21.15.150:0/3694414678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ad40cb2f0 0x7f2ad415c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.855+0000 7f2ad9981700 1 --2- 172.21.15.150:0/3694414678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ad40b3a50 0x7f2ad414dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:09.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.855+0000 7f2ad9981700 1 -- 172.21.15.150:0/3694414678 >> 172.21.15.150:0/3694414678 conn(0x7f2ad406e960 msgr2=0x7f2ad40cabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:09.901 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.855+0000 7f2ad9981700 1 -- 172.21.15.150:0/3694414678 shutdown_connections 2023-07-21T22:10:09.901 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:09.855+0000 7f2ad9981700 1 -- 172.21.15.150:0/3694414678 wait complete. 2023-07-21T22:10:09.911 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:09.867+0000 7eff1d32d2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:10:09.920 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new d1ed415c-a80f-44cc-b4a4-06a83702729e 3 2023-07-21T22:10:10.086 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f61057e0700 1 Processor -- start 2023-07-21T22:10:10.086 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f61057e0700 1 -- start start 2023-07-21T22:10:10.089 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f61057e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61000cd890 0x7f61000cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.090 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f61057e0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f61000c8820 0x7f61000c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.090 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f61057e0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61000cc790 con 0x7f61001582c0 2023-07-21T22:10:10.090 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f61057e0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61000c91e0 con 0x7f61000c8820 2023-07-21T22:10:10.091 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f61057e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610015c110 con 0x7f61000cd890 2023-07-21T22:10:10.091 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f60f7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61000cd890 0x7f61000cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.091 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f60ff7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f61000c8820 0x7f61000c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.091 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f60f7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61000cd890 0x7f61000cc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:37394/0 (socket says 172.21.15.150:37394) 2023-07-21T22:10:10.091 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f60f7fff700 1 -- 172.21.15.150:0/1572728930 learned_addr learned my addr 172.21.15.150:0/1572728930 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-07-21T22:10:10.092 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f60ff7fe700 1 -- 172.21.15.150:0/1572728930 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61000cd890 msgr2=0x7f61000cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:10.092 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f60ff7fe700 1 --2- 172.21.15.150:0/1572728930 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61000cd890 0x7f61000cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.092 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f60ff7fe700 1 -- 172.21.15.150:0/1572728930 >> v1:172.21.15.49:6789/0 conn(0x7f61001582c0 legacy=0x7f610015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.092 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.043+0000 7f60ff7fe700 1 -- 172.21.15.150:0/1572728930 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610015ccb0 con 0x7f61000c8820 2023-07-21T22:10:10.092 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.047+0000 7f60ff7fe700 1 --2- 172.21.15.150:0/1572728930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61000c8820 0x7f61000c8ca0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f60f8009d90 tx=0x7f60f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8541bbeea82db2ac server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:10.094 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.047+0000 7f60fe7fc700 1 -- 172.21.15.150:0/1572728930 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f800e070 con 0x7f61000c8820 2023-07-21T22:10:10.094 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.047+0000 7f60fe7fc700 1 -- 172.21.15.150:0/1572728930 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f800bb20 con 0x7f61000c8820 2023-07-21T22:10:10.094 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.047+0000 7f60fe7fc700 1 -- 172.21.15.150:0/1572728930 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f8012430 con 0x7f61000c8820 2023-07-21T22:10:10.095 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.047+0000 7f61057e0700 1 -- 172.21.15.150:0/1572728930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61000c8820 msgr2=0x7f61000c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.095 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.047+0000 7f61057e0700 1 --2- 172.21.15.150:0/1572728930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61000c8820 0x7f61000c8ca0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f60f8009d90 tx=0x7f60f800b330 comp rx=0 tx=0).stop 2023-07-21T22:10:10.095 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.047+0000 7f61057e0700 1 -- 172.21.15.150:0/1572728930 shutdown_connections 2023-07-21T22:10:10.095 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.047+0000 7f61057e0700 1 --2- 172.21.15.150:0/1572728930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61000c8820 0x7f61000c8ca0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.095 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.047+0000 7f61057e0700 1 --2- 172.21.15.150:0/1572728930 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61000cd890 0x7f61000cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.095 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.047+0000 7f61057e0700 1 -- 172.21.15.150:0/1572728930 >> 172.21.15.150:0/1572728930 conn(0x7f610006e960 msgr2=0x7f610006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:10.096 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.047+0000 7f61057e0700 1 -- 172.21.15.150:0/1572728930 shutdown_connections 2023-07-21T22:10:10.096 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.047+0000 7f61057e0700 1 -- 172.21.15.150:0/1572728930 wait complete. 2023-07-21T22:10:10.096 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f61057e0700 1 Processor -- start 2023-07-21T22:10:10.096 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f61057e0700 1 -- start start 2023-07-21T22:10:10.096 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f61057e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61000c8820 0x7f61000b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.096 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f61057e0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61000cd890 0x7f61001f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.096 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f61057e0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61001582c0 0x7f61000c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.097 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f61057e0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61000b2e00 con 0x7f61000cd890 2023-07-21T22:10:10.097 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f61057e0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61001f47c0 con 0x7f61001582c0 2023-07-21T22:10:10.097 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f61057e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61000b21f0 con 0x7f61000c8820 2023-07-21T22:10:10.098 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60feffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61000c8820 0x7f61000b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.098 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60ff7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61001582c0 0x7f61000c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.099 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60feffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61000c8820 0x7f61000b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:37406/0 (socket says 172.21.15.150:37406) 2023-07-21T22:10:10.099 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60feffd700 1 -- 172.21.15.150:0/1365789201 learned_addr learned my addr 172.21.15.150:0/1365789201 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-07-21T22:10:10.099 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60f7fff700 1 --2- 172.21.15.150:0/1365789201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61000cd890 0x7f61001f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.099 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60feffd700 1 -- 172.21.15.150:0/1365789201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61001582c0 msgr2=0x7f61000c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.099 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60feffd700 1 --2- 172.21.15.150:0/1365789201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61001582c0 0x7f61000c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.099 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60feffd700 1 -- 172.21.15.150:0/1365789201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61000cd890 msgr2=0x7f61001f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.099 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60feffd700 1 --2- 172.21.15.150:0/1365789201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61000cd890 0x7f61001f4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.100 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60feffd700 1 -- 172.21.15.150:0/1365789201 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f8009a70 con 0x7f61000c8820 2023-07-21T22:10:10.100 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60feffd700 1 --2- 172.21.15.150:0/1365789201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61000c8820 0x7f61000b3290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f60f000c500 tx=0x7f60f000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:10.101 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60f77fe700 1 -- 172.21.15.150:0/1365789201 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f00052d0 con 0x7f61000c8820 2023-07-21T22:10:10.101 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60f77fe700 1 -- 172.21.15.150:0/1365789201 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f0005430 con 0x7f61000c8820 2023-07-21T22:10:10.101 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60f77fe700 1 -- 172.21.15.150:0/1365789201 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f00055a0 con 0x7f61000c8820 2023-07-21T22:10:10.102 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f61057e0700 1 -- 172.21.15.150:0/1365789201 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61000b24d0 con 0x7f61000c8820 2023-07-21T22:10:10.102 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f61057e0700 1 -- 172.21.15.150:0/1365789201 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61000b2a90 con 0x7f61000c8820 2023-07-21T22:10:10.102 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60f77fe700 1 -- 172.21.15.150:0/1365789201 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f60f0003be0 con 0x7f61000c8820 2023-07-21T22:10:10.102 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.051+0000 7f60f77fe700 1 -- 172.21.15.150:0/1365789201 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f60f0011db0 con 0x7f61000c8820 2023-07-21T22:10:10.103 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.055+0000 7f61057e0700 1 -- 172.21.15.150:0/1365789201 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610004dd50 con 0x7f61000c8820 2023-07-21T22:10:10.103 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.059+0000 7f60f77fe700 1 -- 172.21.15.150:0/1365789201 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f60f0017070 con 0x7f61000c8820 2023-07-21T22:10:10.129 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:10.082+0000 7f1ee38912c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:10:10.171 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:10.127+0000 7eff1d32d2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:10:10.207 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.163+0000 7f61057e0700 1 -- 172.21.15.150:0/1365789201 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d1ed415c-a80f-44cc-b4a4-06a83702729e", "id": 3} v 0) v1 -- 0x7f61000ceeb0 con 0x7f61000c8820 2023-07-21T22:10:10.215 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:10.170+0000 7f1ee38912c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:10:10.216 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.171+0000 7f60f77fe700 1 -- 172.21.15.150:0/1365789201 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d1ed415c-a80f-44cc-b4a4-06a83702729e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f60f0011590 con 0x7f61000c8820 2023-07-21T22:10:10.216 INFO:teuthology.orchestra.run.smithi150.stdout:3 2023-07-21T22:10:10.218 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.175+0000 7f61057e0700 1 -- 172.21.15.150:0/1365789201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61000c8820 msgr2=0x7f61000b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.218 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.175+0000 7f61057e0700 1 --2- 172.21.15.150:0/1365789201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61000c8820 0x7f61000b3290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f60f000c500 tx=0x7f60f000c810 comp rx=0 tx=0).stop 2023-07-21T22:10:10.218 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.175+0000 7f61057e0700 1 -- 172.21.15.150:0/1365789201 shutdown_connections 2023-07-21T22:10:10.218 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.175+0000 7f61057e0700 1 --2- 172.21.15.150:0/1365789201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61000cd890 0x7f61001f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.218 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.175+0000 7f61057e0700 1 --2- 172.21.15.150:0/1365789201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61001582c0 0x7f61000c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.218 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.175+0000 7f61057e0700 1 --2- 172.21.15.150:0/1365789201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61000c8820 0x7f61000b3290 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.218 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.175+0000 7f61057e0700 1 -- 172.21.15.150:0/1365789201 >> 172.21.15.150:0/1365789201 conn(0x7f610006e960 msgr2=0x7f610006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:10.219 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.175+0000 7f61057e0700 1 -- 172.21.15.150:0/1365789201 shutdown_connections 2023-07-21T22:10:10.219 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.175+0000 7f61057e0700 1 -- 172.21.15.150:0/1365789201 wait complete. 2023-07-21T22:10:10.236 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 12a53eb6-e926-42f2-9360-9e526861f31e 4 2023-07-21T22:10:10.259 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:10.215+0000 7eff1d32d2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:10:10.307 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:10.262+0000 7f1ee38912c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:10:10.358 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:10.315+0000 7eff1d32d2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:10:10.393 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.347+0000 7f88e2ddc700 1 Processor -- start 2023-07-21T22:10:10.393 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.351+0000 7f88e2ddc700 1 -- start start 2023-07-21T22:10:10.396 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.351+0000 7f88e2ddc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88dc0cfb70 0x7f88dc0b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.396 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.351+0000 7f88e2ddc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc0cbb90 con 0x7f88dc0b5f10 2023-07-21T22:10:10.397 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.351+0000 7f88e2ddc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc0cee50 con 0x7f88dc159ca0 2023-07-21T22:10:10.397 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.351+0000 7f88e2ddc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0ceb70 con 0x7f88dc0cfb70 2023-07-21T22:10:10.397 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e1dda700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f88dc159ca0 0x7f88dc0cf460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:36946/0 (socket says 172.21.15.150:36946) 2023-07-21T22:10:10.397 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e15d9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88dc0cfb70 0x7f88dc0b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.397 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e1dda700 1 -- 172.21.15.150:0/647266757 learned_addr learned my addr 172.21.15.150:0/647266757 (peer_addr_for_me v1:172.21.15.150:0/0) 2023-07-21T22:10:10.399 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e15d9700 1 -- 172.21.15.150:0/647266757 >> v1:172.21.15.150:6789/0 conn(0x7f88dc159ca0 legacy=0x7f88dc0cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.399 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e15d9700 1 -- 172.21.15.150:0/647266757 >> v1:172.21.15.49:6789/0 conn(0x7f88dc0b5f10 legacy=0x7f88dc0b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.399 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e15d9700 1 -- 172.21.15.150:0/647266757 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0cbdc0 con 0x7f88dc0cfb70 2023-07-21T22:10:10.399 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e15d9700 1 --2- 172.21.15.150:0/647266757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88dc0cfb70 0x7f88dc0b1ca0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009880 tx=0x7f88cc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=383734f1000d5da0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:10.399 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e0dd8700 1 -- 172.21.15.150:0/647266757 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc011830 con 0x7f88dc0cfb70 2023-07-21T22:10:10.400 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e0dd8700 1 -- 172.21.15.150:0/647266757 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc011990 con 0x7f88dc0cfb70 2023-07-21T22:10:10.400 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e0dd8700 1 -- 172.21.15.150:0/647266757 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc011d20 con 0x7f88dc0cfb70 2023-07-21T22:10:10.400 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e2ddc700 1 -- 172.21.15.150:0/647266757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88dc0cfb70 msgr2=0x7f88dc0b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.400 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e2ddc700 1 --2- 172.21.15.150:0/647266757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88dc0cfb70 0x7f88dc0b1ca0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009880 tx=0x7f88cc009b90 comp rx=0 tx=0).stop 2023-07-21T22:10:10.401 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e2ddc700 1 -- 172.21.15.150:0/647266757 shutdown_connections 2023-07-21T22:10:10.401 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e2ddc700 1 --2- 172.21.15.150:0/647266757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88dc0cfb70 0x7f88dc0b1ca0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.401 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e2ddc700 1 -- 172.21.15.150:0/647266757 >> 172.21.15.150:0/647266757 conn(0x7f88dc069f90 msgr2=0x7f88dc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:10.401 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e2ddc700 1 -- 172.21.15.150:0/647266757 shutdown_connections 2023-07-21T22:10:10.402 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.355+0000 7f88e2ddc700 1 -- 172.21.15.150:0/647266757 wait complete. 2023-07-21T22:10:10.404 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.359+0000 7f88e2ddc700 1 Processor -- start 2023-07-21T22:10:10.405 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e2ddc700 1 -- start start 2023-07-21T22:10:10.406 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e2ddc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88dc0b5f10 0x7f88dc14dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.406 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e2ddc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88dc0cfb70 0x7f88dc0c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.406 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e2ddc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc159ca0 0x7f88dc0c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.406 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e2ddc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0c9100 con 0x7f88dc159ca0 2023-07-21T22:10:10.406 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e2ddc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0c93e0 con 0x7f88dc0cfb70 2023-07-21T22:10:10.407 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e2ddc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0c96c0 con 0x7f88dc0b5f10 2023-07-21T22:10:10.407 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e1dda700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88dc0b5f10 0x7f88dc14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.408 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e1dda700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88dc0b5f10 0x7f88dc14dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:37424/0 (socket says 172.21.15.150:37424) 2023-07-21T22:10:10.408 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e1dda700 1 -- 172.21.15.150:0/1435960856 learned_addr learned my addr 172.21.15.150:0/1435960856 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-07-21T22:10:10.408 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e15d9700 1 --2- 172.21.15.150:0/1435960856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88dc0cfb70 0x7f88dc0c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.408 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e25db700 1 --2- 172.21.15.150:0/1435960856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc159ca0 0x7f88dc0c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.408 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e1dda700 1 -- 172.21.15.150:0/1435960856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88dc0cfb70 msgr2=0x7f88dc0c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.409 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e1dda700 1 --2- 172.21.15.150:0/1435960856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88dc0cfb70 0x7f88dc0c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.409 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e1dda700 1 -- 172.21.15.150:0/1435960856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc159ca0 msgr2=0x7f88dc0c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.409 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e1dda700 1 --2- 172.21.15.150:0/1435960856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc159ca0 0x7f88dc0c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.409 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e1dda700 1 -- 172.21.15.150:0/1435960856 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc0094b0 con 0x7f88dc0b5f10 2023-07-21T22:10:10.409 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e25db700 1 --2- 172.21.15.150:0/1435960856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc159ca0 0x7f88dc0c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:10.409 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e1dda700 1 --2- 172.21.15.150:0/1435960856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88dc0b5f10 0x7f88dc14dde0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f88d8001eb0 tx=0x7f88d800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:10.410 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88d27fc700 1 -- 172.21.15.150:0/1435960856 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8005d90 con 0x7f88dc0b5f10 2023-07-21T22:10:10.411 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88d27fc700 1 -- 172.21.15.150:0/1435960856 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d80070d0 con 0x7f88dc0b5f10 2023-07-21T22:10:10.411 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88d27fc700 1 -- 172.21.15.150:0/1435960856 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8007440 con 0x7f88dc0b5f10 2023-07-21T22:10:10.411 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e2ddc700 1 -- 172.21.15.150:0/1435960856 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc0afbe0 con 0x7f88dc0b5f10 2023-07-21T22:10:10.411 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88e2ddc700 1 -- 172.21.15.150:0/1435960856 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc14e320 con 0x7f88dc0b5f10 2023-07-21T22:10:10.411 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.363+0000 7f88d27fc700 1 -- 172.21.15.150:0/1435960856 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f88d801c440 con 0x7f88dc0b5f10 2023-07-21T22:10:10.411 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.367+0000 7f88d27fc700 1 -- 172.21.15.150:0/1435960856 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f88d801cc00 con 0x7f88dc0b5f10 2023-07-21T22:10:10.411 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.367+0000 7f88e2ddc700 1 -- 172.21.15.150:0/1435960856 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88dc04dcb0 con 0x7f88dc0b5f10 2023-07-21T22:10:10.413 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.371+0000 7f88d27fc700 1 -- 172.21.15.150:0/1435960856 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f88d8021060 con 0x7f88dc0b5f10 2023-07-21T22:10:10.514 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.471+0000 7f88e2ddc700 1 -- 172.21.15.150:0/1435960856 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "12a53eb6-e926-42f2-9360-9e526861f31e", "id": 4} v 0) v1 -- 0x7f88dc0b5780 con 0x7f88dc0b5f10 2023-07-21T22:10:10.523 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.479+0000 7f88d27fc700 1 -- 172.21.15.150:0/1435960856 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "12a53eb6-e926-42f2-9360-9e526861f31e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f88d8017070 con 0x7f88dc0b5f10 2023-07-21T22:10:10.523 INFO:teuthology.orchestra.run.smithi150.stdout:4 2023-07-21T22:10:10.525 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.479+0000 7f88e2ddc700 1 -- 172.21.15.150:0/1435960856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88dc0b5f10 msgr2=0x7f88dc14dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.525 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.479+0000 7f88e2ddc700 1 --2- 172.21.15.150:0/1435960856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88dc0b5f10 0x7f88dc14dde0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f88d8001eb0 tx=0x7f88d800c7b0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.525 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.479+0000 7f88e2ddc700 1 -- 172.21.15.150:0/1435960856 shutdown_connections 2023-07-21T22:10:10.525 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.479+0000 7f88e2ddc700 1 --2- 172.21.15.150:0/1435960856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc159ca0 0x7f88dc0c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.525 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.479+0000 7f88e2ddc700 1 --2- 172.21.15.150:0/1435960856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88dc0cfb70 0x7f88dc0c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.525 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.479+0000 7f88e2ddc700 1 --2- 172.21.15.150:0/1435960856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88dc0b5f10 0x7f88dc14dde0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.526 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.479+0000 7f88e2ddc700 1 -- 172.21.15.150:0/1435960856 >> 172.21.15.150:0/1435960856 conn(0x7f88dc069f90 msgr2=0x7f88dc072490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:10.526 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.479+0000 7f88e2ddc700 1 -- 172.21.15.150:0/1435960856 shutdown_connections 2023-07-21T22:10:10.526 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.479+0000 7f88e2ddc700 1 -- 172.21.15.150:0/1435960856 wait complete. 2023-07-21T22:10:10.543 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 59f4e49d-6615-4da9-a799-fa5d9c461811 5 2023-07-21T22:10:10.752 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.707+0000 7fcac359e700 1 Processor -- start 2023-07-21T22:10:10.752 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.707+0000 7fcac359e700 1 -- start start 2023-07-21T22:10:10.756 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.711+0000 7fcac359e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcac41589a0 0x7fcac406c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.756 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.711+0000 7fcac359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcac406c6d0 0x7fcac40698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.756 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.711+0000 7fcac359e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcac4069de0 0x7fcac40c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.756 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.711+0000 7fcac359e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac406a280 con 0x7fcac41589a0 2023-07-21T22:10:10.756 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.711+0000 7fcac359e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac415c800 con 0x7fcac4069de0 2023-07-21T22:10:10.757 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.711+0000 7fcac359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac4158d70 con 0x7fcac406c6d0 2023-07-21T22:10:10.757 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.711+0000 7fcac2d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcac4069de0 0x7fcac40c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.758 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.711+0000 7fcac1d9b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcac406c6d0 0x7fcac40698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.758 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.711+0000 7fcac2d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcac4069de0 0x7fcac40c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38104/0 (socket says 172.21.15.150:38104) 2023-07-21T22:10:10.758 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.711+0000 7fcac2d9d700 1 -- 172.21.15.150:0/3287322234 learned_addr learned my addr 172.21.15.150:0/3287322234 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-07-21T22:10:10.758 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.711+0000 7fcac259c700 1 --2- 172.21.15.150:0/3287322234 >> v2:172.21.15.49:3300/0 conn(0x7fcac41589a0 0x7fcac406c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.758 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac2d9d700 1 -- 172.21.15.150:0/3287322234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcac406c6d0 msgr2=0x7fcac40698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:10.758 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac2d9d700 1 --2- 172.21.15.150:0/3287322234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcac406c6d0 0x7fcac40698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.759 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac2d9d700 1 -- 172.21.15.150:0/3287322234 >> v2:172.21.15.49:3300/0 conn(0x7fcac41589a0 msgr2=0x7fcac406c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:10.759 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac2d9d700 1 --2- 172.21.15.150:0/3287322234 >> v2:172.21.15.49:3300/0 conn(0x7fcac41589a0 0x7fcac406c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.759 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac2d9d700 1 -- 172.21.15.150:0/3287322234 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac40cc990 con 0x7fcac4069de0 2023-07-21T22:10:10.759 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac259c700 1 --2- 172.21.15.150:0/3287322234 >> v2:172.21.15.49:3300/0 conn(0x7fcac41589a0 0x7fcac406c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:10.759 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac2d9d700 1 --2- 172.21.15.150:0/3287322234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcac4069de0 0x7fcac40c89c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcac40c8720 tx=0x7fcabc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f48a97889b9e73ee server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:10.760 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac159a700 1 -- 172.21.15.150:0/3287322234 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00e070 con 0x7fcac4069de0 2023-07-21T22:10:10.760 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac159a700 1 -- 172.21.15.150:0/3287322234 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc00b910 con 0x7fcac4069de0 2023-07-21T22:10:10.760 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac159a700 1 -- 172.21.15.150:0/3287322234 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00bcc0 con 0x7fcac4069de0 2023-07-21T22:10:10.761 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac359e700 1 -- 172.21.15.150:0/3287322234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcac4069de0 msgr2=0x7fcac40c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.761 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac359e700 1 --2- 172.21.15.150:0/3287322234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcac4069de0 0x7fcac40c89c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcac40c8720 tx=0x7fcabc00b330 comp rx=0 tx=0).stop 2023-07-21T22:10:10.761 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac359e700 1 -- 172.21.15.150:0/3287322234 shutdown_connections 2023-07-21T22:10:10.761 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac359e700 1 --2- 172.21.15.150:0/3287322234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcac406c6d0 0x7fcac40698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.761 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac359e700 1 --2- 172.21.15.150:0/3287322234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcac4069de0 0x7fcac40c89c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.761 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac359e700 1 --2- 172.21.15.150:0/3287322234 >> v2:172.21.15.49:3300/0 conn(0x7fcac41589a0 0x7fcac406c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.762 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac359e700 1 -- 172.21.15.150:0/3287322234 >> 172.21.15.150:0/3287322234 conn(0x7fcac40ce0d0 msgr2=0x7fcac40ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:10.762 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac359e700 1 -- 172.21.15.150:0/3287322234 shutdown_connections 2023-07-21T22:10:10.762 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.715+0000 7fcac359e700 1 -- 172.21.15.150:0/3287322234 wait complete. 2023-07-21T22:10:10.763 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.719+0000 7fcac359e700 1 Processor -- start 2023-07-21T22:10:10.763 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.719+0000 7fcac359e700 1 -- start start 2023-07-21T22:10:10.765 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.719+0000 7fcac359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcac4069de0 0x7fcac41f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.766 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.719+0000 7fcac359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac406c6d0 0x7fcac4157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.766 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.719+0000 7fcac359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcac41589a0 0x7fcac40c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.767 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.719+0000 7fcac359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac41f26f0 con 0x7fcac406c6d0 2023-07-21T22:10:10.767 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.719+0000 7fcac359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac41f15b0 con 0x7fcac4069de0 2023-07-21T22:10:10.767 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.719+0000 7fcac359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac41f1890 con 0x7fcac41589a0 2023-07-21T22:10:10.767 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcac4069de0 0x7fcac41f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.768 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcac4069de0 0x7fcac41f21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38108/0 (socket says 172.21.15.150:38108) 2023-07-21T22:10:10.768 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac259c700 1 -- 172.21.15.150:0/958607884 learned_addr learned my addr 172.21.15.150:0/958607884 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-07-21T22:10:10.768 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac2d9d700 1 --2- 172.21.15.150:0/958607884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcac41589a0 0x7fcac40c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.769 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac1d9b700 1 --2- 172.21.15.150:0/958607884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac406c6d0 0x7fcac4157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.770 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac259c700 1 -- 172.21.15.150:0/958607884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcac41589a0 msgr2=0x7fcac40c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.771 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac259c700 1 --2- 172.21.15.150:0/958607884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcac41589a0 0x7fcac40c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.771 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac259c700 1 -- 172.21.15.150:0/958607884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac406c6d0 msgr2=0x7fcac4157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.771 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac259c700 1 --2- 172.21.15.150:0/958607884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac406c6d0 0x7fcac4157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.771 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac259c700 1 -- 172.21.15.150:0/958607884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc009b30 con 0x7fcac4069de0 2023-07-21T22:10:10.772 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac2d9d700 1 --2- 172.21.15.150:0/958607884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcac41589a0 0x7fcac40c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:10.772 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac259c700 1 --2- 172.21.15.150:0/958607884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcac4069de0 0x7fcac41f21b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcab400e810 tx=0x7fcab400eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:10.772 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcabaffd700 1 -- 172.21.15.150:0/958607884 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab400c070 con 0x7fcac4069de0 2023-07-21T22:10:10.772 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcabaffd700 1 -- 172.21.15.150:0/958607884 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab4013610 con 0x7fcac4069de0 2023-07-21T22:10:10.773 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac359e700 1 -- 172.21.15.150:0/958607884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac41f1b70 con 0x7fcac4069de0 2023-07-21T22:10:10.773 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcabaffd700 1 -- 172.21.15.150:0/958607884 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab40139a0 con 0x7fcac4069de0 2023-07-21T22:10:10.773 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac359e700 1 -- 172.21.15.150:0/958607884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac4154430 con 0x7fcac4069de0 2023-07-21T22:10:10.773 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcabaffd700 1 -- 172.21.15.150:0/958607884 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcab401c400 con 0x7fcac4069de0 2023-07-21T22:10:10.774 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcabaffd700 1 -- 172.21.15.150:0/958607884 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fcab401cc30 con 0x7fcac4069de0 2023-07-21T22:10:10.774 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.723+0000 7fcac359e700 1 -- 172.21.15.150:0/958607884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac404dcb0 con 0x7fcac4069de0 2023-07-21T22:10:10.775 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.727+0000 7fcabaffd700 1 -- 172.21.15.150:0/958607884 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fcab4017020 con 0x7fcac4069de0 2023-07-21T22:10:10.788 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:10.742+0000 7f1ee38912c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:10:10.856 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:10.811+0000 7eff1d32d2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:10:10.875 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.831+0000 7fcac359e700 1 -- 172.21.15.150:0/958607884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "59f4e49d-6615-4da9-a799-fa5d9c461811", "id": 5} v 0) v1 -- 0x7fcac40cc080 con 0x7fcac4069de0 2023-07-21T22:10:10.885 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.839+0000 7fcabaffd700 1 -- 172.21.15.150:0/958607884 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "59f4e49d-6615-4da9-a799-fa5d9c461811", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcab402a020 con 0x7fcac4069de0 2023-07-21T22:10:10.885 INFO:teuthology.orchestra.run.smithi150.stdout:5 2023-07-21T22:10:10.886 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.843+0000 7fcac359e700 1 -- 172.21.15.150:0/958607884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcac4069de0 msgr2=0x7fcac41f21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.843+0000 7fcac359e700 1 --2- 172.21.15.150:0/958607884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcac4069de0 0x7fcac41f21b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcab400e810 tx=0x7fcab400eb20 comp rx=0 tx=0).stop 2023-07-21T22:10:10.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.843+0000 7fcac359e700 1 -- 172.21.15.150:0/958607884 shutdown_connections 2023-07-21T22:10:10.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.843+0000 7fcac359e700 1 --2- 172.21.15.150:0/958607884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac406c6d0 0x7fcac4157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.843+0000 7fcac359e700 1 --2- 172.21.15.150:0/958607884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcac41589a0 0x7fcac40c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.843+0000 7fcac359e700 1 --2- 172.21.15.150:0/958607884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcac4069de0 0x7fcac41f21b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.888 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.843+0000 7fcac359e700 1 -- 172.21.15.150:0/958607884 >> 172.21.15.150:0/958607884 conn(0x7fcac40ce0d0 msgr2=0x7fcac41598c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:10.888 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.843+0000 7fcac359e700 1 -- 172.21.15.150:0/958607884 shutdown_connections 2023-07-21T22:10:10.888 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:10.843+0000 7fcac359e700 1 -- 172.21.15.150:0/958607884 wait complete. 2023-07-21T22:10:10.907 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new b3bd569d-7c03-4108-86fd-c48b7e07ceb9 6 2023-07-21T22:10:10.965 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:10.918+0000 7f1ee38912c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:10:11.037 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:10.991+0000 7eff1d32d2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:10:11.074 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.031+0000 7fb22adf7700 1 Processor -- start 2023-07-21T22:10:11.074 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.031+0000 7fb22adf7700 1 -- start start 2023-07-21T22:10:11.077 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb22adf7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2240b4040 0x7fb2240cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.078 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb22adf7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb2240b4410 0x7fb2240b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.078 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb22adf7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb22415f960 0x7fb22415fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.078 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb22adf7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240cfa20 con 0x7fb2240b4410 2023-07-21T22:10:11.078 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb22adf7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240d03c0 con 0x7fb22415f960 2023-07-21T22:10:11.078 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb22adf7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240b8170 con 0x7fb2240b4040 2023-07-21T22:10:11.079 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb228b93700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2240b4040 0x7fb2240cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.080 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb229394700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb22415f960 0x7fb22415fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.080 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb228b93700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2240b4040 0x7fb2240cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:37468/0 (socket says 172.21.15.150:37468) 2023-07-21T22:10:11.080 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb228b93700 1 -- 172.21.15.150:0/330375958 learned_addr learned my addr 172.21.15.150:0/330375958 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-07-21T22:10:11.080 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb223fff700 1 --2- 172.21.15.150:0/330375958 >> v2:172.21.15.49:3300/0 conn(0x7fb2240b4410 0x7fb2240b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.080 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb228b93700 1 -- 172.21.15.150:0/330375958 >> v2:172.21.15.150:3300/0 conn(0x7fb22415f960 msgr2=0x7fb22415fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:11.081 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb228b93700 1 --2- 172.21.15.150:0/330375958 >> v2:172.21.15.150:3300/0 conn(0x7fb22415f960 0x7fb22415fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.081 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb228b93700 1 -- 172.21.15.150:0/330375958 >> v2:172.21.15.49:3300/0 conn(0x7fb2240b4410 msgr2=0x7fb2240b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:11.081 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb228b93700 1 --2- 172.21.15.150:0/330375958 >> v2:172.21.15.49:3300/0 conn(0x7fb2240b4410 0x7fb2240b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.081 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb228b93700 1 -- 172.21.15.150:0/330375958 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240d2350 con 0x7fb2240b4040 2023-07-21T22:10:11.081 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb228b93700 1 --2- 172.21.15.150:0/330375958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2240b4040 0x7fb2240cf320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb224160a00 tx=0x7fb218009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f42db80efa6aadf0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:11.081 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb2237fe700 1 -- 172.21.15.150:0/330375958 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218011830 con 0x7fb2240b4040 2023-07-21T22:10:11.082 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb2237fe700 1 -- 172.21.15.150:0/330375958 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218011990 con 0x7fb2240b4040 2023-07-21T22:10:11.082 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb2237fe700 1 -- 172.21.15.150:0/330375958 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218011d20 con 0x7fb2240b4040 2023-07-21T22:10:11.083 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb22adf7700 1 -- 172.21.15.150:0/330375958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2240b4040 msgr2=0x7fb2240cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:11.083 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.035+0000 7fb22adf7700 1 --2- 172.21.15.150:0/330375958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2240b4040 0x7fb2240cf320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb224160a00 tx=0x7fb218009bf0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.084 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.039+0000 7fb22adf7700 1 -- 172.21.15.150:0/330375958 shutdown_connections 2023-07-21T22:10:11.084 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.039+0000 7fb22adf7700 1 --2- 172.21.15.150:0/330375958 >> v2:172.21.15.150:3300/0 conn(0x7fb22415f960 0x7fb22415fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.084 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.039+0000 7fb22adf7700 1 --2- 172.21.15.150:0/330375958 >> v2:172.21.15.49:3300/0 conn(0x7fb2240b4410 0x7fb2240b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.084 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.039+0000 7fb22adf7700 1 --2- 172.21.15.150:0/330375958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2240b4040 0x7fb2240cf320 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.085 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.039+0000 7fb22adf7700 1 -- 172.21.15.150:0/330375958 >> 172.21.15.150:0/330375958 conn(0x7fb2240658e0 msgr2=0x7fb22406fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:11.085 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.039+0000 7fb22adf7700 1 -- 172.21.15.150:0/330375958 shutdown_connections 2023-07-21T22:10:11.085 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.039+0000 7fb22adf7700 1 -- 172.21.15.150:0/330375958 wait complete. 2023-07-21T22:10:11.085 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.039+0000 7fb22adf7700 1 Processor -- start 2023-07-21T22:10:11.088 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.039+0000 7fb22adf7700 1 -- start start 2023-07-21T22:10:11.088 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb22adf7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2240b4040 0x7fb2241f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.088 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb22adf7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2240b4410 0x7fb224156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.089 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb22adf7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb22415f960 0x7fb2240c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.089 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb22adf7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2241f4ab0 con 0x7fb2240b4040 2023-07-21T22:10:11.089 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb22adf7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22415f3d0 con 0x7fb22415f960 2023-07-21T22:10:11.089 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb22adf7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2241f5a00 con 0x7fb2240b4410 2023-07-21T22:10:11.090 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb229394700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb22415f960 0x7fb2240c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.090 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb229394700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb22415f960 0x7fb2240c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38116/0 (socket says 172.21.15.150:38116) 2023-07-21T22:10:11.090 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb229394700 1 -- 172.21.15.150:0/1127610951 learned_addr learned my addr 172.21.15.150:0/1127610951 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-07-21T22:10:11.090 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb223fff700 1 --2- 172.21.15.150:0/1127610951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2240b4410 0x7fb224156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.091 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb228b93700 1 --2- 172.21.15.150:0/1127610951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2240b4040 0x7fb2241f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.091 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb223fff700 1 -- 172.21.15.150:0/1127610951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb22415f960 msgr2=0x7fb2240c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:11.091 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb223fff700 1 --2- 172.21.15.150:0/1127610951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb22415f960 0x7fb2240c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.091 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb223fff700 1 -- 172.21.15.150:0/1127610951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2240b4040 msgr2=0x7fb2241f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:11.091 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb223fff700 1 --2- 172.21.15.150:0/1127610951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2240b4040 0x7fb2241f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.092 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb223fff700 1 -- 172.21.15.150:0/1127610951 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb218009570 con 0x7fb2240b4410 2023-07-21T22:10:11.092 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb223fff700 1 --2- 172.21.15.150:0/1127610951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2240b4410 0x7fb224156dc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb21000e810 tx=0x7fb21000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:11.092 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb2217fa700 1 -- 172.21.15.150:0/1127610951 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21000c070 con 0x7fb2240b4410 2023-07-21T22:10:11.092 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb2217fa700 1 -- 172.21.15.150:0/1127610951 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb210013610 con 0x7fb2240b4410 2023-07-21T22:10:11.093 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb22adf7700 1 -- 172.21.15.150:0/1127610951 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2240c60f0 con 0x7fb2240b4410 2023-07-21T22:10:11.093 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb2217fa700 1 -- 172.21.15.150:0/1127610951 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2100139a0 con 0x7fb2240b4410 2023-07-21T22:10:11.093 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb22adf7700 1 -- 172.21.15.150:0/1127610951 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2240c66b0 con 0x7fb2240b4410 2023-07-21T22:10:11.093 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb2217fa700 1 -- 172.21.15.150:0/1127610951 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb21001c400 con 0x7fb2240b4410 2023-07-21T22:10:11.093 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb2217fa700 1 -- 172.21.15.150:0/1127610951 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fb21001cca0 con 0x7fb2240b4410 2023-07-21T22:10:11.094 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.043+0000 7fb22adf7700 1 -- 172.21.15.150:0/1127610951 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22404dd50 con 0x7fb2240b4410 2023-07-21T22:10:11.095 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.047+0000 7fb2217fa700 1 -- 172.21.15.150:0/1127610951 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb21003bb00 con 0x7fb2240b4410 2023-07-21T22:10:11.200 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.155+0000 7fb22adf7700 1 -- 172.21.15.150:0/1127610951 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b3bd569d-7c03-4108-86fd-c48b7e07ceb9", "id": 6} v 0) v1 -- 0x7fb2240b1d00 con 0x7fb2240b4410 2023-07-21T22:10:11.208 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.163+0000 7fb2217fa700 1 -- 172.21.15.150:0/1127610951 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b3bd569d-7c03-4108-86fd-c48b7e07ceb9", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb21002a070 con 0x7fb2240b4410 2023-07-21T22:10:11.209 INFO:teuthology.orchestra.run.smithi150.stdout:6 2023-07-21T22:10:11.210 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.167+0000 7fb22adf7700 1 -- 172.21.15.150:0/1127610951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2240b4410 msgr2=0x7fb224156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:11.210 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.167+0000 7fb22adf7700 1 --2- 172.21.15.150:0/1127610951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2240b4410 0x7fb224156dc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb21000e810 tx=0x7fb21000eb20 comp rx=0 tx=0).stop 2023-07-21T22:10:11.211 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.167+0000 7fb22adf7700 1 -- 172.21.15.150:0/1127610951 shutdown_connections 2023-07-21T22:10:11.212 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.167+0000 7fb22adf7700 1 --2- 172.21.15.150:0/1127610951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb22415f960 0x7fb2240c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.212 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.167+0000 7fb22adf7700 1 --2- 172.21.15.150:0/1127610951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2240b4410 0x7fb224156dc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.212 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.167+0000 7fb22adf7700 1 --2- 172.21.15.150:0/1127610951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2240b4040 0x7fb2241f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.213 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.167+0000 7fb22adf7700 1 -- 172.21.15.150:0/1127610951 >> 172.21.15.150:0/1127610951 conn(0x7fb2240658e0 msgr2=0x7fb2240cfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:11.213 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.167+0000 7fb22adf7700 1 -- 172.21.15.150:0/1127610951 shutdown_connections 2023-07-21T22:10:11.213 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.167+0000 7fb22adf7700 1 -- 172.21.15.150:0/1127610951 wait complete. 2023-07-21T22:10:11.235 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 5017ca1a-9754-46bb-a882-c288c82a420b 7 2023-07-21T22:10:11.343 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:11.298+0000 7f1ee38912c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:10:11.402 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.359+0000 7f74f0af5700 1 Processor -- start 2023-07-21T22:10:11.402 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.359+0000 7f74f0af5700 1 -- start start 2023-07-21T22:10:11.404 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.359+0000 7f74f0af5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f74ec0b4b20 0x7f74ec0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.404 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.359+0000 7f74f0af5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74ec0d0810 0x7f74ec0d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.405 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.359+0000 7f74f0af5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ec0b8170 con 0x7f74ec0b4040 2023-07-21T22:10:11.405 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.359+0000 7f74f0af5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ec0cfa20 con 0x7f74ec0b4b20 2023-07-21T22:10:11.405 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.359+0000 7f74f0af5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0d03c0 con 0x7f74ec0d0810 2023-07-21T22:10:11.405 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.359+0000 7f74ead9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74ec0d0810 0x7f74ec0d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.406 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.359+0000 7f74ead9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74ec0d0810 0x7f74ec0d0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:37492/0 (socket says 172.21.15.150:37492) 2023-07-21T22:10:11.406 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.359+0000 7f74ead9d700 1 -- 172.21.15.150:0/2378710645 learned_addr learned my addr 172.21.15.150:0/2378710645 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-07-21T22:10:11.406 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74e3fff700 1 --2- 172.21.15.150:0/2378710645 >> v2:172.21.15.150:3300/0 conn(0x7f74ec0b4b20 0x7f74ec0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.406 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74ead9d700 1 -- 172.21.15.150:0/2378710645 >> v2:172.21.15.150:3300/0 conn(0x7f74ec0b4b20 msgr2=0x7f74ec0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:11.407 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74ead9d700 1 --2- 172.21.15.150:0/2378710645 >> v2:172.21.15.150:3300/0 conn(0x7f74ec0b4b20 0x7f74ec0cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.407 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74ead9d700 1 -- 172.21.15.150:0/2378710645 >> v1:172.21.15.150:6789/0 conn(0x7f74ec0b4040 legacy=0x7f74ec0b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:11.407 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74ead9d700 1 -- 172.21.15.150:0/2378710645 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec0d2350 con 0x7f74ec0d0810 2023-07-21T22:10:11.407 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74ead9d700 1 --2- 172.21.15.150:0/2378710645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74ec0d0810 0x7f74ec0d0c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009e50 tx=0x7f74e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da80c8dd10069780 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:11.407 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74e9d9b700 1 -- 172.21.15.150:0/2378710645 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e400e070 con 0x7f74ec0d0810 2023-07-21T22:10:11.408 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74e9d9b700 1 -- 172.21.15.150:0/2378710645 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e400b9c0 con 0x7f74ec0d0810 2023-07-21T22:10:11.408 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74e9d9b700 1 -- 172.21.15.150:0/2378710645 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e400bd70 con 0x7f74ec0d0810 2023-07-21T22:10:11.408 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74f0af5700 1 -- 172.21.15.150:0/2378710645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74ec0d0810 msgr2=0x7f74ec0d0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:11.409 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74f0af5700 1 --2- 172.21.15.150:0/2378710645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74ec0d0810 0x7f74ec0d0c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009e50 tx=0x7f74e400b330 comp rx=0 tx=0).stop 2023-07-21T22:10:11.409 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74f0af5700 1 -- 172.21.15.150:0/2378710645 shutdown_connections 2023-07-21T22:10:11.409 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74f0af5700 1 --2- 172.21.15.150:0/2378710645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74ec0d0810 0x7f74ec0d0c90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.409 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74f0af5700 1 --2- 172.21.15.150:0/2378710645 >> v2:172.21.15.150:3300/0 conn(0x7f74ec0b4b20 0x7f74ec0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.409 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74f0af5700 1 -- 172.21.15.150:0/2378710645 >> 172.21.15.150:0/2378710645 conn(0x7f74ec0658e0 msgr2=0x7f74ec06fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:11.409 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74f0af5700 1 -- 172.21.15.150:0/2378710645 shutdown_connections 2023-07-21T22:10:11.410 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.363+0000 7f74f0af5700 1 -- 172.21.15.150:0/2378710645 wait complete. 2023-07-21T22:10:11.410 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.367+0000 7f74f0af5700 1 Processor -- start 2023-07-21T22:10:11.411 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.367+0000 7f74f0af5700 1 -- start start 2023-07-21T22:10:11.412 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.367+0000 7f74f0af5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74ec0b4040 0x7f74ec159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.413 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.367+0000 7f74f0af5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74ec0b4b20 0x7f74ec0cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.413 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.367+0000 7f74f0af5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74ec0d0810 0x7f74ec0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.413 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.367+0000 7f74f0af5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0cf5c0 con 0x7f74ec0b4040 2023-07-21T22:10:11.413 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.367+0000 7f74f0af5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec15d8b0 con 0x7f74ec0b4b20 2023-07-21T22:10:11.413 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.367+0000 7f74f0af5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec15db90 con 0x7f74ec0d0810 2023-07-21T22:10:11.414 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74e3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74ec0b4b20 0x7f74ec0cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.415 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74ead9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74ec0d0810 0x7f74ec0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.415 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74e3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74ec0b4b20 0x7f74ec0cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38130/0 (socket says 172.21.15.150:38130) 2023-07-21T22:10:11.415 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74e3fff700 1 -- 172.21.15.150:0/1745409555 learned_addr learned my addr 172.21.15.150:0/1745409555 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-07-21T22:10:11.415 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74ea59c700 1 --2- 172.21.15.150:0/1745409555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74ec0b4040 0x7f74ec159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.415 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74ead9d700 1 -- 172.21.15.150:0/1745409555 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74ec0b4b20 msgr2=0x7f74ec0cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:11.415 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74ead9d700 1 --2- 172.21.15.150:0/1745409555 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74ec0b4b20 0x7f74ec0cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.415 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74ead9d700 1 -- 172.21.15.150:0/1745409555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74ec0b4040 msgr2=0x7f74ec159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:11.416 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74ead9d700 1 --2- 172.21.15.150:0/1745409555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74ec0b4040 0x7f74ec159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.416 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74ead9d700 1 -- 172.21.15.150:0/1745409555 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e4009b30 con 0x7f74ec0d0810 2023-07-21T22:10:11.416 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74ead9d700 1 --2- 172.21.15.150:0/1745409555 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74ec0d0810 0x7f74ec0b2860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f74e4015000 tx=0x7f74e4004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:11.417 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74e2ffd700 1 -- 172.21.15.150:0/1745409555 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4004800 con 0x7f74ec0d0810 2023-07-21T22:10:11.417 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74e2ffd700 1 -- 172.21.15.150:0/1745409555 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e40099b0 con 0x7f74ec0d0810 2023-07-21T22:10:11.417 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74e2ffd700 1 -- 172.21.15.150:0/1745409555 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e401c650 con 0x7f74ec0d0810 2023-07-21T22:10:11.417 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74f0af5700 1 -- 172.21.15.150:0/1745409555 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec15de70 con 0x7f74ec0d0810 2023-07-21T22:10:11.417 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74f0af5700 1 -- 172.21.15.150:0/1745409555 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec15e430 con 0x7f74ec0d0810 2023-07-21T22:10:11.418 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74e2ffd700 1 -- 172.21.15.150:0/1745409555 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f74e401cab0 con 0x7f74ec0d0810 2023-07-21T22:10:11.418 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74e2ffd700 1 -- 172.21.15.150:0/1745409555 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f74e4024d30 con 0x7f74ec0d0810 2023-07-21T22:10:11.418 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.371+0000 7f74f0af5700 1 -- 172.21.15.150:0/1745409555 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ec04dd50 con 0x7f74ec0d0810 2023-07-21T22:10:11.420 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.375+0000 7f74e2ffd700 1 -- 172.21.15.150:0/1745409555 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f74e4029060 con 0x7f74ec0d0810 2023-07-21T22:10:11.443 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:11.399+0000 7eff1d32d2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:10:11.528 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.483+0000 7f74f0af5700 1 -- 172.21.15.150:0/1745409555 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5017ca1a-9754-46bb-a882-c288c82a420b", "id": 7} v 0) v1 -- 0x7f74ec0b1d00 con 0x7f74ec0d0810 2023-07-21T22:10:11.537 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.495+0000 7f74e2ffd700 1 -- 172.21.15.150:0/1745409555 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5017ca1a-9754-46bb-a882-c288c82a420b", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f74e401cd60 con 0x7f74ec0d0810 2023-07-21T22:10:11.537 INFO:teuthology.orchestra.run.smithi150.stdout:7 2023-07-21T22:10:11.539 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.495+0000 7f74f0af5700 1 -- 172.21.15.150:0/1745409555 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74ec0d0810 msgr2=0x7f74ec0b2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:11.539 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.495+0000 7f74f0af5700 1 --2- 172.21.15.150:0/1745409555 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74ec0d0810 0x7f74ec0b2860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f74e4015000 tx=0x7f74e4004af0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.539 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.495+0000 7f74f0af5700 1 -- 172.21.15.150:0/1745409555 shutdown_connections 2023-07-21T22:10:11.539 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.495+0000 7f74f0af5700 1 --2- 172.21.15.150:0/1745409555 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74ec0d0810 0x7f74ec0b2860 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.539 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.495+0000 7f74f0af5700 1 --2- 172.21.15.150:0/1745409555 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74ec0b4b20 0x7f74ec0cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.540 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.495+0000 7f74f0af5700 1 --2- 172.21.15.150:0/1745409555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74ec0b4040 0x7f74ec159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.540 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.495+0000 7f74f0af5700 1 -- 172.21.15.150:0/1745409555 >> 172.21.15.150:0/1745409555 conn(0x7f74ec0658e0 msgr2=0x7f74ec0b7400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:11.540 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.495+0000 7f74f0af5700 1 -- 172.21.15.150:0/1745409555 shutdown_connections 2023-07-21T22:10:11.540 INFO:teuthology.orchestra.run.smithi150.stderr:2023-07-21T22:10:11.495+0000 7f74f0af5700 1 -- 172.21.15.150:0/1745409555 wait complete. 2023-07-21T22:10:11.559 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-21T22:10:11.559 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-21T22:10:11.565 INFO:tasks.ceph.osd.0:Started 2023-07-21T22:10:11.565 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-21T22:10:11.566 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-21T22:10:11.571 INFO:tasks.ceph.osd.1:Started 2023-07-21T22:10:11.571 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-21T22:10:11.571 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-21T22:10:11.576 INFO:tasks.ceph.osd.2:Started 2023-07-21T22:10:11.576 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-21T22:10:11.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-21T22:10:11.577 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:11.530+0000 7f1ee38912c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:10:11.584 INFO:tasks.ceph.osd.3:Started 2023-07-21T22:10:11.584 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-21T22:10:11.584 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-21T22:10:11.591 INFO:tasks.ceph.osd.4:Started 2023-07-21T22:10:11.591 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-21T22:10:11.592 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-21T22:10:11.597 INFO:tasks.ceph.osd.5:Started 2023-07-21T22:10:11.597 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-21T22:10:11.597 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-21T22:10:11.604 INFO:tasks.ceph.osd.6:Started 2023-07-21T22:10:11.604 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-21T22:10:11.605 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-21T22:10:11.610 INFO:tasks.ceph.osd.7:Started 2023-07-21T22:10:11.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:10:11.694 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:11.646+0000 7f1ee38912c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:10:11.726 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:11.683+0000 7eff1d32d2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:10:11.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.730+0000 7f54dd2e7700 1 Processor -- start 2023-07-21T22:10:11.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.730+0000 7f54dd2e7700 1 -- start start 2023-07-21T22:10:11.777 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:11.730+0000 7f1ee38912c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:10:11.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54dd2e7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54d806af80 0x7f54d815f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54dd2e7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f54d806b420 0x7f54d815fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54dd2e7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d815d240 con 0x7f54d806e960 2023-07-21T22:10:11.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54dd2e7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d806b8d0 con 0x7f54d806af80 2023-07-21T22:10:11.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54dd2e7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d80698a0 con 0x7f54d806b420 2023-07-21T22:10:11.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54d67fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54d806af80 0x7f54d815f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54d67fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54d806af80 0x7f54d815f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33844/0 (socket says 172.21.15.49:33844) 2023-07-21T22:10:11.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54d67fc700 1 -- 172.21.15.49:0/3704002721 learned_addr learned my addr 172.21.15.49:0/3704002721 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:11.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54d77fe700 1 --2- 172.21.15.49:0/3704002721 >> v2:172.21.15.150:3300/0 conn(0x7f54d806b420 0x7f54d815fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54d67fc700 1 -- 172.21.15.49:0/3704002721 >> v2:172.21.15.150:3300/0 conn(0x7f54d806b420 msgr2=0x7f54d815fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:11.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54d67fc700 1 --2- 172.21.15.49:0/3704002721 >> v2:172.21.15.150:3300/0 conn(0x7f54d806b420 0x7f54d815fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54d67fc700 1 -- 172.21.15.49:0/3704002721 >> v1:172.21.15.150:6789/0 conn(0x7f54d806e960 legacy=0x7f54d806ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:11.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54d67fc700 1 -- 172.21.15.49:0/3704002721 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d815c480 con 0x7f54d806af80 2023-07-21T22:10:11.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54d67fc700 1 --2- 172.21.15.49:0/3704002721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54d806af80 0x7f54d815f860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f54d806dd50 tx=0x7f54cc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d25ff941ec6e8c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:11.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54d5ffb700 1 -- 172.21.15.49:0/3704002721 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc004230 con 0x7f54d806af80 2023-07-21T22:10:11.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54d5ffb700 1 -- 172.21.15.49:0/3704002721 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc004390 con 0x7f54d806af80 2023-07-21T22:10:11.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.734+0000 7f54d5ffb700 1 -- 172.21.15.49:0/3704002721 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0036c0 con 0x7f54d806af80 2023-07-21T22:10:11.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.738+0000 7f54dd2e7700 1 -- 172.21.15.49:0/3704002721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54d806af80 msgr2=0x7f54d815f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:11.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.738+0000 7f54dd2e7700 1 --2- 172.21.15.49:0/3704002721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54d806af80 0x7f54d815f860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f54d806dd50 tx=0x7f54cc009bf0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.738+0000 7f54dd2e7700 1 -- 172.21.15.49:0/3704002721 shutdown_connections 2023-07-21T22:10:11.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.738+0000 7f54dd2e7700 1 --2- 172.21.15.49:0/3704002721 >> v2:172.21.15.150:3300/0 conn(0x7f54d806b420 0x7f54d815fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.738+0000 7f54dd2e7700 1 --2- 172.21.15.49:0/3704002721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54d806af80 0x7f54d815f860 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.738+0000 7f54dd2e7700 1 -- 172.21.15.49:0/3704002721 >> 172.21.15.49:0/3704002721 conn(0x7f54d80b0cc0 msgr2=0x7f54d80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:11.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.738+0000 7f54dd2e7700 1 -- 172.21.15.49:0/3704002721 shutdown_connections 2023-07-21T22:10:11.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.738+0000 7f54dd2e7700 1 -- 172.21.15.49:0/3704002721 wait complete. 2023-07-21T22:10:11.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54dd2e7700 1 Processor -- start 2023-07-21T22:10:11.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54dd2e7700 1 -- start start 2023-07-21T22:10:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54dd2e7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d806b420 0x7f54d814f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54dd2e7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54d806e960 0x7f54d80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54dd2e7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d80b2570 0x7f54d8154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54dd2e7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d81f4b80 con 0x7f54d806e960 2023-07-21T22:10:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54dd2e7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d814fbc0 con 0x7f54d806b420 2023-07-21T22:10:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54dd2e7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d81f4dd0 con 0x7f54d80b2570 2023-07-21T22:10:11.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54d67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54d806e960 0x7f54d80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54d67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54d806e960 0x7f54d80b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33854/0 (socket says 172.21.15.49:33854) 2023-07-21T22:10:11.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54d67fc700 1 -- 172.21.15.49:0/2315856969 learned_addr learned my addr 172.21.15.49:0/2315856969 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:11.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54d6ffd700 1 --2- 172.21.15.49:0/2315856969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d806b420 0x7f54d814f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54d77fe700 1 --2- 172.21.15.49:0/2315856969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d80b2570 0x7f54d8154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:11.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54d67fc700 1 -- 172.21.15.49:0/2315856969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d80b2570 msgr2=0x7f54d8154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:11.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54d67fc700 1 --2- 172.21.15.49:0/2315856969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d80b2570 0x7f54d8154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54d67fc700 1 -- 172.21.15.49:0/2315856969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d806b420 msgr2=0x7f54d814f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:11.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54d67fc700 1 --2- 172.21.15.49:0/2315856969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d806b420 0x7f54d814f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54d67fc700 1 -- 172.21.15.49:0/2315856969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc009570 con 0x7f54d806e960 2023-07-21T22:10:11.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54d6ffd700 1 --2- 172.21.15.49:0/2315856969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d806b420 0x7f54d814f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:11.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54d77fe700 1 --2- 172.21.15.49:0/2315856969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d80b2570 0x7f54d8154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:11.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.742+0000 7f54d67fc700 1 --2- 172.21.15.49:0/2315856969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54d806e960 0x7f54d80b2030 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009c30 tx=0x7f54cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:11.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.746+0000 7f54bf7fe700 1 -- 172.21.15.49:0/2315856969 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0036c0 con 0x7f54d806e960 2023-07-21T22:10:11.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.746+0000 7f54bf7fe700 1 -- 172.21.15.49:0/2315856969 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc01f070 con 0x7f54d806e960 2023-07-21T22:10:11.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.746+0000 7f54bf7fe700 1 -- 172.21.15.49:0/2315856969 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc00b660 con 0x7f54d806e960 2023-07-21T22:10:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.746+0000 7f54dd2e7700 1 -- 172.21.15.49:0/2315856969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d81f50b0 con 0x7f54d806e960 2023-07-21T22:10:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.746+0000 7f54dd2e7700 1 -- 172.21.15.49:0/2315856969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d81f5670 con 0x7f54d806e960 2023-07-21T22:10:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.746+0000 7f54bf7fe700 1 -- 172.21.15.49:0/2315856969 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f54cc021030 con 0x7f54d806e960 2023-07-21T22:10:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.746+0000 7f54bf7fe700 1 -- 172.21.15.49:0/2315856969 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f54cc01b440 con 0x7f54d806e960 2023-07-21T22:10:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.746+0000 7f54dd2e7700 1 -- 172.21.15.49:0/2315856969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d804dcb0 con 0x7f54d806e960 2023-07-21T22:10:11.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.750+0000 7f54bf7fe700 1 -- 172.21.15.49:0/2315856969 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f54cc00bc50 con 0x7f54d806e960 2023-07-21T22:10:11.828 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:11.783+0000 7eff1d32d2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:10:11.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.822+0000 7f54dd2e7700 1 -- 172.21.15.49:0/2315856969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54d804dcb0 con 0x7f54d806e960 2023-07-21T22:10:11.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.822+0000 7f54bf7fe700 1 -- 172.21.15.49:0/2315856969 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f54cc00bdf0 con 0x7f54d806e960 2023-07-21T22:10:11.866 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:11.867 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":10,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:11.490984+0000","last_up_change":"0.000000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:10:11.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.822+0000 7f54dd2e7700 1 -- 172.21.15.49:0/2315856969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54d806e960 msgr2=0x7f54d80b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:11.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.822+0000 7f54dd2e7700 1 --2- 172.21.15.49:0/2315856969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54d806e960 0x7f54d80b2030 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009c30 tx=0x7f54cc004770 comp rx=0 tx=0).stop 2023-07-21T22:10:11.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.822+0000 7f54dd2e7700 1 -- 172.21.15.49:0/2315856969 shutdown_connections 2023-07-21T22:10:11.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.822+0000 7f54dd2e7700 1 --2- 172.21.15.49:0/2315856969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54d806e960 0x7f54d80b2030 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.822+0000 7f54dd2e7700 1 --2- 172.21.15.49:0/2315856969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d80b2570 0x7f54d8154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.822+0000 7f54dd2e7700 1 --2- 172.21.15.49:0/2315856969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d806b420 0x7f54d814f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:11.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.822+0000 7f54dd2e7700 1 -- 172.21.15.49:0/2315856969 >> 172.21.15.49:0/2315856969 conn(0x7f54d80b0cc0 msgr2=0x7f54d8069aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:11.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.822+0000 7f54dd2e7700 1 -- 172.21.15.49:0/2315856969 shutdown_connections 2023-07-21T22:10:11.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:11.822+0000 7f54dd2e7700 1 -- 172.21.15.49:0/2315856969 wait complete. 2023-07-21T22:10:11.891 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-21T22:10:11.891 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-21T22:10:11.911 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:11.867+0000 7eff1d32d2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:10:12.245 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-07-21T22:10:12.198+0000 7fa137618700 -1 Falling back to public interface 2023-07-21T22:10:12.252 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-07-21T22:10:12.206+0000 7f7a62d65700 -1 Falling back to public interface 2023-07-21T22:10:12.263 INFO:tasks.ceph.osd.4.smithi150.stderr:2023-07-21T22:10:12.219+0000 7fd6f7203700 -1 Falling back to public interface 2023-07-21T22:10:12.265 INFO:tasks.ceph.osd.5.smithi150.stderr:2023-07-21T22:10:12.223+0000 7fb1a52dd700 -1 Falling back to public interface 2023-07-21T22:10:12.267 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-07-21T22:10:12.222+0000 7f69689af700 -1 Falling back to public interface 2023-07-21T22:10:12.268 INFO:tasks.ceph.osd.7.smithi150.stderr:2023-07-21T22:10:12.223+0000 7f332ccf2700 -1 Falling back to public interface 2023-07-21T22:10:12.269 INFO:tasks.ceph.osd.5.smithi150.stderr:2023-07-21T22:10:12.223+0000 7fb1a42a8700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6808/0: (98) Address already in use 2023-07-21T22:10:12.269 INFO:tasks.ceph.osd.5.smithi150.stderr:2023-07-21T22:10:12.227+0000 7fb1a42a8700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6810/0: (98) Address already in use 2023-07-21T22:10:12.293 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-07-21T22:10:12.246+0000 7f1fe179e700 -1 Falling back to public interface 2023-07-21T22:10:12.300 INFO:tasks.ceph.osd.6.smithi150.stderr:2023-07-21T22:10:12.255+0000 7f93155ad700 -1 Falling back to public interface 2023-07-21T22:10:12.573 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:12.526+0000 7f1ee38912c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:10:12.659 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:12.614+0000 7f1ee38912c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:10:12.697 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-21T22:10:12.765 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:12.723+0000 7eff1d32d2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:10:12.837 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:12.790+0000 7f1ee38912c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:10:12.852 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:12.807+0000 7eff1d32d2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:10:12.857 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edecd6700 1 Processor -- start 2023-07-21T22:10:12.857 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edecd6700 1 -- start start 2023-07-21T22:10:12.858 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edecd6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6ed806a9a0 0x7f6ed806ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:12.858 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edecd6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ed80b0ae0 0x7f6ed80d1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:12.859 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edecd6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed80af640 con 0x7f6ed80d1420 2023-07-21T22:10:12.859 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edecd6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed80d2460 con 0x7f6ed806a9a0 2023-07-21T22:10:12.859 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edecd6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed815c410 con 0x7f6ed80b0ae0 2023-07-21T22:10:12.860 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edca72700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6ed806a9a0 0x7f6ed806ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:12.860 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6ed7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6ed80d1420 0x7f6ed815fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34672/0 (socket says 172.21.15.49:34672) 2023-07-21T22:10:12.860 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6ed7fff700 1 -- 172.21.15.49:0/756442216 learned_addr learned my addr 172.21.15.49:0/756442216 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:12.860 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edd273700 1 --2- 172.21.15.49:0/756442216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ed80b0ae0 0x7f6ed80d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:12.861 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6ed77fe700 1 -- 172.21.15.49:0/756442216 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151957662 0 0) 0x7f6ed80af640 con 0x7f6ed80d1420 2023-07-21T22:10:12.861 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6ed77fe700 1 -- 172.21.15.49:0/756442216 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ec80035d0 con 0x7f6ed80d1420 2023-07-21T22:10:12.861 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edca72700 1 -- 172.21.15.49:0/756442216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ed80b0ae0 msgr2=0x7f6ed80d1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:12.861 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edca72700 1 --2- 172.21.15.49:0/756442216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ed80b0ae0 0x7f6ed80d1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:12.861 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edca72700 1 -- 172.21.15.49:0/756442216 >> v1:172.21.15.49:6789/0 conn(0x7f6ed80d1420 legacy=0x7f6ed815fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:12.861 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edca72700 1 -- 172.21.15.49:0/756442216 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed806b2b0 con 0x7f6ed806a9a0 2023-07-21T22:10:12.862 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edca72700 1 --2- 172.21.15.49:0/756442216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed806a9a0 0x7f6ed806ad70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009850 tx=0x7f6ecc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851b0ce3d16c7856 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:12.862 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6ed77fe700 1 -- 172.21.15.49:0/756442216 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc011830 con 0x7f6ed806a9a0 2023-07-21T22:10:12.862 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6ed77fe700 1 -- 172.21.15.49:0/756442216 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ecc011990 con 0x7f6ed806a9a0 2023-07-21T22:10:12.863 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6ed77fe700 1 -- 172.21.15.49:0/756442216 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc011d00 con 0x7f6ed806a9a0 2023-07-21T22:10:12.863 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edecd6700 1 -- 172.21.15.49:0/756442216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed806a9a0 msgr2=0x7f6ed806ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:12.863 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edecd6700 1 --2- 172.21.15.49:0/756442216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed806a9a0 0x7f6ed806ad70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009850 tx=0x7f6ecc009b60 comp rx=0 tx=0).stop 2023-07-21T22:10:12.863 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edecd6700 1 -- 172.21.15.49:0/756442216 shutdown_connections 2023-07-21T22:10:12.863 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edecd6700 1 --2- 172.21.15.49:0/756442216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ed80b0ae0 0x7f6ed80d1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:12.863 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edecd6700 1 --2- 172.21.15.49:0/756442216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed806a9a0 0x7f6ed806ad70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:12.863 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.814+0000 7f6edecd6700 1 -- 172.21.15.49:0/756442216 >> 172.21.15.49:0/756442216 conn(0x7f6ed809b960 msgr2=0x7f6ed80d2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:12.864 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.818+0000 7f6edecd6700 1 -- 172.21.15.49:0/756442216 shutdown_connections 2023-07-21T22:10:12.864 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.818+0000 7f6edecd6700 1 -- 172.21.15.49:0/756442216 wait complete. 2023-07-21T22:10:12.864 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.818+0000 7f6edecd6700 1 Processor -- start 2023-07-21T22:10:12.864 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.818+0000 7f6edecd6700 1 -- start start 2023-07-21T22:10:12.865 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.818+0000 7f6edecd6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ed806a9a0 0x7f6ed815d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:12.865 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.818+0000 7f6edecd6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed80b0ae0 0x7f6ed81f1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:12.865 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.818+0000 7f6edecd6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ed80d1420 0x7f6ed809e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:12.866 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.818+0000 7f6edecd6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed809c2d0 con 0x7f6ed80b0ae0 2023-07-21T22:10:12.866 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.818+0000 7f6edecd6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed815d570 con 0x7f6ed806a9a0 2023-07-21T22:10:12.866 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.818+0000 7f6edecd6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed815d7f0 con 0x7f6ed80d1420 2023-07-21T22:10:12.867 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.818+0000 7f6ed7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed80b0ae0 0x7f6ed81f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:12.867 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.818+0000 7f6ed7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed80b0ae0 0x7f6ed81f1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33866/0 (socket says 172.21.15.49:33866) 2023-07-21T22:10:12.867 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.818+0000 7f6ed7fff700 1 -- 172.21.15.49:0/3263607631 learned_addr learned my addr 172.21.15.49:0/3263607631 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:12.867 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6edca72700 1 --2- 172.21.15.49:0/3263607631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ed806a9a0 0x7f6ed815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:12.867 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6edd273700 1 --2- 172.21.15.49:0/3263607631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ed80d1420 0x7f6ed809e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:12.868 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6ed7fff700 1 -- 172.21.15.49:0/3263607631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ed80d1420 msgr2=0x7f6ed809e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:12.868 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6ed7fff700 1 --2- 172.21.15.49:0/3263607631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ed80d1420 0x7f6ed809e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:12.868 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6ed7fff700 1 -- 172.21.15.49:0/3263607631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ed806a9a0 msgr2=0x7f6ed815d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:12.868 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6ed7fff700 1 --2- 172.21.15.49:0/3263607631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ed806a9a0 0x7f6ed815d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:12.868 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6ed7fff700 1 -- 172.21.15.49:0/3263607631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc0094b0 con 0x7f6ed80b0ae0 2023-07-21T22:10:12.868 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6ed7fff700 1 --2- 172.21.15.49:0/3263607631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed80b0ae0 0x7f6ed81f1060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400c500 tx=0x7f6ec400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:12.869 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6ed57fa700 1 -- 172.21.15.49:0/3263607631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4005d90 con 0x7f6ed80b0ae0 2023-07-21T22:10:12.869 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6edecd6700 1 -- 172.21.15.49:0/3263607631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed815dad0 con 0x7f6ed80b0ae0 2023-07-21T22:10:12.869 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6ed57fa700 1 -- 172.21.15.49:0/3263607631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec400ce70 con 0x7f6ed80b0ae0 2023-07-21T22:10:12.870 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6ed57fa700 1 -- 172.21.15.49:0/3263607631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec40072d0 con 0x7f6ed80b0ae0 2023-07-21T22:10:12.870 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6edecd6700 1 -- 172.21.15.49:0/3263607631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed809c520 con 0x7f6ed80b0ae0 2023-07-21T22:10:12.870 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6ed57fa700 1 -- 172.21.15.49:0/3263607631 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6ec401c440 con 0x7f6ed80b0ae0 2023-07-21T22:10:12.870 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6ed57fa700 1 -- 172.21.15.49:0/3263607631 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f6ec401cdc0 con 0x7f6ed80b0ae0 2023-07-21T22:10:12.870 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.822+0000 7f6edecd6700 1 -- 172.21.15.49:0/3263607631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed804dcb0 con 0x7f6ed80b0ae0 2023-07-21T22:10:12.872 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.826+0000 7f6ed57fa700 1 -- 172.21.15.49:0/3263607631 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6ec4021060 con 0x7f6ed80b0ae0 2023-07-21T22:10:12.930 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:12.886+0000 7f1ee38912c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:10:12.943 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.898+0000 7f6edecd6700 1 -- 172.21.15.49:0/3263607631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ed815f880 con 0x7f6ed80b0ae0 2023-07-21T22:10:12.944 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.898+0000 7f6ed57fa700 1 -- 172.21.15.49:0/3263607631 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6ec4017070 con 0x7f6ed80b0ae0 2023-07-21T22:10:12.944 INFO:teuthology.misc.health.smithi049.stdout: 2023-07-21T22:10:12.944 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":10,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:11.490984+0000","last_up_change":"0.000000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:10:12.945 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.898+0000 7f6edecd6700 1 -- 172.21.15.49:0/3263607631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed80b0ae0 msgr2=0x7f6ed81f1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:12.945 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.898+0000 7f6edecd6700 1 --2- 172.21.15.49:0/3263607631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed80b0ae0 0x7f6ed81f1060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400c500 tx=0x7f6ec400c810 comp rx=0 tx=0).stop 2023-07-21T22:10:12.946 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.898+0000 7f6edecd6700 1 -- 172.21.15.49:0/3263607631 shutdown_connections 2023-07-21T22:10:12.946 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.898+0000 7f6edecd6700 1 --2- 172.21.15.49:0/3263607631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed80b0ae0 0x7f6ed81f1060 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:12.946 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.898+0000 7f6edecd6700 1 --2- 172.21.15.49:0/3263607631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ed80d1420 0x7f6ed809e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:12.946 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.898+0000 7f6edecd6700 1 --2- 172.21.15.49:0/3263607631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ed806a9a0 0x7f6ed815d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:12.946 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.898+0000 7f6edecd6700 1 -- 172.21.15.49:0/3263607631 >> 172.21.15.49:0/3263607631 conn(0x7f6ed809b960 msgr2=0x7f6ed80b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:12.946 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.898+0000 7f6edecd6700 1 -- 172.21.15.49:0/3263607631 shutdown_connections 2023-07-21T22:10:12.947 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:12.898+0000 7f6edecd6700 1 -- 172.21.15.49:0/3263607631 wait complete. 2023-07-21T22:10:12.960 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-21T22:10:13.033 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:12.990+0000 7f1ee38912c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:10:13.045 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:12.999+0000 7eff1d32d2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:10:13.130 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:13.087+0000 7eff1d32d2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:10:13.224 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:13.179+0000 7eff1d32d2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:10:13.244 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:13.202+0000 7f1ee38912c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:10:13.420 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:13.375+0000 7eff1d32d2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:10:13.494 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:13.450+0000 7f1ee38912c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:10:13.665 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:13.619+0000 7eff1d32d2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:10:14.314 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:14.270+0000 7f1ee38912c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:10:14.495 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-07-21T22:10:14.451+0000 7eff1d32d2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:10:15.355 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:15.314+0000 7f1ecab45700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-21T22:10:15.356 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-07-21T22:10:15.314+0000 7f1ecab45700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-21T22:10:15.992 INFO:tasks.ceph.osd.7.smithi150.stderr:2023-07-21T22:10:15.946+0000 7f332ccf2700 -1 osd.7 0 log_to_monitors true 2023-07-21T22:10:16.174 INFO:tasks.ceph.osd.5.smithi150.stderr:2023-07-21T22:10:16.130+0000 7fb1a52dd700 -1 osd.5 0 log_to_monitors true 2023-07-21T22:10:16.200 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-07-21T22:10:16.158+0000 7f7a62d65700 -1 osd.1 0 log_to_monitors true 2023-07-21T22:10:16.231 INFO:tasks.ceph.osd.4.smithi150.stderr:2023-07-21T22:10:16.186+0000 7fd6f7203700 -1 osd.4 0 log_to_monitors true 2023-07-21T22:10:16.256 INFO:tasks.ceph.osd.6.smithi150.stderr:2023-07-21T22:10:16.210+0000 7f93155ad700 -1 osd.6 0 log_to_monitors true 2023-07-21T22:10:16.468 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-07-21T22:10:16.426+0000 7fa137618700 -1 osd.0 0 log_to_monitors true 2023-07-21T22:10:16.565 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-07-21T22:10:16.522+0000 7f69689af700 -1 osd.3 0 log_to_monitors true 2023-07-21T22:10:16.565 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-07-21T22:10:16.522+0000 7f1fe179e700 -1 osd.2 0 log_to_monitors true 2023-07-21T22:10:18.544 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-07-21T22:10:18.502+0000 7f7a5eba4700 -1 osd.1 0 waiting for initial osdmap 2023-07-21T22:10:18.554 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-07-21T22:10:18.514+0000 7f7a565f0700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:10:19.766 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-21T22:10:19.941 INFO:tasks.ceph.osd.7.smithi150.stderr:2023-07-21T22:10:19.882+0000 7f3328b31700 -1 osd.7 0 waiting for initial osdmap 2023-07-21T22:10:19.942 INFO:tasks.ceph.osd.7.smithi150.stderr:2023-07-21T22:10:19.894+0000 7f33205f0700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:10:19.950 INFO:tasks.ceph.osd.5.smithi150.stderr:2023-07-21T22:10:19.906+0000 7fb1a111c700 -1 osd.5 0 waiting for initial osdmap 2023-07-21T22:10:19.955 INFO:tasks.ceph.osd.4.smithi150.stderr:2023-07-21T22:10:19.906+0000 7fd6f3042700 -1 osd.4 0 waiting for initial osdmap 2023-07-21T22:10:19.961 INFO:tasks.ceph.osd.5.smithi150.stderr:2023-07-21T22:10:19.918+0000 7fb1989f0700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:10:19.964 INFO:tasks.ceph.osd.4.smithi150.stderr:2023-07-21T22:10:19.918+0000 7fd6ea9f0700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:10:19.975 INFO:tasks.ceph.osd.6.smithi150.stderr:2023-07-21T22:10:19.930+0000 7f9311d73700 -1 osd.6 0 waiting for initial osdmap 2023-07-21T22:10:19.983 INFO:tasks.ceph.osd.6.smithi150.stderr:2023-07-21T22:10:19.938+0000 7f9308df0700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:10:19.992 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.950+0000 7f1a66fbf700 1 Processor -- start 2023-07-21T22:10:19.993 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.950+0000 7f1a66fbf700 1 -- start start 2023-07-21T22:10:19.994 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.954+0000 7f1a66fbf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58037740 0x7f1a58037b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:19.994 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.954+0000 7f1a66fbf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1a58050310 0x7f1a58050790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:19.998 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.954+0000 7f1a5ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58037740 0x7f1a58037b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:19.998 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.954+0000 7f1a64d5b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f1a580de2e0 0x7f1a58008230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:42176/0 (socket says 172.21.15.49:42176) 2023-07-21T22:10:19.998 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.954+0000 7f1a64d5b700 1 -- 172.21.15.49:0/1941153268 learned_addr learned my addr 172.21.15.49:0/1941153268 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:19.998 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.954+0000 7f1a66fbf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a580380d0 con 0x7f1a580de2e0 2023-07-21T22:10:19.999 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a66fbf700 1 -- 172.21.15.49:0/1941153268 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a580e0c00 con 0x7f1a58050310 2023-07-21T22:10:19.999 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a66fbf700 1 -- 172.21.15.49:0/1941153268 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a580e0ee0 con 0x7f1a58037740 2023-07-21T22:10:19.999 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a6555c700 1 --2- 172.21.15.49:0/1941153268 >> v2:172.21.15.150:3300/0 conn(0x7f1a58050310 0x7f1a58050790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:19.999 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a5f7fe700 1 -- 172.21.15.49:0/1941153268 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349957967 0 0) 0x7f1a54001110 con 0x7f1a580de2e0 2023-07-21T22:10:19.999 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a5f7fe700 1 -- 172.21.15.49:0/1941153268 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a500035d0 con 0x7f1a580de2e0 2023-07-21T22:10:20.000 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a6555c700 1 -- 172.21.15.49:0/1941153268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58037740 msgr2=0x7f1a58037b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:20.000 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a6555c700 1 --2- 172.21.15.49:0/1941153268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58037740 0x7f1a58037b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:20.000 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a6555c700 1 -- 172.21.15.49:0/1941153268 >> v1:172.21.15.150:6789/0 conn(0x7f1a580de2e0 legacy=0x7f1a58008230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:20.001 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a6555c700 1 -- 172.21.15.49:0/1941153268 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a580e11c0 con 0x7f1a58050310 2023-07-21T22:10:20.001 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a6555c700 1 --2- 172.21.15.49:0/1941153268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a58050310 0x7f1a58050790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1a6002c910 tx=0x7f1a6004e2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89fa536ffb10c773 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:20.001 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a5f7fe700 1 -- 172.21.15.49:0/1941153268 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a600737b0 con 0x7f1a58050310 2023-07-21T22:10:20.001 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a5f7fe700 1 -- 172.21.15.49:0/1941153268 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a60073910 con 0x7f1a58050310 2023-07-21T22:10:20.001 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a5f7fe700 1 -- 172.21.15.49:0/1941153268 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6006aa80 con 0x7f1a58050310 2023-07-21T22:10:20.002 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a66fbf700 1 -- 172.21.15.49:0/1941153268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a58050310 msgr2=0x7f1a58050790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:20.002 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a66fbf700 1 --2- 172.21.15.49:0/1941153268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a58050310 0x7f1a58050790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1a6002c910 tx=0x7f1a6004e2a0 comp rx=0 tx=0).stop 2023-07-21T22:10:20.002 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a66fbf700 1 -- 172.21.15.49:0/1941153268 shutdown_connections 2023-07-21T22:10:20.002 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a66fbf700 1 --2- 172.21.15.49:0/1941153268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58037740 0x7f1a58037b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:20.002 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a66fbf700 1 --2- 172.21.15.49:0/1941153268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a58050310 0x7f1a58050790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:20.003 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.958+0000 7f1a66fbf700 1 -- 172.21.15.49:0/1941153268 >> 172.21.15.49:0/1941153268 conn(0x7f1a58052740 msgr2=0x7f1a58052b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:20.003 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.962+0000 7f1a66fbf700 1 -- 172.21.15.49:0/1941153268 shutdown_connections 2023-07-21T22:10:20.003 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.962+0000 7f1a66fbf700 1 -- 172.21.15.49:0/1941153268 wait complete. 2023-07-21T22:10:20.005 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.962+0000 7f1a66fbf700 1 Processor -- start 2023-07-21T22:10:20.005 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.962+0000 7f1a66fbf700 1 -- start start 2023-07-21T22:10:20.007 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a66fbf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a58037740 0x7f1a580ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:20.008 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a66fbf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58050310 0x7f1a580e2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:20.008 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a64d5b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a58037740 0x7f1a580ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:20.008 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a64d5b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a58037740 0x7f1a580ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34936/0 (socket says 172.21.15.49:34936) 2023-07-21T22:10:20.008 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a66fbf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a580de2e0 0x7f1a580e30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:20.009 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a64d5b700 1 -- 172.21.15.49:0/2117141942 learned_addr learned my addr 172.21.15.49:0/2117141942 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:20.009 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a66fbf700 1 -- 172.21.15.49:0/2117141942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5804b670 con 0x7f1a58037740 2023-07-21T22:10:20.009 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a66fbf700 1 -- 172.21.15.49:0/2117141942 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5803bc90 con 0x7f1a580de2e0 2023-07-21T22:10:20.009 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a66fbf700 1 -- 172.21.15.49:0/2117141942 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a580cf210 con 0x7f1a58050310 2023-07-21T22:10:20.010 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a5ffff700 1 --2- 172.21.15.49:0/2117141942 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58050310 0x7f1a580e2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:20.010 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a6555c700 1 --2- 172.21.15.49:0/2117141942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a580de2e0 0x7f1a580e30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:20.010 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a64d5b700 1 -- 172.21.15.49:0/2117141942 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58050310 msgr2=0x7f1a580e2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:20.010 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a64d5b700 1 --2- 172.21.15.49:0/2117141942 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58050310 0x7f1a580e2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:20.010 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a64d5b700 1 -- 172.21.15.49:0/2117141942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a580de2e0 msgr2=0x7f1a580e30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:20.011 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a64d5b700 1 --2- 172.21.15.49:0/2117141942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a580de2e0 0x7f1a580e30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:20.011 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a64d5b700 1 -- 172.21.15.49:0/2117141942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60073590 con 0x7f1a58037740 2023-07-21T22:10:20.011 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.966+0000 7f1a64d5b700 1 --2- 172.21.15.49:0/2117141942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a58037740 0x7f1a580ccc30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a54001270 tx=0x7f1a5400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:20.011 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.970+0000 7f1a5d7fa700 1 -- 172.21.15.49:0/2117141942 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54005d90 con 0x7f1a58037740 2023-07-21T22:10:20.011 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.970+0000 7f1a5d7fa700 1 -- 172.21.15.49:0/2117141942 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a540070d0 con 0x7f1a58037740 2023-07-21T22:10:20.011 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.970+0000 7f1a5d7fa700 1 -- 172.21.15.49:0/2117141942 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54007460 con 0x7f1a58037740 2023-07-21T22:10:20.014 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.974+0000 7f1a66fbf700 1 -- 172.21.15.49:0/2117141942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a580cf4f0 con 0x7f1a58037740 2023-07-21T22:10:20.015 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.974+0000 7f1a66fbf700 1 -- 172.21.15.49:0/2117141942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a580cfab0 con 0x7f1a58037740 2023-07-21T22:10:20.016 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.974+0000 7f1a66fbf700 1 -- 172.21.15.49:0/2117141942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5804b7b0 con 0x7f1a58037740 2023-07-21T22:10:20.018 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.978+0000 7f1a5d7fa700 1 -- 172.21.15.49:0/2117141942 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f1a540075c0 con 0x7f1a58037740 2023-07-21T22:10:20.020 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.978+0000 7f1a5d7fa700 1 --2- 172.21.15.49:0/2117141942 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1a440662b0 0x7f1a44068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:20.021 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.978+0000 7f1a5ffff700 1 --2- 172.21.15.49:0/2117141942 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1a440662b0 0x7f1a44068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:20.022 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.982+0000 7f1a5ffff700 1 --2- 172.21.15.49:0/2117141942 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1a440662b0 0x7f1a44068760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1a58055680 tx=0x7f1a4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:20.026 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.986+0000 7f1a5d7fa700 1 -- 172.21.15.49:0/2117141942 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f1a54057f00 con 0x7f1a58037740 2023-07-21T22:10:20.033 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:19.990+0000 7f1a5d7fa700 1 -- 172.21.15.49:0/2117141942 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a5804b7b0 con 0x7f1a58037740 2023-07-21T22:10:20.111 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-07-21T22:10:20.070+0000 7f1fdd5dd700 -1 osd.2 0 waiting for initial osdmap 2023-07-21T22:10:20.120 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-07-21T22:10:20.078+0000 7f1fd4ff0700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:10:20.126 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-07-21T22:10:20.082+0000 7fa133457700 -1 osd.0 0 waiting for initial osdmap 2023-07-21T22:10:20.135 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-07-21T22:10:20.094+0000 7fa12adf0700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:10:20.159 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-07-21T22:10:20.118+0000 7f69647ee700 -1 osd.3 0 waiting for initial osdmap 2023-07-21T22:10:20.171 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-07-21T22:10:20.130+0000 7f695c1f0700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:10:20.238 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:20.198+0000 7f1a66fbf700 1 -- 172.21.15.49:0/2117141942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a580380d0 con 0x7f1a58037740 2023-07-21T22:10:20.239 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:20.198+0000 7f1a5d7fa700 1 -- 172.21.15.49:0/2117141942 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7554 (secure 0 0 0) 0x7f1a580380d0 con 0x7f1a58037740 2023-07-21T22:10:20.240 INFO:teuthology.misc.health.smithi049.stdout: 2023-07-21T22:10:20.240 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":14,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:19.370629+0000","last_up_change":"2023-07-21T22:10:19.370629+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:10:20.242 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:20.198+0000 7f1a66fbf700 1 -- 172.21.15.49:0/2117141942 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1a440662b0 msgr2=0x7f1a44068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:20.242 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:20.198+0000 7f1a66fbf700 1 --2- 172.21.15.49:0/2117141942 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1a440662b0 0x7f1a44068760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1a58055680 tx=0x7f1a4c008040 comp rx=0 tx=0).stop 2023-07-21T22:10:20.242 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:20.202+0000 7f1a66fbf700 1 -- 172.21.15.49:0/2117141942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a58037740 msgr2=0x7f1a580ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:20.242 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:20.202+0000 7f1a66fbf700 1 --2- 172.21.15.49:0/2117141942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a58037740 0x7f1a580ccc30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a54001270 tx=0x7f1a5400c9e0 comp rx=0 tx=0).stop 2023-07-21T22:10:20.243 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:20.202+0000 7f1a66fbf700 1 -- 172.21.15.49:0/2117141942 shutdown_connections 2023-07-21T22:10:20.243 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:20.202+0000 7f1a66fbf700 1 --2- 172.21.15.49:0/2117141942 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1a440662b0 0x7f1a44068760 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:20.243 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:20.202+0000 7f1a66fbf700 1 --2- 172.21.15.49:0/2117141942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a580de2e0 0x7f1a580e30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:20.243 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:20.202+0000 7f1a66fbf700 1 --2- 172.21.15.49:0/2117141942 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58050310 0x7f1a580e2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:20.244 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:20.202+0000 7f1a66fbf700 1 --2- 172.21.15.49:0/2117141942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a58037740 0x7f1a580ccc30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:20.244 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:20.202+0000 7f1a66fbf700 1 -- 172.21.15.49:0/2117141942 >> 172.21.15.49:0/2117141942 conn(0x7f1a58052740 msgr2=0x7f1a58035680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:20.244 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:20.202+0000 7f1a66fbf700 1 -- 172.21.15.49:0/2117141942 shutdown_connections 2023-07-21T22:10:20.244 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:20.202+0000 7f1a66fbf700 1 -- 172.21.15.49:0/2117141942 wait complete. 2023-07-21T22:10:20.260 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-07-21T22:10:27.066 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-21T22:10:27.247 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.206+0000 7f76c4816700 1 Processor -- start 2023-07-21T22:10:27.247 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.206+0000 7f76c4816700 1 -- start start 2023-07-21T22:10:27.248 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.206+0000 7f76c4816700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76c015bfa0 0x7f76c00d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:27.249 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.206+0000 7f76c4816700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f76c00cca90 0x7f76c00ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:27.249 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.206+0000 7f76c4816700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c015c370 con 0x7f76c00ceec0 2023-07-21T22:10:27.249 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.206+0000 7f76c4816700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c00cd450 con 0x7f76c015bfa0 2023-07-21T22:10:27.249 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.206+0000 7f76c4816700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c00d0350 con 0x7f76c00cca90 2023-07-21T22:10:27.250 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.206+0000 7f76bf7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76c015bfa0 0x7f76c00d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:27.250 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.206+0000 7f76beffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f76c00cca90 0x7f76c00ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:27.250 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.206+0000 7f76bf7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76c015bfa0 0x7f76c00d13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34094/0 (socket says 172.21.15.49:34094) 2023-07-21T22:10:27.250 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.206+0000 7f76bf7fe700 1 -- 172.21.15.49:0/2679046668 learned_addr learned my addr 172.21.15.49:0/2679046668 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:27.251 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76beffd700 1 -- 172.21.15.49:0/2679046668 >> v2:172.21.15.49:3300/0 conn(0x7f76c015bfa0 msgr2=0x7f76c00d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:27.251 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76beffd700 1 --2- 172.21.15.49:0/2679046668 >> v2:172.21.15.49:3300/0 conn(0x7f76c015bfa0 0x7f76c00d13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.251 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76beffd700 1 -- 172.21.15.49:0/2679046668 >> v1:172.21.15.150:6789/0 conn(0x7f76c00ceec0 legacy=0x7f76c00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:27.251 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76beffd700 1 -- 172.21.15.49:0/2679046668 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c00d05f0 con 0x7f76c00cca90 2023-07-21T22:10:27.252 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76bf7fe700 1 --2- 172.21.15.49:0/2679046668 >> v2:172.21.15.49:3300/0 conn(0x7f76c015bfa0 0x7f76c00d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:27.252 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76beffd700 1 --2- 172.21.15.49:0/2679046668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76c00cca90 0x7f76c00ccf10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f76c00d34b0 tx=0x7f76b4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48e704ffca5781bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:27.252 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76be7fc700 1 -- 172.21.15.49:0/2679046668 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4011830 con 0x7f76c00cca90 2023-07-21T22:10:27.252 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76be7fc700 1 -- 172.21.15.49:0/2679046668 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b4011990 con 0x7f76c00cca90 2023-07-21T22:10:27.253 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76be7fc700 1 -- 172.21.15.49:0/2679046668 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4011d20 con 0x7f76c00cca90 2023-07-21T22:10:27.253 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76c4816700 1 -- 172.21.15.49:0/2679046668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76c00cca90 msgr2=0x7f76c00ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:27.253 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76c4816700 1 --2- 172.21.15.49:0/2679046668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76c00cca90 0x7f76c00ccf10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f76c00d34b0 tx=0x7f76b4009b30 comp rx=0 tx=0).stop 2023-07-21T22:10:27.254 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76c4816700 1 -- 172.21.15.49:0/2679046668 shutdown_connections 2023-07-21T22:10:27.254 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76c4816700 1 --2- 172.21.15.49:0/2679046668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76c00cca90 0x7f76c00ccf10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.254 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76c4816700 1 --2- 172.21.15.49:0/2679046668 >> v2:172.21.15.49:3300/0 conn(0x7f76c015bfa0 0x7f76c00d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.254 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76c4816700 1 -- 172.21.15.49:0/2679046668 >> 172.21.15.49:0/2679046668 conn(0x7f76c0071cc0 msgr2=0x7f76c006a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:27.254 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76c4816700 1 -- 172.21.15.49:0/2679046668 shutdown_connections 2023-07-21T22:10:27.254 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.210+0000 7f76c4816700 1 -- 172.21.15.49:0/2679046668 wait complete. 2023-07-21T22:10:27.256 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.214+0000 7f76c4816700 1 Processor -- start 2023-07-21T22:10:27.257 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.214+0000 7f76c4816700 1 -- start start 2023-07-21T22:10:27.259 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76c4816700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76c00cca90 0x7f76c0152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:27.259 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76c4816700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76c00ceec0 0x7f76c014b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:27.259 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76c4816700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76c015bfa0 0x7f76c00b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:27.259 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76c4816700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c015ea70 con 0x7f76c00ceec0 2023-07-21T22:10:27.259 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76c4816700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c015de60 con 0x7f76c00cca90 2023-07-21T22:10:27.260 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76c4816700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c015e140 con 0x7f76c015bfa0 2023-07-21T22:10:27.260 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76beffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76c00ceec0 0x7f76c014b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:27.261 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76beffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76c00ceec0 0x7f76c014b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34100/0 (socket says 172.21.15.49:34100) 2023-07-21T22:10:27.261 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76beffd700 1 -- 172.21.15.49:0/3564790774 learned_addr learned my addr 172.21.15.49:0/3564790774 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:27.261 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76bf7fe700 1 --2- 172.21.15.49:0/3564790774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76c00cca90 0x7f76c0152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:27.261 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76bffff700 1 --2- 172.21.15.49:0/3564790774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76c015bfa0 0x7f76c00b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:27.261 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76beffd700 1 -- 172.21.15.49:0/3564790774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76c015bfa0 msgr2=0x7f76c00b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:27.261 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76beffd700 1 --2- 172.21.15.49:0/3564790774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76c015bfa0 0x7f76c00b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.261 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76beffd700 1 -- 172.21.15.49:0/3564790774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76c00cca90 msgr2=0x7f76c0152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:27.261 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76beffd700 1 --2- 172.21.15.49:0/3564790774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76c00cca90 0x7f76c0152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.262 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76beffd700 1 -- 172.21.15.49:0/3564790774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b0009570 con 0x7f76c00ceec0 2023-07-21T22:10:27.262 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76beffd700 1 --2- 172.21.15.49:0/3564790774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76c00ceec0 0x7f76c014b7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f76b4014040 tx=0x7f76b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:27.263 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76a7fff700 1 -- 172.21.15.49:0/3564790774 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4004610 con 0x7f76c00ceec0 2023-07-21T22:10:27.263 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76a7fff700 1 -- 172.21.15.49:0/3564790774 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b401e070 con 0x7f76c00ceec0 2023-07-21T22:10:27.263 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76a7fff700 1 -- 172.21.15.49:0/3564790774 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4003900 con 0x7f76c00ceec0 2023-07-21T22:10:27.263 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76c4816700 1 -- 172.21.15.49:0/3564790774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b40094b0 con 0x7f76c00ceec0 2023-07-21T22:10:27.263 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.218+0000 7f76c4816700 1 -- 172.21.15.49:0/3564790774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c015e700 con 0x7f76c00ceec0 2023-07-21T22:10:27.263 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.222+0000 7f76c4816700 1 -- 172.21.15.49:0/3564790774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c004e500 con 0x7f76c00ceec0 2023-07-21T22:10:27.264 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.222+0000 7f76a7fff700 1 -- 172.21.15.49:0/3564790774 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76b4003a60 con 0x7f76c00ceec0 2023-07-21T22:10:27.266 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.226+0000 7f76a7fff700 1 --2- 172.21.15.49:0/3564790774 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f76ac0662f0 0x7f76ac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:27.266 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.226+0000 7f76a7fff700 1 -- 172.21.15.49:0/3564790774 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f76b4084650 con 0x7f76c00ceec0 2023-07-21T22:10:27.267 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.226+0000 7f76bf7fe700 1 --2- 172.21.15.49:0/3564790774 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f76ac0662f0 0x7f76ac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:27.267 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.226+0000 7f76bf7fe700 1 --2- 172.21.15.49:0/3564790774 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f76ac0662f0 0x7f76ac0687a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f76b0006d50 tx=0x7f76b00092e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:27.272 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.230+0000 7f76a7fff700 1 -- 172.21.15.49:0/3564790774 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76b4051f70 con 0x7f76c00ceec0 2023-07-21T22:10:27.443 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.402+0000 7f76c4816700 1 -- 172.21.15.49:0/3564790774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76c015aed0 con 0x7f76c00ceec0 2023-07-21T22:10:27.444 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.402+0000 7f76a7fff700 1 -- 172.21.15.49:0/3564790774 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12814 (secure 0 0 0) 0x7f76b4055590 con 0x7f76c00ceec0 2023-07-21T22:10:27.445 INFO:teuthology.misc.health.smithi049.stdout: 2023-07-21T22:10:27.445 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":19,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:24.952487+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:10:27.447 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.406+0000 7f76c4816700 1 -- 172.21.15.49:0/3564790774 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f76ac0662f0 msgr2=0x7f76ac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:27.447 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.406+0000 7f76c4816700 1 --2- 172.21.15.49:0/3564790774 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f76ac0662f0 0x7f76ac0687a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f76b0006d50 tx=0x7f76b00092e0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.447 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.406+0000 7f76c4816700 1 -- 172.21.15.49:0/3564790774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76c00ceec0 msgr2=0x7f76c014b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:27.447 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.406+0000 7f76c4816700 1 --2- 172.21.15.49:0/3564790774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76c00ceec0 0x7f76c014b7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f76b4014040 tx=0x7f76b4004770 comp rx=0 tx=0).stop 2023-07-21T22:10:27.448 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.406+0000 7f76c4816700 1 -- 172.21.15.49:0/3564790774 shutdown_connections 2023-07-21T22:10:27.448 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.406+0000 7f76c4816700 1 --2- 172.21.15.49:0/3564790774 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f76ac0662f0 0x7f76ac0687a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.448 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.406+0000 7f76c4816700 1 --2- 172.21.15.49:0/3564790774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76c00ceec0 0x7f76c014b7c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.449 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.406+0000 7f76c4816700 1 --2- 172.21.15.49:0/3564790774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76c015bfa0 0x7f76c00b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.449 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.406+0000 7f76c4816700 1 --2- 172.21.15.49:0/3564790774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76c00cca90 0x7f76c0152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.449 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.406+0000 7f76c4816700 1 -- 172.21.15.49:0/3564790774 >> 172.21.15.49:0/3564790774 conn(0x7f76c0071cc0 msgr2=0x7f76c00cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:27.449 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.406+0000 7f76c4816700 1 -- 172.21.15.49:0/3564790774 shutdown_connections 2023-07-21T22:10:27.449 INFO:teuthology.misc.health.smithi049.stderr:2023-07-21T22:10:27.406+0000 7f76c4816700 1 -- 172.21.15.49:0/3564790774 wait complete. 2023-07-21T22:10:27.468 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-21T22:10:27.468 INFO:tasks.ceph:Creating RBD pool 2023-07-21T22:10:27.469 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-21T22:10:27.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99ed3ae700 1 Processor -- start 2023-07-21T22:10:27.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99ed3ae700 1 -- start start 2023-07-21T22:10:27.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99ed3ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99e8159be0 0x7f99e80c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:27.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99ed3ae700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f99e80ca550 0x7f99e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:27.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99ed3ae700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f99e806d6d0 0x7f99e80698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:27.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99ed3ae700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e80c8b80 con 0x7f99e80ca550 2023-07-21T22:10:27.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99ed3ae700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e806db90 con 0x7f99e806d6d0 2023-07-21T22:10:27.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99ed3ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e806de70 con 0x7f99e8159be0 2023-07-21T22:10:27.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99dffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f99e80ca550 0x7f99e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:27.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99dffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f99e80ca550 0x7f99e806d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34110/0 (socket says 172.21.15.49:34110) 2023-07-21T22:10:27.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99dffff700 1 -- 172.21.15.49:0/1023263651 learned_addr learned my addr 172.21.15.49:0/1023263651 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:27.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99e6ffd700 1 --2- 172.21.15.49:0/1023263651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99e8159be0 0x7f99e80c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:27.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99e77fe700 1 --2- 172.21.15.49:0/1023263651 >> v2:172.21.15.150:3300/0 conn(0x7f99e806d6d0 0x7f99e80698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:27.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99e6ffd700 1 -- 172.21.15.49:0/1023263651 >> v2:172.21.15.150:3300/0 conn(0x7f99e806d6d0 msgr2=0x7f99e80698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:27.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99e6ffd700 1 --2- 172.21.15.49:0/1023263651 >> v2:172.21.15.150:3300/0 conn(0x7f99e806d6d0 0x7f99e80698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99e6ffd700 1 -- 172.21.15.49:0/1023263651 >> v2:172.21.15.49:3300/0 conn(0x7f99e80ca550 msgr2=0x7f99e806d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:27.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99e6ffd700 1 --2- 172.21.15.49:0/1023263651 >> v2:172.21.15.49:3300/0 conn(0x7f99e80ca550 0x7f99e806d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.598+0000 7f99e6ffd700 1 -- 172.21.15.49:0/1023263651 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e80c8810 con 0x7f99e8159be0 2023-07-21T22:10:27.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.602+0000 7f99e6ffd700 1 --2- 172.21.15.49:0/1023263651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99e8159be0 0x7f99e80c9010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f99e80ca9c0 tx=0x7f99d8009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8db0302c1dcd6cc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:27.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.602+0000 7f99e67fc700 1 -- 172.21.15.49:0/1023263651 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8011830 con 0x7f99e8159be0 2023-07-21T22:10:27.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.602+0000 7f99e67fc700 1 -- 172.21.15.49:0/1023263651 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d8011990 con 0x7f99e8159be0 2023-07-21T22:10:27.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.602+0000 7f99e67fc700 1 -- 172.21.15.49:0/1023263651 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8011d20 con 0x7f99e8159be0 2023-07-21T22:10:27.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.602+0000 7f99ed3ae700 1 -- 172.21.15.49:0/1023263651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99e8159be0 msgr2=0x7f99e80c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:27.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.602+0000 7f99ed3ae700 1 --2- 172.21.15.49:0/1023263651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99e8159be0 0x7f99e80c9010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f99e80ca9c0 tx=0x7f99d8009b30 comp rx=0 tx=0).stop 2023-07-21T22:10:27.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.602+0000 7f99ed3ae700 1 -- 172.21.15.49:0/1023263651 shutdown_connections 2023-07-21T22:10:27.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.602+0000 7f99ed3ae700 1 --2- 172.21.15.49:0/1023263651 >> v2:172.21.15.150:3300/0 conn(0x7f99e806d6d0 0x7f99e80698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.602+0000 7f99ed3ae700 1 --2- 172.21.15.49:0/1023263651 >> v2:172.21.15.49:3300/0 conn(0x7f99e80ca550 0x7f99e806d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.602+0000 7f99ed3ae700 1 --2- 172.21.15.49:0/1023263651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99e8159be0 0x7f99e80c9010 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.602+0000 7f99ed3ae700 1 -- 172.21.15.49:0/1023263651 >> 172.21.15.49:0/1023263651 conn(0x7f99e80ce0d0 msgr2=0x7f99e80ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:27.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.602+0000 7f99ed3ae700 1 -- 172.21.15.49:0/1023263651 shutdown_connections 2023-07-21T22:10:27.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.602+0000 7f99ed3ae700 1 -- 172.21.15.49:0/1023263651 wait complete. 2023-07-21T22:10:27.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99ed3ae700 1 Processor -- start 2023-07-21T22:10:27.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99ed3ae700 1 -- start start 2023-07-21T22:10:27.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99ed3ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99e806d6d0 0x7f99e814a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:27.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99ed3ae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99e80ca550 0x7f99e80ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:27.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99ed3ae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99e8159be0 0x7f99e81f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:27.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99ed3ae700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80b0f40 con 0x7f99e80ca550 2023-07-21T22:10:27.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99ed3ae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e814aa70 con 0x7f99e8159be0 2023-07-21T22:10:27.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99ed3ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80acbe0 con 0x7f99e806d6d0 2023-07-21T22:10:27.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99dffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99e80ca550 0x7f99e80ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:27.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99e77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99e8159be0 0x7f99e81f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99e6ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99e806d6d0 0x7f99e814a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99e77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99e8159be0 0x7f99e81f4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:53206/0 (socket says 172.21.15.49:53206) 2023-07-21T22:10:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99e77fe700 1 -- 172.21.15.49:0/3550734603 learned_addr learned my addr 172.21.15.49:0/3550734603 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99e77fe700 1 -- 172.21.15.49:0/3550734603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99e806d6d0 msgr2=0x7f99e814a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99e77fe700 1 --2- 172.21.15.49:0/3550734603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99e806d6d0 0x7f99e814a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99e77fe700 1 -- 172.21.15.49:0/3550734603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99e80ca550 msgr2=0x7f99e80ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99e77fe700 1 --2- 172.21.15.49:0/3550734603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99e80ca550 0x7f99e80ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99e77fe700 1 -- 172.21.15.49:0/3550734603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d80094b0 con 0x7f99e8159be0 2023-07-21T22:10:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.606+0000 7f99dffff700 1 --2- 172.21.15.49:0/3550734603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99e80ca550 0x7f99e80ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.610+0000 7f99e77fe700 1 --2- 172.21.15.49:0/3550734603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99e8159be0 0x7f99e81f4700 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f99e000ef90 tx=0x7f99e000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.610+0000 7f99df7fe700 1 -- 172.21.15.49:0/3550734603 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e000cc90 con 0x7f99e8159be0 2023-07-21T22:10:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.610+0000 7f99df7fe700 1 -- 172.21.15.49:0/3550734603 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e000f040 con 0x7f99e8159be0 2023-07-21T22:10:27.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.610+0000 7f99df7fe700 1 -- 172.21.15.49:0/3550734603 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0014480 con 0x7f99e8159be0 2023-07-21T22:10:27.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.610+0000 7f99ed3ae700 1 -- 172.21.15.49:0/3550734603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e80acec0 con 0x7f99e8159be0 2023-07-21T22:10:27.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.610+0000 7f99ed3ae700 1 -- 172.21.15.49:0/3550734603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e80cc4b0 con 0x7f99e8159be0 2023-07-21T22:10:27.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.610+0000 7f99ed3ae700 1 -- 172.21.15.49:0/3550734603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e80cc6d0 con 0x7f99e8159be0 2023-07-21T22:10:27.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.614+0000 7f99df7fe700 1 -- 172.21.15.49:0/3550734603 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99e00145e0 con 0x7f99e8159be0 2023-07-21T22:10:27.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.614+0000 7f99df7fe700 1 --2- 172.21.15.49:0/3550734603 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f99c8066340 0x7f99c80687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:27.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.614+0000 7f99df7fe700 1 -- 172.21.15.49:0/3550734603 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f99e0085170 con 0x7f99e8159be0 2023-07-21T22:10:27.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.614+0000 7f99e6ffd700 1 --2- 172.21.15.49:0/3550734603 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f99c8066340 0x7f99c80687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:27.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.618+0000 7f99e6ffd700 1 --2- 172.21.15.49:0/3550734603 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f99c8066340 0x7f99c80687f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f99d8000c00 tx=0x7f99d801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.622+0000 7f99df7fe700 1 -- 172.21.15.49:0/3550734603 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99e0052a80 con 0x7f99e8159be0 2023-07-21T22:10:27.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:27.794+0000 7f99ed3ae700 1 -- 172.21.15.49:0/3550734603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f99e804dcb0 con 0x7f99e8159be0 2023-07-21T22:10:28.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.094+0000 7f99df7fe700 1 -- 172.21.15.49:0/3550734603 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v20) v1 ==== 109+0+0 (secure 0 0 0) 0x7f99e0009ca0 con 0x7f99e8159be0 2023-07-21T22:10:28.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.098+0000 7f99ed3ae700 1 -- 172.21.15.49:0/3550734603 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f99c8066340 msgr2=0x7f99c80687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:28.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.098+0000 7f99ed3ae700 1 --2- 172.21.15.49:0/3550734603 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f99c8066340 0x7f99c80687f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f99d8000c00 tx=0x7f99d801c040 comp rx=0 tx=0).stop 2023-07-21T22:10:28.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.098+0000 7f99ed3ae700 1 -- 172.21.15.49:0/3550734603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99e8159be0 msgr2=0x7f99e81f4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:28.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.098+0000 7f99ed3ae700 1 --2- 172.21.15.49:0/3550734603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99e8159be0 0x7f99e81f4700 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f99e000ef90 tx=0x7f99e000c3a0 comp rx=0 tx=0).stop 2023-07-21T22:10:28.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.098+0000 7f99ed3ae700 1 -- 172.21.15.49:0/3550734603 shutdown_connections 2023-07-21T22:10:28.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.098+0000 7f99ed3ae700 1 --2- 172.21.15.49:0/3550734603 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f99c8066340 0x7f99c80687f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:28.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.098+0000 7f99ed3ae700 1 --2- 172.21.15.49:0/3550734603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99e80ca550 0x7f99e80ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:28.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.098+0000 7f99ed3ae700 1 --2- 172.21.15.49:0/3550734603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99e8159be0 0x7f99e81f4700 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:28.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.098+0000 7f99ed3ae700 1 --2- 172.21.15.49:0/3550734603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99e806d6d0 0x7f99e814a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:28.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.098+0000 7f99ed3ae700 1 -- 172.21.15.49:0/3550734603 >> 172.21.15.49:0/3550734603 conn(0x7f99e80ce0d0 msgr2=0x7f99e8153e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:28.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.102+0000 7f99ed3ae700 1 -- 172.21.15.49:0/3550734603 shutdown_connections 2023-07-21T22:10:28.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.102+0000 7f99ed3ae700 1 -- 172.21.15.49:0/3550734603 wait complete. 2023-07-21T22:10:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'rbd' created 2023-07-21T22:10:28.164 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-21T22:10:28.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.298+0000 7f31aed46700 1 Processor -- start 2023-07-21T22:10:28.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.298+0000 7f31aed46700 1 -- start start 2023-07-21T22:10:28.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31aed46700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31a80afce0 0x7f31a806dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:28.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31aed46700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31a80c89b0 0x7f31a80b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:28.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31aed46700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f31a806d290 0x7f31a80cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:28.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31aed46700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a806e1c0 con 0x7f31a806d290 2023-07-21T22:10:28.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31aed46700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a806ce00 con 0x7f31a80afce0 2023-07-21T22:10:28.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31aed46700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80b05f0 con 0x7f31a80c89b0 2023-07-21T22:10:28.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31acae2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31a80afce0 0x7f31a806dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:28.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31ad2e3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f31a806d290 0x7f31a80cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:28.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31a7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31a80c89b0 0x7f31a80b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:28.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31acae2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31a80afce0 0x7f31a806dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:53214/0 (socket says 172.21.15.49:53214) 2023-07-21T22:10:28.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31acae2700 1 -- 172.21.15.49:0/2437938425 learned_addr learned my addr 172.21.15.49:0/2437938425 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31a7fff700 1 -- 172.21.15.49:0/2437938425 >> v2:172.21.15.150:3300/0 conn(0x7f31a80afce0 msgr2=0x7f31a806dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31a7fff700 1 --2- 172.21.15.49:0/2437938425 >> v2:172.21.15.150:3300/0 conn(0x7f31a80afce0 0x7f31a806dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31a7fff700 1 -- 172.21.15.49:0/2437938425 >> v2:172.21.15.49:3300/0 conn(0x7f31a806d290 msgr2=0x7f31a80cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31a7fff700 1 --2- 172.21.15.49:0/2437938425 >> v2:172.21.15.49:3300/0 conn(0x7f31a806d290 0x7f31a80cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:28.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31a7fff700 1 -- 172.21.15.49:0/2437938425 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a815d610 con 0x7f31a80c89b0 2023-07-21T22:10:28.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31acae2700 1 --2- 172.21.15.49:0/2437938425 >> v2:172.21.15.150:3300/0 conn(0x7f31a80afce0 0x7f31a806dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:28.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31ad2e3700 1 --2- 172.21.15.49:0/2437938425 >> v2:172.21.15.49:3300/0 conn(0x7f31a806d290 0x7f31a80cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:28.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.302+0000 7f31a7fff700 1 --2- 172.21.15.49:0/2437938425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31a80c89b0 0x7f31a80b00b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f31a80cf360 tx=0x7f3194009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8245c6cb5ce7a8d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:28.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.306+0000 7f31a77fe700 1 -- 172.21.15.49:0/2437938425 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194011830 con 0x7f31a80c89b0 2023-07-21T22:10:28.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.306+0000 7f31a77fe700 1 -- 172.21.15.49:0/2437938425 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3194011990 con 0x7f31a80c89b0 2023-07-21T22:10:28.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.306+0000 7f31a77fe700 1 -- 172.21.15.49:0/2437938425 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194011d20 con 0x7f31a80c89b0 2023-07-21T22:10:28.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.306+0000 7f31aed46700 1 -- 172.21.15.49:0/2437938425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31a80c89b0 msgr2=0x7f31a80b00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:28.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.306+0000 7f31aed46700 1 --2- 172.21.15.49:0/2437938425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31a80c89b0 0x7f31a80b00b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f31a80cf360 tx=0x7f3194009b30 comp rx=0 tx=0).stop 2023-07-21T22:10:28.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.306+0000 7f31aed46700 1 -- 172.21.15.49:0/2437938425 shutdown_connections 2023-07-21T22:10:28.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.306+0000 7f31aed46700 1 --2- 172.21.15.49:0/2437938425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31a80c89b0 0x7f31a80b00b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:28.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.306+0000 7f31aed46700 1 --2- 172.21.15.49:0/2437938425 >> v2:172.21.15.49:3300/0 conn(0x7f31a806d290 0x7f31a80cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:28.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.306+0000 7f31aed46700 1 --2- 172.21.15.49:0/2437938425 >> v2:172.21.15.150:3300/0 conn(0x7f31a80afce0 0x7f31a806dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:28.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.306+0000 7f31aed46700 1 -- 172.21.15.49:0/2437938425 >> 172.21.15.49:0/2437938425 conn(0x7f31a80cace0 msgr2=0x7f31a80cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:28.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.306+0000 7f31aed46700 1 -- 172.21.15.49:0/2437938425 shutdown_connections 2023-07-21T22:10:28.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.306+0000 7f31aed46700 1 -- 172.21.15.49:0/2437938425 wait complete. 2023-07-21T22:10:28.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.310+0000 7f31aed46700 1 Processor -- start 2023-07-21T22:10:28.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.310+0000 7f31aed46700 1 -- start start 2023-07-21T22:10:28.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.310+0000 7f31aed46700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31a806d290 0x7f31a8145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:28.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.310+0000 7f31aed46700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a80afce0 0x7f31a80c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:28.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.310+0000 7f31aed46700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31a80c89b0 0x7f31a80c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:28.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.310+0000 7f31aed46700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80c7230 con 0x7f31a806d290 2023-07-21T22:10:28.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.310+0000 7f31aed46700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80c7510 con 0x7f31a80afce0 2023-07-21T22:10:28.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.310+0000 7f31aed46700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80c77f0 con 0x7f31a80c89b0 2023-07-21T22:10:28.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.310+0000 7f31acae2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31a806d290 0x7f31a8145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:28.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31acae2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31a806d290 0x7f31a8145910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34144/0 (socket says 172.21.15.49:34144) 2023-07-21T22:10:28.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31acae2700 1 -- 172.21.15.49:0/3160283068 learned_addr learned my addr 172.21.15.49:0/3160283068 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:28.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31a7fff700 1 --2- 172.21.15.49:0/3160283068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a80afce0 0x7f31a80c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:28.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31ad2e3700 1 --2- 172.21.15.49:0/3160283068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31a80c89b0 0x7f31a80c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31acae2700 1 -- 172.21.15.49:0/3160283068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31a80c89b0 msgr2=0x7f31a80c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31acae2700 1 --2- 172.21.15.49:0/3160283068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31a80c89b0 0x7f31a80c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31acae2700 1 -- 172.21.15.49:0/3160283068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a80afce0 msgr2=0x7f31a80c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31acae2700 1 --2- 172.21.15.49:0/3160283068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a80afce0 0x7f31a80c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31acae2700 1 -- 172.21.15.49:0/3160283068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a0009a70 con 0x7f31a806d290 2023-07-21T22:10:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31acae2700 1 --2- 172.21.15.49:0/3160283068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31a806d290 0x7f31a8145910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f319c00ebe0 tx=0x7f319c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:28.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31a57fa700 1 -- 172.21.15.49:0/3160283068 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c00c910 con 0x7f31a806d290 2023-07-21T22:10:28.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31a57fa700 1 -- 172.21.15.49:0/3160283068 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c00ca70 con 0x7f31a806d290 2023-07-21T22:10:28.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31aed46700 1 -- 172.21.15.49:0/3160283068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319c009570 con 0x7f31a806d290 2023-07-21T22:10:28.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31a57fa700 1 -- 172.21.15.49:0/3160283068 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c00cde0 con 0x7f31a806d290 2023-07-21T22:10:28.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31aed46700 1 -- 172.21.15.49:0/3160283068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31940094b0 con 0x7f31a806d290 2023-07-21T22:10:28.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.314+0000 7f31aed46700 1 -- 172.21.15.49:0/3160283068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a804dd20 con 0x7f31a806d290 2023-07-21T22:10:28.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.318+0000 7f31a57fa700 1 -- 172.21.15.49:0/3160283068 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f319c013470 con 0x7f31a806d290 2023-07-21T22:10:28.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.318+0000 7f31a57fa700 1 --2- 172.21.15.49:0/3160283068 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f318c0662f0 0x7f318c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:28.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.318+0000 7f31a57fa700 1 -- 172.21.15.49:0/3160283068 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f319c083bb0 con 0x7f31a806d290 2023-07-21T22:10:28.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.318+0000 7f31a7fff700 1 --2- 172.21.15.49:0/3160283068 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f318c0662f0 0x7f318c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:28.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.322+0000 7f31a7fff700 1 --2- 172.21.15.49:0/3160283068 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f318c0662f0 0x7f318c0687a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31940090b0 tx=0x7f3194008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:28.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.326+0000 7f31a57fa700 1 -- 172.21.15.49:0/3160283068 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f319c0512f0 con 0x7f31a806d290 2023-07-21T22:10:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:28.502+0000 7f31aed46700 1 -- 172.21.15.49:0/3160283068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f31a80b0a30 con 0x7f31a806d290 2023-07-21T22:10:29.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.106+0000 7f31a57fa700 1 -- 172.21.15.49:0/3160283068 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v21) v1 ==== 173+0+0 (secure 0 0 0) 0x7f319c054910 con 0x7f31a806d290 2023-07-21T22:10:29.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.110+0000 7f31aed46700 1 -- 172.21.15.49:0/3160283068 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f318c0662f0 msgr2=0x7f318c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:29.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.110+0000 7f31aed46700 1 --2- 172.21.15.49:0/3160283068 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f318c0662f0 0x7f318c0687a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31940090b0 tx=0x7f3194008030 comp rx=0 tx=0).stop 2023-07-21T22:10:29.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.110+0000 7f31aed46700 1 -- 172.21.15.49:0/3160283068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31a806d290 msgr2=0x7f31a8145910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:29.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.110+0000 7f31aed46700 1 --2- 172.21.15.49:0/3160283068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31a806d290 0x7f31a8145910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f319c00ebe0 tx=0x7f319c009e90 comp rx=0 tx=0).stop 2023-07-21T22:10:29.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.110+0000 7f31aed46700 1 -- 172.21.15.49:0/3160283068 shutdown_connections 2023-07-21T22:10:29.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.110+0000 7f31aed46700 1 --2- 172.21.15.49:0/3160283068 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f318c0662f0 0x7f318c0687a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.110+0000 7f31aed46700 1 --2- 172.21.15.49:0/3160283068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31a80c89b0 0x7f31a80c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.110+0000 7f31aed46700 1 --2- 172.21.15.49:0/3160283068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a80afce0 0x7f31a80c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.110+0000 7f31aed46700 1 --2- 172.21.15.49:0/3160283068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31a806d290 0x7f31a8145910 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.110+0000 7f31aed46700 1 -- 172.21.15.49:0/3160283068 >> 172.21.15.49:0/3160283068 conn(0x7f31a80cace0 msgr2=0x7f31a80ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:29.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.110+0000 7f31aed46700 1 -- 172.21.15.49:0/3160283068 shutdown_connections 2023-07-21T22:10:29.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.114+0000 7f31aed46700 1 -- 172.21.15.49:0/3160283068 wait complete. 2023-07-21T22:10:29.156 INFO:teuthology.orchestra.run.smithi049.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-21T22:10:29.176 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-21T22:10:29.177 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T22:10:29.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T22:10:29.184 INFO:tasks.ceph.mds.a:Started 2023-07-21T22:10:29.185 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T22:10:29.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T22:10:29.192 INFO:tasks.ceph.mds.c:Started 2023-07-21T22:10:29.192 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T22:10:29.193 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T22:10:29.200 INFO:tasks.ceph.mds.b:Started 2023-07-21T22:10:29.200 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T22:10:29.201 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T22:10:29.205 INFO:tasks.ceph.mds.d:Started 2023-07-21T22:10:29.206 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-21T22:10:29.206 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:10:29.304 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-07-21T22:10:29.305 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-07-21T22:10:29.320 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-07-21T22:10:29.324 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-07-21T22:10:29.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.334+0000 7ff9b0fd9700 1 Processor -- start 2023-07-21T22:10:29.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.334+0000 7ff9b0fd9700 1 -- start start 2023-07-21T22:10:29.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9b0fd9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9ac15bf30 0x7ff9ac0ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:29.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9b0fd9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff9ac0cbc40 0x7ff9ac0afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:29.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9b0fd9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac0cb270 con 0x7ff9ac0b0030 2023-07-21T22:10:29.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9b0fd9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ac0ac8e0 con 0x7ff9ac0cbc40 2023-07-21T22:10:29.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9b0fd9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac15c300 con 0x7ff9ac15bf30 2023-07-21T22:10:29.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9abfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff9ac0b0030 0x7ff9ac15f9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50522/0 (socket says 172.21.15.49:50522) 2023-07-21T22:10:29.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9abfff700 1 -- 172.21.15.49:0/3342010467 learned_addr learned my addr 172.21.15.49:0/3342010467 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:29.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9a2ffd700 1 --2- 172.21.15.49:0/3342010467 >> v2:172.21.15.49:3300/0 conn(0x7ff9ac0cbc40 0x7ff9ac0afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:29.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9ab7fe700 1 --2- 172.21.15.49:0/3342010467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9ac15bf30 0x7ff9ac0ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:29.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9ab7fe700 1 -- 172.21.15.49:0/3342010467 >> v2:172.21.15.49:3300/0 conn(0x7ff9ac0cbc40 msgr2=0x7ff9ac0afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:29.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9aaffd700 1 -- 172.21.15.49:0/3342010467 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48236367 0 0) 0x7ff9ac0cb270 con 0x7ff9ac0b0030 2023-07-21T22:10:29.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9ab7fe700 1 --2- 172.21.15.49:0/3342010467 >> v2:172.21.15.49:3300/0 conn(0x7ff9ac0cbc40 0x7ff9ac0afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9ab7fe700 1 -- 172.21.15.49:0/3342010467 >> v1:172.21.15.49:6789/0 conn(0x7ff9ac0b0030 legacy=0x7ff9ac15f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:29.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9ab7fe700 1 -- 172.21.15.49:0/3342010467 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0acac0 con 0x7ff9ac15bf30 2023-07-21T22:10:29.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9ab7fe700 1 --2- 172.21.15.49:0/3342010467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9ac15bf30 0x7ff9ac0ad350 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009850 tx=0x7ff99c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4a31aac4dcf13e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:29.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.338+0000 7ff9aaffd700 1 -- 172.21.15.49:0/3342010467 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c011830 con 0x7ff9ac15bf30 2023-07-21T22:10:29.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.342+0000 7ff9aaffd700 1 -- 172.21.15.49:0/3342010467 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c011990 con 0x7ff9ac15bf30 2023-07-21T22:10:29.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.342+0000 7ff9aaffd700 1 -- 172.21.15.49:0/3342010467 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c011d40 con 0x7ff9ac15bf30 2023-07-21T22:10:29.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.342+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3342010467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9ac15bf30 msgr2=0x7ff9ac0ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:29.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.342+0000 7ff9b0fd9700 1 --2- 172.21.15.49:0/3342010467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9ac15bf30 0x7ff9ac0ad350 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009850 tx=0x7ff99c009b60 comp rx=0 tx=0).stop 2023-07-21T22:10:29.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.342+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3342010467 shutdown_connections 2023-07-21T22:10:29.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.342+0000 7ff9b0fd9700 1 --2- 172.21.15.49:0/3342010467 >> v2:172.21.15.49:3300/0 conn(0x7ff9ac0cbc40 0x7ff9ac0afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.342+0000 7ff9b0fd9700 1 --2- 172.21.15.49:0/3342010467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9ac15bf30 0x7ff9ac0ad350 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.342+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3342010467 >> 172.21.15.49:0/3342010467 conn(0x7ff9ac070450 msgr2=0x7ff9ac070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:29.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.342+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3342010467 shutdown_connections 2023-07-21T22:10:29.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.342+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3342010467 wait complete. 2023-07-21T22:10:29.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.346+0000 7ff9b0fd9700 1 Processor -- start 2023-07-21T22:10:29.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.346+0000 7ff9b0fd9700 1 -- start start 2023-07-21T22:10:29.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.346+0000 7ff9b0fd9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9ac0b0030 0x7ff9ac0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:29.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.346+0000 7ff9b0fd9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9ac0cbc40 0x7ff9ac158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:29.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9b0fd9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9ac15bf30 0x7ff9ac15df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:29.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9b0fd9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0c9a10 con 0x7ff9ac0cbc40 2023-07-21T22:10:29.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9b0fd9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac1608e0 con 0x7ff9ac0b0030 2023-07-21T22:10:29.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9b0fd9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac160320 con 0x7ff9ac15bf30 2023-07-21T22:10:29.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9a2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9ac0cbc40 0x7ff9ac158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:29.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9a2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9ac0cbc40 0x7ff9ac158f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34186/0 (socket says 172.21.15.49:34186) 2023-07-21T22:10:29.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9a2ffd700 1 -- 172.21.15.49:0/3499205631 learned_addr learned my addr 172.21.15.49:0/3499205631 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:29.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9abfff700 1 --2- 172.21.15.49:0/3499205631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9ac15bf30 0x7ff9ac15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:29.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9ab7fe700 1 --2- 172.21.15.49:0/3499205631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9ac0b0030 0x7ff9ac0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:29.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9a2ffd700 1 -- 172.21.15.49:0/3499205631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9ac15bf30 msgr2=0x7ff9ac15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:29.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9a2ffd700 1 --2- 172.21.15.49:0/3499205631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9ac15bf30 0x7ff9ac15df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9a2ffd700 1 -- 172.21.15.49:0/3499205631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9ac0b0030 msgr2=0x7ff9ac0c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:29.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9a2ffd700 1 --2- 172.21.15.49:0/3499205631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9ac0b0030 0x7ff9ac0c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9a2ffd700 1 -- 172.21.15.49:0/3499205631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c0094b0 con 0x7ff9ac0cbc40 2023-07-21T22:10:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9a2ffd700 1 --2- 172.21.15.49:0/3499205631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9ac0cbc40 0x7ff9ac158f40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff99400e9d0 tx=0x7ff99400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9a8ff9700 1 -- 172.21.15.49:0/3499205631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994009720 con 0x7ff9ac0cbc40 2023-07-21T22:10:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9a8ff9700 1 -- 172.21.15.49:0/3499205631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99400ee70 con 0x7ff9ac0cbc40 2023-07-21T22:10:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3499205631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac160600 con 0x7ff9ac0cbc40 2023-07-21T22:10:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9a8ff9700 1 -- 172.21.15.49:0/3499205631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99400ca50 con 0x7ff9ac0cbc40 2023-07-21T22:10:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3499205631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac15c850 con 0x7ff9ac0cbc40 2023-07-21T22:10:29.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.350+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3499205631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac04dcb0 con 0x7ff9ac0cbc40 2023-07-21T22:10:29.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.358+0000 7ff9a8ff9700 1 -- 172.21.15.49:0/3499205631 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff99400cbb0 con 0x7ff9ac0cbc40 2023-07-21T22:10:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.358+0000 7ff9a8ff9700 1 --2- 172.21.15.49:0/3499205631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff98c0662f0 0x7ff98c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:29.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.358+0000 7ff9a8ff9700 1 -- 172.21.15.49:0/3499205631 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff994084180 con 0x7ff9ac0cbc40 2023-07-21T22:10:29.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.358+0000 7ff9ab7fe700 1 --2- 172.21.15.49:0/3499205631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff98c0662f0 0x7ff98c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:29.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.362+0000 7ff9ab7fe700 1 --2- 172.21.15.49:0/3499205631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff98c0662f0 0x7ff98c0687a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0090b0 tx=0x7ff99c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:29.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.362+0000 7ff9a8ff9700 1 -- 172.21.15.49:0/3499205631 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff9940553d0 con 0x7ff9ac0cbc40 2023-07-21T22:10:29.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.546+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3499205631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9ac0b0940 con 0x7ff9ac0cbc40 2023-07-21T22:10:29.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.546+0000 7ff9a8ff9700 1 -- 172.21.15.49:0/3499205631 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+14613 (secure 0 0 0) 0x7ff99400ce60 con 0x7ff9ac0cbc40 2023-07-21T22:10:29.590 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:29.590 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":21,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:29.093552+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:10:29.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.550+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3499205631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff98c0662f0 msgr2=0x7ff98c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:29.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.550+0000 7ff9b0fd9700 1 --2- 172.21.15.49:0/3499205631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff98c0662f0 0x7ff98c0687a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0090b0 tx=0x7ff99c008030 comp rx=0 tx=0).stop 2023-07-21T22:10:29.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.550+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3499205631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9ac0cbc40 msgr2=0x7ff9ac158f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:29.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.550+0000 7ff9b0fd9700 1 --2- 172.21.15.49:0/3499205631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9ac0cbc40 0x7ff9ac158f40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff99400e9d0 tx=0x7ff99400ece0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.550+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3499205631 shutdown_connections 2023-07-21T22:10:29.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.550+0000 7ff9b0fd9700 1 --2- 172.21.15.49:0/3499205631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff98c0662f0 0x7ff98c0687a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.550+0000 7ff9b0fd9700 1 --2- 172.21.15.49:0/3499205631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9ac0cbc40 0x7ff9ac158f40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.550+0000 7ff9b0fd9700 1 --2- 172.21.15.49:0/3499205631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9ac15bf30 0x7ff9ac15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.550+0000 7ff9b0fd9700 1 --2- 172.21.15.49:0/3499205631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9ac0b0030 0x7ff9ac0c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.550+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3499205631 >> 172.21.15.49:0/3499205631 conn(0x7ff9ac070450 msgr2=0x7ff9ac0adb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.550+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3499205631 shutdown_connections 2023-07-21T22:10:29.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.550+0000 7ff9b0fd9700 1 -- 172.21.15.49:0/3499205631 wait complete. 2023-07-21T22:10:29.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:10:29.616 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:10:29.768 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:10:29.776 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:10:29.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.750+0000 7f91526f9700 1 Processor -- start 2023-07-21T22:10:29.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.750+0000 7f91526f9700 1 -- start start 2023-07-21T22:10:29.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.754+0000 7f91526f9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f914c0d1e40 0x7f914c0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:29.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.754+0000 7f91526f9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f914c0cee10 0x7f914c0cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:29.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.754+0000 7f91526f9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914c0b3e80 con 0x7f914c0b7af0 2023-07-21T22:10:29.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.754+0000 7f91526f9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c0cf790 con 0x7f914c0d1e40 2023-07-21T22:10:29.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.754+0000 7f91526f9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c15fd40 con 0x7f914c0cee10 2023-07-21T22:10:29.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.754+0000 7f9150ef6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f914c0d1e40 0x7f914c0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:29.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.754+0000 7f9150ef6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f914c0d1e40 0x7f914c0b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34202/0 (socket says 172.21.15.49:34202) 2023-07-21T22:10:29.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.754+0000 7f9150ef6700 1 -- 172.21.15.49:0/1585929243 learned_addr learned my addr 172.21.15.49:0/1585929243 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:29.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.754+0000 7f9151ef8700 1 --2- 172.21.15.49:0/1585929243 >> v2:172.21.15.150:3300/0 conn(0x7f914c0cee10 0x7f914c0cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:29.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.754+0000 7f9150ef6700 1 -- 172.21.15.49:0/1585929243 >> v2:172.21.15.150:3300/0 conn(0x7f914c0cee10 msgr2=0x7f914c0cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:29.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.754+0000 7f9150ef6700 1 --2- 172.21.15.49:0/1585929243 >> v2:172.21.15.150:3300/0 conn(0x7f914c0cee10 0x7f914c0cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.754+0000 7f9150ef6700 1 -- 172.21.15.49:0/1585929243 >> v1:172.21.15.150:6789/0 conn(0x7f914c0b7af0 legacy=0x7f914c15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:29.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.754+0000 7f9150ef6700 1 -- 172.21.15.49:0/1585929243 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c0cea00 con 0x7f914c0d1e40 2023-07-21T22:10:29.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.754+0000 7f9150ef6700 1 --2- 172.21.15.49:0/1585929243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0d1e40 0x7f914c0b1630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f914c0cfed0 tx=0x7f913c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade68d473ef57ba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:29.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.758+0000 7f9143fff700 1 -- 172.21.15.49:0/1585929243 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c004230 con 0x7f914c0d1e40 2023-07-21T22:10:29.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.758+0000 7f9143fff700 1 -- 172.21.15.49:0/1585929243 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c004390 con 0x7f914c0d1e40 2023-07-21T22:10:29.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.758+0000 7f9143fff700 1 -- 172.21.15.49:0/1585929243 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0036c0 con 0x7f914c0d1e40 2023-07-21T22:10:29.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.758+0000 7f91526f9700 1 -- 172.21.15.49:0/1585929243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0d1e40 msgr2=0x7f914c0b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:29.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.758+0000 7f91526f9700 1 --2- 172.21.15.49:0/1585929243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0d1e40 0x7f914c0b1630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f914c0cfed0 tx=0x7f913c009bf0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.758+0000 7f91526f9700 1 -- 172.21.15.49:0/1585929243 shutdown_connections 2023-07-21T22:10:29.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.758+0000 7f91526f9700 1 --2- 172.21.15.49:0/1585929243 >> v2:172.21.15.150:3300/0 conn(0x7f914c0cee10 0x7f914c0cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.758+0000 7f91526f9700 1 --2- 172.21.15.49:0/1585929243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0d1e40 0x7f914c0b1630 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.758+0000 7f91526f9700 1 -- 172.21.15.49:0/1585929243 >> 172.21.15.49:0/1585929243 conn(0x7f914c06e960 msgr2=0x7f914c06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:29.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.758+0000 7f91526f9700 1 -- 172.21.15.49:0/1585929243 shutdown_connections 2023-07-21T22:10:29.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.758+0000 7f91526f9700 1 -- 172.21.15.49:0/1585929243 wait complete. 2023-07-21T22:10:29.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.758+0000 7f91526f9700 1 Processor -- start 2023-07-21T22:10:29.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91526f9700 1 -- start start 2023-07-21T22:10:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91526f9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0b7af0 0x7f914c157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:29.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91526f9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f914c0cee10 0x7f914c0c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:29.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91526f9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f914c0d1e40 0x7f914c1e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:29.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91526f9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0c8e10 con 0x7f914c0b7af0 2023-07-21T22:10:29.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91526f9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0c7d70 con 0x7f914c0cee10 2023-07-21T22:10:29.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91526f9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0c77b0 con 0x7f914c0d1e40 2023-07-21T22:10:29.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91516f7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0b7af0 0x7f914c157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:29.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91516f7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0b7af0 0x7f914c157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34218/0 (socket says 172.21.15.49:34218) 2023-07-21T22:10:29.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91516f7700 1 -- 172.21.15.49:0/218846218 learned_addr learned my addr 172.21.15.49:0/218846218 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:29.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f9151ef8700 1 --2- 172.21.15.49:0/218846218 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f914c0d1e40 0x7f914c1e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:29.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f9150ef6700 1 --2- 172.21.15.49:0/218846218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f914c0cee10 0x7f914c0c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:29.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91516f7700 1 -- 172.21.15.49:0/218846218 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f914c0d1e40 msgr2=0x7f914c1e54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:29.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91516f7700 1 --2- 172.21.15.49:0/218846218 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f914c0d1e40 0x7f914c1e54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91516f7700 1 -- 172.21.15.49:0/218846218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f914c0cee10 msgr2=0x7f914c0c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:29.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91516f7700 1 --2- 172.21.15.49:0/218846218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f914c0cee10 0x7f914c0c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:29.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91516f7700 1 -- 172.21.15.49:0/218846218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c009570 con 0x7f914c0b7af0 2023-07-21T22:10:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91516f7700 1 --2- 172.21.15.49:0/218846218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0b7af0 0x7f914c157070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f914800c4e0 tx=0x7f914800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f9141ffb700 1 -- 172.21.15.49:0/218846218 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148011790 con 0x7f914c0b7af0 2023-07-21T22:10:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f9141ffb700 1 -- 172.21.15.49:0/218846218 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9148011910 con 0x7f914c0b7af0 2023-07-21T22:10:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91526f9700 1 -- 172.21.15.49:0/218846218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c0c7a90 con 0x7f914c0b7af0 2023-07-21T22:10:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f9141ffb700 1 -- 172.21.15.49:0/218846218 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148011cc0 con 0x7f914c0b7af0 2023-07-21T22:10:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.762+0000 7f91526f9700 1 -- 172.21.15.49:0/218846218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c1e4fa0 con 0x7f914c0b7af0 2023-07-21T22:10:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.766+0000 7f91526f9700 1 -- 172.21.15.49:0/218846218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c0b3480 con 0x7f914c0b7af0 2023-07-21T22:10:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.766+0000 7f9141ffb700 1 -- 172.21.15.49:0/218846218 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f914801c460 con 0x7f914c0b7af0 2023-07-21T22:10:29.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.766+0000 7f9141ffb700 1 --2- 172.21.15.49:0/218846218 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f91300662f0 0x7f91300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:29.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.766+0000 7f9141ffb700 1 -- 172.21.15.49:0/218846218 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9148083740 con 0x7f914c0b7af0 2023-07-21T22:10:29.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.770+0000 7f9150ef6700 1 --2- 172.21.15.49:0/218846218 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f91300662f0 0x7f91300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:29.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.770+0000 7f9150ef6700 1 --2- 172.21.15.49:0/218846218 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f91300662f0 0x7f91300687a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f914c0cfed0 tx=0x7f913c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:29.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.774+0000 7f9141ffb700 1 -- 172.21.15.49:0/218846218 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9148050fa0 con 0x7f914c0b7af0 2023-07-21T22:10:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.954+0000 7f91526f9700 1 -- 172.21.15.49:0/218846218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f914c04dcb0 con 0x7f914c0b7af0 2023-07-21T22:10:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.958+0000 7f9141ffb700 1 -- 172.21.15.49:0/218846218 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91480545c0 con 0x7f914c0b7af0 2023-07-21T22:10:29.999 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:10:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.962+0000 7f91526f9700 1 -- 172.21.15.49:0/218846218 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f91300662f0 msgr2=0x7f91300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.962+0000 7f91526f9700 1 --2- 172.21.15.49:0/218846218 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f91300662f0 0x7f91300687a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f914c0cfed0 tx=0x7f913c008030 comp rx=0 tx=0).stop 2023-07-21T22:10:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.962+0000 7f91526f9700 1 -- 172.21.15.49:0/218846218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0b7af0 msgr2=0x7f914c157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:30.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.962+0000 7f91526f9700 1 --2- 172.21.15.49:0/218846218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0b7af0 0x7f914c157070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f914800c4e0 tx=0x7f914800c8a0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.962+0000 7f91526f9700 1 -- 172.21.15.49:0/218846218 shutdown_connections 2023-07-21T22:10:30.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.962+0000 7f91526f9700 1 --2- 172.21.15.49:0/218846218 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f91300662f0 0x7f91300687a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.962+0000 7f91526f9700 1 --2- 172.21.15.49:0/218846218 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f914c0d1e40 0x7f914c1e54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.962+0000 7f91526f9700 1 --2- 172.21.15.49:0/218846218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f914c0cee10 0x7f914c0c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.962+0000 7f91526f9700 1 --2- 172.21.15.49:0/218846218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0b7af0 0x7f914c157070 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.962+0000 7f91526f9700 1 -- 172.21.15.49:0/218846218 >> 172.21.15.49:0/218846218 conn(0x7f914c06e960 msgr2=0x7f914c0b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:30.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.962+0000 7f91526f9700 1 -- 172.21.15.49:0/218846218 shutdown_connections 2023-07-21T22:10:30.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:29.962+0000 7f91526f9700 1 -- 172.21.15.49:0/218846218 wait complete. 2023-07-21T22:10:30.023 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:10:30.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.162+0000 7fa5f6874700 1 Processor -- start 2023-07-21T22:10:30.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.162+0000 7fa5f6874700 1 -- start start 2023-07-21T22:10:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.166+0000 7fa5f6874700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa5f01603e0 0x7fa5f0164370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.166+0000 7fa5f6874700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa5f01648b0 0x7fa5f00cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.166+0000 7fa5f6874700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f0163ee0 con 0x7fa5f0160010 2023-07-21T22:10:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.166+0000 7fa5f6874700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f00cdf70 con 0x7fa5f01648b0 2023-07-21T22:10:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.166+0000 7fa5f6874700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f00cd6d0 con 0x7fa5f01603e0 2023-07-21T22:10:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.166+0000 7fa5f6073700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa5f01648b0 0x7fa5f00cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.166+0000 7fa5f5872700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa5f0160010 0x7fa5f00ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50536/0 (socket says 172.21.15.49:50536) 2023-07-21T22:10:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.166+0000 7fa5f5872700 1 -- 172.21.15.49:0/495513628 learned_addr learned my addr 172.21.15.49:0/495513628 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.166+0000 7fa5f5071700 1 --2- 172.21.15.49:0/495513628 >> v2:172.21.15.150:3300/0 conn(0x7fa5f01603e0 0x7fa5f0164370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.166+0000 7fa5f5071700 1 -- 172.21.15.49:0/495513628 >> v2:172.21.15.49:3300/0 conn(0x7fa5f01648b0 msgr2=0x7fa5f00cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.166+0000 7fa5f5071700 1 --2- 172.21.15.49:0/495513628 >> v2:172.21.15.49:3300/0 conn(0x7fa5f01648b0 0x7fa5f00cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.166+0000 7fa5f5071700 1 -- 172.21.15.49:0/495513628 >> v1:172.21.15.49:6789/0 conn(0x7fa5f0160010 legacy=0x7fa5f00ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.166+0000 7fa5f5071700 1 -- 172.21.15.49:0/495513628 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00cd9b0 con 0x7fa5f01603e0 2023-07-21T22:10:30.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.166+0000 7fa5f5071700 1 --2- 172.21.15.49:0/495513628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f01603e0 0x7fa5f0164370 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00ad960 tx=0x7fa5e0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a34855e236de2e01 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:30.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.170+0000 7fa5f4870700 1 -- 172.21.15.49:0/495513628 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0011830 con 0x7fa5f01603e0 2023-07-21T22:10:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.170+0000 7fa5f4870700 1 -- 172.21.15.49:0/495513628 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e0011990 con 0x7fa5f01603e0 2023-07-21T22:10:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.170+0000 7fa5f4870700 1 -- 172.21.15.49:0/495513628 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0011d20 con 0x7fa5f01603e0 2023-07-21T22:10:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.170+0000 7fa5f6874700 1 -- 172.21.15.49:0/495513628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f01603e0 msgr2=0x7fa5f0164370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:30.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.170+0000 7fa5f6874700 1 --2- 172.21.15.49:0/495513628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f01603e0 0x7fa5f0164370 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00ad960 tx=0x7fa5e0009b30 comp rx=0 tx=0).stop 2023-07-21T22:10:30.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.170+0000 7fa5f6874700 1 -- 172.21.15.49:0/495513628 shutdown_connections 2023-07-21T22:10:30.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.170+0000 7fa5f6874700 1 --2- 172.21.15.49:0/495513628 >> v2:172.21.15.49:3300/0 conn(0x7fa5f01648b0 0x7fa5f00cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.170+0000 7fa5f6874700 1 --2- 172.21.15.49:0/495513628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f01603e0 0x7fa5f0164370 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.170+0000 7fa5f6874700 1 -- 172.21.15.49:0/495513628 >> 172.21.15.49:0/495513628 conn(0x7fa5f00ce0d0 msgr2=0x7fa5f00ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:30.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.170+0000 7fa5f6874700 1 -- 172.21.15.49:0/495513628 shutdown_connections 2023-07-21T22:10:30.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.170+0000 7fa5f6874700 1 -- 172.21.15.49:0/495513628 wait complete. 2023-07-21T22:10:30.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.174+0000 7fa5f6874700 1 Processor -- start 2023-07-21T22:10:30.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.174+0000 7fa5f6874700 1 -- start start 2023-07-21T22:10:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.174+0000 7fa5f6874700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f0160010 0x7fa5f00b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.174+0000 7fa5f6874700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f01603e0 0x7fa5f0156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.174+0000 7fa5f6874700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5f01648b0 0x7fa5f01f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.174+0000 7fa5f6874700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00b0f40 con 0x7fa5f01603e0 2023-07-21T22:10:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.174+0000 7fa5f6874700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00c5110 con 0x7fa5f0160010 2023-07-21T22:10:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.174+0000 7fa5f6874700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00b1190 con 0x7fa5f01648b0 2023-07-21T22:10:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5f5071700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f01603e0 0x7fa5f0156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5f5071700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f01603e0 0x7fa5f0156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34240/0 (socket says 172.21.15.49:34240) 2023-07-21T22:10:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5f5071700 1 -- 172.21.15.49:0/4253986042 learned_addr learned my addr 172.21.15.49:0/4253986042 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5f6073700 1 --2- 172.21.15.49:0/4253986042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5f01648b0 0x7fa5f01f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5f5872700 1 --2- 172.21.15.49:0/4253986042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f0160010 0x7fa5f00b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5f5071700 1 -- 172.21.15.49:0/4253986042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5f01648b0 msgr2=0x7fa5f01f8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5f5071700 1 --2- 172.21.15.49:0/4253986042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5f01648b0 0x7fa5f01f8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5f5071700 1 -- 172.21.15.49:0/4253986042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f0160010 msgr2=0x7fa5f00b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5f5071700 1 --2- 172.21.15.49:0/4253986042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f0160010 0x7fa5f00b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5f5071700 1 -- 172.21.15.49:0/4253986042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e00094b0 con 0x7fa5f01603e0 2023-07-21T22:10:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5f5071700 1 --2- 172.21.15.49:0/4253986042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f01603e0 0x7fa5f0156cd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00090b0 tx=0x7fa5e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:30.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5e67fc700 1 -- 172.21.15.49:0/4253986042 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0004550 con 0x7fa5f01603e0 2023-07-21T22:10:30.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5e67fc700 1 -- 172.21.15.49:0/4253986042 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e001f070 con 0x7fa5f01603e0 2023-07-21T22:10:30.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5e67fc700 1 -- 172.21.15.49:0/4253986042 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00038e0 con 0x7fa5f01603e0 2023-07-21T22:10:30.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5f6874700 1 -- 172.21.15.49:0/4253986042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f00b1470 con 0x7fa5f01603e0 2023-07-21T22:10:30.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.178+0000 7fa5f6874700 1 -- 172.21.15.49:0/4253986042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f00b1a30 con 0x7fa5f01603e0 2023-07-21T22:10:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.182+0000 7fa5f6874700 1 -- 172.21.15.49:0/4253986042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f004dcb0 con 0x7fa5f01603e0 2023-07-21T22:10:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.182+0000 7fa5e67fc700 1 -- 172.21.15.49:0/4253986042 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa5e0003a40 con 0x7fa5f01603e0 2023-07-21T22:10:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.186+0000 7fa5e67fc700 1 --2- 172.21.15.49:0/4253986042 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa5d4066320 0x7fa5d40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.186+0000 7fa5e67fc700 1 -- 172.21.15.49:0/4253986042 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa5e0021070 con 0x7fa5f01603e0 2023-07-21T22:10:30.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.186+0000 7fa5f5872700 1 --2- 172.21.15.49:0/4253986042 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa5d4066320 0x7fa5d40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:30.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.186+0000 7fa5f5872700 1 --2- 172.21.15.49:0/4253986042 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa5d4066320 0x7fa5d40687d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec000f60 tx=0x7fa5ec007f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.190+0000 7fa5e67fc700 1 -- 172.21.15.49:0/4253986042 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa5e00b5700 con 0x7fa5f01603e0 2023-07-21T22:10:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.366+0000 7fa5f6874700 1 -- 172.21.15.49:0/4253986042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa5f00709f0 con 0x7fa5f01603e0 2023-07-21T22:10:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.366+0000 7fa5e67fc700 1 -- 172.21.15.49:0/4253986042 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa5e0052a00 con 0x7fa5f01603e0 2023-07-21T22:10:30.408 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:10:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.366+0000 7fa5f6874700 1 -- 172.21.15.49:0/4253986042 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa5d4066320 msgr2=0x7fa5d40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.366+0000 7fa5f6874700 1 --2- 172.21.15.49:0/4253986042 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa5d4066320 0x7fa5d40687d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec000f60 tx=0x7fa5ec007f30 comp rx=0 tx=0).stop 2023-07-21T22:10:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.366+0000 7fa5f6874700 1 -- 172.21.15.49:0/4253986042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f01603e0 msgr2=0x7fa5f0156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.366+0000 7fa5f6874700 1 --2- 172.21.15.49:0/4253986042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f01603e0 0x7fa5f0156cd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00090b0 tx=0x7fa5e0004770 comp rx=0 tx=0).stop 2023-07-21T22:10:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.366+0000 7fa5f6874700 1 -- 172.21.15.49:0/4253986042 shutdown_connections 2023-07-21T22:10:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.366+0000 7fa5f6874700 1 --2- 172.21.15.49:0/4253986042 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa5d4066320 0x7fa5d40687d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.370+0000 7fa5f6874700 1 --2- 172.21.15.49:0/4253986042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f01603e0 0x7fa5f0156cd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.370+0000 7fa5f6874700 1 --2- 172.21.15.49:0/4253986042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5f01648b0 0x7fa5f01f8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.370+0000 7fa5f6874700 1 --2- 172.21.15.49:0/4253986042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f0160010 0x7fa5f00b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.370+0000 7fa5f6874700 1 -- 172.21.15.49:0/4253986042 >> 172.21.15.49:0/4253986042 conn(0x7fa5f00ce0d0 msgr2=0x7fa5f015e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.370+0000 7fa5f6874700 1 -- 172.21.15.49:0/4253986042 shutdown_connections 2023-07-21T22:10:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.370+0000 7fa5f6874700 1 -- 172.21.15.49:0/4253986042 wait complete. 2023-07-21T22:10:30.432 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:10:30.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.562+0000 7f9d1b59e700 1 Processor -- start 2023-07-21T22:10:30.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.562+0000 7f9d1b59e700 1 -- start start 2023-07-21T22:10:30.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.566+0000 7f9d1b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9d1c15bf30 0x7f9d1c0ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:30.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.566+0000 7f9d1b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c0b0200 0x7f9d1c0ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:30.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.566+0000 7f9d1b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1c0cb270 con 0x7f9d1c0cbc40 2023-07-21T22:10:30.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.566+0000 7f9d1b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1c15c300 con 0x7f9d1c15bf30 2023-07-21T22:10:30.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.566+0000 7f9d1b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0acac0 con 0x7f9d1c0b0200 2023-07-21T22:10:30.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.566+0000 7f9d1ad9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c0b0200 0x7f9d1c0ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:30.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.566+0000 7f9d1ad9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c0b0200 0x7f9d1c0ab8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:42726/0 (socket says 172.21.15.49:42726) 2023-07-21T22:10:30.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.566+0000 7f9d1ad9d700 1 -- 172.21.15.49:0/2536891313 learned_addr learned my addr 172.21.15.49:0/2536891313 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:30.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.566+0000 7f9d1a59c700 1 --2- 172.21.15.49:0/2536891313 >> v2:172.21.15.150:3300/0 conn(0x7f9d1c15bf30 0x7f9d1c0ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.566+0000 7f9d1ad9d700 1 -- 172.21.15.49:0/2536891313 >> v2:172.21.15.150:3300/0 conn(0x7f9d1c15bf30 msgr2=0x7f9d1c0ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.566+0000 7f9d1ad9d700 1 --2- 172.21.15.49:0/2536891313 >> v2:172.21.15.150:3300/0 conn(0x7f9d1c15bf30 0x7f9d1c0ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.566+0000 7f9d1ad9d700 1 -- 172.21.15.49:0/2536891313 >> v1:172.21.15.150:6789/0 conn(0x7f9d1c0cbc40 legacy=0x7f9d1c0afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.566+0000 7f9d1ad9d700 1 -- 172.21.15.49:0/2536891313 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c06f740 con 0x7f9d1c0b0200 2023-07-21T22:10:30.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.570+0000 7f9d1ad9d700 1 --2- 172.21.15.49:0/2536891313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c0b0200 0x7f9d1c0ab8d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009910 tx=0x7f9d14009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d062e0d255a41a97 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:30.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.570+0000 7f9d19d9b700 1 -- 172.21.15.49:0/2536891313 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14004230 con 0x7f9d1c0b0200 2023-07-21T22:10:30.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.570+0000 7f9d19d9b700 1 -- 172.21.15.49:0/2536891313 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d14004390 con 0x7f9d1c0b0200 2023-07-21T22:10:30.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.570+0000 7f9d19d9b700 1 -- 172.21.15.49:0/2536891313 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d140036c0 con 0x7f9d1c0b0200 2023-07-21T22:10:30.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.570+0000 7f9d1b59e700 1 -- 172.21.15.49:0/2536891313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c0b0200 msgr2=0x7f9d1c0ab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:30.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.570+0000 7f9d1b59e700 1 --2- 172.21.15.49:0/2536891313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c0b0200 0x7f9d1c0ab8d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009910 tx=0x7f9d14009c20 comp rx=0 tx=0).stop 2023-07-21T22:10:30.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.570+0000 7f9d1b59e700 1 -- 172.21.15.49:0/2536891313 shutdown_connections 2023-07-21T22:10:30.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.570+0000 7f9d1b59e700 1 --2- 172.21.15.49:0/2536891313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c0b0200 0x7f9d1c0ab8d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.570+0000 7f9d1b59e700 1 --2- 172.21.15.49:0/2536891313 >> v2:172.21.15.150:3300/0 conn(0x7f9d1c15bf30 0x7f9d1c0ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.570+0000 7f9d1b59e700 1 -- 172.21.15.49:0/2536891313 >> 172.21.15.49:0/2536891313 conn(0x7f9d1c070450 msgr2=0x7f9d1c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:30.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.570+0000 7f9d1b59e700 1 -- 172.21.15.49:0/2536891313 shutdown_connections 2023-07-21T22:10:30.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.570+0000 7f9d1b59e700 1 -- 172.21.15.49:0/2536891313 wait complete. 2023-07-21T22:10:30.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.574+0000 7f9d1b59e700 1 Processor -- start 2023-07-21T22:10:30.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.574+0000 7f9d1b59e700 1 -- start start 2023-07-21T22:10:30.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.574+0000 7f9d1b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0b0200 0x7f9d1c15c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:30.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.574+0000 7f9d1b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c0cbc40 0x7f9d1c15e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:30.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.574+0000 7f9d1b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c15bf30 0x7f9d1c15eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:30.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.574+0000 7f9d1b59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c15cff0 con 0x7f9d1c0b0200 2023-07-21T22:10:30.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.574+0000 7f9d1b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c15d2d0 con 0x7f9d1c0cbc40 2023-07-21T22:10:30.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.574+0000 7f9d1b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c15d5b0 con 0x7f9d1c15bf30 2023-07-21T22:10:30.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.574+0000 7f9d1a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0b0200 0x7f9d1c15c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:30.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.574+0000 7f9d1a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0b0200 0x7f9d1c15c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34248/0 (socket says 172.21.15.49:34248) 2023-07-21T22:10:30.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.574+0000 7f9d1a59c700 1 -- 172.21.15.49:0/3578416258 learned_addr learned my addr 172.21.15.49:0/3578416258 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:30.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.578+0000 7f9d1ad9d700 1 --2- 172.21.15.49:0/3578416258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c15bf30 0x7f9d1c15eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:30.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.578+0000 7f9d11d9b700 1 --2- 172.21.15.49:0/3578416258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c0cbc40 0x7f9d1c15e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:30.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.578+0000 7f9d1a59c700 1 -- 172.21.15.49:0/3578416258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c15bf30 msgr2=0x7f9d1c15eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:30.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.578+0000 7f9d1a59c700 1 --2- 172.21.15.49:0/3578416258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c15bf30 0x7f9d1c15eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.578+0000 7f9d1a59c700 1 -- 172.21.15.49:0/3578416258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c0cbc40 msgr2=0x7f9d1c15e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:30.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.578+0000 7f9d1a59c700 1 --2- 172.21.15.49:0/3578416258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c0cbc40 0x7f9d1c15e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.578+0000 7f9d1a59c700 1 -- 172.21.15.49:0/3578416258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d14009570 con 0x7f9d1c0b0200 2023-07-21T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.578+0000 7f9d1a59c700 1 --2- 172.21.15.49:0/3578416258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0b0200 0x7f9d1c15c910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00e9d0 tx=0x7f9d0c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.578+0000 7f9d137fe700 1 -- 172.21.15.49:0/3578416258 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c009720 con 0x7f9d1c0b0200 2023-07-21T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.578+0000 7f9d137fe700 1 -- 172.21.15.49:0/3578416258 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c00ee70 con 0x7f9d1c0b0200 2023-07-21T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.578+0000 7f9d137fe700 1 -- 172.21.15.49:0/3578416258 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c00ca50 con 0x7f9d1c0b0200 2023-07-21T22:10:30.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.578+0000 7f9d1b59e700 1 -- 172.21.15.49:0/3578416258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1c15d890 con 0x7f9d1c0b0200 2023-07-21T22:10:30.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.578+0000 7f9d1b59e700 1 -- 172.21.15.49:0/3578416258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1c15e090 con 0x7f9d1c0b0200 2023-07-21T22:10:30.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.578+0000 7f9d1b59e700 1 -- 172.21.15.49:0/3578416258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1c15e310 con 0x7f9d1c0b0200 2023-07-21T22:10:30.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.582+0000 7f9d137fe700 1 -- 172.21.15.49:0/3578416258 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d0c00cbb0 con 0x7f9d1c0b0200 2023-07-21T22:10:30.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.582+0000 7f9d137fe700 1 --2- 172.21.15.49:0/3578416258 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9cfc0662f0 0x7f9cfc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:30.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.582+0000 7f9d137fe700 1 -- 172.21.15.49:0/3578416258 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9d0c083a90 con 0x7f9d1c0b0200 2023-07-21T22:10:30.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.582+0000 7f9d11d9b700 1 --2- 172.21.15.49:0/3578416258 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9cfc0662f0 0x7f9cfc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:30.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.582+0000 7f9d11d9b700 1 --2- 172.21.15.49:0/3578416258 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9cfc0662f0 0x7f9cfc0687a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c1607d0 tx=0x7f9d040042e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:30.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.590+0000 7f9d137fe700 1 -- 172.21.15.49:0/3578416258 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9d0c054c60 con 0x7f9d1c0b0200 2023-07-21T22:10:30.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.798+0000 7f9d1b59e700 1 -- 172.21.15.49:0/3578416258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d1c04dcb0 con 0x7f9d1c0b0200 2023-07-21T22:10:30.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.798+0000 7f9d137fe700 1 -- 172.21.15.49:0/3578416258 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f9d0c021090 con 0x7f9d1c0b0200 2023-07-21T22:10:30.842 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/1894793298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1894793298},{"type":"v1","addr":"172.21.15.150:6833","nonce":1894793298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1984862419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1984862419},{"type":"v1","addr":"172.21.15.49:6836","nonce":1984862419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1331451608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1331451608},{"type":"v1","addr":"172.21.15.49:6837","nonce":1331451608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2478678672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2478678672},{"type":"v1","addr":"172.21.15.150:6835","nonce":2478678672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-21T22:10:30.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.802+0000 7f9d1b59e700 1 -- 172.21.15.49:0/3578416258 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9cfc0662f0 msgr2=0x7f9cfc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:30.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.802+0000 7f9d1b59e700 1 --2- 172.21.15.49:0/3578416258 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9cfc0662f0 0x7f9cfc0687a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c1607d0 tx=0x7f9d040042e0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.802+0000 7f9d1b59e700 1 -- 172.21.15.49:0/3578416258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0b0200 msgr2=0x7f9d1c15c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:30.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.802+0000 7f9d1b59e700 1 --2- 172.21.15.49:0/3578416258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0b0200 0x7f9d1c15c910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00e9d0 tx=0x7f9d0c00ece0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.802+0000 7f9d1b59e700 1 -- 172.21.15.49:0/3578416258 shutdown_connections 2023-07-21T22:10:30.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.802+0000 7f9d1b59e700 1 --2- 172.21.15.49:0/3578416258 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9cfc0662f0 0x7f9cfc0687a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.802+0000 7f9d1b59e700 1 --2- 172.21.15.49:0/3578416258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c15bf30 0x7f9d1c15eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.802+0000 7f9d1b59e700 1 --2- 172.21.15.49:0/3578416258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c0cbc40 0x7f9d1c15e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.802+0000 7f9d1b59e700 1 --2- 172.21.15.49:0/3578416258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0b0200 0x7f9d1c15c910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:30.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.802+0000 7f9d1b59e700 1 -- 172.21.15.49:0/3578416258 >> 172.21.15.49:0/3578416258 conn(0x7f9d1c070450 msgr2=0x7f9d1c06bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:30.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.802+0000 7f9d1b59e700 1 -- 172.21.15.49:0/3578416258 shutdown_connections 2023-07-21T22:10:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:30.802+0000 7f9d1b59e700 1 -- 172.21.15.49:0/3578416258 wait complete. 2023-07-21T22:10:30.849 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 3 2023-07-21T22:10:30.867 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:10:31.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.002+0000 7fbb759a0700 1 Processor -- start 2023-07-21T22:10:31.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.002+0000 7fbb759a0700 1 -- start start 2023-07-21T22:10:31.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.002+0000 7fbb759a0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbb7006d380 0x7fbb7006d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.002+0000 7fbb759a0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbb700cafb0 0x7fbb700cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.002+0000 7fbb759a0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb700cab20 con 0x7fbb70071c70 2023-07-21T22:10:31.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.002+0000 7fbb759a0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb700c9e80 con 0x7fbb7006d380 2023-07-21T22:10:31.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.002+0000 7fbb759a0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb700afeb0 con 0x7fbb700cafb0 2023-07-21T22:10:31.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb667fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbb70071c70 0x7fbb700b0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50540/0 (socket says 172.21.15.49:50540) 2023-07-21T22:10:31.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb667fc700 1 -- 172.21.15.49:0/4004321037 learned_addr learned my addr 172.21.15.49:0/4004321037 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:31.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb6effd700 1 --2- 172.21.15.49:0/4004321037 >> v2:172.21.15.49:3300/0 conn(0x7fbb7006d380 0x7fbb7006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb6f7fe700 1 --2- 172.21.15.49:0/4004321037 >> v2:172.21.15.150:3300/0 conn(0x7fbb700cafb0 0x7fbb700cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb6e7fc700 1 -- 172.21.15.49:0/4004321037 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322620728 0 0) 0x7fbb700cab20 con 0x7fbb70071c70 2023-07-21T22:10:31.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb6effd700 1 -- 172.21.15.49:0/4004321037 >> v2:172.21.15.150:3300/0 conn(0x7fbb700cafb0 msgr2=0x7fbb700cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:31.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb6effd700 1 --2- 172.21.15.49:0/4004321037 >> v2:172.21.15.150:3300/0 conn(0x7fbb700cafb0 0x7fbb700cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb6effd700 1 -- 172.21.15.49:0/4004321037 >> v1:172.21.15.49:6789/0 conn(0x7fbb70071c70 legacy=0x7fbb700b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb6effd700 1 -- 172.21.15.49:0/4004321037 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7006dc90 con 0x7fbb7006d380 2023-07-21T22:10:31.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb6effd700 1 --2- 172.21.15.49:0/4004321037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb7006d380 0x7fbb7006d750 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbb700cbb90 tx=0x7fbb6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44671431052235ed server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:31.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb6e7fc700 1 -- 172.21.15.49:0/4004321037 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6000e070 con 0x7fbb7006d380 2023-07-21T22:10:31.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb6e7fc700 1 -- 172.21.15.49:0/4004321037 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6000bb20 con 0x7fbb7006d380 2023-07-21T22:10:31.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb6e7fc700 1 -- 172.21.15.49:0/4004321037 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb60012430 con 0x7fbb7006d380 2023-07-21T22:10:31.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb759a0700 1 -- 172.21.15.49:0/4004321037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb7006d380 msgr2=0x7fbb7006d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb759a0700 1 --2- 172.21.15.49:0/4004321037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb7006d380 0x7fbb7006d750 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbb700cbb90 tx=0x7fbb6000b330 comp rx=0 tx=0).stop 2023-07-21T22:10:31.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb759a0700 1 -- 172.21.15.49:0/4004321037 shutdown_connections 2023-07-21T22:10:31.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb759a0700 1 --2- 172.21.15.49:0/4004321037 >> v2:172.21.15.150:3300/0 conn(0x7fbb700cafb0 0x7fbb700cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb759a0700 1 --2- 172.21.15.49:0/4004321037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb7006d380 0x7fbb7006d750 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb759a0700 1 -- 172.21.15.49:0/4004321037 >> 172.21.15.49:0/4004321037 conn(0x7fbb70070450 msgr2=0x7fbb70070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:31.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb759a0700 1 -- 172.21.15.49:0/4004321037 shutdown_connections 2023-07-21T22:10:31.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.006+0000 7fbb759a0700 1 -- 172.21.15.49:0/4004321037 wait complete. 2023-07-21T22:10:31.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.010+0000 7fbb759a0700 1 Processor -- start 2023-07-21T22:10:31.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.010+0000 7fbb759a0700 1 -- start start 2023-07-21T22:10:31.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.010+0000 7fbb759a0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb7006d380 0x7fbb70149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.010+0000 7fbb759a0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb70071c70 0x7fbb7014abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.010+0000 7fbb759a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb700cafb0 0x7fbb700aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.010+0000 7fbb759a0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb700a9300 con 0x7fbb7006d380 2023-07-21T22:10:31.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.010+0000 7fbb759a0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb701498b0 con 0x7fbb70071c70 2023-07-21T22:10:31.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.010+0000 7fbb759a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb70149b30 con 0x7fbb700cafb0 2023-07-21T22:10:31.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.010+0000 7fbb6effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb7006d380 0x7fbb70149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.010+0000 7fbb6effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb7006d380 0x7fbb70149370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34264/0 (socket says 172.21.15.49:34264) 2023-07-21T22:10:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.010+0000 7fbb6effd700 1 -- 172.21.15.49:0/19115120 learned_addr learned my addr 172.21.15.49:0/19115120 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.014+0000 7fbb667fc700 1 --2- 172.21.15.49:0/19115120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb70071c70 0x7fbb7014abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.014+0000 7fbb6effd700 1 -- 172.21.15.49:0/19115120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb700cafb0 msgr2=0x7fbb700aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.014+0000 7fbb6effd700 1 --2- 172.21.15.49:0/19115120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb700cafb0 0x7fbb700aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.014+0000 7fbb6effd700 1 -- 172.21.15.49:0/19115120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb70071c70 msgr2=0x7fbb7014abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.014+0000 7fbb6effd700 1 --2- 172.21.15.49:0/19115120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb70071c70 0x7fbb7014abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.014+0000 7fbb6effd700 1 -- 172.21.15.49:0/19115120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb60009a70 con 0x7fbb7006d380 2023-07-21T22:10:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.014+0000 7fbb6effd700 1 --2- 172.21.15.49:0/19115120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb7006d380 0x7fbb70149370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbb6000b680 tx=0x7fbb60004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:31.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.014+0000 7fbb6cff9700 1 -- 172.21.15.49:0/19115120 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb60012430 con 0x7fbb7006d380 2023-07-21T22:10:31.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.014+0000 7fbb6cff9700 1 -- 172.21.15.49:0/19115120 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb60020070 con 0x7fbb7006d380 2023-07-21T22:10:31.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.014+0000 7fbb6cff9700 1 -- 172.21.15.49:0/19115120 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb60004280 con 0x7fbb7006d380 2023-07-21T22:10:31.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.014+0000 7fbb759a0700 1 -- 172.21.15.49:0/19115120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb70149e10 con 0x7fbb7006d380 2023-07-21T22:10:31.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.014+0000 7fbb759a0700 1 -- 172.21.15.49:0/19115120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7014a1a0 con 0x7fbb7006d380 2023-07-21T22:10:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.014+0000 7fbb759a0700 1 -- 172.21.15.49:0/19115120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7004dcb0 con 0x7fbb7006d380 2023-07-21T22:10:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.018+0000 7fbb6cff9700 1 -- 172.21.15.49:0/19115120 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb600043e0 con 0x7fbb7006d380 2023-07-21T22:10:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.018+0000 7fbb6cff9700 1 --2- 172.21.15.49:0/19115120 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbb500662f0 0x7fbb500687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.018+0000 7fbb6cff9700 1 -- 172.21.15.49:0/19115120 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbb60022070 con 0x7fbb7006d380 2023-07-21T22:10:31.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.018+0000 7fbb667fc700 1 --2- 172.21.15.49:0/19115120 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbb500662f0 0x7fbb500687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.018+0000 7fbb667fc700 1 --2- 172.21.15.49:0/19115120 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbb500662f0 0x7fbb500687a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbb70158a60 tx=0x7fbb58007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:31.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.022+0000 7fbb6cff9700 1 -- 172.21.15.49:0/19115120 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb60052f80 con 0x7fbb7006d380 2023-07-21T22:10:31.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.202+0000 7fbb759a0700 1 -- 172.21.15.49:0/19115120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb700ca4a0 con 0x7fbb7006d380 2023-07-21T22:10:31.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.202+0000 7fbb6cff9700 1 -- 172.21.15.49:0/19115120 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14600 (secure 0 0 0) 0x7fbb600565a0 con 0x7fbb7006d380 2023-07-21T22:10:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:30.105190+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:10:31.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.206+0000 7fbb759a0700 1 -- 172.21.15.49:0/19115120 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbb500662f0 msgr2=0x7fbb500687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.206+0000 7fbb759a0700 1 --2- 172.21.15.49:0/19115120 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbb500662f0 0x7fbb500687a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbb70158a60 tx=0x7fbb58007c00 comp rx=0 tx=0).stop 2023-07-21T22:10:31.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.206+0000 7fbb759a0700 1 -- 172.21.15.49:0/19115120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb7006d380 msgr2=0x7fbb70149370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.206+0000 7fbb759a0700 1 --2- 172.21.15.49:0/19115120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb7006d380 0x7fbb70149370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbb6000b680 tx=0x7fbb60004af0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.206+0000 7fbb759a0700 1 -- 172.21.15.49:0/19115120 shutdown_connections 2023-07-21T22:10:31.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.206+0000 7fbb759a0700 1 --2- 172.21.15.49:0/19115120 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbb500662f0 0x7fbb500687a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.206+0000 7fbb759a0700 1 --2- 172.21.15.49:0/19115120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb700cafb0 0x7fbb700aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.206+0000 7fbb759a0700 1 --2- 172.21.15.49:0/19115120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb70071c70 0x7fbb7014abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.206+0000 7fbb759a0700 1 --2- 172.21.15.49:0/19115120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb7006d380 0x7fbb70149370 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.206+0000 7fbb759a0700 1 -- 172.21.15.49:0/19115120 >> 172.21.15.49:0/19115120 conn(0x7fbb70070450 msgr2=0x7fbb700b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:31.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.206+0000 7fbb759a0700 1 -- 172.21.15.49:0/19115120 shutdown_connections 2023-07-21T22:10:31.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.206+0000 7fbb759a0700 1 -- 172.21.15.49:0/19115120 wait complete. 2023-07-21T22:10:31.272 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:10:31.273 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:10:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.410+0000 7f6491a82700 1 Processor -- start 2023-07-21T22:10:31.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.410+0000 7f6491a82700 1 -- start start 2023-07-21T22:10:31.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.414+0000 7f6491a82700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f648c0cf320 0x7f648c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.414+0000 7f6491a82700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c0b8170 con 0x7f648c0b4b20 2023-07-21T22:10:31.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.414+0000 7f6491a82700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c0d2350 con 0x7f648c0b4040 2023-07-21T22:10:31.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.414+0000 7f6491a82700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648c0cfa20 con 0x7f648c0cf320 2023-07-21T22:10:31.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.414+0000 7f648affd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f648c0b4b20 0x7f648c0d0810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50542/0 (socket says 172.21.15.49:50542) 2023-07-21T22:10:31.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.414+0000 7f648affd700 1 -- 172.21.15.49:0/2610765110 learned_addr learned my addr 172.21.15.49:0/2610765110 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:31.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.414+0000 7f648bfff700 1 --2- 172.21.15.49:0/2610765110 >> v2:172.21.15.150:3300/0 conn(0x7f648c0cf320 0x7f648c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.414+0000 7f648a7fc700 1 -- 172.21.15.49:0/2610765110 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4442710 0 0) 0x7f648c0b8170 con 0x7f648c0b4b20 2023-07-21T22:10:31.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.414+0000 7f648a7fc700 1 -- 172.21.15.49:0/2610765110 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64740035d0 con 0x7f648c0b4b20 2023-07-21T22:10:31.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.414+0000 7f648bfff700 1 -- 172.21.15.49:0/2610765110 >> v1:172.21.15.150:6789/0 conn(0x7f648c0b4040 legacy=0x7f648c0b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.414+0000 7f648a7fc700 1 -- 172.21.15.49:0/2610765110 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377515127 0 0) 0x7f648c0d2350 con 0x7f648c0b4040 2023-07-21T22:10:31.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.414+0000 7f648bfff700 1 -- 172.21.15.49:0/2610765110 >> v1:172.21.15.49:6789/0 conn(0x7f648c0b4b20 legacy=0x7f648c0d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.414+0000 7f648bfff700 1 -- 172.21.15.49:0/2610765110 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c0cd370 con 0x7f648c0cf320 2023-07-21T22:10:31.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.418+0000 7f648bfff700 1 --2- 172.21.15.49:0/2610765110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f648c0cf320 0x7f648c0d0f20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6484009d90 tx=0x7f648400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d35dfc30315e42b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:31.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.418+0000 7f648a7fc700 1 -- 172.21.15.49:0/2610765110 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648400e070 con 0x7f648c0cf320 2023-07-21T22:10:31.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.418+0000 7f648a7fc700 1 -- 172.21.15.49:0/2610765110 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648400bb20 con 0x7f648c0cf320 2023-07-21T22:10:31.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.418+0000 7f648a7fc700 1 -- 172.21.15.49:0/2610765110 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648400bed0 con 0x7f648c0cf320 2023-07-21T22:10:31.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.418+0000 7f6491a82700 1 -- 172.21.15.49:0/2610765110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f648c0cf320 msgr2=0x7f648c0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.418+0000 7f6491a82700 1 --2- 172.21.15.49:0/2610765110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f648c0cf320 0x7f648c0d0f20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6484009d90 tx=0x7f648400b330 comp rx=0 tx=0).stop 2023-07-21T22:10:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.418+0000 7f6491a82700 1 -- 172.21.15.49:0/2610765110 shutdown_connections 2023-07-21T22:10:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.418+0000 7f6491a82700 1 --2- 172.21.15.49:0/2610765110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f648c0cf320 0x7f648c0d0f20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.418+0000 7f6491a82700 1 -- 172.21.15.49:0/2610765110 >> 172.21.15.49:0/2610765110 conn(0x7f648c0658e0 msgr2=0x7f648c06fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.418+0000 7f6491a82700 1 -- 172.21.15.49:0/2610765110 shutdown_connections 2023-07-21T22:10:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.418+0000 7f6491a82700 1 -- 172.21.15.49:0/2610765110 wait complete. 2023-07-21T22:10:31.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f6491a82700 1 Processor -- start 2023-07-21T22:10:31.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f6491a82700 1 -- start start 2023-07-21T22:10:31.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f6491a82700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f648c0b4040 0x7f648c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f6491a82700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f648c0b4b20 0x7f648c0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f6491a82700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f648c0cf320 0x7f648c14c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f6491a82700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c15ec90 con 0x7f648c0b4040 2023-07-21T22:10:31.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f6491a82700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c15ddb0 con 0x7f648c0b4b20 2023-07-21T22:10:31.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f6491a82700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c15e080 con 0x7f648c0cf320 2023-07-21T22:10:31.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f648b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f648c0b4040 0x7f648c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f648b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f648c0b4040 0x7f648c15d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34278/0 (socket says 172.21.15.49:34278) 2023-07-21T22:10:31.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f648b7fe700 1 -- 172.21.15.49:0/1729675299 learned_addr learned my addr 172.21.15.49:0/1729675299 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:31.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f648affd700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f648c0b4b20 0x7f648c0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f648bfff700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f648c0cf320 0x7f648c14c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f648b7fe700 1 -- 172.21.15.49:0/1729675299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f648c0cf320 msgr2=0x7f648c14c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f648b7fe700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f648c0cf320 0x7f648c14c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f648b7fe700 1 -- 172.21.15.49:0/1729675299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f648c0b4b20 msgr2=0x7f648c0b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f648b7fe700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f648c0b4b20 0x7f648c0b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f648b7fe700 1 -- 172.21.15.49:0/1729675299 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6484009a70 con 0x7f648c0b4040 2023-07-21T22:10:31.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.422+0000 7f648bfff700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f648c0cf320 0x7f648c14c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:31.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.426+0000 7f648affd700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f648c0b4b20 0x7f648c0b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:31.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.426+0000 7f648b7fe700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f648c0b4040 0x7f648c15d870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f647c00c520 tx=0x7f647c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:31.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.426+0000 7f6473fff700 1 -- 172.21.15.49:0/1729675299 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c0054e0 con 0x7f648c0b4040 2023-07-21T22:10:31.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.426+0000 7f6473fff700 1 -- 172.21.15.49:0/1729675299 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647c0036a0 con 0x7f648c0b4040 2023-07-21T22:10:31.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.426+0000 7f6491a82700 1 -- 172.21.15.49:0/1729675299 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648c15e360 con 0x7f648c0b4040 2023-07-21T22:10:31.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.426+0000 7f6473fff700 1 -- 172.21.15.49:0/1729675299 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c003a50 con 0x7f648c0b4040 2023-07-21T22:10:31.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.426+0000 7f6491a82700 1 -- 172.21.15.49:0/1729675299 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c15e920 con 0x7f648c0b4040 2023-07-21T22:10:31.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.426+0000 7f6491a82700 1 -- 172.21.15.49:0/1729675299 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c04dd50 con 0x7f648c0b4040 2023-07-21T22:10:31.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.430+0000 7f6473fff700 1 -- 172.21.15.49:0/1729675299 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f647c003bb0 con 0x7f648c0b4040 2023-07-21T22:10:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.430+0000 7f6473fff700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f64780662f0 0x7f64780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.430+0000 7f6473fff700 1 -- 172.21.15.49:0/1729675299 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f647c082ef0 con 0x7f648c0b4040 2023-07-21T22:10:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.430+0000 7f648affd700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f64780662f0 0x7f64780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.430+0000 7f648affd700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f64780662f0 0x7f64780687a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f648c0c5c40 tx=0x7f6480009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.438+0000 7f6473fff700 1 -- 172.21.15.49:0/1729675299 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f647c0506c0 con 0x7f648c0b4040 2023-07-21T22:10:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.618+0000 7f6491a82700 1 -- 172.21.15.49:0/1729675299 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f648c0b1d00 con 0x7f648c0b4040 2023-07-21T22:10:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.618+0000 7f6473fff700 1 -- 172.21.15.49:0/1729675299 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f647c0170a0 con 0x7f648c0b4040 2023-07-21T22:10:31.662 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:10:31.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.626+0000 7f6491a82700 1 -- 172.21.15.49:0/1729675299 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f64780662f0 msgr2=0x7f64780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.626+0000 7f6491a82700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f64780662f0 0x7f64780687a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f648c0c5c40 tx=0x7f6480009040 comp rx=0 tx=0).stop 2023-07-21T22:10:31.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.626+0000 7f6491a82700 1 -- 172.21.15.49:0/1729675299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f648c0b4040 msgr2=0x7f648c15d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.626+0000 7f6491a82700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f648c0b4040 0x7f648c15d870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f647c00c520 tx=0x7f647c00c8e0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.626+0000 7f6491a82700 1 -- 172.21.15.49:0/1729675299 shutdown_connections 2023-07-21T22:10:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.626+0000 7f6491a82700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f64780662f0 0x7f64780687a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.626+0000 7f6491a82700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f648c0cf320 0x7f648c14c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.626+0000 7f6491a82700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f648c0b4b20 0x7f648c0b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.626+0000 7f6491a82700 1 --2- 172.21.15.49:0/1729675299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f648c0b4040 0x7f648c15d870 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.626+0000 7f6491a82700 1 -- 172.21.15.49:0/1729675299 >> 172.21.15.49:0/1729675299 conn(0x7f648c0658e0 msgr2=0x7f648c0cfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:31.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.626+0000 7f6491a82700 1 -- 172.21.15.49:0/1729675299 shutdown_connections 2023-07-21T22:10:31.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.626+0000 7f6491a82700 1 -- 172.21.15.49:0/1729675299 wait complete. 2023-07-21T22:10:31.689 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:10:31.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.830+0000 7f4d67908700 1 Processor -- start 2023-07-21T22:10:31.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d67908700 1 -- start start 2023-07-21T22:10:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d67908700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4d600cb2f0 0x7f4d600ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d67908700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d600b3a50 0x7f4d600ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d67908700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d600ca190 con 0x7f4d6015e380 2023-07-21T22:10:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d67908700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d60159fd0 con 0x7f4d600cb2f0 2023-07-21T22:10:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d67908700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6015d6e0 con 0x7f4d600b3a50 2023-07-21T22:10:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d656a4700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4d6015e380 0x7f4d600cabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50548/0 (socket says 172.21.15.49:50548) 2023-07-21T22:10:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d656a4700 1 -- 172.21.15.49:0/3905790058 learned_addr learned my addr 172.21.15.49:0/3905790058 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d65ea5700 1 --2- 172.21.15.49:0/3905790058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d600b3a50 0x7f4d600ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d64ea3700 1 --2- 172.21.15.49:0/3905790058 >> v2:172.21.15.150:3300/0 conn(0x7f4d600cb2f0 0x7f4d600ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d57fff700 1 -- 172.21.15.49:0/3905790058 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917531845 0 0) 0x7f4d600ca190 con 0x7f4d6015e380 2023-07-21T22:10:31.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d57fff700 1 -- 172.21.15.49:0/3905790058 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d4c0035d0 con 0x7f4d6015e380 2023-07-21T22:10:31.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d65ea5700 1 -- 172.21.15.49:0/3905790058 >> v2:172.21.15.150:3300/0 conn(0x7f4d600cb2f0 msgr2=0x7f4d600ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:31.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d65ea5700 1 --2- 172.21.15.49:0/3905790058 >> v2:172.21.15.150:3300/0 conn(0x7f4d600cb2f0 0x7f4d600ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d65ea5700 1 -- 172.21.15.49:0/3905790058 >> v1:172.21.15.49:6789/0 conn(0x7f4d6015e380 legacy=0x7f4d600cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.834+0000 7f4d65ea5700 1 -- 172.21.15.49:0/3905790058 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d600ca900 con 0x7f4d600b3a50 2023-07-21T22:10:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.838+0000 7f4d65ea5700 1 --2- 172.21.15.49:0/3905790058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d600b3a50 0x7f4d600ce6a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4d58009d90 tx=0x7f4d5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef7a3ebc47745fc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.838+0000 7f4d57fff700 1 -- 172.21.15.49:0/3905790058 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5800e070 con 0x7f4d600b3a50 2023-07-21T22:10:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.838+0000 7f4d57fff700 1 -- 172.21.15.49:0/3905790058 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5800bb20 con 0x7f4d600b3a50 2023-07-21T22:10:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.838+0000 7f4d57fff700 1 -- 172.21.15.49:0/3905790058 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58012430 con 0x7f4d600b3a50 2023-07-21T22:10:31.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.838+0000 7f4d67908700 1 -- 172.21.15.49:0/3905790058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d600b3a50 msgr2=0x7f4d600ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.838+0000 7f4d67908700 1 --2- 172.21.15.49:0/3905790058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d600b3a50 0x7f4d600ce6a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4d58009d90 tx=0x7f4d5800b330 comp rx=0 tx=0).stop 2023-07-21T22:10:31.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.838+0000 7f4d67908700 1 -- 172.21.15.49:0/3905790058 shutdown_connections 2023-07-21T22:10:31.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.838+0000 7f4d67908700 1 --2- 172.21.15.49:0/3905790058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d600b3a50 0x7f4d600ce6a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.838+0000 7f4d67908700 1 --2- 172.21.15.49:0/3905790058 >> v2:172.21.15.150:3300/0 conn(0x7f4d600cb2f0 0x7f4d600ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.838+0000 7f4d67908700 1 -- 172.21.15.49:0/3905790058 >> 172.21.15.49:0/3905790058 conn(0x7f4d6006e960 msgr2=0x7f4d6006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:31.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.838+0000 7f4d67908700 1 -- 172.21.15.49:0/3905790058 shutdown_connections 2023-07-21T22:10:31.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.838+0000 7f4d67908700 1 -- 172.21.15.49:0/3905790058 wait complete. 2023-07-21T22:10:31.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.842+0000 7f4d67908700 1 Processor -- start 2023-07-21T22:10:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.842+0000 7f4d67908700 1 -- start start 2023-07-21T22:10:31.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.842+0000 7f4d67908700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d600b3a50 0x7f4d60153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.842+0000 7f4d67908700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d600cb2f0 0x7f4d600c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.842+0000 7f4d67908700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d6015e380 0x7f4d600ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.842+0000 7f4d67908700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600c39a0 con 0x7f4d6015e380 2023-07-21T22:10:31.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.842+0000 7f4d67908700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d601538b0 con 0x7f4d600b3a50 2023-07-21T22:10:31.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.842+0000 7f4d67908700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600c2d90 con 0x7f4d600cb2f0 2023-07-21T22:10:31.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.842+0000 7f4d65ea5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d6015e380 0x7f4d600ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.842+0000 7f4d65ea5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d6015e380 0x7f4d600ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34294/0 (socket says 172.21.15.49:34294) 2023-07-21T22:10:31.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.842+0000 7f4d65ea5700 1 -- 172.21.15.49:0/335877060 learned_addr learned my addr 172.21.15.49:0/335877060 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:31.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.842+0000 7f4d656a4700 1 --2- 172.21.15.49:0/335877060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d600b3a50 0x7f4d60153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.842+0000 7f4d64ea3700 1 --2- 172.21.15.49:0/335877060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d600cb2f0 0x7f4d600c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.846+0000 7f4d65ea5700 1 -- 172.21.15.49:0/335877060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d600cb2f0 msgr2=0x7f4d600c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.846+0000 7f4d65ea5700 1 --2- 172.21.15.49:0/335877060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d600cb2f0 0x7f4d600c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.846+0000 7f4d65ea5700 1 -- 172.21.15.49:0/335877060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d600b3a50 msgr2=0x7f4d60153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:31.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.846+0000 7f4d65ea5700 1 --2- 172.21.15.49:0/335877060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d600b3a50 0x7f4d60153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:31.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.846+0000 7f4d65ea5700 1 -- 172.21.15.49:0/335877060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d58009a70 con 0x7f4d6015e380 2023-07-21T22:10:31.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.846+0000 7f4d65ea5700 1 --2- 172.21.15.49:0/335877060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d6015e380 0x7f4d600ccda0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4d6015d820 tx=0x7f4d58004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:31.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.846+0000 7f4d55ffb700 1 -- 172.21.15.49:0/335877060 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58012430 con 0x7f4d6015e380 2023-07-21T22:10:31.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.846+0000 7f4d55ffb700 1 -- 172.21.15.49:0/335877060 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d58020070 con 0x7f4d6015e380 2023-07-21T22:10:31.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.846+0000 7f4d67908700 1 -- 172.21.15.49:0/335877060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d600c3000 con 0x7f4d6015e380 2023-07-21T22:10:31.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.846+0000 7f4d55ffb700 1 -- 172.21.15.49:0/335877060 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580098f0 con 0x7f4d6015e380 2023-07-21T22:10:31.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.846+0000 7f4d67908700 1 -- 172.21.15.49:0/335877060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d600c35c0 con 0x7f4d6015e380 2023-07-21T22:10:31.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.846+0000 7f4d67908700 1 -- 172.21.15.49:0/335877060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6004dd50 con 0x7f4d6015e380 2023-07-21T22:10:31.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.850+0000 7f4d55ffb700 1 -- 172.21.15.49:0/335877060 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4d58004040 con 0x7f4d6015e380 2023-07-21T22:10:31.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.850+0000 7f4d55ffb700 1 --2- 172.21.15.49:0/335877060 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4d440662f0 0x7f4d440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:31.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.850+0000 7f4d55ffb700 1 -- 172.21.15.49:0/335877060 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4d58022070 con 0x7f4d6015e380 2023-07-21T22:10:31.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.850+0000 7f4d656a4700 1 --2- 172.21.15.49:0/335877060 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4d440662f0 0x7f4d440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:31.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.854+0000 7f4d656a4700 1 --2- 172.21.15.49:0/335877060 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4d440662f0 0x7f4d440687a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c007fd0 tx=0x7f4d5c007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:31.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:31.858+0000 7f4d55ffb700 1 -- 172.21.15.49:0/335877060 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4d580566f0 con 0x7f4d6015e380 2023-07-21T22:10:32.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.030+0000 7f4d67908700 1 -- 172.21.15.49:0/335877060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4d6006db10 con 0x7f4d6015e380 2023-07-21T22:10:32.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.030+0000 7f4d55ffb700 1 -- 172.21.15.49:0/335877060 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4d58056280 con 0x7f4d6015e380 2023-07-21T22:10:32.075 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:10:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.038+0000 7f4d67908700 1 -- 172.21.15.49:0/335877060 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4d440662f0 msgr2=0x7f4d440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.038+0000 7f4d67908700 1 --2- 172.21.15.49:0/335877060 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4d440662f0 0x7f4d440687a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c007fd0 tx=0x7f4d5c007de0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.038+0000 7f4d67908700 1 -- 172.21.15.49:0/335877060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d6015e380 msgr2=0x7f4d600ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.038+0000 7f4d67908700 1 --2- 172.21.15.49:0/335877060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d6015e380 0x7f4d600ccda0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4d6015d820 tx=0x7f4d58004af0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.038+0000 7f4d67908700 1 -- 172.21.15.49:0/335877060 shutdown_connections 2023-07-21T22:10:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.038+0000 7f4d67908700 1 --2- 172.21.15.49:0/335877060 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4d440662f0 0x7f4d440687a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.038+0000 7f4d67908700 1 --2- 172.21.15.49:0/335877060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d6015e380 0x7f4d600ccda0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.038+0000 7f4d67908700 1 --2- 172.21.15.49:0/335877060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d600cb2f0 0x7f4d600c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.038+0000 7f4d67908700 1 --2- 172.21.15.49:0/335877060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d600b3a50 0x7f4d60153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.038+0000 7f4d67908700 1 -- 172.21.15.49:0/335877060 >> 172.21.15.49:0/335877060 conn(0x7f4d6006e960 msgr2=0x7f4d600cabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:32.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.038+0000 7f4d67908700 1 -- 172.21.15.49:0/335877060 shutdown_connections 2023-07-21T22:10:32.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.038+0000 7f4d67908700 1 -- 172.21.15.49:0/335877060 wait complete. 2023-07-21T22:10:32.102 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:10:32.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.234+0000 7ff4895d5700 1 Processor -- start 2023-07-21T22:10:32.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.234+0000 7ff4895d5700 1 -- start start 2023-07-21T22:10:32.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.234+0000 7ff4895d5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff4840cb5d0 0x7ff484159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:32.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.234+0000 7ff4895d5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4840cb9f0 con 0x7ff48406d540 2023-07-21T22:10:32.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.234+0000 7ff4895d5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48406c780 con 0x7ff484070600 2023-07-21T22:10:32.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.234+0000 7ff4895d5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48415a170 con 0x7ff4840cb5d0 2023-07-21T22:10:32.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.234+0000 7ff47bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff48406d540 0x7ff4840c87f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50564/0 (socket says 172.21.15.49:50564) 2023-07-21T22:10:32.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.234+0000 7ff47bfff700 1 -- 172.21.15.49:0/3587095577 learned_addr learned my addr 172.21.15.49:0/3587095577 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:32.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.234+0000 7ff4837fe700 1 --2- 172.21.15.49:0/3587095577 >> v2:172.21.15.150:3300/0 conn(0x7ff4840cb5d0 0x7ff484159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:32.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.234+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612517113 0 0) 0x7ff4840cb9f0 con 0x7ff48406d540 2023-07-21T22:10:32.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.234+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4700057e0 con 0x7ff48406d540 2023-07-21T22:10:32.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.234+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019702771 0 0) 0x7ff48406c780 con 0x7ff484070600 2023-07-21T22:10:32.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.234+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4840cb9f0 con 0x7ff484070600 2023-07-21T22:10:32.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 528435907 0 0) 0x7ff4700057e0 con 0x7ff48406d540 2023-07-21T22:10:32.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 >> v2:172.21.15.150:3300/0 conn(0x7ff4840cb5d0 msgr2=0x7ff484159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:32.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 --2- 172.21.15.49:0/3587095577 >> v2:172.21.15.150:3300/0 conn(0x7ff4840cb5d0 0x7ff484159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 >> v1:172.21.15.150:6789/0 conn(0x7ff484070600 legacy=0x7ff4840709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48406ca60 con 0x7ff48406d540 2023-07-21T22:10:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7ff46c001670 con 0x7ff48406d540 2023-07-21T22:10:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 >> v1:172.21.15.49:6789/0 conn(0x7ff48406d540 legacy=0x7ff4840c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 --2- 172.21.15.49:0/3587095577 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff470005e30 0x7ff470006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 --2- 172.21.15.49:0/3587095577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff470006a80 0x7ff470006ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 --2- 172.21.15.49:0/3587095577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff470007430 0x7ff470010040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48415a170 con 0x7ff470006a80 2023-07-21T22:10:32.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700105b0 con 0x7ff470007430 2023-07-21T22:10:32.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff470010770 con 0x7ff470005e30 2023-07-21T22:10:32.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff47bfff700 1 --2- 172.21.15.49:0/3587095577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff470006a80 0x7ff470006ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:32.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff482ffd700 1 --2- 172.21.15.49:0/3587095577 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff470005e30 0x7ff470006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:32.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4837fe700 1 --2- 172.21.15.49:0/3587095577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff470007430 0x7ff470010040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:32.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff47bfff700 1 -- 172.21.15.49:0/3587095577 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff470005e30 msgr2=0x7ff470006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:32.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff47bfff700 1 --2- 172.21.15.49:0/3587095577 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff470005e30 0x7ff470006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff47bfff700 1 -- 172.21.15.49:0/3587095577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff470007430 msgr2=0x7ff470010040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:32.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff47bfff700 1 --2- 172.21.15.49:0/3587095577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff470007430 0x7ff470010040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff47bfff700 1 -- 172.21.15.49:0/3587095577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4700057e0 con 0x7ff470006a80 2023-07-21T22:10:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4837fe700 1 -- 172.21.15.49:0/3587095577 reap_dead start 2023-07-21T22:10:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff47bfff700 1 --2- 172.21.15.49:0/3587095577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff470006a80 0x7ff470006ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff46c001eb0 tx=0x7ff470007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729f153089d83fe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00cd40 con 0x7ff470006a80 2023-07-21T22:10:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c005980 con 0x7ff470006a80 2023-07-21T22:10:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.238+0000 7ff4827fc700 1 -- 172.21.15.49:0/3587095577 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c005d30 con 0x7ff470006a80 2023-07-21T22:10:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.242+0000 7ff4895d5700 1 -- 172.21.15.49:0/3587095577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff470006a80 msgr2=0x7ff470006ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.242+0000 7ff4895d5700 1 --2- 172.21.15.49:0/3587095577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff470006a80 0x7ff470006ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff46c001eb0 tx=0x7ff470007ab0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.242+0000 7ff4895d5700 1 -- 172.21.15.49:0/3587095577 shutdown_connections 2023-07-21T22:10:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.242+0000 7ff4895d5700 1 --2- 172.21.15.49:0/3587095577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff470006a80 0x7ff470006ef0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.242+0000 7ff4895d5700 1 -- 172.21.15.49:0/3587095577 >> 172.21.15.49:0/3587095577 conn(0x7ff48406f5a0 msgr2=0x7ff4840cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.242+0000 7ff4895d5700 1 -- 172.21.15.49:0/3587095577 shutdown_connections 2023-07-21T22:10:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.242+0000 7ff4895d5700 1 -- 172.21.15.49:0/3587095577 wait complete. 2023-07-21T22:10:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.242+0000 7ff4895d5700 1 Processor -- start 2023-07-21T22:10:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.242+0000 7ff4895d5700 1 -- start start 2023-07-21T22:10:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff4895d5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff470006a80 0x7ff4840c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff4895d5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4840cc0a0 0x7ff48414fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff4895d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4841e3560 0x7ff4841e39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff4895d5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff484150240 con 0x7ff4840cc0a0 2023-07-21T22:10:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff4895d5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4841e3f10 con 0x7ff470006a80 2023-07-21T22:10:32.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff4895d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4840cc510 con 0x7ff4841e3560 2023-07-21T22:10:32.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff47bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4840cc0a0 0x7ff48414fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:32.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff47bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4840cc0a0 0x7ff48414fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34320/0 (socket says 172.21.15.49:34320) 2023-07-21T22:10:32.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff47bfff700 1 -- 172.21.15.49:0/4158919179 learned_addr learned my addr 172.21.15.49:0/4158919179 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:32.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff4837fe700 1 --2- 172.21.15.49:0/4158919179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4841e3560 0x7ff4841e39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:32.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff482ffd700 1 --2- 172.21.15.49:0/4158919179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff470006a80 0x7ff4840c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:32.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff47bfff700 1 -- 172.21.15.49:0/4158919179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4841e3560 msgr2=0x7ff4841e39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:32.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff47bfff700 1 --2- 172.21.15.49:0/4158919179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4841e3560 0x7ff4841e39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff47bfff700 1 -- 172.21.15.49:0/4158919179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff470006a80 msgr2=0x7ff4840c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:32.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff47bfff700 1 --2- 172.21.15.49:0/4158919179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff470006a80 0x7ff4840c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff47bfff700 1 -- 172.21.15.49:0/4158919179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4840c5270 con 0x7ff4840cc0a0 2023-07-21T22:10:32.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff47bfff700 1 --2- 172.21.15.49:0/4158919179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4840cc0a0 0x7ff48414fd00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff470010580 tx=0x7ff46c001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:32.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff47b7fe700 1 -- 172.21.15.49:0/4158919179 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c007bb0 con 0x7ff4840cc0a0 2023-07-21T22:10:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff47b7fe700 1 -- 172.21.15.49:0/4158919179 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c00cd50 con 0x7ff4840cc0a0 2023-07-21T22:10:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff4895d5700 1 -- 172.21.15.49:0/4158919179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4840cc7a0 con 0x7ff4840cc0a0 2023-07-21T22:10:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff47b7fe700 1 -- 172.21.15.49:0/4158919179 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c004ad0 con 0x7ff4840cc0a0 2023-07-21T22:10:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.246+0000 7ff4895d5700 1 -- 172.21.15.49:0/4158919179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4840ccd60 con 0x7ff4840cc0a0 2023-07-21T22:10:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.250+0000 7ff4895d5700 1 -- 172.21.15.49:0/4158919179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48404dcb0 con 0x7ff4840cc0a0 2023-07-21T22:10:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.250+0000 7ff47b7fe700 1 -- 172.21.15.49:0/4158919179 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff46c004c30 con 0x7ff4840cc0a0 2023-07-21T22:10:32.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.250+0000 7ff47b7fe700 1 --2- 172.21.15.49:0/4158919179 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff464066320 0x7ff4640687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:32.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.250+0000 7ff47b7fe700 1 -- 172.21.15.49:0/4158919179 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff46c0845a0 con 0x7ff4840cc0a0 2023-07-21T22:10:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.250+0000 7ff482ffd700 1 --2- 172.21.15.49:0/4158919179 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff464066320 0x7ff4640687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.254+0000 7ff482ffd700 1 --2- 172.21.15.49:0/4158919179 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff464066320 0x7ff4640687d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff474000c00 tx=0x7ff474009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:32.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.258+0000 7ff47b7fe700 1 -- 172.21.15.49:0/4158919179 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff46c051f20 con 0x7ff4840cc0a0 2023-07-21T22:10:32.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.442+0000 7ff4895d5700 1 -- 172.21.15.49:0/4158919179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff48406cd10 con 0x7ff4840cc0a0 2023-07-21T22:10:32.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.442+0000 7ff47b7fe700 1 -- 172.21.15.49:0/4158919179 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v22) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff46c055540 con 0x7ff4840cc0a0 2023-07-21T22:10:32.486 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:32.486 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-07-21T22:10:32.486 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:10:32.486 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-07-21T22:10:32.487 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-07-21T22:10:32.487 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:10:32.487 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:10:32.487 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-07-21T22:10:32.487 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-07-21T22:10:32.487 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:10:32.487 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-07-21T22:10:32.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.446+0000 7ff4895d5700 1 -- 172.21.15.49:0/4158919179 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff464066320 msgr2=0x7ff4640687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:32.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.446+0000 7ff4895d5700 1 --2- 172.21.15.49:0/4158919179 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff464066320 0x7ff4640687d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff474000c00 tx=0x7ff474009040 comp rx=0 tx=0).stop 2023-07-21T22:10:32.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.446+0000 7ff4895d5700 1 -- 172.21.15.49:0/4158919179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4840cc0a0 msgr2=0x7ff48414fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:32.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.446+0000 7ff4895d5700 1 --2- 172.21.15.49:0/4158919179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4840cc0a0 0x7ff48414fd00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff470010580 tx=0x7ff46c001980 comp rx=0 tx=0).stop 2023-07-21T22:10:32.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.446+0000 7ff4895d5700 1 -- 172.21.15.49:0/4158919179 shutdown_connections 2023-07-21T22:10:32.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.446+0000 7ff4895d5700 1 --2- 172.21.15.49:0/4158919179 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff464066320 0x7ff4640687d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.446+0000 7ff4895d5700 1 --2- 172.21.15.49:0/4158919179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4840cc0a0 0x7ff48414fd00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.446+0000 7ff4895d5700 1 --2- 172.21.15.49:0/4158919179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4841e3560 0x7ff4841e39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.446+0000 7ff4895d5700 1 --2- 172.21.15.49:0/4158919179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff470006a80 0x7ff4840c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.446+0000 7ff4895d5700 1 -- 172.21.15.49:0/4158919179 >> 172.21.15.49:0/4158919179 conn(0x7ff48406f5a0 msgr2=0x7ff4840b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:32.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.446+0000 7ff4895d5700 1 -- 172.21.15.49:0/4158919179 shutdown_connections 2023-07-21T22:10:32.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.446+0000 7ff4895d5700 1 -- 172.21.15.49:0/4158919179 wait complete. 2023-07-21T22:10:32.511 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:10:32.511 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:10:32.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.646+0000 7fcda6369700 1 Processor -- start 2023-07-21T22:10:32.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.646+0000 7fcda6369700 1 -- start start 2023-07-21T22:10:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.646+0000 7fcda6369700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcda0159ea0 0x7fcda00c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.646+0000 7fcda6369700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcda00cb8a0 0x7fcda015e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.646+0000 7fcda6369700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda015d8a0 con 0x7fcda00afce0 2023-07-21T22:10:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.646+0000 7fcda6369700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda00ca640 con 0x7fcda00cb8a0 2023-07-21T22:10:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.646+0000 7fcda6369700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00ca920 con 0x7fcda0159ea0 2023-07-21T22:10:32.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.646+0000 7fcd977fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcda00cb8a0 0x7fcda015e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:32.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.646+0000 7fcd9ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcda0159ea0 0x7fcda00c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:32.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.646+0000 7fcd977fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcda00cb8a0 0x7fcda015e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:53404/0 (socket says 172.21.15.49:53404) 2023-07-21T22:10:32.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcd977fe700 1 -- 172.21.15.49:0/4088252898 learned_addr learned my addr 172.21.15.49:0/4088252898 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:32.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcd9ffff700 1 -- 172.21.15.49:0/4088252898 >> v2:172.21.15.150:3300/0 conn(0x7fcda00cb8a0 msgr2=0x7fcda015e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:32.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcd9ffff700 1 --2- 172.21.15.49:0/4088252898 >> v2:172.21.15.150:3300/0 conn(0x7fcda00cb8a0 0x7fcda015e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcd9ffff700 1 -- 172.21.15.49:0/4088252898 >> v1:172.21.15.150:6789/0 conn(0x7fcda00afce0 legacy=0x7fcda00c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcd9ffff700 1 -- 172.21.15.49:0/4088252898 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda015db40 con 0x7fcda0159ea0 2023-07-21T22:10:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcd977fe700 1 --2- 172.21.15.49:0/4088252898 >> v2:172.21.15.150:3300/0 conn(0x7fcda00cb8a0 0x7fcda015e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcd9f7fe700 1 -- 172.21.15.49:0/4088252898 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825330496 0 0) 0x7fcda015d8a0 con 0x7fcda00afce0 2023-07-21T22:10:32.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcd9ffff700 1 --2- 172.21.15.49:0/4088252898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcda0159ea0 0x7fcda00c9c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009d90 tx=0x7fcd9000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caf60f0c94d71fca server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:32.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcd9f7fe700 1 -- 172.21.15.49:0/4088252898 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000e070 con 0x7fcda0159ea0 2023-07-21T22:10:32.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcd9f7fe700 1 -- 172.21.15.49:0/4088252898 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9000bb20 con 0x7fcda0159ea0 2023-07-21T22:10:32.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcd9f7fe700 1 -- 172.21.15.49:0/4088252898 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90012430 con 0x7fcda0159ea0 2023-07-21T22:10:32.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcda6369700 1 -- 172.21.15.49:0/4088252898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcda0159ea0 msgr2=0x7fcda00c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:32.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcda6369700 1 --2- 172.21.15.49:0/4088252898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcda0159ea0 0x7fcda00c9c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009d90 tx=0x7fcd9000b330 comp rx=0 tx=0).stop 2023-07-21T22:10:32.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcda6369700 1 -- 172.21.15.49:0/4088252898 shutdown_connections 2023-07-21T22:10:32.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcda6369700 1 --2- 172.21.15.49:0/4088252898 >> v2:172.21.15.150:3300/0 conn(0x7fcda00cb8a0 0x7fcda015e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcda6369700 1 --2- 172.21.15.49:0/4088252898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcda0159ea0 0x7fcda00c9c60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcda6369700 1 -- 172.21.15.49:0/4088252898 >> 172.21.15.49:0/4088252898 conn(0x7fcda00cace0 msgr2=0x7fcda00cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcda6369700 1 -- 172.21.15.49:0/4088252898 shutdown_connections 2023-07-21T22:10:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.650+0000 7fcda6369700 1 -- 172.21.15.49:0/4088252898 wait complete. 2023-07-21T22:10:32.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.654+0000 7fcda6369700 1 Processor -- start 2023-07-21T22:10:32.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.654+0000 7fcda6369700 1 -- start start 2023-07-21T22:10:32.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda6369700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcda00afce0 0x7fcda0156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:32.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda6369700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcda00cb8a0 0x7fcda015a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:32.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda6369700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcda0159ea0 0x7fcda01e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:32.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda6369700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda01e4a50 con 0x7fcda0159ea0 2023-07-21T22:10:32.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda6369700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda0155b90 con 0x7fcda00afce0 2023-07-21T22:10:32.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda6369700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda01e40b0 con 0x7fcda00cb8a0 2023-07-21T22:10:32.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda4906700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcda0159ea0 0x7fcda01e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:32.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda4906700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcda0159ea0 0x7fcda01e4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34324/0 (socket says 172.21.15.49:34324) 2023-07-21T22:10:32.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda4906700 1 -- 172.21.15.49:0/1876875978 learned_addr learned my addr 172.21.15.49:0/1876875978 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:32.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcd9ffff700 1 --2- 172.21.15.49:0/1876875978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcda00afce0 0x7fcda0156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:32.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcd977fe700 1 --2- 172.21.15.49:0/1876875978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcda00cb8a0 0x7fcda015a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:32.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda4906700 1 -- 172.21.15.49:0/1876875978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcda00cb8a0 msgr2=0x7fcda015a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:32.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda4906700 1 --2- 172.21.15.49:0/1876875978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcda00cb8a0 0x7fcda015a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda4906700 1 -- 172.21.15.49:0/1876875978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcda00afce0 msgr2=0x7fcda0156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:32.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda4906700 1 --2- 172.21.15.49:0/1876875978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcda00afce0 0x7fcda0156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:32.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda4906700 1 -- 172.21.15.49:0/1876875978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd88009570 con 0x7fcda0159ea0 2023-07-21T22:10:32.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda4906700 1 --2- 172.21.15.49:0/1876875978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcda0159ea0 0x7fcda01e4e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd980011e0 tx=0x7fcd9800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:32.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcd9d7fa700 1 -- 172.21.15.49:0/1876875978 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd980054e0 con 0x7fcda0159ea0 2023-07-21T22:10:32.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcd9d7fa700 1 -- 172.21.15.49:0/1876875978 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd980036a0 con 0x7fcda0159ea0 2023-07-21T22:10:32.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcd9d7fa700 1 -- 172.21.15.49:0/1876875978 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98003a50 con 0x7fcda0159ea0 2023-07-21T22:10:32.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda6369700 1 -- 172.21.15.49:0/1876875978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd90009a70 con 0x7fcda0159ea0 2023-07-21T22:10:32.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.658+0000 7fcda6369700 1 -- 172.21.15.49:0/1876875978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda01e4670 con 0x7fcda0159ea0 2023-07-21T22:10:32.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.662+0000 7fcda6369700 1 -- 172.21.15.49:0/1876875978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda01e4b90 con 0x7fcda0159ea0 2023-07-21T22:10:32.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.662+0000 7fcd9d7fa700 1 -- 172.21.15.49:0/1876875978 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcd98003bb0 con 0x7fcda0159ea0 2023-07-21T22:10:32.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.666+0000 7fcd9d7fa700 1 --2- 172.21.15.49:0/1876875978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd800662f0 0x7fcd800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:32.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.666+0000 7fcd9d7fa700 1 -- 172.21.15.49:0/1876875978 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcd98082d90 con 0x7fcda0159ea0 2023-07-21T22:10:32.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.666+0000 7fcd9ffff700 1 --2- 172.21.15.49:0/1876875978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd800662f0 0x7fcd800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:32.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.666+0000 7fcd9ffff700 1 --2- 172.21.15.49:0/1876875978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd800662f0 0x7fcd800687a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd90014040 tx=0x7fcd90011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:32.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.670+0000 7fcd9d7fa700 1 -- 172.21.15.49:0/1876875978 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcda01e4b90 con 0x7fcda0159ea0 2023-07-21T22:10:32.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:32.850+0000 7fcda6369700 1 -- 172.21.15.49:0/1876875978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcda01e4b90 con 0x7fcda0159ea0 2023-07-21T22:10:33.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.142+0000 7fcd9d7fa700 1 -- 172.21.15.49:0/1876875978 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcda01e4b90 con 0x7fcda0159ea0 2023-07-21T22:10:33.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.150+0000 7fcda6369700 1 -- 172.21.15.49:0/1876875978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd800662f0 msgr2=0x7fcd800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:33.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.150+0000 7fcda6369700 1 --2- 172.21.15.49:0/1876875978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd800662f0 0x7fcd800687a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd90014040 tx=0x7fcd90011000 comp rx=0 tx=0).stop 2023-07-21T22:10:33.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.150+0000 7fcda6369700 1 -- 172.21.15.49:0/1876875978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcda0159ea0 msgr2=0x7fcda01e4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:33.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.150+0000 7fcda6369700 1 --2- 172.21.15.49:0/1876875978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcda0159ea0 0x7fcda01e4e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd980011e0 tx=0x7fcd9800c800 comp rx=0 tx=0).stop 2023-07-21T22:10:33.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.150+0000 7fcda6369700 1 -- 172.21.15.49:0/1876875978 shutdown_connections 2023-07-21T22:10:33.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.150+0000 7fcda6369700 1 --2- 172.21.15.49:0/1876875978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd800662f0 0x7fcd800687a0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd90014040 tx=0x7fcd90011000 comp rx=0 tx=0).stop 2023-07-21T22:10:33.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.150+0000 7fcda6369700 1 --2- 172.21.15.49:0/1876875978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcda0159ea0 0x7fcda01e4e70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:33.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.150+0000 7fcda6369700 1 --2- 172.21.15.49:0/1876875978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcda00cb8a0 0x7fcda015a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:33.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.150+0000 7fcda6369700 1 --2- 172.21.15.49:0/1876875978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcda00afce0 0x7fcda0156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:33.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.150+0000 7fcda6369700 1 -- 172.21.15.49:0/1876875978 >> 172.21.15.49:0/1876875978 conn(0x7fcda00cace0 msgr2=0x7fcda00b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:33.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.154+0000 7fcda6369700 1 -- 172.21.15.49:0/1876875978 shutdown_connections 2023-07-21T22:10:33.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.154+0000 7fcda6369700 1 -- 172.21.15.49:0/1876875978 wait complete. 2023-07-21T22:10:33.197 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-07-21T22:10:33.216 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-07-21T22:10:33.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.366+0000 7f596c4ee700 1 Processor -- start 2023-07-21T22:10:33.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.366+0000 7f596c4ee700 1 -- start start 2023-07-21T22:10:33.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f596c4ee700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59640b4040 0x7f59640cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:33.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f596c4ee700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f59640b4410 0x7f59640b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:33.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f596c4ee700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59640b8170 con 0x7f596415f960 2023-07-21T22:10:33.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f596c4ee700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59640cfa20 con 0x7f59640b4410 2023-07-21T22:10:33.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f596c4ee700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59640d03c0 con 0x7f59640b4040 2023-07-21T22:10:33.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f596a28a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59640b4040 0x7f59640cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:33.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f5969a89700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f59640b4410 0x7f59640b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:33.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f596a28a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59640b4040 0x7f59640cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:42818/0 (socket says 172.21.15.49:42818) 2023-07-21T22:10:33.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f596aa8b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f596415f960 0x7f596415fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:39978/0 (socket says 172.21.15.49:39978) 2023-07-21T22:10:33.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f596aa8b700 1 -- 172.21.15.49:0/2533476067 learned_addr learned my addr 172.21.15.49:0/2533476067 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:33.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f5969a89700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f59640b4410 0x7f59640b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:53426/0 (socket says 172.21.15.49:53426) 2023-07-21T22:10:33.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f5969a89700 1 -- 172.21.15.49:0/2533476067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59640b4040 msgr2=0x7f59640cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:33.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f5969a89700 1 --2- 172.21.15.49:0/2533476067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59640b4040 0x7f59640cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:33.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f5969a89700 1 -- 172.21.15.49:0/2533476067 >> v1:172.21.15.150:6789/0 conn(0x7f596415f960 legacy=0x7f596415fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:33.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f5969a89700 1 -- 172.21.15.49:0/2533476067 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59640d2350 con 0x7f59640b4410 2023-07-21T22:10:33.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f596a28a700 1 --2- 172.21.15.49:0/2533476067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59640b4040 0x7f59640cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:33.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.370+0000 7f5969a89700 1 --2- 172.21.15.49:0/2533476067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640b4410 0x7f59640b4860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5954009850 tx=0x7f5954009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0d7e54a18c0ee92 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:33.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.374+0000 7f5969288700 1 -- 172.21.15.49:0/2533476067 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954011830 con 0x7f59640b4410 2023-07-21T22:10:33.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.374+0000 7f5969288700 1 -- 172.21.15.49:0/2533476067 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5954011990 con 0x7f59640b4410 2023-07-21T22:10:33.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.374+0000 7f5969288700 1 -- 172.21.15.49:0/2533476067 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954011d40 con 0x7f59640b4410 2023-07-21T22:10:33.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.374+0000 7f596c4ee700 1 -- 172.21.15.49:0/2533476067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640b4410 msgr2=0x7f59640b4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:33.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.374+0000 7f596c4ee700 1 --2- 172.21.15.49:0/2533476067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640b4410 0x7f59640b4860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5954009850 tx=0x7f5954009b60 comp rx=0 tx=0).stop 2023-07-21T22:10:33.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.374+0000 7f596c4ee700 1 -- 172.21.15.49:0/2533476067 shutdown_connections 2023-07-21T22:10:33.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.374+0000 7f596c4ee700 1 --2- 172.21.15.49:0/2533476067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640b4410 0x7f59640b4860 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:33.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.374+0000 7f596c4ee700 1 --2- 172.21.15.49:0/2533476067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59640b4040 0x7f59640cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:33.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.374+0000 7f596c4ee700 1 -- 172.21.15.49:0/2533476067 >> 172.21.15.49:0/2533476067 conn(0x7f59640658e0 msgr2=0x7f596406fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:33.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.374+0000 7f596c4ee700 1 -- 172.21.15.49:0/2533476067 shutdown_connections 2023-07-21T22:10:33.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.374+0000 7f596c4ee700 1 -- 172.21.15.49:0/2533476067 wait complete. 2023-07-21T22:10:33.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.378+0000 7f596c4ee700 1 Processor -- start 2023-07-21T22:10:33.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.378+0000 7f596c4ee700 1 -- start start 2023-07-21T22:10:33.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.378+0000 7f596c4ee700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59640b4040 0x7f59640c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:33.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596c4ee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640b4410 0x7f596414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:33.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596c4ee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f596415f960 0x7f596415d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:33.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596c4ee700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59640caf80 con 0x7f596415f960 2023-07-21T22:10:33.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596c4ee700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596414ee50 con 0x7f59640b4410 2023-07-21T22:10:33.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596c4ee700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59640c65c0 con 0x7f59640b4040 2023-07-21T22:10:33.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596aa8b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f596415f960 0x7f596415d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:33.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f5969a89700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640b4410 0x7f596414dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:33.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596a28a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59640b4040 0x7f59640c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:33.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f5969a89700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640b4410 0x7f596414dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:53442/0 (socket says 172.21.15.49:53442) 2023-07-21T22:10:33.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f5969a89700 1 -- 172.21.15.49:0/1791211838 learned_addr learned my addr 172.21.15.49:0/1791211838 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:33.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596aa8b700 1 -- 172.21.15.49:0/1791211838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59640b4040 msgr2=0x7f59640c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:33.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596aa8b700 1 --2- 172.21.15.49:0/1791211838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59640b4040 0x7f59640c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:33.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596aa8b700 1 -- 172.21.15.49:0/1791211838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640b4410 msgr2=0x7f596414dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:33.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596aa8b700 1 --2- 172.21.15.49:0/1791211838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640b4410 0x7f596414dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:33.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596aa8b700 1 -- 172.21.15.49:0/1791211838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600094b0 con 0x7f596415f960 2023-07-21T22:10:33.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596aa8b700 1 --2- 172.21.15.49:0/1791211838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f596415f960 0x7f596415d5e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f595c00caa0 tx=0x7f595c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:33.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f595affd700 1 -- 172.21.15.49:0/1791211838 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c0074e0 con 0x7f596415f960 2023-07-21T22:10:33.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f595affd700 1 -- 172.21.15.49:0/1791211838 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c007640 con 0x7f596415f960 2023-07-21T22:10:33.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f595affd700 1 -- 172.21.15.49:0/1791211838 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c0079b0 con 0x7f596415f960 2023-07-21T22:10:33.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596c4ee700 1 -- 172.21.15.49:0/1791211838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59540094b0 con 0x7f596415f960 2023-07-21T22:10:33.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.382+0000 7f596c4ee700 1 -- 172.21.15.49:0/1791211838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59640c8ea0 con 0x7f596415f960 2023-07-21T22:10:33.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.386+0000 7f596c4ee700 1 -- 172.21.15.49:0/1791211838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596404dd50 con 0x7f596415f960 2023-07-21T22:10:33.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.386+0000 7f595affd700 1 -- 172.21.15.49:0/1791211838 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f595c01b3b0 con 0x7f596415f960 2023-07-21T22:10:33.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.390+0000 7f595affd700 1 --2- 172.21.15.49:0/1791211838 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f59480662f0 0x7f59480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:33.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.390+0000 7f595affd700 1 -- 172.21.15.49:0/1791211838 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f595c0836b0 con 0x7f596415f960 2023-07-21T22:10:33.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.390+0000 7f596a28a700 1 --2- 172.21.15.49:0/1791211838 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f59480662f0 0x7f59480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:33.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.390+0000 7f596a28a700 1 --2- 172.21.15.49:0/1791211838 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f59480662f0 0x7f59480687a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5960009d80 tx=0x7f5960009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:33.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.394+0000 7f595affd700 1 -- 172.21.15.49:0/1791211838 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f595c050e30 con 0x7f596415f960 2023-07-21T22:10:33.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:33.570+0000 7f596c4ee700 1 -- 172.21.15.49:0/1791211838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f59640b1d00 con 0x7f596415f960 2023-07-21T22:10:34.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.158+0000 7f595affd700 1 -- 172.21.15.49:0/1791211838 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v24) v1 ==== 171+0+0 (secure 0 0 0) 0x7f595c0210d0 con 0x7f596415f960 2023-07-21T22:10:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.166+0000 7f596c4ee700 1 -- 172.21.15.49:0/1791211838 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f59480662f0 msgr2=0x7f59480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.166+0000 7f596c4ee700 1 --2- 172.21.15.49:0/1791211838 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f59480662f0 0x7f59480687a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5960009d80 tx=0x7f5960009240 comp rx=0 tx=0).stop 2023-07-21T22:10:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.166+0000 7f596c4ee700 1 -- 172.21.15.49:0/1791211838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f596415f960 msgr2=0x7f596415d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.166+0000 7f596c4ee700 1 --2- 172.21.15.49:0/1791211838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f596415f960 0x7f596415d5e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f595c00caa0 tx=0x7f595c00cad0 comp rx=0 tx=0).stop 2023-07-21T22:10:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.166+0000 7f596c4ee700 1 -- 172.21.15.49:0/1791211838 shutdown_connections 2023-07-21T22:10:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.166+0000 7f596c4ee700 1 --2- 172.21.15.49:0/1791211838 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f59480662f0 0x7f59480687a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.166+0000 7f596c4ee700 1 --2- 172.21.15.49:0/1791211838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f596415f960 0x7f596415d5e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.166+0000 7f596c4ee700 1 --2- 172.21.15.49:0/1791211838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640b4410 0x7f596414dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.166+0000 7f596c4ee700 1 --2- 172.21.15.49:0/1791211838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59640b4040 0x7f59640c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.166+0000 7f596c4ee700 1 -- 172.21.15.49:0/1791211838 >> 172.21.15.49:0/1791211838 conn(0x7f59640658e0 msgr2=0x7f59640cfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:34.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.166+0000 7f596c4ee700 1 -- 172.21.15.49:0/1791211838 shutdown_connections 2023-07-21T22:10:34.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.166+0000 7f596c4ee700 1 -- 172.21.15.49:0/1791211838 wait complete. 2023-07-21T22:10:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-07-21T22:10:34.241 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:10:34.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.382+0000 7f1094881700 1 Processor -- start 2023-07-21T22:10:34.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.382+0000 7f1094881700 1 -- start start 2023-07-21T22:10:34.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.382+0000 7f1094881700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1090159be0 0x7f10900c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:34.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.382+0000 7f1094881700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10900ca550 0x7f109006d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:34.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.382+0000 7f1094881700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f109006d6d0 0x7f10900698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:34.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.382+0000 7f1094881700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10900c8b80 con 0x7f109006d6d0 2023-07-21T22:10:34.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.382+0000 7f1094881700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109006db90 con 0x7f1090159be0 2023-07-21T22:10:34.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.382+0000 7f1094881700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109006de70 con 0x7f10900ca550 2023-07-21T22:10:34.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f108f59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f109006d6d0 0x7f10900698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:34.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f108ed9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1090159be0 0x7f10900c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:34.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f108f59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f109006d6d0 0x7f10900698a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34340/0 (socket says 172.21.15.49:34340) 2023-07-21T22:10:34.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f108f59e700 1 -- 172.21.15.49:0/1305521506 learned_addr learned my addr 172.21.15.49:0/1305521506 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:34.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f108e59c700 1 --2- 172.21.15.49:0/1305521506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10900ca550 0x7f109006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:34.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f108f59e700 1 -- 172.21.15.49:0/1305521506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10900ca550 msgr2=0x7f109006d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:34.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f108f59e700 1 --2- 172.21.15.49:0/1305521506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10900ca550 0x7f109006d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:34.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f108f59e700 1 -- 172.21.15.49:0/1305521506 >> v2:172.21.15.150:3300/0 conn(0x7f1090159be0 msgr2=0x7f10900c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:34.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f108f59e700 1 --2- 172.21.15.49:0/1305521506 >> v2:172.21.15.150:3300/0 conn(0x7f1090159be0 0x7f10900c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:34.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f108f59e700 1 -- 172.21.15.49:0/1305521506 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10900c8810 con 0x7f109006d6d0 2023-07-21T22:10:34.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f108f59e700 1 --2- 172.21.15.49:0/1305521506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f109006d6d0 0x7f10900698a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1090072070 tx=0x7f108800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03d7101c299207d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:34.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f108dd9b700 1 -- 172.21.15.49:0/1305521506 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108800e070 con 0x7f109006d6d0 2023-07-21T22:10:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f108dd9b700 1 -- 172.21.15.49:0/1305521506 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108800b910 con 0x7f109006d6d0 2023-07-21T22:10:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f108dd9b700 1 -- 172.21.15.49:0/1305521506 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108800bcc0 con 0x7f109006d6d0 2023-07-21T22:10:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f1094881700 1 -- 172.21.15.49:0/1305521506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f109006d6d0 msgr2=0x7f10900698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f1094881700 1 --2- 172.21.15.49:0/1305521506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f109006d6d0 0x7f10900698a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1090072070 tx=0x7f108800b330 comp rx=0 tx=0).stop 2023-07-21T22:10:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f1094881700 1 -- 172.21.15.49:0/1305521506 shutdown_connections 2023-07-21T22:10:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f1094881700 1 --2- 172.21.15.49:0/1305521506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10900ca550 0x7f109006d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f1094881700 1 --2- 172.21.15.49:0/1305521506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f109006d6d0 0x7f10900698a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:34.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f1094881700 1 --2- 172.21.15.49:0/1305521506 >> v2:172.21.15.150:3300/0 conn(0x7f1090159be0 0x7f10900c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:34.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f1094881700 1 -- 172.21.15.49:0/1305521506 >> 172.21.15.49:0/1305521506 conn(0x7f10900ce0d0 msgr2=0x7f10900ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:34.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f1094881700 1 -- 172.21.15.49:0/1305521506 shutdown_connections 2023-07-21T22:10:34.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.386+0000 7f1094881700 1 -- 172.21.15.49:0/1305521506 wait complete. 2023-07-21T22:10:34.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.390+0000 7f1094881700 1 Processor -- start 2023-07-21T22:10:34.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.390+0000 7f1094881700 1 -- start start 2023-07-21T22:10:34.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f1094881700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f109006d6d0 0x7f109015bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f1094881700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10900ca550 0x7f10900adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f1094881700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1090159be0 0x7f10900c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f1094881700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900adff0 con 0x7f1090159be0 2023-07-21T22:10:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f1094881700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900ae290 con 0x7f109006d6d0 2023-07-21T22:10:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f1094881700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10900ae570 con 0x7f10900ca550 2023-07-21T22:10:34.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f108f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1090159be0 0x7f10900c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f108f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1090159be0 0x7f10900c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34348/0 (socket says 172.21.15.49:34348) 2023-07-21T22:10:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f108f59e700 1 -- 172.21.15.49:0/1278183337 learned_addr learned my addr 172.21.15.49:0/1278183337 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f108ed9d700 1 --2- 172.21.15.49:0/1278183337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f109006d6d0 0x7f109015bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f108e59c700 1 --2- 172.21.15.49:0/1278183337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10900ca550 0x7f10900adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f108f59e700 1 -- 172.21.15.49:0/1278183337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10900ca550 msgr2=0x7f10900adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f108f59e700 1 --2- 172.21.15.49:0/1278183337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10900ca550 0x7f10900adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f108f59e700 1 -- 172.21.15.49:0/1278183337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f109006d6d0 msgr2=0x7f109015bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:34.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f108f59e700 1 --2- 172.21.15.49:0/1278183337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f109006d6d0 0x7f109015bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:34.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f108f59e700 1 -- 172.21.15.49:0/1278183337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1088009b30 con 0x7f1090159be0 2023-07-21T22:10:34.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f108f59e700 1 --2- 172.21.15.49:0/1278183337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1090159be0 0x7f10900c7550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1088012000 tx=0x7f1088004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:34.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f10777fe700 1 -- 172.21.15.49:0/1278183337 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880099b0 con 0x7f1090159be0 2023-07-21T22:10:34.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f10777fe700 1 -- 172.21.15.49:0/1278183337 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1088004250 con 0x7f1090159be0 2023-07-21T22:10:34.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f10777fe700 1 -- 172.21.15.49:0/1278183337 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088004600 con 0x7f1090159be0 2023-07-21T22:10:34.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f1094881700 1 -- 172.21.15.49:0/1278183337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10900ae850 con 0x7f1090159be0 2023-07-21T22:10:34.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.394+0000 7f1094881700 1 -- 172.21.15.49:0/1278183337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10900c7a90 con 0x7f1090159be0 2023-07-21T22:10:34.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.398+0000 7f1094881700 1 -- 172.21.15.49:0/1278183337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109004dcb0 con 0x7f1090159be0 2023-07-21T22:10:34.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.398+0000 7f10777fe700 1 -- 172.21.15.49:0/1278183337 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1088004760 con 0x7f1090159be0 2023-07-21T22:10:34.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.398+0000 7f10777fe700 1 --2- 172.21.15.49:0/1278183337 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f107c0662f0 0x7f107c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:34.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.398+0000 7f10777fe700 1 -- 172.21.15.49:0/1278183337 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f10880852a0 con 0x7f1090159be0 2023-07-21T22:10:34.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.398+0000 7f108ed9d700 1 --2- 172.21.15.49:0/1278183337 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f107c0662f0 0x7f107c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:34.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.402+0000 7f108ed9d700 1 --2- 172.21.15.49:0/1278183337 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f107c0662f0 0x7f107c0687a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f10900cc770 tx=0x7f1080009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:34.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.406+0000 7f10777fe700 1 -- 172.21.15.49:0/1278183337 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f10880527a0 con 0x7f1090159be0 2023-07-21T22:10:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:34.626+0000 7f1094881700 1 -- 172.21.15.49:0/1278183337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f10900aea40 con 0x7f1090159be0 2023-07-21T22:10:35.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.198+0000 7f10777fe700 1 -- 172.21.15.49:0/1278183337 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1088055dc0 con 0x7f1090159be0 2023-07-21T22:10:35.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.206+0000 7f1094881700 1 -- 172.21.15.49:0/1278183337 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f107c0662f0 msgr2=0x7f107c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:35.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.206+0000 7f1094881700 1 --2- 172.21.15.49:0/1278183337 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f107c0662f0 0x7f107c0687a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f10900cc770 tx=0x7f1080009240 comp rx=0 tx=0).stop 2023-07-21T22:10:35.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.206+0000 7f1094881700 1 -- 172.21.15.49:0/1278183337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1090159be0 msgr2=0x7f10900c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.206+0000 7f1094881700 1 --2- 172.21.15.49:0/1278183337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1090159be0 0x7f10900c7550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1088012000 tx=0x7f1088004af0 comp rx=0 tx=0).stop 2023-07-21T22:10:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.206+0000 7f1094881700 1 -- 172.21.15.49:0/1278183337 shutdown_connections 2023-07-21T22:10:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.206+0000 7f1094881700 1 --2- 172.21.15.49:0/1278183337 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f107c0662f0 0x7f107c0687a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.206+0000 7f1094881700 1 --2- 172.21.15.49:0/1278183337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1090159be0 0x7f10900c7550 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.206+0000 7f1094881700 1 --2- 172.21.15.49:0/1278183337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10900ca550 0x7f10900adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.206+0000 7f1094881700 1 --2- 172.21.15.49:0/1278183337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f109006d6d0 0x7f109015bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.206+0000 7f1094881700 1 -- 172.21.15.49:0/1278183337 >> 172.21.15.49:0/1278183337 conn(0x7f10900ce0d0 msgr2=0x7f10900ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.206+0000 7f1094881700 1 -- 172.21.15.49:0/1278183337 shutdown_connections 2023-07-21T22:10:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.206+0000 7f1094881700 1 -- 172.21.15.49:0/1278183337 wait complete. 2023-07-21T22:10:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 3 and data pool 4 2023-07-21T22:10:35.270 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-07-21T22:10:35.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-07-21T22:10:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.418+0000 7f55e9154700 1 Processor -- start 2023-07-21T22:10:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.418+0000 7f55e9154700 1 -- start start 2023-07-21T22:10:35.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e9154700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e40aff50 0x7f55e40ad500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:35.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e9154700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f55e40cbe30 0x7f55e415fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:35.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e9154700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e4071610 con 0x7f55e40b0320 2023-07-21T22:10:35.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e9154700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e415d5d0 con 0x7f55e40cbe30 2023-07-21T22:10:35.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e9154700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40cdda0 con 0x7f55e40aff50 2023-07-21T22:10:35.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e359e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f55e40b0320 0x7f55e41600a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52530/0 (socket says 172.21.15.49:52530) 2023-07-21T22:10:35.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e359e700 1 -- 172.21.15.49:0/1764368309 learned_addr learned my addr 172.21.15.49:0/1764368309 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:35.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e259c700 1 --2- 172.21.15.49:0/1764368309 >> v2:172.21.15.150:3300/0 conn(0x7f55e40cbe30 0x7f55e415fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:35.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e2d9d700 1 --2- 172.21.15.49:0/1764368309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e40aff50 0x7f55e40ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:35.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e1d9b700 1 -- 172.21.15.49:0/1764368309 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42352464 0 0) 0x7f55e4071610 con 0x7f55e40b0320 2023-07-21T22:10:35.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e1d9b700 1 -- 172.21.15.49:0/1764368309 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55cc0035d0 con 0x7f55e40b0320 2023-07-21T22:10:35.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e259c700 1 -- 172.21.15.49:0/1764368309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e40aff50 msgr2=0x7f55e40ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:35.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e259c700 1 --2- 172.21.15.49:0/1764368309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e40aff50 0x7f55e40ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:35.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e259c700 1 -- 172.21.15.49:0/1764368309 >> v1:172.21.15.49:6789/0 conn(0x7f55e40b0320 legacy=0x7f55e41600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:35.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e259c700 1 -- 172.21.15.49:0/1764368309 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e40caae0 con 0x7f55e40cbe30 2023-07-21T22:10:35.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.422+0000 7f55e259c700 1 --2- 172.21.15.49:0/1764368309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55e40cbe30 0x7f55e415fb60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009850 tx=0x7f55d8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f4a63879c71cc40 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:35.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.426+0000 7f55e1d9b700 1 -- 172.21.15.49:0/1764368309 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8011830 con 0x7f55e40cbe30 2023-07-21T22:10:35.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.426+0000 7f55e1d9b700 1 -- 172.21.15.49:0/1764368309 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d8011990 con 0x7f55e40cbe30 2023-07-21T22:10:35.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.426+0000 7f55e1d9b700 1 -- 172.21.15.49:0/1764368309 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8011d40 con 0x7f55e40cbe30 2023-07-21T22:10:35.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.426+0000 7f55e9154700 1 -- 172.21.15.49:0/1764368309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55e40cbe30 msgr2=0x7f55e415fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:35.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.426+0000 7f55e9154700 1 --2- 172.21.15.49:0/1764368309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55e40cbe30 0x7f55e415fb60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009850 tx=0x7f55d8009b60 comp rx=0 tx=0).stop 2023-07-21T22:10:35.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.426+0000 7f55e9154700 1 -- 172.21.15.49:0/1764368309 shutdown_connections 2023-07-21T22:10:35.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.426+0000 7f55e9154700 1 --2- 172.21.15.49:0/1764368309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55e40cbe30 0x7f55e415fb60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:35.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.426+0000 7f55e9154700 1 --2- 172.21.15.49:0/1764368309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e40aff50 0x7f55e40ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:35.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.426+0000 7f55e9154700 1 -- 172.21.15.49:0/1764368309 >> 172.21.15.49:0/1764368309 conn(0x7f55e40cace0 msgr2=0x7f55e40cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:35.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.426+0000 7f55e9154700 1 -- 172.21.15.49:0/1764368309 shutdown_connections 2023-07-21T22:10:35.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.426+0000 7f55e9154700 1 -- 172.21.15.49:0/1764368309 wait complete. 2023-07-21T22:10:35.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e9154700 1 Processor -- start 2023-07-21T22:10:35.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e9154700 1 -- start start 2023-07-21T22:10:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e9154700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55e40aff50 0x7f55e41e3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e9154700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e40b0320 0x7f55e41e2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e9154700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e40cbe30 0x7f55e40c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e9154700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40c7bf0 con 0x7f55e40b0320 2023-07-21T22:10:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e9154700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40c7ed0 con 0x7f55e40aff50 2023-07-21T22:10:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e9154700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40c81b0 con 0x7f55e40cbe30 2023-07-21T22:10:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e40b0320 0x7f55e41e2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e40b0320 0x7f55e41e2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34468/0 (socket says 172.21.15.49:34468) 2023-07-21T22:10:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e259c700 1 -- 172.21.15.49:0/2226076669 learned_addr learned my addr 172.21.15.49:0/2226076669 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e359e700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e40cbe30 0x7f55e40c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e2d9d700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55e40aff50 0x7f55e41e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e259c700 1 -- 172.21.15.49:0/2226076669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e40cbe30 msgr2=0x7f55e40c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e259c700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e40cbe30 0x7f55e40c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:35.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e259c700 1 -- 172.21.15.49:0/2226076669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55e40aff50 msgr2=0x7f55e41e3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:35.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e259c700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55e40aff50 0x7f55e41e3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:35.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e259c700 1 -- 172.21.15.49:0/2226076669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d80094b0 con 0x7f55e40b0320 2023-07-21T22:10:35.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e2d9d700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55e40aff50 0x7f55e41e3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:10:35.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e359e700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e40cbe30 0x7f55e40c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:10:35.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.430+0000 7f55e259c700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e40b0320 0x7f55e41e2490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f55d8014040 tx=0x7f55d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:35.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.434+0000 7f55cb7fe700 1 -- 172.21.15.49:0/2226076669 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8004590 con 0x7f55e40b0320 2023-07-21T22:10:35.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.434+0000 7f55cb7fe700 1 -- 172.21.15.49:0/2226076669 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d801e070 con 0x7f55e40b0320 2023-07-21T22:10:35.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.434+0000 7f55cb7fe700 1 -- 172.21.15.49:0/2226076669 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8003900 con 0x7f55e40b0320 2023-07-21T22:10:35.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.434+0000 7f55e9154700 1 -- 172.21.15.49:0/2226076669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e40c8490 con 0x7f55e40b0320 2023-07-21T22:10:35.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.434+0000 7f55e9154700 1 -- 172.21.15.49:0/2226076669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e40c7810 con 0x7f55e40b0320 2023-07-21T22:10:35.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.434+0000 7f55e9154700 1 -- 172.21.15.49:0/2226076669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e404dd20 con 0x7f55e40b0320 2023-07-21T22:10:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.438+0000 7f55cb7fe700 1 -- 172.21.15.49:0/2226076669 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55d8003a60 con 0x7f55e40b0320 2023-07-21T22:10:35.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.438+0000 7f55cb7fe700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f55d00662f0 0x7f55d00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:35.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.438+0000 7f55cb7fe700 1 -- 172.21.15.49:0/2226076669 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f55d8084c50 con 0x7f55e40b0320 2023-07-21T22:10:35.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.438+0000 7f55e2d9d700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f55d00662f0 0x7f55d00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:35.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.438+0000 7f55e2d9d700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f55d00662f0 0x7f55d00687a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009b70 tx=0x7f55d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:35.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.442+0000 7f55cb7fe700 1 -- 172.21.15.49:0/2226076669 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55d8052040 con 0x7f55e40b0320 2023-07-21T22:10:35.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:35.630+0000 7f55e9154700 1 -- 172.21.15.49:0/2226076669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f55e40ca560 con 0x7f55e40b0320 2023-07-21T22:10:36.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.194+0000 7f55cb7fe700 1 -- 172.21.15.49:0/2226076669 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v26) v1 ==== 157+0+0 (secure 0 0 0) 0x7f55d8055660 con 0x7f55e40b0320 2023-07-21T22:10:36.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.198+0000 7f55e9154700 1 -- 172.21.15.49:0/2226076669 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f55d00662f0 msgr2=0x7f55d00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:36.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.198+0000 7f55e9154700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f55d00662f0 0x7f55d00687a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009b70 tx=0x7f55d4008040 comp rx=0 tx=0).stop 2023-07-21T22:10:36.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.198+0000 7f55e9154700 1 -- 172.21.15.49:0/2226076669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e40b0320 msgr2=0x7f55e41e2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:36.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.198+0000 7f55e9154700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e40b0320 0x7f55e41e2490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f55d8014040 tx=0x7f55d8004770 comp rx=0 tx=0).stop 2023-07-21T22:10:36.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.198+0000 7f55e9154700 1 -- 172.21.15.49:0/2226076669 shutdown_connections 2023-07-21T22:10:36.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.198+0000 7f55e9154700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f55d00662f0 0x7f55d00687a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:36.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.198+0000 7f55e9154700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e40b0320 0x7f55e41e2490 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:36.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.198+0000 7f55e9154700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e40cbe30 0x7f55e40c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:36.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.198+0000 7f55e9154700 1 --2- 172.21.15.49:0/2226076669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55e40aff50 0x7f55e41e3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:36.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.198+0000 7f55e9154700 1 -- 172.21.15.49:0/2226076669 >> 172.21.15.49:0/2226076669 conn(0x7f55e40cace0 msgr2=0x7f55e415b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:36.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.198+0000 7f55e9154700 1 -- 172.21.15.49:0/2226076669 shutdown_connections 2023-07-21T22:10:36.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.198+0000 7f55e9154700 1 -- 172.21.15.49:0/2226076669 wait complete. 2023-07-21T22:10:36.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:10:36.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.422+0000 7feb0b2b1700 1 Processor -- start 2023-07-21T22:10:36.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.422+0000 7feb0b2b1700 1 -- start start 2023-07-21T22:10:36.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.426+0000 7feb0b2b1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0415c010 0x7feb04071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:36.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.426+0000 7feb0b2b1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb04071700 con 0x7feb040d0290 2023-07-21T22:10:36.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.426+0000 7feb0b2b1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb040d2580 con 0x7feb0415c3e0 2023-07-21T22:10:36.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.426+0000 7feb0b2b1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb04070af0 con 0x7feb0415c010 2023-07-21T22:10:36.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.426+0000 7feb0984e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feb040d0290 0x7feb040ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52546/0 (socket says 172.21.15.49:52546) 2023-07-21T22:10:36.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.426+0000 7feb0984e700 1 -- 172.21.15.49:0/1908941626 learned_addr learned my addr 172.21.15.49:0/1908941626 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:36.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.426+0000 7feb0904d700 1 --2- 172.21.15.49:0/1908941626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0415c010 0x7feb04071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:36.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.426+0000 7feafbfff700 1 -- 172.21.15.49:0/1908941626 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488392940 0 0) 0x7feb04071700 con 0x7feb040d0290 2023-07-21T22:10:36.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.426+0000 7feafbfff700 1 -- 172.21.15.49:0/1908941626 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaf00035d0 con 0x7feb040d0290 2023-07-21T22:10:36.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.426+0000 7feafbfff700 1 -- 172.21.15.49:0/1908941626 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237849549 0 0) 0x7feb040d2580 con 0x7feb0415c3e0 2023-07-21T22:10:36.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.426+0000 7feafbfff700 1 -- 172.21.15.49:0/1908941626 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb04071700 con 0x7feb0415c3e0 2023-07-21T22:10:36.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.426+0000 7feb0904d700 1 -- 172.21.15.49:0/1908941626 >> v1:172.21.15.150:6789/0 conn(0x7feb0415c3e0 legacy=0x7feb0406ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:36.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.430+0000 7feb0904d700 1 -- 172.21.15.49:0/1908941626 >> v1:172.21.15.49:6789/0 conn(0x7feb040d0290 legacy=0x7feb040ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:36.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.430+0000 7feb0904d700 1 -- 172.21.15.49:0/1908941626 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb04070dd0 con 0x7feb0415c010 2023-07-21T22:10:36.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.430+0000 7feb0904d700 1 --2- 172.21.15.49:0/1908941626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0415c010 0x7feb04071b90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feb00009870 tx=0x7feb00009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f13f46411d42206 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:36.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.430+0000 7feafbfff700 1 -- 172.21.15.49:0/1908941626 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb00005e50 con 0x7feb0415c010 2023-07-21T22:10:36.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.430+0000 7feafbfff700 1 -- 172.21.15.49:0/1908941626 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb00006030 con 0x7feb0415c010 2023-07-21T22:10:36.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.430+0000 7feafbfff700 1 -- 172.21.15.49:0/1908941626 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb000063c0 con 0x7feb0415c010 2023-07-21T22:10:36.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.430+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1908941626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0415c010 msgr2=0x7feb04071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:36.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.430+0000 7feb0b2b1700 1 --2- 172.21.15.49:0/1908941626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0415c010 0x7feb04071b90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feb00009870 tx=0x7feb00009b80 comp rx=0 tx=0).stop 2023-07-21T22:10:36.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.430+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1908941626 shutdown_connections 2023-07-21T22:10:36.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.430+0000 7feb0b2b1700 1 --2- 172.21.15.49:0/1908941626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0415c010 0x7feb04071b90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.430+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1908941626 >> 172.21.15.49:0/1908941626 conn(0x7feb0409b9b0 msgr2=0x7feb0406f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.430+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1908941626 shutdown_connections 2023-07-21T22:10:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.430+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1908941626 wait complete. 2023-07-21T22:10:36.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.434+0000 7feb0b2b1700 1 Processor -- start 2023-07-21T22:10:36.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.434+0000 7feb0b2b1700 1 -- start start 2023-07-21T22:10:36.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.434+0000 7feb0b2b1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb040d0290 0x7feb040b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:36.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.434+0000 7feb0b2b1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb0415c010 0x7feb040b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:36.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.434+0000 7feb0b2b1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb0415c3e0 0x7feb040b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:36.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.434+0000 7feb0b2b1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb040b7a60 con 0x7feb0415c3e0 2023-07-21T22:10:36.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.434+0000 7feb0b2b1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb040c9a10 con 0x7feb0415c010 2023-07-21T22:10:36.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.434+0000 7feb0b2b1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb040c9cb0 con 0x7feb040d0290 2023-07-21T22:10:36.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0984e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb0415c3e0 0x7feb040b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:36.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0984e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb0415c3e0 0x7feb040b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34484/0 (socket says 172.21.15.49:34484) 2023-07-21T22:10:36.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0984e700 1 -- 172.21.15.49:0/1689567359 learned_addr learned my addr 172.21.15.49:0/1689567359 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:36.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0884c700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb0415c010 0x7feb040b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:36.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0904d700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb040d0290 0x7feb040b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:36.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0984e700 1 -- 172.21.15.49:0/1689567359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb040d0290 msgr2=0x7feb040b6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:36.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0984e700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb040d0290 0x7feb040b6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:36.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0984e700 1 -- 172.21.15.49:0/1689567359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb0415c010 msgr2=0x7feb040b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:36.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0984e700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb0415c010 0x7feb040b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:36.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0984e700 1 -- 172.21.15.49:0/1689567359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb00009450 con 0x7feb0415c3e0 2023-07-21T22:10:36.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0904d700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb040d0290 0x7feb040b6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:36.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0884c700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb0415c010 0x7feb040b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:36.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0984e700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb0415c3e0 0x7feb040b3d10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feafc00cba0 tx=0x7feafc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:36.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feaf9ffb700 1 -- 172.21.15.49:0/1689567359 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc00a980 con 0x7feb0415c3e0 2023-07-21T22:10:36.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feaf9ffb700 1 -- 172.21.15.49:0/1689567359 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc00aae0 con 0x7feb0415c3e0 2023-07-21T22:10:36.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feaf9ffb700 1 -- 172.21.15.49:0/1689567359 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc00ae70 con 0x7feb0415c3e0 2023-07-21T22:10:36.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1689567359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb040c9f90 con 0x7feb0415c3e0 2023-07-21T22:10:36.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.438+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1689567359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb040ca550 con 0x7feb0415c3e0 2023-07-21T22:10:36.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.442+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1689567359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0404dcb0 con 0x7feb0415c3e0 2023-07-21T22:10:36.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.442+0000 7feaf9ffb700 1 -- 172.21.15.49:0/1689567359 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feafc01b3b0 con 0x7feb0415c3e0 2023-07-21T22:10:36.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.442+0000 7feaf9ffb700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feae80662f0 0x7feae80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:36.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.446+0000 7feaf9ffb700 1 -- 172.21.15.49:0/1689567359 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6288+0+0 (secure 0 0 0) 0x7feafc083910 con 0x7feb0415c3e0 2023-07-21T22:10:36.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.446+0000 7feb0904d700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feae80662f0 0x7feae80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:36.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.446+0000 7feb0904d700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feae80662f0 0x7feae80687a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feb000097c0 tx=0x7feb00008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:36.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.450+0000 7feaf9ffb700 1 -- 172.21.15.49:0/1689567359 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feafc050cc0 con 0x7feb0415c3e0 2023-07-21T22:10:36.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:36.630+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1689567359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feb04072660 con 0x7feb0415c3e0 2023-07-21T22:10:38.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.238+0000 7feaf9ffb700 1 -- 172.21.15.49:0/1689567359 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v28) v1 ==== 228+0+0 (secure 0 0 0) 0x7feafc0542e0 con 0x7feb0415c3e0 2023-07-21T22:10:38.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.242+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1689567359 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feae80662f0 msgr2=0x7feae80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.242+0000 7feb0b2b1700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feae80662f0 0x7feae80687a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feb000097c0 tx=0x7feb00008070 comp rx=0 tx=0).stop 2023-07-21T22:10:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.242+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1689567359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb0415c3e0 msgr2=0x7feb040b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.242+0000 7feb0b2b1700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb0415c3e0 0x7feb040b3d10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feafc00cba0 tx=0x7feafc00cc80 comp rx=0 tx=0).stop 2023-07-21T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.246+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1689567359 shutdown_connections 2023-07-21T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.246+0000 7feb0b2b1700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feae80662f0 0x7feae80687a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.246+0000 7feb0b2b1700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb0415c3e0 0x7feb040b3d10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.246+0000 7feb0b2b1700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb0415c010 0x7feb040b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:38.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.246+0000 7feb0b2b1700 1 --2- 172.21.15.49:0/1689567359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb040d0290 0x7feb040b6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:38.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.246+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1689567359 >> 172.21.15.49:0/1689567359 conn(0x7feb0409b9b0 msgr2=0x7feb040b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:38.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.246+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1689567359 shutdown_connections 2023-07-21T22:10:38.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.246+0000 7feb0b2b1700 1 -- 172.21.15.49:0/1689567359 wait complete. 2023-07-21T22:10:38.298 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data_ec' created 2023-07-21T22:10:38.316 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-07-21T22:10:38.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.454+0000 7f8b25e51700 1 Processor -- start 2023-07-21T22:10:38.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.454+0000 7f8b25e51700 1 -- start start 2023-07-21T22:10:38.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b25e51700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8b20159ea0 0x7f8b200c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:38.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b25e51700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2015d8a0 con 0x7f8b200b03f0 2023-07-21T22:10:38.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b25e51700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b200ca640 con 0x7f8b200cb8a0 2023-07-21T22:10:38.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b25e51700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b200ca920 con 0x7f8b20159ea0 2023-07-21T22:10:38.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b1ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8b200b03f0 0x7f8b200c88b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52548/0 (socket says 172.21.15.49:52548) 2023-07-21T22:10:38.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b1ffff700 1 -- 172.21.15.49:0/1137431459 learned_addr learned my addr 172.21.15.49:0/1137431459 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:38.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b1f7fe700 1 --2- 172.21.15.49:0/1137431459 >> v2:172.21.15.49:3300/0 conn(0x7f8b20159ea0 0x7f8b200c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:38.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b1f7fe700 1 -- 172.21.15.49:0/1137431459 >> v1:172.21.15.150:6789/0 conn(0x7f8b200cb8a0 legacy=0x7f8b200afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:38.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b1f7fe700 1 -- 172.21.15.49:0/1137431459 >> v1:172.21.15.49:6789/0 conn(0x7f8b200b03f0 legacy=0x7f8b200c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:38.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b1f7fe700 1 -- 172.21.15.49:0/1137431459 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2015db40 con 0x7f8b20159ea0 2023-07-21T22:10:38.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b1e7fc700 1 -- 172.21.15.49:0/1137431459 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27811087 0 0) 0x7f8b200ca640 con 0x7f8b200cb8a0 2023-07-21T22:10:38.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b1f7fe700 1 --2- 172.21.15.49:0/1137431459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b20159ea0 0x7f8b200c9c60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009850 tx=0x7f8b10009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555f6dfd82dfe1f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:38.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b1e7fc700 1 -- 172.21.15.49:0/1137431459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10004230 con 0x7f8b20159ea0 2023-07-21T22:10:38.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b1e7fc700 1 -- 172.21.15.49:0/1137431459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b10004390 con 0x7f8b20159ea0 2023-07-21T22:10:38.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.458+0000 7f8b1e7fc700 1 -- 172.21.15.49:0/1137431459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b100036c0 con 0x7f8b20159ea0 2023-07-21T22:10:38.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.462+0000 7f8b25e51700 1 -- 172.21.15.49:0/1137431459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b20159ea0 msgr2=0x7f8b200c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:38.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.462+0000 7f8b25e51700 1 --2- 172.21.15.49:0/1137431459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b20159ea0 0x7f8b200c9c60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009850 tx=0x7f8b10009b60 comp rx=0 tx=0).stop 2023-07-21T22:10:38.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.462+0000 7f8b25e51700 1 -- 172.21.15.49:0/1137431459 shutdown_connections 2023-07-21T22:10:38.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.462+0000 7f8b25e51700 1 --2- 172.21.15.49:0/1137431459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b20159ea0 0x7f8b200c9c60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:38.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.462+0000 7f8b25e51700 1 -- 172.21.15.49:0/1137431459 >> 172.21.15.49:0/1137431459 conn(0x7f8b200cace0 msgr2=0x7f8b200cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:38.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.462+0000 7f8b25e51700 1 -- 172.21.15.49:0/1137431459 shutdown_connections 2023-07-21T22:10:38.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.462+0000 7f8b25e51700 1 -- 172.21.15.49:0/1137431459 wait complete. 2023-07-21T22:10:38.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b25e51700 1 Processor -- start 2023-07-21T22:10:38.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b25e51700 1 -- start start 2023-07-21T22:10:38.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b25e51700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b200b03f0 0x7f8b20158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:38.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b25e51700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b200cb8a0 0x7f8b200c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:38.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b25e51700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b20159ea0 0x7f8b200c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:38.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b25e51700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b200c79b0 con 0x7f8b200b03f0 2023-07-21T22:10:38.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b25e51700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b200c7c90 con 0x7f8b20159ea0 2023-07-21T22:10:38.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b25e51700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b200c7f70 con 0x7f8b200cb8a0 2023-07-21T22:10:38.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b1f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b200b03f0 0x7f8b20158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:38.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b1f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b200b03f0 0x7f8b20158920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34490/0 (socket says 172.21.15.49:34490) 2023-07-21T22:10:38.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b1f7fe700 1 -- 172.21.15.49:0/3834645083 learned_addr learned my addr 172.21.15.49:0/3834645083 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:38.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b1ffff700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b20159ea0 0x7f8b200c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:38.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b1effd700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b200cb8a0 0x7f8b200c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:38.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b1f7fe700 1 -- 172.21.15.49:0/3834645083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b200cb8a0 msgr2=0x7f8b200c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:38.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b1f7fe700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b200cb8a0 0x7f8b200c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:38.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b1f7fe700 1 -- 172.21.15.49:0/3834645083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b20159ea0 msgr2=0x7f8b200c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:38.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b1f7fe700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b20159ea0 0x7f8b200c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:38.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b1f7fe700 1 -- 172.21.15.49:0/3834645083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100094b0 con 0x7f8b200b03f0 2023-07-21T22:10:38.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.466+0000 7f8b1effd700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b200cb8a0 0x7f8b200c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:38.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.470+0000 7f8b1f7fe700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b200b03f0 0x7f8b20158920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b100090b0 tx=0x7f8b10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:38.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.470+0000 7f8b07fff700 1 -- 172.21.15.49:0/3834645083 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10011630 con 0x7f8b200b03f0 2023-07-21T22:10:38.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.470+0000 7f8b07fff700 1 -- 172.21.15.49:0/3834645083 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b100117b0 con 0x7f8b200b03f0 2023-07-21T22:10:38.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.470+0000 7f8b25e51700 1 -- 172.21.15.49:0/3834645083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b200c8250 con 0x7f8b200b03f0 2023-07-21T22:10:38.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.470+0000 7f8b07fff700 1 -- 172.21.15.49:0/3834645083 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10011b60 con 0x7f8b200b03f0 2023-07-21T22:10:38.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.470+0000 7f8b25e51700 1 -- 172.21.15.49:0/3834645083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b20158e60 con 0x7f8b200b03f0 2023-07-21T22:10:38.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.470+0000 7f8b25e51700 1 -- 172.21.15.49:0/3834645083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b200c8770 con 0x7f8b200b03f0 2023-07-21T22:10:38.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.474+0000 7f8b07fff700 1 -- 172.21.15.49:0/3834645083 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8b10018050 con 0x7f8b200b03f0 2023-07-21T22:10:38.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.474+0000 7f8b07fff700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8b0c0662f0 0x7f8b0c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:38.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.474+0000 7f8b07fff700 1 -- 172.21.15.49:0/3834645083 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f8b10084c90 con 0x7f8b200b03f0 2023-07-21T22:10:38.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.474+0000 7f8b1effd700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8b0c0662f0 0x7f8b0c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:38.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.478+0000 7f8b1effd700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8b0c0662f0 0x7f8b0c0687a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8b200a93c0 tx=0x7f8b14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:38.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.482+0000 7f8b07fff700 1 -- 172.21.15.49:0/3834645083 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8b200c8770 con 0x7f8b200b03f0 2023-07-21T22:10:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:38.654+0000 7f8b25e51700 1 -- 172.21.15.49:0/3834645083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f8b200702c0 con 0x7f8b200b03f0 2023-07-21T22:10:39.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.254+0000 7f8b07fff700 1 -- 172.21.15.49:0/3834645083 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8b100160c0 con 0x7f8b200b03f0 2023-07-21T22:10:39.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.262+0000 7f8b25e51700 1 -- 172.21.15.49:0/3834645083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8b0c0662f0 msgr2=0x7f8b0c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:39.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.262+0000 7f8b25e51700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8b0c0662f0 0x7f8b0c0687a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8b200a93c0 tx=0x7f8b14009040 comp rx=0 tx=0).stop 2023-07-21T22:10:39.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.262+0000 7f8b25e51700 1 -- 172.21.15.49:0/3834645083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b200b03f0 msgr2=0x7f8b20158920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:39.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.262+0000 7f8b25e51700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b200b03f0 0x7f8b20158920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b100090b0 tx=0x7f8b10004770 comp rx=0 tx=0).stop 2023-07-21T22:10:39.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.266+0000 7f8b25e51700 1 -- 172.21.15.49:0/3834645083 shutdown_connections 2023-07-21T22:10:39.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.266+0000 7f8b25e51700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8b0c0662f0 0x7f8b0c0687a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:39.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.266+0000 7f8b25e51700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b20159ea0 0x7f8b200c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:39.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.266+0000 7f8b25e51700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b200cb8a0 0x7f8b200c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:39.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.266+0000 7f8b25e51700 1 --2- 172.21.15.49:0/3834645083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b200b03f0 0x7f8b20158920 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b100090b0 tx=0x7f8b10004770 comp rx=0 tx=0).stop 2023-07-21T22:10:39.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.266+0000 7f8b25e51700 1 -- 172.21.15.49:0/3834645083 >> 172.21.15.49:0/3834645083 conn(0x7f8b200cace0 msgr2=0x7f8b200c98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:39.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.270+0000 7f8b25e51700 1 -- 172.21.15.49:0/3834645083 shutdown_connections 2023-07-21T22:10:39.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.270+0000 7f8b25e51700 1 -- 172.21.15.49:0/3834645083 wait complete. 2023-07-21T22:10:39.326 INFO:teuthology.orchestra.run.smithi049.stderr:set pool 5 allow_ec_overwrites to true 2023-07-21T22:10:39.348 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-07-21T22:10:39.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.482+0000 7f5fb9526700 1 Processor -- start 2023-07-21T22:10:39.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.482+0000 7f5fb9526700 1 -- start start 2023-07-21T22:10:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.486+0000 7f5fb9526700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5fb40b7af0 0x7f5fb40b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.486+0000 7f5fb9526700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb40d1e40 0x7f5fb415f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.486+0000 7f5fb9526700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb40b3e80 con 0x7f5fb40cee10 2023-07-21T22:10:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.486+0000 7f5fb9526700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb40cea00 con 0x7f5fb40b7af0 2023-07-21T22:10:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.486+0000 7f5fb9526700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb40ccbf0 con 0x7f5fb40d1e40 2023-07-21T22:10:39.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.486+0000 7f5fb37fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5fb40cee10 0x7f5fb40b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52554/0 (socket says 172.21.15.49:52554) 2023-07-21T22:10:39.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.486+0000 7f5fb37fe700 1 -- 172.21.15.49:0/2926736374 learned_addr learned my addr 172.21.15.49:0/2926736374 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:39.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.486+0000 7f5fb27fc700 1 --2- 172.21.15.49:0/2926736374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb40d1e40 0x7f5fb415f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:39.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.486+0000 7f5fb2ffd700 1 --2- 172.21.15.49:0/2926736374 >> v2:172.21.15.150:3300/0 conn(0x7f5fb40b7af0 0x7f5fb40b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:39.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.486+0000 7f5fb1ffb700 1 -- 172.21.15.49:0/2926736374 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249643484 0 0) 0x7f5fb40b3e80 con 0x7f5fb40cee10 2023-07-21T22:10:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb1ffb700 1 -- 172.21.15.49:0/2926736374 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f9c0035d0 con 0x7f5fb40cee10 2023-07-21T22:10:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb2ffd700 1 -- 172.21.15.49:0/2926736374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb40d1e40 msgr2=0x7f5fb415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb2ffd700 1 --2- 172.21.15.49:0/2926736374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb40d1e40 0x7f5fb415f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb2ffd700 1 -- 172.21.15.49:0/2926736374 >> v1:172.21.15.49:6789/0 conn(0x7f5fb40cee10 legacy=0x7f5fb40b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:39.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb2ffd700 1 -- 172.21.15.49:0/2926736374 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb40cced0 con 0x7f5fb40b7af0 2023-07-21T22:10:39.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb27fc700 1 --2- 172.21.15.49:0/2926736374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb40d1e40 0x7f5fb415f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:39.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb2ffd700 1 --2- 172.21.15.49:0/2926736374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb40b7af0 0x7f5fb40b1630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009850 tx=0x7f5fa4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=951665440e4d7620 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb1ffb700 1 -- 172.21.15.49:0/2926736374 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4011830 con 0x7f5fb40b7af0 2023-07-21T22:10:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb1ffb700 1 -- 172.21.15.49:0/2926736374 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa4011990 con 0x7f5fb40b7af0 2023-07-21T22:10:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb1ffb700 1 -- 172.21.15.49:0/2926736374 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4011d40 con 0x7f5fb40b7af0 2023-07-21T22:10:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb9526700 1 -- 172.21.15.49:0/2926736374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb40b7af0 msgr2=0x7f5fb40b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb9526700 1 --2- 172.21.15.49:0/2926736374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb40b7af0 0x7f5fb40b1630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009850 tx=0x7f5fa4009b60 comp rx=0 tx=0).stop 2023-07-21T22:10:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb9526700 1 -- 172.21.15.49:0/2926736374 shutdown_connections 2023-07-21T22:10:39.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb9526700 1 --2- 172.21.15.49:0/2926736374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb40d1e40 0x7f5fb415f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:39.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb9526700 1 --2- 172.21.15.49:0/2926736374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb40b7af0 0x7f5fb40b1630 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:39.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb9526700 1 -- 172.21.15.49:0/2926736374 >> 172.21.15.49:0/2926736374 conn(0x7f5fb406e960 msgr2=0x7f5fb406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:39.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb9526700 1 -- 172.21.15.49:0/2926736374 shutdown_connections 2023-07-21T22:10:39.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.490+0000 7f5fb9526700 1 -- 172.21.15.49:0/2926736374 wait complete. 2023-07-21T22:10:39.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb9526700 1 Processor -- start 2023-07-21T22:10:39.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb9526700 1 -- start start 2023-07-21T22:10:39.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb9526700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb40b7af0 0x7f5fb40cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb9526700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb40cee10 0x7f5fb41561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb9526700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb40d1e40 0x7f5fb40c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb9526700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb415a160 con 0x7f5fb40b7af0 2023-07-21T22:10:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb9526700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb40c9b30 con 0x7f5fb40d1e40 2023-07-21T22:10:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb9526700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb40c9570 con 0x7f5fb40cee10 2023-07-21T22:10:39.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb40b7af0 0x7f5fb40cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:39.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb40b7af0 0x7f5fb40cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34492/0 (socket says 172.21.15.49:34492) 2023-07-21T22:10:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb2ffd700 1 -- 172.21.15.49:0/3316863066 learned_addr learned my addr 172.21.15.49:0/3316863066 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb27fc700 1 --2- 172.21.15.49:0/3316863066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb40cee10 0x7f5fb41561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb37fe700 1 --2- 172.21.15.49:0/3316863066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb40d1e40 0x7f5fb40c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb2ffd700 1 -- 172.21.15.49:0/3316863066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb40cee10 msgr2=0x7f5fb41561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb2ffd700 1 --2- 172.21.15.49:0/3316863066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb40cee10 0x7f5fb41561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb2ffd700 1 -- 172.21.15.49:0/3316863066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb40d1e40 msgr2=0x7f5fb40c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb2ffd700 1 --2- 172.21.15.49:0/3316863066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb40d1e40 0x7f5fb40c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb2ffd700 1 -- 172.21.15.49:0/3316863066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa80094b0 con 0x7f5fb40b7af0 2023-07-21T22:10:39.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb2ffd700 1 --2- 172.21.15.49:0/3316863066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb40b7af0 0x7f5fb40cc330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40090b0 tx=0x7f5fa4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:39.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5f9b7fe700 1 -- 172.21.15.49:0/3316863066 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4004380 con 0x7f5fb40b7af0 2023-07-21T22:10:39.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5f9b7fe700 1 -- 172.21.15.49:0/3316863066 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa401f070 con 0x7f5fb40b7af0 2023-07-21T22:10:39.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb9526700 1 -- 172.21.15.49:0/3316863066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa40094b0 con 0x7f5fb40b7af0 2023-07-21T22:10:39.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5f9b7fe700 1 -- 172.21.15.49:0/3316863066 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa40036c0 con 0x7f5fb40b7af0 2023-07-21T22:10:39.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.494+0000 7f5fb9526700 1 -- 172.21.15.49:0/3316863066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb415c3e0 con 0x7f5fb40b7af0 2023-07-21T22:10:39.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.498+0000 7f5fb9526700 1 -- 172.21.15.49:0/3316863066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb404dcb0 con 0x7f5fb40b7af0 2023-07-21T22:10:39.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.498+0000 7f5f9b7fe700 1 -- 172.21.15.49:0/3316863066 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5fa4021030 con 0x7f5fb40b7af0 2023-07-21T22:10:39.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.502+0000 7f5f9b7fe700 1 --2- 172.21.15.49:0/3316863066 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5fa00662f0 0x7f5fa00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:39.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.502+0000 7f5f9b7fe700 1 -- 172.21.15.49:0/3316863066 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f5fa4085330 con 0x7f5fb40b7af0 2023-07-21T22:10:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.502+0000 7f5fb27fc700 1 --2- 172.21.15.49:0/3316863066 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5fa00662f0 0x7f5fa00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.502+0000 7f5fb27fc700 1 --2- 172.21.15.49:0/3316863066 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5fa00662f0 0x7f5fa00687a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5fb415f190 tx=0x7f5fa8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.510+0000 7f5f9b7fe700 1 -- 172.21.15.49:0/3316863066 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5fa40525f0 con 0x7f5fb40b7af0 2023-07-21T22:10:39.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:39.726+0000 7f5fb9526700 1 -- 172.21.15.49:0/3316863066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f5fb406f250 con 0x7f5fb40b7af0 2023-07-21T22:10:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.258+0000 7f5f9b7fe700 1 -- 172.21.15.49:0/3316863066 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f5fa4006ce0 con 0x7f5fb40b7af0 2023-07-21T22:10:40.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.262+0000 7f5fb9526700 1 -- 172.21.15.49:0/3316863066 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5fa00662f0 msgr2=0x7f5fa00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:40.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.262+0000 7f5fb9526700 1 --2- 172.21.15.49:0/3316863066 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5fa00662f0 0x7f5fa00687a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5fb415f190 tx=0x7f5fa8009240 comp rx=0 tx=0).stop 2023-07-21T22:10:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.262+0000 7f5fb9526700 1 -- 172.21.15.49:0/3316863066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb40b7af0 msgr2=0x7f5fb40cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.262+0000 7f5fb9526700 1 --2- 172.21.15.49:0/3316863066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb40b7af0 0x7f5fb40cc330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40090b0 tx=0x7f5fa4004770 comp rx=0 tx=0).stop 2023-07-21T22:10:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.262+0000 7f5fb9526700 1 -- 172.21.15.49:0/3316863066 shutdown_connections 2023-07-21T22:10:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.262+0000 7f5fb9526700 1 --2- 172.21.15.49:0/3316863066 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5fa00662f0 0x7f5fa00687a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.262+0000 7f5fb9526700 1 --2- 172.21.15.49:0/3316863066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb40d1e40 0x7f5fb40c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.262+0000 7f5fb9526700 1 --2- 172.21.15.49:0/3316863066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb40cee10 0x7f5fb41561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.262+0000 7f5fb9526700 1 --2- 172.21.15.49:0/3316863066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb40b7af0 0x7f5fb40cc330 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.262+0000 7f5fb9526700 1 -- 172.21.15.49:0/3316863066 >> 172.21.15.49:0/3316863066 conn(0x7f5fb406e960 msgr2=0x7f5fb40b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:40.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.262+0000 7f5fb9526700 1 -- 172.21.15.49:0/3316863066 shutdown_connections 2023-07-21T22:10:40.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.262+0000 7f5fb9526700 1 -- 172.21.15.49:0/3316863066 wait complete. 2023-07-21T22:10:40.307 INFO:teuthology.orchestra.run.smithi049.stderr:added data pool 5 to fsmap 2023-07-21T22:10:40.327 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:10:40.338 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-07-21T22:10:40.294+0000 7fc879983700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:10:40.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.470+0000 7f892737e700 1 Processor -- start 2023-07-21T22:10:40.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.470+0000 7f892737e700 1 -- start start 2023-07-21T22:10:40.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.470+0000 7f892737e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8920158c00 0x7f892015d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:40.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.470+0000 7f892737e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f892006da70 0x7f892006c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:40.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.470+0000 7f892737e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8920158fd0 con 0x7f89200c90d0 2023-07-21T22:10:40.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.470+0000 7f892737e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892006d650 con 0x7f8920158c00 2023-07-21T22:10:40.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.470+0000 7f892737e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892006c9d0 con 0x7f892006da70 2023-07-21T22:10:40.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f892637c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8920158c00 0x7f892015d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:40.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f8925b7b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f892006da70 0x7f892006c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:40.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f8926b7d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f89200c90d0 0x7f89200cbc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:44538/0 (socket says 172.21.15.49:44538) 2023-07-21T22:10:40.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f8926b7d700 1 -- 172.21.15.49:0/689686651 learned_addr learned my addr 172.21.15.49:0/689686651 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:40.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f892537a700 1 -- 172.21.15.49:0/689686651 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890267297 0 0) 0x7f8920158fd0 con 0x7f89200c90d0 2023-07-21T22:10:40.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f892537a700 1 -- 172.21.15.49:0/689686651 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f890c0035d0 con 0x7f89200c90d0 2023-07-21T22:10:40.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f892637c700 1 -- 172.21.15.49:0/689686651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f892006da70 msgr2=0x7f892006c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:40.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f892637c700 1 --2- 172.21.15.49:0/689686651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f892006da70 0x7f892006c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f892637c700 1 -- 172.21.15.49:0/689686651 >> v1:172.21.15.150:6789/0 conn(0x7f89200c90d0 legacy=0x7f89200cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:40.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f892637c700 1 -- 172.21.15.49:0/689686651 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892006ccb0 con 0x7f8920158c00 2023-07-21T22:10:40.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f8925b7b700 1 --2- 172.21.15.49:0/689686651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f892006da70 0x7f892006c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:40.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f892637c700 1 --2- 172.21.15.49:0/689686651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8920158c00 0x7f892015d180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f891c009850 tx=0x7f891c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebd16326d04720a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:40.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f892537a700 1 -- 172.21.15.49:0/689686651 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c011830 con 0x7f8920158c00 2023-07-21T22:10:40.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f892537a700 1 -- 172.21.15.49:0/689686651 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c011990 con 0x7f8920158c00 2023-07-21T22:10:40.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.474+0000 7f892537a700 1 -- 172.21.15.49:0/689686651 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c011d40 con 0x7f8920158c00 2023-07-21T22:10:40.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.478+0000 7f892737e700 1 -- 172.21.15.49:0/689686651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8920158c00 msgr2=0x7f892015d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:40.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.478+0000 7f892737e700 1 --2- 172.21.15.49:0/689686651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8920158c00 0x7f892015d180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f891c009850 tx=0x7f891c009b60 comp rx=0 tx=0).stop 2023-07-21T22:10:40.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.478+0000 7f892737e700 1 -- 172.21.15.49:0/689686651 shutdown_connections 2023-07-21T22:10:40.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.478+0000 7f892737e700 1 --2- 172.21.15.49:0/689686651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f892006da70 0x7f892006c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.478+0000 7f892737e700 1 --2- 172.21.15.49:0/689686651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8920158c00 0x7f892015d180 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.478+0000 7f892737e700 1 -- 172.21.15.49:0/689686651 >> 172.21.15.49:0/689686651 conn(0x7f8920070450 msgr2=0x7f8920070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:40.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.478+0000 7f892737e700 1 -- 172.21.15.49:0/689686651 shutdown_connections 2023-07-21T22:10:40.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.478+0000 7f892737e700 1 -- 172.21.15.49:0/689686651 wait complete. 2023-07-21T22:10:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.478+0000 7f892737e700 1 Processor -- start 2023-07-21T22:10:40.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.478+0000 7f892737e700 1 -- start start 2023-07-21T22:10:40.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892737e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f892006da70 0x7f89200ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:40.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892737e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89200c90d0 0x7f8920149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:40.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892737e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8920158c00 0x7f89200c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:40.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892737e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8920159040 con 0x7f892006da70 2023-07-21T22:10:40.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892737e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8920149b90 con 0x7f89200c90d0 2023-07-21T22:10:40.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892737e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89200c78c0 con 0x7f8920158c00 2023-07-21T22:10:40.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892637c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f892006da70 0x7f89200ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892637c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f892006da70 0x7f89200ad400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34498/0 (socket says 172.21.15.49:34498) 2023-07-21T22:10:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892637c700 1 -- 172.21.15.49:0/2578169360 learned_addr learned my addr 172.21.15.49:0/2578169360 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:40.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f8926b7d700 1 --2- 172.21.15.49:0/2578169360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8920158c00 0x7f89200c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:40.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f8925b7b700 1 --2- 172.21.15.49:0/2578169360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89200c90d0 0x7f8920149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:40.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892637c700 1 -- 172.21.15.49:0/2578169360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8920158c00 msgr2=0x7f89200c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:40.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892637c700 1 --2- 172.21.15.49:0/2578169360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8920158c00 0x7f89200c6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892637c700 1 -- 172.21.15.49:0/2578169360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89200c90d0 msgr2=0x7f8920149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:40.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892637c700 1 --2- 172.21.15.49:0/2578169360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89200c90d0 0x7f8920149650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892637c700 1 -- 172.21.15.49:0/2578169360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89100094b0 con 0x7f892006da70 2023-07-21T22:10:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892637c700 1 --2- 172.21.15.49:0/2578169360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f892006da70 0x7f89200ad400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f891c014040 tx=0x7f891c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f8916ffd700 1 -- 172.21.15.49:0/2578169360 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c004510 con 0x7f892006da70 2023-07-21T22:10:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f8916ffd700 1 -- 172.21.15.49:0/2578169360 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c01e070 con 0x7f892006da70 2023-07-21T22:10:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f892737e700 1 -- 172.21.15.49:0/2578169360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891c0094b0 con 0x7f892006da70 2023-07-21T22:10:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.482+0000 7f8916ffd700 1 -- 172.21.15.49:0/2578169360 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c003900 con 0x7f892006da70 2023-07-21T22:10:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.486+0000 7f892737e700 1 -- 172.21.15.49:0/2578169360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89200c7e10 con 0x7f892006da70 2023-07-21T22:10:40.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.486+0000 7f892737e700 1 -- 172.21.15.49:0/2578169360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f892004dcb0 con 0x7f892006da70 2023-07-21T22:10:40.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.486+0000 7f8916ffd700 1 -- 172.21.15.49:0/2578169360 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f891c003a60 con 0x7f892006da70 2023-07-21T22:10:40.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.490+0000 7f8916ffd700 1 --2- 172.21.15.49:0/2578169360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f89040662f0 0x7f89040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:40.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.490+0000 7f8916ffd700 1 -- 172.21.15.49:0/2578169360 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f891c020070 con 0x7f892006da70 2023-07-21T22:10:40.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.490+0000 7f8925b7b700 1 --2- 172.21.15.49:0/2578169360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f89040662f0 0x7f89040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:40.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.490+0000 7f8925b7b700 1 --2- 172.21.15.49:0/2578169360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f89040662f0 0x7f89040687a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f892015bfb0 tx=0x7f8910009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:40.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.498+0000 7f8916ffd700 1 -- 172.21.15.49:0/2578169360 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f891c052500 con 0x7f892006da70 2023-07-21T22:10:40.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.714+0000 7f892737e700 1 -- 172.21.15.49:0/2578169360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89200b3ff0 con 0x7f892006da70 2023-07-21T22:10:40.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.714+0000 7f8916ffd700 1 -- 172.21.15.49:0/2578169360 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f891c006ce0 con 0x7f892006da70 2023-07-21T22:10:40.756 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:40.757 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/1894793298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1894793298},{"type":"v1","addr":"172.21.15.150:6833","nonce":1894793298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1984862419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1984862419},{"type":"v1","addr":"172.21.15.49:6836","nonce":1984862419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1331451608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1331451608},{"type":"v1","addr":"172.21.15.49:6837","nonce":1331451608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:10:34.629989+0000","modified":"2023-07-21T22:10:40.250104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2478678672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2478678672},{"type":"v1","addr":"172.21.15.150:6835","nonce":2478678672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-21T22:10:40.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.718+0000 7f892737e700 1 -- 172.21.15.49:0/2578169360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f89040662f0 msgr2=0x7f89040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:40.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.718+0000 7f892737e700 1 --2- 172.21.15.49:0/2578169360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f89040662f0 0x7f89040687a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f892015bfb0 tx=0x7f8910009240 comp rx=0 tx=0).stop 2023-07-21T22:10:40.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.718+0000 7f892737e700 1 -- 172.21.15.49:0/2578169360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f892006da70 msgr2=0x7f89200ad400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:40.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.718+0000 7f892737e700 1 --2- 172.21.15.49:0/2578169360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f892006da70 0x7f89200ad400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f891c014040 tx=0x7f891c004770 comp rx=0 tx=0).stop 2023-07-21T22:10:40.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.718+0000 7f892737e700 1 -- 172.21.15.49:0/2578169360 shutdown_connections 2023-07-21T22:10:40.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.718+0000 7f892737e700 1 --2- 172.21.15.49:0/2578169360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f89040662f0 0x7f89040687a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.718+0000 7f892737e700 1 --2- 172.21.15.49:0/2578169360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8920158c00 0x7f89200c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.718+0000 7f892737e700 1 --2- 172.21.15.49:0/2578169360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89200c90d0 0x7f8920149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.718+0000 7f892737e700 1 --2- 172.21.15.49:0/2578169360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f892006da70 0x7f89200ad400 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.718+0000 7f892737e700 1 -- 172.21.15.49:0/2578169360 >> 172.21.15.49:0/2578169360 conn(0x7f8920070450 msgr2=0x7f89200cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:40.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.718+0000 7f892737e700 1 -- 172.21.15.49:0/2578169360 shutdown_connections 2023-07-21T22:10:40.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.718+0000 7f892737e700 1 -- 172.21.15.49:0/2578169360 wait complete. 2023-07-21T22:10:40.764 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 7 2023-07-21T22:10:40.780 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:10:40.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.910+0000 7f1fe13ae700 1 Processor -- start 2023-07-21T22:10:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.910+0000 7f1fe13ae700 1 -- start start 2023-07-21T22:10:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fe13ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fdc070d30 0x7f1fdc06e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fe13ae700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc15d610 con 0x7f1fdc0cbbd0 2023-07-21T22:10:40.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fe13ae700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc15deb0 con 0x7f1fdc06d630 2023-07-21T22:10:40.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fe13ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0cc0b0 con 0x7f1fdc070d30 2023-07-21T22:10:40.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fdbfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1fdc0cbbd0 0x7f1fdc159f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52558/0 (socket says 172.21.15.49:52558) 2023-07-21T22:10:40.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fdbfff700 1 -- 172.21.15.49:0/3332290321 learned_addr learned my addr 172.21.15.49:0/3332290321 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fd3fff700 1 --2- 172.21.15.49:0/3332290321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fdc070d30 0x7f1fdc06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fda7fc700 1 -- 172.21.15.49:0/3332290321 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774286079 0 0) 0x7f1fdc15d610 con 0x7f1fdc0cbbd0 2023-07-21T22:10:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fda7fc700 1 -- 172.21.15.49:0/3332290321 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fc80035d0 con 0x7f1fdc0cbbd0 2023-07-21T22:10:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fd3fff700 1 -- 172.21.15.49:0/3332290321 >> v1:172.21.15.150:6789/0 conn(0x7f1fdc06d630 legacy=0x7f1fdc06da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fda7fc700 1 -- 172.21.15.49:0/3332290321 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142660716 0 0) 0x7f1fdc15deb0 con 0x7f1fdc06d630 2023-07-21T22:10:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fd3fff700 1 -- 172.21.15.49:0/3332290321 >> v1:172.21.15.49:6789/0 conn(0x7f1fdc0cbbd0 legacy=0x7f1fdc159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fd3fff700 1 -- 172.21.15.49:0/3332290321 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc15d860 con 0x7f1fdc070d30 2023-07-21T22:10:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fd3fff700 1 --2- 172.21.15.49:0/3332290321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fdc070d30 0x7f1fdc06e960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009870 tx=0x7f1fc4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38ef892b886fa6c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fda7fc700 1 -- 172.21.15.49:0/3332290321 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40019f0 con 0x7f1fdc070d30 2023-07-21T22:10:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fda7fc700 1 -- 172.21.15.49:0/3332290321 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc4004030 con 0x7f1fdc070d30 2023-07-21T22:10:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.914+0000 7f1fda7fc700 1 -- 172.21.15.49:0/3332290321 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc40043a0 con 0x7f1fdc070d30 2023-07-21T22:10:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.918+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3332290321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fdc070d30 msgr2=0x7f1fdc06e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.918+0000 7f1fe13ae700 1 --2- 172.21.15.49:0/3332290321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fdc070d30 0x7f1fdc06e960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009870 tx=0x7f1fc4009b80 comp rx=0 tx=0).stop 2023-07-21T22:10:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.918+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3332290321 shutdown_connections 2023-07-21T22:10:40.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.918+0000 7f1fe13ae700 1 --2- 172.21.15.49:0/3332290321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fdc070d30 0x7f1fdc06e960 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.918+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3332290321 >> 172.21.15.49:0/3332290321 conn(0x7f1fdc0cc430 msgr2=0x7f1fdc0cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:40.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.918+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3332290321 shutdown_connections 2023-07-21T22:10:40.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.918+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3332290321 wait complete. 2023-07-21T22:10:40.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.918+0000 7f1fe13ae700 1 Processor -- start 2023-07-21T22:10:40.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fe13ae700 1 -- start start 2023-07-21T22:10:40.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fe13ae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fdc06d630 0x7f1fdc1f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:40.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fe13ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fdc070d30 0x7f1fdc0c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:40.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fe13ae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fdc0cbbd0 0x7f1fdc0c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:40.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fe13ae700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1efdd0 con 0x7f1fdc06d630 2023-07-21T22:10:40.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fe13ae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1ef430 con 0x7f1fdc0cbbd0 2023-07-21T22:10:40.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fe13ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1ef710 con 0x7f1fdc070d30 2023-07-21T22:10:40.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fdaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fdc06d630 0x7f1fdc1f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fdaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fdc06d630 0x7f1fdc1f1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34500/0 (socket says 172.21.15.49:34500) 2023-07-21T22:10:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fdaffd700 1 -- 172.21.15.49:0/3399406535 learned_addr learned my addr 172.21.15.49:0/3399406535 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fd3fff700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fdc070d30 0x7f1fdc0c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fdbfff700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fdc0cbbd0 0x7f1fdc0c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fdaffd700 1 -- 172.21.15.49:0/3399406535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fdc070d30 msgr2=0x7f1fdc0c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fdaffd700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fdc070d30 0x7f1fdc0c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fdaffd700 1 -- 172.21.15.49:0/3399406535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fdc0cbbd0 msgr2=0x7f1fdc0c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fdaffd700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fdc0cbbd0 0x7f1fdc0c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fdaffd700 1 -- 172.21.15.49:0/3399406535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc4009450 con 0x7f1fdc06d630 2023-07-21T22:10:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fdbfff700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fdc0cbbd0 0x7f1fdc0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fdaffd700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fdc06d630 0x7f1fdc1f1ea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0011e0 tx=0x7f1fcc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fd37fe700 1 -- 172.21.15.49:0/3399406535 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0054e0 con 0x7f1fdc06d630 2023-07-21T22:10:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fd37fe700 1 -- 172.21.15.49:0/3399406535 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0036a0 con 0x7f1fdc06d630 2023-07-21T22:10:40.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.922+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3399406535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc15e4c0 con 0x7f1fdc06d630 2023-07-21T22:10:40.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.926+0000 7f1fd37fe700 1 -- 172.21.15.49:0/3399406535 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc003a50 con 0x7f1fdc06d630 2023-07-21T22:10:40.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.926+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3399406535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc1ef120 con 0x7f1fdc06d630 2023-07-21T22:10:40.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.926+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3399406535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc1eff10 con 0x7f1fdc06d630 2023-07-21T22:10:40.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.930+0000 7f1fd37fe700 1 -- 172.21.15.49:0/3399406535 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1fcc003bb0 con 0x7f1fdc06d630 2023-07-21T22:10:40.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.930+0000 7f1fd37fe700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1fbc0662f0 0x7f1fbc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:40.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.930+0000 7f1fd37fe700 1 -- 172.21.15.49:0/3399406535 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1fcc083490 con 0x7f1fdc06d630 2023-07-21T22:10:40.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.930+0000 7f1fd3fff700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1fbc0662f0 0x7f1fbc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:40.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.930+0000 7f1fd3fff700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1fbc0662f0 0x7f1fbc0687a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40097c0 tx=0x7f1fc4008000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:40.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:40.938+0000 7f1fd37fe700 1 -- 172.21.15.49:0/3399406535 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1fdc1eff10 con 0x7f1fdc06d630 2023-07-21T22:10:41.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.118+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3399406535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fdc1eff10 con 0x7f1fdc06d630 2023-07-21T22:10:41.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.118+0000 7f1fd37fe700 1 -- 172.21.15.49:0/3399406535 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f1fdc1eff10 con 0x7f1fdc06d630 2023-07-21T22:10:41.162 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:41.162 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:39.728219+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:10:41.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.122+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3399406535 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1fbc0662f0 msgr2=0x7f1fbc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:41.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.122+0000 7f1fe13ae700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1fbc0662f0 0x7f1fbc0687a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40097c0 tx=0x7f1fc4008000 comp rx=0 tx=0).stop 2023-07-21T22:10:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.122+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3399406535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fdc06d630 msgr2=0x7f1fdc1f1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.122+0000 7f1fe13ae700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fdc06d630 0x7f1fdc1f1ea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0011e0 tx=0x7f1fcc00ca30 comp rx=0 tx=0).stop 2023-07-21T22:10:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.122+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3399406535 shutdown_connections 2023-07-21T22:10:41.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.122+0000 7f1fe13ae700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1fbc0662f0 0x7f1fbc0687a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.122+0000 7f1fe13ae700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fdc0cbbd0 0x7f1fdc0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.122+0000 7f1fe13ae700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fdc070d30 0x7f1fdc0c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.122+0000 7f1fe13ae700 1 --2- 172.21.15.49:0/3399406535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fdc06d630 0x7f1fdc1f1ea0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.122+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3399406535 >> 172.21.15.49:0/3399406535 conn(0x7f1fdc0cc430 msgr2=0x7f1fdc15bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:41.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.122+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3399406535 shutdown_connections 2023-07-21T22:10:41.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.122+0000 7f1fe13ae700 1 -- 172.21.15.49:0/3399406535 wait complete. 2023-07-21T22:10:41.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:10:41.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.306+0000 7f1b459f7700 1 Processor -- start 2023-07-21T22:10:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.310+0000 7f1b459f7700 1 -- start start 2023-07-21T22:10:41.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.310+0000 7f1b459f7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b4006e960 0x7f1b4006ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.310+0000 7f1b459f7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1b4006b3f0 0x7f1b400cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.310+0000 7f1b459f7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4015d240 con 0x7f1b4006af80 2023-07-21T22:10:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.310+0000 7f1b459f7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4006b8d0 con 0x7f1b4006b3f0 2023-07-21T22:10:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.310+0000 7f1b459f7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400698a0 con 0x7f1b4006e960 2023-07-21T22:10:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b3effd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b4006e960 0x7f1b4006ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b3effd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b4006e960 0x7f1b4006ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:41642/0 (socket says 172.21.15.49:41642) 2023-07-21T22:10:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b3effd700 1 -- 172.21.15.49:0/1848857206 learned_addr learned my addr 172.21.15.49:0/1848857206 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b3f7fe700 1 --2- 172.21.15.49:0/1848857206 >> v2:172.21.15.150:3300/0 conn(0x7f1b4006b3f0 0x7f1b400cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b3f7fe700 1 -- 172.21.15.49:0/1848857206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b4006e960 msgr2=0x7f1b4006ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b3f7fe700 1 --2- 172.21.15.49:0/1848857206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b4006e960 0x7f1b4006ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b3f7fe700 1 -- 172.21.15.49:0/1848857206 >> v1:172.21.15.150:6789/0 conn(0x7f1b4006af80 legacy=0x7f1b400cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b3f7fe700 1 -- 172.21.15.49:0/1848857206 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4006f270 con 0x7f1b4006b3f0 2023-07-21T22:10:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b3f7fe700 1 --2- 172.21.15.49:0/1848857206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b4006b3f0 0x7f1b400cc290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1b38009d90 tx=0x7f1b3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6a869e63ae54bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b3dffb700 1 -- 172.21.15.49:0/1848857206 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3800e070 con 0x7f1b4006b3f0 2023-07-21T22:10:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b3dffb700 1 -- 172.21.15.49:0/1848857206 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3800bb20 con 0x7f1b4006b3f0 2023-07-21T22:10:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b3dffb700 1 -- 172.21.15.49:0/1848857206 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38012430 con 0x7f1b4006b3f0 2023-07-21T22:10:41.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b459f7700 1 -- 172.21.15.49:0/1848857206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b4006b3f0 msgr2=0x7f1b400cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:41.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b459f7700 1 --2- 172.21.15.49:0/1848857206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b4006b3f0 0x7f1b400cc290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1b38009d90 tx=0x7f1b3800b330 comp rx=0 tx=0).stop 2023-07-21T22:10:41.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b459f7700 1 -- 172.21.15.49:0/1848857206 shutdown_connections 2023-07-21T22:10:41.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b459f7700 1 --2- 172.21.15.49:0/1848857206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b4006b3f0 0x7f1b400cc290 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b459f7700 1 --2- 172.21.15.49:0/1848857206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b4006e960 0x7f1b4006ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b459f7700 1 -- 172.21.15.49:0/1848857206 >> 172.21.15.49:0/1848857206 conn(0x7f1b400b0cc0 msgr2=0x7f1b400b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:41.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.314+0000 7f1b459f7700 1 -- 172.21.15.49:0/1848857206 shutdown_connections 2023-07-21T22:10:41.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.318+0000 7f1b459f7700 1 -- 172.21.15.49:0/1848857206 wait complete. 2023-07-21T22:10:41.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b459f7700 1 Processor -- start 2023-07-21T22:10:41.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b459f7700 1 -- start start 2023-07-21T22:10:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b459f7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b4006af80 0x7f1b400acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b459f7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b4006b3f0 0x7f1b401f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b459f7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b4006e960 0x7f1b4015a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b459f7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400ae840 con 0x7f1b4006e960 2023-07-21T22:10:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b459f7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400ae0b0 con 0x7f1b4006af80 2023-07-21T22:10:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b459f7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b401f23a0 con 0x7f1b4006b3f0 2023-07-21T22:10:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b3f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b4006e960 0x7f1b4015a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b3f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b4006e960 0x7f1b4015a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34510/0 (socket says 172.21.15.49:34510) 2023-07-21T22:10:41.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b3f7fe700 1 -- 172.21.15.49:0/603080398 learned_addr learned my addr 172.21.15.49:0/603080398 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:41.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b3e7fc700 1 --2- 172.21.15.49:0/603080398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b4006b3f0 0x7f1b401f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:41.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b3effd700 1 --2- 172.21.15.49:0/603080398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b4006af80 0x7f1b400acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:41.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b3f7fe700 1 -- 172.21.15.49:0/603080398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b4006b3f0 msgr2=0x7f1b401f1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:41.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b3f7fe700 1 --2- 172.21.15.49:0/603080398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b4006b3f0 0x7f1b401f1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b3f7fe700 1 -- 172.21.15.49:0/603080398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b4006af80 msgr2=0x7f1b400acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:41.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b3f7fe700 1 --2- 172.21.15.49:0/603080398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b4006af80 0x7f1b400acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.322+0000 7f1b3f7fe700 1 -- 172.21.15.49:0/603080398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b38009a70 con 0x7f1b4006e960 2023-07-21T22:10:41.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.326+0000 7f1b3f7fe700 1 --2- 172.21.15.49:0/603080398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b4006e960 0x7f1b4015a160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b38014040 tx=0x7f1b38004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:41.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.326+0000 7f1b27fff700 1 -- 172.21.15.49:0/603080398 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38012430 con 0x7f1b4006e960 2023-07-21T22:10:41.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.326+0000 7f1b27fff700 1 -- 172.21.15.49:0/603080398 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b38020070 con 0x7f1b4006e960 2023-07-21T22:10:41.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.326+0000 7f1b459f7700 1 -- 172.21.15.49:0/603080398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b40158440 con 0x7f1b4006e960 2023-07-21T22:10:41.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.326+0000 7f1b27fff700 1 -- 172.21.15.49:0/603080398 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b380098f0 con 0x7f1b4006e960 2023-07-21T22:10:41.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.326+0000 7f1b459f7700 1 -- 172.21.15.49:0/603080398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b40158a00 con 0x7f1b4006e960 2023-07-21T22:10:41.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.326+0000 7f1b459f7700 1 -- 172.21.15.49:0/603080398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4004dcb0 con 0x7f1b4006e960 2023-07-21T22:10:41.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.330+0000 7f1b27fff700 1 -- 172.21.15.49:0/603080398 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1b38004040 con 0x7f1b4006e960 2023-07-21T22:10:41.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.330+0000 7f1b27fff700 1 --2- 172.21.15.49:0/603080398 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b2c066340 0x7f1b2c0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:41.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.330+0000 7f1b27fff700 1 -- 172.21.15.49:0/603080398 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1b38022070 con 0x7f1b4006e960 2023-07-21T22:10:41.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.330+0000 7f1b3effd700 1 --2- 172.21.15.49:0/603080398 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b2c066340 0x7f1b2c0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:41.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.334+0000 7f1b3effd700 1 --2- 172.21.15.49:0/603080398 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b2c066340 0x7f1b2c0687f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1b30006d70 tx=0x7f1b300092e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:41.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.338+0000 7f1b27fff700 1 -- 172.21.15.49:0/603080398 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b380531e0 con 0x7f1b4006e960 2023-07-21T22:10:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.510+0000 7f1b459f7700 1 -- 172.21.15.49:0/603080398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b400cb960 con 0x7f1b4006e960 2023-07-21T22:10:41.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.514+0000 7f1b27fff700 1 -- 172.21.15.49:0/603080398 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f1b38056800 con 0x7f1b4006e960 2023-07-21T22:10:41.555 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:41.555 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:39.728219+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:10:41.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.518+0000 7f1b459f7700 1 -- 172.21.15.49:0/603080398 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b2c066340 msgr2=0x7f1b2c0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:41.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.518+0000 7f1b459f7700 1 --2- 172.21.15.49:0/603080398 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b2c066340 0x7f1b2c0687f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1b30006d70 tx=0x7f1b300092e0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.518+0000 7f1b459f7700 1 -- 172.21.15.49:0/603080398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b4006e960 msgr2=0x7f1b4015a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:41.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.518+0000 7f1b459f7700 1 --2- 172.21.15.49:0/603080398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b4006e960 0x7f1b4015a160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b38014040 tx=0x7f1b38004af0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.518+0000 7f1b459f7700 1 -- 172.21.15.49:0/603080398 shutdown_connections 2023-07-21T22:10:41.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.518+0000 7f1b459f7700 1 --2- 172.21.15.49:0/603080398 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b2c066340 0x7f1b2c0687f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.518+0000 7f1b459f7700 1 --2- 172.21.15.49:0/603080398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b4006e960 0x7f1b4015a160 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.518+0000 7f1b459f7700 1 --2- 172.21.15.49:0/603080398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b4006b3f0 0x7f1b401f1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.518+0000 7f1b459f7700 1 --2- 172.21.15.49:0/603080398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b4006af80 0x7f1b400acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.518+0000 7f1b459f7700 1 -- 172.21.15.49:0/603080398 >> 172.21.15.49:0/603080398 conn(0x7f1b400b0cc0 msgr2=0x7f1b400ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:41.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.518+0000 7f1b459f7700 1 -- 172.21.15.49:0/603080398 shutdown_connections 2023-07-21T22:10:41.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.518+0000 7f1b459f7700 1 -- 172.21.15.49:0/603080398 wait complete. 2023-07-21T22:10:41.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:10:41.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.734+0000 7f14ef078700 1 Processor -- start 2023-07-21T22:10:41.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.738+0000 7f14ef078700 1 -- start start 2023-07-21T22:10:41.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.738+0000 7f14ef078700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f14e80ab8d0 0x7f14e80afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:41.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.738+0000 7f14ef078700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14e80cb800 0x7f14e80b0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:41.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.738+0000 7f14ef078700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e80cdd70 con 0x7f14e815c0a0 2023-07-21T22:10:41.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.738+0000 7f14ef078700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e80abdd0 con 0x7f14e80ab8d0 2023-07-21T22:10:41.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.738+0000 7f14ef078700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80ccab0 con 0x7f14e80cb800 2023-07-21T22:10:41.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.738+0000 7f14dffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f14e80ab8d0 0x7f14e80afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:41.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.738+0000 7f14ece14700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f14e815c0a0 0x7f14e80ad350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52570/0 (socket says 172.21.15.49:52570) 2023-07-21T22:10:41.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.738+0000 7f14ece14700 1 -- 172.21.15.49:0/709780819 learned_addr learned my addr 172.21.15.49:0/709780819 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:41.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.738+0000 7f14ed615700 1 --2- 172.21.15.49:0/709780819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14e80cb800 0x7f14e80b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:41.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14dffff700 1 -- 172.21.15.49:0/709780819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14e80cb800 msgr2=0x7f14e80b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:41.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14dffff700 1 --2- 172.21.15.49:0/709780819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14e80cb800 0x7f14e80b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14dffff700 1 -- 172.21.15.49:0/709780819 >> v1:172.21.15.49:6789/0 conn(0x7f14e815c0a0 legacy=0x7f14e80ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:41.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14dffff700 1 -- 172.21.15.49:0/709780819 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e80cda40 con 0x7f14e80ab8d0 2023-07-21T22:10:41.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14df7fe700 1 -- 172.21.15.49:0/709780819 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273745399 0 0) 0x7f14e80cdd70 con 0x7f14e815c0a0 2023-07-21T22:10:41.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14dffff700 1 --2- 172.21.15.49:0/709780819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14e80ab8d0 0x7f14e80afc20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009850 tx=0x7f14d8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c6b7b6a376292e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:41.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14df7fe700 1 -- 172.21.15.49:0/709780819 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8011830 con 0x7f14e80ab8d0 2023-07-21T22:10:41.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14df7fe700 1 -- 172.21.15.49:0/709780819 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d8011990 con 0x7f14e80ab8d0 2023-07-21T22:10:41.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14df7fe700 1 -- 172.21.15.49:0/709780819 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8011d40 con 0x7f14e80ab8d0 2023-07-21T22:10:41.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14ef078700 1 -- 172.21.15.49:0/709780819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14e80ab8d0 msgr2=0x7f14e80afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:41.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14ef078700 1 --2- 172.21.15.49:0/709780819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14e80ab8d0 0x7f14e80afc20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009850 tx=0x7f14d8009b60 comp rx=0 tx=0).stop 2023-07-21T22:10:41.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14ef078700 1 -- 172.21.15.49:0/709780819 shutdown_connections 2023-07-21T22:10:41.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14ef078700 1 --2- 172.21.15.49:0/709780819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14e80cb800 0x7f14e80b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14ef078700 1 --2- 172.21.15.49:0/709780819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14e80ab8d0 0x7f14e80afc20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14ef078700 1 -- 172.21.15.49:0/709780819 >> 172.21.15.49:0/709780819 conn(0x7f14e806f5a0 msgr2=0x7f14e80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14ef078700 1 -- 172.21.15.49:0/709780819 shutdown_connections 2023-07-21T22:10:41.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.742+0000 7f14ef078700 1 -- 172.21.15.49:0/709780819 wait complete. 2023-07-21T22:10:41.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ef078700 1 Processor -- start 2023-07-21T22:10:41.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ef078700 1 -- start start 2023-07-21T22:10:41.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ef078700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14e80ab8d0 0x7f14e81505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:41.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ef078700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14e80cb800 0x7f14e80c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:41.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ef078700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14e815c0a0 0x7f14e80c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:41.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ef078700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80c5270 con 0x7f14e80ab8d0 2023-07-21T22:10:41.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ef078700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80b3d90 con 0x7f14e815c0a0 2023-07-21T22:10:41.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ef078700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80c54c0 con 0x7f14e80cb800 2023-07-21T22:10:41.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ece14700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14e80ab8d0 0x7f14e81505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:41.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ece14700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14e80ab8d0 0x7f14e81505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34526/0 (socket says 172.21.15.49:34526) 2023-07-21T22:10:41.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ece14700 1 -- 172.21.15.49:0/3972576429 learned_addr learned my addr 172.21.15.49:0/3972576429 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:41.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14dffff700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14e80cb800 0x7f14e80c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:41.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ed615700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14e815c0a0 0x7f14e80c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:41.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ece14700 1 -- 172.21.15.49:0/3972576429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14e80cb800 msgr2=0x7f14e80c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:41.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ece14700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14e80cb800 0x7f14e80c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ece14700 1 -- 172.21.15.49:0/3972576429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14e815c0a0 msgr2=0x7f14e80c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:41.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ece14700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14e815c0a0 0x7f14e80c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:41.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ece14700 1 -- 172.21.15.49:0/3972576429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80094b0 con 0x7f14e80ab8d0 2023-07-21T22:10:41.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14dffff700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14e80cb800 0x7f14e80c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14ece14700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14e80ab8d0 0x7f14e81505f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14e400cc50 tx=0x7f14e400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.746+0000 7f14dd7fa700 1 -- 172.21.15.49:0/3972576429 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e400ab40 con 0x7f14e80ab8d0 2023-07-21T22:10:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.750+0000 7f14dd7fa700 1 -- 172.21.15.49:0/3972576429 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e400acc0 con 0x7f14e80ab8d0 2023-07-21T22:10:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.750+0000 7f14ef078700 1 -- 172.21.15.49:0/3972576429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e80c57a0 con 0x7f14e80ab8d0 2023-07-21T22:10:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.750+0000 7f14dd7fa700 1 -- 172.21.15.49:0/3972576429 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e4007310 con 0x7f14e80ab8d0 2023-07-21T22:10:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.750+0000 7f14ef078700 1 -- 172.21.15.49:0/3972576429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e80c5d60 con 0x7f14e80ab8d0 2023-07-21T22:10:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.750+0000 7f14ef078700 1 -- 172.21.15.49:0/3972576429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e80ac5b0 con 0x7f14e80ab8d0 2023-07-21T22:10:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.754+0000 7f14dd7fa700 1 -- 172.21.15.49:0/3972576429 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f14e4007470 con 0x7f14e80ab8d0 2023-07-21T22:10:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.754+0000 7f14dd7fa700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f14d40662f0 0x7f14d40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.754+0000 7f14dd7fa700 1 -- 172.21.15.49:0/3972576429 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f14e4083b40 con 0x7f14e80ab8d0 2023-07-21T22:10:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.754+0000 7f14dffff700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f14d40662f0 0x7f14d40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.754+0000 7f14dffff700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f14d40662f0 0x7f14d40687a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f14d80090b0 tx=0x7f14d8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:41.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.762+0000 7f14dd7fa700 1 -- 172.21.15.49:0/3972576429 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14e4050c30 con 0x7f14e80ab8d0 2023-07-21T22:10:42.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.970+0000 7f14ef078700 1 -- 172.21.15.49:0/3972576429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14e804dcb0 con 0x7f14e80ab8d0 2023-07-21T22:10:42.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.970+0000 7f14dd7fa700 1 -- 172.21.15.49:0/3972576429 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f14e4054250 con 0x7f14e80ab8d0 2023-07-21T22:10:42.013 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:42.013 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/1894793298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1894793298},{"type":"v1","addr":"172.21.15.150:6833","nonce":1894793298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1984862419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1984862419},{"type":"v1","addr":"172.21.15.49:6836","nonce":1984862419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1331451608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1331451608},{"type":"v1","addr":"172.21.15.49:6837","nonce":1331451608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:10:34.629989+0000","modified":"2023-07-21T22:10:40.250104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2478678672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2478678672},{"type":"v1","addr":"172.21.15.150:6835","nonce":2478678672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-21T22:10:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.974+0000 7f14ef078700 1 -- 172.21.15.49:0/3972576429 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f14d40662f0 msgr2=0x7f14d40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:42.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.974+0000 7f14ef078700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f14d40662f0 0x7f14d40687a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f14d80090b0 tx=0x7f14d8008030 comp rx=0 tx=0).stop 2023-07-21T22:10:42.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.974+0000 7f14ef078700 1 -- 172.21.15.49:0/3972576429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14e80ab8d0 msgr2=0x7f14e81505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:42.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.974+0000 7f14ef078700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14e80ab8d0 0x7f14e81505f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14e400cc50 tx=0x7f14e400cf60 comp rx=0 tx=0).stop 2023-07-21T22:10:42.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.974+0000 7f14ef078700 1 -- 172.21.15.49:0/3972576429 shutdown_connections 2023-07-21T22:10:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.974+0000 7f14ef078700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f14d40662f0 0x7f14d40687a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.974+0000 7f14ef078700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14e815c0a0 0x7f14e80c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.974+0000 7f14ef078700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14e80cb800 0x7f14e80c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.974+0000 7f14ef078700 1 --2- 172.21.15.49:0/3972576429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14e80ab8d0 0x7f14e81505f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.974+0000 7f14ef078700 1 -- 172.21.15.49:0/3972576429 >> 172.21.15.49:0/3972576429 conn(0x7f14e806f5a0 msgr2=0x7f14e8159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.974+0000 7f14ef078700 1 -- 172.21.15.49:0/3972576429 shutdown_connections 2023-07-21T22:10:42.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:41.974+0000 7f14ef078700 1 -- 172.21.15.49:0/3972576429 wait complete. 2023-07-21T22:10:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 7 2023-07-21T22:10:42.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:10:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.166+0000 7f50fd627700 1 Processor -- start 2023-07-21T22:10:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.166+0000 7f50fd627700 1 -- start start 2023-07-21T22:10:42.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.166+0000 7f50fd627700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50f806d380 0x7f50f806d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:42.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.166+0000 7f50fd627700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f80cab20 con 0x7f50f8071c70 2023-07-21T22:10:42.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.166+0000 7f50fd627700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f806dc90 con 0x7f50f80cafb0 2023-07-21T22:10:42.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.166+0000 7f50fd627700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f80c9e80 con 0x7f50f806d380 2023-07-21T22:10:42.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50f7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50f806d380 0x7f50f806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:42.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50f7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50f806d380 0x7f50f806d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34540/0 (socket says 172.21.15.49:34540) 2023-07-21T22:10:42.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50f7fff700 1 -- 172.21.15.49:0/2634838793 learned_addr learned my addr 172.21.15.49:0/2634838793 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:42.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50f7fff700 1 -- 172.21.15.49:0/2634838793 >> v1:172.21.15.150:6789/0 conn(0x7f50f80cafb0 legacy=0x7f50f8164730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:42.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50f7fff700 1 -- 172.21.15.49:0/2634838793 >> v1:172.21.15.49:6789/0 conn(0x7f50f8071c70 legacy=0x7f50f80b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:42.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50f7fff700 1 -- 172.21.15.49:0/2634838793 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f80ca1f0 con 0x7f50f806d380 2023-07-21T22:10:42.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50f7fff700 1 --2- 172.21.15.49:0/2634838793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f806d380 0x7f50f806d750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009910 tx=0x7f50e8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b333f019617d58 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:42.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50f77fe700 1 -- 172.21.15.49:0/2634838793 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e800ba60 con 0x7f50f806d380 2023-07-21T22:10:42.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50f77fe700 1 -- 172.21.15.49:0/2634838793 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e800bbc0 con 0x7f50f806d380 2023-07-21T22:10:42.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50f77fe700 1 -- 172.21.15.49:0/2634838793 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e8009e60 con 0x7f50f806d380 2023-07-21T22:10:42.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50fd627700 1 -- 172.21.15.49:0/2634838793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f806d380 msgr2=0x7f50f806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:42.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50fd627700 1 --2- 172.21.15.49:0/2634838793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f806d380 0x7f50f806d750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009910 tx=0x7f50e8009c20 comp rx=0 tx=0).stop 2023-07-21T22:10:42.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50fd627700 1 -- 172.21.15.49:0/2634838793 shutdown_connections 2023-07-21T22:10:42.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50fd627700 1 --2- 172.21.15.49:0/2634838793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f806d380 0x7f50f806d750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:42.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50fd627700 1 -- 172.21.15.49:0/2634838793 >> 172.21.15.49:0/2634838793 conn(0x7f50f8070450 msgr2=0x7f50f8070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:42.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50fd627700 1 -- 172.21.15.49:0/2634838793 shutdown_connections 2023-07-21T22:10:42.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.170+0000 7f50fd627700 1 -- 172.21.15.49:0/2634838793 wait complete. 2023-07-21T22:10:42.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.174+0000 7f50fd627700 1 Processor -- start 2023-07-21T22:10:42.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.174+0000 7f50fd627700 1 -- start start 2023-07-21T22:10:42.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.174+0000 7f50fd627700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50f806d380 0x7f50f814b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:42.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.174+0000 7f50fd627700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50f8071c70 0x7f50f8151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:42.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.174+0000 7f50fd627700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f80cafb0 0x7f50f80c2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:42.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.174+0000 7f50fd627700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f81521a0 con 0x7f50f80cafb0 2023-07-21T22:10:42.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.174+0000 7f50fd627700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f8159f60 con 0x7f50f806d380 2023-07-21T22:10:42.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.174+0000 7f50fd627700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f814baf0 con 0x7f50f8071c70 2023-07-21T22:10:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.174+0000 7f50fce26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f80cafb0 0x7f50f80c2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.174+0000 7f50fce26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f80cafb0 0x7f50f80c2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34542/0 (socket says 172.21.15.49:34542) 2023-07-21T22:10:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.174+0000 7f50fce26700 1 -- 172.21.15.49:0/1252209588 learned_addr learned my addr 172.21.15.49:0/1252209588 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.174+0000 7f50effff700 1 --2- 172.21.15.49:0/1252209588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50f8071c70 0x7f50f8151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.174+0000 7f50f7fff700 1 --2- 172.21.15.49:0/1252209588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50f806d380 0x7f50f814b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.178+0000 7f50fce26700 1 -- 172.21.15.49:0/1252209588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50f8071c70 msgr2=0x7f50f8151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:42.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.178+0000 7f50fce26700 1 --2- 172.21.15.49:0/1252209588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50f8071c70 0x7f50f8151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:42.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.178+0000 7f50fce26700 1 -- 172.21.15.49:0/1252209588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50f806d380 msgr2=0x7f50f814b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:42.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.178+0000 7f50fce26700 1 --2- 172.21.15.49:0/1252209588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50f806d380 0x7f50f814b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:42.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.178+0000 7f50fce26700 1 -- 172.21.15.49:0/1252209588 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e8009570 con 0x7f50f80cafb0 2023-07-21T22:10:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.178+0000 7f50fce26700 1 --2- 172.21.15.49:0/1252209588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f80cafb0 0x7f50f80c2590 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f50f000cc50 tx=0x7f50f000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.178+0000 7f50f57fa700 1 -- 172.21.15.49:0/1252209588 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0003c20 con 0x7f50f80cafb0 2023-07-21T22:10:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.178+0000 7f50f57fa700 1 -- 172.21.15.49:0/1252209588 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f0003d80 con 0x7f50f80cafb0 2023-07-21T22:10:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.178+0000 7f50fd627700 1 -- 172.21.15.49:0/1252209588 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f815a200 con 0x7f50f80cafb0 2023-07-21T22:10:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.178+0000 7f50f57fa700 1 -- 172.21.15.49:0/1252209588 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f000aab0 con 0x7f50f80cafb0 2023-07-21T22:10:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.178+0000 7f50fd627700 1 -- 172.21.15.49:0/1252209588 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f815a7c0 con 0x7f50f80cafb0 2023-07-21T22:10:42.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.182+0000 7f50fd627700 1 -- 172.21.15.49:0/1252209588 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f804dcb0 con 0x7f50f80cafb0 2023-07-21T22:10:42.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.182+0000 7f50f57fa700 1 -- 172.21.15.49:0/1252209588 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50f000ac10 con 0x7f50f80cafb0 2023-07-21T22:10:42.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.186+0000 7f50f57fa700 1 --2- 172.21.15.49:0/1252209588 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f50d80662f0 0x7f50d80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:42.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.186+0000 7f50f57fa700 1 -- 172.21.15.49:0/1252209588 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f50f0083fc0 con 0x7f50f80cafb0 2023-07-21T22:10:42.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.186+0000 7f50f7fff700 1 --2- 172.21.15.49:0/1252209588 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f50d80662f0 0x7f50d80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:42.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.186+0000 7f50f7fff700 1 --2- 172.21.15.49:0/1252209588 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f50d80662f0 0x7f50d80687a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f50e8006f80 tx=0x7f50e801f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:42.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.190+0000 7f50f57fa700 1 -- 172.21.15.49:0/1252209588 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50f0051170 con 0x7f50f80cafb0 2023-07-21T22:10:42.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.366+0000 7f50fd627700 1 -- 172.21.15.49:0/1252209588 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50f80b3ff0 con 0x7f50f80cafb0 2023-07-21T22:10:42.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.370+0000 7f50f57fa700 1 -- 172.21.15.49:0/1252209588 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f50f0054790 con 0x7f50f80cafb0 2023-07-21T22:10:42.412 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:42.412 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:39.728219+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:10:42.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.370+0000 7f50fd627700 1 -- 172.21.15.49:0/1252209588 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f50d80662f0 msgr2=0x7f50d80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:42.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.370+0000 7f50fd627700 1 --2- 172.21.15.49:0/1252209588 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f50d80662f0 0x7f50d80687a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f50e8006f80 tx=0x7f50e801f040 comp rx=0 tx=0).stop 2023-07-21T22:10:42.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.370+0000 7f50fd627700 1 -- 172.21.15.49:0/1252209588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f80cafb0 msgr2=0x7f50f80c2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:42.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.370+0000 7f50fd627700 1 --2- 172.21.15.49:0/1252209588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f80cafb0 0x7f50f80c2590 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f50f000cc50 tx=0x7f50f000cf60 comp rx=0 tx=0).stop 2023-07-21T22:10:42.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.374+0000 7f50fd627700 1 -- 172.21.15.49:0/1252209588 shutdown_connections 2023-07-21T22:10:42.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.374+0000 7f50fd627700 1 --2- 172.21.15.49:0/1252209588 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f50d80662f0 0x7f50d80687a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:42.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.374+0000 7f50fd627700 1 --2- 172.21.15.49:0/1252209588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f80cafb0 0x7f50f80c2590 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:42.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.374+0000 7f50fd627700 1 --2- 172.21.15.49:0/1252209588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50f8071c70 0x7f50f8151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:42.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.374+0000 7f50fd627700 1 --2- 172.21.15.49:0/1252209588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50f806d380 0x7f50f814b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:42.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.374+0000 7f50fd627700 1 -- 172.21.15.49:0/1252209588 >> 172.21.15.49:0/1252209588 conn(0x7f50f8070450 msgr2=0x7f50f80b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:42.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.374+0000 7f50fd627700 1 -- 172.21.15.49:0/1252209588 shutdown_connections 2023-07-21T22:10:42.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.374+0000 7f50fd627700 1 -- 172.21.15.49:0/1252209588 wait complete. 2023-07-21T22:10:42.839 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:10:34.629989+0000', 'modified': '2023-07-21T22:10:40.250104+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/2478678672', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 2478678672}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 2478678672}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-07-21T22:10:42.840 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:10:42.840 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-21T22:10:43.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.982+0000 7f03d5200700 1 Processor -- start 2023-07-21T22:10:43.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.982+0000 7f03d5200700 1 -- start start 2023-07-21T22:10:43.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03d5200700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f03d00b7af0 0x7f03d00b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03d5200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f03d00d1e40 0x7f03d015f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03d5200700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d00b3e80 con 0x7f03d00cee10 2023-07-21T22:10:43.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03d5200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d00cea00 con 0x7f03d00d1e40 2023-07-21T22:10:43.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03d5200700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d00ccbf0 con 0x7f03d00b7af0 2023-07-21T22:10:43.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03ce59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f03d00d1e40 0x7f03d015f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03ced9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f03d00b7af0 0x7f03d00b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03cf59e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f03d00cee10 0x7f03d00b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:44582/0 (socket says 172.21.15.49:44582) 2023-07-21T22:10:43.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03ced9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f03d00b7af0 0x7f03d00b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:33828/0 (socket says 172.21.15.49:33828) 2023-07-21T22:10:43.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03ce59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f03d00d1e40 0x7f03d015f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34558/0 (socket says 172.21.15.49:34558) 2023-07-21T22:10:43.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03cf59e700 1 -- 172.21.15.49:0/3501084058 learned_addr learned my addr 172.21.15.49:0/3501084058 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:43.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03ce59c700 1 -- 172.21.15.49:0/3501084058 >> v2:172.21.15.150:3300/0 conn(0x7f03d00b7af0 msgr2=0x7f03d00b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:43.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03ce59c700 1 --2- 172.21.15.49:0/3501084058 >> v2:172.21.15.150:3300/0 conn(0x7f03d00b7af0 0x7f03d00b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03ce59c700 1 -- 172.21.15.49:0/3501084058 >> v1:172.21.15.150:6789/0 conn(0x7f03d00cee10 legacy=0x7f03d00b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03ce59c700 1 -- 172.21.15.49:0/3501084058 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d00cced0 con 0x7f03d00d1e40 2023-07-21T22:10:43.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.986+0000 7f03cdd9b700 1 -- 172.21.15.49:0/3501084058 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620597295 0 0) 0x7f03d00b3e80 con 0x7f03d00cee10 2023-07-21T22:10:43.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.990+0000 7f03ce59c700 1 --2- 172.21.15.49:0/3501084058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03d00d1e40 0x7f03d015f630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f03d00cede0 tx=0x7f03c4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc8d6630dc3623d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:43.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.990+0000 7f03cdd9b700 1 -- 172.21.15.49:0/3501084058 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4011830 con 0x7f03d00d1e40 2023-07-21T22:10:43.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.990+0000 7f03cdd9b700 1 -- 172.21.15.49:0/3501084058 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c4011990 con 0x7f03d00d1e40 2023-07-21T22:10:43.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.990+0000 7f03cdd9b700 1 -- 172.21.15.49:0/3501084058 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4011d20 con 0x7f03d00d1e40 2023-07-21T22:10:43.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.990+0000 7f03d5200700 1 -- 172.21.15.49:0/3501084058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03d00d1e40 msgr2=0x7f03d015f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.990+0000 7f03d5200700 1 --2- 172.21.15.49:0/3501084058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03d00d1e40 0x7f03d015f630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f03d00cede0 tx=0x7f03c4009b30 comp rx=0 tx=0).stop 2023-07-21T22:10:43.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.990+0000 7f03d5200700 1 -- 172.21.15.49:0/3501084058 shutdown_connections 2023-07-21T22:10:43.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.990+0000 7f03d5200700 1 --2- 172.21.15.49:0/3501084058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03d00d1e40 0x7f03d015f630 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.990+0000 7f03d5200700 1 --2- 172.21.15.49:0/3501084058 >> v2:172.21.15.150:3300/0 conn(0x7f03d00b7af0 0x7f03d00b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.990+0000 7f03d5200700 1 -- 172.21.15.49:0/3501084058 >> 172.21.15.49:0/3501084058 conn(0x7f03d006e960 msgr2=0x7f03d006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:43.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.990+0000 7f03d5200700 1 -- 172.21.15.49:0/3501084058 shutdown_connections 2023-07-21T22:10:43.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.990+0000 7f03d5200700 1 -- 172.21.15.49:0/3501084058 wait complete. 2023-07-21T22:10:43.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.994+0000 7f03d5200700 1 Processor -- start 2023-07-21T22:10:43.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.994+0000 7f03d5200700 1 -- start start 2023-07-21T22:10:43.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03d5200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03d00b7af0 0x7f03d00c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03d5200700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03d00cee10 0x7f03d0154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03d5200700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03d00d1e40 0x7f03d00b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03d5200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d015b500 con 0x7f03d00b7af0 2023-07-21T22:10:43.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03d5200700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d00ca5a0 con 0x7f03d00cee10 2023-07-21T22:10:43.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03d5200700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d00c9d00 con 0x7f03d00d1e40 2023-07-21T22:10:43.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03ced9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03d00b7af0 0x7f03d00c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03ced9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03d00b7af0 0x7f03d00c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34574/0 (socket says 172.21.15.49:34574) 2023-07-21T22:10:43.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03ced9d700 1 -- 172.21.15.49:0/880830013 learned_addr learned my addr 172.21.15.49:0/880830013 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:43.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03cf59e700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03d00d1e40 0x7f03d00b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03ce59c700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03d00cee10 0x7f03d0154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03ced9d700 1 -- 172.21.15.49:0/880830013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03d00d1e40 msgr2=0x7f03d00b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03ced9d700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03d00d1e40 0x7f03d00b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03ced9d700 1 -- 172.21.15.49:0/880830013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03d00cee10 msgr2=0x7f03d0154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03ced9d700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03d00cee10 0x7f03d0154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03ced9d700 1 -- 172.21.15.49:0/880830013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c40094b0 con 0x7f03d00b7af0 2023-07-21T22:10:43.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03cf59e700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03d00d1e40 0x7f03d00b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:43.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03ced9d700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03d00b7af0 0x7f03d00c94d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f03c000e9d0 tx=0x7f03c000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:43.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:42.998+0000 7f03b77fe700 1 -- 172.21.15.49:0/880830013 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0009720 con 0x7f03d00b7af0 2023-07-21T22:10:43.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.002+0000 7f03d5200700 1 -- 172.21.15.49:0/880830013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d00c9fe0 con 0x7f03d00b7af0 2023-07-21T22:10:43.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.002+0000 7f03b77fe700 1 -- 172.21.15.49:0/880830013 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c000ee70 con 0x7f03d00b7af0 2023-07-21T22:10:43.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.002+0000 7f03b77fe700 1 -- 172.21.15.49:0/880830013 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c000ca50 con 0x7f03d00b7af0 2023-07-21T22:10:43.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.002+0000 7f03d5200700 1 -- 172.21.15.49:0/880830013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d00c5fd0 con 0x7f03d00b7af0 2023-07-21T22:10:43.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.002+0000 7f03b77fe700 1 -- 172.21.15.49:0/880830013 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f03c000cbb0 con 0x7f03d00b7af0 2023-07-21T22:10:43.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.006+0000 7f03b77fe700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f03bc0662f0 0x7f03bc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.006+0000 7f03b77fe700 1 -- 172.21.15.49:0/880830013 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f03c00840e0 con 0x7f03d00b7af0 2023-07-21T22:10:43.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.006+0000 7f03ce59c700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f03bc0662f0 0x7f03bc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.006+0000 7f03d8486740 1 Processor -- start 2023-07-21T22:10:43.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.006+0000 7f03ce59c700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f03bc0662f0 0x7f03bc0687a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f03c4000c00 tx=0x7f03c4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:43.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03d8486740 1 -- start start 2023-07-21T22:10:43.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03d8486740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x1724840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03d8486740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x1724d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03d8486740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 0x16d9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03d8486740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x15f8270 con 0x146beb0 2023-07-21T22:10:43.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03d8486740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x164b3a0 con 0x146b710 2023-07-21T22:10:43.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03d8486740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x1644600 con 0x146bae0 2023-07-21T22:10:43.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03ced9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x1724840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03ced9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x1724840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34584/0 (socket says 172.21.15.49:34584) 2023-07-21T22:10:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03ced9d700 1 -- 172.21.15.49:0/3722683110 learned_addr learned my addr 172.21.15.49:0/3722683110 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03ce59c700 1 --2- 172.21.15.49:0/3722683110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x1724d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03cf59e700 1 --2- 172.21.15.49:0/3722683110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 0x16d9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03ced9d700 1 -- 172.21.15.49:0/3722683110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 msgr2=0x1724d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03ced9d700 1 --2- 172.21.15.49:0/3722683110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x1724d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03ced9d700 1 -- 172.21.15.49:0/3722683110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 msgr2=0x16d9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03ced9d700 1 --2- 172.21.15.49:0/3722683110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 0x16d9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03ced9d700 1 -- 172.21.15.49:0/3722683110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14b79e0 con 0x146beb0 2023-07-21T22:10:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03cf59e700 1 --2- 172.21.15.49:0/3722683110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 0x16d9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03ced9d700 1 --2- 172.21.15.49:0/3722683110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x1724840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f03c00820f0 tx=0x7f03c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fcb0960b6884f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03b4ff9700 1 -- 172.21.15.49:0/3722683110 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0053240 con 0x146beb0 2023-07-21T22:10:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03b4ff9700 1 -- 172.21.15.49:0/3722683110 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c0054390 con 0x146beb0 2023-07-21T22:10:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.010+0000 7f03b4ff9700 1 -- 172.21.15.49:0/3722683110 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c005cd60 con 0x146beb0 2023-07-21T22:10:43.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 -- 172.21.15.49:0/3722683110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 msgr2=0x1724840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 --2- 172.21.15.49:0/3722683110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x1724840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f03c00820f0 tx=0x7f03c000cf90 comp rx=0 tx=0).stop 2023-07-21T22:10:43.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 -- 172.21.15.49:0/3722683110 shutdown_connections 2023-07-21T22:10:43.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 --2- 172.21.15.49:0/3722683110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 0x16d9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 --2- 172.21.15.49:0/3722683110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x1724d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 --2- 172.21.15.49:0/3722683110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x1724840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 -- 172.21.15.49:0/3722683110 >> 172.21.15.49:0/3722683110 conn(0x16d5b60 msgr2=0x16e0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:43.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 -- 172.21.15.49:0/3722683110 shutdown_connections 2023-07-21T22:10:43.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 -- 172.21.15.49:0/3722683110 wait complete. 2023-07-21T22:10:43.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 -- start start 2023-07-21T22:10:43.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 Processor -- start 2023-07-21T22:10:43.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 0x1709710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x170a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x170a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1606b00 con 0x146beb0 2023-07-21T22:10:43.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.014+0000 7f03d8486740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x1605470 con 0x146b710 2023-07-21T22:10:43.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03d8486740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x14f0b20 con 0x146bae0 2023-07-21T22:10:43.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03d8486740 10 client.0 _ll_register_callbacks cb 0x166a530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:10:43.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03cf59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x170a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03cf59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x170a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34600/0 (socket says 172.21.15.49:34600) 2023-07-21T22:10:43.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03cf59e700 1 -- 172.21.15.49:0/2035750280 learned_addr learned my addr 172.21.15.49:0/2035750280 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:43.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03ced9d700 1 --2- 172.21.15.49:0/2035750280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 0x1709710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03ce59c700 1 --2- 172.21.15.49:0/2035750280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x170a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03cf59e700 1 -- 172.21.15.49:0/2035750280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 msgr2=0x170a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:43.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03cf59e700 1 --2- 172.21.15.49:0/2035750280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x170a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03cf59e700 1 -- 172.21.15.49:0/2035750280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 msgr2=0x1709710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:43.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03cf59e700 1 --2- 172.21.15.49:0/2035750280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 0x1709710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03cf59e700 1 -- 172.21.15.49:0/2035750280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d00c5fd0 con 0x146beb0 2023-07-21T22:10:43.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03cf59e700 1 --2- 172.21.15.49:0/2035750280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x170a6d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f03c80112d0 tx=0x7f03c80115e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5aee5ce649230 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:43.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03adffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-07-21T22:10:43.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03adffb700 1 -- 172.21.15.49:0/2035750280 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c8015470 con 0x146beb0 2023-07-21T22:10:43.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03d8486740 1 -- 172.21.15.49:0/2035750280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x163d5e0 con 0x146beb0 2023-07-21T22:10:43.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03adffb700 1 -- 172.21.15.49:0/2035750280 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f03c80155d0 con 0x146beb0 2023-07-21T22:10:43.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03adffb700 1 -- 172.21.15.49:0/2035750280 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03c8015790 con 0x146beb0 2023-07-21T22:10:43.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03d8486740 10 client.4431 fetch_fsmap learned FSMap version 7 2023-07-21T22:10:43.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03d8486740 1 -- 172.21.15.49:0/2035750280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x160a250 con 0x146beb0 2023-07-21T22:10:43.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03adffb700 1 -- 172.21.15.49:0/2035750280 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x163d5e0 con 0x146beb0 2023-07-21T22:10:43.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03adffb700 1 -- 172.21.15.49:0/2035750280 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f03c80158f0 con 0x146beb0 2023-07-21T22:10:43.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03d8486740 10 client.4431 fetch_fsmap finished waiting for FSMap version 7 2023-07-21T22:10:43.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03d8486740 10 client.4431 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-21T22:10:43.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03d8486740 20 client.4431 populate_metadata read hostname 'smithi049' 2023-07-21T22:10:43.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03d8486740 1 --2- 172.21.15.49:0/2035750280 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x14b6790 0x172d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03d8486740 4 client.4431 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:10:43.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03d8486740 1 -- 172.21.15.49:0/2035750280 --> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x163d300 con 0x14b6790 2023-07-21T22:10:43.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03ced9d700 1 --2- 172.21.15.49:0/2035750280 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x14b6790 0x172d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03ced9d700 1 --2- 172.21.15.49:0/2035750280 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x14b6790 0x172d9b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=367e8d9603096a8e server_cookie=abdd93519072078a in_seq=0 out_seq=0 2023-07-21T22:10:43.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.018+0000 7f03adffb700 10 client.4431 ms_handle_connect on v2:172.21.15.150:6834/2478678672 2023-07-21T22:10:43.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03adffb700 1 -- 172.21.15.49:0/2035750280 <== mds.0 v2:172.21.15.150:6834/2478678672 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x163d300 con 0x14b6790 2023-07-21T22:10:43.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03adffb700 10 client.4431 handle_command_reply: tid=0 2023-07-21T22:10:43.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03d8486740 1 client.4431 shutdown 2023-07-21T22:10:43.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03d8486740 1 -- 172.21.15.49:0/2035750280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 msgr2=0x170a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03d8486740 1 --2- 172.21.15.49:0/2035750280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x170a6d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f03c80112d0 tx=0x7f03c80115e0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03d8486740 1 -- 172.21.15.49:0/2035750280 shutdown_connections 2023-07-21T22:10:43.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03d8486740 1 --2- 172.21.15.49:0/2035750280 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x14b6790 0x172d9b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03d8486740 1 --2- 172.21.15.49:0/2035750280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x170a6d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03d8486740 1 --2- 172.21.15.49:0/2035750280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x170a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03d8486740 1 --2- 172.21.15.49:0/2035750280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 0x1709710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03adffb700 0 client.4431 ms_handle_reset on v2:172.21.15.150:6834/2478678672 2023-07-21T22:10:43.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03d8486740 1 -- 172.21.15.49:0/2035750280 >> 172.21.15.49:0/2035750280 conn(0x16d5b60 msgr2=0x1707180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:43.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03d8486740 1 -- 172.21.15.49:0/2035750280 shutdown_connections 2023-07-21T22:10:43.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03d8486740 1 -- 172.21.15.49:0/2035750280 wait complete. 2023-07-21T22:10:43.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.022+0000 7f03d8486740 20 client.4431 trim_cache size 0 max 16384 2023-07-21T22:10:43.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.046+0000 7f03d8486740 1 Processor -- start 2023-07-21T22:10:43.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.046+0000 7f03d8486740 1 -- start start 2023-07-21T22:10:43.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.046+0000 7f03d8486740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146b710 0x16d9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.046+0000 7f03d8486740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x16d99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.046+0000 7f03d8486740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146beb0 0x1707180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.046+0000 7f03d8486740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1641a00 con 0x146b710 2023-07-21T22:10:43.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.046+0000 7f03d8486740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x1641e10 con 0x146beb0 2023-07-21T22:10:43.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.046+0000 7f03d8486740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x15e2f30 con 0x146bae0 2023-07-21T22:10:43.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.046+0000 7f03ced9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146b710 0x16d9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.046+0000 7f03ced9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146b710 0x16d9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34616/0 (socket says 172.21.15.49:34616) 2023-07-21T22:10:43.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.046+0000 7f03ced9d700 1 -- 172.21.15.49:0/3590540883 learned_addr learned my addr 172.21.15.49:0/3590540883 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:43.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.046+0000 7f03cf59e700 1 --2- 172.21.15.49:0/3590540883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146beb0 0x1707180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.046+0000 7f03ce59c700 1 --2- 172.21.15.49:0/3590540883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x16d99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03ced9d700 1 -- 172.21.15.49:0/3590540883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 msgr2=0x16d99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:43.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03ced9d700 1 --2- 172.21.15.49:0/3590540883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x16d99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03ced9d700 1 -- 172.21.15.49:0/3590540883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146beb0 msgr2=0x1707180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03ced9d700 1 --2- 172.21.15.49:0/3590540883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146beb0 0x1707180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03ced9d700 1 -- 172.21.15.49:0/3590540883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d00b6c50 con 0x146b710 2023-07-21T22:10:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03cf59e700 1 --2- 172.21.15.49:0/3590540883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146beb0 0x1707180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03ced9d700 1 --2- 172.21.15.49:0/3590540883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146b710 0x16d9490 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f03c0054e30 tx=0x7f03c0058fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f26e067061dd0a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03b57fa700 1 -- 172.21.15.49:0/3590540883 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0053240 con 0x146b710 2023-07-21T22:10:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03b57fa700 1 -- 172.21.15.49:0/3590540883 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c0054500 con 0x146b710 2023-07-21T22:10:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03b57fa700 1 -- 172.21.15.49:0/3590540883 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c005cf60 con 0x146b710 2023-07-21T22:10:43.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03d8486740 1 -- 172.21.15.49:0/3590540883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146b710 msgr2=0x16d9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03d8486740 1 --2- 172.21.15.49:0/3590540883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146b710 0x16d9490 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f03c0054e30 tx=0x7f03c0058fe0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03d8486740 1 -- 172.21.15.49:0/3590540883 shutdown_connections 2023-07-21T22:10:43.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03d8486740 1 --2- 172.21.15.49:0/3590540883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146beb0 0x1707180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03d8486740 1 --2- 172.21.15.49:0/3590540883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x16d99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03d8486740 1 --2- 172.21.15.49:0/3590540883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146b710 0x16d9490 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03d8486740 1 -- 172.21.15.49:0/3590540883 >> 172.21.15.49:0/3590540883 conn(0x16d5b60 msgr2=0x170a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:43.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03d8486740 1 -- 172.21.15.49:0/3590540883 shutdown_connections 2023-07-21T22:10:43.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03d8486740 1 -- 172.21.15.49:0/3590540883 wait complete. 2023-07-21T22:10:43.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03d8486740 1 -- start start 2023-07-21T22:10:43.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.050+0000 7f03d8486740 1 Processor -- start 2023-07-21T22:10:43.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 0x17289c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x1781bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x170a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1602ea0 con 0x146beb0 2023-07-21T22:10:43.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x1648600 con 0x146b710 2023-07-21T22:10:43.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x1647160 con 0x146bae0 2023-07-21T22:10:43.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 10 client.0 _ll_register_callbacks cb 0x15fc800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:10:43.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03cf59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x170a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03cf59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x170a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34624/0 (socket says 172.21.15.49:34624) 2023-07-21T22:10:43.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03cf59e700 1 -- 172.21.15.49:0/3621495469 learned_addr learned my addr 172.21.15.49:0/3621495469 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:43.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03ced9d700 1 --2- 172.21.15.49:0/3621495469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 0x17289c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03ce59c700 1 --2- 172.21.15.49:0/3621495469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x1781bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03cf59e700 1 -- 172.21.15.49:0/3621495469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 msgr2=0x1781bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:43.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03cf59e700 1 --2- 172.21.15.49:0/3621495469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x1781bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03cf59e700 1 -- 172.21.15.49:0/3621495469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 msgr2=0x17289c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:43.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03cf59e700 1 --2- 172.21.15.49:0/3621495469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 0x17289c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03cf59e700 1 -- 172.21.15.49:0/3621495469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x14b79e0 con 0x146beb0 2023-07-21T22:10:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03ced9d700 1 --2- 172.21.15.49:0/3621495469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 0x17289c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03cf59e700 1 --2- 172.21.15.49:0/3621495469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x170a3d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f03c8007610 tx=0x7f03c80012a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33501d44d44b7e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03adffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-07-21T22:10:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03adffb700 1 -- 172.21.15.49:0/3621495469 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c802b070 con 0x146beb0 2023-07-21T22:10:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 1 -- 172.21.15.49:0/3621495469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f03c0054390 con 0x146beb0 2023-07-21T22:10:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03adffb700 1 -- 172.21.15.49:0/3621495469 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f03c801db60 con 0x146beb0 2023-07-21T22:10:43.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03adffb700 1 -- 172.21.15.49:0/3621495469 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03c80119e0 con 0x146beb0 2023-07-21T22:10:43.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 10 client.4437 fetch_fsmap learned FSMap version 7 2023-07-21T22:10:43.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 1 -- 172.21.15.49:0/3621495469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x15f05c0 con 0x146beb0 2023-07-21T22:10:43.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03adffb700 1 -- 172.21.15.49:0/3621495469 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c0054390 con 0x146beb0 2023-07-21T22:10:43.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03adffb700 1 -- 172.21.15.49:0/3621495469 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f03c801d350 con 0x146beb0 2023-07-21T22:10:43.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 10 client.4437 fetch_fsmap finished waiting for FSMap version 7 2023-07-21T22:10:43.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 10 client.4437 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-21T22:10:43.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 20 client.4437 populate_metadata read hostname 'smithi049' 2023-07-21T22:10:43.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 1 --2- 172.21.15.49:0/3621495469 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x1729450 0x1726850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 4 client.4437 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-07-21T22:10:43.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.054+0000 7f03d8486740 1 -- 172.21.15.49:0/3621495469 --> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] -- command(tid 0: {"prefix": "status"}) v1 -- 0x14c34e0 con 0x1729450 2023-07-21T22:10:43.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03ced9d700 1 --2- 172.21.15.49:0/3621495469 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x1729450 0x1726850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03adffb700 10 client.4437 ms_handle_connect on v2:172.21.15.150:6834/2478678672 2023-07-21T22:10:43.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03ced9d700 1 --2- 172.21.15.49:0/3621495469 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x1729450 0x1726850 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=914d5231116b35c0 server_cookie=71caa2d515e7cd89 in_seq=0 out_seq=0 2023-07-21T22:10:43.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03adffb700 1 -- 172.21.15.49:0/3621495469 <== mds.0 v2:172.21.15.150:6834/2478678672 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x14c34e0 con 0x1729450 2023-07-21T22:10:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03adffb700 10 client.4437 handle_command_reply: tid=0 2023-07-21T22:10:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03d8486740 1 client.4437 shutdown 2023-07-21T22:10:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03d8486740 1 -- 172.21.15.49:0/3621495469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 msgr2=0x170a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03d8486740 1 --2- 172.21.15.49:0/3621495469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x170a3d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f03c8007610 tx=0x7f03c80012a0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03d8486740 1 -- 172.21.15.49:0/3621495469 shutdown_connections 2023-07-21T22:10:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03d8486740 1 --2- 172.21.15.49:0/3621495469 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x1729450 0x1726850 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03d8486740 1 --2- 172.21.15.49:0/3621495469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x146beb0 0x170a3d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03d8486740 1 --2- 172.21.15.49:0/3621495469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x146bae0 0x1781bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03d8486740 1 --2- 172.21.15.49:0/3621495469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x146b710 0x17289c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03adffb700 0 client.4437 ms_handle_reset on v2:172.21.15.150:6834/2478678672 2023-07-21T22:10:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03d8486740 1 -- 172.21.15.49:0/3621495469 >> 172.21.15.49:0/3621495469 conn(0x16d5b60 msgr2=0x1723a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03d8486740 1 -- 172.21.15.49:0/3621495469 shutdown_connections 2023-07-21T22:10:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03d8486740 1 -- 172.21.15.49:0/3621495469 wait complete. 2023-07-21T22:10:43.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.058+0000 7f03d8486740 20 client.4437 trim_cache size 0 max 16384 2023-07-21T22:10:43.107 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:10:43.107 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "c1346180-e695-42c2-8f5b-b72be8101116", 2023-07-21T22:10:43.107 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-07-21T22:10:43.108 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4291, 2023-07-21T22:10:43.108 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-07-21T22:10:43.108 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-07-21T22:10:43.108 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-07-21T22:10:43.108 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 7.8696820560000003, 2023-07-21T22:10:43.109 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 7, 2023-07-21T22:10:43.109 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 30, 2023-07-21T22:10:43.109 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 29, 2023-07-21T22:10:43.109 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 13.769317343000001 2023-07-21T22:10:43.109 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:10:43.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.062+0000 7f03d5200700 1 -- 172.21.15.49:0/880830013 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f03bc0662f0 msgr2=0x7f03bc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.062+0000 7f03d5200700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f03bc0662f0 0x7f03bc0687a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f03c4000c00 tx=0x7f03c4008030 comp rx=0 tx=0).stop 2023-07-21T22:10:43.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.062+0000 7f03d5200700 1 -- 172.21.15.49:0/880830013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03d00b7af0 msgr2=0x7f03d00c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.062+0000 7f03d5200700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03d00b7af0 0x7f03d00c94d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f03c000e9d0 tx=0x7f03c000ece0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.062+0000 7f03d5200700 1 -- 172.21.15.49:0/880830013 shutdown_connections 2023-07-21T22:10:43.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.062+0000 7f03d5200700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f03bc0662f0 0x7f03bc0687a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.062+0000 7f03d5200700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03d00d1e40 0x7f03d00b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.062+0000 7f03d5200700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03d00cee10 0x7f03d0154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.062+0000 7f03d5200700 1 --2- 172.21.15.49:0/880830013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03d00b7af0 0x7f03d00c94d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.062+0000 7f03d5200700 1 -- 172.21.15.49:0/880830013 >> 172.21.15.49:0/880830013 conn(0x7f03d006e960 msgr2=0x7f03d00cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:43.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.062+0000 7f03d5200700 1 -- 172.21.15.49:0/880830013 shutdown_connections 2023-07-21T22:10:43.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.062+0000 7f03d5200700 1 -- 172.21.15.49:0/880830013 wait complete. 2023-07-21T22:10:43.126 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T22:10:43.127 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-21T22:10:43.128 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:10:43.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.274+0000 7f9e5bcb3700 1 Processor -- start 2023-07-21T22:10:43.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.274+0000 7f9e5bcb3700 1 -- start start 2023-07-21T22:10:43.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.274+0000 7f9e5bcb3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9e540ce790 0x7f9e540ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.274+0000 7f9e5bcb3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e540b8680 con 0x7f9e540d0b80 2023-07-21T22:10:43.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.274+0000 7f9e5bcb3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e540d3500 con 0x7f9e540cdd50 2023-07-21T22:10:43.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.274+0000 7f9e5bcb3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e540d2fa0 con 0x7f9e540ce790 2023-07-21T22:10:43.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.274+0000 7f9e5a250700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9e540ce790 0x7f9e540ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.274+0000 7f9e5924e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9e540d0b80 0x7f9e540cf330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52592/0 (socket says 172.21.15.49:52592) 2023-07-21T22:10:43.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.274+0000 7f9e5924e700 1 -- 172.21.15.49:0/802518406 learned_addr learned my addr 172.21.15.49:0/802518406 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:43.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.274+0000 7f9e59a4f700 1 --1- 172.21.15.49:0/802518406 >> v1:172.21.15.150:6789/0 conn(0x7f9e540cdd50 0x7f9e540d0470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:44594/0 (socket says 172.21.15.49:44594) 2023-07-21T22:10:43.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e58a4d700 1 -- 172.21.15.49:0/802518406 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723787708 0 0) 0x7f9e540d3500 con 0x7f9e540cdd50 2023-07-21T22:10:43.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e58a4d700 1 -- 172.21.15.49:0/802518406 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e400035d0 con 0x7f9e540cdd50 2023-07-21T22:10:43.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e5a250700 1 -- 172.21.15.49:0/802518406 >> v1:172.21.15.150:6789/0 conn(0x7f9e540cdd50 legacy=0x7f9e540d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e5a250700 1 -- 172.21.15.49:0/802518406 >> v1:172.21.15.49:6789/0 conn(0x7f9e540d0b80 legacy=0x7f9e540cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e58a4d700 1 -- 172.21.15.49:0/802518406 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30663660 0 0) 0x7f9e540b8680 con 0x7f9e540d0b80 2023-07-21T22:10:43.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e5a250700 1 -- 172.21.15.49:0/802518406 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e540b6290 con 0x7f9e540ce790 2023-07-21T22:10:43.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e5a250700 1 --2- 172.21.15.49:0/802518406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540ce790 0x7f9e540ccce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009850 tx=0x7f9e4c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec399da4445641d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:43.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e58a4d700 1 -- 172.21.15.49:0/802518406 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c011830 con 0x7f9e540ce790 2023-07-21T22:10:43.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e58a4d700 1 -- 172.21.15.49:0/802518406 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c011990 con 0x7f9e540ce790 2023-07-21T22:10:43.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e58a4d700 1 -- 172.21.15.49:0/802518406 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c011d00 con 0x7f9e540ce790 2023-07-21T22:10:43.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/802518406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540ce790 msgr2=0x7f9e540ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e5bcb3700 1 --2- 172.21.15.49:0/802518406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540ce790 0x7f9e540ccce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009850 tx=0x7f9e4c009b60 comp rx=0 tx=0).stop 2023-07-21T22:10:43.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/802518406 shutdown_connections 2023-07-21T22:10:43.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e5bcb3700 1 --2- 172.21.15.49:0/802518406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540ce790 0x7f9e540ccce0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/802518406 >> 172.21.15.49:0/802518406 conn(0x7f9e540b55e0 msgr2=0x7f9e540b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:43.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/802518406 shutdown_connections 2023-07-21T22:10:43.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.278+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/802518406 wait complete. 2023-07-21T22:10:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.282+0000 7f9e5bcb3700 1 Processor -- start 2023-07-21T22:10:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.282+0000 7f9e5bcb3700 1 -- start start 2023-07-21T22:10:43.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.282+0000 7f9e5bcb3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e540cdd50 0x7f9e541f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.282+0000 7f9e5bcb3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540ce790 0x7f9e5414ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.282+0000 7f9e5bcb3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e540d0b80 0x7f9e541f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.282+0000 7f9e5bcb3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540b46d0 con 0x7f9e540ce790 2023-07-21T22:10:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.282+0000 7f9e5bcb3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540b3ae0 con 0x7f9e540d0b80 2023-07-21T22:10:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.282+0000 7f9e5bcb3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5414f3c0 con 0x7f9e540cdd50 2023-07-21T22:10:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.282+0000 7f9e5924e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540ce790 0x7f9e5414ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.282+0000 7f9e5924e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540ce790 0x7f9e5414ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34636/0 (socket says 172.21.15.49:34636) 2023-07-21T22:10:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.282+0000 7f9e5924e700 1 -- 172.21.15.49:0/2527633932 learned_addr learned my addr 172.21.15.49:0/2527633932 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.282+0000 7f9e59a4f700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e540cdd50 0x7f9e541f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.282+0000 7f9e5a250700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e540d0b80 0x7f9e541f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.286+0000 7f9e5924e700 1 -- 172.21.15.49:0/2527633932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e540cdd50 msgr2=0x7f9e541f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.286+0000 7f9e5924e700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e540cdd50 0x7f9e541f5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.286+0000 7f9e5924e700 1 -- 172.21.15.49:0/2527633932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e540d0b80 msgr2=0x7f9e541f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.286+0000 7f9e5924e700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e540d0b80 0x7f9e541f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.286+0000 7f9e5924e700 1 -- 172.21.15.49:0/2527633932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c0094b0 con 0x7f9e540ce790 2023-07-21T22:10:43.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.286+0000 7f9e59a4f700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e540cdd50 0x7f9e541f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:43.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.286+0000 7f9e5924e700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540ce790 0x7f9e5414ee80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400c4e0 tx=0x7f9e4400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:43.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.286+0000 7f9e4a7fc700 1 -- 172.21.15.49:0/2527633932 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44004ca0 con 0x7f9e540ce790 2023-07-21T22:10:43.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.286+0000 7f9e4a7fc700 1 -- 172.21.15.49:0/2527633932 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e44004e20 con 0x7f9e540ce790 2023-07-21T22:10:43.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.286+0000 7f9e4a7fc700 1 -- 172.21.15.49:0/2527633932 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44007310 con 0x7f9e540ce790 2023-07-21T22:10:43.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.286+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/2527633932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e540b3d30 con 0x7f9e540ce790 2023-07-21T22:10:43.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.286+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/2527633932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e540b42f0 con 0x7f9e540ce790 2023-07-21T22:10:43.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.286+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/2527633932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e540d3200 con 0x7f9e540ce790 2023-07-21T22:10:43.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.290+0000 7f9e4a7fc700 1 -- 172.21.15.49:0/2527633932 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e44007470 con 0x7f9e540ce790 2023-07-21T22:10:43.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.290+0000 7f9e4a7fc700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9e38066370 0x7f9e38068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:43.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.290+0000 7f9e4a7fc700 1 -- 172.21.15.49:0/2527633932 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9e44083a70 con 0x7f9e540ce790 2023-07-21T22:10:43.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.290+0000 7f9e59a4f700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9e38066370 0x7f9e38068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:43.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.290+0000 7f9e59a4f700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9e38066370 0x7f9e38068820 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9e50001330 tx=0x7f9e500019a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:43.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.298+0000 7f9e4a7fc700 1 -- 172.21.15.49:0/2527633932 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e540d3200 con 0x7f9e540ce790 2023-07-21T22:10:43.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.510+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/2527633932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e540b4810 con 0x7f9e540ce790 2023-07-21T22:10:43.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.514+0000 7f9e4a7fc700 1 -- 172.21.15.49:0/2527633932 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9e540b4810 con 0x7f9e540ce790 2023-07-21T22:10:43.556 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-21T22:10:43.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.514+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/2527633932 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9e38066370 msgr2=0x7f9e38068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.514+0000 7f9e5bcb3700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9e38066370 0x7f9e38068820 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9e50001330 tx=0x7f9e500019a0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.514+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/2527633932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540ce790 msgr2=0x7f9e5414ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.514+0000 7f9e5bcb3700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540ce790 0x7f9e5414ee80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400c4e0 tx=0x7f9e4400c7f0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.514+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/2527633932 shutdown_connections 2023-07-21T22:10:43.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.514+0000 7f9e5bcb3700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9e38066370 0x7f9e38068820 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.514+0000 7f9e5bcb3700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540ce790 0x7f9e5414ee80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.514+0000 7f9e5bcb3700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e540d0b80 0x7f9e541f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.514+0000 7f9e5bcb3700 1 --2- 172.21.15.49:0/2527633932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e540cdd50 0x7f9e541f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.514+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/2527633932 >> 172.21.15.49:0/2527633932 conn(0x7f9e540b55e0 msgr2=0x7f9e540b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:43.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.514+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/2527633932 shutdown_connections 2023-07-21T22:10:43.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:43.514+0000 7f9e5bcb3700 1 -- 172.21.15.49:0/2527633932 wait complete. 2023-07-21T22:10:43.577 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T22:10:43.578 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:10:43.578 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-07-21T22:10:43.578 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-07-21T22:10:43.578 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-21T22:10:43.578 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T22:10:43.579 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:10:43.579 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:10:43.579 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-07-21T22:10:43.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:43.580 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-07-21T22:10:43.597 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:10:43.597 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:10:43.597 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:10:43.597 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:10:43.598 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-07-21T22:10:43.598 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:10:43.598 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:10:43.598 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:10:43.598 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-07-21T22:10:43.598 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:10:43.598 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:10:43.599 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-07-21T22:10:43.599 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:10:43.599 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:10:43.599 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-07-21T22:10:43.599 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:10:43.599 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42311sec preferred_lft 42311sec 2023-07-21T22:10:43.599 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-07-21T22:10:43.600 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:10:43.600 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:10:43.600 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:10:43.600 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-07-21T22:10:43.600 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:10:43.600 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:19:e1:20:16 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:10:43.600 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:10:43.601 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:10:43.602 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-21T22:10:43.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:43.602 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:10:43.603 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:10:43.603 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2023-07-21T22:10:43.603 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2023-07-21T22:10:43.603 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2023-07-21T22:10:43.604 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-21T22:10:43.604 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:10:43.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:43.761 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:10:43.788 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-07-21T22:10:43.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:43.792 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-07-21T22:10:43.869 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-07-21T22:10:43.869 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:10:43.870 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:10:43.870 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:10:43.870 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:10:43.870 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:10:43.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:43.872 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:10:43.872 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:10:43.872 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:10:43.872 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:10:43.873 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:10:43.873 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:10:44.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:44.013 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-07-21T22:10:44.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:44.030 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2023-07-21T22:10:44.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:44.095 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:10:44.095 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:10:44.096 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-21T22:10:44.098 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-07-21T22:10:44.098 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:10:44.218 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-07-21T22:10:44.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:44.220 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:10:44.220 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:10:44.221 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-07-21T22:10:44.221 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-21T22:10:44.221 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-07-21T22:10:44.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-07-21T22:10:44.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-07-21T22:10:44.223 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:10:44.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:44.396 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:10:44.397 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:10:44.398 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-07-21T22:10:44.398 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2023-07-21T22:10:44.399 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:10:44.476 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-07-21T22:10:44.477 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:10:44.477 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-07-21T22:10:44.493 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-07-21T22:10:44.494 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:10:44.494 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-07-21T22:10:44.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:10:44.628 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:10:44.629 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:10:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:10:44.713 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:10:44.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:44.714 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:10:44.779 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-21T22:10:44.779 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-07-21T22:10:44.829 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:10:44.862 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:10:44.862 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:10:44.939 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:10:44.942 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:10:44.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:44.943 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:10:45.166 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:2023-07-21T22:10:45.126+0000 7f1a6055a640 -1 init, newargv = 0x560c98aa8670 newargc=15 2023-07-21T22:10:45.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[39354]: starting ceph client 2023-07-21T22:10:45.180 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[39354]: starting fuse 2023-07-21T22:10:46.104 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:10:46.141 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:10:46.142 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:10:46.215 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:10:46.217 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:10:46.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:46.218 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:10:46.284 INFO:teuthology.orchestra.run.smithi049.stdout:49 2023-07-21T22:10:46.285 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-07-21T22:10:46.285 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T22:10:46.286 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2023-07-21T22:10:46.286 DEBUG:teuthology.orchestra.run.smithi049:> import re 2023-07-21T22:10:46.286 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-07-21T22:10:46.286 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-07-21T22:10:46.287 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:10:46.287 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2023-07-21T22:10:46.287 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-07-21T22:10:46.288 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2023-07-21T22:10:46.288 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-07-21T22:10:46.288 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:10:46.289 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2023-07-21T22:10:46.289 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2023-07-21T22:10:46.289 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2023-07-21T22:10:46.289 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2023-07-21T22:10:46.290 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:10:46.290 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2023-07-21T22:10:46.290 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T22:10:46.290 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T22:10:46.291 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T22:10:46.291 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2023-07-21T22:10:46.291 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2023-07-21T22:10:46.291 DEBUG:teuthology.orchestra.run.smithi049:> return f 2023-07-21T22:10:46.292 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T22:10:46.292 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:10:46.292 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.admin")) 2023-07-21T22:10:46.293 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-07-21T22:10:46.444 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.admin.39354.asok 2023-07-21T22:10:46.626 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.39354.asok 2023-07-21T22:10:46.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:46.627 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.39354.asok status 2023-07-21T22:10:46.822 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:10:46.823 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2023-07-21T22:10:46.823 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea", 2023-07-21T22:10:46.823 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:10:46.823 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "admin", 2023-07-21T22:10:46.823 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2023-07-21T22:10:46.823 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-07-21T22:10:46.824 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "39354", 2023-07-21T22:10:46.824 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2023-07-21T22:10:46.824 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:10:46.824 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2023-07-21T22:10:46.824 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2023-07-21T22:10:46.824 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4452, 2023-07-21T22:10:46.824 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2023-07-21T22:10:46.825 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2023-07-21T22:10:46.825 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2023-07-21T22:10:46.825 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4452 2023-07-21T22:10:46.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:10:46.825 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:10:46.825 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:10:46.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:10:46.826 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 890733493 2023-07-21T22:10:46.826 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:10:46.826 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:10:46.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:10:46.826 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:10:46.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:10:46.826 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 890733493 2023-07-21T22:10:46.827 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:10:46.827 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4452 192.168.0.1:0/890733493", 2023-07-21T22:10:46.827 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/890733493", 2023-07-21T22:10:46.827 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2023-07-21T22:10:46.828 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 7, 2023-07-21T22:10:46.828 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 30, 2023-07-21T22:10:46.828 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2023-07-21T22:10:46.828 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2023-07-21T22:10:46.828 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2023-07-21T22:10:46.828 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:10:46.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:46.838 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2023-07-21T22:10:46.838 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-07-21T22:10:46.857 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2023-07-21T22:10:46.857 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-07-21T22:10:46.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:46.858 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-07-21T22:10:46.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:46.936 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-07-21T22:10:47.043 INFO:teuthology.orchestra.run.smithi049.stdout:# file: . 2023-07-21T22:10:47.044 INFO:teuthology.orchestra.run.smithi049.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-07-21T22:10:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:47.045 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:47.045 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:10:47.063 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:10:47.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.246+0000 7effec8c3700 1 Processor -- start 2023-07-21T22:10:47.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.246+0000 7effec8c3700 1 -- start start 2023-07-21T22:10:47.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.246+0000 7effec8c3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7effe81582f0 0x7effe80cb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.246+0000 7effec8c3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effe815c870 0x7effe80c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effec8c3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe80cdab0 con 0x7effe80c8c00 2023-07-21T22:10:47.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effec8c3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe80cbad0 con 0x7effe81582f0 2023-07-21T22:10:47.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effec8c3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe80c9080 con 0x7effe815c870 2023-07-21T22:10:47.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7effe80c8c00 0x7effe80afaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46890/0 (socket says 172.21.15.49:46890) 2023-07-21T22:10:47.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe7fff700 1 -- 172.21.15.49:0/2332578861 learned_addr learned my addr 172.21.15.49:0/2332578861 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:47.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe77fe700 1 --2- 172.21.15.49:0/2332578861 >> v2:172.21.15.150:3300/0 conn(0x7effe81582f0 0x7effe80cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effdeffd700 1 --2- 172.21.15.49:0/2332578861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effe815c870 0x7effe80c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 -- 172.21.15.49:0/2332578861 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799291953 0 0) 0x7effe80cdab0 con 0x7effe80c8c00 2023-07-21T22:10:47.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 -- 172.21.15.49:0/2332578861 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd40035d0 con 0x7effe80c8c00 2023-07-21T22:10:47.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 -- 172.21.15.49:0/2332578861 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2507226773 0 0) 0x7effd40035d0 con 0x7effe80c8c00 2023-07-21T22:10:47.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 -- 172.21.15.49:0/2332578861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effe815c870 msgr2=0x7effe80c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:47.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 --2- 172.21.15.49:0/2332578861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effe815c870 0x7effe80c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 -- 172.21.15.49:0/2332578861 >> v2:172.21.15.150:3300/0 conn(0x7effe81582f0 msgr2=0x7effe80cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:47.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 --2- 172.21.15.49:0/2332578861 >> v2:172.21.15.150:3300/0 conn(0x7effe81582f0 0x7effe80cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 -- 172.21.15.49:0/2332578861 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe81586c0 con 0x7effe80c8c00 2023-07-21T22:10:47.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 -- 172.21.15.49:0/2332578861 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7effe00019f0 con 0x7effe80c8c00 2023-07-21T22:10:47.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 -- 172.21.15.49:0/2332578861 >> v1:172.21.15.49:6789/0 conn(0x7effe80c8c00 legacy=0x7effe80afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:47.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 --2- 172.21.15.49:0/2332578861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effe815c870 0x7effd4003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 --2- 172.21.15.49:0/2332578861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd4003fa0 0x7effd4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 --2- 172.21.15.49:0/2332578861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effd4004db0 0x7effd4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 -- 172.21.15.49:0/2332578861 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe80c9080 con 0x7effd4003fa0 2023-07-21T22:10:47.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 -- 172.21.15.49:0/2332578861 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd400dc40 con 0x7effd4004db0 2023-07-21T22:10:47.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe6ffd700 1 -- 172.21.15.49:0/2332578861 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd400dd80 con 0x7effe815c870 2023-07-21T22:10:47.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe77fe700 1 --2- 172.21.15.49:0/2332578861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effe815c870 0x7effd4003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effdeffd700 1 --2- 172.21.15.49:0/2332578861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd4003fa0 0x7effd4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe7fff700 1 --2- 172.21.15.49:0/2332578861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effd4004db0 0x7effd4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effdeffd700 1 -- 172.21.15.49:0/2332578861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effe815c870 msgr2=0x7effd4003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:47.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effdeffd700 1 --2- 172.21.15.49:0/2332578861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effe815c870 0x7effd4003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effdeffd700 1 -- 172.21.15.49:0/2332578861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effd4004db0 msgr2=0x7effd4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:47.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effdeffd700 1 --2- 172.21.15.49:0/2332578861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effd4004db0 0x7effd4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effdeffd700 1 -- 172.21.15.49:0/2332578861 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd40035d0 con 0x7effd4003fa0 2023-07-21T22:10:47.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.250+0000 7effe7fff700 1 --2- 172.21.15.49:0/2332578861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effd4004db0 0x7effd4005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:47.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.254+0000 7effdeffd700 1 --2- 172.21.15.49:0/2332578861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd4003fa0 0x7effd4004870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7effd000aac0 tx=0x7effd40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9b8991f25edb8b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:47.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.254+0000 7effe6ffd700 1 -- 172.21.15.49:0/2332578861 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd000e960 con 0x7effd4003fa0 2023-07-21T22:10:47.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.254+0000 7effe6ffd700 1 -- 172.21.15.49:0/2332578861 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd000eac0 con 0x7effd4003fa0 2023-07-21T22:10:47.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.254+0000 7effe6ffd700 1 -- 172.21.15.49:0/2332578861 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd000ee50 con 0x7effd4003fa0 2023-07-21T22:10:47.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.254+0000 7effec8c3700 1 -- 172.21.15.49:0/2332578861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd4003fa0 msgr2=0x7effd4004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:47.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.254+0000 7effec8c3700 1 --2- 172.21.15.49:0/2332578861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd4003fa0 0x7effd4004870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7effd000aac0 tx=0x7effd40058a0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.254+0000 7effe7fff700 1 -- 172.21.15.49:0/2332578861 reap_dead start 2023-07-21T22:10:47.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.254+0000 7effec8c3700 1 -- 172.21.15.49:0/2332578861 shutdown_connections 2023-07-21T22:10:47.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.254+0000 7effec8c3700 1 -- 172.21.15.49:0/2332578861 >> 172.21.15.49:0/2332578861 conn(0x7effe8070450 msgr2=0x7effe8070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:47.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.254+0000 7effec8c3700 1 -- 172.21.15.49:0/2332578861 shutdown_connections 2023-07-21T22:10:47.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.254+0000 7effec8c3700 1 -- 172.21.15.49:0/2332578861 wait complete. 2023-07-21T22:10:47.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.258+0000 7effec8c3700 1 Processor -- start 2023-07-21T22:10:47.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.258+0000 7effec8c3700 1 -- start start 2023-07-21T22:10:47.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.258+0000 7effec8c3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effd4003fa0 0x7effe80b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.258+0000 7effec8c3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effe80b31c0 0x7effe80b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.258+0000 7effec8c3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe80b3b70 0x7effe80b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.258+0000 7effec8c3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe80c6a40 con 0x7effe80b3b70 2023-07-21T22:10:47.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.258+0000 7effec8c3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe80c5e30 con 0x7effe80b31c0 2023-07-21T22:10:47.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.258+0000 7effec8c3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe80c6110 con 0x7effd4003fa0 2023-07-21T22:10:47.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.258+0000 7effe7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe80b3b70 0x7effe80b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effe77fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effd4003fa0 0x7effe80b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effe7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe80b3b70 0x7effe80b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59620/0 (socket says 172.21.15.49:59620) 2023-07-21T22:10:47.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effe7fff700 1 -- 172.21.15.49:0/3488352789 learned_addr learned my addr 172.21.15.49:0/3488352789 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:47.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effdeffd700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effe80b31c0 0x7effe80b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effe7fff700 1 -- 172.21.15.49:0/3488352789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effd4003fa0 msgr2=0x7effe80b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:47.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effe7fff700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effd4003fa0 0x7effe80b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effe7fff700 1 -- 172.21.15.49:0/3488352789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effe80b31c0 msgr2=0x7effe80b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:47.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effe7fff700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effe80b31c0 0x7effe80b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effe7fff700 1 -- 172.21.15.49:0/3488352789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe80c63f0 con 0x7effe80b3b70 2023-07-21T22:10:47.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effe77fe700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effd4003fa0 0x7effe80b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:47.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effdeffd700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effe80b31c0 0x7effe80b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:47.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effe7fff700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe80b3b70 0x7effe80b10a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7effe80c91c0 tx=0x7effe0007cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:47.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effe4ff9700 1 -- 172.21.15.49:0/3488352789 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe000e810 con 0x7effe80b3b70 2023-07-21T22:10:47.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effe4ff9700 1 -- 172.21.15.49:0/3488352789 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe000e970 con 0x7effe80b3b70 2023-07-21T22:10:47.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effe4ff9700 1 -- 172.21.15.49:0/3488352789 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe000ed00 con 0x7effe80b3b70 2023-07-21T22:10:47.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effec8c3700 1 -- 172.21.15.49:0/3488352789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe80c66d0 con 0x7effe80b3b70 2023-07-21T22:10:47.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effec8c3700 1 -- 172.21.15.49:0/3488352789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe8153950 con 0x7effe80b3b70 2023-07-21T22:10:47.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.262+0000 7effec8c3700 1 -- 172.21.15.49:0/3488352789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe804dcb0 con 0x7effe80b3b70 2023-07-21T22:10:47.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.266+0000 7effe4ff9700 1 -- 172.21.15.49:0/3488352789 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7effe001d460 con 0x7effe80b3b70 2023-07-21T22:10:47.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.266+0000 7effe4ff9700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7effc80662f0 0x7effc80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.266+0000 7effe4ff9700 1 -- 172.21.15.49:0/3488352789 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7effe0084250 con 0x7effe80b3b70 2023-07-21T22:10:47.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.266+0000 7effe77fe700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7effc80662f0 0x7effc80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.270+0000 7effe77fe700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7effc80662f0 0x7effc80687a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7effd8009fd0 tx=0x7effd8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:47.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.274+0000 7effe4ff9700 1 -- 172.21.15.49:0/3488352789 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7effe0051340 con 0x7effe80b3b70 2023-07-21T22:10:47.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.453+0000 7effec8c3700 1 -- 172.21.15.49:0/3488352789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effe806f6b0 con 0x7effe80b3b70 2023-07-21T22:10:47.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.457+0000 7effe4ff9700 1 -- 172.21.15.49:0/3488352789 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20084 (secure 0 0 0) 0x7effe0054960 con 0x7effe80b3b70 2023-07-21T22:10:47.500 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:47.500 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:39.728219+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:10:47.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.457+0000 7effec8c3700 1 -- 172.21.15.49:0/3488352789 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7effc80662f0 msgr2=0x7effc80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:47.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.457+0000 7effec8c3700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7effc80662f0 0x7effc80687a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7effd8009fd0 tx=0x7effd8009240 comp rx=0 tx=0).stop 2023-07-21T22:10:47.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.457+0000 7effec8c3700 1 -- 172.21.15.49:0/3488352789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe80b3b70 msgr2=0x7effe80b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.457+0000 7effec8c3700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe80b3b70 0x7effe80b10a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7effe80c91c0 tx=0x7effe0007cb0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.457+0000 7effec8c3700 1 -- 172.21.15.49:0/3488352789 shutdown_connections 2023-07-21T22:10:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.457+0000 7effec8c3700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7effc80662f0 0x7effc80687a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.457+0000 7effec8c3700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe80b3b70 0x7effe80b10a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.461+0000 7effec8c3700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effe80b31c0 0x7effe80b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.461+0000 7effec8c3700 1 --2- 172.21.15.49:0/3488352789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effd4003fa0 0x7effe80b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.461+0000 7effec8c3700 1 -- 172.21.15.49:0/3488352789 >> 172.21.15.49:0/3488352789 conn(0x7effe8070450 msgr2=0x7effe80adf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:47.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.461+0000 7effec8c3700 1 -- 172.21.15.49:0/3488352789 shutdown_connections 2023-07-21T22:10:47.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.461+0000 7effec8c3700 1 -- 172.21.15.49:0/3488352789 wait complete. 2023-07-21T22:10:47.523 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:10:47.524 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:10:47.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.669+0000 7fe4233a0700 1 Processor -- start 2023-07-21T22:10:47.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.669+0000 7fe4233a0700 1 -- start start 2023-07-21T22:10:47.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe4233a0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe41c160110 0x7fe41c0cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe4233a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe41c0cb2f0 0x7fe41c163d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe4233a0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41c0cdf00 con 0x7fe41c071220 2023-07-21T22:10:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe4233a0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c0cd730 con 0x7fe41c160110 2023-07-21T22:10:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe4233a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0ce600 con 0x7fe41c0cb2f0 2023-07-21T22:10:47.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe42113c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe41c160110 0x7fe41c0cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe42093b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe41c071220 0x7fe41c0cabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46898/0 (socket says 172.21.15.49:46898) 2023-07-21T22:10:47.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe42093b700 1 -- 172.21.15.49:0/1637372277 learned_addr learned my addr 172.21.15.49:0/1637372277 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:47.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe42193d700 1 --2- 172.21.15.49:0/1637372277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe41c0cb2f0 0x7fe41c163d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe413fff700 1 -- 172.21.15.49:0/1637372277 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595380893 0 0) 0x7fe41c0cdf00 con 0x7fe41c071220 2023-07-21T22:10:47.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe42113c700 1 -- 172.21.15.49:0/1637372277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe41c0cb2f0 msgr2=0x7fe41c163d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:47.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe42113c700 1 --2- 172.21.15.49:0/1637372277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe41c0cb2f0 0x7fe41c163d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe42113c700 1 -- 172.21.15.49:0/1637372277 >> v1:172.21.15.49:6789/0 conn(0x7fe41c071220 legacy=0x7fe41c0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:47.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe42113c700 1 -- 172.21.15.49:0/1637372277 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c0cefd0 con 0x7fe41c160110 2023-07-21T22:10:47.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe42113c700 1 --2- 172.21.15.49:0/1637372277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe41c160110 0x7fe41c0cea90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe418009850 tx=0x7fe418009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79d334ac4b3a256 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:47.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe413fff700 1 -- 172.21.15.49:0/1637372277 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418011830 con 0x7fe41c160110 2023-07-21T22:10:47.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe413fff700 1 -- 172.21.15.49:0/1637372277 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe418011990 con 0x7fe41c160110 2023-07-21T22:10:47.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.673+0000 7fe413fff700 1 -- 172.21.15.49:0/1637372277 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418011d40 con 0x7fe41c160110 2023-07-21T22:10:47.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.677+0000 7fe4233a0700 1 -- 172.21.15.49:0/1637372277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe41c160110 msgr2=0x7fe41c0cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:47.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.677+0000 7fe4233a0700 1 --2- 172.21.15.49:0/1637372277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe41c160110 0x7fe41c0cea90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe418009850 tx=0x7fe418009b60 comp rx=0 tx=0).stop 2023-07-21T22:10:47.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.677+0000 7fe4233a0700 1 -- 172.21.15.49:0/1637372277 shutdown_connections 2023-07-21T22:10:47.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.677+0000 7fe4233a0700 1 --2- 172.21.15.49:0/1637372277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe41c0cb2f0 0x7fe41c163d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.677+0000 7fe4233a0700 1 --2- 172.21.15.49:0/1637372277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe41c160110 0x7fe41c0cea90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.677+0000 7fe4233a0700 1 -- 172.21.15.49:0/1637372277 >> 172.21.15.49:0/1637372277 conn(0x7fe41c06e960 msgr2=0x7fe41c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:47.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.677+0000 7fe4233a0700 1 -- 172.21.15.49:0/1637372277 shutdown_connections 2023-07-21T22:10:47.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.677+0000 7fe4233a0700 1 -- 172.21.15.49:0/1637372277 wait complete. 2023-07-21T22:10:47.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.677+0000 7fe4233a0700 1 Processor -- start 2023-07-21T22:10:47.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.677+0000 7fe4233a0700 1 -- start start 2023-07-21T22:10:47.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe4233a0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe41c071220 0x7fe41c0af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe4233a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe41c0cb2f0 0x7fe41c1f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe4233a0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe41c160110 0x7fe41c163640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe4233a0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c1f6850 con 0x7fe41c160110 2023-07-21T22:10:47.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe4233a0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c1f5ee0 con 0x7fe41c071220 2023-07-21T22:10:47.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe4233a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c1f61c0 con 0x7fe41c0cb2f0 2023-07-21T22:10:47.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe42193d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe41c160110 0x7fe41c163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe42193d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe41c160110 0x7fe41c163640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59628/0 (socket says 172.21.15.49:59628) 2023-07-21T22:10:47.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe42193d700 1 -- 172.21.15.49:0/1249234974 learned_addr learned my addr 172.21.15.49:0/1249234974 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:47.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe42093b700 1 --2- 172.21.15.49:0/1249234974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe41c0cb2f0 0x7fe41c1f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe42113c700 1 --2- 172.21.15.49:0/1249234974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe41c071220 0x7fe41c0af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe42193d700 1 -- 172.21.15.49:0/1249234974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe41c0cb2f0 msgr2=0x7fe41c1f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:47.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe42193d700 1 --2- 172.21.15.49:0/1249234974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe41c0cb2f0 0x7fe41c1f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe42193d700 1 -- 172.21.15.49:0/1249234974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe41c071220 msgr2=0x7fe41c0af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:47.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe42193d700 1 --2- 172.21.15.49:0/1249234974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe41c071220 0x7fe41c0af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe42193d700 1 -- 172.21.15.49:0/1249234974 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4180094b0 con 0x7fe41c160110 2023-07-21T22:10:47.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe42193d700 1 --2- 172.21.15.49:0/1249234974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe41c160110 0x7fe41c163640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe41400efc0 tx=0x7fe41400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:47.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe411ffb700 1 -- 172.21.15.49:0/1249234974 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414009ea0 con 0x7fe41c160110 2023-07-21T22:10:47.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe411ffb700 1 -- 172.21.15.49:0/1249234974 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41400f040 con 0x7fe41c160110 2023-07-21T22:10:47.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe411ffb700 1 -- 172.21.15.49:0/1249234974 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41400ced0 con 0x7fe41c160110 2023-07-21T22:10:47.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe4233a0700 1 -- 172.21.15.49:0/1249234974 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c1f64a0 con 0x7fe41c160110 2023-07-21T22:10:47.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.681+0000 7fe4233a0700 1 -- 172.21.15.49:0/1249234974 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c1f5bd0 con 0x7fe41c160110 2023-07-21T22:10:47.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.685+0000 7fe4233a0700 1 -- 172.21.15.49:0/1249234974 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c1f6ca0 con 0x7fe41c160110 2023-07-21T22:10:47.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.685+0000 7fe411ffb700 1 -- 172.21.15.49:0/1249234974 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe414014480 con 0x7fe41c160110 2023-07-21T22:10:47.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.689+0000 7fe411ffb700 1 --2- 172.21.15.49:0/1249234974 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe4000662f0 0x7fe4000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:47.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.689+0000 7fe411ffb700 1 -- 172.21.15.49:0/1249234974 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe414084800 con 0x7fe41c160110 2023-07-21T22:10:47.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.689+0000 7fe42113c700 1 --2- 172.21.15.49:0/1249234974 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe4000662f0 0x7fe4000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:47.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.689+0000 7fe42113c700 1 --2- 172.21.15.49:0/1249234974 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe4000662f0 0x7fe4000687a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe4180090b0 tx=0x7fe418008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:47.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.693+0000 7fe411ffb700 1 -- 172.21.15.49:0/1249234974 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe41c1f6ca0 con 0x7fe41c160110 2023-07-21T22:10:47.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.865+0000 7fe4233a0700 1 -- 172.21.15.49:0/1249234974 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe41c1f6ca0 con 0x7fe41c160110 2023-07-21T22:10:47.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.865+0000 7fe411ffb700 1 -- 172.21.15.49:0/1249234974 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe41c1f6ca0 con 0x7fe41c160110 2023-07-21T22:10:47.909 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:10:47.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.869+0000 7fe4233a0700 1 -- 172.21.15.49:0/1249234974 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe4000662f0 msgr2=0x7fe4000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:47.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.869+0000 7fe4233a0700 1 --2- 172.21.15.49:0/1249234974 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe4000662f0 0x7fe4000687a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe4180090b0 tx=0x7fe418008030 comp rx=0 tx=0).stop 2023-07-21T22:10:47.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.869+0000 7fe4233a0700 1 -- 172.21.15.49:0/1249234974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe41c160110 msgr2=0x7fe41c163640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:47.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.869+0000 7fe4233a0700 1 --2- 172.21.15.49:0/1249234974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe41c160110 0x7fe41c163640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe41400efc0 tx=0x7fe41400c3a0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.869+0000 7fe4233a0700 1 -- 172.21.15.49:0/1249234974 shutdown_connections 2023-07-21T22:10:47.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.869+0000 7fe4233a0700 1 --2- 172.21.15.49:0/1249234974 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe4000662f0 0x7fe4000687a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.869+0000 7fe4233a0700 1 --2- 172.21.15.49:0/1249234974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe41c160110 0x7fe41c163640 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.869+0000 7fe4233a0700 1 --2- 172.21.15.49:0/1249234974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe41c0cb2f0 0x7fe41c1f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.869+0000 7fe4233a0700 1 --2- 172.21.15.49:0/1249234974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe41c071220 0x7fe41c0af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:47.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.869+0000 7fe4233a0700 1 -- 172.21.15.49:0/1249234974 >> 172.21.15.49:0/1249234974 conn(0x7fe41c06e960 msgr2=0x7fe41c0adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:47.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.869+0000 7fe4233a0700 1 -- 172.21.15.49:0/1249234974 shutdown_connections 2023-07-21T22:10:47.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:47.869+0000 7fe4233a0700 1 -- 172.21.15.49:0/1249234974 wait complete. 2023-07-21T22:10:47.934 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:10:48.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.073+0000 7f06e95f7700 1 Processor -- start 2023-07-21T22:10:48.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.073+0000 7f06e95f7700 1 -- start start 2023-07-21T22:10:48.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e95f7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f06e40d1e40 0x7f06e40b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e95f7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06e40cee10 0x7f06e40cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e95f7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e40b3e80 con 0x7f06e40b7af0 2023-07-21T22:10:48.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e95f7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e40cf790 con 0x7f06e40cee10 2023-07-21T22:10:48.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e95f7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e415fd40 con 0x7f06e40d1e40 2023-07-21T22:10:48.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e2ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f06e40b7af0 0x7f06e415f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46900/0 (socket says 172.21.15.49:46900) 2023-07-21T22:10:48.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e2ffd700 1 -- 172.21.15.49:0/1374118727 learned_addr learned my addr 172.21.15.49:0/1374118727 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:48.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e37fe700 1 --2- 172.21.15.49:0/1374118727 >> v2:172.21.15.49:3300/0 conn(0x7f06e40cee10 0x7f06e40cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e27fc700 1 --2- 172.21.15.49:0/1374118727 >> v2:172.21.15.150:3300/0 conn(0x7f06e40d1e40 0x7f06e40b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e1ffb700 1 -- 172.21.15.49:0/1374118727 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823714230 0 0) 0x7f06e40b3e80 con 0x7f06e40b7af0 2023-07-21T22:10:48.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e1ffb700 1 -- 172.21.15.49:0/1374118727 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06cc0035d0 con 0x7f06e40b7af0 2023-07-21T22:10:48.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e37fe700 1 -- 172.21.15.49:0/1374118727 >> v2:172.21.15.150:3300/0 conn(0x7f06e40d1e40 msgr2=0x7f06e40b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:48.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e37fe700 1 --2- 172.21.15.49:0/1374118727 >> v2:172.21.15.150:3300/0 conn(0x7f06e40d1e40 0x7f06e40b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e37fe700 1 -- 172.21.15.49:0/1374118727 >> v1:172.21.15.49:6789/0 conn(0x7f06e40b7af0 legacy=0x7f06e415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e37fe700 1 -- 172.21.15.49:0/1374118727 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e40cea00 con 0x7f06e40cee10 2023-07-21T22:10:48.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.077+0000 7f06e27fc700 1 --2- 172.21.15.49:0/1374118727 >> v2:172.21.15.150:3300/0 conn(0x7f06e40d1e40 0x7f06e40b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:48.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.081+0000 7f06e37fe700 1 --2- 172.21.15.49:0/1374118727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e40cee10 0x7f06e40cf250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06e40d1200 tx=0x7f06dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e62ceedd8750236 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:48.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.081+0000 7f06e1ffb700 1 -- 172.21.15.49:0/1374118727 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00e070 con 0x7f06e40cee10 2023-07-21T22:10:48.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.081+0000 7f06e1ffb700 1 -- 172.21.15.49:0/1374118727 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc00bb20 con 0x7f06e40cee10 2023-07-21T22:10:48.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.081+0000 7f06e1ffb700 1 -- 172.21.15.49:0/1374118727 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00be90 con 0x7f06e40cee10 2023-07-21T22:10:48.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.081+0000 7f06e95f7700 1 -- 172.21.15.49:0/1374118727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e40cee10 msgr2=0x7f06e40cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.081+0000 7f06e95f7700 1 --2- 172.21.15.49:0/1374118727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e40cee10 0x7f06e40cf250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06e40d1200 tx=0x7f06dc00b330 comp rx=0 tx=0).stop 2023-07-21T22:10:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.081+0000 7f06e95f7700 1 -- 172.21.15.49:0/1374118727 shutdown_connections 2023-07-21T22:10:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.081+0000 7f06e95f7700 1 --2- 172.21.15.49:0/1374118727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e40cee10 0x7f06e40cf250 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.081+0000 7f06e95f7700 1 --2- 172.21.15.49:0/1374118727 >> v2:172.21.15.150:3300/0 conn(0x7f06e40d1e40 0x7f06e40b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.081+0000 7f06e95f7700 1 -- 172.21.15.49:0/1374118727 >> 172.21.15.49:0/1374118727 conn(0x7f06e406e960 msgr2=0x7f06e406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.081+0000 7f06e95f7700 1 -- 172.21.15.49:0/1374118727 shutdown_connections 2023-07-21T22:10:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.081+0000 7f06e95f7700 1 -- 172.21.15.49:0/1374118727 wait complete. 2023-07-21T22:10:48.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.085+0000 7f06e95f7700 1 Processor -- start 2023-07-21T22:10:48.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.085+0000 7f06e95f7700 1 -- start start 2023-07-21T22:10:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.085+0000 7f06e95f7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06e40b7af0 0x7f06e40caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.085+0000 7f06e95f7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06e40cee10 0x7f06e40c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.085+0000 7f06e95f7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e40d1e40 0x7f06e40c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.085+0000 7f06e95f7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e40cb690 con 0x7f06e40d1e40 2023-07-21T22:10:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.085+0000 7f06e95f7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e40c94d0 con 0x7f06e40cee10 2023-07-21T22:10:48.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.085+0000 7f06e95f7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e40c9a90 con 0x7f06e40b7af0 2023-07-21T22:10:48.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.085+0000 7f06e37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e40d1e40 0x7f06e40c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.085+0000 7f06e37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e40d1e40 0x7f06e40c9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59648/0 (socket says 172.21.15.49:59648) 2023-07-21T22:10:48.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.085+0000 7f06e37fe700 1 -- 172.21.15.49:0/1441041616 learned_addr learned my addr 172.21.15.49:0/1441041616 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:48.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.085+0000 7f06e27fc700 1 --2- 172.21.15.49:0/1441041616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06e40cee10 0x7f06e40c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.085+0000 7f06e2ffd700 1 --2- 172.21.15.49:0/1441041616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06e40b7af0 0x7f06e40caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.089+0000 7f06e37fe700 1 -- 172.21.15.49:0/1441041616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06e40b7af0 msgr2=0x7f06e40caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.089+0000 7f06e37fe700 1 --2- 172.21.15.49:0/1441041616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06e40b7af0 0x7f06e40caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.089+0000 7f06e37fe700 1 -- 172.21.15.49:0/1441041616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06e40cee10 msgr2=0x7f06e40c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.089+0000 7f06e37fe700 1 --2- 172.21.15.49:0/1441041616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06e40cee10 0x7f06e40c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.089+0000 7f06e37fe700 1 -- 172.21.15.49:0/1441041616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc009a70 con 0x7f06e40d1e40 2023-07-21T22:10:48.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.089+0000 7f06e37fe700 1 --2- 172.21.15.49:0/1441041616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e40d1e40 0x7f06e40c9f20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00b370 tx=0x7f06dc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:48.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.089+0000 7f06cb7fe700 1 -- 172.21.15.49:0/1441041616 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc007000 con 0x7f06e40d1e40 2023-07-21T22:10:48.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.089+0000 7f06cb7fe700 1 -- 172.21.15.49:0/1441041616 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc012630 con 0x7f06e40d1e40 2023-07-21T22:10:48.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.089+0000 7f06cb7fe700 1 -- 172.21.15.49:0/1441041616 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0129e0 con 0x7f06e40d1e40 2023-07-21T22:10:48.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.089+0000 7f06e95f7700 1 -- 172.21.15.49:0/1441041616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e40c8090 con 0x7f06e40d1e40 2023-07-21T22:10:48.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.089+0000 7f06e95f7700 1 -- 172.21.15.49:0/1441041616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e40cb3b0 con 0x7f06e40d1e40 2023-07-21T22:10:48.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.089+0000 7f06e95f7700 1 -- 172.21.15.49:0/1441041616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e40c9c20 con 0x7f06e40d1e40 2023-07-21T22:10:48.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.093+0000 7f06cb7fe700 1 -- 172.21.15.49:0/1441041616 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06dc012b40 con 0x7f06e40d1e40 2023-07-21T22:10:48.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.093+0000 7f06cb7fe700 1 --2- 172.21.15.49:0/1441041616 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06d00662f0 0x7f06d00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.093+0000 7f06cb7fe700 1 -- 172.21.15.49:0/1441041616 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f06dc006e40 con 0x7f06e40d1e40 2023-07-21T22:10:48.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.093+0000 7f06e2ffd700 1 --2- 172.21.15.49:0/1441041616 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06d00662f0 0x7f06d00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.097+0000 7f06e2ffd700 1 --2- 172.21.15.49:0/1441041616 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06d00662f0 0x7f06d00687a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f06d4007fd0 tx=0x7f06d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:48.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.101+0000 7f06cb7fe700 1 -- 172.21.15.49:0/1441041616 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06dc053110 con 0x7f06e40d1e40 2023-07-21T22:10:48.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.281+0000 7f06e95f7700 1 -- 172.21.15.49:0/1441041616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f06e404dcb0 con 0x7f06e40d1e40 2023-07-21T22:10:48.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.285+0000 7f06cb7fe700 1 -- 172.21.15.49:0/1441041616 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f06dc02b0a0 con 0x7f06e40d1e40 2023-07-21T22:10:48.327 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:10:48.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.285+0000 7f06e95f7700 1 -- 172.21.15.49:0/1441041616 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06d00662f0 msgr2=0x7f06d00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.285+0000 7f06e95f7700 1 --2- 172.21.15.49:0/1441041616 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06d00662f0 0x7f06d00687a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f06d4007fd0 tx=0x7f06d4009040 comp rx=0 tx=0).stop 2023-07-21T22:10:48.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.285+0000 7f06e95f7700 1 -- 172.21.15.49:0/1441041616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e40d1e40 msgr2=0x7f06e40c9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.285+0000 7f06e95f7700 1 --2- 172.21.15.49:0/1441041616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e40d1e40 0x7f06e40c9f20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00b370 tx=0x7f06dc004b40 comp rx=0 tx=0).stop 2023-07-21T22:10:48.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.285+0000 7f06e95f7700 1 -- 172.21.15.49:0/1441041616 shutdown_connections 2023-07-21T22:10:48.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.285+0000 7f06e95f7700 1 --2- 172.21.15.49:0/1441041616 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06d00662f0 0x7f06d00687a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.285+0000 7f06e95f7700 1 --2- 172.21.15.49:0/1441041616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e40d1e40 0x7f06e40c9f20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.285+0000 7f06e95f7700 1 --2- 172.21.15.49:0/1441041616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06e40cee10 0x7f06e40c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.285+0000 7f06e95f7700 1 --2- 172.21.15.49:0/1441041616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06e40b7af0 0x7f06e40caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.285+0000 7f06e95f7700 1 -- 172.21.15.49:0/1441041616 >> 172.21.15.49:0/1441041616 conn(0x7f06e406e960 msgr2=0x7f06e40d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:48.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.285+0000 7f06e95f7700 1 -- 172.21.15.49:0/1441041616 shutdown_connections 2023-07-21T22:10:48.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.289+0000 7f06e95f7700 1 -- 172.21.15.49:0/1441041616 wait complete. 2023-07-21T22:10:48.351 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:10:48.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.493+0000 7f513d7bf700 1 Processor -- start 2023-07-21T22:10:48.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.493+0000 7f513d7bf700 1 -- start start 2023-07-21T22:10:48.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f513d7bf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51380b7af0 0x7f51380b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f513d7bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51380d1e40 0x7f513815f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f513d7bf700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51380b3e80 con 0x7f51380cee10 2023-07-21T22:10:48.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f513d7bf700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51380cea00 con 0x7f51380b7af0 2023-07-21T22:10:48.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f513d7bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51380ccbf0 con 0x7f51380d1e40 2023-07-21T22:10:48.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f5136ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51380b7af0 0x7f51380b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f51377fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f51380cee10 0x7f51380b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46910/0 (socket says 172.21.15.49:46910) 2023-07-21T22:10:48.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f5136ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51380b7af0 0x7f51380b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59662/0 (socket says 172.21.15.49:59662) 2023-07-21T22:10:48.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f51377fe700 1 -- 172.21.15.49:0/696433006 learned_addr learned my addr 172.21.15.49:0/696433006 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:48.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f51367fc700 1 --2- 172.21.15.49:0/696433006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51380d1e40 0x7f513815f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f5136ffd700 1 -- 172.21.15.49:0/696433006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51380d1e40 msgr2=0x7f513815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:48.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f5136ffd700 1 --2- 172.21.15.49:0/696433006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51380d1e40 0x7f513815f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f5136ffd700 1 -- 172.21.15.49:0/696433006 >> v1:172.21.15.49:6789/0 conn(0x7f51380cee10 legacy=0x7f51380b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f5136ffd700 1 -- 172.21.15.49:0/696433006 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380cced0 con 0x7f51380b7af0 2023-07-21T22:10:48.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f5135ffb700 1 -- 172.21.15.49:0/696433006 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921349689 0 0) 0x7f51380b3e80 con 0x7f51380cee10 2023-07-21T22:10:48.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.497+0000 7f5136ffd700 1 --2- 172.21.15.49:0/696433006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51380b7af0 0x7f51380b1630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5128009850 tx=0x7f5128009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b042b9d19862ad0c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:48.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.501+0000 7f5135ffb700 1 -- 172.21.15.49:0/696433006 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128011830 con 0x7f51380b7af0 2023-07-21T22:10:48.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.501+0000 7f5135ffb700 1 -- 172.21.15.49:0/696433006 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5128011990 con 0x7f51380b7af0 2023-07-21T22:10:48.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.501+0000 7f5135ffb700 1 -- 172.21.15.49:0/696433006 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128011d40 con 0x7f51380b7af0 2023-07-21T22:10:48.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.501+0000 7f513d7bf700 1 -- 172.21.15.49:0/696433006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51380b7af0 msgr2=0x7f51380b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.501+0000 7f513d7bf700 1 --2- 172.21.15.49:0/696433006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51380b7af0 0x7f51380b1630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5128009850 tx=0x7f5128009b60 comp rx=0 tx=0).stop 2023-07-21T22:10:48.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.501+0000 7f513d7bf700 1 -- 172.21.15.49:0/696433006 shutdown_connections 2023-07-21T22:10:48.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.501+0000 7f513d7bf700 1 --2- 172.21.15.49:0/696433006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51380d1e40 0x7f513815f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.501+0000 7f513d7bf700 1 --2- 172.21.15.49:0/696433006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51380b7af0 0x7f51380b1630 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.501+0000 7f513d7bf700 1 -- 172.21.15.49:0/696433006 >> 172.21.15.49:0/696433006 conn(0x7f513806e960 msgr2=0x7f513806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.501+0000 7f513d7bf700 1 -- 172.21.15.49:0/696433006 shutdown_connections 2023-07-21T22:10:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.501+0000 7f513d7bf700 1 -- 172.21.15.49:0/696433006 wait complete. 2023-07-21T22:10:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f513d7bf700 1 Processor -- start 2023-07-21T22:10:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f513d7bf700 1 -- start start 2023-07-21T22:10:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f513d7bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51380b7af0 0x7f5138159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f513d7bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51380cee10 0x7f513815bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f513d7bf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51380d1e40 0x7f51380b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f513d7bf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513815ccb0 con 0x7f51380b7af0 2023-07-21T22:10:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f513d7bf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513815c9d0 con 0x7f51380d1e40 2023-07-21T22:10:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f513d7bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51381f46a0 con 0x7f51380cee10 2023-07-21T22:10:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f5136ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51380b7af0 0x7f5138159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f5136ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51380b7af0 0x7f5138159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59672/0 (socket says 172.21.15.49:59672) 2023-07-21T22:10:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f5136ffd700 1 -- 172.21.15.49:0/804608155 learned_addr learned my addr 172.21.15.49:0/804608155 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f51367fc700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51380cee10 0x7f513815bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f51377fe700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51380d1e40 0x7f51380b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f5136ffd700 1 -- 172.21.15.49:0/804608155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51380cee10 msgr2=0x7f513815bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f5136ffd700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51380cee10 0x7f513815bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f5136ffd700 1 -- 172.21.15.49:0/804608155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51380d1e40 msgr2=0x7f51380b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f5136ffd700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51380d1e40 0x7f51380b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f5136ffd700 1 -- 172.21.15.49:0/804608155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51280094b0 con 0x7f51380b7af0 2023-07-21T22:10:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f51367fc700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51380cee10 0x7f513815bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:10:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.505+0000 7f51377fe700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51380d1e40 0x7f51380b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:10:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.509+0000 7f5136ffd700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51380b7af0 0x7f5138159ed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5128000c00 tx=0x7f5128004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.509+0000 7f511f7fe700 1 -- 172.21.15.49:0/804608155 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51280036c0 con 0x7f51380b7af0 2023-07-21T22:10:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.509+0000 7f511f7fe700 1 -- 172.21.15.49:0/804608155 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512801f070 con 0x7f51380b7af0 2023-07-21T22:10:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.509+0000 7f511f7fe700 1 -- 172.21.15.49:0/804608155 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128003a80 con 0x7f51380b7af0 2023-07-21T22:10:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.509+0000 7f513d7bf700 1 -- 172.21.15.49:0/804608155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51381f4980 con 0x7f51380b7af0 2023-07-21T22:10:48.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.509+0000 7f513d7bf700 1 -- 172.21.15.49:0/804608155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513815eee0 con 0x7f51380b7af0 2023-07-21T22:10:48.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.509+0000 7f513d7bf700 1 -- 172.21.15.49:0/804608155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51381f4500 con 0x7f51380b7af0 2023-07-21T22:10:48.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.513+0000 7f511f7fe700 1 -- 172.21.15.49:0/804608155 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5128003be0 con 0x7f51380b7af0 2023-07-21T22:10:48.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.513+0000 7f511f7fe700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f51240662f0 0x7f51240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.513+0000 7f511f7fe700 1 -- 172.21.15.49:0/804608155 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5128021070 con 0x7f51380b7af0 2023-07-21T22:10:48.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.513+0000 7f51367fc700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f51240662f0 0x7f51240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.513+0000 7f51367fc700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f51240662f0 0x7f51240687a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f51380b1580 tx=0x7f512c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:48.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.517+0000 7f511f7fe700 1 -- 172.21.15.49:0/804608155 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f51381f4500 con 0x7f51380b7af0 2023-07-21T22:10:48.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.693+0000 7f513d7bf700 1 -- 172.21.15.49:0/804608155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51381f4500 con 0x7f51380b7af0 2023-07-21T22:10:48.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.693+0000 7f511f7fe700 1 -- 172.21.15.49:0/804608155 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51381f4500 con 0x7f51380b7af0 2023-07-21T22:10:48.736 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:10:48.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.693+0000 7f513d7bf700 1 -- 172.21.15.49:0/804608155 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f51240662f0 msgr2=0x7f51240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.693+0000 7f513d7bf700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f51240662f0 0x7f51240687a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f51380b1580 tx=0x7f512c008040 comp rx=0 tx=0).stop 2023-07-21T22:10:48.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.693+0000 7f513d7bf700 1 -- 172.21.15.49:0/804608155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51380b7af0 msgr2=0x7f5138159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.693+0000 7f513d7bf700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51380b7af0 0x7f5138159ed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5128000c00 tx=0x7f5128004770 comp rx=0 tx=0).stop 2023-07-21T22:10:48.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.697+0000 7f513d7bf700 1 -- 172.21.15.49:0/804608155 shutdown_connections 2023-07-21T22:10:48.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.697+0000 7f513d7bf700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f51240662f0 0x7f51240687a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.697+0000 7f513d7bf700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51380d1e40 0x7f51380b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.697+0000 7f513d7bf700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51380cee10 0x7f513815bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.697+0000 7f513d7bf700 1 --2- 172.21.15.49:0/804608155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51380b7af0 0x7f5138159ed0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.697+0000 7f513d7bf700 1 -- 172.21.15.49:0/804608155 >> 172.21.15.49:0/804608155 conn(0x7f513806e960 msgr2=0x7f51380b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:48.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.697+0000 7f513d7bf700 1 -- 172.21.15.49:0/804608155 shutdown_connections 2023-07-21T22:10:48.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.697+0000 7f513d7bf700 1 -- 172.21.15.49:0/804608155 wait complete. 2023-07-21T22:10:48.763 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:10:48.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.905+0000 7f43624a6700 1 Processor -- start 2023-07-21T22:10:48.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.905+0000 7f43624a6700 1 -- start start 2023-07-21T22:10:48.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.905+0000 7f43624a6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f435c0698a0 0x7f435c069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.905+0000 7f43624a6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f435c0aba80 0x7f435c0abf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.905+0000 7f43624a6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c06a230 con 0x7f435c0c9b80 2023-07-21T22:10:48.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.905+0000 7f43624a6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c160710 con 0x7f435c0aba80 2023-07-21T22:10:48.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.905+0000 7f43624a6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c15f880 con 0x7f435c0698a0 2023-07-21T22:10:48.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.905+0000 7f43614a4700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f435c0c9b80 0x7f435c0ad3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46916/0 (socket says 172.21.15.49:46916) 2023-07-21T22:10:48.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.905+0000 7f43614a4700 1 -- 172.21.15.49:0/1729497721 learned_addr learned my addr 172.21.15.49:0/1729497721 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:48.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.905+0000 7f4361ca5700 1 --2- 172.21.15.49:0/1729497721 >> v2:172.21.15.49:3300/0 conn(0x7f435c0aba80 0x7f435c0abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.905+0000 7f4360ca3700 1 --2- 172.21.15.49:0/1729497721 >> v2:172.21.15.150:3300/0 conn(0x7f435c0698a0 0x7f435c069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f4353fff700 1 -- 172.21.15.49:0/1729497721 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79351118 0 0) 0x7f4358001110 con 0x7f435c0c9b80 2023-07-21T22:10:48.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f4353fff700 1 -- 172.21.15.49:0/1729497721 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43480035d0 con 0x7f435c0c9b80 2023-07-21T22:10:48.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f4360ca3700 1 -- 172.21.15.49:0/1729497721 >> v2:172.21.15.49:3300/0 conn(0x7f435c0aba80 msgr2=0x7f435c0abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:48.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f4360ca3700 1 --2- 172.21.15.49:0/1729497721 >> v2:172.21.15.49:3300/0 conn(0x7f435c0aba80 0x7f435c0abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f4360ca3700 1 -- 172.21.15.49:0/1729497721 >> v1:172.21.15.49:6789/0 conn(0x7f435c0c9b80 legacy=0x7f435c0ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f4360ca3700 1 -- 172.21.15.49:0/1729497721 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c15fa90 con 0x7f435c0698a0 2023-07-21T22:10:48.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f4360ca3700 1 --2- 172.21.15.49:0/1729497721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f435c0698a0 0x7f435c069cf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f435c06b840 tx=0x7f434c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57486bfb4a3391a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:48.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f4353fff700 1 -- 172.21.15.49:0/1729497721 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c011830 con 0x7f435c0698a0 2023-07-21T22:10:48.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f4353fff700 1 -- 172.21.15.49:0/1729497721 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c011990 con 0x7f435c0698a0 2023-07-21T22:10:48.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f4353fff700 1 -- 172.21.15.49:0/1729497721 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c011d20 con 0x7f435c0698a0 2023-07-21T22:10:48.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f43624a6700 1 -- 172.21.15.49:0/1729497721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f435c0698a0 msgr2=0x7f435c069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f43624a6700 1 --2- 172.21.15.49:0/1729497721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f435c0698a0 0x7f435c069cf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f435c06b840 tx=0x7f434c009b30 comp rx=0 tx=0).stop 2023-07-21T22:10:48.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f43624a6700 1 -- 172.21.15.49:0/1729497721 shutdown_connections 2023-07-21T22:10:48.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f43624a6700 1 --2- 172.21.15.49:0/1729497721 >> v2:172.21.15.49:3300/0 conn(0x7f435c0aba80 0x7f435c0abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f43624a6700 1 --2- 172.21.15.49:0/1729497721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f435c0698a0 0x7f435c069cf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.909+0000 7f43624a6700 1 -- 172.21.15.49:0/1729497721 >> 172.21.15.49:0/1729497721 conn(0x7f435c0ce0d0 msgr2=0x7f435c0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:48.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.913+0000 7f43624a6700 1 -- 172.21.15.49:0/1729497721 shutdown_connections 2023-07-21T22:10:48.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.913+0000 7f43624a6700 1 -- 172.21.15.49:0/1729497721 wait complete. 2023-07-21T22:10:48.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.913+0000 7f43624a6700 1 Processor -- start 2023-07-21T22:10:48.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.913+0000 7f43624a6700 1 -- start start 2023-07-21T22:10:48.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f43624a6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f435c0698a0 0x7f435c1f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f43624a6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f435c0aba80 0x7f435c1f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f43624a6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c0c9b80 0x7f435c1f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f43624a6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0c2370 con 0x7f435c0c9b80 2023-07-21T22:10:48.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f43624a6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c15ca40 con 0x7f435c0aba80 2023-07-21T22:10:48.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f43624a6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0c1df0 con 0x7f435c0698a0 2023-07-21T22:10:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f4361ca5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c0c9b80 0x7f435c1f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f4361ca5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c0c9b80 0x7f435c1f4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59686/0 (socket says 172.21.15.49:59686) 2023-07-21T22:10:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f4361ca5700 1 -- 172.21.15.49:0/1570259771 learned_addr learned my addr 172.21.15.49:0/1570259771 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f4360ca3700 1 --2- 172.21.15.49:0/1570259771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f435c0aba80 0x7f435c1f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f43614a4700 1 --2- 172.21.15.49:0/1570259771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f435c0698a0 0x7f435c1f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f4361ca5700 1 -- 172.21.15.49:0/1570259771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f435c0698a0 msgr2=0x7f435c1f0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f4361ca5700 1 --2- 172.21.15.49:0/1570259771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f435c0698a0 0x7f435c1f0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f4361ca5700 1 -- 172.21.15.49:0/1570259771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f435c0aba80 msgr2=0x7f435c1f4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f4361ca5700 1 --2- 172.21.15.49:0/1570259771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f435c0aba80 0x7f435c1f4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f4361ca5700 1 -- 172.21.15.49:0/1570259771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c0094b0 con 0x7f435c0c9b80 2023-07-21T22:10:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f4361ca5700 1 --2- 172.21.15.49:0/1570259771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c0c9b80 0x7f435c1f4fe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4354009dd0 tx=0x7f435400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f4351ffb700 1 -- 172.21.15.49:0/1570259771 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354009c40 con 0x7f435c0c9b80 2023-07-21T22:10:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f4351ffb700 1 -- 172.21.15.49:0/1570259771 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435400f040 con 0x7f435c0c9b80 2023-07-21T22:10:48.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f4351ffb700 1 -- 172.21.15.49:0/1570259771 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354014480 con 0x7f435c0c9b80 2023-07-21T22:10:48.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f43624a6700 1 -- 172.21.15.49:0/1570259771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c0c2090 con 0x7f435c0c9b80 2023-07-21T22:10:48.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.917+0000 7f43624a6700 1 -- 172.21.15.49:0/1570259771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c1f5970 con 0x7f435c0c9b80 2023-07-21T22:10:48.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.921+0000 7f43624a6700 1 -- 172.21.15.49:0/1570259771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435c15c380 con 0x7f435c0c9b80 2023-07-21T22:10:48.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.921+0000 7f4351ffb700 1 -- 172.21.15.49:0/1570259771 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f43540145e0 con 0x7f435c0c9b80 2023-07-21T22:10:48.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.921+0000 7f4351ffb700 1 --2- 172.21.15.49:0/1570259771 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f43400662f0 0x7f43400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:48.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.921+0000 7f4351ffb700 1 -- 172.21.15.49:0/1570259771 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4354084950 con 0x7f435c0c9b80 2023-07-21T22:10:48.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.925+0000 7f43614a4700 1 --2- 172.21.15.49:0/1570259771 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f43400662f0 0x7f43400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:48.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.925+0000 7f43614a4700 1 --2- 172.21.15.49:0/1570259771 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f43400662f0 0x7f43400687a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4358001270 tx=0x7f4358009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:48.929+0000 7f4351ffb700 1 -- 172.21.15.49:0/1570259771 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f435c15c380 con 0x7f435c0c9b80 2023-07-21T22:10:49.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.101+0000 7f43624a6700 1 -- 172.21.15.49:0/1570259771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f435c15c760 con 0x7f435c0c9b80 2023-07-21T22:10:49.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.105+0000 7f4351ffb700 1 -- 172.21.15.49:0/1570259771 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f435c15c760 con 0x7f435c0c9b80 2023-07-21T22:10:49.147 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:10:49.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.105+0000 7f43624a6700 1 -- 172.21.15.49:0/1570259771 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f43400662f0 msgr2=0x7f43400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.105+0000 7f43624a6700 1 --2- 172.21.15.49:0/1570259771 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f43400662f0 0x7f43400687a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4358001270 tx=0x7f4358009040 comp rx=0 tx=0).stop 2023-07-21T22:10:49.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.105+0000 7f43624a6700 1 -- 172.21.15.49:0/1570259771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c0c9b80 msgr2=0x7f435c1f4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.105+0000 7f43624a6700 1 --2- 172.21.15.49:0/1570259771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c0c9b80 0x7f435c1f4fe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4354009dd0 tx=0x7f435400c3a0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.105+0000 7f43624a6700 1 -- 172.21.15.49:0/1570259771 shutdown_connections 2023-07-21T22:10:49.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.105+0000 7f43624a6700 1 --2- 172.21.15.49:0/1570259771 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f43400662f0 0x7f43400687a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.105+0000 7f43624a6700 1 --2- 172.21.15.49:0/1570259771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c0c9b80 0x7f435c1f4fe0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.105+0000 7f43624a6700 1 --2- 172.21.15.49:0/1570259771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f435c0aba80 0x7f435c1f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.105+0000 7f43624a6700 1 --2- 172.21.15.49:0/1570259771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f435c0698a0 0x7f435c1f0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.105+0000 7f43624a6700 1 -- 172.21.15.49:0/1570259771 >> 172.21.15.49:0/1570259771 conn(0x7f435c0ce0d0 msgr2=0x7f435c0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:49.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.105+0000 7f43624a6700 1 -- 172.21.15.49:0/1570259771 shutdown_connections 2023-07-21T22:10:49.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.109+0000 7f43624a6700 1 -- 172.21.15.49:0/1570259771 wait complete. 2023-07-21T22:10:49.172 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:10:49.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.313+0000 7ffb06465700 1 Processor -- start 2023-07-21T22:10:49.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.313+0000 7ffb06465700 1 -- start start 2023-07-21T22:10:49.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.317+0000 7ffb06465700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffb00160110 0x7ffb000cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.317+0000 7ffb06465700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffb00071220 0x7ffb000cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.317+0000 7ffb06465700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb000cdf00 con 0x7ffb00071670 2023-07-21T22:10:49.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.317+0000 7ffb06465700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb000cd730 con 0x7ffb00071220 2023-07-21T22:10:49.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.317+0000 7ffb06465700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb000ce600 con 0x7ffb00160110 2023-07-21T22:10:49.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.317+0000 7ffaff7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffb00071220 0x7ffb000cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:49.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.317+0000 7ffaff7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffb00071220 0x7ffb000cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59700/0 (socket says 172.21.15.49:59700) 2023-07-21T22:10:49.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.317+0000 7ffafffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffb00160110 0x7ffb000cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:49.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.317+0000 7ffaff7fe700 1 -- 172.21.15.49:0/3802148070 learned_addr learned my addr 172.21.15.49:0/3802148070 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:49.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.317+0000 7ffaff7fe700 1 -- 172.21.15.49:0/3802148070 >> v2:172.21.15.150:3300/0 conn(0x7ffb00160110 msgr2=0x7ffb000cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:49.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.317+0000 7ffaff7fe700 1 --2- 172.21.15.49:0/3802148070 >> v2:172.21.15.150:3300/0 conn(0x7ffb00160110 0x7ffb000cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.317+0000 7ffaff7fe700 1 -- 172.21.15.49:0/3802148070 >> v1:172.21.15.150:6789/0 conn(0x7ffb00071670 legacy=0x7ffb00163d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.317+0000 7ffaff7fe700 1 -- 172.21.15.49:0/3802148070 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb000cefd0 con 0x7ffb00071220 2023-07-21T22:10:49.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.317+0000 7ffaff7fe700 1 --2- 172.21.15.49:0/3802148070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb00071220 0x7ffb000cabe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffb000cabb0 tx=0x7ffaf4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b732c3cff15ecc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:49.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.321+0000 7ffafeffd700 1 -- 172.21.15.49:0/3802148070 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4005e50 con 0x7ffb00071220 2023-07-21T22:10:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.321+0000 7ffafeffd700 1 -- 172.21.15.49:0/3802148070 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf4006030 con 0x7ffb00071220 2023-07-21T22:10:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.321+0000 7ffafeffd700 1 -- 172.21.15.49:0/3802148070 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40063c0 con 0x7ffb00071220 2023-07-21T22:10:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.325+0000 7ffb06465700 1 -- 172.21.15.49:0/3802148070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb00071220 msgr2=0x7ffb000cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.325+0000 7ffb06465700 1 --2- 172.21.15.49:0/3802148070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb00071220 0x7ffb000cabe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffb000cabb0 tx=0x7ffaf4009bf0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.325+0000 7ffb06465700 1 -- 172.21.15.49:0/3802148070 shutdown_connections 2023-07-21T22:10:49.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.325+0000 7ffb06465700 1 --2- 172.21.15.49:0/3802148070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb00071220 0x7ffb000cabe0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.325+0000 7ffb06465700 1 --2- 172.21.15.49:0/3802148070 >> v2:172.21.15.150:3300/0 conn(0x7ffb00160110 0x7ffb000cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.325+0000 7ffb06465700 1 -- 172.21.15.49:0/3802148070 >> 172.21.15.49:0/3802148070 conn(0x7ffb0006e960 msgr2=0x7ffb0006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:49.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.325+0000 7ffb06465700 1 -- 172.21.15.49:0/3802148070 shutdown_connections 2023-07-21T22:10:49.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.325+0000 7ffb06465700 1 -- 172.21.15.49:0/3802148070 wait complete. 2023-07-21T22:10:49.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.325+0000 7ffb06465700 1 Processor -- start 2023-07-21T22:10:49.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.325+0000 7ffb06465700 1 -- start start 2023-07-21T22:10:49.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffb06465700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb00071220 0x7ffb0015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffb06465700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb00071670 0x7ffb000c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffb06465700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb00160110 0x7ffb000aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffb06465700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000c6080 con 0x7ffb00160110 2023-07-21T22:10:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffb06465700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb001f9b80 con 0x7ffb00071220 2023-07-21T22:10:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffb06465700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb001f9000 con 0x7ffb00071670 2023-07-21T22:10:49.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffb04a02700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb00160110 0x7ffb000aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:49.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffafffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb00071220 0x7ffb0015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:49.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffafffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb00071220 0x7ffb0015a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:40340/0 (socket says 172.21.15.49:40340) 2023-07-21T22:10:49.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffb04a02700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb00160110 0x7ffb000aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59712/0 (socket says 172.21.15.49:59712) 2023-07-21T22:10:49.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffafffff700 1 -- 172.21.15.49:0/378679745 learned_addr learned my addr 172.21.15.49:0/378679745 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:49.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffaff7fe700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb00071670 0x7ffb000c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:49.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffafffff700 1 -- 172.21.15.49:0/378679745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb00071670 msgr2=0x7ffb000c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffafffff700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb00071670 0x7ffb000c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffafffff700 1 -- 172.21.15.49:0/378679745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb00160110 msgr2=0x7ffb000aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffafffff700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb00160110 0x7ffb000aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffafffff700 1 -- 172.21.15.49:0/378679745 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf4009520 con 0x7ffb00071220 2023-07-21T22:10:49.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffb04a02700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb00160110 0x7ffb000aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:49.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffaff7fe700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb00071670 0x7ffb000c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffafffff700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb00071220 0x7ffb0015a9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000e840 tx=0x7ffaf000eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffafcff9700 1 -- 172.21.15.49:0/378679745 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf00095a0 con 0x7ffb00071220 2023-07-21T22:10:49.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffafcff9700 1 -- 172.21.15.49:0/378679745 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf0013680 con 0x7ffb00071220 2023-07-21T22:10:49.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffb06465700 1 -- 172.21.15.49:0/378679745 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb001f92e0 con 0x7ffb00071220 2023-07-21T22:10:49.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffafcff9700 1 -- 172.21.15.49:0/378679745 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf00139f0 con 0x7ffb00071220 2023-07-21T22:10:49.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.329+0000 7ffb06465700 1 -- 172.21.15.49:0/378679745 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb001f98a0 con 0x7ffb00071220 2023-07-21T22:10:49.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.333+0000 7ffb06465700 1 -- 172.21.15.49:0/378679745 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0004dd50 con 0x7ffb00071220 2023-07-21T22:10:49.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.333+0000 7ffafcff9700 1 -- 172.21.15.49:0/378679745 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffaf0013b50 con 0x7ffb00071220 2023-07-21T22:10:49.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.337+0000 7ffafcff9700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ffaec0662f0 0x7ffaec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.337+0000 7ffafcff9700 1 -- 172.21.15.49:0/378679745 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffaf0083f10 con 0x7ffb00071220 2023-07-21T22:10:49.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.337+0000 7ffaff7fe700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ffaec0662f0 0x7ffaec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:49.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.337+0000 7ffaff7fe700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ffaec0662f0 0x7ffaec0687a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4013040 tx=0x7ffaf4008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:49.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.345+0000 7ffafcff9700 1 -- 172.21.15.49:0/378679745 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffaf0054a90 con 0x7ffb00071220 2023-07-21T22:10:49.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.525+0000 7ffb06465700 1 -- 172.21.15.49:0/378679745 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ffb000b0c10 con 0x7ffb00071220 2023-07-21T22:10:49.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.525+0000 7ffafcff9700 1 -- 172.21.15.49:0/378679745 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7ffaf0017020 con 0x7ffb00071220 2023-07-21T22:10:49.568 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:10:49.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.529+0000 7ffb06465700 1 -- 172.21.15.49:0/378679745 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ffaec0662f0 msgr2=0x7ffaec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.529+0000 7ffb06465700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ffaec0662f0 0x7ffaec0687a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4013040 tx=0x7ffaf4008070 comp rx=0 tx=0).stop 2023-07-21T22:10:49.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.529+0000 7ffb06465700 1 -- 172.21.15.49:0/378679745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb00071220 msgr2=0x7ffb0015a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.529+0000 7ffb06465700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb00071220 0x7ffb0015a9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000e840 tx=0x7ffaf000eb50 comp rx=0 tx=0).stop 2023-07-21T22:10:49.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.529+0000 7ffb06465700 1 -- 172.21.15.49:0/378679745 shutdown_connections 2023-07-21T22:10:49.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.529+0000 7ffb06465700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ffaec0662f0 0x7ffaec0687a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.529+0000 7ffb06465700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb00160110 0x7ffb000aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.529+0000 7ffb06465700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb00071670 0x7ffb000c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.529+0000 7ffb06465700 1 --2- 172.21.15.49:0/378679745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb00071220 0x7ffb0015a9c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.529+0000 7ffb06465700 1 -- 172.21.15.49:0/378679745 >> 172.21.15.49:0/378679745 conn(0x7ffb0006e960 msgr2=0x7ffb0015f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:49.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.529+0000 7ffb06465700 1 -- 172.21.15.49:0/378679745 shutdown_connections 2023-07-21T22:10:49.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.529+0000 7ffb06465700 1 -- 172.21.15.49:0/378679745 wait complete. 2023-07-21T22:10:49.597 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:10:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.733+0000 7f8928a89700 1 Processor -- start 2023-07-21T22:10:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.733+0000 7f8928a89700 1 -- start start 2023-07-21T22:10:49.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.737+0000 7f8928a89700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89240afc20 0x7f89240cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.737+0000 7f8928a89700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89240cdeb0 con 0x7f89241604c0 2023-07-21T22:10:49.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.737+0000 7f8928a89700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8924163df0 con 0x7f89240c8860 2023-07-21T22:10:49.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.737+0000 7f8928a89700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89241640d0 con 0x7f89240afc20 2023-07-21T22:10:49.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.737+0000 7f8921d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f89241604c0 0x7f89240afff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46920/0 (socket says 172.21.15.49:46920) 2023-07-21T22:10:49.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.737+0000 7f8921d9b700 1 -- 172.21.15.49:0/1363218683 learned_addr learned my addr 172.21.15.49:0/1363218683 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:49.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.737+0000 7f892259c700 1 --2- 172.21.15.49:0/1363218683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89240afc20 0x7f89240cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:49.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f892259c700 1 -- 172.21.15.49:0/1363218683 >> v1:172.21.15.150:6789/0 conn(0x7f89240c8860 legacy=0x7f8924070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f892159a700 1 -- 172.21.15.49:0/1363218683 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123133824 0 0) 0x7f89240cdeb0 con 0x7f89241604c0 2023-07-21T22:10:49.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f892259c700 1 -- 172.21.15.49:0/1363218683 >> v1:172.21.15.49:6789/0 conn(0x7f89241604c0 legacy=0x7f89240afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f892259c700 1 -- 172.21.15.49:0/1363218683 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89241643b0 con 0x7f89240afc20 2023-07-21T22:10:49.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f892259c700 1 --2- 172.21.15.49:0/1363218683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89240afc20 0x7f89240cd970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8914009880 tx=0x7f8914009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4433feb0529879e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:49.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f892159a700 1 -- 172.21.15.49:0/1363218683 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914011830 con 0x7f89240afc20 2023-07-21T22:10:49.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f892159a700 1 -- 172.21.15.49:0/1363218683 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8914011990 con 0x7f89240afc20 2023-07-21T22:10:49.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f892159a700 1 -- 172.21.15.49:0/1363218683 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914011d20 con 0x7f89240afc20 2023-07-21T22:10:49.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f8928a89700 1 -- 172.21.15.49:0/1363218683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89240afc20 msgr2=0x7f89240cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f8928a89700 1 --2- 172.21.15.49:0/1363218683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89240afc20 0x7f89240cd970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8914009880 tx=0x7f8914009b90 comp rx=0 tx=0).stop 2023-07-21T22:10:49.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f8928a89700 1 -- 172.21.15.49:0/1363218683 shutdown_connections 2023-07-21T22:10:49.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f8928a89700 1 --2- 172.21.15.49:0/1363218683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89240afc20 0x7f89240cd970 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f8928a89700 1 -- 172.21.15.49:0/1363218683 >> 172.21.15.49:0/1363218683 conn(0x7f892406f5a0 msgr2=0x7f89240cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:49.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f8928a89700 1 -- 172.21.15.49:0/1363218683 shutdown_connections 2023-07-21T22:10:49.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.741+0000 7f8928a89700 1 -- 172.21.15.49:0/1363218683 wait complete. 2023-07-21T22:10:49.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.745+0000 7f8928a89700 1 Processor -- start 2023-07-21T22:10:49.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.745+0000 7f8928a89700 1 -- start start 2023-07-21T22:10:49.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.745+0000 7f8928a89700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89240afc20 0x7f89240c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.745+0000 7f8928a89700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89240c8860 0x7f89240c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.745+0000 7f8928a89700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89241604c0 0x7f89240c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.745+0000 7f8928a89700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89240c2ea0 con 0x7f89240c8860 2023-07-21T22:10:49.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.745+0000 7f8928a89700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89240c3180 con 0x7f89241604c0 2023-07-21T22:10:49.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.745+0000 7f8928a89700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89240c3460 con 0x7f89240afc20 2023-07-21T22:10:49.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.745+0000 7f8921d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89240c8860 0x7f89240c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:49.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.745+0000 7f8921d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89240c8860 0x7f89240c3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59728/0 (socket says 172.21.15.49:59728) 2023-07-21T22:10:49.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.745+0000 7f8921d9b700 1 -- 172.21.15.49:0/3081421171 learned_addr learned my addr 172.21.15.49:0/3081421171 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:49.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.745+0000 7f892259c700 1 --2- 172.21.15.49:0/3081421171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89240afc20 0x7f89240c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:49.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.745+0000 7f8922d9d700 1 --2- 172.21.15.49:0/3081421171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89241604c0 0x7f89240c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:49.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.749+0000 7f8921d9b700 1 -- 172.21.15.49:0/3081421171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89240afc20 msgr2=0x7f89240c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.749+0000 7f8921d9b700 1 --2- 172.21.15.49:0/3081421171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89240afc20 0x7f89240c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.749+0000 7f8921d9b700 1 -- 172.21.15.49:0/3081421171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89241604c0 msgr2=0x7f89240c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.749+0000 7f8921d9b700 1 --2- 172.21.15.49:0/3081421171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89241604c0 0x7f89240c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.749+0000 7f8921d9b700 1 -- 172.21.15.49:0/3081421171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89140094b0 con 0x7f89240c8860 2023-07-21T22:10:49.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.749+0000 7f8921d9b700 1 --2- 172.21.15.49:0/3081421171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89240c8860 0x7f89240c3f40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f891800c4a0 tx=0x7f891800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:49.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.749+0000 7f8912ffd700 1 -- 172.21.15.49:0/3081421171 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918004ca0 con 0x7f89240c8860 2023-07-21T22:10:49.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.749+0000 7f8912ffd700 1 -- 172.21.15.49:0/3081421171 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8918004e00 con 0x7f89240c8860 2023-07-21T22:10:49.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.749+0000 7f8912ffd700 1 -- 172.21.15.49:0/3081421171 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918007310 con 0x7f89240c8860 2023-07-21T22:10:49.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.749+0000 7f8928a89700 1 -- 172.21.15.49:0/3081421171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89240c3740 con 0x7f89240c8860 2023-07-21T22:10:49.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.749+0000 7f8928a89700 1 -- 172.21.15.49:0/3081421171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89240c80d0 con 0x7f89240c8860 2023-07-21T22:10:49.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.749+0000 7f8928a89700 1 -- 172.21.15.49:0/3081421171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f892404dcb0 con 0x7f89240c8860 2023-07-21T22:10:49.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.753+0000 7f8912ffd700 1 -- 172.21.15.49:0/3081421171 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8918007470 con 0x7f89240c8860 2023-07-21T22:10:49.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.753+0000 7f8912ffd700 1 --2- 172.21.15.49:0/3081421171 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f89040662f0 0x7f89040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.757+0000 7f8912ffd700 1 -- 172.21.15.49:0/3081421171 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8918083bf0 con 0x7f89240c8860 2023-07-21T22:10:49.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.757+0000 7f892259c700 1 --2- 172.21.15.49:0/3081421171 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f89040662f0 0x7f89040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:49.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.757+0000 7f892259c700 1 --2- 172.21.15.49:0/3081421171 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f89040662f0 0x7f89040687a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f89140090b0 tx=0x7f8914008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.761+0000 7f8912ffd700 1 -- 172.21.15.49:0/3081421171 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8918050ce0 con 0x7f89240c8860 2023-07-21T22:10:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.941+0000 7f8928a89700 1 -- 172.21.15.49:0/3081421171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8924163b10 con 0x7f89240c8860 2023-07-21T22:10:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.945+0000 7f8912ffd700 1 -- 172.21.15.49:0/3081421171 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8918007720 con 0x7f89240c8860 2023-07-21T22:10:49.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.949+0000 7f8928a89700 1 -- 172.21.15.49:0/3081421171 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f89040662f0 msgr2=0x7f89040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.949+0000 7f8928a89700 1 --2- 172.21.15.49:0/3081421171 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f89040662f0 0x7f89040687a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f89140090b0 tx=0x7f8914008030 comp rx=0 tx=0).stop 2023-07-21T22:10:49.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.949+0000 7f8928a89700 1 -- 172.21.15.49:0/3081421171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89240c8860 msgr2=0x7f89240c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.949+0000 7f8928a89700 1 --2- 172.21.15.49:0/3081421171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89240c8860 0x7f89240c3f40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f891800c4a0 tx=0x7f891800c7b0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.949+0000 7f8928a89700 1 -- 172.21.15.49:0/3081421171 shutdown_connections 2023-07-21T22:10:49.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.949+0000 7f8928a89700 1 --2- 172.21.15.49:0/3081421171 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f89040662f0 0x7f89040687a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.949+0000 7f8928a89700 1 --2- 172.21.15.49:0/3081421171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89240c8860 0x7f89240c3f40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.949+0000 7f8928a89700 1 --2- 172.21.15.49:0/3081421171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89241604c0 0x7f89240c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.949+0000 7f8928a89700 1 --2- 172.21.15.49:0/3081421171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89240afc20 0x7f89240c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.949+0000 7f8928a89700 1 -- 172.21.15.49:0/3081421171 >> 172.21.15.49:0/3081421171 conn(0x7f892406f5a0 msgr2=0x7f89240afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:49.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.949+0000 7f8928a89700 1 -- 172.21.15.49:0/3081421171 shutdown_connections 2023-07-21T22:10:49.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:49.949+0000 7f8928a89700 1 -- 172.21.15.49:0/3081421171 wait complete. 2023-07-21T22:10:49.996 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:10:50.014 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:10:50.015 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:10:50.034 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:10:50.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.221+0000 7f1435600700 1 Processor -- start 2023-07-21T22:10:50.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.221+0000 7f1435600700 1 -- start start 2023-07-21T22:10:50.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.221+0000 7f1435600700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f143006d630 0x7f143006e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:50.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.221+0000 7f1435600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1430070d30 0x7f143006da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:50.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.221+0000 7f1435600700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143015d610 con 0x7f14300cbbd0 2023-07-21T22:10:50.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.221+0000 7f1435600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143015deb0 con 0x7f1430070d30 2023-07-21T22:10:50.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.221+0000 7f1435600700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143006df40 con 0x7f143006d630 2023-07-21T22:10:50.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.221+0000 7f142e7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1430070d30 0x7f143006da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:50.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.221+0000 7f142e7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1430070d30 0x7f143006da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59742/0 (socket says 172.21.15.49:59742) 2023-07-21T22:10:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.221+0000 7f142e7fc700 1 -- 172.21.15.49:0/2648676997 learned_addr learned my addr 172.21.15.49:0/2648676997 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f142effd700 1 --2- 172.21.15.49:0/2648676997 >> v2:172.21.15.150:3300/0 conn(0x7f143006d630 0x7f143006e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f142e7fc700 1 -- 172.21.15.49:0/2648676997 >> v2:172.21.15.150:3300/0 conn(0x7f143006d630 msgr2=0x7f143006e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f142e7fc700 1 --2- 172.21.15.49:0/2648676997 >> v2:172.21.15.150:3300/0 conn(0x7f143006d630 0x7f143006e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f142e7fc700 1 -- 172.21.15.49:0/2648676997 >> v1:172.21.15.150:6789/0 conn(0x7f14300cbbd0 legacy=0x7f14300b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f142e7fc700 1 -- 172.21.15.49:0/2648676997 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14300cc0b0 con 0x7f1430070d30 2023-07-21T22:10:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f142e7fc700 1 --2- 172.21.15.49:0/2648676997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1430070d30 0x7f143006da00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f143006d0e0 tx=0x7f1424009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611680831445dab3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:50.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f142dffb700 1 -- 172.21.15.49:0/2648676997 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424005e50 con 0x7f1430070d30 2023-07-21T22:10:50.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f142dffb700 1 -- 172.21.15.49:0/2648676997 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1424004030 con 0x7f1430070d30 2023-07-21T22:10:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f142dffb700 1 -- 172.21.15.49:0/2648676997 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14240043c0 con 0x7f1430070d30 2023-07-21T22:10:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f1435600700 1 -- 172.21.15.49:0/2648676997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1430070d30 msgr2=0x7f143006da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f1435600700 1 --2- 172.21.15.49:0/2648676997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1430070d30 0x7f143006da00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f143006d0e0 tx=0x7f1424009bf0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f1435600700 1 -- 172.21.15.49:0/2648676997 shutdown_connections 2023-07-21T22:10:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f1435600700 1 --2- 172.21.15.49:0/2648676997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1430070d30 0x7f143006da00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f1435600700 1 --2- 172.21.15.49:0/2648676997 >> v2:172.21.15.150:3300/0 conn(0x7f143006d630 0x7f143006e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f1435600700 1 -- 172.21.15.49:0/2648676997 >> 172.21.15.49:0/2648676997 conn(0x7f14300cc430 msgr2=0x7f14300cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f1435600700 1 -- 172.21.15.49:0/2648676997 shutdown_connections 2023-07-21T22:10:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.225+0000 7f1435600700 1 -- 172.21.15.49:0/2648676997 wait complete. 2023-07-21T22:10:50.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.229+0000 7f1435600700 1 Processor -- start 2023-07-21T22:10:50.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.229+0000 7f1435600700 1 -- start start 2023-07-21T22:10:50.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.229+0000 7f1435600700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f143006d630 0x7f1430158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.229+0000 7f1435600700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1430070d30 0x7f14300b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.229+0000 7f1435600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14300cbbd0 0x7f14300b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.229+0000 7f1435600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1430159070 con 0x7f14300cbbd0 2023-07-21T22:10:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.229+0000 7f1435600700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14301efb70 con 0x7f1430070d30 2023-07-21T22:10:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.229+0000 7f1435600700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14300c7c50 con 0x7f143006d630 2023-07-21T22:10:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.229+0000 7f142e7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1430070d30 0x7f14300b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.229+0000 7f142ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14300cbbd0 0x7f14300b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.229+0000 7f142effd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f143006d630 0x7f1430158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.229+0000 7f142e7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1430070d30 0x7f14300b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:40366/0 (socket says 172.21.15.49:40366) 2023-07-21T22:10:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.229+0000 7f142e7fc700 1 -- 172.21.15.49:0/852764718 learned_addr learned my addr 172.21.15.49:0/852764718 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.233+0000 7f142ffff700 1 -- 172.21.15.49:0/852764718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f143006d630 msgr2=0x7f1430158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.233+0000 7f142ffff700 1 --2- 172.21.15.49:0/852764718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f143006d630 0x7f1430158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.233+0000 7f142ffff700 1 -- 172.21.15.49:0/852764718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1430070d30 msgr2=0x7f14300b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.233+0000 7f142ffff700 1 --2- 172.21.15.49:0/852764718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1430070d30 0x7f14300b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.233+0000 7f142ffff700 1 -- 172.21.15.49:0/852764718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1424009520 con 0x7f14300cbbd0 2023-07-21T22:10:50.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.233+0000 7f142e7fc700 1 --2- 172.21.15.49:0/852764718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1430070d30 0x7f14300b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:50.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.233+0000 7f142effd700 1 --2- 172.21.15.49:0/852764718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f143006d630 0x7f1430158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:50.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.233+0000 7f142ffff700 1 --2- 172.21.15.49:0/852764718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14300cbbd0 0x7f14300b1db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f143006e210 tx=0x7f1428009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.233+0000 7f14177fe700 1 -- 172.21.15.49:0/852764718 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800cb30 con 0x7f14300cbbd0 2023-07-21T22:10:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.233+0000 7f14177fe700 1 -- 172.21.15.49:0/852764718 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142800cc90 con 0x7f14300cbbd0 2023-07-21T22:10:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.233+0000 7f14177fe700 1 -- 172.21.15.49:0/852764718 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1428014440 con 0x7f14300cbbd0 2023-07-21T22:10:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.233+0000 7f1435600700 1 -- 172.21.15.49:0/852764718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14300c7690 con 0x7f14300cbbd0 2023-07-21T22:10:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.233+0000 7f1435600700 1 -- 172.21.15.49:0/852764718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14300af590 con 0x7f14300cbbd0 2023-07-21T22:10:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.233+0000 7f1435600700 1 -- 172.21.15.49:0/852764718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14300af3f0 con 0x7f14300cbbd0 2023-07-21T22:10:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.237+0000 7f14177fe700 1 -- 172.21.15.49:0/852764718 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f142801d3b0 con 0x7f14300cbbd0 2023-07-21T22:10:50.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.237+0000 7f14177fe700 1 --2- 172.21.15.49:0/852764718 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f141c0662f0 0x7f141c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:50.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.237+0000 7f14177fe700 1 -- 172.21.15.49:0/852764718 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1428083de0 con 0x7f14300cbbd0 2023-07-21T22:10:50.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.237+0000 7f142effd700 1 --2- 172.21.15.49:0/852764718 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f141c0662f0 0x7f141c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:50.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.241+0000 7f142effd700 1 --2- 172.21.15.49:0/852764718 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f141c0662f0 0x7f141c0687a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1420009df0 tx=0x7f1420008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:50.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.241+0000 7f14177fe700 1 -- 172.21.15.49:0/852764718 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14300af3f0 con 0x7f14300cbbd0 2023-07-21T22:10:50.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.417+0000 7f1435600700 1 -- 172.21.15.49:0/852764718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14300af3f0 con 0x7f14300cbbd0 2023-07-21T22:10:50.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.417+0000 7f14177fe700 1 -- 172.21.15.49:0/852764718 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f14300af3f0 con 0x7f14300cbbd0 2023-07-21T22:10:50.462 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:50.463 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:39.728219+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:10:50.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.425+0000 7f1435600700 1 -- 172.21.15.49:0/852764718 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f141c0662f0 msgr2=0x7f141c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:50.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.425+0000 7f1435600700 1 --2- 172.21.15.49:0/852764718 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f141c0662f0 0x7f141c0687a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1420009df0 tx=0x7f1420008040 comp rx=0 tx=0).stop 2023-07-21T22:10:50.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.425+0000 7f1435600700 1 -- 172.21.15.49:0/852764718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14300cbbd0 msgr2=0x7f14300b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:50.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.425+0000 7f1435600700 1 --2- 172.21.15.49:0/852764718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14300cbbd0 0x7f14300b1db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f143006e210 tx=0x7f1428009ed0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.425+0000 7f1435600700 1 -- 172.21.15.49:0/852764718 shutdown_connections 2023-07-21T22:10:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.425+0000 7f1435600700 1 --2- 172.21.15.49:0/852764718 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f141c0662f0 0x7f141c0687a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.425+0000 7f1435600700 1 --2- 172.21.15.49:0/852764718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14300cbbd0 0x7f14300b1db0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.425+0000 7f1435600700 1 --2- 172.21.15.49:0/852764718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1430070d30 0x7f14300b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.425+0000 7f1435600700 1 --2- 172.21.15.49:0/852764718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f143006d630 0x7f1430158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.425+0000 7f1435600700 1 -- 172.21.15.49:0/852764718 >> 172.21.15.49:0/852764718 conn(0x7f14300cc430 msgr2=0x7f143015c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:50.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.425+0000 7f1435600700 1 -- 172.21.15.49:0/852764718 shutdown_connections 2023-07-21T22:10:50.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.425+0000 7f1435600700 1 -- 172.21.15.49:0/852764718 wait complete. 2023-07-21T22:10:50.490 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:10:50.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:10:50.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.629+0000 7fcc493bf700 1 Processor -- start 2023-07-21T22:10:50.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.629+0000 7fcc493bf700 1 -- start start 2023-07-21T22:10:50.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.629+0000 7fcc493bf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc440ca550 0x7fcc4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:50.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.629+0000 7fcc493bf700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc440c8b80 con 0x7fcc44159be0 2023-07-21T22:10:50.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.629+0000 7fcc493bf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4406db90 con 0x7fcc4406d6d0 2023-07-21T22:10:50.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.629+0000 7fcc493bf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc440c9720 con 0x7fcc440ca550 2023-07-21T22:10:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.629+0000 7fcc42ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcc44159be0 0x7fcc440c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46936/0 (socket says 172.21.15.49:46936) 2023-07-21T22:10:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.629+0000 7fcc42ffd700 1 -- 172.21.15.49:0/383125935 learned_addr learned my addr 172.21.15.49:0/383125935 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.629+0000 7fcc3bfff700 1 --2- 172.21.15.49:0/383125935 >> v2:172.21.15.150:3300/0 conn(0x7fcc440ca550 0x7fcc4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:50.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.629+0000 7fcc3bfff700 1 -- 172.21.15.49:0/383125935 >> v1:172.21.15.150:6789/0 conn(0x7fcc4406d6d0 legacy=0x7fcc440698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:50.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.629+0000 7fcc3bfff700 1 -- 172.21.15.49:0/383125935 >> v1:172.21.15.49:6789/0 conn(0x7fcc44159be0 legacy=0x7fcc440c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:50.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.629+0000 7fcc3bfff700 1 -- 172.21.15.49:0/383125935 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4406de70 con 0x7fcc440ca550 2023-07-21T22:10:50.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.629+0000 7fcc427fc700 1 -- 172.21.15.49:0/383125935 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642915160 0 0) 0x7fcc440c8b80 con 0x7fcc44159be0 2023-07-21T22:10:50.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.633+0000 7fcc3bfff700 1 --2- 172.21.15.49:0/383125935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440ca550 0x7fcc4406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009850 tx=0x7fcc2c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cf01f51fd71cc1a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:50.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.633+0000 7fcc427fc700 1 -- 172.21.15.49:0/383125935 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c011830 con 0x7fcc440ca550 2023-07-21T22:10:50.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.633+0000 7fcc427fc700 1 -- 172.21.15.49:0/383125935 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c011990 con 0x7fcc440ca550 2023-07-21T22:10:50.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.633+0000 7fcc427fc700 1 -- 172.21.15.49:0/383125935 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c011d20 con 0x7fcc440ca550 2023-07-21T22:10:50.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.633+0000 7fcc493bf700 1 -- 172.21.15.49:0/383125935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440ca550 msgr2=0x7fcc4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:50.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.633+0000 7fcc493bf700 1 --2- 172.21.15.49:0/383125935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440ca550 0x7fcc4406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009850 tx=0x7fcc2c009b60 comp rx=0 tx=0).stop 2023-07-21T22:10:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.633+0000 7fcc493bf700 1 -- 172.21.15.49:0/383125935 shutdown_connections 2023-07-21T22:10:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.633+0000 7fcc493bf700 1 --2- 172.21.15.49:0/383125935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440ca550 0x7fcc4406d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.633+0000 7fcc493bf700 1 -- 172.21.15.49:0/383125935 >> 172.21.15.49:0/383125935 conn(0x7fcc440ce0d0 msgr2=0x7fcc440ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.633+0000 7fcc493bf700 1 -- 172.21.15.49:0/383125935 shutdown_connections 2023-07-21T22:10:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.633+0000 7fcc493bf700 1 -- 172.21.15.49:0/383125935 wait complete. 2023-07-21T22:10:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.633+0000 7fcc493bf700 1 Processor -- start 2023-07-21T22:10:50.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.633+0000 7fcc493bf700 1 -- start start 2023-07-21T22:10:50.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc493bf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc4406d6d0 0x7fcc441f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:50.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc493bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc440ca550 0x7fcc441471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:50.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc493bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc44159be0 0x7fcc440cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:50.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc493bf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440c6690 con 0x7fcc44159be0 2023-07-21T22:10:50.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc493bf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc441f4190 con 0x7fcc4406d6d0 2023-07-21T22:10:50.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc493bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440ae9c0 con 0x7fcc440ca550 2023-07-21T22:10:50.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc44159be0 0x7fcc440cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:50.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc44159be0 0x7fcc440cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59766/0 (socket says 172.21.15.49:59766) 2023-07-21T22:10:50.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc437fe700 1 -- 172.21.15.49:0/1712485554 learned_addr learned my addr 172.21.15.49:0/1712485554 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc42ffd700 1 --2- 172.21.15.49:0/1712485554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc4406d6d0 0x7fcc441f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc3bfff700 1 --2- 172.21.15.49:0/1712485554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc440ca550 0x7fcc441471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc437fe700 1 -- 172.21.15.49:0/1712485554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc440ca550 msgr2=0x7fcc441471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc437fe700 1 --2- 172.21.15.49:0/1712485554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc440ca550 0x7fcc441471f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc437fe700 1 -- 172.21.15.49:0/1712485554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc4406d6d0 msgr2=0x7fcc441f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:50.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc437fe700 1 --2- 172.21.15.49:0/1712485554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc4406d6d0 0x7fcc441f3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc437fe700 1 -- 172.21.15.49:0/1712485554 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c0094b0 con 0x7fcc44159be0 2023-07-21T22:10:50.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc437fe700 1 --2- 172.21.15.49:0/1712485554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc44159be0 0x7fcc440cd250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00caf0 tx=0x7fcc3c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:50.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc3b7fe700 1 -- 172.21.15.49:0/1712485554 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c003c20 con 0x7fcc44159be0 2023-07-21T22:10:50.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc3b7fe700 1 -- 172.21.15.49:0/1712485554 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c003d80 con 0x7fcc44159be0 2023-07-21T22:10:50.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc3b7fe700 1 -- 172.21.15.49:0/1712485554 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c00aab0 con 0x7fcc44159be0 2023-07-21T22:10:50.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc493bf700 1 -- 172.21.15.49:0/1712485554 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc440aeca0 con 0x7fcc44159be0 2023-07-21T22:10:50.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc493bf700 1 -- 172.21.15.49:0/1712485554 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc440ae600 con 0x7fcc44159be0 2023-07-21T22:10:50.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.637+0000 7fcc493bf700 1 -- 172.21.15.49:0/1712485554 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc440af1c0 con 0x7fcc44159be0 2023-07-21T22:10:50.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.641+0000 7fcc3b7fe700 1 -- 172.21.15.49:0/1712485554 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc3c00ac10 con 0x7fcc44159be0 2023-07-21T22:10:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.641+0000 7fcc3b7fe700 1 --2- 172.21.15.49:0/1712485554 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcc240662f0 0x7fcc240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.641+0000 7fcc3b7fe700 1 -- 172.21.15.49:0/1712485554 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcc3c083f80 con 0x7fcc44159be0 2023-07-21T22:10:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.641+0000 7fcc42ffd700 1 --2- 172.21.15.49:0/1712485554 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcc240662f0 0x7fcc240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:50.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.645+0000 7fcc42ffd700 1 --2- 172.21.15.49:0/1712485554 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcc240662f0 0x7fcc240687a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcc34000f60 tx=0x7fcc34007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:50.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.645+0000 7fcc3b7fe700 1 -- 172.21.15.49:0/1712485554 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc440af1c0 con 0x7fcc44159be0 2023-07-21T22:10:50.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.821+0000 7fcc493bf700 1 -- 172.21.15.49:0/1712485554 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc440c67d0 con 0x7fcc44159be0 2023-07-21T22:10:50.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.821+0000 7fcc3b7fe700 1 -- 172.21.15.49:0/1712485554 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc440c67d0 con 0x7fcc44159be0 2023-07-21T22:10:50.866 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:10:50.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.825+0000 7fcc493bf700 1 -- 172.21.15.49:0/1712485554 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcc240662f0 msgr2=0x7fcc240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:50.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.825+0000 7fcc493bf700 1 --2- 172.21.15.49:0/1712485554 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcc240662f0 0x7fcc240687a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcc34000f60 tx=0x7fcc34007c00 comp rx=0 tx=0).stop 2023-07-21T22:10:50.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.825+0000 7fcc493bf700 1 -- 172.21.15.49:0/1712485554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc44159be0 msgr2=0x7fcc440cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:50.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.825+0000 7fcc493bf700 1 --2- 172.21.15.49:0/1712485554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc44159be0 0x7fcc440cd250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00caf0 tx=0x7fcc3c00ceb0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.825+0000 7fcc493bf700 1 -- 172.21.15.49:0/1712485554 shutdown_connections 2023-07-21T22:10:50.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.825+0000 7fcc493bf700 1 --2- 172.21.15.49:0/1712485554 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcc240662f0 0x7fcc240687a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.825+0000 7fcc493bf700 1 --2- 172.21.15.49:0/1712485554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc44159be0 0x7fcc440cd250 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.825+0000 7fcc493bf700 1 --2- 172.21.15.49:0/1712485554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc440ca550 0x7fcc441471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.825+0000 7fcc493bf700 1 --2- 172.21.15.49:0/1712485554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc4406d6d0 0x7fcc441f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:50.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.825+0000 7fcc493bf700 1 -- 172.21.15.49:0/1712485554 >> 172.21.15.49:0/1712485554 conn(0x7fcc440ce0d0 msgr2=0x7fcc4406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:50.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.825+0000 7fcc493bf700 1 -- 172.21.15.49:0/1712485554 shutdown_connections 2023-07-21T22:10:50.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:50.825+0000 7fcc493bf700 1 -- 172.21.15.49:0/1712485554 wait complete. 2023-07-21T22:10:50.889 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:10:51.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.029+0000 7f40f194d700 1 Processor -- start 2023-07-21T22:10:51.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.029+0000 7f40f194d700 1 -- start start 2023-07-21T22:10:51.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40f194d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40ec071220 0x7f40ec0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40f194d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f40ec071670 0x7f40ec0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40f194d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ec0cdf00 con 0x7f40ec160110 2023-07-21T22:10:51.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40f194d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec0cd730 con 0x7f40ec071220 2023-07-21T22:10:51.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40f194d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec0ce600 con 0x7f40ec071670 2023-07-21T22:10:51.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40e3fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40ec071220 0x7f40ec0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40e3fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40ec071220 0x7f40ec0cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59770/0 (socket says 172.21.15.49:59770) 2023-07-21T22:10:51.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40e3fff700 1 -- 172.21.15.49:0/3793220445 learned_addr learned my addr 172.21.15.49:0/3793220445 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:51.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40eb7fe700 1 --2- 172.21.15.49:0/3793220445 >> v2:172.21.15.150:3300/0 conn(0x7f40ec071670 0x7f40ec0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40e3fff700 1 -- 172.21.15.49:0/3793220445 >> v2:172.21.15.150:3300/0 conn(0x7f40ec071670 msgr2=0x7f40ec0cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40e3fff700 1 --2- 172.21.15.49:0/3793220445 >> v2:172.21.15.150:3300/0 conn(0x7f40ec071670 0x7f40ec0cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40e3fff700 1 -- 172.21.15.49:0/3793220445 >> v1:172.21.15.49:6789/0 conn(0x7f40ec160110 legacy=0x7f40ec0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40e3fff700 1 -- 172.21.15.49:0/3793220445 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec06e190 con 0x7f40ec071220 2023-07-21T22:10:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40e3fff700 1 --2- 172.21.15.49:0/3793220445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40ec071220 0x7f40ec0cabe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f40ec06be70 tx=0x7f40d4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d374d90beadb4adc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40ea7fc700 1 -- 172.21.15.49:0/3793220445 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4005e50 con 0x7f40ec071220 2023-07-21T22:10:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40ea7fc700 1 -- 172.21.15.49:0/3793220445 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d4006030 con 0x7f40ec071220 2023-07-21T22:10:51.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.033+0000 7f40ea7fc700 1 -- 172.21.15.49:0/3793220445 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d40063c0 con 0x7f40ec071220 2023-07-21T22:10:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.037+0000 7f40f194d700 1 -- 172.21.15.49:0/3793220445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40ec071220 msgr2=0x7f40ec0cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.037+0000 7f40f194d700 1 --2- 172.21.15.49:0/3793220445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40ec071220 0x7f40ec0cabe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f40ec06be70 tx=0x7f40d4009bf0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.037+0000 7f40f194d700 1 -- 172.21.15.49:0/3793220445 shutdown_connections 2023-07-21T22:10:51.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.037+0000 7f40f194d700 1 --2- 172.21.15.49:0/3793220445 >> v2:172.21.15.150:3300/0 conn(0x7f40ec071670 0x7f40ec0cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.037+0000 7f40f194d700 1 --2- 172.21.15.49:0/3793220445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40ec071220 0x7f40ec0cabe0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.037+0000 7f40f194d700 1 -- 172.21.15.49:0/3793220445 >> 172.21.15.49:0/3793220445 conn(0x7f40ec06e960 msgr2=0x7f40ec06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:51.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.037+0000 7f40f194d700 1 -- 172.21.15.49:0/3793220445 shutdown_connections 2023-07-21T22:10:51.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.037+0000 7f40f194d700 1 -- 172.21.15.49:0/3793220445 wait complete. 2023-07-21T22:10:51.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40f194d700 1 Processor -- start 2023-07-21T22:10:51.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40f194d700 1 -- start start 2023-07-21T22:10:51.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40f194d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40ec071220 0x7f40ec1f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40f194d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40ec071670 0x7f40ec1623c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40f194d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40ec160110 0x7f40ec160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40f194d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec0b0730 con 0x7f40ec160110 2023-07-21T22:10:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40f194d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec0adcb0 con 0x7f40ec071220 2023-07-21T22:10:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40f194d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec0adf00 con 0x7f40ec071670 2023-07-21T22:10:51.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40eb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40ec160110 0x7f40ec160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40eb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40ec160110 0x7f40ec160ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59774/0 (socket says 172.21.15.49:59774) 2023-07-21T22:10:51.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40eb7fe700 1 -- 172.21.15.49:0/2057027442 learned_addr learned my addr 172.21.15.49:0/2057027442 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:51.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40eaffd700 1 --2- 172.21.15.49:0/2057027442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40ec071220 0x7f40ec1f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40e3fff700 1 --2- 172.21.15.49:0/2057027442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40ec071670 0x7f40ec1623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40eb7fe700 1 -- 172.21.15.49:0/2057027442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40ec071670 msgr2=0x7f40ec1623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40eb7fe700 1 --2- 172.21.15.49:0/2057027442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40ec071670 0x7f40ec1623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40eb7fe700 1 -- 172.21.15.49:0/2057027442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40ec071220 msgr2=0x7f40ec1f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40eb7fe700 1 --2- 172.21.15.49:0/2057027442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40ec071220 0x7f40ec1f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.041+0000 7f40eb7fe700 1 -- 172.21.15.49:0/2057027442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d4009520 con 0x7f40ec160110 2023-07-21T22:10:51.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.045+0000 7f40eb7fe700 1 --2- 172.21.15.49:0/2057027442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40ec160110 0x7f40ec160ef0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f40e4007e60 tx=0x7f40e400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:51.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.045+0000 7f40e8ff9700 1 -- 172.21.15.49:0/2057027442 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e400ede0 con 0x7f40ec160110 2023-07-21T22:10:51.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.045+0000 7f40e8ff9700 1 -- 172.21.15.49:0/2057027442 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e4014420 con 0x7f40ec160110 2023-07-21T22:10:51.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.045+0000 7f40e8ff9700 1 -- 172.21.15.49:0/2057027442 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40147d0 con 0x7f40ec160110 2023-07-21T22:10:51.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.045+0000 7f40f194d700 1 -- 172.21.15.49:0/2057027442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec0ae1e0 con 0x7f40ec160110 2023-07-21T22:10:51.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.045+0000 7f40f194d700 1 -- 172.21.15.49:0/2057027442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec0ae7a0 con 0x7f40ec160110 2023-07-21T22:10:51.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.045+0000 7f40f194d700 1 -- 172.21.15.49:0/2057027442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec04dd50 con 0x7f40ec160110 2023-07-21T22:10:51.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.045+0000 7f40e8ff9700 1 -- 172.21.15.49:0/2057027442 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f40e4014930 con 0x7f40ec160110 2023-07-21T22:10:51.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.049+0000 7f40e8ff9700 1 --2- 172.21.15.49:0/2057027442 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f40cc066320 0x7f40cc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.049+0000 7f40e8ff9700 1 -- 172.21.15.49:0/2057027442 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f40e40846c0 con 0x7f40ec160110 2023-07-21T22:10:51.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.049+0000 7f40eaffd700 1 --2- 172.21.15.49:0/2057027442 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f40cc066320 0x7f40cc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.049+0000 7f40eaffd700 1 --2- 172.21.15.49:0/2057027442 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f40cc066320 0x7f40cc0687d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f40dc001800 tx=0x7f40dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:51.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.053+0000 7f40e8ff9700 1 -- 172.21.15.49:0/2057027442 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f40e4051840 con 0x7f40ec160110 2023-07-21T22:10:51.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.233+0000 7f40f194d700 1 -- 172.21.15.49:0/2057027442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f40ec071000 con 0x7f40ec160110 2023-07-21T22:10:51.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.233+0000 7f40e8ff9700 1 -- 172.21.15.49:0/2057027442 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f40e4054e60 con 0x7f40ec160110 2023-07-21T22:10:51.276 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:10:51.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.237+0000 7f40f194d700 1 -- 172.21.15.49:0/2057027442 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f40cc066320 msgr2=0x7f40cc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.237+0000 7f40f194d700 1 --2- 172.21.15.49:0/2057027442 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f40cc066320 0x7f40cc0687d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f40dc001800 tx=0x7f40dc009040 comp rx=0 tx=0).stop 2023-07-21T22:10:51.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.237+0000 7f40f194d700 1 -- 172.21.15.49:0/2057027442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40ec160110 msgr2=0x7f40ec160ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.237+0000 7f40f194d700 1 --2- 172.21.15.49:0/2057027442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40ec160110 0x7f40ec160ef0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f40e4007e60 tx=0x7f40e400e3c0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.237+0000 7f40f194d700 1 -- 172.21.15.49:0/2057027442 shutdown_connections 2023-07-21T22:10:51.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.237+0000 7f40f194d700 1 --2- 172.21.15.49:0/2057027442 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f40cc066320 0x7f40cc0687d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.237+0000 7f40f194d700 1 --2- 172.21.15.49:0/2057027442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40ec160110 0x7f40ec160ef0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.237+0000 7f40f194d700 1 --2- 172.21.15.49:0/2057027442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40ec071670 0x7f40ec1623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.237+0000 7f40f194d700 1 --2- 172.21.15.49:0/2057027442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40ec071220 0x7f40ec1f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.237+0000 7f40f194d700 1 -- 172.21.15.49:0/2057027442 >> 172.21.15.49:0/2057027442 conn(0x7f40ec06e960 msgr2=0x7f40ec0cabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:51.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.237+0000 7f40f194d700 1 -- 172.21.15.49:0/2057027442 shutdown_connections 2023-07-21T22:10:51.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.237+0000 7f40f194d700 1 -- 172.21.15.49:0/2057027442 wait complete. 2023-07-21T22:10:51.302 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:10:51.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.437+0000 7fac6bf46700 1 Processor -- start 2023-07-21T22:10:51.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.441+0000 7fac6bf46700 1 -- start start 2023-07-21T22:10:51.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.441+0000 7fac6bf46700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fac64071220 0x7fac640cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.441+0000 7fac6bf46700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac640cdf00 con 0x7fac64160110 2023-07-21T22:10:51.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.441+0000 7fac6bf46700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac640ce600 con 0x7fac64071670 2023-07-21T22:10:51.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.441+0000 7fac6bf46700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac640cd730 con 0x7fac64071220 2023-07-21T22:10:51.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.441+0000 7fac69ce2700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fac64160110 0x7fac640cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46958/0 (socket says 172.21.15.49:46958) 2023-07-21T22:10:51.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.441+0000 7fac69ce2700 1 -- 172.21.15.49:0/3741406993 learned_addr learned my addr 172.21.15.49:0/3741406993 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:51.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac694e1700 1 --2- 172.21.15.49:0/3741406993 >> v2:172.21.15.150:3300/0 conn(0x7fac64071220 0x7fac640cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 -- 172.21.15.49:0/3741406993 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539035780 0 0) 0x7fac640cdf00 con 0x7fac64160110 2023-07-21T22:10:51.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 -- 172.21.15.49:0/3741406993 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac500035d0 con 0x7fac64160110 2023-07-21T22:10:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 -- 172.21.15.49:0/3741406993 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2442450490 0 0) 0x7fac500035d0 con 0x7fac64160110 2023-07-21T22:10:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 -- 172.21.15.49:0/3741406993 >> v2:172.21.15.150:3300/0 conn(0x7fac64071220 msgr2=0x7fac640cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 --2- 172.21.15.49:0/3741406993 >> v2:172.21.15.150:3300/0 conn(0x7fac64071220 0x7fac640cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 -- 172.21.15.49:0/3741406993 >> v1:172.21.15.150:6789/0 conn(0x7fac64071670 legacy=0x7fac64163d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 -- 172.21.15.49:0/3741406993 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6406e190 con 0x7fac64160110 2023-07-21T22:10:51.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 -- 172.21.15.49:0/3741406993 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7fac60001670 con 0x7fac64160110 2023-07-21T22:10:51.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 -- 172.21.15.49:0/3741406993 >> v1:172.21.15.49:6789/0 conn(0x7fac64160110 legacy=0x7fac640cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 --2- 172.21.15.49:0/3741406993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac50003a20 0x7fac50003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 --2- 172.21.15.49:0/3741406993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac50004410 0x7fac500048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 --2- 172.21.15.49:0/3741406993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac50005170 0x7fac5000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 -- 172.21.15.49:0/3741406993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac640cd730 con 0x7fac50004410 2023-07-21T22:10:51.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 -- 172.21.15.49:0/3741406993 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5000c0a0 con 0x7fac50003a20 2023-07-21T22:10:51.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 -- 172.21.15.49:0/3741406993 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5000c260 con 0x7fac50005170 2023-07-21T22:10:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac694e1700 1 --2- 172.21.15.49:0/3741406993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac50004410 0x7fac500048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac69ce2700 1 --2- 172.21.15.49:0/3741406993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac50003a20 0x7fac50003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac6a4e3700 1 --2- 172.21.15.49:0/3741406993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac50005170 0x7fac5000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac694e1700 1 -- 172.21.15.49:0/3741406993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac50005170 msgr2=0x7fac5000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac694e1700 1 --2- 172.21.15.49:0/3741406993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac50005170 0x7fac5000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac694e1700 1 -- 172.21.15.49:0/3741406993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac50003a20 msgr2=0x7fac50003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac694e1700 1 --2- 172.21.15.49:0/3741406993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac50003a20 0x7fac50003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac694e1700 1 -- 172.21.15.49:0/3741406993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac500035d0 con 0x7fac50004410 2023-07-21T22:10:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac69ce2700 1 --2- 172.21.15.49:0/3741406993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac50003a20 0x7fac50003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:51.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac6a4e3700 1 -- 172.21.15.49:0/3741406993 reap_dead start 2023-07-21T22:10:51.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac694e1700 1 --2- 172.21.15.49:0/3741406993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac50004410 0x7fac500048d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fac54009b60 tx=0x7fac500058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aceb06ae4071343 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 -- 172.21.15.49:0/3741406993 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54005a40 con 0x7fac50004410 2023-07-21T22:10:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 -- 172.21.15.49:0/3741406993 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac54005ba0 con 0x7fac50004410 2023-07-21T22:10:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac68ce0700 1 -- 172.21.15.49:0/3741406993 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5400e6c0 con 0x7fac50004410 2023-07-21T22:10:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac6bf46700 1 -- 172.21.15.49:0/3741406993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac50004410 msgr2=0x7fac500048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.445+0000 7fac6bf46700 1 --2- 172.21.15.49:0/3741406993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac50004410 0x7fac500048d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fac54009b60 tx=0x7fac500058a0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.449+0000 7fac6bf46700 1 -- 172.21.15.49:0/3741406993 shutdown_connections 2023-07-21T22:10:51.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.449+0000 7fac6bf46700 1 --2- 172.21.15.49:0/3741406993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac50004410 0x7fac500048d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.449+0000 7fac6bf46700 1 -- 172.21.15.49:0/3741406993 >> 172.21.15.49:0/3741406993 conn(0x7fac6406e960 msgr2=0x7fac6406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:51.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.449+0000 7fac6bf46700 1 -- 172.21.15.49:0/3741406993 shutdown_connections 2023-07-21T22:10:51.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.449+0000 7fac6bf46700 1 -- 172.21.15.49:0/3741406993 wait complete. 2023-07-21T22:10:51.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.449+0000 7fac6bf46700 1 Processor -- start 2023-07-21T22:10:51.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.449+0000 7fac6bf46700 1 -- start start 2023-07-21T22:10:51.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6bf46700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac50004410 0x7fac641575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6bf46700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac6415de40 0x7fac6415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6bf46700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac640b2ac0 0x7fac640b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6bf46700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6415e7f0 con 0x7fac640b2ac0 2023-07-21T22:10:51.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6bf46700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac64157b10 con 0x7fac50004410 2023-07-21T22:10:51.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6bf46700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac64160b10 con 0x7fac6415de40 2023-07-21T22:10:51.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6a4e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac640b2ac0 0x7fac640b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6a4e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac640b2ac0 0x7fac640b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59796/0 (socket says 172.21.15.49:59796) 2023-07-21T22:10:51.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6a4e3700 1 -- 172.21.15.49:0/2832166443 learned_addr learned my addr 172.21.15.49:0/2832166443 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:51.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac694e1700 1 --2- 172.21.15.49:0/2832166443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac6415de40 0x7fac6415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac69ce2700 1 --2- 172.21.15.49:0/2832166443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac50004410 0x7fac641575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6a4e3700 1 -- 172.21.15.49:0/2832166443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac6415de40 msgr2=0x7fac6415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6a4e3700 1 --2- 172.21.15.49:0/2832166443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac6415de40 0x7fac6415e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6a4e3700 1 -- 172.21.15.49:0/2832166443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac50004410 msgr2=0x7fac641575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6a4e3700 1 --2- 172.21.15.49:0/2832166443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac50004410 0x7fac641575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6a4e3700 1 -- 172.21.15.49:0/2832166443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac641582e0 con 0x7fac640b2ac0 2023-07-21T22:10:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6a4e3700 1 --2- 172.21.15.49:0/2832166443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac640b2ac0 0x7fac640b2f30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fac6406f690 tx=0x7fac5c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac5a7fc700 1 -- 172.21.15.49:0/2832166443 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c003c30 con 0x7fac640b2ac0 2023-07-21T22:10:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac5a7fc700 1 -- 172.21.15.49:0/2832166443 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5c003d90 con 0x7fac640b2ac0 2023-07-21T22:10:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6bf46700 1 -- 172.21.15.49:0/2832166443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac641585c0 con 0x7fac640b2ac0 2023-07-21T22:10:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac5a7fc700 1 -- 172.21.15.49:0/2832166443 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c005310 con 0x7fac640b2ac0 2023-07-21T22:10:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.453+0000 7fac6bf46700 1 -- 172.21.15.49:0/2832166443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac64158b80 con 0x7fac640b2ac0 2023-07-21T22:10:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.457+0000 7fac6bf46700 1 -- 172.21.15.49:0/2832166443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6404dd50 con 0x7fac640b2ac0 2023-07-21T22:10:51.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.457+0000 7fac5a7fc700 1 -- 172.21.15.49:0/2832166443 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fac5c005470 con 0x7fac640b2ac0 2023-07-21T22:10:51.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.457+0000 7fac5a7fc700 1 --2- 172.21.15.49:0/2832166443 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac48066320 0x7fac480687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.457+0000 7fac5a7fc700 1 -- 172.21.15.49:0/2832166443 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fac5c084140 con 0x7fac640b2ac0 2023-07-21T22:10:51.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.457+0000 7fac69ce2700 1 --2- 172.21.15.49:0/2832166443 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac48066320 0x7fac480687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.461+0000 7fac69ce2700 1 --2- 172.21.15.49:0/2832166443 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac48066320 0x7fac480687d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fac640693e0 tx=0x7fac60007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:51.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.465+0000 7fac5a7fc700 1 -- 172.21.15.49:0/2832166443 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac5c0511b0 con 0x7fac640b2ac0 2023-07-21T22:10:51.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.637+0000 7fac6bf46700 1 -- 172.21.15.49:0/2832166443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fac64071000 con 0x7fac640b2ac0 2023-07-21T22:10:51.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.641+0000 7fac5a7fc700 1 -- 172.21.15.49:0/2832166443 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fac5c0547d0 con 0x7fac640b2ac0 2023-07-21T22:10:51.683 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:10:51.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.641+0000 7fac6bf46700 1 -- 172.21.15.49:0/2832166443 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac48066320 msgr2=0x7fac480687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.641+0000 7fac6bf46700 1 --2- 172.21.15.49:0/2832166443 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac48066320 0x7fac480687d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fac640693e0 tx=0x7fac60007040 comp rx=0 tx=0).stop 2023-07-21T22:10:51.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.641+0000 7fac6bf46700 1 -- 172.21.15.49:0/2832166443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac640b2ac0 msgr2=0x7fac640b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.641+0000 7fac6bf46700 1 --2- 172.21.15.49:0/2832166443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac640b2ac0 0x7fac640b2f30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fac6406f690 tx=0x7fac5c00ee50 comp rx=0 tx=0).stop 2023-07-21T22:10:51.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.641+0000 7fac6bf46700 1 -- 172.21.15.49:0/2832166443 shutdown_connections 2023-07-21T22:10:51.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.641+0000 7fac6bf46700 1 --2- 172.21.15.49:0/2832166443 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac48066320 0x7fac480687d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.641+0000 7fac6bf46700 1 --2- 172.21.15.49:0/2832166443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac640b2ac0 0x7fac640b2f30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.641+0000 7fac6bf46700 1 --2- 172.21.15.49:0/2832166443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac6415de40 0x7fac6415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.641+0000 7fac6bf46700 1 --2- 172.21.15.49:0/2832166443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac50004410 0x7fac641575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.641+0000 7fac6bf46700 1 -- 172.21.15.49:0/2832166443 >> 172.21.15.49:0/2832166443 conn(0x7fac6406e960 msgr2=0x7fac640ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:51.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.641+0000 7fac6bf46700 1 -- 172.21.15.49:0/2832166443 shutdown_connections 2023-07-21T22:10:51.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.641+0000 7fac6bf46700 1 -- 172.21.15.49:0/2832166443 wait complete. 2023-07-21T22:10:51.709 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:10:51.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.849+0000 7f5f44e20700 1 Processor -- start 2023-07-21T22:10:51.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.849+0000 7f5f44e20700 1 -- start start 2023-07-21T22:10:51.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.853+0000 7f5f44e20700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5f400cf320 0x7f5f400d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.853+0000 7f5f44e20700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f400b8170 con 0x7f5f400b4b20 2023-07-21T22:10:51.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.853+0000 7f5f44e20700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f400d2350 con 0x7f5f400b4040 2023-07-21T22:10:51.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.853+0000 7f5f44e20700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f400cfa20 con 0x7f5f400cf320 2023-07-21T22:10:51.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.853+0000 7f5f3dd9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5f400b4b20 0x7f5f400d0810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46962/0 (socket says 172.21.15.49:46962) 2023-07-21T22:10:51.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.853+0000 7f5f3dd9b700 1 -- 172.21.15.49:0/3149061262 learned_addr learned my addr 172.21.15.49:0/3149061262 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:51.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.853+0000 7f5f3ed9d700 1 --2- 172.21.15.49:0/3149061262 >> v2:172.21.15.150:3300/0 conn(0x7f5f400cf320 0x7f5f400d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.853+0000 7f5f3d59a700 1 -- 172.21.15.49:0/3149061262 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008472586 0 0) 0x7f5f400b8170 con 0x7f5f400b4b20 2023-07-21T22:10:51.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.853+0000 7f5f3d59a700 1 -- 172.21.15.49:0/3149061262 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f280035d0 con 0x7f5f400b4b20 2023-07-21T22:10:51.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.853+0000 7f5f3d59a700 1 -- 172.21.15.49:0/3149061262 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4186102099 0 0) 0x7f5f280035d0 con 0x7f5f400b4b20 2023-07-21T22:10:51.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.853+0000 7f5f3ed9d700 1 -- 172.21.15.49:0/3149061262 >> v1:172.21.15.150:6789/0 conn(0x7f5f400b4040 legacy=0x7f5f400b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.853+0000 7f5f3ed9d700 1 -- 172.21.15.49:0/3149061262 >> v1:172.21.15.49:6789/0 conn(0x7f5f400b4b20 legacy=0x7f5f400d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.853+0000 7f5f3ed9d700 1 -- 172.21.15.49:0/3149061262 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f400cd370 con 0x7f5f400cf320 2023-07-21T22:10:51.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.857+0000 7f5f3ed9d700 1 --2- 172.21.15.49:0/3149061262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f400cf320 0x7f5f400d0f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009d90 tx=0x7f5f3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6182c5a69af301e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:51.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.857+0000 7f5f3d59a700 1 -- 172.21.15.49:0/3149061262 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3800e070 con 0x7f5f400cf320 2023-07-21T22:10:51.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.857+0000 7f5f3d59a700 1 -- 172.21.15.49:0/3149061262 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f38003a40 con 0x7f5f400cf320 2023-07-21T22:10:51.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.857+0000 7f5f3d59a700 1 -- 172.21.15.49:0/3149061262 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34001670 con 0x7f5f400cf320 2023-07-21T22:10:51.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.857+0000 7f5f44e20700 1 -- 172.21.15.49:0/3149061262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f400cf320 msgr2=0x7f5f400d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.857+0000 7f5f44e20700 1 --2- 172.21.15.49:0/3149061262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f400cf320 0x7f5f400d0f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009d90 tx=0x7f5f3800b330 comp rx=0 tx=0).stop 2023-07-21T22:10:51.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.857+0000 7f5f44e20700 1 -- 172.21.15.49:0/3149061262 shutdown_connections 2023-07-21T22:10:51.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.857+0000 7f5f44e20700 1 --2- 172.21.15.49:0/3149061262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f400cf320 0x7f5f400d0f20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.857+0000 7f5f44e20700 1 -- 172.21.15.49:0/3149061262 >> 172.21.15.49:0/3149061262 conn(0x7f5f400658e0 msgr2=0x7f5f4006fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:51.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.857+0000 7f5f44e20700 1 -- 172.21.15.49:0/3149061262 shutdown_connections 2023-07-21T22:10:51.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.857+0000 7f5f44e20700 1 -- 172.21.15.49:0/3149061262 wait complete. 2023-07-21T22:10:51.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f44e20700 1 Processor -- start 2023-07-21T22:10:51.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f44e20700 1 -- start start 2023-07-21T22:10:51.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f44e20700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f400b4040 0x7f5f400c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f44e20700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f400b4b20 0x7f5f400c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f44e20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f400cf320 0x7f5f400b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f44e20700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400b2e40 con 0x7f5f400cf320 2023-07-21T22:10:51.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f44e20700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400cc8f0 con 0x7f5f400b4b20 2023-07-21T22:10:51.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f44e20700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400cbfc0 con 0x7f5f400b4040 2023-07-21T22:10:51.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f3ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f400cf320 0x7f5f400b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f3ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f400cf320 0x7f5f400b25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59802/0 (socket says 172.21.15.49:59802) 2023-07-21T22:10:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f3ed9d700 1 -- 172.21.15.49:0/1947624725 learned_addr learned my addr 172.21.15.49:0/1947624725 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f3dd9b700 1 --2- 172.21.15.49:0/1947624725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f400b4b20 0x7f5f400c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f3e59c700 1 --2- 172.21.15.49:0/1947624725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f400b4040 0x7f5f400c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f3ed9d700 1 -- 172.21.15.49:0/1947624725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f400b4040 msgr2=0x7f5f400c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f3ed9d700 1 --2- 172.21.15.49:0/1947624725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f400b4040 0x7f5f400c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f3ed9d700 1 -- 172.21.15.49:0/1947624725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f400b4b20 msgr2=0x7f5f400c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:51.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f3ed9d700 1 --2- 172.21.15.49:0/1947624725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f400b4b20 0x7f5f400c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:51.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f3ed9d700 1 -- 172.21.15.49:0/1947624725 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f38009a70 con 0x7f5f400cf320 2023-07-21T22:10:51.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.861+0000 7f5f3ed9d700 1 --2- 172.21.15.49:0/1947624725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f400cf320 0x7f5f400b25f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5f400b51b0 tx=0x7f5f38004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:51.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.865+0000 7f5f2effd700 1 -- 172.21.15.49:0/1947624725 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38004540 con 0x7f5f400cf320 2023-07-21T22:10:51.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.865+0000 7f5f2effd700 1 -- 172.21.15.49:0/1947624725 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f380046a0 con 0x7f5f400cf320 2023-07-21T22:10:51.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.865+0000 7f5f44e20700 1 -- 172.21.15.49:0/1947624725 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f400cc2a0 con 0x7f5f400cf320 2023-07-21T22:10:51.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.865+0000 7f5f2effd700 1 -- 172.21.15.49:0/1947624725 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3801d470 con 0x7f5f400cf320 2023-07-21T22:10:51.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.865+0000 7f5f44e20700 1 -- 172.21.15.49:0/1947624725 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f400b2b30 con 0x7f5f400cf320 2023-07-21T22:10:51.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.865+0000 7f5f44e20700 1 -- 172.21.15.49:0/1947624725 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f400cca60 con 0x7f5f400cf320 2023-07-21T22:10:51.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.865+0000 7f5f2effd700 1 -- 172.21.15.49:0/1947624725 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f3801d5d0 con 0x7f5f400cf320 2023-07-21T22:10:51.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.869+0000 7f5f2effd700 1 --2- 172.21.15.49:0/1947624725 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5f200662f0 0x7f5f200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:51.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.869+0000 7f5f2effd700 1 -- 172.21.15.49:0/1947624725 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5f38085730 con 0x7f5f400cf320 2023-07-21T22:10:51.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.869+0000 7f5f3e59c700 1 --2- 172.21.15.49:0/1947624725 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5f200662f0 0x7f5f200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:51.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.869+0000 7f5f3e59c700 1 --2- 172.21.15.49:0/1947624725 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5f200662f0 0x7f5f200687a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f30000f60 tx=0x7f5f30009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:51.873+0000 7f5f2effd700 1 -- 172.21.15.49:0/1947624725 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f38052930 con 0x7f5f400cf320 2023-07-21T22:10:52.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.045+0000 7f5f44e20700 1 -- 172.21.15.49:0/1947624725 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f4004dd50 con 0x7f5f400cf320 2023-07-21T22:10:52.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.045+0000 7f5f2effd700 1 -- 172.21.15.49:0/1947624725 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f38055f50 con 0x7f5f400cf320 2023-07-21T22:10:52.090 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:10:52.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.049+0000 7f5f44e20700 1 -- 172.21.15.49:0/1947624725 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5f200662f0 msgr2=0x7f5f200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:52.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.049+0000 7f5f44e20700 1 --2- 172.21.15.49:0/1947624725 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5f200662f0 0x7f5f200687a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f30000f60 tx=0x7f5f30009040 comp rx=0 tx=0).stop 2023-07-21T22:10:52.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.049+0000 7f5f44e20700 1 -- 172.21.15.49:0/1947624725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f400cf320 msgr2=0x7f5f400b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:52.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.049+0000 7f5f44e20700 1 --2- 172.21.15.49:0/1947624725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f400cf320 0x7f5f400b25f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5f400b51b0 tx=0x7f5f38004af0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.049+0000 7f5f44e20700 1 -- 172.21.15.49:0/1947624725 shutdown_connections 2023-07-21T22:10:52.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.049+0000 7f5f44e20700 1 --2- 172.21.15.49:0/1947624725 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5f200662f0 0x7f5f200687a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.049+0000 7f5f44e20700 1 --2- 172.21.15.49:0/1947624725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f400cf320 0x7f5f400b25f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.049+0000 7f5f44e20700 1 --2- 172.21.15.49:0/1947624725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f400b4b20 0x7f5f400c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.049+0000 7f5f44e20700 1 --2- 172.21.15.49:0/1947624725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f400b4040 0x7f5f400c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.049+0000 7f5f44e20700 1 -- 172.21.15.49:0/1947624725 >> 172.21.15.49:0/1947624725 conn(0x7f5f400658e0 msgr2=0x7f5f400b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:52.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.049+0000 7f5f44e20700 1 -- 172.21.15.49:0/1947624725 shutdown_connections 2023-07-21T22:10:52.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.049+0000 7f5f44e20700 1 -- 172.21.15.49:0/1947624725 wait complete. 2023-07-21T22:10:52.116 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:10:52.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e74e7700 1 Processor -- start 2023-07-21T22:10:52.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e74e7700 1 -- start start 2023-07-21T22:10:52.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e74e7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10e0160110 0x7f10e00cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:52.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e74e7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10e0071220 0x7f10e00cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:52.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e74e7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e00cdf00 con 0x7f10e0071670 2023-07-21T22:10:52.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e74e7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e00cd730 con 0x7f10e0071220 2023-07-21T22:10:52.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e74e7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00ce600 con 0x7f10e0160110 2023-07-21T22:10:52.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e4a82700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10e0071220 0x7f10e00cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:52.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e4a82700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10e0071220 0x7f10e00cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59814/0 (socket says 172.21.15.49:59814) 2023-07-21T22:10:52.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e4a82700 1 -- 172.21.15.49:0/2804234808 learned_addr learned my addr 172.21.15.49:0/2804234808 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:52.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e5283700 1 --2- 172.21.15.49:0/2804234808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10e0160110 0x7f10e00cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:52.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e4a82700 1 -- 172.21.15.49:0/2804234808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10e0160110 msgr2=0x7f10e00cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:52.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e4a82700 1 --2- 172.21.15.49:0/2804234808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10e0160110 0x7f10e00cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e4a82700 1 -- 172.21.15.49:0/2804234808 >> v1:172.21.15.150:6789/0 conn(0x7f10e0071670 legacy=0x7f10e0163d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:52.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.253+0000 7f10e4a82700 1 -- 172.21.15.49:0/2804234808 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e00cefd0 con 0x7f10e0071220 2023-07-21T22:10:52.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.257+0000 7f10e4a82700 1 --2- 172.21.15.49:0/2804234808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e0071220 0x7f10e00cabe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009910 tx=0x7f10d0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a35815254a5aa6b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:52.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.257+0000 7f10d7fff700 1 -- 172.21.15.49:0/2804234808 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0005e50 con 0x7f10e0071220 2023-07-21T22:10:52.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.257+0000 7f10d7fff700 1 -- 172.21.15.49:0/2804234808 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0009e60 con 0x7f10e0071220 2023-07-21T22:10:52.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.257+0000 7f10d7fff700 1 -- 172.21.15.49:0/2804234808 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0004250 con 0x7f10e0071220 2023-07-21T22:10:52.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.257+0000 7f10e74e7700 1 -- 172.21.15.49:0/2804234808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e0071220 msgr2=0x7f10e00cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:52.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.257+0000 7f10e74e7700 1 --2- 172.21.15.49:0/2804234808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e0071220 0x7f10e00cabe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009910 tx=0x7f10d0009c20 comp rx=0 tx=0).stop 2023-07-21T22:10:52.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.257+0000 7f10e74e7700 1 -- 172.21.15.49:0/2804234808 shutdown_connections 2023-07-21T22:10:52.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.257+0000 7f10e74e7700 1 --2- 172.21.15.49:0/2804234808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e0071220 0x7f10e00cabe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.257+0000 7f10e74e7700 1 --2- 172.21.15.49:0/2804234808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10e0160110 0x7f10e00cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.257+0000 7f10e74e7700 1 -- 172.21.15.49:0/2804234808 >> 172.21.15.49:0/2804234808 conn(0x7f10e006e960 msgr2=0x7f10e006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:52.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.257+0000 7f10e74e7700 1 -- 172.21.15.49:0/2804234808 shutdown_connections 2023-07-21T22:10:52.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.257+0000 7f10e74e7700 1 -- 172.21.15.49:0/2804234808 wait complete. 2023-07-21T22:10:52.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.261+0000 7f10e74e7700 1 Processor -- start 2023-07-21T22:10:52.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.261+0000 7f10e74e7700 1 -- start start 2023-07-21T22:10:52.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e74e7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e0071220 0x7f10e01f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:52.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e74e7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10e0071670 0x7f10e01f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:52.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e74e7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10e0160110 0x7f10e014f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:52.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e74e7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00af060 con 0x7f10e0071220 2023-07-21T22:10:52.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e74e7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e01f59c0 con 0x7f10e0071670 2023-07-21T22:10:52.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e74e7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00b0b50 con 0x7f10e0160110 2023-07-21T22:10:52.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e5283700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e0071220 0x7f10e01f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:52.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e5283700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e0071220 0x7f10e01f4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59830/0 (socket says 172.21.15.49:59830) 2023-07-21T22:10:52.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e5283700 1 -- 172.21.15.49:0/2394236090 learned_addr learned my addr 172.21.15.49:0/2394236090 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:52.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e5a84700 1 --2- 172.21.15.49:0/2394236090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10e0160110 0x7f10e014f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:52.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e4a82700 1 --2- 172.21.15.49:0/2394236090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10e0071670 0x7f10e01f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:52.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e5283700 1 -- 172.21.15.49:0/2394236090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10e0160110 msgr2=0x7f10e014f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:52.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e5283700 1 --2- 172.21.15.49:0/2394236090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10e0160110 0x7f10e014f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e5283700 1 -- 172.21.15.49:0/2394236090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10e0071670 msgr2=0x7f10e01f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:52.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e5283700 1 --2- 172.21.15.49:0/2394236090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10e0071670 0x7f10e01f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e5283700 1 -- 172.21.15.49:0/2394236090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d0009520 con 0x7f10e0071220 2023-07-21T22:10:52.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e5283700 1 --2- 172.21.15.49:0/2394236090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e0071220 0x7f10e01f4f40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00d800 tx=0x7f10dc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:52.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10d5ffb700 1 -- 172.21.15.49:0/2394236090 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc0125f0 con 0x7f10e0071220 2023-07-21T22:10:52.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10d5ffb700 1 -- 172.21.15.49:0/2394236090 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc012750 con 0x7f10e0071220 2023-07-21T22:10:52.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e74e7700 1 -- 172.21.15.49:0/2394236090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e00ae6c0 con 0x7f10e0071220 2023-07-21T22:10:52.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10d5ffb700 1 -- 172.21.15.49:0/2394236090 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc012ac0 con 0x7f10e0071220 2023-07-21T22:10:52.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.265+0000 7f10e74e7700 1 -- 172.21.15.49:0/2394236090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e00aec80 con 0x7f10e0071220 2023-07-21T22:10:52.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.269+0000 7f10e74e7700 1 -- 172.21.15.49:0/2394236090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e00af2d0 con 0x7f10e0071220 2023-07-21T22:10:52.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.269+0000 7f10d5ffb700 1 -- 172.21.15.49:0/2394236090 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10dc012c20 con 0x7f10e0071220 2023-07-21T22:10:52.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.269+0000 7f10d5ffb700 1 --2- 172.21.15.49:0/2394236090 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10c40662f0 0x7f10c40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:52.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.269+0000 7f10d5ffb700 1 -- 172.21.15.49:0/2394236090 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f10dc083fc0 con 0x7f10e0071220 2023-07-21T22:10:52.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.269+0000 7f10e4a82700 1 --2- 172.21.15.49:0/2394236090 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10c40662f0 0x7f10c40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:52.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.273+0000 7f10e4a82700 1 --2- 172.21.15.49:0/2394236090 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10c40662f0 0x7f10c40687a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10d0000c00 tx=0x7f10d0008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:52.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.277+0000 7f10d5ffb700 1 -- 172.21.15.49:0/2394236090 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f10dc0b4700 con 0x7f10e0071220 2023-07-21T22:10:52.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.453+0000 7f10e74e7700 1 -- 172.21.15.49:0/2394236090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f10e006f260 con 0x7f10e0071220 2023-07-21T22:10:52.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.453+0000 7f10d5ffb700 1 -- 172.21.15.49:0/2394236090 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f10dc051160 con 0x7f10e0071220 2023-07-21T22:10:52.496 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:10:52.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.457+0000 7f10e74e7700 1 -- 172.21.15.49:0/2394236090 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10c40662f0 msgr2=0x7f10c40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:52.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.457+0000 7f10e74e7700 1 --2- 172.21.15.49:0/2394236090 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10c40662f0 0x7f10c40687a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10d0000c00 tx=0x7f10d0008070 comp rx=0 tx=0).stop 2023-07-21T22:10:52.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.457+0000 7f10e74e7700 1 -- 172.21.15.49:0/2394236090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e0071220 msgr2=0x7f10e01f4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:52.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.457+0000 7f10e74e7700 1 --2- 172.21.15.49:0/2394236090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e0071220 0x7f10e01f4f40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00d800 tx=0x7f10dc00db10 comp rx=0 tx=0).stop 2023-07-21T22:10:52.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.457+0000 7f10e74e7700 1 -- 172.21.15.49:0/2394236090 shutdown_connections 2023-07-21T22:10:52.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.457+0000 7f10e74e7700 1 --2- 172.21.15.49:0/2394236090 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10c40662f0 0x7f10c40687a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.457+0000 7f10e74e7700 1 --2- 172.21.15.49:0/2394236090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10e0160110 0x7f10e014f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.457+0000 7f10e74e7700 1 --2- 172.21.15.49:0/2394236090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10e0071670 0x7f10e01f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.457+0000 7f10e74e7700 1 --2- 172.21.15.49:0/2394236090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e0071220 0x7f10e01f4f40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.457+0000 7f10e74e7700 1 -- 172.21.15.49:0/2394236090 >> 172.21.15.49:0/2394236090 conn(0x7f10e006e960 msgr2=0x7f10e015f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:52.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.457+0000 7f10e74e7700 1 -- 172.21.15.49:0/2394236090 shutdown_connections 2023-07-21T22:10:52.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.457+0000 7f10e74e7700 1 -- 172.21.15.49:0/2394236090 wait complete. 2023-07-21T22:10:52.519 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:10:52.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.661+0000 7f60696d5700 1 Processor -- start 2023-07-21T22:10:52.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.661+0000 7f60696d5700 1 -- start start 2023-07-21T22:10:52.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.661+0000 7f60696d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f606406d380 0x7f606406d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:52.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.661+0000 7f60696d5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f60640cafb0 0x7f60640cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:52.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.661+0000 7f60696d5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60640cb940 con 0x7f6064071c70 2023-07-21T22:10:52.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.661+0000 7f60696d5700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60640c9e80 con 0x7f60640cafb0 2023-07-21T22:10:52.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.661+0000 7f60696d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60640afeb0 con 0x7f606406d380 2023-07-21T22:10:52.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.661+0000 7f6068ed4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f60640cafb0 0x7f60640cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:52.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f6068ed4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f60640cafb0 0x7f60640cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59838/0 (socket says 172.21.15.49:59838) 2023-07-21T22:10:52.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f6068ed4700 1 -- 172.21.15.49:0/1255492123 learned_addr learned my addr 172.21.15.49:0/1255492123 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:52.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f605bfff700 1 --1- 172.21.15.49:0/1255492123 >> v1:172.21.15.49:6789/0 conn(0x7f6064071c70 0x7f60640b0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46966/0 (socket says 172.21.15.49:46966) 2023-07-21T22:10:52.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f6063fff700 1 --2- 172.21.15.49:0/1255492123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f606406d380 0x7f606406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:52.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f6068ed4700 1 -- 172.21.15.49:0/1255492123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f606406d380 msgr2=0x7f606406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:52.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f6068ed4700 1 --2- 172.21.15.49:0/1255492123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f606406d380 0x7f606406d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f6068ed4700 1 -- 172.21.15.49:0/1255492123 >> v1:172.21.15.49:6789/0 conn(0x7f6064071c70 legacy=0x7f60640b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:52.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f6068ed4700 1 -- 172.21.15.49:0/1255492123 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60640cab20 con 0x7f60640cafb0 2023-07-21T22:10:52.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f6068ed4700 1 --2- 172.21.15.49:0/1255492123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60640cafb0 0x7f60640cb400 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f605c009e50 tx=0x7f605c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f1b4d86f69ced1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:52.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f60637fe700 1 -- 172.21.15.49:0/1255492123 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c00e070 con 0x7f60640cafb0 2023-07-21T22:10:52.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f60637fe700 1 -- 172.21.15.49:0/1255492123 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c00b910 con 0x7f60640cafb0 2023-07-21T22:10:52.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f60637fe700 1 -- 172.21.15.49:0/1255492123 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c00bcc0 con 0x7f60640cafb0 2023-07-21T22:10:52.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f60696d5700 1 -- 172.21.15.49:0/1255492123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60640cafb0 msgr2=0x7f60640cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:52.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f60696d5700 1 --2- 172.21.15.49:0/1255492123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60640cafb0 0x7f60640cb400 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f605c009e50 tx=0x7f605c00b330 comp rx=0 tx=0).stop 2023-07-21T22:10:52.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f60696d5700 1 -- 172.21.15.49:0/1255492123 shutdown_connections 2023-07-21T22:10:52.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f60696d5700 1 --2- 172.21.15.49:0/1255492123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60640cafb0 0x7f60640cb400 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f60696d5700 1 --2- 172.21.15.49:0/1255492123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f606406d380 0x7f606406d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f60696d5700 1 -- 172.21.15.49:0/1255492123 >> 172.21.15.49:0/1255492123 conn(0x7f6064070450 msgr2=0x7f6064070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:52.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f60696d5700 1 -- 172.21.15.49:0/1255492123 shutdown_connections 2023-07-21T22:10:52.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.665+0000 7f60696d5700 1 -- 172.21.15.49:0/1255492123 wait complete. 2023-07-21T22:10:52.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.669+0000 7f60696d5700 1 Processor -- start 2023-07-21T22:10:52.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.669+0000 7f60696d5700 1 -- start start 2023-07-21T22:10:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f60696d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f606406d380 0x7f606414e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f60696d5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6064071c70 0x7f60640a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f60696d5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60640cafb0 0x7f60641f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:52.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f60696d5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60640cbd90 con 0x7f60640cafb0 2023-07-21T22:10:52.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f60696d5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60640a9aa0 con 0x7f6064071c70 2023-07-21T22:10:52.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f60696d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60640cc5f0 con 0x7f606406d380 2023-07-21T22:10:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f6068ed4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60640cafb0 0x7f60641f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f6068ed4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60640cafb0 0x7f60641f4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59854/0 (socket says 172.21.15.49:59854) 2023-07-21T22:10:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f6068ed4700 1 -- 172.21.15.49:0/3794272758 learned_addr learned my addr 172.21.15.49:0/3794272758 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f605bfff700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6064071c70 0x7f60640a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f6063fff700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f606406d380 0x7f606414e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f6068ed4700 1 -- 172.21.15.49:0/3794272758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f606406d380 msgr2=0x7f606414e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f6068ed4700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f606406d380 0x7f606414e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f6068ed4700 1 -- 172.21.15.49:0/3794272758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6064071c70 msgr2=0x7f60640a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f6068ed4700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6064071c70 0x7f60640a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f6068ed4700 1 -- 172.21.15.49:0/3794272758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c009b30 con 0x7f60640cafb0 2023-07-21T22:10:52.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f605bfff700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6064071c70 0x7f60640a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:52.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f6068ed4700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60640cafb0 0x7f60641f4430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f606406afa0 tx=0x7f605c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:52.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f60617fa700 1 -- 172.21.15.49:0/3794272758 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c0048b0 con 0x7f60640cafb0 2023-07-21T22:10:52.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f60617fa700 1 -- 172.21.15.49:0/3794272758 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c0099b0 con 0x7f60640cafb0 2023-07-21T22:10:52.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f60696d5700 1 -- 172.21.15.49:0/3794272758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60640a79a0 con 0x7f60640cafb0 2023-07-21T22:10:52.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f60617fa700 1 -- 172.21.15.49:0/3794272758 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c01c650 con 0x7f60640cafb0 2023-07-21T22:10:52.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f60696d5700 1 -- 172.21.15.49:0/3794272758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60640cc280 con 0x7f60640cafb0 2023-07-21T22:10:52.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.673+0000 7f60696d5700 1 -- 172.21.15.49:0/3794272758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60640cc760 con 0x7f60640cafb0 2023-07-21T22:10:52.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.677+0000 7f60617fa700 1 -- 172.21.15.49:0/3794272758 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f605c01c7b0 con 0x7f60640cafb0 2023-07-21T22:10:52.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.677+0000 7f60617fa700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f60480662f0 0x7f60480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:52.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.677+0000 7f60617fa700 1 -- 172.21.15.49:0/3794272758 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f605c085140 con 0x7f60640cafb0 2023-07-21T22:10:52.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.677+0000 7f6063fff700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f60480662f0 0x7f60480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:52.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.681+0000 7f6063fff700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f60480662f0 0x7f60480687a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f606406a7f0 tx=0x7f6054009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:52.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.681+0000 7f60617fa700 1 -- 172.21.15.49:0/3794272758 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f605c0522c0 con 0x7f60640cafb0 2023-07-21T22:10:52.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.869+0000 7f60696d5700 1 -- 172.21.15.49:0/3794272758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f606404dcb0 con 0x7f60640cafb0 2023-07-21T22:10:52.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.869+0000 7f60617fa700 1 -- 172.21.15.49:0/3794272758 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f605c0558e0 con 0x7f60640cafb0 2023-07-21T22:10:52.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.869+0000 7f60696d5700 1 -- 172.21.15.49:0/3794272758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f60480662f0 msgr2=0x7f60480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:52.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.869+0000 7f60696d5700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f60480662f0 0x7f60480687a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f606406a7f0 tx=0x7f6054009240 comp rx=0 tx=0).stop 2023-07-21T22:10:52.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.869+0000 7f60696d5700 1 -- 172.21.15.49:0/3794272758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60640cafb0 msgr2=0x7f60641f4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:52.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.869+0000 7f60696d5700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60640cafb0 0x7f60641f4430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f606406afa0 tx=0x7f605c004af0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.869+0000 7f60696d5700 1 -- 172.21.15.49:0/3794272758 shutdown_connections 2023-07-21T22:10:52.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.869+0000 7f60696d5700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f60480662f0 0x7f60480687a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.869+0000 7f60696d5700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60640cafb0 0x7f60641f4430 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.869+0000 7f60696d5700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6064071c70 0x7f60640a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.869+0000 7f60696d5700 1 --2- 172.21.15.49:0/3794272758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f606406d380 0x7f606414e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:52.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.869+0000 7f60696d5700 1 -- 172.21.15.49:0/3794272758 >> 172.21.15.49:0/3794272758 conn(0x7f6064070450 msgr2=0x7f606415bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:52.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.869+0000 7f60696d5700 1 -- 172.21.15.49:0/3794272758 shutdown_connections 2023-07-21T22:10:52.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:52.873+0000 7f60696d5700 1 -- 172.21.15.49:0/3794272758 wait complete. 2023-07-21T22:10:52.917 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:10:52.935 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2023-07-21T22:10:52.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:52.936 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-07-21T22:10:52.980 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[39354]: fuse finished with error 0 and tester_r 0 2023-07-21T22:10:52.984 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:10:59.087 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:10:59.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:10:59.089 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-07-21T22:10:59.127 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:10:59.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.321+0000 7f0fb1f88700 1 Processor -- start 2023-07-21T22:10:59.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.321+0000 7f0fb1f88700 1 -- start start 2023-07-21T22:10:59.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0fb1f88700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0fac06d540 0x7f0fac0cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:59.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0fb1f88700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0fac159c30 0x7f0fac0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:59.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0fb1f88700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac06c780 con 0x7f0fac070600 2023-07-21T22:10:59.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0fb1f88700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac06ca60 con 0x7f0fac06d540 2023-07-21T22:10:59.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0fb1f88700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac06cd40 con 0x7f0fac159c30 2023-07-21T22:10:59.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0fab7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0fac070600 0x7f0fac0709d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57622/0 (socket says 172.21.15.49:57622) 2023-07-21T22:10:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0fab7fe700 1 -- 172.21.15.49:0/2392198658 learned_addr learned my addr 172.21.15.49:0/2392198658 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0fa2ffd700 1 --2- 172.21.15.49:0/2392198658 >> v2:172.21.15.49:3300/0 conn(0x7f0fac06d540 0x7f0fac0cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0fabfff700 1 --2- 172.21.15.49:0/2392198658 >> v2:172.21.15.150:3300/0 conn(0x7f0fac159c30 0x7f0fac0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0faaffd700 1 -- 172.21.15.49:0/2392198658 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050362841 0 0) 0x7f0fac06c780 con 0x7f0fac070600 2023-07-21T22:10:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0faaffd700 1 -- 172.21.15.49:0/2392198658 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f980035d0 con 0x7f0fac070600 2023-07-21T22:10:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0fa2ffd700 1 -- 172.21.15.49:0/2392198658 >> v2:172.21.15.150:3300/0 conn(0x7f0fac159c30 msgr2=0x7f0fac0c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0fa2ffd700 1 --2- 172.21.15.49:0/2392198658 >> v2:172.21.15.150:3300/0 conn(0x7f0fac159c30 0x7f0fac0c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0fa2ffd700 1 -- 172.21.15.49:0/2392198658 >> v1:172.21.15.49:6789/0 conn(0x7f0fac070600 legacy=0x7f0fac0709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0fa2ffd700 1 -- 172.21.15.49:0/2392198658 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac06d020 con 0x7f0fac06d540 2023-07-21T22:10:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0fa2ffd700 1 --2- 172.21.15.49:0/2392198658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fac06d540 0x7f0fac0cb5d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fac06bf00 tx=0x7f0f94009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3150458e54ccbc93 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0faaffd700 1 -- 172.21.15.49:0/2392198658 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94011830 con 0x7f0fac06d540 2023-07-21T22:10:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0faaffd700 1 -- 172.21.15.49:0/2392198658 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f94011990 con 0x7f0fac06d540 2023-07-21T22:10:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.325+0000 7f0faaffd700 1 -- 172.21.15.49:0/2392198658 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94011d20 con 0x7f0fac06d540 2023-07-21T22:10:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.329+0000 7f0fb1f88700 1 -- 172.21.15.49:0/2392198658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fac06d540 msgr2=0x7f0fac0cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:59.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.329+0000 7f0fb1f88700 1 --2- 172.21.15.49:0/2392198658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fac06d540 0x7f0fac0cb5d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fac06bf00 tx=0x7f0f94009b30 comp rx=0 tx=0).stop 2023-07-21T22:10:59.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.329+0000 7f0fb1f88700 1 -- 172.21.15.49:0/2392198658 shutdown_connections 2023-07-21T22:10:59.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.329+0000 7f0fb1f88700 1 --2- 172.21.15.49:0/2392198658 >> v2:172.21.15.150:3300/0 conn(0x7f0fac159c30 0x7f0fac0c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.329+0000 7f0fb1f88700 1 --2- 172.21.15.49:0/2392198658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fac06d540 0x7f0fac0cb5d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.329+0000 7f0fb1f88700 1 -- 172.21.15.49:0/2392198658 >> 172.21.15.49:0/2392198658 conn(0x7f0fac06f5a0 msgr2=0x7f0fac0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:59.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.329+0000 7f0fb1f88700 1 -- 172.21.15.49:0/2392198658 shutdown_connections 2023-07-21T22:10:59.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.329+0000 7f0fb1f88700 1 -- 172.21.15.49:0/2392198658 wait complete. 2023-07-21T22:10:59.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.333+0000 7f0fb1f88700 1 Processor -- start 2023-07-21T22:10:59.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.333+0000 7f0fb1f88700 1 -- start start 2023-07-21T22:10:59.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.333+0000 7f0fb1f88700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fac06d540 0x7f0fac0cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:59.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.333+0000 7f0fb1f88700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fac070600 0x7f0fac147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:59.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.333+0000 7f0fb1f88700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fac159c30 0x7f0fac0b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:59.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.333+0000 7f0fb1f88700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0ccf00 con 0x7f0fac06d540 2023-07-21T22:10:59.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.333+0000 7f0fb1f88700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0cd130 con 0x7f0fac070600 2023-07-21T22:10:59.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.333+0000 7f0fb1f88700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0cd410 con 0x7f0fac159c30 2023-07-21T22:10:59.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fab7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fac06d540 0x7f0fac0cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:59.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fab7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fac06d540 0x7f0fac0cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46442/0 (socket says 172.21.15.49:46442) 2023-07-21T22:10:59.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fab7fe700 1 -- 172.21.15.49:0/475464605 learned_addr learned my addr 172.21.15.49:0/475464605 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:59.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fabfff700 1 --2- 172.21.15.49:0/475464605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fac159c30 0x7f0fac0b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:59.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fa2ffd700 1 --2- 172.21.15.49:0/475464605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fac070600 0x7f0fac147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:59.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fab7fe700 1 -- 172.21.15.49:0/475464605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fac159c30 msgr2=0x7f0fac0b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fab7fe700 1 --2- 172.21.15.49:0/475464605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fac159c30 0x7f0fac0b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fab7fe700 1 -- 172.21.15.49:0/475464605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fac070600 msgr2=0x7f0fac147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fab7fe700 1 --2- 172.21.15.49:0/475464605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fac070600 0x7f0fac147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fab7fe700 1 -- 172.21.15.49:0/475464605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f940094b0 con 0x7f0fac06d540 2023-07-21T22:10:59.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fab7fe700 1 --2- 172.21.15.49:0/475464605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fac06d540 0x7f0fac0cdef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00c700 tx=0x7f0f9c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:59.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fa8ff9700 1 -- 172.21.15.49:0/475464605 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c005d90 con 0x7f0fac06d540 2023-07-21T22:10:59.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fa8ff9700 1 -- 172.21.15.49:0/475464605 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c0070d0 con 0x7f0fac06d540 2023-07-21T22:10:59.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fb1f88700 1 -- 172.21.15.49:0/475464605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fac0cd6f0 con 0x7f0fac06d540 2023-07-21T22:10:59.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fa8ff9700 1 -- 172.21.15.49:0/475464605 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c007480 con 0x7f0fac06d540 2023-07-21T22:10:59.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fb1f88700 1 -- 172.21.15.49:0/475464605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac0b3a00 con 0x7f0fac06d540 2023-07-21T22:10:59.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.337+0000 7f0fb1f88700 1 -- 172.21.15.49:0/475464605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac0cdc10 con 0x7f0fac06d540 2023-07-21T22:10:59.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.341+0000 7f0fa8ff9700 1 -- 172.21.15.49:0/475464605 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0f9c0075e0 con 0x7f0fac06d540 2023-07-21T22:10:59.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.341+0000 7f0fa8ff9700 1 --2- 172.21.15.49:0/475464605 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0f8c0662f0 0x7f0f8c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:59.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.341+0000 7f0fa8ff9700 1 -- 172.21.15.49:0/475464605 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0f9c083530 con 0x7f0fac06d540 2023-07-21T22:10:59.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.345+0000 7f0fa2ffd700 1 --2- 172.21.15.49:0/475464605 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0f8c0662f0 0x7f0f8c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:59.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.345+0000 7f0fa2ffd700 1 --2- 172.21.15.49:0/475464605 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0f8c0662f0 0x7f0f8c0687a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0f94000c00 tx=0x7f0f94008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:59.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.349+0000 7f0fa8ff9700 1 -- 172.21.15.49:0/475464605 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0fac0cdc10 con 0x7f0fac06d540 2023-07-21T22:10:59.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.533+0000 7f0fb1f88700 1 -- 172.21.15.49:0/475464605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fac0cdc10 con 0x7f0fac06d540 2023-07-21T22:10:59.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.537+0000 7f0fa8ff9700 1 -- 172.21.15.49:0/475464605 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f0fac0cdc10 con 0x7f0fac06d540 2023-07-21T22:10:59.581 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:59.581 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:39.728219+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:10:59.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.541+0000 7f0fb1f88700 1 -- 172.21.15.49:0/475464605 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0f8c0662f0 msgr2=0x7f0f8c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:59.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.541+0000 7f0fb1f88700 1 --2- 172.21.15.49:0/475464605 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0f8c0662f0 0x7f0f8c0687a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0f94000c00 tx=0x7f0f94008030 comp rx=0 tx=0).stop 2023-07-21T22:10:59.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.541+0000 7f0fb1f88700 1 -- 172.21.15.49:0/475464605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fac06d540 msgr2=0x7f0fac0cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:59.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.541+0000 7f0fb1f88700 1 --2- 172.21.15.49:0/475464605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fac06d540 0x7f0fac0cdef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00c700 tx=0x7f0f9c00ca10 comp rx=0 tx=0).stop 2023-07-21T22:10:59.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.541+0000 7f0fb1f88700 1 -- 172.21.15.49:0/475464605 shutdown_connections 2023-07-21T22:10:59.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.541+0000 7f0fb1f88700 1 --2- 172.21.15.49:0/475464605 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0f8c0662f0 0x7f0f8c0687a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.541+0000 7f0fb1f88700 1 --2- 172.21.15.49:0/475464605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fac159c30 0x7f0fac0b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.541+0000 7f0fb1f88700 1 --2- 172.21.15.49:0/475464605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fac070600 0x7f0fac147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.541+0000 7f0fb1f88700 1 --2- 172.21.15.49:0/475464605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fac06d540 0x7f0fac0cdef0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.541+0000 7f0fb1f88700 1 -- 172.21.15.49:0/475464605 >> 172.21.15.49:0/475464605 conn(0x7f0fac06f5a0 msgr2=0x7f0fac1574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.541+0000 7f0fb1f88700 1 -- 172.21.15.49:0/475464605 shutdown_connections 2023-07-21T22:10:59.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.541+0000 7f0fb1f88700 1 -- 172.21.15.49:0/475464605 wait complete. 2023-07-21T22:10:59.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:10:59.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.741+0000 7f534927d700 1 Processor -- start 2023-07-21T22:10:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.741+0000 7f534927d700 1 -- start start 2023-07-21T22:10:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.745+0000 7f534927d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53440d1e40 0x7f53440b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.745+0000 7f534927d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f53440cee10 0x7f53440cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.745+0000 7f534927d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53440b3e80 con 0x7f53440b7af0 2023-07-21T22:10:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.745+0000 7f534927d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53440cf7d0 con 0x7f53440cee10 2023-07-21T22:10:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.745+0000 7f534927d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534415fd40 con 0x7f53440d1e40 2023-07-21T22:10:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.745+0000 7f5343fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f53440b7af0 0x7f534415f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57636/0 (socket says 172.21.15.49:57636) 2023-07-21T22:10:59.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.745+0000 7f5343fff700 1 -- 172.21.15.49:0/2639987669 learned_addr learned my addr 172.21.15.49:0/2639987669 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:10:59.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.745+0000 7f53437fe700 1 --2- 172.21.15.49:0/2639987669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53440d1e40 0x7f53440b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:59.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.745+0000 7f5348a7c700 1 --2- 172.21.15.49:0/2639987669 >> v2:172.21.15.150:3300/0 conn(0x7f53440cee10 0x7f53440cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:59.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.745+0000 7f53437fe700 1 -- 172.21.15.49:0/2639987669 >> v2:172.21.15.150:3300/0 conn(0x7f53440cee10 msgr2=0x7f53440cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:10:59.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.745+0000 7f53437fe700 1 --2- 172.21.15.49:0/2639987669 >> v2:172.21.15.150:3300/0 conn(0x7f53440cee10 0x7f53440cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.745+0000 7f53437fe700 1 -- 172.21.15.49:0/2639987669 >> v1:172.21.15.49:6789/0 conn(0x7f53440b7af0 legacy=0x7f534415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:59.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.745+0000 7f53437fe700 1 -- 172.21.15.49:0/2639987669 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53440cea00 con 0x7f53440d1e40 2023-07-21T22:10:59.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.745+0000 7f53437fe700 1 --2- 172.21.15.49:0/2639987669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53440d1e40 0x7f53440b1630 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5338009850 tx=0x7f5338009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3d8a8b63af9a275 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:59.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.749+0000 7f5342ffd700 1 -- 172.21.15.49:0/2639987669 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338011830 con 0x7f53440d1e40 2023-07-21T22:10:59.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.749+0000 7f5342ffd700 1 -- 172.21.15.49:0/2639987669 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5338011990 con 0x7f53440d1e40 2023-07-21T22:10:59.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.749+0000 7f5342ffd700 1 -- 172.21.15.49:0/2639987669 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338011d40 con 0x7f53440d1e40 2023-07-21T22:10:59.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.749+0000 7f534927d700 1 -- 172.21.15.49:0/2639987669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53440d1e40 msgr2=0x7f53440b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:59.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.749+0000 7f534927d700 1 --2- 172.21.15.49:0/2639987669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53440d1e40 0x7f53440b1630 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5338009850 tx=0x7f5338009b60 comp rx=0 tx=0).stop 2023-07-21T22:10:59.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.749+0000 7f534927d700 1 -- 172.21.15.49:0/2639987669 shutdown_connections 2023-07-21T22:10:59.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.749+0000 7f534927d700 1 --2- 172.21.15.49:0/2639987669 >> v2:172.21.15.150:3300/0 conn(0x7f53440cee10 0x7f53440cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.749+0000 7f534927d700 1 --2- 172.21.15.49:0/2639987669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53440d1e40 0x7f53440b1630 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.749+0000 7f534927d700 1 -- 172.21.15.49:0/2639987669 >> 172.21.15.49:0/2639987669 conn(0x7f534406e960 msgr2=0x7f534406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:59.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.749+0000 7f534927d700 1 -- 172.21.15.49:0/2639987669 shutdown_connections 2023-07-21T22:10:59.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.749+0000 7f534927d700 1 -- 172.21.15.49:0/2639987669 wait complete. 2023-07-21T22:10:59.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.753+0000 7f534927d700 1 Processor -- start 2023-07-21T22:10:59.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.753+0000 7f534927d700 1 -- start start 2023-07-21T22:10:59.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.753+0000 7f534927d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53440b7af0 0x7f53440c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:59.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f534927d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53440cee10 0x7f53440b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:59.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f534927d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53440d1e40 0x7f53440b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:59.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f534927d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53440c79b0 con 0x7f53440b7af0 2023-07-21T22:10:59.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f534927d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53440c6460 con 0x7f53440d1e40 2023-07-21T22:10:59.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f534927d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53440c66b0 con 0x7f53440cee10 2023-07-21T22:10:59.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f5343fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53440b7af0 0x7f53440c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:59.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f5343fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53440b7af0 0x7f53440c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46448/0 (socket says 172.21.15.49:46448) 2023-07-21T22:10:59.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f5343fff700 1 -- 172.21.15.49:0/4053697168 learned_addr learned my addr 172.21.15.49:0/4053697168 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:10:59.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f5348a7c700 1 --2- 172.21.15.49:0/4053697168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53440d1e40 0x7f53440b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:59.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f53437fe700 1 --2- 172.21.15.49:0/4053697168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53440cee10 0x7f53440b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:59.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f5343fff700 1 -- 172.21.15.49:0/4053697168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53440cee10 msgr2=0x7f53440b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:59.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f5343fff700 1 --2- 172.21.15.49:0/4053697168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53440cee10 0x7f53440b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f5343fff700 1 -- 172.21.15.49:0/4053697168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53440d1e40 msgr2=0x7f53440b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:59.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f5343fff700 1 --2- 172.21.15.49:0/4053697168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53440d1e40 0x7f53440b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f5343fff700 1 -- 172.21.15.49:0/4053697168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53380094b0 con 0x7f53440b7af0 2023-07-21T22:10:59.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f5343fff700 1 --2- 172.21.15.49:0/4053697168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53440b7af0 0x7f53440c7470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f533400c700 tx=0x7f533400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:59.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f5340ff9700 1 -- 172.21.15.49:0/4053697168 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334005d90 con 0x7f53440b7af0 2023-07-21T22:10:59.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f5340ff9700 1 -- 172.21.15.49:0/4053697168 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53340070d0 con 0x7f53440b7af0 2023-07-21T22:10:59.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f5340ff9700 1 -- 172.21.15.49:0/4053697168 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334007440 con 0x7f53440b7af0 2023-07-21T22:10:59.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f534927d700 1 -- 172.21.15.49:0/4053697168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53440c6990 con 0x7f53440b7af0 2023-07-21T22:10:59.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.757+0000 7f534927d700 1 -- 172.21.15.49:0/4053697168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53440c6f50 con 0x7f53440b7af0 2023-07-21T22:10:59.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.761+0000 7f534927d700 1 -- 172.21.15.49:0/4053697168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53440c8dd0 con 0x7f53440b7af0 2023-07-21T22:10:59.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.761+0000 7f5340ff9700 1 -- 172.21.15.49:0/4053697168 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f53340075a0 con 0x7f53440b7af0 2023-07-21T22:10:59.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.761+0000 7f5340ff9700 1 --2- 172.21.15.49:0/4053697168 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f53300662f0 0x7f53300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:59.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.761+0000 7f5340ff9700 1 -- 172.21.15.49:0/4053697168 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f53340834f0 con 0x7f53440b7af0 2023-07-21T22:10:59.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.761+0000 7f53437fe700 1 --2- 172.21.15.49:0/4053697168 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f53300662f0 0x7f53300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:59.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.765+0000 7f53437fe700 1 --2- 172.21.15.49:0/4053697168 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f53300662f0 0x7f53300687a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f53380090b0 tx=0x7f5338008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:59.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.769+0000 7f5340ff9700 1 -- 172.21.15.49:0/4053697168 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f53340506a0 con 0x7f53440b7af0 2023-07-21T22:10:59.841 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:10:59.850 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:10:59.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.945+0000 7f534927d700 1 -- 172.21.15.49:0/4053697168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53440ccb70 con 0x7f53440b7af0 2023-07-21T22:10:59.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.949+0000 7f5340ff9700 1 -- 172.21.15.49:0/4053697168 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f5334053cc0 con 0x7f53440b7af0 2023-07-21T22:10:59.994 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:10:59.994 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:39.728219+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:10:59.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.953+0000 7f534927d700 1 -- 172.21.15.49:0/4053697168 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f53300662f0 msgr2=0x7f53300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:59.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.953+0000 7f534927d700 1 --2- 172.21.15.49:0/4053697168 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f53300662f0 0x7f53300687a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f53380090b0 tx=0x7f5338008030 comp rx=0 tx=0).stop 2023-07-21T22:10:59.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.953+0000 7f534927d700 1 -- 172.21.15.49:0/4053697168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53440b7af0 msgr2=0x7f53440c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:59.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.953+0000 7f534927d700 1 --2- 172.21.15.49:0/4053697168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53440b7af0 0x7f53440c7470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f533400c700 tx=0x7f533400cac0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.953+0000 7f534927d700 1 -- 172.21.15.49:0/4053697168 shutdown_connections 2023-07-21T22:10:59.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.953+0000 7f534927d700 1 --2- 172.21.15.49:0/4053697168 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f53300662f0 0x7f53300687a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.953+0000 7f534927d700 1 --2- 172.21.15.49:0/4053697168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53440d1e40 0x7f53440b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.953+0000 7f534927d700 1 --2- 172.21.15.49:0/4053697168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53440cee10 0x7f53440b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.953+0000 7f534927d700 1 --2- 172.21.15.49:0/4053697168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53440b7af0 0x7f53440c7470 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:59.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.953+0000 7f534927d700 1 -- 172.21.15.49:0/4053697168 >> 172.21.15.49:0/4053697168 conn(0x7f534406e960 msgr2=0x7f534415b470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:59.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.953+0000 7f534927d700 1 -- 172.21.15.49:0/4053697168 shutdown_connections 2023-07-21T22:10:59.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:10:59.953+0000 7f534927d700 1 -- 172.21.15.49:0/4053697168 wait complete. 2023-07-21T22:11:00.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:11:00.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.157+0000 7fdc26e48700 1 Processor -- start 2023-07-21T22:11:00.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.157+0000 7fdc26e48700 1 -- start start 2023-07-21T22:11:00.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc26e48700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdc200ccc70 0x7fdc200cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:00.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc26e48700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc200ca8f0 con 0x7fdc200cde70 2023-07-21T22:11:00.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc26e48700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc200cab40 con 0x7fdc200b1900 2023-07-21T22:11:00.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc26e48700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc200d1240 con 0x7fdc200ccc70 2023-07-21T22:11:00.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc26647700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdc200cde70 0x7fdc200ce2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57652/0 (socket says 172.21.15.49:57652) 2023-07-21T22:11:00.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc26647700 1 -- 172.21.15.49:0/479607020 learned_addr learned my addr 172.21.15.49:0/479607020 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:00.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc25645700 1 --2- 172.21.15.49:0/479607020 >> v2:172.21.15.150:3300/0 conn(0x7fdc200ccc70 0x7fdc200cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:00.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc24e44700 1 -- 172.21.15.49:0/479607020 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536815954 0 0) 0x7fdc200ca8f0 con 0x7fdc200cde70 2023-07-21T22:11:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc24e44700 1 -- 172.21.15.49:0/479607020 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc0c0035d0 con 0x7fdc200cde70 2023-07-21T22:11:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc24e44700 1 -- 172.21.15.49:0/479607020 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3385007930 0 0) 0x7fdc200cab40 con 0x7fdc200b1900 2023-07-21T22:11:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc24e44700 1 -- 172.21.15.49:0/479607020 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc200ca8f0 con 0x7fdc200b1900 2023-07-21T22:11:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc25645700 1 -- 172.21.15.49:0/479607020 >> v1:172.21.15.150:6789/0 conn(0x7fdc200b1900 legacy=0x7fdc200b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc25645700 1 -- 172.21.15.49:0/479607020 >> v1:172.21.15.49:6789/0 conn(0x7fdc200cde70 legacy=0x7fdc200ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc25645700 1 -- 172.21.15.49:0/479607020 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc200cae20 con 0x7fdc200ccc70 2023-07-21T22:11:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc25645700 1 --2- 172.21.15.49:0/479607020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc200ccc70 0x7fdc200cfcc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009850 tx=0x7fdc10009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a454e36f70ee827c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.161+0000 7fdc24e44700 1 -- 172.21.15.49:0/479607020 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10011830 con 0x7fdc200ccc70 2023-07-21T22:11:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.165+0000 7fdc24e44700 1 -- 172.21.15.49:0/479607020 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc10011990 con 0x7fdc200ccc70 2023-07-21T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.165+0000 7fdc24e44700 1 -- 172.21.15.49:0/479607020 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10011d40 con 0x7fdc200ccc70 2023-07-21T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.165+0000 7fdc26e48700 1 -- 172.21.15.49:0/479607020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc200ccc70 msgr2=0x7fdc200cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.165+0000 7fdc26e48700 1 --2- 172.21.15.49:0/479607020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc200ccc70 0x7fdc200cfcc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009850 tx=0x7fdc10009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.165+0000 7fdc26e48700 1 -- 172.21.15.49:0/479607020 shutdown_connections 2023-07-21T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.165+0000 7fdc26e48700 1 --2- 172.21.15.49:0/479607020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc200ccc70 0x7fdc200cfcc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:00.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.165+0000 7fdc26e48700 1 -- 172.21.15.49:0/479607020 >> 172.21.15.49:0/479607020 conn(0x7fdc200995e0 msgr2=0x7fdc200d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:00.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.165+0000 7fdc26e48700 1 -- 172.21.15.49:0/479607020 shutdown_connections 2023-07-21T22:11:00.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.165+0000 7fdc26e48700 1 -- 172.21.15.49:0/479607020 wait complete. 2023-07-21T22:11:00.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.165+0000 7fdc26e48700 1 Processor -- start 2023-07-21T22:11:00.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.165+0000 7fdc26e48700 1 -- start start 2023-07-21T22:11:00.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc26e48700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc200b1900 0x7fdc201587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:00.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc26e48700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc200ccc70 0x7fdc200ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:00.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc26e48700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc200cde70 0x7fdc2015c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:00.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc26e48700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc20158ce0 con 0x7fdc200b1900 2023-07-21T22:11:00.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc26e48700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2015d1d0 con 0x7fdc200ccc70 2023-07-21T22:11:00.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc26e48700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc201579e0 con 0x7fdc200cde70 2023-07-21T22:11:00.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc25e46700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc200b1900 0x7fdc201587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:00.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc25e46700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc200b1900 0x7fdc201587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46462/0 (socket says 172.21.15.49:46462) 2023-07-21T22:11:00.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc25e46700 1 -- 172.21.15.49:0/2926782071 learned_addr learned my addr 172.21.15.49:0/2926782071 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:00.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc25645700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc200ccc70 0x7fdc200ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:00.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc26647700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc200cde70 0x7fdc2015c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:00.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc25e46700 1 -- 172.21.15.49:0/2926782071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc200cde70 msgr2=0x7fdc2015c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:00.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc25e46700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc200cde70 0x7fdc2015c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:00.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc25e46700 1 -- 172.21.15.49:0/2926782071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc200ccc70 msgr2=0x7fdc200ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:00.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc25e46700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc200ccc70 0x7fdc200ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:00.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc25e46700 1 -- 172.21.15.49:0/2926782071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc100094b0 con 0x7fdc200b1900 2023-07-21T22:11:00.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc25645700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc200ccc70 0x7fdc200ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:00.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc25e46700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc200b1900 0x7fdc201587a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00c700 tx=0x7fdc1c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:00.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc167fc700 1 -- 172.21.15.49:0/2926782071 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0052d0 con 0x7fdc200b1900 2023-07-21T22:11:00.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc167fc700 1 -- 172.21.15.49:0/2926782071 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c005430 con 0x7fdc200b1900 2023-07-21T22:11:00.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc167fc700 1 -- 172.21.15.49:0/2926782071 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c003930 con 0x7fdc200b1900 2023-07-21T22:11:00.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc26e48700 1 -- 172.21.15.49:0/2926782071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc20157cc0 con 0x7fdc200b1900 2023-07-21T22:11:00.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.169+0000 7fdc26e48700 1 -- 172.21.15.49:0/2926782071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc20158280 con 0x7fdc200b1900 2023-07-21T22:11:00.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.173+0000 7fdc26e48700 1 -- 172.21.15.49:0/2926782071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc200cb6a0 con 0x7fdc200b1900 2023-07-21T22:11:00.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.173+0000 7fdc167fc700 1 -- 172.21.15.49:0/2926782071 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdc1c003a90 con 0x7fdc200b1900 2023-07-21T22:11:00.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.173+0000 7fdc167fc700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdc040662f0 0x7fdc040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:00.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.173+0000 7fdc167fc700 1 -- 172.21.15.49:0/2926782071 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdc1c0836a0 con 0x7fdc200b1900 2023-07-21T22:11:00.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.173+0000 7fdc25645700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdc040662f0 0x7fdc040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:00.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.177+0000 7fdc25645700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdc040662f0 0x7fdc040687a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdc100090b0 tx=0x7fdc10008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:00.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.177+0000 7fdc167fc700 1 -- 172.21.15.49:0/2926782071 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc200cb6a0 con 0x7fdc200b1900 2023-07-21T22:11:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.385+0000 7fdc26e48700 1 -- 172.21.15.49:0/2926782071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdc200cb6a0 con 0x7fdc200b1900 2023-07-21T22:11:01.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:00.997+0000 7fdc167fc700 1 -- 172.21.15.49:0/2926782071 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdc200cb6a0 con 0x7fdc200b1900 2023-07-21T22:11:01.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.001+0000 7fdc26e48700 1 -- 172.21.15.49:0/2926782071 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdc040662f0 msgr2=0x7fdc040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:01.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.001+0000 7fdc26e48700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdc040662f0 0x7fdc040687a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdc100090b0 tx=0x7fdc10008030 comp rx=0 tx=0).stop 2023-07-21T22:11:01.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.001+0000 7fdc26e48700 1 -- 172.21.15.49:0/2926782071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc200b1900 msgr2=0x7fdc201587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:01.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.001+0000 7fdc26e48700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc200b1900 0x7fdc201587a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00c700 tx=0x7fdc1c00cac0 comp rx=0 tx=0).stop 2023-07-21T22:11:01.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.001+0000 7fdc26e48700 1 -- 172.21.15.49:0/2926782071 shutdown_connections 2023-07-21T22:11:01.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.001+0000 7fdc26e48700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdc040662f0 0x7fdc040687a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:01.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.001+0000 7fdc26e48700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc200cde70 0x7fdc2015c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:01.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.001+0000 7fdc26e48700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc200ccc70 0x7fdc200ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:01.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.001+0000 7fdc26e48700 1 --2- 172.21.15.49:0/2926782071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc200b1900 0x7fdc201587a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:01.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.001+0000 7fdc26e48700 1 -- 172.21.15.49:0/2926782071 >> 172.21.15.49:0/2926782071 conn(0x7fdc200995e0 msgr2=0x7fdc200d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:01.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.001+0000 7fdc26e48700 1 -- 172.21.15.49:0/2926782071 shutdown_connections 2023-07-21T22:11:01.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.001+0000 7fdc26e48700 1 -- 172.21.15.49:0/2926782071 wait complete. 2023-07-21T22:11:01.072 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-07-21T22:11:01.072 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T22:11:01.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.213+0000 7f1da34b1700 1 Processor -- start 2023-07-21T22:11:01.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.213+0000 7f1da34b1700 1 -- start start 2023-07-21T22:11:01.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.217+0000 7f1da34b1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d9c160110 0x7f1d9c0cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:01.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.217+0000 7f1da34b1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d9c0cb2f0 0x7f1d9c163d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:01.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.217+0000 7f1da34b1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9c0cdf00 con 0x7f1d9c071220 2023-07-21T22:11:01.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.217+0000 7f1da34b1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c0cd730 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.217+0000 7f1da34b1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0ce600 con 0x7f1d9c160110 2023-07-21T22:11:01.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.217+0000 7f1da1a4e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d9c0cb2f0 0x7f1d9c163d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:01.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.217+0000 7f1da1a4e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d9c0cb2f0 0x7f1d9c163d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46470/0 (socket says 172.21.15.49:46470) 2023-07-21T22:11:01.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.217+0000 7f1da1a4e700 1 -- 172.21.15.49:0/3697417235 learned_addr learned my addr 172.21.15.49:0/3697417235 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:01.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.217+0000 7f1da124d700 1 --2- 172.21.15.49:0/3697417235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d9c160110 0x7f1d9c0cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:01.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.217+0000 7f1da1a4e700 1 -- 172.21.15.49:0/3697417235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d9c160110 msgr2=0x7f1d9c0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:01.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.217+0000 7f1da1a4e700 1 --2- 172.21.15.49:0/3697417235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d9c160110 0x7f1d9c0cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:01.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.217+0000 7f1da1a4e700 1 -- 172.21.15.49:0/3697417235 >> v1:172.21.15.150:6789/0 conn(0x7f1d9c071220 legacy=0x7f1d9c0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:01.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.217+0000 7f1da1a4e700 1 -- 172.21.15.49:0/3697417235 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c0cefd0 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.217+0000 7f1da1a4e700 1 --2- 172.21.15.49:0/3697417235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d9c0cb2f0 0x7f1d9c163d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009e50 tx=0x7f1d9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3727899aacd8d3ae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:01.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.221+0000 7f1d93fff700 1 -- 172.21.15.49:0/3697417235 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400e070 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.221+0000 7f1d93fff700 1 -- 172.21.15.49:0/3697417235 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9400b9c0 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.221+0000 7f1d93fff700 1 -- 172.21.15.49:0/3697417235 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400bd70 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.221+0000 7f1da34b1700 1 -- 172.21.15.49:0/3697417235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d9c0cb2f0 msgr2=0x7f1d9c163d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:01.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.221+0000 7f1da34b1700 1 --2- 172.21.15.49:0/3697417235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d9c0cb2f0 0x7f1d9c163d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009e50 tx=0x7f1d9400b330 comp rx=0 tx=0).stop 2023-07-21T22:11:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.221+0000 7f1da34b1700 1 -- 172.21.15.49:0/3697417235 shutdown_connections 2023-07-21T22:11:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.221+0000 7f1da34b1700 1 --2- 172.21.15.49:0/3697417235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d9c0cb2f0 0x7f1d9c163d40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.221+0000 7f1da34b1700 1 --2- 172.21.15.49:0/3697417235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d9c160110 0x7f1d9c0cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.221+0000 7f1da34b1700 1 -- 172.21.15.49:0/3697417235 >> 172.21.15.49:0/3697417235 conn(0x7f1d9c06e960 msgr2=0x7f1d9c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:01.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.221+0000 7f1da34b1700 1 -- 172.21.15.49:0/3697417235 shutdown_connections 2023-07-21T22:11:01.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.221+0000 7f1da34b1700 1 -- 172.21.15.49:0/3697417235 wait complete. 2023-07-21T22:11:01.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da34b1700 1 Processor -- start 2023-07-21T22:11:01.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da34b1700 1 -- start start 2023-07-21T22:11:01.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da34b1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d9c071220 0x7f1d9c0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:01.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da34b1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d9c0cb2f0 0x7f1d9c152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:01.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da34b1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d9c160110 0x7f1d9c0b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:01.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da34b1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0ad450 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da34b1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c1f9310 con 0x7f1d9c071220 2023-07-21T22:11:01.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da34b1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c1f95f0 con 0x7f1d9c160110 2023-07-21T22:11:01.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da0a4c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d9c0cb2f0 0x7f1d9c152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:01.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da0a4c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d9c0cb2f0 0x7f1d9c152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46476/0 (socket says 172.21.15.49:46476) 2023-07-21T22:11:01.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da0a4c700 1 -- 172.21.15.49:0/3302971631 learned_addr learned my addr 172.21.15.49:0/3302971631 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:01.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da124d700 1 --2- 172.21.15.49:0/3302971631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d9c071220 0x7f1d9c0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:01.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da1a4e700 1 --2- 172.21.15.49:0/3302971631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d9c160110 0x7f1d9c0b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:01.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da0a4c700 1 -- 172.21.15.49:0/3302971631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d9c160110 msgr2=0x7f1d9c0b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:01.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da0a4c700 1 --2- 172.21.15.49:0/3302971631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d9c160110 0x7f1d9c0b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:01.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da0a4c700 1 -- 172.21.15.49:0/3302971631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d9c071220 msgr2=0x7f1d9c0b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:01.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da0a4c700 1 --2- 172.21.15.49:0/3302971631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d9c071220 0x7f1d9c0b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:01.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da0a4c700 1 -- 172.21.15.49:0/3302971631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d94009b30 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.225+0000 7f1da0a4c700 1 --2- 172.21.15.49:0/3302971631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d9c0cb2f0 0x7f1d9c152dd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c400 tx=0x7f1d8c00c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:01.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.229+0000 7f1d91ffb700 1 -- 172.21.15.49:0/3302971631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0052d0 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.229+0000 7f1d91ffb700 1 -- 172.21.15.49:0/3302971631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c005430 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.229+0000 7f1d91ffb700 1 -- 172.21.15.49:0/3302971631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c006af0 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.229+0000 7f1da34b1700 1 -- 172.21.15.49:0/3302971631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c1f98d0 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.229+0000 7f1da34b1700 1 -- 172.21.15.49:0/3302971631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c0b0a60 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.229+0000 7f1da34b1700 1 -- 172.21.15.49:0/3302971631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9c1f9df0 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.233+0000 7f1d91ffb700 1 -- 172.21.15.49:0/3302971631 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1d8c0036f0 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.233+0000 7f1d91ffb700 1 --2- 172.21.15.49:0/3302971631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1d800662f0 0x7f1d800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:01.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.233+0000 7f1d91ffb700 1 -- 172.21.15.49:0/3302971631 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1d8c0830c0 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.233+0000 7f1da124d700 1 --2- 172.21.15.49:0/3302971631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1d800662f0 0x7f1d800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:01.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.237+0000 7f1da124d700 1 --2- 172.21.15.49:0/3302971631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1d800662f0 0x7f1d800687a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009a00 tx=0x7f1d98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:01.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.241+0000 7f1d91ffb700 1 -- 172.21.15.49:0/3302971631 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d8c0502e0 con 0x7f1d9c0cb2f0 2023-07-21T22:11:01.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:01.453+0000 7f1da34b1700 1 -- 172.21.15.49:0/3302971631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1d9c04dd50 con 0x7f1d9c0cb2f0 2023-07-21T22:11:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.001+0000 7f1d91ffb700 1 -- 172.21.15.49:0/3302971631 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1d8c053900 con 0x7f1d9c0cb2f0 2023-07-21T22:11:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.009+0000 7f1da34b1700 1 -- 172.21.15.49:0/3302971631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1d800662f0 msgr2=0x7f1d800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:02.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.009+0000 7f1da34b1700 1 --2- 172.21.15.49:0/3302971631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1d800662f0 0x7f1d800687a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009a00 tx=0x7f1d98008040 comp rx=0 tx=0).stop 2023-07-21T22:11:02.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.009+0000 7f1da34b1700 1 -- 172.21.15.49:0/3302971631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d9c0cb2f0 msgr2=0x7f1d9c152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:02.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.009+0000 7f1da34b1700 1 --2- 172.21.15.49:0/3302971631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d9c0cb2f0 0x7f1d9c152dd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c400 tx=0x7f1d8c00c710 comp rx=0 tx=0).stop 2023-07-21T22:11:02.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.009+0000 7f1da34b1700 1 -- 172.21.15.49:0/3302971631 shutdown_connections 2023-07-21T22:11:02.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.009+0000 7f1da34b1700 1 --2- 172.21.15.49:0/3302971631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1d800662f0 0x7f1d800687a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.009+0000 7f1da34b1700 1 --2- 172.21.15.49:0/3302971631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d9c0cb2f0 0x7f1d9c152dd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.009+0000 7f1da34b1700 1 --2- 172.21.15.49:0/3302971631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d9c160110 0x7f1d9c0b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.009+0000 7f1da34b1700 1 --2- 172.21.15.49:0/3302971631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d9c071220 0x7f1d9c0b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.009+0000 7f1da34b1700 1 -- 172.21.15.49:0/3302971631 >> 172.21.15.49:0/3302971631 conn(0x7f1d9c06e960 msgr2=0x7f1d9c0b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:02.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.009+0000 7f1da34b1700 1 -- 172.21.15.49:0/3302971631 shutdown_connections 2023-07-21T22:11:02.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.009+0000 7f1da34b1700 1 -- 172.21.15.49:0/3302971631 wait complete. 2023-07-21T22:11:02.076 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T22:11:02.077 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:11:02.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.213+0000 7f3b04c40700 1 Processor -- start 2023-07-21T22:11:02.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.213+0000 7f3b04c40700 1 -- start start 2023-07-21T22:11:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.217+0000 7f3b04c40700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000d1e40 0x7f3b000b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.217+0000 7f3b04c40700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b000cee10 0x7f3b000cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.217+0000 7f3b04c40700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b000b3e80 con 0x7f3b000b7af0 2023-07-21T22:11:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.217+0000 7f3b04c40700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b000cf7d0 con 0x7f3b000cee10 2023-07-21T22:11:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.217+0000 7f3b04c40700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0015fd40 con 0x7f3b000d1e40 2023-07-21T22:11:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.217+0000 7f3afffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b000cee10 0x7f3b000cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.217+0000 7f3afeffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000d1e40 0x7f3b000b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.217+0000 7f3aff7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3b000b7af0 0x7f3b0015f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:39322/0 (socket says 172.21.15.49:39322) 2023-07-21T22:11:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.217+0000 7f3aff7fe700 1 -- 172.21.15.49:0/986962106 learned_addr learned my addr 172.21.15.49:0/986962106 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.217+0000 7f3afffff700 1 -- 172.21.15.49:0/986962106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000d1e40 msgr2=0x7f3b000b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.217+0000 7f3afffff700 1 --2- 172.21.15.49:0/986962106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000d1e40 0x7f3b000b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.217+0000 7f3afffff700 1 -- 172.21.15.49:0/986962106 >> v1:172.21.15.150:6789/0 conn(0x7f3b000b7af0 legacy=0x7f3b0015f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.217+0000 7f3afffff700 1 -- 172.21.15.49:0/986962106 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000cea00 con 0x7f3b000cee10 2023-07-21T22:11:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.217+0000 7f3afffff700 1 --2- 172.21.15.49:0/986962106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b000cee10 0x7f3b000cf290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009d90 tx=0x7f3af800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f8ffb7a2d4f7779 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.221+0000 7f3afe7fc700 1 -- 172.21.15.49:0/986962106 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af800e070 con 0x7f3b000cee10 2023-07-21T22:11:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.221+0000 7f3afe7fc700 1 -- 172.21.15.49:0/986962106 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af800bb20 con 0x7f3b000cee10 2023-07-21T22:11:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.221+0000 7f3afe7fc700 1 -- 172.21.15.49:0/986962106 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8012430 con 0x7f3b000cee10 2023-07-21T22:11:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.221+0000 7f3b04c40700 1 -- 172.21.15.49:0/986962106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b000cee10 msgr2=0x7f3b000cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.221+0000 7f3b04c40700 1 --2- 172.21.15.49:0/986962106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b000cee10 0x7f3b000cf290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009d90 tx=0x7f3af800b330 comp rx=0 tx=0).stop 2023-07-21T22:11:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.221+0000 7f3b04c40700 1 -- 172.21.15.49:0/986962106 shutdown_connections 2023-07-21T22:11:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.221+0000 7f3b04c40700 1 --2- 172.21.15.49:0/986962106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000d1e40 0x7f3b000b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.221+0000 7f3b04c40700 1 --2- 172.21.15.49:0/986962106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b000cee10 0x7f3b000cf290 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.221+0000 7f3b04c40700 1 -- 172.21.15.49:0/986962106 >> 172.21.15.49:0/986962106 conn(0x7f3b0006e960 msgr2=0x7f3b0006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.221+0000 7f3b04c40700 1 -- 172.21.15.49:0/986962106 shutdown_connections 2023-07-21T22:11:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.221+0000 7f3b04c40700 1 -- 172.21.15.49:0/986962106 wait complete. 2023-07-21T22:11:02.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.225+0000 7f3b04c40700 1 Processor -- start 2023-07-21T22:11:02.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.225+0000 7f3b04c40700 1 -- start start 2023-07-21T22:11:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.225+0000 7f3b04c40700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b000b7af0 0x7f3b00151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.225+0000 7f3b04c40700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b000cee10 0x7f3b0015d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.225+0000 7f3b04c40700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000d1e40 0x7f3b0015db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.225+0000 7f3b04c40700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0015e1c0 con 0x7f3b000cee10 2023-07-21T22:11:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.225+0000 7f3b04c40700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000c6a00 con 0x7f3b000b7af0 2023-07-21T22:11:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.225+0000 7f3b04c40700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000c60d0 con 0x7f3b000d1e40 2023-07-21T22:11:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.225+0000 7f3afeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b000cee10 0x7f3b0015d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.225+0000 7f3aff7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b000b7af0 0x7f3b00151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.225+0000 7f3aff7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b000b7af0 0x7f3b00151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:38870/0 (socket says 172.21.15.49:38870) 2023-07-21T22:11:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.225+0000 7f3aff7fe700 1 -- 172.21.15.49:0/3933336570 learned_addr learned my addr 172.21.15.49:0/3933336570 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.225+0000 7f3afffff700 1 --2- 172.21.15.49:0/3933336570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000d1e40 0x7f3b0015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.229+0000 7f3aff7fe700 1 -- 172.21.15.49:0/3933336570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000d1e40 msgr2=0x7f3b0015db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.229+0000 7f3aff7fe700 1 --2- 172.21.15.49:0/3933336570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000d1e40 0x7f3b0015db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.229+0000 7f3aff7fe700 1 -- 172.21.15.49:0/3933336570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b000cee10 msgr2=0x7f3b0015d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.229+0000 7f3aff7fe700 1 --2- 172.21.15.49:0/3933336570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b000cee10 0x7f3b0015d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.229+0000 7f3aff7fe700 1 -- 172.21.15.49:0/3933336570 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af8009a70 con 0x7f3b000b7af0 2023-07-21T22:11:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.229+0000 7f3afeffd700 1 --2- 172.21.15.49:0/3933336570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b000cee10 0x7f3b0015d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.229+0000 7f3aff7fe700 1 --2- 172.21.15.49:0/3933336570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b000b7af0 0x7f3b00151180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3af000c730 tx=0x7f3af000ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.229+0000 7f3ae7fff700 1 -- 172.21.15.49:0/3933336570 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0005d90 con 0x7f3b000b7af0 2023-07-21T22:11:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.229+0000 7f3ae7fff700 1 -- 172.21.15.49:0/3933336570 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af00070d0 con 0x7f3b000b7af0 2023-07-21T22:11:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.229+0000 7f3ae7fff700 1 -- 172.21.15.49:0/3933336570 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0007440 con 0x7f3b000b7af0 2023-07-21T22:11:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.229+0000 7f3b04c40700 1 -- 172.21.15.49:0/3933336570 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b000c63b0 con 0x7f3b000b7af0 2023-07-21T22:11:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.229+0000 7f3b04c40700 1 -- 172.21.15.49:0/3933336570 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b000c7d80 con 0x7f3b000b7af0 2023-07-21T22:11:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.229+0000 7f3b04c40700 1 -- 172.21.15.49:0/3933336570 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0004dcb0 con 0x7f3b000b7af0 2023-07-21T22:11:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.233+0000 7f3ae7fff700 1 -- 172.21.15.49:0/3933336570 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3af00075a0 con 0x7f3b000b7af0 2023-07-21T22:11:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.233+0000 7f3ae7fff700 1 --2- 172.21.15.49:0/3933336570 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3aec066340 0x7f3aec0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.237+0000 7f3ae7fff700 1 -- 172.21.15.49:0/3933336570 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3af00836b0 con 0x7f3b000b7af0 2023-07-21T22:11:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.237+0000 7f3afeffd700 1 --2- 172.21.15.49:0/3933336570 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3aec066340 0x7f3aec0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:02.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.237+0000 7f3afeffd700 1 --2- 172.21.15.49:0/3933336570 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3aec066340 0x7f3aec0687f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b0015fbf0 tx=0x7f3af4009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:02.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.241+0000 7f3ae7fff700 1 -- 172.21.15.49:0/3933336570 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3af0050960 con 0x7f3b000b7af0 2023-07-21T22:11:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.453+0000 7f3b04c40700 1 -- 172.21.15.49:0/3933336570 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b0015f940 con 0x7f3b000b7af0 2023-07-21T22:11:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.453+0000 7f3ae7fff700 1 -- 172.21.15.49:0/3933336570 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f3af0053f80 con 0x7f3b000b7af0 2023-07-21T22:11:02.497 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:02.497 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/1894793298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1894793298},{"type":"v1","addr":"172.21.15.150:6833","nonce":1894793298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1984862419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1984862419},{"type":"v1","addr":"172.21.15.49:6836","nonce":1984862419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1331451608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1331451608},{"type":"v1","addr":"172.21.15.49:6837","nonce":1331451608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:10:34.629989+0000","modified":"2023-07-21T22:11:01.997441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2478678672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2478678672},{"type":"v1","addr":"172.21.15.150:6835","nonce":2478678672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:11:02.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.457+0000 7f3b04c40700 1 -- 172.21.15.49:0/3933336570 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3aec066340 msgr2=0x7f3aec0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:02.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.457+0000 7f3b04c40700 1 --2- 172.21.15.49:0/3933336570 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3aec066340 0x7f3aec0687f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b0015fbf0 tx=0x7f3af4009240 comp rx=0 tx=0).stop 2023-07-21T22:11:02.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.457+0000 7f3b04c40700 1 -- 172.21.15.49:0/3933336570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b000b7af0 msgr2=0x7f3b00151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:02.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.457+0000 7f3b04c40700 1 --2- 172.21.15.49:0/3933336570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b000b7af0 0x7f3b00151180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3af000c730 tx=0x7f3af000ca40 comp rx=0 tx=0).stop 2023-07-21T22:11:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.457+0000 7f3b04c40700 1 -- 172.21.15.49:0/3933336570 shutdown_connections 2023-07-21T22:11:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.457+0000 7f3b04c40700 1 --2- 172.21.15.49:0/3933336570 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3aec066340 0x7f3aec0687f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.457+0000 7f3b04c40700 1 --2- 172.21.15.49:0/3933336570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b000cee10 0x7f3b0015d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.457+0000 7f3b04c40700 1 --2- 172.21.15.49:0/3933336570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000d1e40 0x7f3b0015db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.457+0000 7f3b04c40700 1 --2- 172.21.15.49:0/3933336570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b000b7af0 0x7f3b00151180 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.457+0000 7f3b04c40700 1 -- 172.21.15.49:0/3933336570 >> 172.21.15.49:0/3933336570 conn(0x7f3b0006e960 msgr2=0x7f3b000b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:02.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.457+0000 7f3b04c40700 1 -- 172.21.15.49:0/3933336570 shutdown_connections 2023-07-21T22:11:02.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.457+0000 7f3b04c40700 1 -- 172.21.15.49:0/3933336570 wait complete. 2023-07-21T22:11:02.503 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2023-07-21T22:11:02.522 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:02.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.649+0000 7f9719ee7700 1 Processor -- start 2023-07-21T22:11:02.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.649+0000 7f9719ee7700 1 -- start start 2023-07-21T22:11:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f9719ee7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f971406d5d0 0x7f971406d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f9719ee7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9714159f60 0x7f97140afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f9719ee7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971406dee0 con 0x7f97140b0160 2023-07-21T22:11:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f9719ee7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97140b0600 con 0x7f9714159f60 2023-07-21T22:11:02.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f9719ee7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971415a470 con 0x7f971406d5d0 2023-07-21T22:11:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f970affd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9714159f60 0x7f97140afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:02.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f970affd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9714159f60 0x7f97140afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46484/0 (socket says 172.21.15.49:46484) 2023-07-21T22:11:02.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f970affd700 1 -- 172.21.15.49:0/2647314710 learned_addr learned my addr 172.21.15.49:0/2647314710 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:02.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f97137fe700 1 --2- 172.21.15.49:0/2647314710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f971406d5d0 0x7f971406d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:02.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f970affd700 1 -- 172.21.15.49:0/2647314710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f971406d5d0 msgr2=0x7f971406d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:02.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f970affd700 1 --2- 172.21.15.49:0/2647314710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f971406d5d0 0x7f971406d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f970affd700 1 -- 172.21.15.49:0/2647314710 >> v1:172.21.15.150:6789/0 conn(0x7f97140b0160 legacy=0x7f9714070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:02.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f970affd700 1 -- 172.21.15.49:0/2647314710 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971415a750 con 0x7f9714159f60 2023-07-21T22:11:02.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f970affd700 1 --2- 172.21.15.49:0/2647314710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9714159f60 0x7f97140afc20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009910 tx=0x7f96fc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c423bb15fb13b00a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:02.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.653+0000 7f9712ffd700 1 -- 172.21.15.49:0/2647314710 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc011830 con 0x7f9714159f60 2023-07-21T22:11:02.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.657+0000 7f9712ffd700 1 -- 172.21.15.49:0/2647314710 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc011990 con 0x7f9714159f60 2023-07-21T22:11:02.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.657+0000 7f9712ffd700 1 -- 172.21.15.49:0/2647314710 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc011d40 con 0x7f9714159f60 2023-07-21T22:11:02.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.657+0000 7f9719ee7700 1 -- 172.21.15.49:0/2647314710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9714159f60 msgr2=0x7f97140afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:02.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.657+0000 7f9719ee7700 1 --2- 172.21.15.49:0/2647314710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9714159f60 0x7f97140afc20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009910 tx=0x7f96fc009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:02.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.657+0000 7f9719ee7700 1 -- 172.21.15.49:0/2647314710 shutdown_connections 2023-07-21T22:11:02.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.657+0000 7f9719ee7700 1 --2- 172.21.15.49:0/2647314710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9714159f60 0x7f97140afc20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.657+0000 7f9719ee7700 1 --2- 172.21.15.49:0/2647314710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f971406d5d0 0x7f971406d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.657+0000 7f9719ee7700 1 -- 172.21.15.49:0/2647314710 >> 172.21.15.49:0/2647314710 conn(0x7f971406f5a0 msgr2=0x7f97140cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:02.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.657+0000 7f9719ee7700 1 -- 172.21.15.49:0/2647314710 shutdown_connections 2023-07-21T22:11:02.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.657+0000 7f9719ee7700 1 -- 172.21.15.49:0/2647314710 wait complete. 2023-07-21T22:11:02.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.657+0000 7f9719ee7700 1 Processor -- start 2023-07-21T22:11:02.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f9719ee7700 1 -- start start 2023-07-21T22:11:02.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f9719ee7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f971406d5d0 0x7f9714148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:02.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f9719ee7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97140b0160 0x7f97140c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:02.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f9719ee7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9714159f60 0x7f97140c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:02.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f9719ee7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97140c4c40 con 0x7f9714159f60 2023-07-21T22:11:02.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f9719ee7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97140c5bb0 con 0x7f97140b0160 2023-07-21T22:11:02.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f9719ee7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97140c4960 con 0x7f971406d5d0 2023-07-21T22:11:02.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f9713fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9714159f60 0x7f97140c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:02.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f97137fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f971406d5d0 0x7f9714148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:02.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f97137fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f971406d5d0 0x7f9714148f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:55590/0 (socket says 172.21.15.49:55590) 2023-07-21T22:11:02.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f97137fe700 1 -- 172.21.15.49:0/3469881207 learned_addr learned my addr 172.21.15.49:0/3469881207 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:02.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f9713fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9714159f60 0x7f97140c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46496/0 (socket says 172.21.15.49:46496) 2023-07-21T22:11:02.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f970affd700 1 --2- 172.21.15.49:0/3469881207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97140b0160 0x7f97140c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:02.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f97137fe700 1 -- 172.21.15.49:0/3469881207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97140b0160 msgr2=0x7f97140c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:02.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f97137fe700 1 --2- 172.21.15.49:0/3469881207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97140b0160 0x7f97140c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f97137fe700 1 -- 172.21.15.49:0/3469881207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9714159f60 msgr2=0x7f97140c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:02.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f97137fe700 1 --2- 172.21.15.49:0/3469881207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9714159f60 0x7f97140c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f97137fe700 1 -- 172.21.15.49:0/3469881207 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc009570 con 0x7f971406d5d0 2023-07-21T22:11:02.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f9713fff700 1 --2- 172.21.15.49:0/3469881207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9714159f60 0x7f97140c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:02.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f97137fe700 1 --2- 172.21.15.49:0/3469881207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f971406d5d0 0x7f9714148f70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9704009d10 tx=0x7f970400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:02.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.661+0000 7f9710ff9700 1 -- 172.21.15.49:0/3469881207 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970400cd10 con 0x7f971406d5d0 2023-07-21T22:11:02.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.665+0000 7f9710ff9700 1 -- 172.21.15.49:0/3469881207 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970400f040 con 0x7f971406d5d0 2023-07-21T22:11:02.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.665+0000 7f9710ff9700 1 -- 172.21.15.49:0/3469881207 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97040146a0 con 0x7f971406d5d0 2023-07-21T22:11:02.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.665+0000 7f9719ee7700 1 -- 172.21.15.49:0/3469881207 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97140c5560 con 0x7f971406d5d0 2023-07-21T22:11:02.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.665+0000 7f9719ee7700 1 -- 172.21.15.49:0/3469881207 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97140c2210 con 0x7f971406d5d0 2023-07-21T22:11:02.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.665+0000 7f9719ee7700 1 -- 172.21.15.49:0/3469881207 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9714073130 con 0x7f971406d5d0 2023-07-21T22:11:02.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.669+0000 7f9710ff9700 1 -- 172.21.15.49:0/3469881207 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f970403b020 con 0x7f971406d5d0 2023-07-21T22:11:02.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.669+0000 7f9710ff9700 1 --2- 172.21.15.49:0/3469881207 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f96f40662f0 0x7f96f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:02.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.669+0000 7f9710ff9700 1 -- 172.21.15.49:0/3469881207 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9704084ca0 con 0x7f971406d5d0 2023-07-21T22:11:02.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.669+0000 7f970affd700 1 --2- 172.21.15.49:0/3469881207 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f96f40662f0 0x7f96f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:02.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.669+0000 7f970affd700 1 --2- 172.21.15.49:0/3469881207 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f96f40662f0 0x7f96f40687a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f96fc000c00 tx=0x7f96fc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:02.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.677+0000 7f9710ff9700 1 -- 172.21.15.49:0/3469881207 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9704051ea0 con 0x7f971406d5d0 2023-07-21T22:11:02.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.853+0000 7f9719ee7700 1 -- 172.21.15.49:0/3469881207 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97140c53c0 con 0x7f971406d5d0 2023-07-21T22:11:02.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.853+0000 7f9710ff9700 1 -- 172.21.15.49:0/3469881207 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f97140c53c0 con 0x7f971406d5d0 2023-07-21T22:11:02.899 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:02.899 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:39.728219+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:02.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.861+0000 7f9719ee7700 1 -- 172.21.15.49:0/3469881207 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f96f40662f0 msgr2=0x7f96f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:02.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.861+0000 7f9719ee7700 1 --2- 172.21.15.49:0/3469881207 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f96f40662f0 0x7f96f40687a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f96fc000c00 tx=0x7f96fc008030 comp rx=0 tx=0).stop 2023-07-21T22:11:02.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.861+0000 7f9719ee7700 1 -- 172.21.15.49:0/3469881207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f971406d5d0 msgr2=0x7f9714148f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:02.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.861+0000 7f9719ee7700 1 --2- 172.21.15.49:0/3469881207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f971406d5d0 0x7f9714148f70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9704009d10 tx=0x7f970400c3a0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.861+0000 7f9719ee7700 1 -- 172.21.15.49:0/3469881207 shutdown_connections 2023-07-21T22:11:02.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.861+0000 7f9719ee7700 1 --2- 172.21.15.49:0/3469881207 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f96f40662f0 0x7f96f40687a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.861+0000 7f9719ee7700 1 --2- 172.21.15.49:0/3469881207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9714159f60 0x7f97140c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.861+0000 7f9719ee7700 1 --2- 172.21.15.49:0/3469881207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97140b0160 0x7f97140c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.861+0000 7f9719ee7700 1 --2- 172.21.15.49:0/3469881207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f971406d5d0 0x7f9714148f70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:02.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.861+0000 7f9719ee7700 1 -- 172.21.15.49:0/3469881207 >> 172.21.15.49:0/3469881207 conn(0x7f971406f5a0 msgr2=0x7f971406bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:02.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.861+0000 7f9719ee7700 1 -- 172.21.15.49:0/3469881207 shutdown_connections 2023-07-21T22:11:02.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:02.861+0000 7f9719ee7700 1 -- 172.21.15.49:0/3469881207 wait complete. 2023-07-21T22:11:02.924 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:11:02.925 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:11:03.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.057+0000 7eff8a664700 1 Processor -- start 2023-07-21T22:11:03.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.057+0000 7eff8a664700 1 -- start start 2023-07-21T22:11:03.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.061+0000 7eff8a664700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff84071c70 0x7eff840b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:03.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.061+0000 7eff8a664700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff840b1400 0x7eff840cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:03.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.061+0000 7eff8a664700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff840cab20 con 0x7eff8406d380 2023-07-21T22:11:03.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.061+0000 7eff8a664700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff840c9e80 con 0x7eff840b1400 2023-07-21T22:11:03.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.061+0000 7eff8a664700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff840afeb0 con 0x7eff84071c70 2023-07-21T22:11:03.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.061+0000 7eff89e63700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff840b1400 0x7eff840cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:03.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.061+0000 7eff88e61700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff84071c70 0x7eff840b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:03.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.061+0000 7eff89e63700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff840b1400 0x7eff840cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46512/0 (socket says 172.21.15.49:46512) 2023-07-21T22:11:03.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.061+0000 7eff89e63700 1 -- 172.21.15.49:0/1127159910 learned_addr learned my addr 172.21.15.49:0/1127159910 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:03.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.061+0000 7eff89e63700 1 -- 172.21.15.49:0/1127159910 >> v2:172.21.15.150:3300/0 conn(0x7eff84071c70 msgr2=0x7eff840b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:03.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.061+0000 7eff89e63700 1 --2- 172.21.15.49:0/1127159910 >> v2:172.21.15.150:3300/0 conn(0x7eff84071c70 0x7eff840b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.061+0000 7eff89e63700 1 -- 172.21.15.49:0/1127159910 >> v1:172.21.15.150:6789/0 conn(0x7eff8406d380 legacy=0x7eff8406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:03.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.061+0000 7eff89e63700 1 -- 172.21.15.49:0/1127159910 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff840ca1f0 con 0x7eff840b1400 2023-07-21T22:11:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.065+0000 7eff89e63700 1 --2- 172.21.15.49:0/1127159910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff840b1400 0x7eff840cafb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7eff8406b3f0 tx=0x7eff7c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78a9ac13b452e04 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.065+0000 7eff7bfff700 1 -- 172.21.15.49:0/1127159910 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c011830 con 0x7eff840b1400 2023-07-21T22:11:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.065+0000 7eff7bfff700 1 -- 172.21.15.49:0/1127159910 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c011990 con 0x7eff840b1400 2023-07-21T22:11:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.065+0000 7eff7bfff700 1 -- 172.21.15.49:0/1127159910 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c011d20 con 0x7eff840b1400 2023-07-21T22:11:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.065+0000 7eff8a664700 1 -- 172.21.15.49:0/1127159910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff840b1400 msgr2=0x7eff840cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.065+0000 7eff8a664700 1 --2- 172.21.15.49:0/1127159910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff840b1400 0x7eff840cafb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7eff8406b3f0 tx=0x7eff7c009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.065+0000 7eff8a664700 1 -- 172.21.15.49:0/1127159910 shutdown_connections 2023-07-21T22:11:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.065+0000 7eff8a664700 1 --2- 172.21.15.49:0/1127159910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff840b1400 0x7eff840cafb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.065+0000 7eff8a664700 1 --2- 172.21.15.49:0/1127159910 >> v2:172.21.15.150:3300/0 conn(0x7eff84071c70 0x7eff840b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.065+0000 7eff8a664700 1 -- 172.21.15.49:0/1127159910 >> 172.21.15.49:0/1127159910 conn(0x7eff84070450 msgr2=0x7eff84070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.065+0000 7eff8a664700 1 -- 172.21.15.49:0/1127159910 shutdown_connections 2023-07-21T22:11:03.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.065+0000 7eff8a664700 1 -- 172.21.15.49:0/1127159910 wait complete. 2023-07-21T22:11:03.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.069+0000 7eff8a664700 1 Processor -- start 2023-07-21T22:11:03.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.069+0000 7eff8a664700 1 -- start start 2023-07-21T22:11:03.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.069+0000 7eff8a664700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff8406d380 0x7eff840cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:03.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.069+0000 7eff8a664700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff84071c70 0x7eff840c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:03.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.069+0000 7eff8a664700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff840b1400 0x7eff840cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:03.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.069+0000 7eff8a664700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff840cc1c0 con 0x7eff8406d380 2023-07-21T22:11:03.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.069+0000 7eff8a664700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff840cc4a0 con 0x7eff84071c70 2023-07-21T22:11:03.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.069+0000 7eff8a664700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff840cc780 con 0x7eff840b1400 2023-07-21T22:11:03.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.069+0000 7eff89662700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff8406d380 0x7eff840cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:03.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.069+0000 7eff89662700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff8406d380 0x7eff840cbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46520/0 (socket says 172.21.15.49:46520) 2023-07-21T22:11:03.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.069+0000 7eff89662700 1 -- 172.21.15.49:0/334942119 learned_addr learned my addr 172.21.15.49:0/334942119 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:03.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.073+0000 7eff88e61700 1 --2- 172.21.15.49:0/334942119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff84071c70 0x7eff840c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.073+0000 7eff89e63700 1 --2- 172.21.15.49:0/334942119 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff840b1400 0x7eff840cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.073+0000 7eff89662700 1 -- 172.21.15.49:0/334942119 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff840b1400 msgr2=0x7eff840cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.073+0000 7eff89662700 1 --2- 172.21.15.49:0/334942119 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff840b1400 0x7eff840cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.073+0000 7eff89662700 1 -- 172.21.15.49:0/334942119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff84071c70 msgr2=0x7eff840c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:03.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.073+0000 7eff89662700 1 --2- 172.21.15.49:0/334942119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff84071c70 0x7eff840c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.073+0000 7eff89662700 1 -- 172.21.15.49:0/334942119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c009570 con 0x7eff8406d380 2023-07-21T22:11:03.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.073+0000 7eff89662700 1 --2- 172.21.15.49:0/334942119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff8406d380 0x7eff840cbbe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7eff80001ed0 tx=0x7eff800021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:03.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.073+0000 7eff79ffb700 1 -- 172.21.15.49:0/334942119 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80003c20 con 0x7eff8406d380 2023-07-21T22:11:03.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.073+0000 7eff79ffb700 1 -- 172.21.15.49:0/334942119 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff80003d80 con 0x7eff8406d380 2023-07-21T22:11:03.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.073+0000 7eff79ffb700 1 -- 172.21.15.49:0/334942119 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8000abf0 con 0x7eff8406d380 2023-07-21T22:11:03.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.073+0000 7eff8a664700 1 -- 172.21.15.49:0/334942119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff840cca60 con 0x7eff8406d380 2023-07-21T22:11:03.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.073+0000 7eff8a664700 1 -- 172.21.15.49:0/334942119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff840c3a80 con 0x7eff8406d380 2023-07-21T22:11:03.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.073+0000 7eff8a664700 1 -- 172.21.15.49:0/334942119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff840ccf80 con 0x7eff8406d380 2023-07-21T22:11:03.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.077+0000 7eff79ffb700 1 -- 172.21.15.49:0/334942119 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7eff8000ad50 con 0x7eff8406d380 2023-07-21T22:11:03.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.077+0000 7eff79ffb700 1 --2- 172.21.15.49:0/334942119 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7eff68066320 0x7eff680687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:03.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.077+0000 7eff79ffb700 1 -- 172.21.15.49:0/334942119 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7eff80084220 con 0x7eff8406d380 2023-07-21T22:11:03.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.077+0000 7eff88e61700 1 --2- 172.21.15.49:0/334942119 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7eff68066320 0x7eff680687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:03.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.081+0000 7eff88e61700 1 --2- 172.21.15.49:0/334942119 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7eff68066320 0x7eff680687d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7eff840c9a00 tx=0x7eff7400f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:03.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.085+0000 7eff79ffb700 1 -- 172.21.15.49:0/334942119 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff840ccf80 con 0x7eff8406d380 2023-07-21T22:11:03.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.257+0000 7eff8a664700 1 -- 172.21.15.49:0/334942119 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff840ca7b0 con 0x7eff68066320 2023-07-21T22:11:03.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.277+0000 7eff79ffb700 1 -- 172.21.15.49:0/334942119 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367063 (secure 0 0 0) 0x7eff74013040 con 0x7eff68066320 2023-07-21T22:11:03.323 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.289+0000 7eff8a664700 1 -- 172.21.15.49:0/334942119 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7eff68066320 msgr2=0x7eff680687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.289+0000 7eff8a664700 1 --2- 172.21.15.49:0/334942119 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7eff68066320 0x7eff680687d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7eff840c9a00 tx=0x7eff7400f040 comp rx=0 tx=0).stop 2023-07-21T22:11:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.289+0000 7eff8a664700 1 -- 172.21.15.49:0/334942119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff8406d380 msgr2=0x7eff840cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:03.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.289+0000 7eff8a664700 1 --2- 172.21.15.49:0/334942119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff8406d380 0x7eff840cbbe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7eff80001ed0 tx=0x7eff800021e0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.289+0000 7eff8a664700 1 -- 172.21.15.49:0/334942119 shutdown_connections 2023-07-21T22:11:03.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.289+0000 7eff8a664700 1 --2- 172.21.15.49:0/334942119 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7eff68066320 0x7eff680687d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.289+0000 7eff8a664700 1 --2- 172.21.15.49:0/334942119 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff840b1400 0x7eff840cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.289+0000 7eff8a664700 1 --2- 172.21.15.49:0/334942119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff84071c70 0x7eff840c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.289+0000 7eff8a664700 1 --2- 172.21.15.49:0/334942119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff8406d380 0x7eff840cbbe0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.289+0000 7eff8a664700 1 -- 172.21.15.49:0/334942119 >> 172.21.15.49:0/334942119 conn(0x7eff84070450 msgr2=0x7eff8415a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:03.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.289+0000 7eff8a664700 1 -- 172.21.15.49:0/334942119 shutdown_connections 2023-07-21T22:11:03.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.289+0000 7eff8a664700 1 -- 172.21.15.49:0/334942119 wait complete. 2023-07-21T22:11:03.335 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:11:03.350 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-07-21T22:11:02.311434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231624,"kb_used_data":3720,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754743096,"statfs":{"total":773094113280,"available":772856930304,"internally_reserved":0,"allocated":3809280,"data_stored":2233358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005408"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148041+0000","last_change":"2023-07-21T22:10:39.285920+0000","last_active":"2023-07-21T22:10:41.148041+0000","last_peered":"2023-07-21T22:10:41.148041+0000","last_clean":"2023-07-21T22:10:41.148041+0000","last_became_active":"2023-07-21T22:10:39.285402+0000","last_became_peered":"2023-07-21T22:10:39.285402+0000","last_unstale":"2023-07-21T22:10:41.148041+0000","last_undegraded":"2023-07-21T22:10:41.148041+0000","last_fullsized":"2023-07-21T22:10:41.148041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:53.331934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146444+0000","last_change":"2023-07-21T22:10:34.187231+0000","last_active":"2023-07-21T22:10:41.146444+0000","last_peered":"2023-07-21T22:10:41.146444+0000","last_clean":"2023-07-21T22:10:41.146444+0000","last_became_active":"2023-07-21T22:10:34.186893+0000","last_became_peered":"2023-07-21T22:10:34.186893+0000","last_unstale":"2023-07-21T22:10:41.146444+0000","last_undegraded":"2023-07-21T22:10:41.146444+0000","last_fullsized":"2023-07-21T22:10:41.146444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:35:27.556960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263558+0000","last_change":"2023-07-21T22:10:35.187303+0000","last_active":"2023-07-21T22:10:40.263558+0000","last_peered":"2023-07-21T22:10:40.263558+0000","last_clean":"2023-07-21T22:10:40.263558+0000","last_became_active":"2023-07-21T22:10:35.186998+0000","last_became_peered":"2023-07-21T22:10:35.186998+0000","last_unstale":"2023-07-21T22:10:40.263558+0000","last_undegraded":"2023-07-21T22:10:40.263558+0000","last_fullsized":"2023-07-21T22:10:40.263558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:14.259344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263311+0000","last_change":"2023-07-21T22:10:39.284321+0000","last_active":"2023-07-21T22:10:40.263311+0000","last_peered":"2023-07-21T22:10:40.263311+0000","last_clean":"2023-07-21T22:10:40.263311+0000","last_became_active":"2023-07-21T22:10:39.283184+0000","last_became_peered":"2023-07-21T22:10:39.283184+0000","last_unstale":"2023-07-21T22:10:40.263311+0000","last_undegraded":"2023-07-21T22:10:40.263311+0000","last_fullsized":"2023-07-21T22:10:40.263311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:02:07.314838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643758+0000","last_change":"2023-07-21T22:10:34.183067+0000","last_active":"2023-07-21T22:10:40.643758+0000","last_peered":"2023-07-21T22:10:40.643758+0000","last_clean":"2023-07-21T22:10:40.643758+0000","last_became_active":"2023-07-21T22:10:34.182744+0000","last_became_peered":"2023-07-21T22:10:34.182744+0000","last_unstale":"2023-07-21T22:10:40.643758+0000","last_undegraded":"2023-07-21T22:10:40.643758+0000","last_fullsized":"2023-07-21T22:10:40.643758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:16:50.409495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643472+0000","last_change":"2023-07-21T22:10:35.193952+0000","last_active":"2023-07-21T22:10:40.643472+0000","last_peered":"2023-07-21T22:10:40.643472+0000","last_clean":"2023-07-21T22:10:40.643472+0000","last_became_active":"2023-07-21T22:10:35.193594+0000","last_became_peered":"2023-07-21T22:10:35.193594+0000","last_unstale":"2023-07-21T22:10:40.643472+0000","last_undegraded":"2023-07-21T22:10:40.643472+0000","last_fullsized":"2023-07-21T22:10:40.643472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:23:35.116197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265724+0000","last_change":"2023-07-21T22:10:39.275701+0000","last_active":"2023-07-21T22:10:40.265724+0000","last_peered":"2023-07-21T22:10:40.265724+0000","last_clean":"2023-07-21T22:10:40.265724+0000","last_became_active":"2023-07-21T22:10:39.275276+0000","last_became_peered":"2023-07-21T22:10:39.275276+0000","last_unstale":"2023-07-21T22:10:40.265724+0000","last_undegraded":"2023-07-21T22:10:40.265724+0000","last_fullsized":"2023-07-21T22:10:40.265724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:52.259693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266022+0000","last_change":"2023-07-21T22:10:34.189037+0000","last_active":"2023-07-21T22:10:40.266022+0000","last_peered":"2023-07-21T22:10:40.266022+0000","last_clean":"2023-07-21T22:10:40.266022+0000","last_became_active":"2023-07-21T22:10:34.188705+0000","last_became_peered":"2023-07-21T22:10:34.188705+0000","last_unstale":"2023-07-21T22:10:40.266022+0000","last_undegraded":"2023-07-21T22:10:40.266022+0000","last_fullsized":"2023-07-21T22:10:40.266022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:32:09.815085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264089+0000","last_change":"2023-07-21T22:10:35.190920+0000","last_active":"2023-07-21T22:10:40.264089+0000","last_peered":"2023-07-21T22:10:40.264089+0000","last_clean":"2023-07-21T22:10:40.264089+0000","last_became_active":"2023-07-21T22:10:35.190624+0000","last_became_peered":"2023-07-21T22:10:35.190624+0000","last_unstale":"2023-07-21T22:10:40.264089+0000","last_undegraded":"2023-07-21T22:10:40.264089+0000","last_fullsized":"2023-07-21T22:10:40.264089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:24:44.643941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145887+0000","last_change":"2023-07-21T22:10:39.288143+0000","last_active":"2023-07-21T22:10:41.145887+0000","last_peered":"2023-07-21T22:10:41.145887+0000","last_clean":"2023-07-21T22:10:41.145887+0000","last_became_active":"2023-07-21T22:10:39.287727+0000","last_became_peered":"2023-07-21T22:10:39.287727+0000","last_unstale":"2023-07-21T22:10:41.145887+0000","last_undegraded":"2023-07-21T22:10:41.145887+0000","last_fullsized":"2023-07-21T22:10:41.145887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:55:32.701346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265495+0000","last_change":"2023-07-21T22:10:34.189233+0000","last_active":"2023-07-21T22:10:40.265495+0000","last_peered":"2023-07-21T22:10:40.265495+0000","last_clean":"2023-07-21T22:10:40.265495+0000","last_became_active":"2023-07-21T22:10:34.188693+0000","last_became_peered":"2023-07-21T22:10:34.188693+0000","last_unstale":"2023-07-21T22:10:40.265495+0000","last_undegraded":"2023-07-21T22:10:40.265495+0000","last_fullsized":"2023-07-21T22:10:40.265495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:19.034773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263831+0000","last_change":"2023-07-21T22:10:35.196227+0000","last_active":"2023-07-21T22:10:40.263831+0000","last_peered":"2023-07-21T22:10:40.263831+0000","last_clean":"2023-07-21T22:10:40.263831+0000","last_became_active":"2023-07-21T22:10:35.195975+0000","last_became_peered":"2023-07-21T22:10:35.195975+0000","last_unstale":"2023-07-21T22:10:40.263831+0000","last_undegraded":"2023-07-21T22:10:40.263831+0000","last_fullsized":"2023-07-21T22:10:40.263831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:42:02.828468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147542+0000","last_change":"2023-07-21T22:10:39.286940+0000","last_active":"2023-07-21T22:10:41.147542+0000","last_peered":"2023-07-21T22:10:41.147542+0000","last_clean":"2023-07-21T22:10:41.147542+0000","last_became_active":"2023-07-21T22:10:39.286471+0000","last_became_peered":"2023-07-21T22:10:39.286471+0000","last_unstale":"2023-07-21T22:10:41.147542+0000","last_undegraded":"2023-07-21T22:10:41.147542+0000","last_fullsized":"2023-07-21T22:10:41.147542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:44.332920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147513+0000","last_change":"2023-07-21T22:10:34.195078+0000","last_active":"2023-07-21T22:10:41.147513+0000","last_peered":"2023-07-21T22:10:41.147513+0000","last_clean":"2023-07-21T22:10:41.147513+0000","last_became_active":"2023-07-21T22:10:34.194778+0000","last_became_peered":"2023-07-21T22:10:34.194778+0000","last_unstale":"2023-07-21T22:10:41.147513+0000","last_undegraded":"2023-07-21T22:10:41.147513+0000","last_fullsized":"2023-07-21T22:10:41.147513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:13:31.016122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262886+0000","last_change":"2023-07-21T22:10:35.184187+0000","last_active":"2023-07-21T22:10:40.262886+0000","last_peered":"2023-07-21T22:10:40.262886+0000","last_clean":"2023-07-21T22:10:40.262886+0000","last_became_active":"2023-07-21T22:10:35.183664+0000","last_became_peered":"2023-07-21T22:10:35.183664+0000","last_unstale":"2023-07-21T22:10:40.262886+0000","last_undegraded":"2023-07-21T22:10:40.262886+0000","last_fullsized":"2023-07-21T22:10:40.262886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:17:19.358440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264275+0000","last_change":"2023-07-21T22:10:39.277910+0000","last_active":"2023-07-21T22:10:40.264275+0000","last_peered":"2023-07-21T22:10:40.264275+0000","last_clean":"2023-07-21T22:10:40.264275+0000","last_became_active":"2023-07-21T22:10:39.277601+0000","last_became_peered":"2023-07-21T22:10:39.277601+0000","last_unstale":"2023-07-21T22:10:40.264275+0000","last_undegraded":"2023-07-21T22:10:40.264275+0000","last_fullsized":"2023-07-21T22:10:40.264275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:41:03.813859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264319+0000","last_change":"2023-07-21T22:10:34.181116+0000","last_active":"2023-07-21T22:10:40.264319+0000","last_peered":"2023-07-21T22:10:40.264319+0000","last_clean":"2023-07-21T22:10:40.264319+0000","last_became_active":"2023-07-21T22:10:34.180817+0000","last_became_peered":"2023-07-21T22:10:34.180817+0000","last_unstale":"2023-07-21T22:10:40.264319+0000","last_undegraded":"2023-07-21T22:10:40.264319+0000","last_fullsized":"2023-07-21T22:10:40.264319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:29.537599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644380+0000","last_change":"2023-07-21T22:10:35.198715+0000","last_active":"2023-07-21T22:10:40.644380+0000","last_peered":"2023-07-21T22:10:40.644380+0000","last_clean":"2023-07-21T22:10:40.644380+0000","last_became_active":"2023-07-21T22:10:35.196452+0000","last_became_peered":"2023-07-21T22:10:35.196452+0000","last_unstale":"2023-07-21T22:10:40.644380+0000","last_undegraded":"2023-07-21T22:10:40.644380+0000","last_fullsized":"2023-07-21T22:10:40.644380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:54.017939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146548+0000","last_change":"2023-07-21T22:10:39.282183+0000","last_active":"2023-07-21T22:10:41.146548+0000","last_peered":"2023-07-21T22:10:41.146548+0000","last_clean":"2023-07-21T22:10:41.146548+0000","last_became_active":"2023-07-21T22:10:39.281786+0000","last_became_peered":"2023-07-21T22:10:39.281786+0000","last_unstale":"2023-07-21T22:10:41.146548+0000","last_undegraded":"2023-07-21T22:10:41.146548+0000","last_fullsized":"2023-07-21T22:10:41.146548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:36.102033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148156+0000","last_change":"2023-07-21T22:10:34.189390+0000","last_active":"2023-07-21T22:10:41.148156+0000","last_peered":"2023-07-21T22:10:41.148156+0000","last_clean":"2023-07-21T22:10:41.148156+0000","last_became_active":"2023-07-21T22:10:34.189100+0000","last_became_peered":"2023-07-21T22:10:34.189100+0000","last_unstale":"2023-07-21T22:10:41.148156+0000","last_undegraded":"2023-07-21T22:10:41.148156+0000","last_fullsized":"2023-07-21T22:10:41.148156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:51:46.906168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146955+0000","last_change":"2023-07-21T22:10:35.186334+0000","last_active":"2023-07-21T22:10:41.146955+0000","last_peered":"2023-07-21T22:10:41.146955+0000","last_clean":"2023-07-21T22:10:41.146955+0000","last_became_active":"2023-07-21T22:10:35.186027+0000","last_became_peered":"2023-07-21T22:10:35.186027+0000","last_unstale":"2023-07-21T22:10:41.146955+0000","last_undegraded":"2023-07-21T22:10:41.146955+0000","last_fullsized":"2023-07-21T22:10:41.146955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:26.382303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146339+0000","last_change":"2023-07-21T22:10:39.283921+0000","last_active":"2023-07-21T22:10:41.146339+0000","last_peered":"2023-07-21T22:10:41.146339+0000","last_clean":"2023-07-21T22:10:41.146339+0000","last_became_active":"2023-07-21T22:10:39.283579+0000","last_became_peered":"2023-07-21T22:10:39.283579+0000","last_unstale":"2023-07-21T22:10:41.146339+0000","last_undegraded":"2023-07-21T22:10:41.146339+0000","last_fullsized":"2023-07-21T22:10:41.146339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:33:27.956737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643473+0000","last_change":"2023-07-21T22:10:34.185811+0000","last_active":"2023-07-21T22:10:40.643473+0000","last_peered":"2023-07-21T22:10:40.643473+0000","last_clean":"2023-07-21T22:10:40.643473+0000","last_became_active":"2023-07-21T22:10:34.185528+0000","last_became_peered":"2023-07-21T22:10:34.185528+0000","last_unstale":"2023-07-21T22:10:40.643473+0000","last_undegraded":"2023-07-21T22:10:40.643473+0000","last_fullsized":"2023-07-21T22:10:40.643473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:32:55.911711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146562+0000","last_change":"2023-07-21T22:10:35.181437+0000","last_active":"2023-07-21T22:10:41.146562+0000","last_peered":"2023-07-21T22:10:41.146562+0000","last_clean":"2023-07-21T22:10:41.146562+0000","last_became_active":"2023-07-21T22:10:35.181153+0000","last_became_peered":"2023-07-21T22:10:35.181153+0000","last_unstale":"2023-07-21T22:10:41.146562+0000","last_undegraded":"2023-07-21T22:10:41.146562+0000","last_fullsized":"2023-07-21T22:10:41.146562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:15.974063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643126+0000","last_change":"2023-07-21T22:10:35.191719+0000","last_active":"2023-07-21T22:10:40.643126+0000","last_peered":"2023-07-21T22:10:40.643126+0000","last_clean":"2023-07-21T22:10:40.643126+0000","last_became_active":"2023-07-21T22:10:35.191220+0000","last_became_peered":"2023-07-21T22:10:35.191220+0000","last_unstale":"2023-07-21T22:10:40.643126+0000","last_undegraded":"2023-07-21T22:10:40.643126+0000","last_fullsized":"2023-07-21T22:10:40.643126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:33.738041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146486+0000","last_change":"2023-07-21T22:10:34.187207+0000","last_active":"2023-07-21T22:10:41.146486+0000","last_peered":"2023-07-21T22:10:41.146486+0000","last_clean":"2023-07-21T22:10:41.146486+0000","last_became_active":"2023-07-21T22:10:34.185806+0000","last_became_peered":"2023-07-21T22:10:34.185806+0000","last_unstale":"2023-07-21T22:10:41.146486+0000","last_undegraded":"2023-07-21T22:10:41.146486+0000","last_fullsized":"2023-07-21T22:10:41.146486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:17.068811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144651+0000","last_change":"2023-07-21T22:10:39.284138+0000","last_active":"2023-07-21T22:10:41.144651+0000","last_peered":"2023-07-21T22:10:41.144651+0000","last_clean":"2023-07-21T22:10:41.144651+0000","last_became_active":"2023-07-21T22:10:39.283678+0000","last_became_peered":"2023-07-21T22:10:39.283678+0000","last_unstale":"2023-07-21T22:10:41.144651+0000","last_undegraded":"2023-07-21T22:10:41.144651+0000","last_fullsized":"2023-07-21T22:10:41.144651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:52.307715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643341+0000","last_change":"2023-07-21T22:10:35.193661+0000","last_active":"2023-07-21T22:10:40.643341+0000","last_peered":"2023-07-21T22:10:40.643341+0000","last_clean":"2023-07-21T22:10:40.643341+0000","last_became_active":"2023-07-21T22:10:35.193205+0000","last_became_peered":"2023-07-21T22:10:35.193205+0000","last_unstale":"2023-07-21T22:10:40.643341+0000","last_undegraded":"2023-07-21T22:10:40.643341+0000","last_fullsized":"2023-07-21T22:10:40.643341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:44:13.704282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266550+0000","last_change":"2023-07-21T22:10:34.178085+0000","last_active":"2023-07-21T22:10:40.266550+0000","last_peered":"2023-07-21T22:10:40.266550+0000","last_clean":"2023-07-21T22:10:40.266550+0000","last_became_active":"2023-07-21T22:10:34.177713+0000","last_became_peered":"2023-07-21T22:10:34.177713+0000","last_unstale":"2023-07-21T22:10:40.266550+0000","last_undegraded":"2023-07-21T22:10:40.266550+0000","last_fullsized":"2023-07-21T22:10:40.266550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:20:06.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144877+0000","last_change":"2023-07-21T22:10:39.284566+0000","last_active":"2023-07-21T22:10:41.144877+0000","last_peered":"2023-07-21T22:10:41.144877+0000","last_clean":"2023-07-21T22:10:41.144877+0000","last_became_active":"2023-07-21T22:10:39.284100+0000","last_became_peered":"2023-07-21T22:10:39.284100+0000","last_unstale":"2023-07-21T22:10:41.144877+0000","last_undegraded":"2023-07-21T22:10:41.144877+0000","last_fullsized":"2023-07-21T22:10:41.144877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:31:22.286788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146666+0000","last_change":"2023-07-21T22:10:34.190125+0000","last_active":"2023-07-21T22:10:41.146666+0000","last_peered":"2023-07-21T22:10:41.146666+0000","last_clean":"2023-07-21T22:10:41.146666+0000","last_became_active":"2023-07-21T22:10:34.189780+0000","last_became_peered":"2023-07-21T22:10:34.189780+0000","last_unstale":"2023-07-21T22:10:41.146666+0000","last_undegraded":"2023-07-21T22:10:41.146666+0000","last_fullsized":"2023-07-21T22:10:41.146666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:53.502850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147220+0000","last_change":"2023-07-21T22:10:35.186228+0000","last_active":"2023-07-21T22:10:41.147220+0000","last_peered":"2023-07-21T22:10:41.147220+0000","last_clean":"2023-07-21T22:10:41.147220+0000","last_became_active":"2023-07-21T22:10:35.185965+0000","last_became_peered":"2023-07-21T22:10:35.185965+0000","last_unstale":"2023-07-21T22:10:41.147220+0000","last_undegraded":"2023-07-21T22:10:41.147220+0000","last_fullsized":"2023-07-21T22:10:41.147220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:15:55.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643839+0000","last_change":"2023-07-21T22:10:39.283587+0000","last_active":"2023-07-21T22:10:40.643839+0000","last_peered":"2023-07-21T22:10:40.643839+0000","last_clean":"2023-07-21T22:10:40.643839+0000","last_became_active":"2023-07-21T22:10:39.283180+0000","last_became_peered":"2023-07-21T22:10:39.283180+0000","last_unstale":"2023-07-21T22:10:40.643839+0000","last_undegraded":"2023-07-21T22:10:40.643839+0000","last_fullsized":"2023-07-21T22:10:40.643839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:38.593377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"30'10","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:52.945484+0000","last_change":"2023-07-21T22:10:34.185183+0000","last_active":"2023-07-21T22:10:52.945484+0000","last_peered":"2023-07-21T22:10:52.945484+0000","last_clean":"2023-07-21T22:10:52.945484+0000","last_became_active":"2023-07-21T22:10:34.184368+0000","last_became_peered":"2023-07-21T22:10:34.184368+0000","last_unstale":"2023-07-21T22:10:52.945484+0000","last_undegraded":"2023-07-21T22:10:52.945484+0000","last_fullsized":"2023-07-21T22:10:52.945484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:08:24.257997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263920+0000","last_change":"2023-07-21T22:10:35.177131+0000","last_active":"2023-07-21T22:10:40.263920+0000","last_peered":"2023-07-21T22:10:40.263920+0000","last_clean":"2023-07-21T22:10:40.263920+0000","last_became_active":"2023-07-21T22:10:35.176633+0000","last_became_peered":"2023-07-21T22:10:35.176633+0000","last_unstale":"2023-07-21T22:10:40.263920+0000","last_undegraded":"2023-07-21T22:10:40.263920+0000","last_fullsized":"2023-07-21T22:10:40.263920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:20:38.535159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145828+0000","last_change":"2023-07-21T22:10:39.287688+0000","last_active":"2023-07-21T22:10:41.145828+0000","last_peered":"2023-07-21T22:10:41.145828+0000","last_clean":"2023-07-21T22:10:41.145828+0000","last_became_active":"2023-07-21T22:10:39.285544+0000","last_became_peered":"2023-07-21T22:10:39.285544+0000","last_unstale":"2023-07-21T22:10:41.145828+0000","last_undegraded":"2023-07-21T22:10:41.145828+0000","last_fullsized":"2023-07-21T22:10:41.145828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:36.370365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264245+0000","last_change":"2023-07-21T22:10:35.176961+0000","last_active":"2023-07-21T22:10:40.264245+0000","last_peered":"2023-07-21T22:10:40.264245+0000","last_clean":"2023-07-21T22:10:40.264245+0000","last_became_active":"2023-07-21T22:10:35.175909+0000","last_became_peered":"2023-07-21T22:10:35.175909+0000","last_unstale":"2023-07-21T22:10:40.264245+0000","last_undegraded":"2023-07-21T22:10:40.264245+0000","last_fullsized":"2023-07-21T22:10:40.264245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:47:46.146151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146724+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:10:41.146724+0000","last_peered":"2023-07-21T22:10:41.146724+0000","last_clean":"2023-07-21T22:10:41.146724+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:10:41.146724+0000","last_undegraded":"2023-07-21T22:10:41.146724+0000","last_fullsized":"2023-07-21T22:10:41.146724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:47:22.065189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147620+0000","last_change":"2023-07-21T22:10:34.185463+0000","last_active":"2023-07-21T22:10:41.147620+0000","last_peered":"2023-07-21T22:10:41.147620+0000","last_clean":"2023-07-21T22:10:41.147620+0000","last_became_active":"2023-07-21T22:10:34.185164+0000","last_became_peered":"2023-07-21T22:10:34.185164+0000","last_unstale":"2023-07-21T22:10:41.147620+0000","last_undegraded":"2023-07-21T22:10:41.147620+0000","last_fullsized":"2023-07-21T22:10:41.147620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:07.490045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643172+0000","last_change":"2023-07-21T22:10:39.295728+0000","last_active":"2023-07-21T22:10:40.643172+0000","last_peered":"2023-07-21T22:10:40.643172+0000","last_clean":"2023-07-21T22:10:40.643172+0000","last_became_active":"2023-07-21T22:10:39.295285+0000","last_became_peered":"2023-07-21T22:10:39.295285+0000","last_unstale":"2023-07-21T22:10:40.643172+0000","last_undegraded":"2023-07-21T22:10:40.643172+0000","last_fullsized":"2023-07-21T22:10:40.643172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:42.629475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643332+0000","last_change":"2023-07-21T22:10:35.191518+0000","last_active":"2023-07-21T22:10:40.643332+0000","last_peered":"2023-07-21T22:10:40.643332+0000","last_clean":"2023-07-21T22:10:40.643332+0000","last_became_active":"2023-07-21T22:10:35.190851+0000","last_became_peered":"2023-07-21T22:10:35.190851+0000","last_unstale":"2023-07-21T22:10:40.643332+0000","last_undegraded":"2023-07-21T22:10:40.643332+0000","last_fullsized":"2023-07-21T22:10:40.643332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:31.644944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148333+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:10:41.148333+0000","last_peered":"2023-07-21T22:10:41.148333+0000","last_clean":"2023-07-21T22:10:41.148333+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:10:41.148333+0000","last_undegraded":"2023-07-21T22:10:41.148333+0000","last_fullsized":"2023-07-21T22:10:41.148333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:52.095138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644583+0000","last_change":"2023-07-21T22:10:34.180214+0000","last_active":"2023-07-21T22:10:40.644583+0000","last_peered":"2023-07-21T22:10:40.644583+0000","last_clean":"2023-07-21T22:10:40.644583+0000","last_became_active":"2023-07-21T22:10:34.179689+0000","last_became_peered":"2023-07-21T22:10:34.179689+0000","last_unstale":"2023-07-21T22:10:40.644583+0000","last_undegraded":"2023-07-21T22:10:40.644583+0000","last_fullsized":"2023-07-21T22:10:40.644583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:49.373811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263542+0000","last_change":"2023-07-21T22:10:39.277033+0000","last_active":"2023-07-21T22:10:40.263542+0000","last_peered":"2023-07-21T22:10:40.263542+0000","last_clean":"2023-07-21T22:10:40.263542+0000","last_became_active":"2023-07-21T22:10:39.276652+0000","last_became_peered":"2023-07-21T22:10:39.276652+0000","last_unstale":"2023-07-21T22:10:40.263542+0000","last_undegraded":"2023-07-21T22:10:40.263542+0000","last_fullsized":"2023-07-21T22:10:40.263542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:15:28.734422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146510+0000","last_change":"2023-07-21T22:10:35.183693+0000","last_active":"2023-07-21T22:10:41.146510+0000","last_peered":"2023-07-21T22:10:41.146510+0000","last_clean":"2023-07-21T22:10:41.146510+0000","last_became_active":"2023-07-21T22:10:35.182990+0000","last_became_peered":"2023-07-21T22:10:35.182990+0000","last_unstale":"2023-07-21T22:10:41.146510+0000","last_undegraded":"2023-07-21T22:10:41.146510+0000","last_fullsized":"2023-07-21T22:10:41.146510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:19:08.043869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147014+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:10:41.147014+0000","last_peered":"2023-07-21T22:10:41.147014+0000","last_clean":"2023-07-21T22:10:41.147014+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:10:41.147014+0000","last_undegraded":"2023-07-21T22:10:41.147014+0000","last_fullsized":"2023-07-21T22:10:41.147014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:42.440048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147957+0000","last_change":"2023-07-21T22:10:34.181525+0000","last_active":"2023-07-21T22:10:41.147957+0000","last_peered":"2023-07-21T22:10:41.147957+0000","last_clean":"2023-07-21T22:10:41.147957+0000","last_became_active":"2023-07-21T22:10:34.180865+0000","last_became_peered":"2023-07-21T22:10:34.180865+0000","last_unstale":"2023-07-21T22:10:41.147957+0000","last_undegraded":"2023-07-21T22:10:41.147957+0000","last_fullsized":"2023-07-21T22:10:41.147957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:18.845683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145191+0000","last_change":"2023-07-21T22:10:39.285010+0000","last_active":"2023-07-21T22:10:41.145191+0000","last_peered":"2023-07-21T22:10:41.145191+0000","last_clean":"2023-07-21T22:10:41.145191+0000","last_became_active":"2023-07-21T22:10:39.283077+0000","last_became_peered":"2023-07-21T22:10:39.283077+0000","last_unstale":"2023-07-21T22:10:41.145191+0000","last_undegraded":"2023-07-21T22:10:41.145191+0000","last_fullsized":"2023-07-21T22:10:41.145191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:07.012665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147524+0000","last_change":"2023-07-21T22:10:35.181554+0000","last_active":"2023-07-21T22:10:41.147524+0000","last_peered":"2023-07-21T22:10:41.147524+0000","last_clean":"2023-07-21T22:10:41.147524+0000","last_became_active":"2023-07-21T22:10:35.180489+0000","last_became_peered":"2023-07-21T22:10:35.180489+0000","last_unstale":"2023-07-21T22:10:41.147524+0000","last_undegraded":"2023-07-21T22:10:41.147524+0000","last_fullsized":"2023-07-21T22:10:41.147524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:10.196079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147886+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:10:41.147886+0000","last_peered":"2023-07-21T22:10:41.147886+0000","last_clean":"2023-07-21T22:10:41.147886+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:10:41.147886+0000","last_undegraded":"2023-07-21T22:10:41.147886+0000","last_fullsized":"2023-07-21T22:10:41.147886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:13.984747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266059+0000","last_change":"2023-07-21T22:10:34.190035+0000","last_active":"2023-07-21T22:10:40.266059+0000","last_peered":"2023-07-21T22:10:40.266059+0000","last_clean":"2023-07-21T22:10:40.266059+0000","last_became_active":"2023-07-21T22:10:34.188881+0000","last_became_peered":"2023-07-21T22:10:34.188881+0000","last_unstale":"2023-07-21T22:10:40.266059+0000","last_undegraded":"2023-07-21T22:10:40.266059+0000","last_fullsized":"2023-07-21T22:10:40.266059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:09.950174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146612+0000","last_change":"2023-07-21T22:10:39.279664+0000","last_active":"2023-07-21T22:10:41.146612+0000","last_peered":"2023-07-21T22:10:41.146612+0000","last_clean":"2023-07-21T22:10:41.146612+0000","last_became_active":"2023-07-21T22:10:39.279267+0000","last_became_peered":"2023-07-21T22:10:39.279267+0000","last_unstale":"2023-07-21T22:10:41.146612+0000","last_undegraded":"2023-07-21T22:10:41.146612+0000","last_fullsized":"2023-07-21T22:10:41.146612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:09.200877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147703+0000","last_change":"2023-07-21T22:10:35.182579+0000","last_active":"2023-07-21T22:10:41.147703+0000","last_peered":"2023-07-21T22:10:41.147703+0000","last_clean":"2023-07-21T22:10:41.147703+0000","last_became_active":"2023-07-21T22:10:35.182269+0000","last_became_peered":"2023-07-21T22:10:35.182269+0000","last_unstale":"2023-07-21T22:10:41.147703+0000","last_undegraded":"2023-07-21T22:10:41.147703+0000","last_fullsized":"2023-07-21T22:10:41.147703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:48.503179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264029+0000","last_change":"2023-07-21T22:10:34.188309+0000","last_active":"2023-07-21T22:10:40.264029+0000","last_peered":"2023-07-21T22:10:40.264029+0000","last_clean":"2023-07-21T22:10:40.264029+0000","last_became_active":"2023-07-21T22:10:34.187999+0000","last_became_peered":"2023-07-21T22:10:34.187999+0000","last_unstale":"2023-07-21T22:10:40.264029+0000","last_undegraded":"2023-07-21T22:10:40.264029+0000","last_fullsized":"2023-07-21T22:10:40.264029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:13:37.870348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265143+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:10:40.265143+0000","last_peered":"2023-07-21T22:10:40.265143+0000","last_clean":"2023-07-21T22:10:40.265143+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:10:40.265143+0000","last_undegraded":"2023-07-21T22:10:40.265143+0000","last_fullsized":"2023-07-21T22:10:40.265143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:42.440048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146356+0000","last_change":"2023-07-21T22:10:39.279822+0000","last_active":"2023-07-21T22:10:41.146356+0000","last_peered":"2023-07-21T22:10:41.146356+0000","last_clean":"2023-07-21T22:10:41.146356+0000","last_became_active":"2023-07-21T22:10:39.279315+0000","last_became_peered":"2023-07-21T22:10:39.279315+0000","last_unstale":"2023-07-21T22:10:41.146356+0000","last_undegraded":"2023-07-21T22:10:41.146356+0000","last_fullsized":"2023-07-21T22:10:41.146356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:04:04.200991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147521+0000","last_change":"2023-07-21T22:10:35.184632+0000","last_active":"2023-07-21T22:10:41.147521+0000","last_peered":"2023-07-21T22:10:41.147521+0000","last_clean":"2023-07-21T22:10:41.147521+0000","last_became_active":"2023-07-21T22:10:35.184294+0000","last_became_peered":"2023-07-21T22:10:35.184294+0000","last_unstale":"2023-07-21T22:10:41.147521+0000","last_undegraded":"2023-07-21T22:10:41.147521+0000","last_fullsized":"2023-07-21T22:10:41.147521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:54.515955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146420+0000","last_change":"2023-07-21T22:10:34.182197+0000","last_active":"2023-07-21T22:10:41.146420+0000","last_peered":"2023-07-21T22:10:41.146420+0000","last_clean":"2023-07-21T22:10:41.146420+0000","last_became_active":"2023-07-21T22:10:34.181919+0000","last_became_peered":"2023-07-21T22:10:34.181919+0000","last_unstale":"2023-07-21T22:10:41.146420+0000","last_undegraded":"2023-07-21T22:10:41.146420+0000","last_fullsized":"2023-07-21T22:10:41.146420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:55:27.605200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261707+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:10:40.261707+0000","last_peered":"2023-07-21T22:10:40.261707+0000","last_clean":"2023-07-21T22:10:40.261707+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:10:40.261707+0000","last_undegraded":"2023-07-21T22:10:40.261707+0000","last_fullsized":"2023-07-21T22:10:40.261707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:52.407450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262619+0000","last_change":"2023-07-21T22:10:39.289595+0000","last_active":"2023-07-21T22:10:40.262619+0000","last_peered":"2023-07-21T22:10:40.262619+0000","last_clean":"2023-07-21T22:10:40.262619+0000","last_became_active":"2023-07-21T22:10:39.289158+0000","last_became_peered":"2023-07-21T22:10:39.289158+0000","last_unstale":"2023-07-21T22:10:40.262619+0000","last_undegraded":"2023-07-21T22:10:40.262619+0000","last_fullsized":"2023-07-21T22:10:40.262619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:06:55.084320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147467+0000","last_change":"2023-07-21T22:10:35.185318+0000","last_active":"2023-07-21T22:10:41.147467+0000","last_peered":"2023-07-21T22:10:41.147467+0000","last_clean":"2023-07-21T22:10:41.147467+0000","last_became_active":"2023-07-21T22:10:35.185029+0000","last_became_peered":"2023-07-21T22:10:35.185029+0000","last_unstale":"2023-07-21T22:10:41.147467+0000","last_undegraded":"2023-07-21T22:10:41.147467+0000","last_fullsized":"2023-07-21T22:10:41.147467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:10.274416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145597+0000","last_change":"2023-07-21T22:10:34.189207+0000","last_active":"2023-07-21T22:10:41.145597+0000","last_peered":"2023-07-21T22:10:41.145597+0000","last_clean":"2023-07-21T22:10:41.145597+0000","last_became_active":"2023-07-21T22:10:34.188853+0000","last_became_peered":"2023-07-21T22:10:34.188853+0000","last_unstale":"2023-07-21T22:10:41.145597+0000","last_undegraded":"2023-07-21T22:10:41.145597+0000","last_fullsized":"2023-07-21T22:10:41.145597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:37:58.265151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145150+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:10:41.145150+0000","last_peered":"2023-07-21T22:10:41.145150+0000","last_clean":"2023-07-21T22:10:41.145150+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:10:41.145150+0000","last_undegraded":"2023-07-21T22:10:41.145150+0000","last_fullsized":"2023-07-21T22:10:41.145150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:03:10.317005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266651+0000","last_change":"2023-07-21T22:10:39.280697+0000","last_active":"2023-07-21T22:10:40.266651+0000","last_peered":"2023-07-21T22:10:40.266651+0000","last_clean":"2023-07-21T22:10:40.266651+0000","last_became_active":"2023-07-21T22:10:39.279870+0000","last_became_peered":"2023-07-21T22:10:39.279870+0000","last_unstale":"2023-07-21T22:10:40.266651+0000","last_undegraded":"2023-07-21T22:10:40.266651+0000","last_fullsized":"2023-07-21T22:10:40.266651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:32:46.379437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146280+0000","last_change":"2023-07-21T22:10:35.182836+0000","last_active":"2023-07-21T22:10:41.146280+0000","last_peered":"2023-07-21T22:10:41.146280+0000","last_clean":"2023-07-21T22:10:41.146280+0000","last_became_active":"2023-07-21T22:10:35.182544+0000","last_became_peered":"2023-07-21T22:10:35.182544+0000","last_unstale":"2023-07-21T22:10:41.146280+0000","last_undegraded":"2023-07-21T22:10:41.146280+0000","last_fullsized":"2023-07-21T22:10:41.146280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:50:33.337315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643783+0000","last_change":"2023-07-21T22:10:34.179261+0000","last_active":"2023-07-21T22:10:40.643783+0000","last_peered":"2023-07-21T22:10:40.643783+0000","last_clean":"2023-07-21T22:10:40.643783+0000","last_became_active":"2023-07-21T22:10:34.178960+0000","last_became_peered":"2023-07-21T22:10:34.178960+0000","last_unstale":"2023-07-21T22:10:40.643783+0000","last_undegraded":"2023-07-21T22:10:40.643783+0000","last_fullsized":"2023-07-21T22:10:40.643783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:06.437405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265850+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:10:40.265850+0000","last_peered":"2023-07-21T22:10:40.265850+0000","last_clean":"2023-07-21T22:10:40.265850+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:10:40.265850+0000","last_undegraded":"2023-07-21T22:10:40.265850+0000","last_fullsized":"2023-07-21T22:10:40.265850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:19:33.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":181,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145465+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:10:41.145465+0000","last_peered":"2023-07-21T22:10:41.145465+0000","last_clean":"2023-07-21T22:10:41.145465+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:10:41.145465+0000","last_undegraded":"2023-07-21T22:10:41.145465+0000","last_fullsized":"2023-07-21T22:10:41.145465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:21.070954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146227+0000","last_change":"2023-07-21T22:10:39.284150+0000","last_active":"2023-07-21T22:10:41.146227+0000","last_peered":"2023-07-21T22:10:41.146227+0000","last_clean":"2023-07-21T22:10:41.146227+0000","last_became_active":"2023-07-21T22:10:39.283381+0000","last_became_peered":"2023-07-21T22:10:39.283381+0000","last_unstale":"2023-07-21T22:10:41.146227+0000","last_undegraded":"2023-07-21T22:10:41.146227+0000","last_fullsized":"2023-07-21T22:10:41.146227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:15:59.402797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147452+0000","last_change":"2023-07-21T22:10:35.197136+0000","last_active":"2023-07-21T22:10:41.147452+0000","last_peered":"2023-07-21T22:10:41.147452+0000","last_clean":"2023-07-21T22:10:41.147452+0000","last_became_active":"2023-07-21T22:10:35.196793+0000","last_became_peered":"2023-07-21T22:10:35.196793+0000","last_unstale":"2023-07-21T22:10:41.147452+0000","last_undegraded":"2023-07-21T22:10:41.147452+0000","last_fullsized":"2023-07-21T22:10:41.147452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:58:58.416910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643562+0000","last_change":"2023-07-21T22:10:34.182106+0000","last_active":"2023-07-21T22:10:40.643562+0000","last_peered":"2023-07-21T22:10:40.643562+0000","last_clean":"2023-07-21T22:10:40.643562+0000","last_became_active":"2023-07-21T22:10:34.181808+0000","last_became_peered":"2023-07-21T22:10:34.181808+0000","last_unstale":"2023-07-21T22:10:40.643562+0000","last_undegraded":"2023-07-21T22:10:40.643562+0000","last_fullsized":"2023-07-21T22:10:40.643562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:42:55.768979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265150+0000","last_change":"2023-07-21T22:10:39.278199+0000","last_active":"2023-07-21T22:10:40.265150+0000","last_peered":"2023-07-21T22:10:40.265150+0000","last_clean":"2023-07-21T22:10:40.265150+0000","last_became_active":"2023-07-21T22:10:39.277773+0000","last_became_peered":"2023-07-21T22:10:39.277773+0000","last_unstale":"2023-07-21T22:10:40.265150+0000","last_undegraded":"2023-07-21T22:10:40.265150+0000","last_fullsized":"2023-07-21T22:10:40.265150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:32:06.176345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265331+0000","last_change":"2023-07-21T22:10:35.183217+0000","last_active":"2023-07-21T22:10:40.265331+0000","last_peered":"2023-07-21T22:10:40.265331+0000","last_clean":"2023-07-21T22:10:40.265331+0000","last_became_active":"2023-07-21T22:10:35.182856+0000","last_became_peered":"2023-07-21T22:10:35.182856+0000","last_unstale":"2023-07-21T22:10:40.265331+0000","last_undegraded":"2023-07-21T22:10:40.265331+0000","last_fullsized":"2023-07-21T22:10:40.265331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:30:25.920287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264485+0000","last_change":"2023-07-21T22:10:34.187410+0000","last_active":"2023-07-21T22:10:40.264485+0000","last_peered":"2023-07-21T22:10:40.264485+0000","last_clean":"2023-07-21T22:10:40.264485+0000","last_became_active":"2023-07-21T22:10:34.185501+0000","last_became_peered":"2023-07-21T22:10:34.185501+0000","last_unstale":"2023-07-21T22:10:40.264485+0000","last_undegraded":"2023-07-21T22:10:40.264485+0000","last_fullsized":"2023-07-21T22:10:40.264485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:39:44.435404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266593+0000","last_change":"2023-07-21T22:10:39.280745+0000","last_active":"2023-07-21T22:10:40.266593+0000","last_peered":"2023-07-21T22:10:40.266593+0000","last_clean":"2023-07-21T22:10:40.266593+0000","last_became_active":"2023-07-21T22:10:39.279223+0000","last_became_peered":"2023-07-21T22:10:39.279223+0000","last_unstale":"2023-07-21T22:10:40.266593+0000","last_undegraded":"2023-07-21T22:10:40.266593+0000","last_fullsized":"2023-07-21T22:10:40.266593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:54.403892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264956+0000","last_change":"2023-07-21T22:10:35.181575+0000","last_active":"2023-07-21T22:10:40.264956+0000","last_peered":"2023-07-21T22:10:40.264956+0000","last_clean":"2023-07-21T22:10:40.264956+0000","last_became_active":"2023-07-21T22:10:35.181328+0000","last_became_peered":"2023-07-21T22:10:35.181328+0000","last_unstale":"2023-07-21T22:10:40.264956+0000","last_undegraded":"2023-07-21T22:10:40.264956+0000","last_fullsized":"2023-07-21T22:10:40.264956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:42:35.913798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145748+0000","last_change":"2023-07-21T22:10:34.190677+0000","last_active":"2023-07-21T22:10:41.145748+0000","last_peered":"2023-07-21T22:10:41.145748+0000","last_clean":"2023-07-21T22:10:41.145748+0000","last_became_active":"2023-07-21T22:10:34.190379+0000","last_became_peered":"2023-07-21T22:10:34.190379+0000","last_unstale":"2023-07-21T22:10:41.145748+0000","last_undegraded":"2023-07-21T22:10:41.145748+0000","last_fullsized":"2023-07-21T22:10:41.145748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:28:46.376238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147094+0000","last_change":"2023-07-21T22:10:39.285099+0000","last_active":"2023-07-21T22:10:41.147094+0000","last_peered":"2023-07-21T22:10:41.147094+0000","last_clean":"2023-07-21T22:10:41.147094+0000","last_became_active":"2023-07-21T22:10:39.284046+0000","last_became_peered":"2023-07-21T22:10:39.284046+0000","last_unstale":"2023-07-21T22:10:41.147094+0000","last_undegraded":"2023-07-21T22:10:41.147094+0000","last_fullsized":"2023-07-21T22:10:41.147094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:49.251705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264528+0000","last_change":"2023-07-21T22:10:35.193709+0000","last_active":"2023-07-21T22:10:40.264528+0000","last_peered":"2023-07-21T22:10:40.264528+0000","last_clean":"2023-07-21T22:10:40.264528+0000","last_became_active":"2023-07-21T22:10:35.193409+0000","last_became_peered":"2023-07-21T22:10:35.193409+0000","last_unstale":"2023-07-21T22:10:40.264528+0000","last_undegraded":"2023-07-21T22:10:40.264528+0000","last_fullsized":"2023-07-21T22:10:40.264528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:01.253948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644277+0000","last_change":"2023-07-21T22:10:34.185707+0000","last_active":"2023-07-21T22:10:40.644277+0000","last_peered":"2023-07-21T22:10:40.644277+0000","last_clean":"2023-07-21T22:10:40.644277+0000","last_became_active":"2023-07-21T22:10:34.185415+0000","last_became_peered":"2023-07-21T22:10:34.185415+0000","last_unstale":"2023-07-21T22:10:40.644277+0000","last_undegraded":"2023-07-21T22:10:40.644277+0000","last_fullsized":"2023-07-21T22:10:40.644277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:01:57.132624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262536+0000","last_change":"2023-07-21T22:10:39.288923+0000","last_active":"2023-07-21T22:10:40.262536+0000","last_peered":"2023-07-21T22:10:40.262536+0000","last_clean":"2023-07-21T22:10:40.262536+0000","last_became_active":"2023-07-21T22:10:39.284848+0000","last_became_peered":"2023-07-21T22:10:39.284848+0000","last_unstale":"2023-07-21T22:10:40.262536+0000","last_undegraded":"2023-07-21T22:10:40.262536+0000","last_fullsized":"2023-07-21T22:10:40.262536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:54:17.869022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146100+0000","last_change":"2023-07-21T22:10:35.183881+0000","last_active":"2023-07-21T22:10:41.146100+0000","last_peered":"2023-07-21T22:10:41.146100+0000","last_clean":"2023-07-21T22:10:41.146100+0000","last_became_active":"2023-07-21T22:10:35.183392+0000","last_became_peered":"2023-07-21T22:10:35.183392+0000","last_unstale":"2023-07-21T22:10:41.146100+0000","last_undegraded":"2023-07-21T22:10:41.146100+0000","last_fullsized":"2023-07-21T22:10:41.146100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:17:44.809522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265587+0000","last_change":"2023-07-21T22:10:34.189475+0000","last_active":"2023-07-21T22:10:40.265587+0000","last_peered":"2023-07-21T22:10:40.265587+0000","last_clean":"2023-07-21T22:10:40.265587+0000","last_became_active":"2023-07-21T22:10:34.189101+0000","last_became_peered":"2023-07-21T22:10:34.189101+0000","last_unstale":"2023-07-21T22:10:40.265587+0000","last_undegraded":"2023-07-21T22:10:40.265587+0000","last_fullsized":"2023-07-21T22:10:40.265587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:48.235788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261969+0000","last_change":"2023-07-21T22:10:39.288287+0000","last_active":"2023-07-21T22:10:40.261969+0000","last_peered":"2023-07-21T22:10:40.261969+0000","last_clean":"2023-07-21T22:10:40.261969+0000","last_became_active":"2023-07-21T22:10:39.285298+0000","last_became_peered":"2023-07-21T22:10:39.285298+0000","last_unstale":"2023-07-21T22:10:40.261969+0000","last_undegraded":"2023-07-21T22:10:40.261969+0000","last_fullsized":"2023-07-21T22:10:40.261969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:50:45.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145472+0000","last_change":"2023-07-21T22:10:35.189604+0000","last_active":"2023-07-21T22:10:41.145472+0000","last_peered":"2023-07-21T22:10:41.145472+0000","last_clean":"2023-07-21T22:10:41.145472+0000","last_became_active":"2023-07-21T22:10:35.189358+0000","last_became_peered":"2023-07-21T22:10:35.189358+0000","last_unstale":"2023-07-21T22:10:41.145472+0000","last_undegraded":"2023-07-21T22:10:41.145472+0000","last_fullsized":"2023-07-21T22:10:41.145472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:57.173528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146814+0000","last_change":"2023-07-21T22:10:34.178611+0000","last_active":"2023-07-21T22:10:41.146814+0000","last_peered":"2023-07-21T22:10:41.146814+0000","last_clean":"2023-07-21T22:10:41.146814+0000","last_became_active":"2023-07-21T22:10:34.178321+0000","last_became_peered":"2023-07-21T22:10:34.178321+0000","last_unstale":"2023-07-21T22:10:41.146814+0000","last_undegraded":"2023-07-21T22:10:41.146814+0000","last_fullsized":"2023-07-21T22:10:41.146814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:39.236774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261985+0000","last_change":"2023-07-21T22:10:39.285122+0000","last_active":"2023-07-21T22:10:40.261985+0000","last_peered":"2023-07-21T22:10:40.261985+0000","last_clean":"2023-07-21T22:10:40.261985+0000","last_became_active":"2023-07-21T22:10:39.284637+0000","last_became_peered":"2023-07-21T22:10:39.284637+0000","last_unstale":"2023-07-21T22:10:40.261985+0000","last_undegraded":"2023-07-21T22:10:40.261985+0000","last_fullsized":"2023-07-21T22:10:40.261985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:54:50.939333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263932+0000","last_change":"2023-07-21T22:10:35.188636+0000","last_active":"2023-07-21T22:10:40.263932+0000","last_peered":"2023-07-21T22:10:40.263932+0000","last_clean":"2023-07-21T22:10:40.263932+0000","last_became_active":"2023-07-21T22:10:35.188298+0000","last_became_peered":"2023-07-21T22:10:35.188298+0000","last_unstale":"2023-07-21T22:10:40.263932+0000","last_undegraded":"2023-07-21T22:10:40.263932+0000","last_fullsized":"2023-07-21T22:10:40.263932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:18:45.368754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147220+0000","last_change":"2023-07-21T22:10:34.194251+0000","last_active":"2023-07-21T22:10:41.147220+0000","last_peered":"2023-07-21T22:10:41.147220+0000","last_clean":"2023-07-21T22:10:41.147220+0000","last_became_active":"2023-07-21T22:10:34.193914+0000","last_became_peered":"2023-07-21T22:10:34.193914+0000","last_unstale":"2023-07-21T22:10:41.147220+0000","last_undegraded":"2023-07-21T22:10:41.147220+0000","last_fullsized":"2023-07-21T22:10:41.147220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:18.845683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261519+0000","last_change":"2023-07-21T22:10:39.284893+0000","last_active":"2023-07-21T22:10:40.261519+0000","last_peered":"2023-07-21T22:10:40.261519+0000","last_clean":"2023-07-21T22:10:40.261519+0000","last_became_active":"2023-07-21T22:10:39.284465+0000","last_became_peered":"2023-07-21T22:10:39.284465+0000","last_unstale":"2023-07-21T22:10:40.261519+0000","last_undegraded":"2023-07-21T22:10:40.261519+0000","last_fullsized":"2023-07-21T22:10:40.261519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:08.368632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263217+0000","last_change":"2023-07-21T22:10:35.179108+0000","last_active":"2023-07-21T22:10:40.263217+0000","last_peered":"2023-07-21T22:10:40.263217+0000","last_clean":"2023-07-21T22:10:40.263217+0000","last_became_active":"2023-07-21T22:10:35.178860+0000","last_became_peered":"2023-07-21T22:10:35.178860+0000","last_unstale":"2023-07-21T22:10:40.263217+0000","last_undegraded":"2023-07-21T22:10:40.263217+0000","last_fullsized":"2023-07-21T22:10:40.263217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:10.196079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147218+0000","last_change":"2023-07-21T22:10:34.191213+0000","last_active":"2023-07-21T22:10:41.147218+0000","last_peered":"2023-07-21T22:10:41.147218+0000","last_clean":"2023-07-21T22:10:41.147218+0000","last_became_active":"2023-07-21T22:10:34.190864+0000","last_became_peered":"2023-07-21T22:10:34.190864+0000","last_unstale":"2023-07-21T22:10:41.147218+0000","last_undegraded":"2023-07-21T22:10:41.147218+0000","last_fullsized":"2023-07-21T22:10:41.147218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:48.235788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146089+0000","last_change":"2023-07-21T22:10:39.285659+0000","last_active":"2023-07-21T22:10:41.146089+0000","last_peered":"2023-07-21T22:10:41.146089+0000","last_clean":"2023-07-21T22:10:41.146089+0000","last_became_active":"2023-07-21T22:10:39.285107+0000","last_became_peered":"2023-07-21T22:10:39.285107+0000","last_unstale":"2023-07-21T22:10:41.146089+0000","last_undegraded":"2023-07-21T22:10:41.146089+0000","last_fullsized":"2023-07-21T22:10:41.146089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:49.251705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265541+0000","last_change":"2023-07-21T22:10:39.283176+0000","last_active":"2023-07-21T22:10:40.265541+0000","last_peered":"2023-07-21T22:10:40.265541+0000","last_clean":"2023-07-21T22:10:40.265541+0000","last_became_active":"2023-07-21T22:10:39.282822+0000","last_became_peered":"2023-07-21T22:10:39.282822+0000","last_unstale":"2023-07-21T22:10:40.265541+0000","last_undegraded":"2023-07-21T22:10:40.265541+0000","last_fullsized":"2023-07-21T22:10:40.265541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:44:45.486837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'8","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144843+0000","last_change":"2023-07-21T22:10:34.187632+0000","last_active":"2023-07-21T22:10:41.144843+0000","last_peered":"2023-07-21T22:10:41.144843+0000","last_clean":"2023-07-21T22:10:41.144843+0000","last_became_active":"2023-07-21T22:10:34.187327+0000","last_became_peered":"2023-07-21T22:10:34.187327+0000","last_unstale":"2023-07-21T22:10:41.144843+0000","last_undegraded":"2023-07-21T22:10:41.144843+0000","last_fullsized":"2023-07-21T22:10:41.144843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:29.738382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644454+0000","last_change":"2023-07-21T22:10:35.196258+0000","last_active":"2023-07-21T22:10:40.644454+0000","last_peered":"2023-07-21T22:10:40.644454+0000","last_clean":"2023-07-21T22:10:40.644454+0000","last_became_active":"2023-07-21T22:10:35.195943+0000","last_became_peered":"2023-07-21T22:10:35.195943+0000","last_unstale":"2023-07-21T22:10:40.644454+0000","last_undegraded":"2023-07-21T22:10:40.644454+0000","last_fullsized":"2023-07-21T22:10:40.644454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:53:55.769220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644298+0000","last_change":"2023-07-21T22:10:39.285606+0000","last_active":"2023-07-21T22:10:40.644298+0000","last_peered":"2023-07-21T22:10:40.644298+0000","last_clean":"2023-07-21T22:10:40.644298+0000","last_became_active":"2023-07-21T22:10:39.285013+0000","last_became_peered":"2023-07-21T22:10:39.285013+0000","last_unstale":"2023-07-21T22:10:40.644298+0000","last_undegraded":"2023-07-21T22:10:40.644298+0000","last_fullsized":"2023-07-21T22:10:40.644298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:09:27.124262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146727+0000","last_change":"2023-07-21T22:10:34.194383+0000","last_active":"2023-07-21T22:10:41.146727+0000","last_peered":"2023-07-21T22:10:41.146727+0000","last_clean":"2023-07-21T22:10:41.146727+0000","last_became_active":"2023-07-21T22:10:34.194063+0000","last_became_peered":"2023-07-21T22:10:34.194063+0000","last_unstale":"2023-07-21T22:10:41.146727+0000","last_undegraded":"2023-07-21T22:10:41.146727+0000","last_fullsized":"2023-07-21T22:10:41.146727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:09.182975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147842+0000","last_change":"2023-07-21T22:10:35.193372+0000","last_active":"2023-07-21T22:10:41.147842+0000","last_peered":"2023-07-21T22:10:41.147842+0000","last_clean":"2023-07-21T22:10:41.147842+0000","last_became_active":"2023-07-21T22:10:35.193099+0000","last_became_peered":"2023-07-21T22:10:35.193099+0000","last_unstale":"2023-07-21T22:10:41.147842+0000","last_undegraded":"2023-07-21T22:10:41.147842+0000","last_fullsized":"2023-07-21T22:10:41.147842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:18:34.792098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145663+0000","last_change":"2023-07-21T22:10:34.174760+0000","last_active":"2023-07-21T22:10:41.145663+0000","last_peered":"2023-07-21T22:10:41.145663+0000","last_clean":"2023-07-21T22:10:41.145663+0000","last_became_active":"2023-07-21T22:10:34.174412+0000","last_became_peered":"2023-07-21T22:10:34.174412+0000","last_unstale":"2023-07-21T22:10:41.145663+0000","last_undegraded":"2023-07-21T22:10:41.145663+0000","last_fullsized":"2023-07-21T22:10:41.145663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:49.434373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265838+0000","last_change":"2023-07-21T22:10:35.181797+0000","last_active":"2023-07-21T22:10:40.265838+0000","last_peered":"2023-07-21T22:10:40.265838+0000","last_clean":"2023-07-21T22:10:40.265838+0000","last_became_active":"2023-07-21T22:10:35.180383+0000","last_became_peered":"2023-07-21T22:10:35.180383+0000","last_unstale":"2023-07-21T22:10:40.265838+0000","last_undegraded":"2023-07-21T22:10:40.265838+0000","last_fullsized":"2023-07-21T22:10:40.265838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:58.158269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644090+0000","last_change":"2023-07-21T22:10:39.283924+0000","last_active":"2023-07-21T22:10:40.644090+0000","last_peered":"2023-07-21T22:10:40.644090+0000","last_clean":"2023-07-21T22:10:40.644090+0000","last_became_active":"2023-07-21T22:10:39.283524+0000","last_became_peered":"2023-07-21T22:10:39.283524+0000","last_unstale":"2023-07-21T22:10:40.644090+0000","last_undegraded":"2023-07-21T22:10:40.644090+0000","last_fullsized":"2023-07-21T22:10:40.644090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:10:21.482474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147082+0000","last_change":"2023-07-21T22:10:34.195049+0000","last_active":"2023-07-21T22:10:41.147082+0000","last_peered":"2023-07-21T22:10:41.147082+0000","last_clean":"2023-07-21T22:10:41.147082+0000","last_became_active":"2023-07-21T22:10:34.194734+0000","last_became_peered":"2023-07-21T22:10:34.194734+0000","last_unstale":"2023-07-21T22:10:41.147082+0000","last_undegraded":"2023-07-21T22:10:41.147082+0000","last_fullsized":"2023-07-21T22:10:41.147082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:19.034773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644242+0000","last_change":"2023-07-21T22:10:35.192516+0000","last_active":"2023-07-21T22:10:40.644242+0000","last_peered":"2023-07-21T22:10:40.644242+0000","last_clean":"2023-07-21T22:10:40.644242+0000","last_became_active":"2023-07-21T22:10:35.192223+0000","last_became_peered":"2023-07-21T22:10:35.192223+0000","last_unstale":"2023-07-21T22:10:40.644242+0000","last_undegraded":"2023-07-21T22:10:40.644242+0000","last_fullsized":"2023-07-21T22:10:40.644242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:35:11.828421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265637+0000","last_change":"2023-07-21T22:10:39.279488+0000","last_active":"2023-07-21T22:10:40.265637+0000","last_peered":"2023-07-21T22:10:40.265637+0000","last_clean":"2023-07-21T22:10:40.265637+0000","last_became_active":"2023-07-21T22:10:39.279003+0000","last_became_peered":"2023-07-21T22:10:39.279003+0000","last_unstale":"2023-07-21T22:10:40.265637+0000","last_undegraded":"2023-07-21T22:10:40.265637+0000","last_fullsized":"2023-07-21T22:10:40.265637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:23.941829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144554+0000","last_change":"2023-07-21T22:10:35.179763+0000","last_active":"2023-07-21T22:10:41.144554+0000","last_peered":"2023-07-21T22:10:41.144554+0000","last_clean":"2023-07-21T22:10:41.144554+0000","last_became_active":"2023-07-21T22:10:35.179461+0000","last_became_peered":"2023-07-21T22:10:35.179461+0000","last_unstale":"2023-07-21T22:10:41.144554+0000","last_undegraded":"2023-07-21T22:10:41.144554+0000","last_fullsized":"2023-07-21T22:10:41.144554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:26:37.683815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643259+0000","last_change":"2023-07-21T22:10:35.198489+0000","last_active":"2023-07-21T22:10:40.643259+0000","last_peered":"2023-07-21T22:10:40.643259+0000","last_clean":"2023-07-21T22:10:40.643259+0000","last_became_active":"2023-07-21T22:10:35.196445+0000","last_became_peered":"2023-07-21T22:10:35.196445+0000","last_unstale":"2023-07-21T22:10:40.643259+0000","last_undegraded":"2023-07-21T22:10:40.643259+0000","last_fullsized":"2023-07-21T22:10:40.643259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:44:28.401234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264788+0000","last_change":"2023-07-21T22:10:35.187176+0000","last_active":"2023-07-21T22:10:40.264788+0000","last_peered":"2023-07-21T22:10:40.264788+0000","last_clean":"2023-07-21T22:10:40.264788+0000","last_became_active":"2023-07-21T22:10:35.186863+0000","last_became_peered":"2023-07-21T22:10:35.186863+0000","last_unstale":"2023-07-21T22:10:40.264788+0000","last_undegraded":"2023-07-21T22:10:40.264788+0000","last_fullsized":"2023-07-21T22:10:40.264788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:06:49.659850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644061+0000","last_change":"2023-07-21T22:10:35.198787+0000","last_active":"2023-07-21T22:10:40.644061+0000","last_peered":"2023-07-21T22:10:40.644061+0000","last_clean":"2023-07-21T22:10:40.644061+0000","last_became_active":"2023-07-21T22:10:35.198500+0000","last_became_peered":"2023-07-21T22:10:35.198500+0000","last_unstale":"2023-07-21T22:10:40.644061+0000","last_undegraded":"2023-07-21T22:10:40.644061+0000","last_fullsized":"2023-07-21T22:10:40.644061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:53:24.242935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147817+0000","last_change":"2023-07-21T22:10:35.179417+0000","last_active":"2023-07-21T22:10:41.147817+0000","last_peered":"2023-07-21T22:10:41.147817+0000","last_clean":"2023-07-21T22:10:41.147817+0000","last_became_active":"2023-07-21T22:10:35.179102+0000","last_became_peered":"2023-07-21T22:10:35.179102+0000","last_unstale":"2023-07-21T22:10:41.147817+0000","last_undegraded":"2023-07-21T22:10:41.147817+0000","last_fullsized":"2023-07-21T22:10:41.147817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:44:41.403795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265823+0000","last_change":"2023-07-21T22:10:35.183678+0000","last_active":"2023-07-21T22:10:40.265823+0000","last_peered":"2023-07-21T22:10:40.265823+0000","last_clean":"2023-07-21T22:10:40.265823+0000","last_became_active":"2023-07-21T22:10:35.181954+0000","last_became_peered":"2023-07-21T22:10:35.181954+0000","last_unstale":"2023-07-21T22:10:40.265823+0000","last_undegraded":"2023-07-21T22:10:40.265823+0000","last_fullsized":"2023-07-21T22:10:40.265823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:51:47.919272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148183+0000","last_change":"2023-07-21T22:10:35.183172+0000","last_active":"2023-07-21T22:10:41.148183+0000","last_peered":"2023-07-21T22:10:41.148183+0000","last_clean":"2023-07-21T22:10:41.148183+0000","last_became_active":"2023-07-21T22:10:35.182810+0000","last_became_peered":"2023-07-21T22:10:35.182810+0000","last_unstale":"2023-07-21T22:10:41.148183+0000","last_undegraded":"2023-07-21T22:10:41.148183+0000","last_fullsized":"2023-07-21T22:10:41.148183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:48.176651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147386+0000","last_change":"2023-07-21T22:10:35.185656+0000","last_active":"2023-07-21T22:10:41.147386+0000","last_peered":"2023-07-21T22:10:41.147386+0000","last_clean":"2023-07-21T22:10:41.147386+0000","last_became_active":"2023-07-21T22:10:35.185351+0000","last_became_peered":"2023-07-21T22:10:35.185351+0000","last_unstale":"2023-07-21T22:10:41.147386+0000","last_undegraded":"2023-07-21T22:10:41.147386+0000","last_fullsized":"2023-07-21T22:10:41.147386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:37:12.318204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145095+0000","last_change":"2023-07-21T22:10:35.196481+0000","last_active":"2023-07-21T22:10:41.145095+0000","last_peered":"2023-07-21T22:10:41.145095+0000","last_clean":"2023-07-21T22:10:41.145095+0000","last_became_active":"2023-07-21T22:10:35.196158+0000","last_became_peered":"2023-07-21T22:10:35.196158+0000","last_unstale":"2023-07-21T22:10:41.145095+0000","last_undegraded":"2023-07-21T22:10:41.145095+0000","last_fullsized":"2023-07-21T22:10:41.145095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:32.007914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643201+0000","last_change":"2023-07-21T22:10:35.194616+0000","last_active":"2023-07-21T22:10:40.643201+0000","last_peered":"2023-07-21T22:10:40.643201+0000","last_clean":"2023-07-21T22:10:40.643201+0000","last_became_active":"2023-07-21T22:10:35.194326+0000","last_became_peered":"2023-07-21T22:10:35.194326+0000","last_unstale":"2023-07-21T22:10:40.643201+0000","last_undegraded":"2023-07-21T22:10:40.643201+0000","last_fullsized":"2023-07-21T22:10:40.643201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:54:51.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145426+0000","last_change":"2023-07-21T22:10:35.181759+0000","last_active":"2023-07-21T22:10:41.145426+0000","last_peered":"2023-07-21T22:10:41.145426+0000","last_clean":"2023-07-21T22:10:41.145426+0000","last_became_active":"2023-07-21T22:10:35.179939+0000","last_became_peered":"2023-07-21T22:10:35.179939+0000","last_unstale":"2023-07-21T22:10:41.145426+0000","last_undegraded":"2023-07-21T22:10:41.145426+0000","last_fullsized":"2023-07-21T22:10:41.145426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:59:17.361629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147050+0000","last_change":"2023-07-21T22:10:35.201621+0000","last_active":"2023-07-21T22:10:41.147050+0000","last_peered":"2023-07-21T22:10:41.147050+0000","last_clean":"2023-07-21T22:10:41.147050+0000","last_became_active":"2023-07-21T22:10:35.201242+0000","last_became_peered":"2023-07-21T22:10:35.201242+0000","last_unstale":"2023-07-21T22:10:41.147050+0000","last_undegraded":"2023-07-21T22:10:41.147050+0000","last_fullsized":"2023-07-21T22:10:41.147050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:44:41.403795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264570+0000","last_change":"2023-07-21T22:10:35.181975+0000","last_active":"2023-07-21T22:10:40.264570+0000","last_peered":"2023-07-21T22:10:40.264570+0000","last_clean":"2023-07-21T22:10:40.264570+0000","last_became_active":"2023-07-21T22:10:35.181368+0000","last_became_peered":"2023-07-21T22:10:35.181368+0000","last_unstale":"2023-07-21T22:10:40.264570+0000","last_undegraded":"2023-07-21T22:10:40.264570+0000","last_fullsized":"2023-07-21T22:10:40.264570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:44.586259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262782+0000","last_change":"2023-07-21T22:10:35.182687+0000","last_active":"2023-07-21T22:10:40.262782+0000","last_peered":"2023-07-21T22:10:40.262782+0000","last_clean":"2023-07-21T22:10:40.262782+0000","last_became_active":"2023-07-21T22:10:35.182369+0000","last_became_peered":"2023-07-21T22:10:35.182369+0000","last_unstale":"2023-07-21T22:10:40.262782+0000","last_undegraded":"2023-07-21T22:10:40.262782+0000","last_fullsized":"2023-07-21T22:10:40.262782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:47:37.395408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265158+0000","last_change":"2023-07-21T22:10:35.181596+0000","last_active":"2023-07-21T22:10:40.265158+0000","last_peered":"2023-07-21T22:10:40.265158+0000","last_clean":"2023-07-21T22:10:40.265158+0000","last_became_active":"2023-07-21T22:10:35.181343+0000","last_became_peered":"2023-07-21T22:10:35.181343+0000","last_unstale":"2023-07-21T22:10:40.265158+0000","last_undegraded":"2023-07-21T22:10:40.265158+0000","last_fullsized":"2023-07-21T22:10:40.265158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:00.862980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146323+0000","last_change":"2023-07-21T22:10:35.191662+0000","last_active":"2023-07-21T22:10:41.146323+0000","last_peered":"2023-07-21T22:10:41.146323+0000","last_clean":"2023-07-21T22:10:41.146323+0000","last_became_active":"2023-07-21T22:10:35.191389+0000","last_became_peered":"2023-07-21T22:10:35.191389+0000","last_unstale":"2023-07-21T22:10:41.146323+0000","last_undegraded":"2023-07-21T22:10:41.146323+0000","last_fullsized":"2023-07-21T22:10:41.146323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:49.731806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263421+0000","last_change":"2023-07-21T22:10:35.180343+0000","last_active":"2023-07-21T22:10:40.263421+0000","last_peered":"2023-07-21T22:10:40.263421+0000","last_clean":"2023-07-21T22:10:40.263421+0000","last_became_active":"2023-07-21T22:10:35.178216+0000","last_became_peered":"2023-07-21T22:10:35.178216+0000","last_unstale":"2023-07-21T22:10:40.263421+0000","last_undegraded":"2023-07-21T22:10:40.263421+0000","last_fullsized":"2023-07-21T22:10:40.263421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:28:03.815256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146613+0000","last_change":"2023-07-21T22:10:35.188474+0000","last_active":"2023-07-21T22:10:41.146613+0000","last_peered":"2023-07-21T22:10:41.146613+0000","last_clean":"2023-07-21T22:10:41.146613+0000","last_became_active":"2023-07-21T22:10:35.187957+0000","last_became_peered":"2023-07-21T22:10:35.187957+0000","last_unstale":"2023-07-21T22:10:41.146613+0000","last_undegraded":"2023-07-21T22:10:41.146613+0000","last_fullsized":"2023-07-21T22:10:41.146613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:58:58.416910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264825+0000","last_change":"2023-07-21T22:10:35.172559+0000","last_active":"2023-07-21T22:10:40.264825+0000","last_peered":"2023-07-21T22:10:40.264825+0000","last_clean":"2023-07-21T22:10:40.264825+0000","last_became_active":"2023-07-21T22:10:35.172297+0000","last_became_peered":"2023-07-21T22:10:35.172297+0000","last_unstale":"2023-07-21T22:10:40.264825+0000","last_undegraded":"2023-07-21T22:10:40.264825+0000","last_fullsized":"2023-07-21T22:10:40.264825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:40.249878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261736+0000","last_change":"2023-07-21T22:10:35.197849+0000","last_active":"2023-07-21T22:10:40.261736+0000","last_peered":"2023-07-21T22:10:40.261736+0000","last_clean":"2023-07-21T22:10:40.261736+0000","last_became_active":"2023-07-21T22:10:35.197518+0000","last_became_peered":"2023-07-21T22:10:35.197518+0000","last_unstale":"2023-07-21T22:10:40.261736+0000","last_undegraded":"2023-07-21T22:10:40.261736+0000","last_fullsized":"2023-07-21T22:10:40.261736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:14.080646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262913+0000","last_change":"2023-07-21T22:10:35.181027+0000","last_active":"2023-07-21T22:10:40.262913+0000","last_peered":"2023-07-21T22:10:40.262913+0000","last_clean":"2023-07-21T22:10:40.262913+0000","last_became_active":"2023-07-21T22:10:35.180649+0000","last_became_peered":"2023-07-21T22:10:35.180649+0000","last_unstale":"2023-07-21T22:10:40.262913+0000","last_undegraded":"2023-07-21T22:10:40.262913+0000","last_fullsized":"2023-07-21T22:10:40.262913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:43.732515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265501+0000","last_change":"2023-07-21T22:10:35.188747+0000","last_active":"2023-07-21T22:10:40.265501+0000","last_peered":"2023-07-21T22:10:40.265501+0000","last_clean":"2023-07-21T22:10:40.265501+0000","last_became_active":"2023-07-21T22:10:35.188468+0000","last_became_peered":"2023-07-21T22:10:35.188468+0000","last_unstale":"2023-07-21T22:10:40.265501+0000","last_undegraded":"2023-07-21T22:10:40.265501+0000","last_fullsized":"2023-07-21T22:10:40.265501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:36:18.273058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266392+0000","last_change":"2023-07-21T22:10:35.186280+0000","last_active":"2023-07-21T22:10:40.266392+0000","last_peered":"2023-07-21T22:10:40.266392+0000","last_clean":"2023-07-21T22:10:40.266392+0000","last_became_active":"2023-07-21T22:10:35.185899+0000","last_became_peered":"2023-07-21T22:10:35.185899+0000","last_unstale":"2023-07-21T22:10:40.266392+0000","last_undegraded":"2023-07-21T22:10:40.266392+0000","last_fullsized":"2023-07-21T22:10:40.266392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:58:24.147605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146096+0000","last_change":"2023-07-21T22:10:35.194217+0000","last_active":"2023-07-21T22:10:41.146096+0000","last_peered":"2023-07-21T22:10:41.146096+0000","last_clean":"2023-07-21T22:10:41.146096+0000","last_became_active":"2023-07-21T22:10:35.193943+0000","last_became_peered":"2023-07-21T22:10:35.193943+0000","last_unstale":"2023-07-21T22:10:41.146096+0000","last_undegraded":"2023-07-21T22:10:41.146096+0000","last_fullsized":"2023-07-21T22:10:41.146096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:08:11.726615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263158+0000","last_change":"2023-07-21T22:10:35.175314+0000","last_active":"2023-07-21T22:10:40.263158+0000","last_peered":"2023-07-21T22:10:40.263158+0000","last_clean":"2023-07-21T22:10:40.263158+0000","last_became_active":"2023-07-21T22:10:35.175046+0000","last_became_peered":"2023-07-21T22:10:35.175046+0000","last_unstale":"2023-07-21T22:10:40.263158+0000","last_undegraded":"2023-07-21T22:10:40.263158+0000","last_fullsized":"2023-07-21T22:10:40.263158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:54.515955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146323+0000","last_change":"2023-07-21T22:10:35.187761+0000","last_active":"2023-07-21T22:10:41.146323+0000","last_peered":"2023-07-21T22:10:41.146323+0000","last_clean":"2023-07-21T22:10:41.146323+0000","last_became_active":"2023-07-21T22:10:35.187432+0000","last_became_peered":"2023-07-21T22:10:35.187432+0000","last_unstale":"2023-07-21T22:10:41.146323+0000","last_undegraded":"2023-07-21T22:10:41.146323+0000","last_fullsized":"2023-07-21T22:10:41.146323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:37:12.318204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263742+0000","last_change":"2023-07-21T22:10:35.180975+0000","last_active":"2023-07-21T22:10:40.263742+0000","last_peered":"2023-07-21T22:10:40.263742+0000","last_clean":"2023-07-21T22:10:40.263742+0000","last_became_active":"2023-07-21T22:10:35.180610+0000","last_became_peered":"2023-07-21T22:10:35.180610+0000","last_unstale":"2023-07-21T22:10:40.263742+0000","last_undegraded":"2023-07-21T22:10:40.263742+0000","last_fullsized":"2023-07-21T22:10:40.263742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:24.993895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146787+0000","last_change":"2023-07-21T22:10:35.202116+0000","last_active":"2023-07-21T22:10:41.146787+0000","last_peered":"2023-07-21T22:10:41.146787+0000","last_clean":"2023-07-21T22:10:41.146787+0000","last_became_active":"2023-07-21T22:10:35.201807+0000","last_became_peered":"2023-07-21T22:10:35.201807+0000","last_unstale":"2023-07-21T22:10:41.146787+0000","last_undegraded":"2023-07-21T22:10:41.146787+0000","last_fullsized":"2023-07-21T22:10:41.146787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:03:42.309634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145678+0000","last_change":"2023-07-21T22:10:35.182990+0000","last_active":"2023-07-21T22:10:41.145678+0000","last_peered":"2023-07-21T22:10:41.145678+0000","last_clean":"2023-07-21T22:10:41.145678+0000","last_became_active":"2023-07-21T22:10:35.182451+0000","last_became_peered":"2023-07-21T22:10:35.182451+0000","last_unstale":"2023-07-21T22:10:41.145678+0000","last_undegraded":"2023-07-21T22:10:41.145678+0000","last_fullsized":"2023-07-21T22:10:41.145678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:52:17.840975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264696+0000","last_change":"2023-07-21T22:10:35.181124+0000","last_active":"2023-07-21T22:10:40.264696+0000","last_peered":"2023-07-21T22:10:40.264696+0000","last_clean":"2023-07-21T22:10:40.264696+0000","last_became_active":"2023-07-21T22:10:35.180857+0000","last_became_peered":"2023-07-21T22:10:35.180857+0000","last_unstale":"2023-07-21T22:10:40.264696+0000","last_undegraded":"2023-07-21T22:10:40.264696+0000","last_fullsized":"2023-07-21T22:10:40.264696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:20:59.226705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266167+0000","last_change":"2023-07-21T22:10:35.178260+0000","last_active":"2023-07-21T22:10:40.266167+0000","last_peered":"2023-07-21T22:10:40.266167+0000","last_clean":"2023-07-21T22:10:40.266167+0000","last_became_active":"2023-07-21T22:10:35.178006+0000","last_became_peered":"2023-07-21T22:10:35.178006+0000","last_unstale":"2023-07-21T22:10:40.266167+0000","last_undegraded":"2023-07-21T22:10:40.266167+0000","last_fullsized":"2023-07-21T22:10:40.266167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:58:45.344226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262442+0000","last_change":"2023-07-21T22:10:35.197676+0000","last_active":"2023-07-21T22:10:40.262442+0000","last_peered":"2023-07-21T22:10:40.262442+0000","last_clean":"2023-07-21T22:10:40.262442+0000","last_became_active":"2023-07-21T22:10:35.197328+0000","last_became_peered":"2023-07-21T22:10:35.197328+0000","last_unstale":"2023-07-21T22:10:40.262442+0000","last_undegraded":"2023-07-21T22:10:40.262442+0000","last_fullsized":"2023-07-21T22:10:40.262442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:17:58.266481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":724807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":130430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":327680,"data_stored":131082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":339968,"data_stored":134279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":323584,"data_stored":130520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":319488,"data_stored":130430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":917504,"data_stored":721380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":130430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6120000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:11:03.359 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:11:03.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.537+0000 7f5ea5765700 1 Processor -- start 2023-07-21T22:11:03.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.537+0000 7f5ea5765700 1 -- start start 2023-07-21T22:11:03.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.537+0000 7f5ea5765700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea00ab8d0 0x7f5ea00afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:03.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.537+0000 7f5ea5765700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5ea00cb800 0x7f5ea00b0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:03.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.537+0000 7f5ea5765700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea00cdd70 con 0x7f5ea015c0a0 2023-07-21T22:11:03.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.537+0000 7f5ea5765700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea00abdd0 con 0x7f5ea00cb800 2023-07-21T22:11:03.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.537+0000 7f5ea5765700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea00ccab0 con 0x7f5ea00ab8d0 2023-07-21T22:11:03.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5e9f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5ea00cb800 0x7f5ea00b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:03.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5e9e7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea00ab8d0 0x7f5ea00afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:03.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5e9f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5ea00cb800 0x7f5ea00b0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:38912/0 (socket says 172.21.15.49:38912) 2023-07-21T22:11:03.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5e9f7fe700 1 -- 172.21.15.49:0/1592260629 learned_addr learned my addr 172.21.15.49:0/1592260629 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:03.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5e9f7fe700 1 -- 172.21.15.49:0/1592260629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea00ab8d0 msgr2=0x7f5ea00afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:03.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5e9f7fe700 1 --2- 172.21.15.49:0/1592260629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea00ab8d0 0x7f5ea00afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5e9f7fe700 1 -- 172.21.15.49:0/1592260629 >> v1:172.21.15.150:6789/0 conn(0x7f5ea015c0a0 legacy=0x7f5ea00ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:03.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5e9f7fe700 1 -- 172.21.15.49:0/1592260629 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea00cda40 con 0x7f5ea00cb800 2023-07-21T22:11:03.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5e9f7fe700 1 --2- 172.21.15.49:0/1592260629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea00cb800 0x7f5ea00b0160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009e50 tx=0x7f5e9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b6bbd22ceef5bf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:03.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5e9dffb700 1 -- 172.21.15.49:0/1592260629 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9800e070 con 0x7f5ea00cb800 2023-07-21T22:11:03.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5e9dffb700 1 -- 172.21.15.49:0/1592260629 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9800b910 con 0x7f5ea00cb800 2023-07-21T22:11:03.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5e9dffb700 1 -- 172.21.15.49:0/1592260629 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9800bcc0 con 0x7f5ea00cb800 2023-07-21T22:11:03.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5ea5765700 1 -- 172.21.15.49:0/1592260629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea00cb800 msgr2=0x7f5ea00b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:03.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5ea5765700 1 --2- 172.21.15.49:0/1592260629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea00cb800 0x7f5ea00b0160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009e50 tx=0x7f5e9800b330 comp rx=0 tx=0).stop 2023-07-21T22:11:03.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5ea5765700 1 -- 172.21.15.49:0/1592260629 shutdown_connections 2023-07-21T22:11:03.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5ea5765700 1 --2- 172.21.15.49:0/1592260629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea00ab8d0 0x7f5ea00afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5ea5765700 1 --2- 172.21.15.49:0/1592260629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea00cb800 0x7f5ea00b0160 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5ea5765700 1 -- 172.21.15.49:0/1592260629 >> 172.21.15.49:0/1592260629 conn(0x7f5ea006f5a0 msgr2=0x7f5ea00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:03.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5ea5765700 1 -- 172.21.15.49:0/1592260629 shutdown_connections 2023-07-21T22:11:03.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.541+0000 7f5ea5765700 1 -- 172.21.15.49:0/1592260629 wait complete. 2023-07-21T22:11:03.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.545+0000 7f5ea5765700 1 Processor -- start 2023-07-21T22:11:03.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.545+0000 7f5ea5765700 1 -- start start 2023-07-21T22:11:03.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5ea5765700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea00ab8d0 0x7f5ea00b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:03.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5ea5765700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea00cb800 0x7f5ea00c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:03.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5ea5765700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea015c0a0 0x7f5ea0158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:03.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5ea5765700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea0152270 con 0x7f5ea00ab8d0 2023-07-21T22:11:03.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5ea5765700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea0151350 con 0x7f5ea015c0a0 2023-07-21T22:11:03.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5ea5765700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea01515f0 con 0x7f5ea00cb800 2023-07-21T22:11:03.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e9effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea00ab8d0 0x7f5ea00b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:03.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e9effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea00ab8d0 0x7f5ea00b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46524/0 (socket says 172.21.15.49:46524) 2023-07-21T22:11:03.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e9effd700 1 -- 172.21.15.49:0/654497221 learned_addr learned my addr 172.21.15.49:0/654497221 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:03.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e9e7fc700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea00cb800 0x7f5ea00c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:03.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e9f7fe700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea015c0a0 0x7f5ea0158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:03.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e9effd700 1 -- 172.21.15.49:0/654497221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea00cb800 msgr2=0x7f5ea00c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:03.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e9effd700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea00cb800 0x7f5ea00c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e9effd700 1 -- 172.21.15.49:0/654497221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea015c0a0 msgr2=0x7f5ea0158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:03.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e9effd700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea015c0a0 0x7f5ea0158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e9effd700 1 -- 172.21.15.49:0/654497221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e98009b30 con 0x7f5ea00ab8d0 2023-07-21T22:11:03.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e9e7fc700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea00cb800 0x7f5ea00c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:03.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e9effd700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea00ab8d0 0x7f5ea00b3730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000c500 tx=0x7f5e9000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:03.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e877fe700 1 -- 172.21.15.49:0/654497221 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e900052d0 con 0x7f5ea00ab8d0 2023-07-21T22:11:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e877fe700 1 -- 172.21.15.49:0/654497221 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e90005430 con 0x7f5ea00ab8d0 2023-07-21T22:11:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5ea5765700 1 -- 172.21.15.49:0/654497221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea01518d0 con 0x7f5ea00ab8d0 2023-07-21T22:11:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5e877fe700 1 -- 172.21.15.49:0/654497221 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e900055a0 con 0x7f5ea00ab8d0 2023-07-21T22:11:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.549+0000 7f5ea5765700 1 -- 172.21.15.49:0/654497221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea0151e90 con 0x7f5ea00ab8d0 2023-07-21T22:11:03.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.553+0000 7f5ea5765700 1 -- 172.21.15.49:0/654497221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea00ac5b0 con 0x7f5ea00ab8d0 2023-07-21T22:11:03.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.553+0000 7f5e877fe700 1 -- 172.21.15.49:0/654497221 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e900038e0 con 0x7f5ea00ab8d0 2023-07-21T22:11:03.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.557+0000 7f5e877fe700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5e8c0662f0 0x7f5e8c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:03.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.557+0000 7f5e877fe700 1 -- 172.21.15.49:0/654497221 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e900833f0 con 0x7f5ea00ab8d0 2023-07-21T22:11:03.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.557+0000 7f5e9e7fc700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5e8c0662f0 0x7f5e8c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:03.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.557+0000 7f5e9e7fc700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5e8c0662f0 0x7f5e8c0687a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00c5220 tx=0x7f5e94008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.565+0000 7f5e877fe700 1 -- 172.21.15.49:0/654497221 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5e900504f0 con 0x7f5ea00ab8d0 2023-07-21T22:11:03.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.737+0000 7f5ea5765700 1 -- 172.21.15.49:0/654497221 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ea00ccfa0 con 0x7f5e8c0662f0 2023-07-21T22:11:03.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.753+0000 7f5e877fe700 1 -- 172.21.15.49:0/654497221 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367063 (secure 0 0 0) 0x7f5e94011830 con 0x7f5e8c0662f0 2023-07-21T22:11:03.803 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:03.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.765+0000 7f5ea5765700 1 -- 172.21.15.49:0/654497221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5e8c0662f0 msgr2=0x7f5e8c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:03.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.765+0000 7f5ea5765700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5e8c0662f0 0x7f5e8c0687a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00c5220 tx=0x7f5e94008040 comp rx=0 tx=0).stop 2023-07-21T22:11:03.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.765+0000 7f5ea5765700 1 -- 172.21.15.49:0/654497221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea00ab8d0 msgr2=0x7f5ea00b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:03.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.765+0000 7f5ea5765700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea00ab8d0 0x7f5ea00b3730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000c500 tx=0x7f5e9000c810 comp rx=0 tx=0).stop 2023-07-21T22:11:03.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.765+0000 7f5ea5765700 1 -- 172.21.15.49:0/654497221 shutdown_connections 2023-07-21T22:11:03.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.765+0000 7f5ea5765700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5e8c0662f0 0x7f5e8c0687a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.765+0000 7f5ea5765700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea015c0a0 0x7f5ea0158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.765+0000 7f5ea5765700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea00cb800 0x7f5ea00c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.765+0000 7f5ea5765700 1 --2- 172.21.15.49:0/654497221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea00ab8d0 0x7f5ea00b3730 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.765+0000 7f5ea5765700 1 -- 172.21.15.49:0/654497221 >> 172.21.15.49:0/654497221 conn(0x7f5ea006f5a0 msgr2=0x7f5ea006bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.765+0000 7f5ea5765700 1 -- 172.21.15.49:0/654497221 shutdown_connections 2023-07-21T22:11:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:03.765+0000 7f5ea5765700 1 -- 172.21.15.49:0/654497221 wait complete. 2023-07-21T22:11:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:11:03.832 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-07-21T22:11:02.311434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231624,"kb_used_data":3720,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754743096,"statfs":{"total":773094113280,"available":772856930304,"internally_reserved":0,"allocated":3809280,"data_stored":2233358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005408"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148041+0000","last_change":"2023-07-21T22:10:39.285920+0000","last_active":"2023-07-21T22:10:41.148041+0000","last_peered":"2023-07-21T22:10:41.148041+0000","last_clean":"2023-07-21T22:10:41.148041+0000","last_became_active":"2023-07-21T22:10:39.285402+0000","last_became_peered":"2023-07-21T22:10:39.285402+0000","last_unstale":"2023-07-21T22:10:41.148041+0000","last_undegraded":"2023-07-21T22:10:41.148041+0000","last_fullsized":"2023-07-21T22:10:41.148041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:53.331934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146444+0000","last_change":"2023-07-21T22:10:34.187231+0000","last_active":"2023-07-21T22:10:41.146444+0000","last_peered":"2023-07-21T22:10:41.146444+0000","last_clean":"2023-07-21T22:10:41.146444+0000","last_became_active":"2023-07-21T22:10:34.186893+0000","last_became_peered":"2023-07-21T22:10:34.186893+0000","last_unstale":"2023-07-21T22:10:41.146444+0000","last_undegraded":"2023-07-21T22:10:41.146444+0000","last_fullsized":"2023-07-21T22:10:41.146444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:35:27.556960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263558+0000","last_change":"2023-07-21T22:10:35.187303+0000","last_active":"2023-07-21T22:10:40.263558+0000","last_peered":"2023-07-21T22:10:40.263558+0000","last_clean":"2023-07-21T22:10:40.263558+0000","last_became_active":"2023-07-21T22:10:35.186998+0000","last_became_peered":"2023-07-21T22:10:35.186998+0000","last_unstale":"2023-07-21T22:10:40.263558+0000","last_undegraded":"2023-07-21T22:10:40.263558+0000","last_fullsized":"2023-07-21T22:10:40.263558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:14.259344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263311+0000","last_change":"2023-07-21T22:10:39.284321+0000","last_active":"2023-07-21T22:10:40.263311+0000","last_peered":"2023-07-21T22:10:40.263311+0000","last_clean":"2023-07-21T22:10:40.263311+0000","last_became_active":"2023-07-21T22:10:39.283184+0000","last_became_peered":"2023-07-21T22:10:39.283184+0000","last_unstale":"2023-07-21T22:10:40.263311+0000","last_undegraded":"2023-07-21T22:10:40.263311+0000","last_fullsized":"2023-07-21T22:10:40.263311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:02:07.314838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643758+0000","last_change":"2023-07-21T22:10:34.183067+0000","last_active":"2023-07-21T22:10:40.643758+0000","last_peered":"2023-07-21T22:10:40.643758+0000","last_clean":"2023-07-21T22:10:40.643758+0000","last_became_active":"2023-07-21T22:10:34.182744+0000","last_became_peered":"2023-07-21T22:10:34.182744+0000","last_unstale":"2023-07-21T22:10:40.643758+0000","last_undegraded":"2023-07-21T22:10:40.643758+0000","last_fullsized":"2023-07-21T22:10:40.643758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:16:50.409495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643472+0000","last_change":"2023-07-21T22:10:35.193952+0000","last_active":"2023-07-21T22:10:40.643472+0000","last_peered":"2023-07-21T22:10:40.643472+0000","last_clean":"2023-07-21T22:10:40.643472+0000","last_became_active":"2023-07-21T22:10:35.193594+0000","last_became_peered":"2023-07-21T22:10:35.193594+0000","last_unstale":"2023-07-21T22:10:40.643472+0000","last_undegraded":"2023-07-21T22:10:40.643472+0000","last_fullsized":"2023-07-21T22:10:40.643472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:23:35.116197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265724+0000","last_change":"2023-07-21T22:10:39.275701+0000","last_active":"2023-07-21T22:10:40.265724+0000","last_peered":"2023-07-21T22:10:40.265724+0000","last_clean":"2023-07-21T22:10:40.265724+0000","last_became_active":"2023-07-21T22:10:39.275276+0000","last_became_peered":"2023-07-21T22:10:39.275276+0000","last_unstale":"2023-07-21T22:10:40.265724+0000","last_undegraded":"2023-07-21T22:10:40.265724+0000","last_fullsized":"2023-07-21T22:10:40.265724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:52.259693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266022+0000","last_change":"2023-07-21T22:10:34.189037+0000","last_active":"2023-07-21T22:10:40.266022+0000","last_peered":"2023-07-21T22:10:40.266022+0000","last_clean":"2023-07-21T22:10:40.266022+0000","last_became_active":"2023-07-21T22:10:34.188705+0000","last_became_peered":"2023-07-21T22:10:34.188705+0000","last_unstale":"2023-07-21T22:10:40.266022+0000","last_undegraded":"2023-07-21T22:10:40.266022+0000","last_fullsized":"2023-07-21T22:10:40.266022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:32:09.815085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264089+0000","last_change":"2023-07-21T22:10:35.190920+0000","last_active":"2023-07-21T22:10:40.264089+0000","last_peered":"2023-07-21T22:10:40.264089+0000","last_clean":"2023-07-21T22:10:40.264089+0000","last_became_active":"2023-07-21T22:10:35.190624+0000","last_became_peered":"2023-07-21T22:10:35.190624+0000","last_unstale":"2023-07-21T22:10:40.264089+0000","last_undegraded":"2023-07-21T22:10:40.264089+0000","last_fullsized":"2023-07-21T22:10:40.264089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:24:44.643941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145887+0000","last_change":"2023-07-21T22:10:39.288143+0000","last_active":"2023-07-21T22:10:41.145887+0000","last_peered":"2023-07-21T22:10:41.145887+0000","last_clean":"2023-07-21T22:10:41.145887+0000","last_became_active":"2023-07-21T22:10:39.287727+0000","last_became_peered":"2023-07-21T22:10:39.287727+0000","last_unstale":"2023-07-21T22:10:41.145887+0000","last_undegraded":"2023-07-21T22:10:41.145887+0000","last_fullsized":"2023-07-21T22:10:41.145887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:55:32.701346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265495+0000","last_change":"2023-07-21T22:10:34.189233+0000","last_active":"2023-07-21T22:10:40.265495+0000","last_peered":"2023-07-21T22:10:40.265495+0000","last_clean":"2023-07-21T22:10:40.265495+0000","last_became_active":"2023-07-21T22:10:34.188693+0000","last_became_peered":"2023-07-21T22:10:34.188693+0000","last_unstale":"2023-07-21T22:10:40.265495+0000","last_undegraded":"2023-07-21T22:10:40.265495+0000","last_fullsized":"2023-07-21T22:10:40.265495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:19.034773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263831+0000","last_change":"2023-07-21T22:10:35.196227+0000","last_active":"2023-07-21T22:10:40.263831+0000","last_peered":"2023-07-21T22:10:40.263831+0000","last_clean":"2023-07-21T22:10:40.263831+0000","last_became_active":"2023-07-21T22:10:35.195975+0000","last_became_peered":"2023-07-21T22:10:35.195975+0000","last_unstale":"2023-07-21T22:10:40.263831+0000","last_undegraded":"2023-07-21T22:10:40.263831+0000","last_fullsized":"2023-07-21T22:10:40.263831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:42:02.828468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147542+0000","last_change":"2023-07-21T22:10:39.286940+0000","last_active":"2023-07-21T22:10:41.147542+0000","last_peered":"2023-07-21T22:10:41.147542+0000","last_clean":"2023-07-21T22:10:41.147542+0000","last_became_active":"2023-07-21T22:10:39.286471+0000","last_became_peered":"2023-07-21T22:10:39.286471+0000","last_unstale":"2023-07-21T22:10:41.147542+0000","last_undegraded":"2023-07-21T22:10:41.147542+0000","last_fullsized":"2023-07-21T22:10:41.147542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:44.332920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147513+0000","last_change":"2023-07-21T22:10:34.195078+0000","last_active":"2023-07-21T22:10:41.147513+0000","last_peered":"2023-07-21T22:10:41.147513+0000","last_clean":"2023-07-21T22:10:41.147513+0000","last_became_active":"2023-07-21T22:10:34.194778+0000","last_became_peered":"2023-07-21T22:10:34.194778+0000","last_unstale":"2023-07-21T22:10:41.147513+0000","last_undegraded":"2023-07-21T22:10:41.147513+0000","last_fullsized":"2023-07-21T22:10:41.147513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:13:31.016122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262886+0000","last_change":"2023-07-21T22:10:35.184187+0000","last_active":"2023-07-21T22:10:40.262886+0000","last_peered":"2023-07-21T22:10:40.262886+0000","last_clean":"2023-07-21T22:10:40.262886+0000","last_became_active":"2023-07-21T22:10:35.183664+0000","last_became_peered":"2023-07-21T22:10:35.183664+0000","last_unstale":"2023-07-21T22:10:40.262886+0000","last_undegraded":"2023-07-21T22:10:40.262886+0000","last_fullsized":"2023-07-21T22:10:40.262886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:17:19.358440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264275+0000","last_change":"2023-07-21T22:10:39.277910+0000","last_active":"2023-07-21T22:10:40.264275+0000","last_peered":"2023-07-21T22:10:40.264275+0000","last_clean":"2023-07-21T22:10:40.264275+0000","last_became_active":"2023-07-21T22:10:39.277601+0000","last_became_peered":"2023-07-21T22:10:39.277601+0000","last_unstale":"2023-07-21T22:10:40.264275+0000","last_undegraded":"2023-07-21T22:10:40.264275+0000","last_fullsized":"2023-07-21T22:10:40.264275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:41:03.813859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264319+0000","last_change":"2023-07-21T22:10:34.181116+0000","last_active":"2023-07-21T22:10:40.264319+0000","last_peered":"2023-07-21T22:10:40.264319+0000","last_clean":"2023-07-21T22:10:40.264319+0000","last_became_active":"2023-07-21T22:10:34.180817+0000","last_became_peered":"2023-07-21T22:10:34.180817+0000","last_unstale":"2023-07-21T22:10:40.264319+0000","last_undegraded":"2023-07-21T22:10:40.264319+0000","last_fullsized":"2023-07-21T22:10:40.264319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:29.537599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644380+0000","last_change":"2023-07-21T22:10:35.198715+0000","last_active":"2023-07-21T22:10:40.644380+0000","last_peered":"2023-07-21T22:10:40.644380+0000","last_clean":"2023-07-21T22:10:40.644380+0000","last_became_active":"2023-07-21T22:10:35.196452+0000","last_became_peered":"2023-07-21T22:10:35.196452+0000","last_unstale":"2023-07-21T22:10:40.644380+0000","last_undegraded":"2023-07-21T22:10:40.644380+0000","last_fullsized":"2023-07-21T22:10:40.644380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:54.017939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146548+0000","last_change":"2023-07-21T22:10:39.282183+0000","last_active":"2023-07-21T22:10:41.146548+0000","last_peered":"2023-07-21T22:10:41.146548+0000","last_clean":"2023-07-21T22:10:41.146548+0000","last_became_active":"2023-07-21T22:10:39.281786+0000","last_became_peered":"2023-07-21T22:10:39.281786+0000","last_unstale":"2023-07-21T22:10:41.146548+0000","last_undegraded":"2023-07-21T22:10:41.146548+0000","last_fullsized":"2023-07-21T22:10:41.146548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:36.102033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148156+0000","last_change":"2023-07-21T22:10:34.189390+0000","last_active":"2023-07-21T22:10:41.148156+0000","last_peered":"2023-07-21T22:10:41.148156+0000","last_clean":"2023-07-21T22:10:41.148156+0000","last_became_active":"2023-07-21T22:10:34.189100+0000","last_became_peered":"2023-07-21T22:10:34.189100+0000","last_unstale":"2023-07-21T22:10:41.148156+0000","last_undegraded":"2023-07-21T22:10:41.148156+0000","last_fullsized":"2023-07-21T22:10:41.148156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:51:46.906168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146955+0000","last_change":"2023-07-21T22:10:35.186334+0000","last_active":"2023-07-21T22:10:41.146955+0000","last_peered":"2023-07-21T22:10:41.146955+0000","last_clean":"2023-07-21T22:10:41.146955+0000","last_became_active":"2023-07-21T22:10:35.186027+0000","last_became_peered":"2023-07-21T22:10:35.186027+0000","last_unstale":"2023-07-21T22:10:41.146955+0000","last_undegraded":"2023-07-21T22:10:41.146955+0000","last_fullsized":"2023-07-21T22:10:41.146955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:26.382303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146339+0000","last_change":"2023-07-21T22:10:39.283921+0000","last_active":"2023-07-21T22:10:41.146339+0000","last_peered":"2023-07-21T22:10:41.146339+0000","last_clean":"2023-07-21T22:10:41.146339+0000","last_became_active":"2023-07-21T22:10:39.283579+0000","last_became_peered":"2023-07-21T22:10:39.283579+0000","last_unstale":"2023-07-21T22:10:41.146339+0000","last_undegraded":"2023-07-21T22:10:41.146339+0000","last_fullsized":"2023-07-21T22:10:41.146339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:33:27.956737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643473+0000","last_change":"2023-07-21T22:10:34.185811+0000","last_active":"2023-07-21T22:10:40.643473+0000","last_peered":"2023-07-21T22:10:40.643473+0000","last_clean":"2023-07-21T22:10:40.643473+0000","last_became_active":"2023-07-21T22:10:34.185528+0000","last_became_peered":"2023-07-21T22:10:34.185528+0000","last_unstale":"2023-07-21T22:10:40.643473+0000","last_undegraded":"2023-07-21T22:10:40.643473+0000","last_fullsized":"2023-07-21T22:10:40.643473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:32:55.911711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146562+0000","last_change":"2023-07-21T22:10:35.181437+0000","last_active":"2023-07-21T22:10:41.146562+0000","last_peered":"2023-07-21T22:10:41.146562+0000","last_clean":"2023-07-21T22:10:41.146562+0000","last_became_active":"2023-07-21T22:10:35.181153+0000","last_became_peered":"2023-07-21T22:10:35.181153+0000","last_unstale":"2023-07-21T22:10:41.146562+0000","last_undegraded":"2023-07-21T22:10:41.146562+0000","last_fullsized":"2023-07-21T22:10:41.146562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:15.974063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643126+0000","last_change":"2023-07-21T22:10:35.191719+0000","last_active":"2023-07-21T22:10:40.643126+0000","last_peered":"2023-07-21T22:10:40.643126+0000","last_clean":"2023-07-21T22:10:40.643126+0000","last_became_active":"2023-07-21T22:10:35.191220+0000","last_became_peered":"2023-07-21T22:10:35.191220+0000","last_unstale":"2023-07-21T22:10:40.643126+0000","last_undegraded":"2023-07-21T22:10:40.643126+0000","last_fullsized":"2023-07-21T22:10:40.643126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:33.738041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146486+0000","last_change":"2023-07-21T22:10:34.187207+0000","last_active":"2023-07-21T22:10:41.146486+0000","last_peered":"2023-07-21T22:10:41.146486+0000","last_clean":"2023-07-21T22:10:41.146486+0000","last_became_active":"2023-07-21T22:10:34.185806+0000","last_became_peered":"2023-07-21T22:10:34.185806+0000","last_unstale":"2023-07-21T22:10:41.146486+0000","last_undegraded":"2023-07-21T22:10:41.146486+0000","last_fullsized":"2023-07-21T22:10:41.146486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:17.068811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144651+0000","last_change":"2023-07-21T22:10:39.284138+0000","last_active":"2023-07-21T22:10:41.144651+0000","last_peered":"2023-07-21T22:10:41.144651+0000","last_clean":"2023-07-21T22:10:41.144651+0000","last_became_active":"2023-07-21T22:10:39.283678+0000","last_became_peered":"2023-07-21T22:10:39.283678+0000","last_unstale":"2023-07-21T22:10:41.144651+0000","last_undegraded":"2023-07-21T22:10:41.144651+0000","last_fullsized":"2023-07-21T22:10:41.144651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:52.307715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643341+0000","last_change":"2023-07-21T22:10:35.193661+0000","last_active":"2023-07-21T22:10:40.643341+0000","last_peered":"2023-07-21T22:10:40.643341+0000","last_clean":"2023-07-21T22:10:40.643341+0000","last_became_active":"2023-07-21T22:10:35.193205+0000","last_became_peered":"2023-07-21T22:10:35.193205+0000","last_unstale":"2023-07-21T22:10:40.643341+0000","last_undegraded":"2023-07-21T22:10:40.643341+0000","last_fullsized":"2023-07-21T22:10:40.643341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:44:13.704282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266550+0000","last_change":"2023-07-21T22:10:34.178085+0000","last_active":"2023-07-21T22:10:40.266550+0000","last_peered":"2023-07-21T22:10:40.266550+0000","last_clean":"2023-07-21T22:10:40.266550+0000","last_became_active":"2023-07-21T22:10:34.177713+0000","last_became_peered":"2023-07-21T22:10:34.177713+0000","last_unstale":"2023-07-21T22:10:40.266550+0000","last_undegraded":"2023-07-21T22:10:40.266550+0000","last_fullsized":"2023-07-21T22:10:40.266550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:20:06.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144877+0000","last_change":"2023-07-21T22:10:39.284566+0000","last_active":"2023-07-21T22:10:41.144877+0000","last_peered":"2023-07-21T22:10:41.144877+0000","last_clean":"2023-07-21T22:10:41.144877+0000","last_became_active":"2023-07-21T22:10:39.284100+0000","last_became_peered":"2023-07-21T22:10:39.284100+0000","last_unstale":"2023-07-21T22:10:41.144877+0000","last_undegraded":"2023-07-21T22:10:41.144877+0000","last_fullsized":"2023-07-21T22:10:41.144877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:31:22.286788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146666+0000","last_change":"2023-07-21T22:10:34.190125+0000","last_active":"2023-07-21T22:10:41.146666+0000","last_peered":"2023-07-21T22:10:41.146666+0000","last_clean":"2023-07-21T22:10:41.146666+0000","last_became_active":"2023-07-21T22:10:34.189780+0000","last_became_peered":"2023-07-21T22:10:34.189780+0000","last_unstale":"2023-07-21T22:10:41.146666+0000","last_undegraded":"2023-07-21T22:10:41.146666+0000","last_fullsized":"2023-07-21T22:10:41.146666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:53.502850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147220+0000","last_change":"2023-07-21T22:10:35.186228+0000","last_active":"2023-07-21T22:10:41.147220+0000","last_peered":"2023-07-21T22:10:41.147220+0000","last_clean":"2023-07-21T22:10:41.147220+0000","last_became_active":"2023-07-21T22:10:35.185965+0000","last_became_peered":"2023-07-21T22:10:35.185965+0000","last_unstale":"2023-07-21T22:10:41.147220+0000","last_undegraded":"2023-07-21T22:10:41.147220+0000","last_fullsized":"2023-07-21T22:10:41.147220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:15:55.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643839+0000","last_change":"2023-07-21T22:10:39.283587+0000","last_active":"2023-07-21T22:10:40.643839+0000","last_peered":"2023-07-21T22:10:40.643839+0000","last_clean":"2023-07-21T22:10:40.643839+0000","last_became_active":"2023-07-21T22:10:39.283180+0000","last_became_peered":"2023-07-21T22:10:39.283180+0000","last_unstale":"2023-07-21T22:10:40.643839+0000","last_undegraded":"2023-07-21T22:10:40.643839+0000","last_fullsized":"2023-07-21T22:10:40.643839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:38.593377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"30'10","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:52.945484+0000","last_change":"2023-07-21T22:10:34.185183+0000","last_active":"2023-07-21T22:10:52.945484+0000","last_peered":"2023-07-21T22:10:52.945484+0000","last_clean":"2023-07-21T22:10:52.945484+0000","last_became_active":"2023-07-21T22:10:34.184368+0000","last_became_peered":"2023-07-21T22:10:34.184368+0000","last_unstale":"2023-07-21T22:10:52.945484+0000","last_undegraded":"2023-07-21T22:10:52.945484+0000","last_fullsized":"2023-07-21T22:10:52.945484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:08:24.257997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263920+0000","last_change":"2023-07-21T22:10:35.177131+0000","last_active":"2023-07-21T22:10:40.263920+0000","last_peered":"2023-07-21T22:10:40.263920+0000","last_clean":"2023-07-21T22:10:40.263920+0000","last_became_active":"2023-07-21T22:10:35.176633+0000","last_became_peered":"2023-07-21T22:10:35.176633+0000","last_unstale":"2023-07-21T22:10:40.263920+0000","last_undegraded":"2023-07-21T22:10:40.263920+0000","last_fullsized":"2023-07-21T22:10:40.263920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:20:38.535159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145828+0000","last_change":"2023-07-21T22:10:39.287688+0000","last_active":"2023-07-21T22:10:41.145828+0000","last_peered":"2023-07-21T22:10:41.145828+0000","last_clean":"2023-07-21T22:10:41.145828+0000","last_became_active":"2023-07-21T22:10:39.285544+0000","last_became_peered":"2023-07-21T22:10:39.285544+0000","last_unstale":"2023-07-21T22:10:41.145828+0000","last_undegraded":"2023-07-21T22:10:41.145828+0000","last_fullsized":"2023-07-21T22:10:41.145828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:36.370365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264245+0000","last_change":"2023-07-21T22:10:35.176961+0000","last_active":"2023-07-21T22:10:40.264245+0000","last_peered":"2023-07-21T22:10:40.264245+0000","last_clean":"2023-07-21T22:10:40.264245+0000","last_became_active":"2023-07-21T22:10:35.175909+0000","last_became_peered":"2023-07-21T22:10:35.175909+0000","last_unstale":"2023-07-21T22:10:40.264245+0000","last_undegraded":"2023-07-21T22:10:40.264245+0000","last_fullsized":"2023-07-21T22:10:40.264245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:47:46.146151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146724+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:10:41.146724+0000","last_peered":"2023-07-21T22:10:41.146724+0000","last_clean":"2023-07-21T22:10:41.146724+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:10:41.146724+0000","last_undegraded":"2023-07-21T22:10:41.146724+0000","last_fullsized":"2023-07-21T22:10:41.146724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:47:22.065189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147620+0000","last_change":"2023-07-21T22:10:34.185463+0000","last_active":"2023-07-21T22:10:41.147620+0000","last_peered":"2023-07-21T22:10:41.147620+0000","last_clean":"2023-07-21T22:10:41.147620+0000","last_became_active":"2023-07-21T22:10:34.185164+0000","last_became_peered":"2023-07-21T22:10:34.185164+0000","last_unstale":"2023-07-21T22:10:41.147620+0000","last_undegraded":"2023-07-21T22:10:41.147620+0000","last_fullsized":"2023-07-21T22:10:41.147620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:07.490045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643172+0000","last_change":"2023-07-21T22:10:39.295728+0000","last_active":"2023-07-21T22:10:40.643172+0000","last_peered":"2023-07-21T22:10:40.643172+0000","last_clean":"2023-07-21T22:10:40.643172+0000","last_became_active":"2023-07-21T22:10:39.295285+0000","last_became_peered":"2023-07-21T22:10:39.295285+0000","last_unstale":"2023-07-21T22:10:40.643172+0000","last_undegraded":"2023-07-21T22:10:40.643172+0000","last_fullsized":"2023-07-21T22:10:40.643172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:42.629475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643332+0000","last_change":"2023-07-21T22:10:35.191518+0000","last_active":"2023-07-21T22:10:40.643332+0000","last_peered":"2023-07-21T22:10:40.643332+0000","last_clean":"2023-07-21T22:10:40.643332+0000","last_became_active":"2023-07-21T22:10:35.190851+0000","last_became_peered":"2023-07-21T22:10:35.190851+0000","last_unstale":"2023-07-21T22:10:40.643332+0000","last_undegraded":"2023-07-21T22:10:40.643332+0000","last_fullsized":"2023-07-21T22:10:40.643332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:31.644944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148333+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:10:41.148333+0000","last_peered":"2023-07-21T22:10:41.148333+0000","last_clean":"2023-07-21T22:10:41.148333+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:10:41.148333+0000","last_undegraded":"2023-07-21T22:10:41.148333+0000","last_fullsized":"2023-07-21T22:10:41.148333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:52.095138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644583+0000","last_change":"2023-07-21T22:10:34.180214+0000","last_active":"2023-07-21T22:10:40.644583+0000","last_peered":"2023-07-21T22:10:40.644583+0000","last_clean":"2023-07-21T22:10:40.644583+0000","last_became_active":"2023-07-21T22:10:34.179689+0000","last_became_peered":"2023-07-21T22:10:34.179689+0000","last_unstale":"2023-07-21T22:10:40.644583+0000","last_undegraded":"2023-07-21T22:10:40.644583+0000","last_fullsized":"2023-07-21T22:10:40.644583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:49.373811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263542+0000","last_change":"2023-07-21T22:10:39.277033+0000","last_active":"2023-07-21T22:10:40.263542+0000","last_peered":"2023-07-21T22:10:40.263542+0000","last_clean":"2023-07-21T22:10:40.263542+0000","last_became_active":"2023-07-21T22:10:39.276652+0000","last_became_peered":"2023-07-21T22:10:39.276652+0000","last_unstale":"2023-07-21T22:10:40.263542+0000","last_undegraded":"2023-07-21T22:10:40.263542+0000","last_fullsized":"2023-07-21T22:10:40.263542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:15:28.734422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146510+0000","last_change":"2023-07-21T22:10:35.183693+0000","last_active":"2023-07-21T22:10:41.146510+0000","last_peered":"2023-07-21T22:10:41.146510+0000","last_clean":"2023-07-21T22:10:41.146510+0000","last_became_active":"2023-07-21T22:10:35.182990+0000","last_became_peered":"2023-07-21T22:10:35.182990+0000","last_unstale":"2023-07-21T22:10:41.146510+0000","last_undegraded":"2023-07-21T22:10:41.146510+0000","last_fullsized":"2023-07-21T22:10:41.146510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:19:08.043869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147014+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:10:41.147014+0000","last_peered":"2023-07-21T22:10:41.147014+0000","last_clean":"2023-07-21T22:10:41.147014+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:10:41.147014+0000","last_undegraded":"2023-07-21T22:10:41.147014+0000","last_fullsized":"2023-07-21T22:10:41.147014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:42.440048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147957+0000","last_change":"2023-07-21T22:10:34.181525+0000","last_active":"2023-07-21T22:10:41.147957+0000","last_peered":"2023-07-21T22:10:41.147957+0000","last_clean":"2023-07-21T22:10:41.147957+0000","last_became_active":"2023-07-21T22:10:34.180865+0000","last_became_peered":"2023-07-21T22:10:34.180865+0000","last_unstale":"2023-07-21T22:10:41.147957+0000","last_undegraded":"2023-07-21T22:10:41.147957+0000","last_fullsized":"2023-07-21T22:10:41.147957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:18.845683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145191+0000","last_change":"2023-07-21T22:10:39.285010+0000","last_active":"2023-07-21T22:10:41.145191+0000","last_peered":"2023-07-21T22:10:41.145191+0000","last_clean":"2023-07-21T22:10:41.145191+0000","last_became_active":"2023-07-21T22:10:39.283077+0000","last_became_peered":"2023-07-21T22:10:39.283077+0000","last_unstale":"2023-07-21T22:10:41.145191+0000","last_undegraded":"2023-07-21T22:10:41.145191+0000","last_fullsized":"2023-07-21T22:10:41.145191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:07.012665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147524+0000","last_change":"2023-07-21T22:10:35.181554+0000","last_active":"2023-07-21T22:10:41.147524+0000","last_peered":"2023-07-21T22:10:41.147524+0000","last_clean":"2023-07-21T22:10:41.147524+0000","last_became_active":"2023-07-21T22:10:35.180489+0000","last_became_peered":"2023-07-21T22:10:35.180489+0000","last_unstale":"2023-07-21T22:10:41.147524+0000","last_undegraded":"2023-07-21T22:10:41.147524+0000","last_fullsized":"2023-07-21T22:10:41.147524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:10.196079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147886+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:10:41.147886+0000","last_peered":"2023-07-21T22:10:41.147886+0000","last_clean":"2023-07-21T22:10:41.147886+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:10:41.147886+0000","last_undegraded":"2023-07-21T22:10:41.147886+0000","last_fullsized":"2023-07-21T22:10:41.147886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:13.984747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266059+0000","last_change":"2023-07-21T22:10:34.190035+0000","last_active":"2023-07-21T22:10:40.266059+0000","last_peered":"2023-07-21T22:10:40.266059+0000","last_clean":"2023-07-21T22:10:40.266059+0000","last_became_active":"2023-07-21T22:10:34.188881+0000","last_became_peered":"2023-07-21T22:10:34.188881+0000","last_unstale":"2023-07-21T22:10:40.266059+0000","last_undegraded":"2023-07-21T22:10:40.266059+0000","last_fullsized":"2023-07-21T22:10:40.266059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:09.950174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146612+0000","last_change":"2023-07-21T22:10:39.279664+0000","last_active":"2023-07-21T22:10:41.146612+0000","last_peered":"2023-07-21T22:10:41.146612+0000","last_clean":"2023-07-21T22:10:41.146612+0000","last_became_active":"2023-07-21T22:10:39.279267+0000","last_became_peered":"2023-07-21T22:10:39.279267+0000","last_unstale":"2023-07-21T22:10:41.146612+0000","last_undegraded":"2023-07-21T22:10:41.146612+0000","last_fullsized":"2023-07-21T22:10:41.146612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:09.200877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147703+0000","last_change":"2023-07-21T22:10:35.182579+0000","last_active":"2023-07-21T22:10:41.147703+0000","last_peered":"2023-07-21T22:10:41.147703+0000","last_clean":"2023-07-21T22:10:41.147703+0000","last_became_active":"2023-07-21T22:10:35.182269+0000","last_became_peered":"2023-07-21T22:10:35.182269+0000","last_unstale":"2023-07-21T22:10:41.147703+0000","last_undegraded":"2023-07-21T22:10:41.147703+0000","last_fullsized":"2023-07-21T22:10:41.147703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:48.503179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264029+0000","last_change":"2023-07-21T22:10:34.188309+0000","last_active":"2023-07-21T22:10:40.264029+0000","last_peered":"2023-07-21T22:10:40.264029+0000","last_clean":"2023-07-21T22:10:40.264029+0000","last_became_active":"2023-07-21T22:10:34.187999+0000","last_became_peered":"2023-07-21T22:10:34.187999+0000","last_unstale":"2023-07-21T22:10:40.264029+0000","last_undegraded":"2023-07-21T22:10:40.264029+0000","last_fullsized":"2023-07-21T22:10:40.264029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:13:37.870348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265143+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:10:40.265143+0000","last_peered":"2023-07-21T22:10:40.265143+0000","last_clean":"2023-07-21T22:10:40.265143+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:10:40.265143+0000","last_undegraded":"2023-07-21T22:10:40.265143+0000","last_fullsized":"2023-07-21T22:10:40.265143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:42.440048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146356+0000","last_change":"2023-07-21T22:10:39.279822+0000","last_active":"2023-07-21T22:10:41.146356+0000","last_peered":"2023-07-21T22:10:41.146356+0000","last_clean":"2023-07-21T22:10:41.146356+0000","last_became_active":"2023-07-21T22:10:39.279315+0000","last_became_peered":"2023-07-21T22:10:39.279315+0000","last_unstale":"2023-07-21T22:10:41.146356+0000","last_undegraded":"2023-07-21T22:10:41.146356+0000","last_fullsized":"2023-07-21T22:10:41.146356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:04:04.200991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147521+0000","last_change":"2023-07-21T22:10:35.184632+0000","last_active":"2023-07-21T22:10:41.147521+0000","last_peered":"2023-07-21T22:10:41.147521+0000","last_clean":"2023-07-21T22:10:41.147521+0000","last_became_active":"2023-07-21T22:10:35.184294+0000","last_became_peered":"2023-07-21T22:10:35.184294+0000","last_unstale":"2023-07-21T22:10:41.147521+0000","last_undegraded":"2023-07-21T22:10:41.147521+0000","last_fullsized":"2023-07-21T22:10:41.147521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:54.515955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146420+0000","last_change":"2023-07-21T22:10:34.182197+0000","last_active":"2023-07-21T22:10:41.146420+0000","last_peered":"2023-07-21T22:10:41.146420+0000","last_clean":"2023-07-21T22:10:41.146420+0000","last_became_active":"2023-07-21T22:10:34.181919+0000","last_became_peered":"2023-07-21T22:10:34.181919+0000","last_unstale":"2023-07-21T22:10:41.146420+0000","last_undegraded":"2023-07-21T22:10:41.146420+0000","last_fullsized":"2023-07-21T22:10:41.146420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:55:27.605200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261707+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:10:40.261707+0000","last_peered":"2023-07-21T22:10:40.261707+0000","last_clean":"2023-07-21T22:10:40.261707+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:10:40.261707+0000","last_undegraded":"2023-07-21T22:10:40.261707+0000","last_fullsized":"2023-07-21T22:10:40.261707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:52.407450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262619+0000","last_change":"2023-07-21T22:10:39.289595+0000","last_active":"2023-07-21T22:10:40.262619+0000","last_peered":"2023-07-21T22:10:40.262619+0000","last_clean":"2023-07-21T22:10:40.262619+0000","last_became_active":"2023-07-21T22:10:39.289158+0000","last_became_peered":"2023-07-21T22:10:39.289158+0000","last_unstale":"2023-07-21T22:10:40.262619+0000","last_undegraded":"2023-07-21T22:10:40.262619+0000","last_fullsized":"2023-07-21T22:10:40.262619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:06:55.084320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147467+0000","last_change":"2023-07-21T22:10:35.185318+0000","last_active":"2023-07-21T22:10:41.147467+0000","last_peered":"2023-07-21T22:10:41.147467+0000","last_clean":"2023-07-21T22:10:41.147467+0000","last_became_active":"2023-07-21T22:10:35.185029+0000","last_became_peered":"2023-07-21T22:10:35.185029+0000","last_unstale":"2023-07-21T22:10:41.147467+0000","last_undegraded":"2023-07-21T22:10:41.147467+0000","last_fullsized":"2023-07-21T22:10:41.147467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:10.274416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145597+0000","last_change":"2023-07-21T22:10:34.189207+0000","last_active":"2023-07-21T22:10:41.145597+0000","last_peered":"2023-07-21T22:10:41.145597+0000","last_clean":"2023-07-21T22:10:41.145597+0000","last_became_active":"2023-07-21T22:10:34.188853+0000","last_became_peered":"2023-07-21T22:10:34.188853+0000","last_unstale":"2023-07-21T22:10:41.145597+0000","last_undegraded":"2023-07-21T22:10:41.145597+0000","last_fullsized":"2023-07-21T22:10:41.145597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:37:58.265151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145150+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:10:41.145150+0000","last_peered":"2023-07-21T22:10:41.145150+0000","last_clean":"2023-07-21T22:10:41.145150+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:10:41.145150+0000","last_undegraded":"2023-07-21T22:10:41.145150+0000","last_fullsized":"2023-07-21T22:10:41.145150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:03:10.317005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266651+0000","last_change":"2023-07-21T22:10:39.280697+0000","last_active":"2023-07-21T22:10:40.266651+0000","last_peered":"2023-07-21T22:10:40.266651+0000","last_clean":"2023-07-21T22:10:40.266651+0000","last_became_active":"2023-07-21T22:10:39.279870+0000","last_became_peered":"2023-07-21T22:10:39.279870+0000","last_unstale":"2023-07-21T22:10:40.266651+0000","last_undegraded":"2023-07-21T22:10:40.266651+0000","last_fullsized":"2023-07-21T22:10:40.266651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:32:46.379437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146280+0000","last_change":"2023-07-21T22:10:35.182836+0000","last_active":"2023-07-21T22:10:41.146280+0000","last_peered":"2023-07-21T22:10:41.146280+0000","last_clean":"2023-07-21T22:10:41.146280+0000","last_became_active":"2023-07-21T22:10:35.182544+0000","last_became_peered":"2023-07-21T22:10:35.182544+0000","last_unstale":"2023-07-21T22:10:41.146280+0000","last_undegraded":"2023-07-21T22:10:41.146280+0000","last_fullsized":"2023-07-21T22:10:41.146280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:50:33.337315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643783+0000","last_change":"2023-07-21T22:10:34.179261+0000","last_active":"2023-07-21T22:10:40.643783+0000","last_peered":"2023-07-21T22:10:40.643783+0000","last_clean":"2023-07-21T22:10:40.643783+0000","last_became_active":"2023-07-21T22:10:34.178960+0000","last_became_peered":"2023-07-21T22:10:34.178960+0000","last_unstale":"2023-07-21T22:10:40.643783+0000","last_undegraded":"2023-07-21T22:10:40.643783+0000","last_fullsized":"2023-07-21T22:10:40.643783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:06.437405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265850+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:10:40.265850+0000","last_peered":"2023-07-21T22:10:40.265850+0000","last_clean":"2023-07-21T22:10:40.265850+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:10:40.265850+0000","last_undegraded":"2023-07-21T22:10:40.265850+0000","last_fullsized":"2023-07-21T22:10:40.265850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:19:33.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":181,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145465+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:10:41.145465+0000","last_peered":"2023-07-21T22:10:41.145465+0000","last_clean":"2023-07-21T22:10:41.145465+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:10:41.145465+0000","last_undegraded":"2023-07-21T22:10:41.145465+0000","last_fullsized":"2023-07-21T22:10:41.145465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:21.070954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146227+0000","last_change":"2023-07-21T22:10:39.284150+0000","last_active":"2023-07-21T22:10:41.146227+0000","last_peered":"2023-07-21T22:10:41.146227+0000","last_clean":"2023-07-21T22:10:41.146227+0000","last_became_active":"2023-07-21T22:10:39.283381+0000","last_became_peered":"2023-07-21T22:10:39.283381+0000","last_unstale":"2023-07-21T22:10:41.146227+0000","last_undegraded":"2023-07-21T22:10:41.146227+0000","last_fullsized":"2023-07-21T22:10:41.146227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:15:59.402797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147452+0000","last_change":"2023-07-21T22:10:35.197136+0000","last_active":"2023-07-21T22:10:41.147452+0000","last_peered":"2023-07-21T22:10:41.147452+0000","last_clean":"2023-07-21T22:10:41.147452+0000","last_became_active":"2023-07-21T22:10:35.196793+0000","last_became_peered":"2023-07-21T22:10:35.196793+0000","last_unstale":"2023-07-21T22:10:41.147452+0000","last_undegraded":"2023-07-21T22:10:41.147452+0000","last_fullsized":"2023-07-21T22:10:41.147452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:58:58.416910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643562+0000","last_change":"2023-07-21T22:10:34.182106+0000","last_active":"2023-07-21T22:10:40.643562+0000","last_peered":"2023-07-21T22:10:40.643562+0000","last_clean":"2023-07-21T22:10:40.643562+0000","last_became_active":"2023-07-21T22:10:34.181808+0000","last_became_peered":"2023-07-21T22:10:34.181808+0000","last_unstale":"2023-07-21T22:10:40.643562+0000","last_undegraded":"2023-07-21T22:10:40.643562+0000","last_fullsized":"2023-07-21T22:10:40.643562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:42:55.768979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265150+0000","last_change":"2023-07-21T22:10:39.278199+0000","last_active":"2023-07-21T22:10:40.265150+0000","last_peered":"2023-07-21T22:10:40.265150+0000","last_clean":"2023-07-21T22:10:40.265150+0000","last_became_active":"2023-07-21T22:10:39.277773+0000","last_became_peered":"2023-07-21T22:10:39.277773+0000","last_unstale":"2023-07-21T22:10:40.265150+0000","last_undegraded":"2023-07-21T22:10:40.265150+0000","last_fullsized":"2023-07-21T22:10:40.265150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:32:06.176345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265331+0000","last_change":"2023-07-21T22:10:35.183217+0000","last_active":"2023-07-21T22:10:40.265331+0000","last_peered":"2023-07-21T22:10:40.265331+0000","last_clean":"2023-07-21T22:10:40.265331+0000","last_became_active":"2023-07-21T22:10:35.182856+0000","last_became_peered":"2023-07-21T22:10:35.182856+0000","last_unstale":"2023-07-21T22:10:40.265331+0000","last_undegraded":"2023-07-21T22:10:40.265331+0000","last_fullsized":"2023-07-21T22:10:40.265331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:30:25.920287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264485+0000","last_change":"2023-07-21T22:10:34.187410+0000","last_active":"2023-07-21T22:10:40.264485+0000","last_peered":"2023-07-21T22:10:40.264485+0000","last_clean":"2023-07-21T22:10:40.264485+0000","last_became_active":"2023-07-21T22:10:34.185501+0000","last_became_peered":"2023-07-21T22:10:34.185501+0000","last_unstale":"2023-07-21T22:10:40.264485+0000","last_undegraded":"2023-07-21T22:10:40.264485+0000","last_fullsized":"2023-07-21T22:10:40.264485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:39:44.435404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266593+0000","last_change":"2023-07-21T22:10:39.280745+0000","last_active":"2023-07-21T22:10:40.266593+0000","last_peered":"2023-07-21T22:10:40.266593+0000","last_clean":"2023-07-21T22:10:40.266593+0000","last_became_active":"2023-07-21T22:10:39.279223+0000","last_became_peered":"2023-07-21T22:10:39.279223+0000","last_unstale":"2023-07-21T22:10:40.266593+0000","last_undegraded":"2023-07-21T22:10:40.266593+0000","last_fullsized":"2023-07-21T22:10:40.266593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:54.403892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264956+0000","last_change":"2023-07-21T22:10:35.181575+0000","last_active":"2023-07-21T22:10:40.264956+0000","last_peered":"2023-07-21T22:10:40.264956+0000","last_clean":"2023-07-21T22:10:40.264956+0000","last_became_active":"2023-07-21T22:10:35.181328+0000","last_became_peered":"2023-07-21T22:10:35.181328+0000","last_unstale":"2023-07-21T22:10:40.264956+0000","last_undegraded":"2023-07-21T22:10:40.264956+0000","last_fullsized":"2023-07-21T22:10:40.264956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:42:35.913798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145748+0000","last_change":"2023-07-21T22:10:34.190677+0000","last_active":"2023-07-21T22:10:41.145748+0000","last_peered":"2023-07-21T22:10:41.145748+0000","last_clean":"2023-07-21T22:10:41.145748+0000","last_became_active":"2023-07-21T22:10:34.190379+0000","last_became_peered":"2023-07-21T22:10:34.190379+0000","last_unstale":"2023-07-21T22:10:41.145748+0000","last_undegraded":"2023-07-21T22:10:41.145748+0000","last_fullsized":"2023-07-21T22:10:41.145748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:28:46.376238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147094+0000","last_change":"2023-07-21T22:10:39.285099+0000","last_active":"2023-07-21T22:10:41.147094+0000","last_peered":"2023-07-21T22:10:41.147094+0000","last_clean":"2023-07-21T22:10:41.147094+0000","last_became_active":"2023-07-21T22:10:39.284046+0000","last_became_peered":"2023-07-21T22:10:39.284046+0000","last_unstale":"2023-07-21T22:10:41.147094+0000","last_undegraded":"2023-07-21T22:10:41.147094+0000","last_fullsized":"2023-07-21T22:10:41.147094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:49.251705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264528+0000","last_change":"2023-07-21T22:10:35.193709+0000","last_active":"2023-07-21T22:10:40.264528+0000","last_peered":"2023-07-21T22:10:40.264528+0000","last_clean":"2023-07-21T22:10:40.264528+0000","last_became_active":"2023-07-21T22:10:35.193409+0000","last_became_peered":"2023-07-21T22:10:35.193409+0000","last_unstale":"2023-07-21T22:10:40.264528+0000","last_undegraded":"2023-07-21T22:10:40.264528+0000","last_fullsized":"2023-07-21T22:10:40.264528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:01.253948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644277+0000","last_change":"2023-07-21T22:10:34.185707+0000","last_active":"2023-07-21T22:10:40.644277+0000","last_peered":"2023-07-21T22:10:40.644277+0000","last_clean":"2023-07-21T22:10:40.644277+0000","last_became_active":"2023-07-21T22:10:34.185415+0000","last_became_peered":"2023-07-21T22:10:34.185415+0000","last_unstale":"2023-07-21T22:10:40.644277+0000","last_undegraded":"2023-07-21T22:10:40.644277+0000","last_fullsized":"2023-07-21T22:10:40.644277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:01:57.132624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262536+0000","last_change":"2023-07-21T22:10:39.288923+0000","last_active":"2023-07-21T22:10:40.262536+0000","last_peered":"2023-07-21T22:10:40.262536+0000","last_clean":"2023-07-21T22:10:40.262536+0000","last_became_active":"2023-07-21T22:10:39.284848+0000","last_became_peered":"2023-07-21T22:10:39.284848+0000","last_unstale":"2023-07-21T22:10:40.262536+0000","last_undegraded":"2023-07-21T22:10:40.262536+0000","last_fullsized":"2023-07-21T22:10:40.262536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:54:17.869022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146100+0000","last_change":"2023-07-21T22:10:35.183881+0000","last_active":"2023-07-21T22:10:41.146100+0000","last_peered":"2023-07-21T22:10:41.146100+0000","last_clean":"2023-07-21T22:10:41.146100+0000","last_became_active":"2023-07-21T22:10:35.183392+0000","last_became_peered":"2023-07-21T22:10:35.183392+0000","last_unstale":"2023-07-21T22:10:41.146100+0000","last_undegraded":"2023-07-21T22:10:41.146100+0000","last_fullsized":"2023-07-21T22:10:41.146100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:17:44.809522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265587+0000","last_change":"2023-07-21T22:10:34.189475+0000","last_active":"2023-07-21T22:10:40.265587+0000","last_peered":"2023-07-21T22:10:40.265587+0000","last_clean":"2023-07-21T22:10:40.265587+0000","last_became_active":"2023-07-21T22:10:34.189101+0000","last_became_peered":"2023-07-21T22:10:34.189101+0000","last_unstale":"2023-07-21T22:10:40.265587+0000","last_undegraded":"2023-07-21T22:10:40.265587+0000","last_fullsized":"2023-07-21T22:10:40.265587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:48.235788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261969+0000","last_change":"2023-07-21T22:10:39.288287+0000","last_active":"2023-07-21T22:10:40.261969+0000","last_peered":"2023-07-21T22:10:40.261969+0000","last_clean":"2023-07-21T22:10:40.261969+0000","last_became_active":"2023-07-21T22:10:39.285298+0000","last_became_peered":"2023-07-21T22:10:39.285298+0000","last_unstale":"2023-07-21T22:10:40.261969+0000","last_undegraded":"2023-07-21T22:10:40.261969+0000","last_fullsized":"2023-07-21T22:10:40.261969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:50:45.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145472+0000","last_change":"2023-07-21T22:10:35.189604+0000","last_active":"2023-07-21T22:10:41.145472+0000","last_peered":"2023-07-21T22:10:41.145472+0000","last_clean":"2023-07-21T22:10:41.145472+0000","last_became_active":"2023-07-21T22:10:35.189358+0000","last_became_peered":"2023-07-21T22:10:35.189358+0000","last_unstale":"2023-07-21T22:10:41.145472+0000","last_undegraded":"2023-07-21T22:10:41.145472+0000","last_fullsized":"2023-07-21T22:10:41.145472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:57.173528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146814+0000","last_change":"2023-07-21T22:10:34.178611+0000","last_active":"2023-07-21T22:10:41.146814+0000","last_peered":"2023-07-21T22:10:41.146814+0000","last_clean":"2023-07-21T22:10:41.146814+0000","last_became_active":"2023-07-21T22:10:34.178321+0000","last_became_peered":"2023-07-21T22:10:34.178321+0000","last_unstale":"2023-07-21T22:10:41.146814+0000","last_undegraded":"2023-07-21T22:10:41.146814+0000","last_fullsized":"2023-07-21T22:10:41.146814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:39.236774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261985+0000","last_change":"2023-07-21T22:10:39.285122+0000","last_active":"2023-07-21T22:10:40.261985+0000","last_peered":"2023-07-21T22:10:40.261985+0000","last_clean":"2023-07-21T22:10:40.261985+0000","last_became_active":"2023-07-21T22:10:39.284637+0000","last_became_peered":"2023-07-21T22:10:39.284637+0000","last_unstale":"2023-07-21T22:10:40.261985+0000","last_undegraded":"2023-07-21T22:10:40.261985+0000","last_fullsized":"2023-07-21T22:10:40.261985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:54:50.939333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263932+0000","last_change":"2023-07-21T22:10:35.188636+0000","last_active":"2023-07-21T22:10:40.263932+0000","last_peered":"2023-07-21T22:10:40.263932+0000","last_clean":"2023-07-21T22:10:40.263932+0000","last_became_active":"2023-07-21T22:10:35.188298+0000","last_became_peered":"2023-07-21T22:10:35.188298+0000","last_unstale":"2023-07-21T22:10:40.263932+0000","last_undegraded":"2023-07-21T22:10:40.263932+0000","last_fullsized":"2023-07-21T22:10:40.263932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:18:45.368754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147220+0000","last_change":"2023-07-21T22:10:34.194251+0000","last_active":"2023-07-21T22:10:41.147220+0000","last_peered":"2023-07-21T22:10:41.147220+0000","last_clean":"2023-07-21T22:10:41.147220+0000","last_became_active":"2023-07-21T22:10:34.193914+0000","last_became_peered":"2023-07-21T22:10:34.193914+0000","last_unstale":"2023-07-21T22:10:41.147220+0000","last_undegraded":"2023-07-21T22:10:41.147220+0000","last_fullsized":"2023-07-21T22:10:41.147220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:18.845683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261519+0000","last_change":"2023-07-21T22:10:39.284893+0000","last_active":"2023-07-21T22:10:40.261519+0000","last_peered":"2023-07-21T22:10:40.261519+0000","last_clean":"2023-07-21T22:10:40.261519+0000","last_became_active":"2023-07-21T22:10:39.284465+0000","last_became_peered":"2023-07-21T22:10:39.284465+0000","last_unstale":"2023-07-21T22:10:40.261519+0000","last_undegraded":"2023-07-21T22:10:40.261519+0000","last_fullsized":"2023-07-21T22:10:40.261519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:08.368632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263217+0000","last_change":"2023-07-21T22:10:35.179108+0000","last_active":"2023-07-21T22:10:40.263217+0000","last_peered":"2023-07-21T22:10:40.263217+0000","last_clean":"2023-07-21T22:10:40.263217+0000","last_became_active":"2023-07-21T22:10:35.178860+0000","last_became_peered":"2023-07-21T22:10:35.178860+0000","last_unstale":"2023-07-21T22:10:40.263217+0000","last_undegraded":"2023-07-21T22:10:40.263217+0000","last_fullsized":"2023-07-21T22:10:40.263217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:10.196079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147218+0000","last_change":"2023-07-21T22:10:34.191213+0000","last_active":"2023-07-21T22:10:41.147218+0000","last_peered":"2023-07-21T22:10:41.147218+0000","last_clean":"2023-07-21T22:10:41.147218+0000","last_became_active":"2023-07-21T22:10:34.190864+0000","last_became_peered":"2023-07-21T22:10:34.190864+0000","last_unstale":"2023-07-21T22:10:41.147218+0000","last_undegraded":"2023-07-21T22:10:41.147218+0000","last_fullsized":"2023-07-21T22:10:41.147218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:48.235788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146089+0000","last_change":"2023-07-21T22:10:39.285659+0000","last_active":"2023-07-21T22:10:41.146089+0000","last_peered":"2023-07-21T22:10:41.146089+0000","last_clean":"2023-07-21T22:10:41.146089+0000","last_became_active":"2023-07-21T22:10:39.285107+0000","last_became_peered":"2023-07-21T22:10:39.285107+0000","last_unstale":"2023-07-21T22:10:41.146089+0000","last_undegraded":"2023-07-21T22:10:41.146089+0000","last_fullsized":"2023-07-21T22:10:41.146089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:49.251705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265541+0000","last_change":"2023-07-21T22:10:39.283176+0000","last_active":"2023-07-21T22:10:40.265541+0000","last_peered":"2023-07-21T22:10:40.265541+0000","last_clean":"2023-07-21T22:10:40.265541+0000","last_became_active":"2023-07-21T22:10:39.282822+0000","last_became_peered":"2023-07-21T22:10:39.282822+0000","last_unstale":"2023-07-21T22:10:40.265541+0000","last_undegraded":"2023-07-21T22:10:40.265541+0000","last_fullsized":"2023-07-21T22:10:40.265541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:44:45.486837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'8","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144843+0000","last_change":"2023-07-21T22:10:34.187632+0000","last_active":"2023-07-21T22:10:41.144843+0000","last_peered":"2023-07-21T22:10:41.144843+0000","last_clean":"2023-07-21T22:10:41.144843+0000","last_became_active":"2023-07-21T22:10:34.187327+0000","last_became_peered":"2023-07-21T22:10:34.187327+0000","last_unstale":"2023-07-21T22:10:41.144843+0000","last_undegraded":"2023-07-21T22:10:41.144843+0000","last_fullsized":"2023-07-21T22:10:41.144843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:29.738382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644454+0000","last_change":"2023-07-21T22:10:35.196258+0000","last_active":"2023-07-21T22:10:40.644454+0000","last_peered":"2023-07-21T22:10:40.644454+0000","last_clean":"2023-07-21T22:10:40.644454+0000","last_became_active":"2023-07-21T22:10:35.195943+0000","last_became_peered":"2023-07-21T22:10:35.195943+0000","last_unstale":"2023-07-21T22:10:40.644454+0000","last_undegraded":"2023-07-21T22:10:40.644454+0000","last_fullsized":"2023-07-21T22:10:40.644454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:53:55.769220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644298+0000","last_change":"2023-07-21T22:10:39.285606+0000","last_active":"2023-07-21T22:10:40.644298+0000","last_peered":"2023-07-21T22:10:40.644298+0000","last_clean":"2023-07-21T22:10:40.644298+0000","last_became_active":"2023-07-21T22:10:39.285013+0000","last_became_peered":"2023-07-21T22:10:39.285013+0000","last_unstale":"2023-07-21T22:10:40.644298+0000","last_undegraded":"2023-07-21T22:10:40.644298+0000","last_fullsized":"2023-07-21T22:10:40.644298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:09:27.124262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146727+0000","last_change":"2023-07-21T22:10:34.194383+0000","last_active":"2023-07-21T22:10:41.146727+0000","last_peered":"2023-07-21T22:10:41.146727+0000","last_clean":"2023-07-21T22:10:41.146727+0000","last_became_active":"2023-07-21T22:10:34.194063+0000","last_became_peered":"2023-07-21T22:10:34.194063+0000","last_unstale":"2023-07-21T22:10:41.146727+0000","last_undegraded":"2023-07-21T22:10:41.146727+0000","last_fullsized":"2023-07-21T22:10:41.146727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:09.182975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147842+0000","last_change":"2023-07-21T22:10:35.193372+0000","last_active":"2023-07-21T22:10:41.147842+0000","last_peered":"2023-07-21T22:10:41.147842+0000","last_clean":"2023-07-21T22:10:41.147842+0000","last_became_active":"2023-07-21T22:10:35.193099+0000","last_became_peered":"2023-07-21T22:10:35.193099+0000","last_unstale":"2023-07-21T22:10:41.147842+0000","last_undegraded":"2023-07-21T22:10:41.147842+0000","last_fullsized":"2023-07-21T22:10:41.147842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:18:34.792098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145663+0000","last_change":"2023-07-21T22:10:34.174760+0000","last_active":"2023-07-21T22:10:41.145663+0000","last_peered":"2023-07-21T22:10:41.145663+0000","last_clean":"2023-07-21T22:10:41.145663+0000","last_became_active":"2023-07-21T22:10:34.174412+0000","last_became_peered":"2023-07-21T22:10:34.174412+0000","last_unstale":"2023-07-21T22:10:41.145663+0000","last_undegraded":"2023-07-21T22:10:41.145663+0000","last_fullsized":"2023-07-21T22:10:41.145663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:49.434373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265838+0000","last_change":"2023-07-21T22:10:35.181797+0000","last_active":"2023-07-21T22:10:40.265838+0000","last_peered":"2023-07-21T22:10:40.265838+0000","last_clean":"2023-07-21T22:10:40.265838+0000","last_became_active":"2023-07-21T22:10:35.180383+0000","last_became_peered":"2023-07-21T22:10:35.180383+0000","last_unstale":"2023-07-21T22:10:40.265838+0000","last_undegraded":"2023-07-21T22:10:40.265838+0000","last_fullsized":"2023-07-21T22:10:40.265838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:58.158269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644090+0000","last_change":"2023-07-21T22:10:39.283924+0000","last_active":"2023-07-21T22:10:40.644090+0000","last_peered":"2023-07-21T22:10:40.644090+0000","last_clean":"2023-07-21T22:10:40.644090+0000","last_became_active":"2023-07-21T22:10:39.283524+0000","last_became_peered":"2023-07-21T22:10:39.283524+0000","last_unstale":"2023-07-21T22:10:40.644090+0000","last_undegraded":"2023-07-21T22:10:40.644090+0000","last_fullsized":"2023-07-21T22:10:40.644090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:10:21.482474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147082+0000","last_change":"2023-07-21T22:10:34.195049+0000","last_active":"2023-07-21T22:10:41.147082+0000","last_peered":"2023-07-21T22:10:41.147082+0000","last_clean":"2023-07-21T22:10:41.147082+0000","last_became_active":"2023-07-21T22:10:34.194734+0000","last_became_peered":"2023-07-21T22:10:34.194734+0000","last_unstale":"2023-07-21T22:10:41.147082+0000","last_undegraded":"2023-07-21T22:10:41.147082+0000","last_fullsized":"2023-07-21T22:10:41.147082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:19.034773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644242+0000","last_change":"2023-07-21T22:10:35.192516+0000","last_active":"2023-07-21T22:10:40.644242+0000","last_peered":"2023-07-21T22:10:40.644242+0000","last_clean":"2023-07-21T22:10:40.644242+0000","last_became_active":"2023-07-21T22:10:35.192223+0000","last_became_peered":"2023-07-21T22:10:35.192223+0000","last_unstale":"2023-07-21T22:10:40.644242+0000","last_undegraded":"2023-07-21T22:10:40.644242+0000","last_fullsized":"2023-07-21T22:10:40.644242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:35:11.828421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265637+0000","last_change":"2023-07-21T22:10:39.279488+0000","last_active":"2023-07-21T22:10:40.265637+0000","last_peered":"2023-07-21T22:10:40.265637+0000","last_clean":"2023-07-21T22:10:40.265637+0000","last_became_active":"2023-07-21T22:10:39.279003+0000","last_became_peered":"2023-07-21T22:10:39.279003+0000","last_unstale":"2023-07-21T22:10:40.265637+0000","last_undegraded":"2023-07-21T22:10:40.265637+0000","last_fullsized":"2023-07-21T22:10:40.265637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:23.941829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144554+0000","last_change":"2023-07-21T22:10:35.179763+0000","last_active":"2023-07-21T22:10:41.144554+0000","last_peered":"2023-07-21T22:10:41.144554+0000","last_clean":"2023-07-21T22:10:41.144554+0000","last_became_active":"2023-07-21T22:10:35.179461+0000","last_became_peered":"2023-07-21T22:10:35.179461+0000","last_unstale":"2023-07-21T22:10:41.144554+0000","last_undegraded":"2023-07-21T22:10:41.144554+0000","last_fullsized":"2023-07-21T22:10:41.144554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:26:37.683815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643259+0000","last_change":"2023-07-21T22:10:35.198489+0000","last_active":"2023-07-21T22:10:40.643259+0000","last_peered":"2023-07-21T22:10:40.643259+0000","last_clean":"2023-07-21T22:10:40.643259+0000","last_became_active":"2023-07-21T22:10:35.196445+0000","last_became_peered":"2023-07-21T22:10:35.196445+0000","last_unstale":"2023-07-21T22:10:40.643259+0000","last_undegraded":"2023-07-21T22:10:40.643259+0000","last_fullsized":"2023-07-21T22:10:40.643259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:44:28.401234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264788+0000","last_change":"2023-07-21T22:10:35.187176+0000","last_active":"2023-07-21T22:10:40.264788+0000","last_peered":"2023-07-21T22:10:40.264788+0000","last_clean":"2023-07-21T22:10:40.264788+0000","last_became_active":"2023-07-21T22:10:35.186863+0000","last_became_peered":"2023-07-21T22:10:35.186863+0000","last_unstale":"2023-07-21T22:10:40.264788+0000","last_undegraded":"2023-07-21T22:10:40.264788+0000","last_fullsized":"2023-07-21T22:10:40.264788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:06:49.659850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644061+0000","last_change":"2023-07-21T22:10:35.198787+0000","last_active":"2023-07-21T22:10:40.644061+0000","last_peered":"2023-07-21T22:10:40.644061+0000","last_clean":"2023-07-21T22:10:40.644061+0000","last_became_active":"2023-07-21T22:10:35.198500+0000","last_became_peered":"2023-07-21T22:10:35.198500+0000","last_unstale":"2023-07-21T22:10:40.644061+0000","last_undegraded":"2023-07-21T22:10:40.644061+0000","last_fullsized":"2023-07-21T22:10:40.644061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:53:24.242935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147817+0000","last_change":"2023-07-21T22:10:35.179417+0000","last_active":"2023-07-21T22:10:41.147817+0000","last_peered":"2023-07-21T22:10:41.147817+0000","last_clean":"2023-07-21T22:10:41.147817+0000","last_became_active":"2023-07-21T22:10:35.179102+0000","last_became_peered":"2023-07-21T22:10:35.179102+0000","last_unstale":"2023-07-21T22:10:41.147817+0000","last_undegraded":"2023-07-21T22:10:41.147817+0000","last_fullsized":"2023-07-21T22:10:41.147817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:44:41.403795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265823+0000","last_change":"2023-07-21T22:10:35.183678+0000","last_active":"2023-07-21T22:10:40.265823+0000","last_peered":"2023-07-21T22:10:40.265823+0000","last_clean":"2023-07-21T22:10:40.265823+0000","last_became_active":"2023-07-21T22:10:35.181954+0000","last_became_peered":"2023-07-21T22:10:35.181954+0000","last_unstale":"2023-07-21T22:10:40.265823+0000","last_undegraded":"2023-07-21T22:10:40.265823+0000","last_fullsized":"2023-07-21T22:10:40.265823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:51:47.919272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148183+0000","last_change":"2023-07-21T22:10:35.183172+0000","last_active":"2023-07-21T22:10:41.148183+0000","last_peered":"2023-07-21T22:10:41.148183+0000","last_clean":"2023-07-21T22:10:41.148183+0000","last_became_active":"2023-07-21T22:10:35.182810+0000","last_became_peered":"2023-07-21T22:10:35.182810+0000","last_unstale":"2023-07-21T22:10:41.148183+0000","last_undegraded":"2023-07-21T22:10:41.148183+0000","last_fullsized":"2023-07-21T22:10:41.148183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:48.176651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147386+0000","last_change":"2023-07-21T22:10:35.185656+0000","last_active":"2023-07-21T22:10:41.147386+0000","last_peered":"2023-07-21T22:10:41.147386+0000","last_clean":"2023-07-21T22:10:41.147386+0000","last_became_active":"2023-07-21T22:10:35.185351+0000","last_became_peered":"2023-07-21T22:10:35.185351+0000","last_unstale":"2023-07-21T22:10:41.147386+0000","last_undegraded":"2023-07-21T22:10:41.147386+0000","last_fullsized":"2023-07-21T22:10:41.147386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:37:12.318204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145095+0000","last_change":"2023-07-21T22:10:35.196481+0000","last_active":"2023-07-21T22:10:41.145095+0000","last_peered":"2023-07-21T22:10:41.145095+0000","last_clean":"2023-07-21T22:10:41.145095+0000","last_became_active":"2023-07-21T22:10:35.196158+0000","last_became_peered":"2023-07-21T22:10:35.196158+0000","last_unstale":"2023-07-21T22:10:41.145095+0000","last_undegraded":"2023-07-21T22:10:41.145095+0000","last_fullsized":"2023-07-21T22:10:41.145095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:32.007914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643201+0000","last_change":"2023-07-21T22:10:35.194616+0000","last_active":"2023-07-21T22:10:40.643201+0000","last_peered":"2023-07-21T22:10:40.643201+0000","last_clean":"2023-07-21T22:10:40.643201+0000","last_became_active":"2023-07-21T22:10:35.194326+0000","last_became_peered":"2023-07-21T22:10:35.194326+0000","last_unstale":"2023-07-21T22:10:40.643201+0000","last_undegraded":"2023-07-21T22:10:40.643201+0000","last_fullsized":"2023-07-21T22:10:40.643201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:54:51.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145426+0000","last_change":"2023-07-21T22:10:35.181759+0000","last_active":"2023-07-21T22:10:41.145426+0000","last_peered":"2023-07-21T22:10:41.145426+0000","last_clean":"2023-07-21T22:10:41.145426+0000","last_became_active":"2023-07-21T22:10:35.179939+0000","last_became_peered":"2023-07-21T22:10:35.179939+0000","last_unstale":"2023-07-21T22:10:41.145426+0000","last_undegraded":"2023-07-21T22:10:41.145426+0000","last_fullsized":"2023-07-21T22:10:41.145426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:59:17.361629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147050+0000","last_change":"2023-07-21T22:10:35.201621+0000","last_active":"2023-07-21T22:10:41.147050+0000","last_peered":"2023-07-21T22:10:41.147050+0000","last_clean":"2023-07-21T22:10:41.147050+0000","last_became_active":"2023-07-21T22:10:35.201242+0000","last_became_peered":"2023-07-21T22:10:35.201242+0000","last_unstale":"2023-07-21T22:10:41.147050+0000","last_undegraded":"2023-07-21T22:10:41.147050+0000","last_fullsized":"2023-07-21T22:10:41.147050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:44:41.403795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264570+0000","last_change":"2023-07-21T22:10:35.181975+0000","last_active":"2023-07-21T22:10:40.264570+0000","last_peered":"2023-07-21T22:10:40.264570+0000","last_clean":"2023-07-21T22:10:40.264570+0000","last_became_active":"2023-07-21T22:10:35.181368+0000","last_became_peered":"2023-07-21T22:10:35.181368+0000","last_unstale":"2023-07-21T22:10:40.264570+0000","last_undegraded":"2023-07-21T22:10:40.264570+0000","last_fullsized":"2023-07-21T22:10:40.264570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:44.586259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262782+0000","last_change":"2023-07-21T22:10:35.182687+0000","last_active":"2023-07-21T22:10:40.262782+0000","last_peered":"2023-07-21T22:10:40.262782+0000","last_clean":"2023-07-21T22:10:40.262782+0000","last_became_active":"2023-07-21T22:10:35.182369+0000","last_became_peered":"2023-07-21T22:10:35.182369+0000","last_unstale":"2023-07-21T22:10:40.262782+0000","last_undegraded":"2023-07-21T22:10:40.262782+0000","last_fullsized":"2023-07-21T22:10:40.262782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:47:37.395408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265158+0000","last_change":"2023-07-21T22:10:35.181596+0000","last_active":"2023-07-21T22:10:40.265158+0000","last_peered":"2023-07-21T22:10:40.265158+0000","last_clean":"2023-07-21T22:10:40.265158+0000","last_became_active":"2023-07-21T22:10:35.181343+0000","last_became_peered":"2023-07-21T22:10:35.181343+0000","last_unstale":"2023-07-21T22:10:40.265158+0000","last_undegraded":"2023-07-21T22:10:40.265158+0000","last_fullsized":"2023-07-21T22:10:40.265158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:00.862980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146323+0000","last_change":"2023-07-21T22:10:35.191662+0000","last_active":"2023-07-21T22:10:41.146323+0000","last_peered":"2023-07-21T22:10:41.146323+0000","last_clean":"2023-07-21T22:10:41.146323+0000","last_became_active":"2023-07-21T22:10:35.191389+0000","last_became_peered":"2023-07-21T22:10:35.191389+0000","last_unstale":"2023-07-21T22:10:41.146323+0000","last_undegraded":"2023-07-21T22:10:41.146323+0000","last_fullsized":"2023-07-21T22:10:41.146323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:49.731806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263421+0000","last_change":"2023-07-21T22:10:35.180343+0000","last_active":"2023-07-21T22:10:40.263421+0000","last_peered":"2023-07-21T22:10:40.263421+0000","last_clean":"2023-07-21T22:10:40.263421+0000","last_became_active":"2023-07-21T22:10:35.178216+0000","last_became_peered":"2023-07-21T22:10:35.178216+0000","last_unstale":"2023-07-21T22:10:40.263421+0000","last_undegraded":"2023-07-21T22:10:40.263421+0000","last_fullsized":"2023-07-21T22:10:40.263421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:28:03.815256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146613+0000","last_change":"2023-07-21T22:10:35.188474+0000","last_active":"2023-07-21T22:10:41.146613+0000","last_peered":"2023-07-21T22:10:41.146613+0000","last_clean":"2023-07-21T22:10:41.146613+0000","last_became_active":"2023-07-21T22:10:35.187957+0000","last_became_peered":"2023-07-21T22:10:35.187957+0000","last_unstale":"2023-07-21T22:10:41.146613+0000","last_undegraded":"2023-07-21T22:10:41.146613+0000","last_fullsized":"2023-07-21T22:10:41.146613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:58:58.416910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264825+0000","last_change":"2023-07-21T22:10:35.172559+0000","last_active":"2023-07-21T22:10:40.264825+0000","last_peered":"2023-07-21T22:10:40.264825+0000","last_clean":"2023-07-21T22:10:40.264825+0000","last_became_active":"2023-07-21T22:10:35.172297+0000","last_became_peered":"2023-07-21T22:10:35.172297+0000","last_unstale":"2023-07-21T22:10:40.264825+0000","last_undegraded":"2023-07-21T22:10:40.264825+0000","last_fullsized":"2023-07-21T22:10:40.264825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:40.249878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261736+0000","last_change":"2023-07-21T22:10:35.197849+0000","last_active":"2023-07-21T22:10:40.261736+0000","last_peered":"2023-07-21T22:10:40.261736+0000","last_clean":"2023-07-21T22:10:40.261736+0000","last_became_active":"2023-07-21T22:10:35.197518+0000","last_became_peered":"2023-07-21T22:10:35.197518+0000","last_unstale":"2023-07-21T22:10:40.261736+0000","last_undegraded":"2023-07-21T22:10:40.261736+0000","last_fullsized":"2023-07-21T22:10:40.261736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:14.080646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262913+0000","last_change":"2023-07-21T22:10:35.181027+0000","last_active":"2023-07-21T22:10:40.262913+0000","last_peered":"2023-07-21T22:10:40.262913+0000","last_clean":"2023-07-21T22:10:40.262913+0000","last_became_active":"2023-07-21T22:10:35.180649+0000","last_became_peered":"2023-07-21T22:10:35.180649+0000","last_unstale":"2023-07-21T22:10:40.262913+0000","last_undegraded":"2023-07-21T22:10:40.262913+0000","last_fullsized":"2023-07-21T22:10:40.262913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:43.732515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265501+0000","last_change":"2023-07-21T22:10:35.188747+0000","last_active":"2023-07-21T22:10:40.265501+0000","last_peered":"2023-07-21T22:10:40.265501+0000","last_clean":"2023-07-21T22:10:40.265501+0000","last_became_active":"2023-07-21T22:10:35.188468+0000","last_became_peered":"2023-07-21T22:10:35.188468+0000","last_unstale":"2023-07-21T22:10:40.265501+0000","last_undegraded":"2023-07-21T22:10:40.265501+0000","last_fullsized":"2023-07-21T22:10:40.265501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:36:18.273058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266392+0000","last_change":"2023-07-21T22:10:35.186280+0000","last_active":"2023-07-21T22:10:40.266392+0000","last_peered":"2023-07-21T22:10:40.266392+0000","last_clean":"2023-07-21T22:10:40.266392+0000","last_became_active":"2023-07-21T22:10:35.185899+0000","last_became_peered":"2023-07-21T22:10:35.185899+0000","last_unstale":"2023-07-21T22:10:40.266392+0000","last_undegraded":"2023-07-21T22:10:40.266392+0000","last_fullsized":"2023-07-21T22:10:40.266392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:58:24.147605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146096+0000","last_change":"2023-07-21T22:10:35.194217+0000","last_active":"2023-07-21T22:10:41.146096+0000","last_peered":"2023-07-21T22:10:41.146096+0000","last_clean":"2023-07-21T22:10:41.146096+0000","last_became_active":"2023-07-21T22:10:35.193943+0000","last_became_peered":"2023-07-21T22:10:35.193943+0000","last_unstale":"2023-07-21T22:10:41.146096+0000","last_undegraded":"2023-07-21T22:10:41.146096+0000","last_fullsized":"2023-07-21T22:10:41.146096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:08:11.726615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263158+0000","last_change":"2023-07-21T22:10:35.175314+0000","last_active":"2023-07-21T22:10:40.263158+0000","last_peered":"2023-07-21T22:10:40.263158+0000","last_clean":"2023-07-21T22:10:40.263158+0000","last_became_active":"2023-07-21T22:10:35.175046+0000","last_became_peered":"2023-07-21T22:10:35.175046+0000","last_unstale":"2023-07-21T22:10:40.263158+0000","last_undegraded":"2023-07-21T22:10:40.263158+0000","last_fullsized":"2023-07-21T22:10:40.263158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:54.515955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146323+0000","last_change":"2023-07-21T22:10:35.187761+0000","last_active":"2023-07-21T22:10:41.146323+0000","last_peered":"2023-07-21T22:10:41.146323+0000","last_clean":"2023-07-21T22:10:41.146323+0000","last_became_active":"2023-07-21T22:10:35.187432+0000","last_became_peered":"2023-07-21T22:10:35.187432+0000","last_unstale":"2023-07-21T22:10:41.146323+0000","last_undegraded":"2023-07-21T22:10:41.146323+0000","last_fullsized":"2023-07-21T22:10:41.146323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:37:12.318204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263742+0000","last_change":"2023-07-21T22:10:35.180975+0000","last_active":"2023-07-21T22:10:40.263742+0000","last_peered":"2023-07-21T22:10:40.263742+0000","last_clean":"2023-07-21T22:10:40.263742+0000","last_became_active":"2023-07-21T22:10:35.180610+0000","last_became_peered":"2023-07-21T22:10:35.180610+0000","last_unstale":"2023-07-21T22:10:40.263742+0000","last_undegraded":"2023-07-21T22:10:40.263742+0000","last_fullsized":"2023-07-21T22:10:40.263742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:24.993895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146787+0000","last_change":"2023-07-21T22:10:35.202116+0000","last_active":"2023-07-21T22:10:41.146787+0000","last_peered":"2023-07-21T22:10:41.146787+0000","last_clean":"2023-07-21T22:10:41.146787+0000","last_became_active":"2023-07-21T22:10:35.201807+0000","last_became_peered":"2023-07-21T22:10:35.201807+0000","last_unstale":"2023-07-21T22:10:41.146787+0000","last_undegraded":"2023-07-21T22:10:41.146787+0000","last_fullsized":"2023-07-21T22:10:41.146787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:03:42.309634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145678+0000","last_change":"2023-07-21T22:10:35.182990+0000","last_active":"2023-07-21T22:10:41.145678+0000","last_peered":"2023-07-21T22:10:41.145678+0000","last_clean":"2023-07-21T22:10:41.145678+0000","last_became_active":"2023-07-21T22:10:35.182451+0000","last_became_peered":"2023-07-21T22:10:35.182451+0000","last_unstale":"2023-07-21T22:10:41.145678+0000","last_undegraded":"2023-07-21T22:10:41.145678+0000","last_fullsized":"2023-07-21T22:10:41.145678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:52:17.840975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264696+0000","last_change":"2023-07-21T22:10:35.181124+0000","last_active":"2023-07-21T22:10:40.264696+0000","last_peered":"2023-07-21T22:10:40.264696+0000","last_clean":"2023-07-21T22:10:40.264696+0000","last_became_active":"2023-07-21T22:10:35.180857+0000","last_became_peered":"2023-07-21T22:10:35.180857+0000","last_unstale":"2023-07-21T22:10:40.264696+0000","last_undegraded":"2023-07-21T22:10:40.264696+0000","last_fullsized":"2023-07-21T22:10:40.264696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:20:59.226705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266167+0000","last_change":"2023-07-21T22:10:35.178260+0000","last_active":"2023-07-21T22:10:40.266167+0000","last_peered":"2023-07-21T22:10:40.266167+0000","last_clean":"2023-07-21T22:10:40.266167+0000","last_became_active":"2023-07-21T22:10:35.178006+0000","last_became_peered":"2023-07-21T22:10:35.178006+0000","last_unstale":"2023-07-21T22:10:40.266167+0000","last_undegraded":"2023-07-21T22:10:40.266167+0000","last_fullsized":"2023-07-21T22:10:40.266167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:58:45.344226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262442+0000","last_change":"2023-07-21T22:10:35.197676+0000","last_active":"2023-07-21T22:10:40.262442+0000","last_peered":"2023-07-21T22:10:40.262442+0000","last_clean":"2023-07-21T22:10:40.262442+0000","last_became_active":"2023-07-21T22:10:35.197328+0000","last_became_peered":"2023-07-21T22:10:35.197328+0000","last_unstale":"2023-07-21T22:10:40.262442+0000","last_undegraded":"2023-07-21T22:10:40.262442+0000","last_fullsized":"2023-07-21T22:10:40.262442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:17:58.266481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":724807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":130430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":327680,"data_stored":131082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":339968,"data_stored":134279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":323584,"data_stored":130520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":319488,"data_stored":130430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":917504,"data_stored":721380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":130430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6120000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:11:03.841 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:11:03.841 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-21T22:11:03.842 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-21T22:11:03.842 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-21T22:11:03.842 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-21T22:11:04.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.013+0000 7f639931a700 1 Processor -- start 2023-07-21T22:11:04.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.013+0000 7f639931a700 1 -- start start 2023-07-21T22:11:04.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.017+0000 7f639931a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63940afc20 0x7f63940cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.017+0000 7f639931a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f63941604c0 0x7f63940afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.017+0000 7f639931a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f63940c8860 0x7f63940cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.017+0000 7f639931a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63940cdeb0 con 0x7f63941604c0 2023-07-21T22:11:04.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.017+0000 7f639931a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63940b0530 con 0x7f63940c8860 2023-07-21T22:11:04.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.017+0000 7f639931a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6394163df0 con 0x7f63940afc20 2023-07-21T22:11:04.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.017+0000 7f638bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f63941604c0 0x7f63940afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.017+0000 7f638bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f63941604c0 0x7f63940afff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46536/0 (socket says 172.21.15.49:46536) 2023-07-21T22:11:04.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.017+0000 7f638bfff700 1 -- 172.21.15.49:0/3252071434 learned_addr learned my addr 172.21.15.49:0/3252071434 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:04.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.017+0000 7f63937fe700 1 --2- 172.21.15.49:0/3252071434 >> v2:172.21.15.150:3300/0 conn(0x7f63940c8860 0x7f63940cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.017+0000 7f6392ffd700 1 --2- 172.21.15.49:0/3252071434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63940afc20 0x7f63940cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.017+0000 7f638bfff700 1 -- 172.21.15.49:0/3252071434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63940afc20 msgr2=0x7f63940cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:04.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.017+0000 7f638bfff700 1 --2- 172.21.15.49:0/3252071434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63940afc20 0x7f63940cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.021+0000 7f638bfff700 1 -- 172.21.15.49:0/3252071434 >> v2:172.21.15.150:3300/0 conn(0x7f63940c8860 msgr2=0x7f63940cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:04.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.021+0000 7f638bfff700 1 --2- 172.21.15.49:0/3252071434 >> v2:172.21.15.150:3300/0 conn(0x7f63940c8860 0x7f63940cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.021+0000 7f638bfff700 1 -- 172.21.15.49:0/3252071434 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63941640d0 con 0x7f63941604c0 2023-07-21T22:11:04.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.021+0000 7f638bfff700 1 --2- 172.21.15.49:0/3252071434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63941604c0 0x7f63940afff0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6394073160 tx=0x7f637c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b115ce75591077d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:04.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.025+0000 7f63927fc700 1 -- 172.21.15.49:0/3252071434 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c011830 con 0x7f63941604c0 2023-07-21T22:11:04.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.025+0000 7f63927fc700 1 -- 172.21.15.49:0/3252071434 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c011990 con 0x7f63941604c0 2023-07-21T22:11:04.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.025+0000 7f63927fc700 1 -- 172.21.15.49:0/3252071434 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c011d20 con 0x7f63941604c0 2023-07-21T22:11:04.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.025+0000 7f639931a700 1 -- 172.21.15.49:0/3252071434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63941604c0 msgr2=0x7f63940afff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.025+0000 7f639931a700 1 --2- 172.21.15.49:0/3252071434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63941604c0 0x7f63940afff0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6394073160 tx=0x7f637c009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.025+0000 7f639931a700 1 -- 172.21.15.49:0/3252071434 shutdown_connections 2023-07-21T22:11:04.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.025+0000 7f639931a700 1 --2- 172.21.15.49:0/3252071434 >> v2:172.21.15.150:3300/0 conn(0x7f63940c8860 0x7f63940cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.025+0000 7f639931a700 1 --2- 172.21.15.49:0/3252071434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63941604c0 0x7f63940afff0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.025+0000 7f639931a700 1 --2- 172.21.15.49:0/3252071434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63940afc20 0x7f63940cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.025+0000 7f639931a700 1 -- 172.21.15.49:0/3252071434 >> 172.21.15.49:0/3252071434 conn(0x7f639406f5a0 msgr2=0x7f63940cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:04.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.025+0000 7f639931a700 1 -- 172.21.15.49:0/3252071434 shutdown_connections 2023-07-21T22:11:04.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.025+0000 7f639931a700 1 -- 172.21.15.49:0/3252071434 wait complete. 2023-07-21T22:11:04.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.029+0000 7f639931a700 1 Processor -- start 2023-07-21T22:11:04.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.029+0000 7f639931a700 1 -- start start 2023-07-21T22:11:04.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.029+0000 7f639931a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63940afc20 0x7f63940ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.029+0000 7f639931a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63940c8860 0x7f63940b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.029+0000 7f639931a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63941604c0 0x7f63940b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.029+0000 7f639931a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6394161e60 con 0x7f63940c8860 2023-07-21T22:11:04.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.029+0000 7f639931a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63940b2bc0 con 0x7f63940afc20 2023-07-21T22:11:04.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.029+0000 7f639931a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63940b2ea0 con 0x7f63941604c0 2023-07-21T22:11:04.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.029+0000 7f638bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63940c8860 0x7f63940b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.029+0000 7f63937fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63941604c0 0x7f63940b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.029+0000 7f6392ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63940afc20 0x7f63940ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.029+0000 7f63937fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63941604c0 0x7f63940b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:55640/0 (socket says 172.21.15.49:55640) 2023-07-21T22:11:04.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.029+0000 7f63937fe700 1 -- 172.21.15.49:0/761828212 learned_addr learned my addr 172.21.15.49:0/761828212 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:04.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.029+0000 7f63937fe700 1 -- 172.21.15.49:0/761828212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63940afc20 msgr2=0x7f63940ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.033+0000 7f63937fe700 1 --2- 172.21.15.49:0/761828212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63940afc20 0x7f63940ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.033+0000 7f63937fe700 1 -- 172.21.15.49:0/761828212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63940c8860 msgr2=0x7f63940b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.033+0000 7f63937fe700 1 --2- 172.21.15.49:0/761828212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63940c8860 0x7f63940b2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.033+0000 7f63937fe700 1 -- 172.21.15.49:0/761828212 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c009570 con 0x7f63941604c0 2023-07-21T22:11:04.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.033+0000 7f63937fe700 1 --2- 172.21.15.49:0/761828212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63941604c0 0x7f63940b2560 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f638c00efc0 tx=0x7f638c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:04.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.033+0000 7f638b7fe700 1 -- 172.21.15.49:0/761828212 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c009ea0 con 0x7f63941604c0 2023-07-21T22:11:04.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.033+0000 7f638b7fe700 1 -- 172.21.15.49:0/761828212 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c00f040 con 0x7f63941604c0 2023-07-21T22:11:04.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.033+0000 7f639931a700 1 -- 172.21.15.49:0/761828212 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63940b3180 con 0x7f63941604c0 2023-07-21T22:11:04.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.033+0000 7f638b7fe700 1 -- 172.21.15.49:0/761828212 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c00ced0 con 0x7f63941604c0 2023-07-21T22:11:04.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.033+0000 7f639931a700 1 -- 172.21.15.49:0/761828212 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63940b3740 con 0x7f63941604c0 2023-07-21T22:11:04.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.033+0000 7f639931a700 1 -- 172.21.15.49:0/761828212 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63940b3930 con 0x7f63941604c0 2023-07-21T22:11:04.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.037+0000 7f638b7fe700 1 -- 172.21.15.49:0/761828212 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f638c014480 con 0x7f63941604c0 2023-07-21T22:11:04.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.037+0000 7f638b7fe700 1 --2- 172.21.15.49:0/761828212 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f63740662f0 0x7f63740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.037+0000 7f638b7fe700 1 -- 172.21.15.49:0/761828212 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f638c0848a0 con 0x7f63941604c0 2023-07-21T22:11:04.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.037+0000 7f6392ffd700 1 --2- 172.21.15.49:0/761828212 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f63740662f0 0x7f63740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.041+0000 7f6392ffd700 1 --2- 172.21.15.49:0/761828212 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f63740662f0 0x7f63740687a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6384004610 tx=0x7f6384008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:04.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.045+0000 7f638b7fe700 1 -- 172.21.15.49:0/761828212 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f638c051a40 con 0x7f63941604c0 2023-07-21T22:11:04.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.261+0000 7f639931a700 1 -- 172.21.15.49:0/761828212 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f639404dcb0 con 0x7f63941604c0 2023-07-21T22:11:04.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.269+0000 7f638b7fe700 1 -- 172.21.15.49:0/761828212 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164240 (secure 0 0 0) 0x7f638c018090 con 0x7f63941604c0 2023-07-21T22:11:04.314 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.277+0000 7f639931a700 1 -- 172.21.15.49:0/761828212 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f63740662f0 msgr2=0x7f63740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.277+0000 7f639931a700 1 --2- 172.21.15.49:0/761828212 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f63740662f0 0x7f63740687a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6384004610 tx=0x7f6384008040 comp rx=0 tx=0).stop 2023-07-21T22:11:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.277+0000 7f639931a700 1 -- 172.21.15.49:0/761828212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63941604c0 msgr2=0x7f63940b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.277+0000 7f639931a700 1 --2- 172.21.15.49:0/761828212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63941604c0 0x7f63940b2560 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f638c00efc0 tx=0x7f638c00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.277+0000 7f639931a700 1 -- 172.21.15.49:0/761828212 shutdown_connections 2023-07-21T22:11:04.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.277+0000 7f639931a700 1 --2- 172.21.15.49:0/761828212 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f63740662f0 0x7f63740687a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.277+0000 7f639931a700 1 --2- 172.21.15.49:0/761828212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63940c8860 0x7f63940b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.277+0000 7f639931a700 1 --2- 172.21.15.49:0/761828212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63941604c0 0x7f63940b2560 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.277+0000 7f639931a700 1 --2- 172.21.15.49:0/761828212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63940afc20 0x7f63940ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.277+0000 7f639931a700 1 -- 172.21.15.49:0/761828212 >> 172.21.15.49:0/761828212 conn(0x7f639406f5a0 msgr2=0x7f6394070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.277+0000 7f639931a700 1 -- 172.21.15.49:0/761828212 shutdown_connections 2023-07-21T22:11:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.277+0000 7f639931a700 1 -- 172.21.15.49:0/761828212 wait complete. 2023-07-21T22:11:04.342 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1334330893},{"type":"v1","addr":"172.21.15.49:6833","nonce":1334330893}]},"active_addr":"172.21.15.49:6833/1334330893","active_change":"2023-07-21T22:10:14.277357+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":1254033367}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":2076265854}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":47255286}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":3561614695}]}]} 2023-07-21T22:11:04.346 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-21T22:11:04.347 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-21T22:11:04.347 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:04.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.485+0000 7fd4f10a2700 1 Processor -- start 2023-07-21T22:11:04.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.489+0000 7fd4f10a2700 1 -- start start 2023-07-21T22:11:04.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.489+0000 7fd4f10a2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd4ec15c070 0x7fd4ec0ae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.489+0000 7fd4f10a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0b1260 0x7fd4ec06fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.489+0000 7fd4f10a2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd4ec0cb570 0x7fd4ec0cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.489+0000 7fd4f10a2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ec0cbf00 con 0x7fd4ec15c070 2023-07-21T22:11:04.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.489+0000 7fd4f10a2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ec15c440 con 0x7fd4ec0cb570 2023-07-21T22:11:04.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.489+0000 7fd4f10a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0c3e90 con 0x7fd4ec0b1260 2023-07-21T22:11:04.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.489+0000 7fd4ead9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd4ec15c070 0x7fd4ec0ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.489+0000 7fd4ea59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0b1260 0x7fd4ec06fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.489+0000 7fd4eb59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd4ec0cb570 0x7fd4ec0cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.489+0000 7fd4ea59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0b1260 0x7fd4ec06fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:55644/0 (socket says 172.21.15.49:55644) 2023-07-21T22:11:04.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.489+0000 7fd4ea59c700 1 -- 172.21.15.49:0/820195287 learned_addr learned my addr 172.21.15.49:0/820195287 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:04.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4ea59c700 1 -- 172.21.15.49:0/820195287 >> v2:172.21.15.150:3300/0 conn(0x7fd4ec0cb570 msgr2=0x7fd4ec0cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:04.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4ea59c700 1 --2- 172.21.15.49:0/820195287 >> v2:172.21.15.150:3300/0 conn(0x7fd4ec0cb570 0x7fd4ec0cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4ea59c700 1 -- 172.21.15.49:0/820195287 >> v2:172.21.15.49:3300/0 conn(0x7fd4ec15c070 msgr2=0x7fd4ec0ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:04.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4ea59c700 1 --2- 172.21.15.49:0/820195287 >> v2:172.21.15.49:3300/0 conn(0x7fd4ec15c070 0x7fd4ec0ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4ea59c700 1 -- 172.21.15.49:0/820195287 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec0c54b0 con 0x7fd4ec0b1260 2023-07-21T22:11:04.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4ea59c700 1 --2- 172.21.15.49:0/820195287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0b1260 0x7fd4ec06fc80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0734c0 tx=0x7fd4e0009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7380d26eceed5fcf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:04.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4e9d9b700 1 -- 172.21.15.49:0/820195287 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0011830 con 0x7fd4ec0b1260 2023-07-21T22:11:04.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4e9d9b700 1 -- 172.21.15.49:0/820195287 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e0011990 con 0x7fd4ec0b1260 2023-07-21T22:11:04.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4e9d9b700 1 -- 172.21.15.49:0/820195287 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0011d20 con 0x7fd4ec0b1260 2023-07-21T22:11:04.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4f10a2700 1 -- 172.21.15.49:0/820195287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0b1260 msgr2=0x7fd4ec06fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4f10a2700 1 --2- 172.21.15.49:0/820195287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0b1260 0x7fd4ec06fc80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0734c0 tx=0x7fd4e0009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4f10a2700 1 -- 172.21.15.49:0/820195287 shutdown_connections 2023-07-21T22:11:04.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4f10a2700 1 --2- 172.21.15.49:0/820195287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0b1260 0x7fd4ec06fc80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4f10a2700 1 --2- 172.21.15.49:0/820195287 >> v2:172.21.15.150:3300/0 conn(0x7fd4ec0cb570 0x7fd4ec0cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4f10a2700 1 --2- 172.21.15.49:0/820195287 >> v2:172.21.15.49:3300/0 conn(0x7fd4ec15c070 0x7fd4ec0ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4f10a2700 1 -- 172.21.15.49:0/820195287 >> 172.21.15.49:0/820195287 conn(0x7fd4ec071d20 msgr2=0x7fd4ec0b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:04.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4f10a2700 1 -- 172.21.15.49:0/820195287 shutdown_connections 2023-07-21T22:11:04.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.493+0000 7fd4f10a2700 1 -- 172.21.15.49:0/820195287 wait complete. 2023-07-21T22:11:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.497+0000 7fd4f10a2700 1 Processor -- start 2023-07-21T22:11:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.497+0000 7fd4f10a2700 1 -- start start 2023-07-21T22:11:04.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4f10a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0b1260 0x7fd4ec0ce250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4f10a2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ec0cb570 0x7fd4ec0c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4f10a2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4ec15c070 0x7fd4ec0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4f10a2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec15a270 con 0x7fd4ec0cb570 2023-07-21T22:11:04.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4f10a2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0ccdd0 con 0x7fd4ec15c070 2023-07-21T22:11:04.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4f10a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec159660 con 0x7fd4ec0b1260 2023-07-21T22:11:04.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4ea59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ec0cb570 0x7fd4ec0c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4ea59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ec0cb570 0x7fd4ec0c5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46566/0 (socket says 172.21.15.49:46566) 2023-07-21T22:11:04.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4ea59c700 1 -- 172.21.15.49:0/683879360 learned_addr learned my addr 172.21.15.49:0/683879360 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:04.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4ead9d700 1 --2- 172.21.15.49:0/683879360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0b1260 0x7fd4ec0ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4eb59e700 1 --2- 172.21.15.49:0/683879360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4ec15c070 0x7fd4ec0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4ea59c700 1 -- 172.21.15.49:0/683879360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0b1260 msgr2=0x7fd4ec0ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4ea59c700 1 --2- 172.21.15.49:0/683879360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0b1260 0x7fd4ec0ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4ea59c700 1 -- 172.21.15.49:0/683879360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4ec15c070 msgr2=0x7fd4ec0ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4ea59c700 1 --2- 172.21.15.49:0/683879360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4ec15c070 0x7fd4ec0ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4ea59c700 1 -- 172.21.15.49:0/683879360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e0009570 con 0x7fd4ec0cb570 2023-07-21T22:11:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4ea59c700 1 --2- 172.21.15.49:0/683879360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ec0cb570 0x7fd4ec0c5c50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0000c00 tx=0x7fd4e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:04.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4d37fe700 1 -- 172.21.15.49:0/683879360 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0004450 con 0x7fd4ec0cb570 2023-07-21T22:11:04.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4d37fe700 1 -- 172.21.15.49:0/683879360 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e001e070 con 0x7fd4ec0cb570 2023-07-21T22:11:04.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4d37fe700 1 -- 172.21.15.49:0/683879360 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e00038e0 con 0x7fd4ec0cb570 2023-07-21T22:11:04.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.501+0000 7fd4f10a2700 1 -- 172.21.15.49:0/683879360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ec159940 con 0x7fd4ec0cb570 2023-07-21T22:11:04.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.505+0000 7fd4f10a2700 1 -- 172.21.15.49:0/683879360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec159f00 con 0x7fd4ec0cb570 2023-07-21T22:11:04.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.505+0000 7fd4f10a2700 1 -- 172.21.15.49:0/683879360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ec15a090 con 0x7fd4ec0cb570 2023-07-21T22:11:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.509+0000 7fd4d37fe700 1 -- 172.21.15.49:0/683879360 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd4e0003a40 con 0x7fd4ec0cb570 2023-07-21T22:11:04.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.509+0000 7fd4d37fe700 1 --2- 172.21.15.49:0/683879360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd4d80662f0 0x7fd4d80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.509+0000 7fd4d37fe700 1 -- 172.21.15.49:0/683879360 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd4e0020070 con 0x7fd4ec0cb570 2023-07-21T22:11:04.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.509+0000 7fd4ead9d700 1 --2- 172.21.15.49:0/683879360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd4d80662f0 0x7fd4d80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.509+0000 7fd4ead9d700 1 --2- 172.21.15.49:0/683879360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd4d80662f0 0x7fd4d80687a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009be0 tx=0x7fd4dc009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.517+0000 7fd4d37fe700 1 -- 172.21.15.49:0/683879360 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4e0051d40 con 0x7fd4ec0cb570 2023-07-21T22:11:04.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.697+0000 7fd4f10a2700 1 -- 172.21.15.49:0/683879360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4ec04dcb0 con 0x7fd4ec0cb570 2023-07-21T22:11:04.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.701+0000 7fd4d37fe700 1 -- 172.21.15.49:0/683879360 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20084 (secure 0 0 0) 0x7fd4e0055360 con 0x7fd4ec0cb570 2023-07-21T22:11:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:04.743 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:39.728219+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:04.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.701+0000 7fd4f10a2700 1 -- 172.21.15.49:0/683879360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd4d80662f0 msgr2=0x7fd4d80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.701+0000 7fd4f10a2700 1 --2- 172.21.15.49:0/683879360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd4d80662f0 0x7fd4d80687a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009be0 tx=0x7fd4dc009240 comp rx=0 tx=0).stop 2023-07-21T22:11:04.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.701+0000 7fd4f10a2700 1 -- 172.21.15.49:0/683879360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ec0cb570 msgr2=0x7fd4ec0c5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.701+0000 7fd4f10a2700 1 --2- 172.21.15.49:0/683879360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ec0cb570 0x7fd4ec0c5c50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0000c00 tx=0x7fd4e0004770 comp rx=0 tx=0).stop 2023-07-21T22:11:04.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.701+0000 7fd4f10a2700 1 -- 172.21.15.49:0/683879360 shutdown_connections 2023-07-21T22:11:04.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.701+0000 7fd4f10a2700 1 --2- 172.21.15.49:0/683879360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd4d80662f0 0x7fd4d80687a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.701+0000 7fd4f10a2700 1 --2- 172.21.15.49:0/683879360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ec0cb570 0x7fd4ec0c5c50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.701+0000 7fd4f10a2700 1 --2- 172.21.15.49:0/683879360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4ec15c070 0x7fd4ec0ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.701+0000 7fd4f10a2700 1 --2- 172.21.15.49:0/683879360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0b1260 0x7fd4ec0ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.701+0000 7fd4f10a2700 1 -- 172.21.15.49:0/683879360 >> 172.21.15.49:0/683879360 conn(0x7fd4ec071d20 msgr2=0x7fd4ec06fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:04.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.701+0000 7fd4f10a2700 1 -- 172.21.15.49:0/683879360 shutdown_connections 2023-07-21T22:11:04.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.701+0000 7fd4f10a2700 1 -- 172.21.15.49:0/683879360 wait complete. 2023-07-21T22:11:04.769 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-21T22:11:04.769 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:04.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.901+0000 7f4c7342c700 1 Processor -- start 2023-07-21T22:11:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.901+0000 7f4c7342c700 1 -- start start 2023-07-21T22:11:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.901+0000 7f4c7342c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c6c1628f0 0x7f4c6c164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.901+0000 7f4c7342c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c6c0b0330 con 0x7f4c6c159f60 2023-07-21T22:11:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.901+0000 7f4c7342c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c6c0b0600 con 0x7f4c6c06d5d0 2023-07-21T22:11:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.901+0000 7f4c7342c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c15a470 con 0x7f4c6c1628f0 2023-07-21T22:11:04.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c709c7700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4c6c159f60 0x7f4c6c0afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44622/0 (socket says 172.21.15.49:44622) 2023-07-21T22:11:04.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c709c7700 1 -- 172.21.15.49:0/2617897981 learned_addr learned my addr 172.21.15.49:0/2617897981 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:04.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c719c9700 1 --2- 172.21.15.49:0/2617897981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c6c1628f0 0x7f4c6c164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 -- 172.21.15.49:0/2617897981 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389583784 0 0) 0x7f4c6c0b0330 con 0x7f4c6c159f60 2023-07-21T22:11:04.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 -- 172.21.15.49:0/2617897981 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c580035d0 con 0x7f4c6c159f60 2023-07-21T22:11:04.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 -- 172.21.15.49:0/2617897981 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1617527920 0 0) 0x7f4c580035d0 con 0x7f4c6c159f60 2023-07-21T22:11:04.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 -- 172.21.15.49:0/2617897981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c6c1628f0 msgr2=0x7f4c6c164cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:04.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 --2- 172.21.15.49:0/2617897981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c6c1628f0 0x7f4c6c164cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 -- 172.21.15.49:0/2617897981 >> v1:172.21.15.150:6789/0 conn(0x7f4c6c06d5d0 legacy=0x7f4c6c06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 -- 172.21.15.49:0/2617897981 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c15a750 con 0x7f4c6c159f60 2023-07-21T22:11:04.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 -- 172.21.15.49:0/2617897981 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f4c5c001670 con 0x7f4c6c159f60 2023-07-21T22:11:04.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 -- 172.21.15.49:0/2617897981 >> v1:172.21.15.49:6789/0 conn(0x7f4c6c159f60 legacy=0x7f4c6c0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 --2- 172.21.15.49:0/2617897981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c6c1628f0 0x7f4c58003ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 --2- 172.21.15.49:0/2617897981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c58004040 0x7f4c58004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 --2- 172.21.15.49:0/2617897981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58004db0 0x7f4c58005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 -- 172.21.15.49:0/2617897981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c15a470 con 0x7f4c58004db0 2023-07-21T22:11:04.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 -- 172.21.15.49:0/2617897981 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5800bd10 con 0x7f4c58004040 2023-07-21T22:11:04.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 -- 172.21.15.49:0/2617897981 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5800bed0 con 0x7f4c6c1628f0 2023-07-21T22:11:04.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c719c9700 1 --2- 172.21.15.49:0/2617897981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58004db0 0x7f4c58005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c711c8700 1 --2- 172.21.15.49:0/2617897981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c6c1628f0 0x7f4c58003ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c709c7700 1 --2- 172.21.15.49:0/2617897981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c58004040 0x7f4c58004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c719c9700 1 -- 172.21.15.49:0/2617897981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c6c1628f0 msgr2=0x7f4c58003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:04.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c719c9700 1 --2- 172.21.15.49:0/2617897981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c6c1628f0 0x7f4c58003ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c719c9700 1 -- 172.21.15.49:0/2617897981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c58004040 msgr2=0x7f4c58004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:04.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c719c9700 1 --2- 172.21.15.49:0/2617897981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c58004040 0x7f4c58004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c719c9700 1 -- 172.21.15.49:0/2617897981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580035d0 con 0x7f4c58004db0 2023-07-21T22:11:04.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c709c7700 1 --2- 172.21.15.49:0/2617897981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c58004040 0x7f4c58004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:04.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c719c9700 1 --2- 172.21.15.49:0/2617897981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58004db0 0x7f4c58005220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009f90 tx=0x7f4c580058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6bb11832c3db1c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:04.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 -- 172.21.15.49:0/2617897981 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6400ec30 con 0x7f4c58004db0 2023-07-21T22:11:04.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 -- 172.21.15.49:0/2617897981 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6400f040 con 0x7f4c58004db0 2023-07-21T22:11:04.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.905+0000 7f4c63fff700 1 -- 172.21.15.49:0/2617897981 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64014480 con 0x7f4c58004db0 2023-07-21T22:11:04.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.909+0000 7f4c7342c700 1 -- 172.21.15.49:0/2617897981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58004db0 msgr2=0x7f4c58005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.909+0000 7f4c7342c700 1 --2- 172.21.15.49:0/2617897981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58004db0 0x7f4c58005220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009f90 tx=0x7f4c580058a0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.909+0000 7f4c719c9700 1 -- 172.21.15.49:0/2617897981 reap_dead start 2023-07-21T22:11:04.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.909+0000 7f4c7342c700 1 -- 172.21.15.49:0/2617897981 shutdown_connections 2023-07-21T22:11:04.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.909+0000 7f4c7342c700 1 -- 172.21.15.49:0/2617897981 >> 172.21.15.49:0/2617897981 conn(0x7f4c6c06f5a0 msgr2=0x7f4c6c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:04.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.909+0000 7f4c7342c700 1 -- 172.21.15.49:0/2617897981 shutdown_connections 2023-07-21T22:11:04.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.909+0000 7f4c7342c700 1 -- 172.21.15.49:0/2617897981 wait complete. 2023-07-21T22:11:04.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c7342c700 1 Processor -- start 2023-07-21T22:11:04.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c7342c700 1 -- start start 2023-07-21T22:11:04.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c7342c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c58004db0 0x7f4c6c154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c7342c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c6c0ca2b0 0x7f4c6c152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c7342c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c6c15b1c0 0x7f4c6c1f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c7342c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c1547f0 con 0x7f4c6c0ca2b0 2023-07-21T22:11:04.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c7342c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c0c1e00 con 0x7f4c58004db0 2023-07-21T22:11:04.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c7342c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c0c20a0 con 0x7f4c6c15b1c0 2023-07-21T22:11:04.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c709c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c6c0ca2b0 0x7f4c6c152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c709c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c6c0ca2b0 0x7f4c6c152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47986/0 (socket says 172.21.15.49:47986) 2023-07-21T22:11:04.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c709c7700 1 -- 172.21.15.49:0/1779743106 learned_addr learned my addr 172.21.15.49:0/1779743106 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:04.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c711c8700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c58004db0 0x7f4c6c154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c719c9700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c6c15b1c0 0x7f4c6c1f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c709c7700 1 -- 172.21.15.49:0/1779743106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c6c15b1c0 msgr2=0x7f4c6c1f0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c709c7700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c6c15b1c0 0x7f4c6c1f0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c709c7700 1 -- 172.21.15.49:0/1779743106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c58004db0 msgr2=0x7f4c6c154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:04.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c709c7700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c58004db0 0x7f4c6c154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:04.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c709c7700 1 -- 172.21.15.49:0/1779743106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c0c2380 con 0x7f4c6c0ca2b0 2023-07-21T22:11:04.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c711c8700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c58004db0 0x7f4c6c154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:04.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.913+0000 7f4c709c7700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c6c0ca2b0 0x7f4c6c152940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c000ff0 tx=0x7f4c5c00de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:04.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.917+0000 7f4c61ffb700 1 -- 172.21.15.49:0/1779743106 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c004ca0 con 0x7f4c6c0ca2b0 2023-07-21T22:11:04.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.917+0000 7f4c61ffb700 1 -- 172.21.15.49:0/1779743106 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5c004e00 con 0x7f4c6c0ca2b0 2023-07-21T22:11:04.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.917+0000 7f4c61ffb700 1 -- 172.21.15.49:0/1779743106 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0072f0 con 0x7f4c6c0ca2b0 2023-07-21T22:11:04.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.917+0000 7f4c7342c700 1 -- 172.21.15.49:0/1779743106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6c0af5d0 con 0x7f4c6c0ca2b0 2023-07-21T22:11:04.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.917+0000 7f4c7342c700 1 -- 172.21.15.49:0/1779743106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6c15b630 con 0x7f4c6c0ca2b0 2023-07-21T22:11:04.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.917+0000 7f4c7342c700 1 -- 172.21.15.49:0/1779743106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6c073130 con 0x7f4c6c0ca2b0 2023-07-21T22:11:04.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.917+0000 7f4c61ffb700 1 -- 172.21.15.49:0/1779743106 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4c5c007450 con 0x7f4c6c0ca2b0 2023-07-21T22:11:04.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.921+0000 7f4c61ffb700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4c50066320 0x7f4c500687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:04.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.921+0000 7f4c61ffb700 1 -- 172.21.15.49:0/1779743106 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4c5c083cf0 con 0x7f4c6c0ca2b0 2023-07-21T22:11:04.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.921+0000 7f4c711c8700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4c50066320 0x7f4c500687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:04.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.921+0000 7f4c711c8700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4c50066320 0x7f4c500687d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4c68005670 tx=0x7f4c68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:04.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:04.925+0000 7f4c61ffb700 1 -- 172.21.15.49:0/1779743106 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c5c050f30 con 0x7f4c6c0ca2b0 2023-07-21T22:11:05.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.105+0000 7f4c7342c700 1 -- 172.21.15.49:0/1779743106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c6c04dcb0 con 0x7f4c6c0ca2b0 2023-07-21T22:11:05.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.109+0000 7f4c61ffb700 1 -- 172.21.15.49:0/1779743106 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f4c5c054550 con 0x7f4c6c0ca2b0 2023-07-21T22:11:05.154 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:05.154 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:39.728219+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:05.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.113+0000 7f4c7342c700 1 -- 172.21.15.49:0/1779743106 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4c50066320 msgr2=0x7f4c500687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.113+0000 7f4c7342c700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4c50066320 0x7f4c500687d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4c68005670 tx=0x7f4c68009040 comp rx=0 tx=0).stop 2023-07-21T22:11:05.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.113+0000 7f4c7342c700 1 -- 172.21.15.49:0/1779743106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c6c0ca2b0 msgr2=0x7f4c6c152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.113+0000 7f4c7342c700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c6c0ca2b0 0x7f4c6c152940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c000ff0 tx=0x7f4c5c00de70 comp rx=0 tx=0).stop 2023-07-21T22:11:05.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.113+0000 7f4c7342c700 1 -- 172.21.15.49:0/1779743106 shutdown_connections 2023-07-21T22:11:05.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.113+0000 7f4c7342c700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4c50066320 0x7f4c500687d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.113+0000 7f4c7342c700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c6c0ca2b0 0x7f4c6c152940 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.113+0000 7f4c7342c700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c6c15b1c0 0x7f4c6c1f0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.113+0000 7f4c7342c700 1 --2- 172.21.15.49:0/1779743106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c58004db0 0x7f4c6c154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.113+0000 7f4c7342c700 1 -- 172.21.15.49:0/1779743106 >> 172.21.15.49:0/1779743106 conn(0x7f4c6c06f5a0 msgr2=0x7f4c6c06d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.113+0000 7f4c7342c700 1 -- 172.21.15.49:0/1779743106 shutdown_connections 2023-07-21T22:11:05.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.113+0000 7f4c7342c700 1 -- 172.21.15.49:0/1779743106 wait complete. 2023-07-21T22:11:05.181 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-21T22:11:05.182 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-21T22:11:05.182 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-21T22:11:05.183 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-21T22:11:05.183 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-21T22:11:05.183 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-21T22:11:05.184 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-21T22:11:05.184 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-21T22:11:05.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.377+0000 7f45e14f2700 1 Processor -- start 2023-07-21T22:11:05.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.377+0000 7f45e14f2700 1 -- start start 2023-07-21T22:11:05.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45e14f2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45dc0b7df0 0x7f45dc0d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45e14f2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45dc0d1c20 0x7f45dc0cde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45e14f2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45dc0d2070 con 0x7f45dc163680 2023-07-21T22:11:05.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45e14f2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45dc0d1110 con 0x7f45dc0d1c20 2023-07-21T22:11:05.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45e14f2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0d0070 con 0x7f45dc0b7df0 2023-07-21T22:11:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45dbfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f45dc163680 0x7f45dc1645d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:58788/0 (socket says 172.21.15.49:58788) 2023-07-21T22:11:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45dbfff700 1 -- 172.21.15.49:0/2996090550 learned_addr learned my addr 172.21.15.49:0/2996090550 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45e0cf1700 1 --2- 172.21.15.49:0/2996090550 >> v2:172.21.15.49:3300/0 conn(0x7f45dc0d1c20 0x7f45dc0cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45db7fe700 1 --2- 172.21.15.49:0/2996090550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45dc0b7df0 0x7f45dc0d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45daffd700 1 -- 172.21.15.49:0/2996090550 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330720502 0 0) 0x7f45d0001110 con 0x7f45dc163680 2023-07-21T22:11:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45daffd700 1 -- 172.21.15.49:0/2996090550 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45c40035d0 con 0x7f45dc163680 2023-07-21T22:11:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45e0cf1700 1 -- 172.21.15.49:0/2996090550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45dc0b7df0 msgr2=0x7f45dc0d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45e0cf1700 1 --2- 172.21.15.49:0/2996090550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45dc0b7df0 0x7f45dc0d16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45e0cf1700 1 -- 172.21.15.49:0/2996090550 >> v1:172.21.15.150:6789/0 conn(0x7f45dc163680 legacy=0x7f45dc1645d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45e0cf1700 1 -- 172.21.15.49:0/2996090550 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc0d0350 con 0x7f45dc0d1c20 2023-07-21T22:11:05.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45db7fe700 1 --2- 172.21.15.49:0/2996090550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45dc0b7df0 0x7f45dc0d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:05.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45e0cf1700 1 --2- 172.21.15.49:0/2996090550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45dc0d1c20 0x7f45dc0cde50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009dc0 tx=0x7f45d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6514870e390ce3f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45daffd700 1 -- 172.21.15.49:0/2996090550 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d400e070 con 0x7f45dc0d1c20 2023-07-21T22:11:05.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45daffd700 1 -- 172.21.15.49:0/2996090550 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d400bae0 con 0x7f45dc0d1c20 2023-07-21T22:11:05.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.381+0000 7f45daffd700 1 -- 172.21.15.49:0/2996090550 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d400be90 con 0x7f45dc0d1c20 2023-07-21T22:11:05.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.385+0000 7f45e14f2700 1 -- 172.21.15.49:0/2996090550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45dc0d1c20 msgr2=0x7f45dc0cde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.385+0000 7f45e14f2700 1 --2- 172.21.15.49:0/2996090550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45dc0d1c20 0x7f45dc0cde50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009dc0 tx=0x7f45d400b330 comp rx=0 tx=0).stop 2023-07-21T22:11:05.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.385+0000 7f45e14f2700 1 -- 172.21.15.49:0/2996090550 shutdown_connections 2023-07-21T22:11:05.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.385+0000 7f45e14f2700 1 --2- 172.21.15.49:0/2996090550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45dc0b7df0 0x7f45dc0d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.385+0000 7f45e14f2700 1 --2- 172.21.15.49:0/2996090550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45dc0d1c20 0x7f45dc0cde50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.385+0000 7f45e14f2700 1 -- 172.21.15.49:0/2996090550 >> 172.21.15.49:0/2996090550 conn(0x7f45dc06e960 msgr2=0x7f45dc06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.385+0000 7f45e14f2700 1 -- 172.21.15.49:0/2996090550 shutdown_connections 2023-07-21T22:11:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.385+0000 7f45e14f2700 1 -- 172.21.15.49:0/2996090550 wait complete. 2023-07-21T22:11:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.385+0000 7f45e14f2700 1 Processor -- start 2023-07-21T22:11:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e14f2700 1 -- start start 2023-07-21T22:11:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f3e9605a700 1 Processor -- start 2023-07-21T22:11:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e14f2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45dc0b7df0 0x7f45dc212290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e14f2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45dc0d1c20 0x7f45dc2127d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e14f2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45dc163680 0x7f45dc212d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e14f2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc06d880 con 0x7f45dc163680 2023-07-21T22:11:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e14f2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0c6720 con 0x7f45dc0b7df0 2023-07-21T22:11:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e14f2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc06d5a0 con 0x7f45dc0d1c20 2023-07-21T22:11:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e0cf1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45dc163680 0x7f45dc212d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e0cf1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45dc163680 0x7f45dc212d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48010/0 (socket says 172.21.15.49:48010) 2023-07-21T22:11:05.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e0cf1700 1 -- 172.21.15.49:0/100042178 learned_addr learned my addr 172.21.15.49:0/100042178 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45dbfff700 1 --2- 172.21.15.49:0/100042178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45dc0b7df0 0x7f45dc212290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45db7fe700 1 --2- 172.21.15.49:0/100042178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45dc0d1c20 0x7f45dc2127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e0cf1700 1 -- 172.21.15.49:0/100042178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45dc0d1c20 msgr2=0x7f45dc2127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e0cf1700 1 --2- 172.21.15.49:0/100042178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45dc0d1c20 0x7f45dc2127d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e0cf1700 1 -- 172.21.15.49:0/100042178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45dc0b7df0 msgr2=0x7f45dc212290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e0cf1700 1 --2- 172.21.15.49:0/100042178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45dc0b7df0 0x7f45dc212290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e0cf1700 1 -- 172.21.15.49:0/100042178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d4009a70 con 0x7f45dc163680 2023-07-21T22:11:05.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f9cce54a700 1 Processor -- start 2023-07-21T22:11:05.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f45e0cf1700 1 --2- 172.21.15.49:0/100042178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45dc163680 0x7f45dc212d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45d400b370 tx=0x7f45d4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f3e9605a700 1 -- start start 2023-07-21T22:11:05.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.389+0000 7f3e9605a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3e900c1470 0x7f3e900c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e9605a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9006e010 con 0x7f3e900ca2c0 2023-07-21T22:11:05.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e9605a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e90160740 con 0x7f3e90160370 2023-07-21T22:11:05.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e9605a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e900ccc50 con 0x7f3e900c1470 2023-07-21T22:11:05.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e95058700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3e90160370 0x7f3e9006d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:58802/0 (socket says 172.21.15.49:58802) 2023-07-21T22:11:05.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e95058700 1 -- 172.21.15.49:0/1911909022 learned_addr learned my addr 172.21.15.49:0/1911909022 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:05.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e94857700 1 --2- 172.21.15.49:0/1911909022 >> v2:172.21.15.49:3300/0 conn(0x7f3e900c1470 0x7f3e900c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e8ffff700 1 -- 172.21.15.49:0/1911909022 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920927016 0 0) 0x7f3e90160740 con 0x7f3e90160370 2023-07-21T22:11:05.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e8ffff700 1 -- 172.21.15.49:0/1911909022 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e780035d0 con 0x7f3e90160370 2023-07-21T22:11:05.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f9cce54a700 1 -- start start 2023-07-21T22:11:05.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f9cce54a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9cc00e29f0 0x7f9cc0055490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f9cce54a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9cc0038560 0x7f9cc003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f9cce54a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc0007360 con 0x7f9cc003b160 2023-07-21T22:11:05.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f9cce54a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc00e2dc0 con 0x7f9cc00e29f0 2023-07-21T22:11:05.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f9cce54a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc0053f70 con 0x7f9cc0038560 2023-07-21T22:11:05.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e94857700 1 -- 172.21.15.49:0/1911909022 >> v1:172.21.15.150:6789/0 conn(0x7f3e90160370 legacy=0x7f3e9006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e94857700 1 -- 172.21.15.49:0/1911909022 >> v1:172.21.15.49:6789/0 conn(0x7f3e900ca2c0 legacy=0x7f3e90163ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:11:05.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e94857700 1 -- 172.21.15.49:0/1911909022 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e900afc90 con 0x7f3e900c1470 2023-07-21T22:11:05.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f45d8ff9700 1 -- 172.21.15.49:0/100042178 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d40045d0 con 0x7f45dc163680 2023-07-21T22:11:05.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f45d8ff9700 1 -- 172.21.15.49:0/100042178 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d4020070 con 0x7f45dc163680 2023-07-21T22:11:05.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f9ccd548700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9cc00e29f0 0x7f9cc0055490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f9ccd548700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9cc00e29f0 0x7f9cc0055490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48020/0 (socket says 172.21.15.49:48020) 2023-07-21T22:11:05.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f9ccd548700 1 -- 172.21.15.49:0/2802669575 learned_addr learned my addr 172.21.15.49:0/2802669575 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f45d8ff9700 1 -- 172.21.15.49:0/100042178 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d4004970 con 0x7f45dc163680 2023-07-21T22:11:05.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e94857700 1 --2- 172.21.15.49:0/1911909022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e900c1470 0x7f3e900c9d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009850 tx=0x7f3e84009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f9f94e2ed8b99b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f45e14f2700 1 -- 172.21.15.49:0/100042178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45dc0c60d0 con 0x7f45dc163680 2023-07-21T22:11:05.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f45e14f2700 1 -- 172.21.15.49:0/100042178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc06d190 con 0x7f45dc163680 2023-07-21T22:11:05.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f9cccd47700 1 --2- 172.21.15.49:0/2802669575 >> v2:172.21.15.150:3300/0 conn(0x7f9cc0038560 0x7f9cc003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f9ccd548700 1 -- 172.21.15.49:0/2802669575 >> v2:172.21.15.150:3300/0 conn(0x7f9cc0038560 msgr2=0x7f9cc003ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f9ccd548700 1 --2- 172.21.15.49:0/2802669575 >> v2:172.21.15.150:3300/0 conn(0x7f9cc0038560 0x7f9cc003ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f9ccd548700 1 -- 172.21.15.49:0/2802669575 >> v1:172.21.15.150:6789/0 conn(0x7f9cc003b160 legacy=0x7f9cc00e64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f9ccd548700 1 -- 172.21.15.49:0/2802669575 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc003b5a0 con 0x7f9cc00e29f0 2023-07-21T22:11:05.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e8ffff700 1 -- 172.21.15.49:0/1911909022 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84004230 con 0x7f3e900c1470 2023-07-21T22:11:05.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e8ffff700 1 -- 172.21.15.49:0/1911909022 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e84004390 con 0x7f3e900c1470 2023-07-21T22:11:05.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f3e8ffff700 1 -- 172.21.15.49:0/1911909022 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e840036c0 con 0x7f3e900c1470 2023-07-21T22:11:05.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7f45e14f2700 1 -- 172.21.15.49:0/100042178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45dc0d0910 con 0x7f45dc163680 2023-07-21T22:11:05.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.393+0000 7fed1359e700 1 Processor -- start 2023-07-21T22:11:05.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f9ccd548700 1 --2- 172.21.15.49:0/2802669575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc00e29f0 0x7f9cc0055490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8066610 tx=0x7f9cc8067440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64419a408ce7473a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f3e9605a700 1 -- 172.21.15.49:0/1911909022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e900c1470 msgr2=0x7f3e900c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f3e9605a700 1 --2- 172.21.15.49:0/1911909022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e900c1470 0x7f3e900c9d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009850 tx=0x7f3e84009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:05.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f9cbffff700 1 -- 172.21.15.49:0/2802669575 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc80737b0 con 0x7f9cc00e29f0 2023-07-21T22:11:05.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f9cbffff700 1 -- 172.21.15.49:0/2802669575 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc8073910 con 0x7f9cc00e29f0 2023-07-21T22:11:05.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f9cbffff700 1 -- 172.21.15.49:0/2802669575 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc806e130 con 0x7f9cc00e29f0 2023-07-21T22:11:05.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7fed1359e700 1 -- start start 2023-07-21T22:11:05.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f3e9605a700 1 -- 172.21.15.49:0/1911909022 shutdown_connections 2023-07-21T22:11:05.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f3e9605a700 1 --2- 172.21.15.49:0/1911909022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e900c1470 0x7f3e900c9d80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f3e9605a700 1 -- 172.21.15.49:0/1911909022 >> 172.21.15.49:0/1911909022 conn(0x7f3e90070450 msgr2=0x7f3e90070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f3e9605a700 1 -- 172.21.15.49:0/1911909022 shutdown_connections 2023-07-21T22:11:05.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f9cce54a700 1 -- 172.21.15.49:0/2802669575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc00e29f0 msgr2=0x7f9cc0055490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f9cce54a700 1 --2- 172.21.15.49:0/2802669575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc00e29f0 0x7f9cc0055490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8066610 tx=0x7f9cc8067440 comp rx=0 tx=0).stop 2023-07-21T22:11:05.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7fed1359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed0c052280 0x7fed0c036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f9cce54a700 1 -- 172.21.15.49:0/2802669575 shutdown_connections 2023-07-21T22:11:05.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f9cce54a700 1 --2- 172.21.15.49:0/2802669575 >> v2:172.21.15.150:3300/0 conn(0x7f9cc0038560 0x7f9cc003ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f9cce54a700 1 --2- 172.21.15.49:0/2802669575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc00e29f0 0x7f9cc0055490 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f9cce54a700 1 -- 172.21.15.49:0/2802669575 >> 172.21.15.49:0/2802669575 conn(0x7f9cc0055c20 msgr2=0x7f9cc0056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7fed1359e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fed0c03a810 0x7fed0c036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7fed12d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fed0c03a810 0x7fed0c036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7fed12d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fed0c03a810 0x7fed0c036cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48024/0 (socket says 172.21.15.49:48024) 2023-07-21T22:11:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7fed12d9d700 1 -- 172.21.15.49:0/3443221354 learned_addr learned my addr 172.21.15.49:0/3443221354 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7fed1359e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0c0060c0 con 0x7fed0c054770 2023-07-21T22:11:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7fed1359e700 1 -- 172.21.15.49:0/3443221354 --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c0070b0 con 0x7fed0c03a810 2023-07-21T22:11:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7fed1359e700 1 -- 172.21.15.49:0/3443221354 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0ded00 con 0x7fed0c052280 2023-07-21T22:11:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f45d8ff9700 1 -- 172.21.15.49:0/100042178 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f45d4012430 con 0x7f45dc163680 2023-07-21T22:11:05.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f3e9605a700 1 -- 172.21.15.49:0/1911909022 wait complete. 2023-07-21T22:11:05.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f2338f3a700 1 Processor -- start 2023-07-21T22:11:05.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7fed1259c700 1 --2- 172.21.15.49:0/3443221354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed0c052280 0x7fed0c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.397+0000 7f2338f3a700 1 -- start start 2023-07-21T22:11:05.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f45d8ff9700 1 --2- 172.21.15.49:0/100042178 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f45c80663c0 0x7f45c8068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed1159a700 1 -- 172.21.15.49:0/3443221354 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818309119 0 0) 0x7fed0c0060c0 con 0x7fed0c054770 2023-07-21T22:11:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed1159a700 1 -- 172.21.15.49:0/3443221354 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecfc0057e0 con 0x7fed0c054770 2023-07-21T22:11:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed12d9d700 1 -- 172.21.15.49:0/3443221354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed0c052280 msgr2=0x7fed0c036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed12d9d700 1 --2- 172.21.15.49:0/3443221354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed0c052280 0x7fed0c036770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed12d9d700 1 -- 172.21.15.49:0/3443221354 >> v1:172.21.15.49:6789/0 conn(0x7fed0c054770 legacy=0x7fed0c03a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed12d9d700 1 -- 172.21.15.49:0/3443221354 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c0062f0 con 0x7fed0c03a810 2023-07-21T22:11:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f9cce54a700 1 -- 172.21.15.49:0/2802669575 shutdown_connections 2023-07-21T22:11:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f3e9605a700 1 Processor -- start 2023-07-21T22:11:05.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fc661c20700 1 Processor -- start 2023-07-21T22:11:05.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f9cce54a700 1 -- 172.21.15.49:0/2802669575 wait complete. 2023-07-21T22:11:05.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f3e9605a700 1 -- start start 2023-07-21T22:11:05.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f45d8ff9700 1 -- 172.21.15.49:0/100042178 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f45d4022070 con 0x7f45dc163680 2023-07-21T22:11:05.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f45d8ff9700 1 --2- 172.21.15.49:0/100042178 >> [v2:172.21.15.49:6800/5206931,v1:172.21.15.49:6801/5206931] conn(0x7f45c8070090 0x7f45c80724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f45d8ff9700 1 -- 172.21.15.49:0/100042178 --> [v2:172.21.15.49:6800/5206931,v1:172.21.15.49:6801/5206931] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45c8072b90 con 0x7f45c8070090 2023-07-21T22:11:05.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed12d9d700 1 --2- 172.21.15.49:0/3443221354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed0c03a810 0x7fed0c036cb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fed04009910 tx=0x7fed04009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be59ace2e966f30f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f45d8ff9700 1 -- 172.21.15.49:0/100042178 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45d4086480 con 0x7f45dc163680 2023-07-21T22:11:05.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f45dbfff700 1 --2- 172.21.15.49:0/100042178 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f45c80663c0 0x7f45c8068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f45db7fe700 1 --2- 172.21.15.49:0/100042178 >> [v2:172.21.15.49:6800/5206931,v1:172.21.15.49:6801/5206931] conn(0x7f45c8070090 0x7f45c80724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f2338f3a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f232c0dd280 0x7f232c050760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f2338f3a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f232c036e80 0x7f232c0060c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f2338f3a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232c052bf0 con 0x7f232c0dfb70 2023-07-21T22:11:05.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f2338f3a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232c0dd650 con 0x7f232c0dd280 2023-07-21T22:11:05.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f2338f3a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c0528c0 con 0x7f232c036e80 2023-07-21T22:11:05.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f45dbfff700 1 --2- 172.21.15.49:0/100042178 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f45c80663c0 0x7f45c8068870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f45d0007fd0 tx=0x7f45d0007c60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f3e9605a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e900c1470 0x7f3e9015e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f3e9605a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e900ca2c0 0x7f3e900c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fc661c20700 1 -- start start 2023-07-21T22:11:05.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f45db7fe700 1 --2- 172.21.15.49:0/100042178 >> [v2:172.21.15.49:6800/5206931,v1:172.21.15.49:6801/5206931] conn(0x7f45c8070090 0x7f45c80724c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f3e9605a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e90160370 0x7f3e900c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f3e9605a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900b11d0 con 0x7f3e900ca2c0 2023-07-21T22:11:05.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f3e9605a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900b14b0 con 0x7f3e900c1470 2023-07-21T22:11:05.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f3e9605a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900b1790 con 0x7f3e90160370 2023-07-21T22:11:05.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed1159a700 1 -- 172.21.15.49:0/3443221354 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04011830 con 0x7fed0c03a810 2023-07-21T22:11:05.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed1159a700 1 -- 172.21.15.49:0/3443221354 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed04011990 con 0x7fed0c03a810 2023-07-21T22:11:05.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed1159a700 1 -- 172.21.15.49:0/3443221354 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04011d40 con 0x7fed0c03a810 2023-07-21T22:11:05.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed1359e700 1 -- 172.21.15.49:0/3443221354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed0c03a810 msgr2=0x7fed0c036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed1359e700 1 --2- 172.21.15.49:0/3443221354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed0c03a810 0x7fed0c036cb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fed04009910 tx=0x7fed04009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:05.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed1359e700 1 -- 172.21.15.49:0/3443221354 shutdown_connections 2023-07-21T22:11:05.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed1359e700 1 --2- 172.21.15.49:0/3443221354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed0c03a810 0x7fed0c036cb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed1359e700 1 --2- 172.21.15.49:0/3443221354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed0c052280 0x7fed0c036770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7fed1359e700 1 -- 172.21.15.49:0/3443221354 >> 172.21.15.49:0/3443221354 conn(0x7fed0c051770 msgr2=0x7fed0c051b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f9cce54a700 1 Processor -- start 2023-07-21T22:11:05.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f233259c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f232c0dd280 0x7f232c050760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f233259c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f232c0dd280 0x7f232c050760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:39696/0 (socket says 172.21.15.49:39696) 2023-07-21T22:11:05.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f233259c700 1 -- 172.21.15.49:0/2577709034 learned_addr learned my addr 172.21.15.49:0/2577709034 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f233259c700 1 -- 172.21.15.49:0/2577709034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f232c036e80 msgr2=0x7f232c0060c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:11:05.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f233259c700 1 --2- 172.21.15.49:0/2577709034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f232c036e80 0x7f232c0060c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f233259c700 1 -- 172.21.15.49:0/2577709034 >> v1:172.21.15.49:6789/0 conn(0x7f232c0dfb70 legacy=0x7f232c036770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:11:05.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.401+0000 7f233259c700 1 -- 172.21.15.49:0/2577709034 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c0e0430 con 0x7f232c0dd280 2023-07-21T22:11:05.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f3e94857700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e900ca2c0 0x7f3e900c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f3e94857700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e900ca2c0 0x7f3e900c77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48032/0 (socket says 172.21.15.49:48032) 2023-07-21T22:11:05.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f3e94857700 1 -- 172.21.15.49:0/1617123230 learned_addr learned my addr 172.21.15.49:0/1617123230 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f233259c700 1 --2- 172.21.15.49:0/2577709034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232c0dd280 0x7f232c050760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2324009910 tx=0x7f2324009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb03dd2b094dbc73 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cce54a700 1 -- start start 2023-07-21T22:11:05.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fed1359e700 1 -- 172.21.15.49:0/3443221354 shutdown_connections 2023-07-21T22:11:05.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f45d8ff9700 1 -- 172.21.15.49:0/100042178 <== osd.0 v2:172.21.15.49:6800/5206931 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f45c8072b90 con 0x7f45c8070090 2023-07-21T22:11:05.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f3e94857700 1 -- 172.21.15.49:0/1617123230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e90160370 msgr2=0x7f3e900c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f3e94857700 1 --2- 172.21.15.49:0/1617123230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e90160370 0x7f3e900c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f3e94857700 1 -- 172.21.15.49:0/1617123230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e900c1470 msgr2=0x7f3e9015e030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:11:05.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f3e94857700 1 --2- 172.21.15.49:0/1617123230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e900c1470 0x7f3e9015e030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f3e94857700 1 -- 172.21.15.49:0/1617123230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e840094b0 con 0x7f3e900ca2c0 2023-07-21T22:11:05.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fc661c20700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc65c15bf70 0x7fc65c0b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fc661c20700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc65c0cd530 0x7fc65c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fc661c20700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65c0cb5b0 con 0x7fc65c0afc80 2023-07-21T22:11:05.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fc661c20700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65c0ca000 con 0x7fc65c0cd530 2023-07-21T22:11:05.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fc661c20700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65c0b0590 con 0x7fc65c15bf70 2023-07-21T22:11:05.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fc65bfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc65c15bf70 0x7fc65c0b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fc65bfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc65c15bf70 0x7fc65c0b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:39718/0 (socket says 172.21.15.49:39718) 2023-07-21T22:11:05.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fc65bfff700 1 -- 172.21.15.49:0/407632230 learned_addr learned my addr 172.21.15.49:0/407632230 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fc66141f700 1 --2- 172.21.15.49:0/407632230 >> v2:172.21.15.49:3300/0 conn(0x7fc65c0cd530 0x7fc65c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fed1359e700 1 -- 172.21.15.49:0/3443221354 wait complete. 2023-07-21T22:11:05.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f3e94857700 1 --2- 172.21.15.49:0/1617123230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e900ca2c0 0x7f3e900c77b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e84000c00 tx=0x7f3e84004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f233159a700 1 -- 172.21.15.49:0/2577709034 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324004230 con 0x7f232c0dd280 2023-07-21T22:11:05.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f233159a700 1 -- 172.21.15.49:0/2577709034 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2324004390 con 0x7f232c0dd280 2023-07-21T22:11:05.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f0159be6700 1 Processor -- start 2023-07-21T22:11:05.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f233159a700 1 -- 172.21.15.49:0/2577709034 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324009e60 con 0x7f232c0dd280 2023-07-21T22:11:05.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f3e8dffb700 1 -- 172.21.15.49:0/1617123230 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84006ea0 con 0x7f3e900ca2c0 2023-07-21T22:11:05.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f3e8dffb700 1 -- 172.21.15.49:0/1617123230 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8401f070 con 0x7f3e900ca2c0 2023-07-21T22:11:05.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f3e9605a700 1 -- 172.21.15.49:0/1617123230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e900b1a70 con 0x7f3e900ca2c0 2023-07-21T22:11:05.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f3e8dffb700 1 -- 172.21.15.49:0/1617123230 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84011a50 con 0x7f3e900ca2c0 2023-07-21T22:11:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cce54a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cc0038560 0x7f9cc0050fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cce54a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cc003b160 0x7f9cc004ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cce54a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc00e29f0 0x7f9cc004f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cce54a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc00514f0 con 0x7f9cc00e29f0 2023-07-21T22:11:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cce54a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc01789e0 con 0x7f9cc003b160 2023-07-21T22:11:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cce54a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc0178cc0 con 0x7f9cc0038560 2023-07-21T22:11:05.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fc66141f700 1 -- 172.21.15.49:0/407632230 >> v2:172.21.15.150:3300/0 conn(0x7fc65c15bf70 msgr2=0x7fc65c0b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fc66141f700 1 --2- 172.21.15.49:0/407632230 >> v2:172.21.15.150:3300/0 conn(0x7fc65c15bf70 0x7fc65c0b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fc66141f700 1 -- 172.21.15.49:0/407632230 >> v1:172.21.15.150:6789/0 conn(0x7fc65c0afc80 legacy=0x7fc65c15cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7fc66141f700 1 -- 172.21.15.49:0/407632230 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c0ca9a0 con 0x7fc65c0cd530 2023-07-21T22:11:05.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cccd47700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cc003b160 0x7f9cc004ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cccd47700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cc003b160 0x7f9cc004ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:39734/0 (socket says 172.21.15.49:39734) 2023-07-21T22:11:05.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cccd47700 1 -- 172.21.15.49:0/3533936320 learned_addr learned my addr 172.21.15.49:0/3533936320 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cccd47700 1 -- 172.21.15.49:0/3533936320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cc0038560 msgr2=0x7f9cc0050fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T22:11:05.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cccd47700 1 --2- 172.21.15.49:0/3533936320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cc0038560 0x7f9cc0050fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cccd47700 1 -- 172.21.15.49:0/3533936320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc00e29f0 msgr2=0x7f9cc004f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cccd47700 1 --2- 172.21.15.49:0/3533936320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc00e29f0 0x7f9cc004f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f9cccd47700 1 -- 172.21.15.49:0/3533936320 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc0178fa0 con 0x7f9cc003b160 2023-07-21T22:11:05.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f3e9605a700 1 -- 172.21.15.49:0/1617123230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e900c3750 con 0x7f3e900ca2c0 2023-07-21T22:11:05.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed1359e700 1 Processor -- start 2023-07-21T22:11:05.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fc66141f700 1 --2- 172.21.15.49:0/407632230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65c0cd530 0x7fc65c0cd930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc65c070320 tx=0x7fc650009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c37e7e5e4014ba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed1359e700 1 -- start start 2023-07-21T22:11:05.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f3e777fe700 1 -- 172.21.15.49:0/1617123230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e68000fc0 con 0x7f3e900ca2c0 2023-07-21T22:11:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.405+0000 7f0159be6700 1 -- start start 2023-07-21T22:11:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f0159be6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f014c054800 0x7f014c036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f0159be6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f014c052280 0x7f014c053150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f2338f3a700 1 -- 172.21.15.49:0/2577709034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232c0dd280 msgr2=0x7f232c050760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f2338f3a700 1 --2- 172.21.15.49:0/2577709034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232c0dd280 0x7f232c050760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2324009910 tx=0x7f2324009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:05.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f01537fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f014c054800 0x7f014c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f01537fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f014c054800 0x7f014c036770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:37174/0 (socket says 172.21.15.49:37174) 2023-07-21T22:11:05.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f01537fe700 1 -- 172.21.15.49:0/1810615626 learned_addr learned my addr 172.21.15.49:0/1810615626 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed1359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed0c03a810 0x7fed0c047a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed1359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed0c052280 0x7fed0c17d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed1359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed0c054770 0x7fed0c04e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed1359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c17c370 con 0x7fed0c052280 2023-07-21T22:11:05.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed1359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0dae30 con 0x7fed0c03a810 2023-07-21T22:11:05.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed1359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0db110 con 0x7fed0c054770 2023-07-21T22:11:05.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f2338f3a700 1 -- 172.21.15.49:0/2577709034 shutdown_connections 2023-07-21T22:11:05.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f2338f3a700 1 --2- 172.21.15.49:0/2577709034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f232c036e80 0x7f232c0060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f2338f3a700 1 --2- 172.21.15.49:0/2577709034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232c0dd280 0x7f232c050760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f2338f3a700 1 -- 172.21.15.49:0/2577709034 >> 172.21.15.49:0/2577709034 conn(0x7f232c051770 msgr2=0x7f232c051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f0159be6700 1 -- 172.21.15.49:0/1810615626 --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c0060c0 con 0x7f014c036cb0 2023-07-21T22:11:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f0159be6700 1 -- 172.21.15.49:0/1810615626 --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014c0070b0 con 0x7f014c052280 2023-07-21T22:11:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f0159be6700 1 -- 172.21.15.49:0/1810615626 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c037120 con 0x7f014c054800 2023-07-21T22:11:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f0153fff700 1 --2- 172.21.15.49:0/1810615626 >> v2:172.21.15.49:3300/0 conn(0x7f014c052280 0x7f014c053150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f9cccd47700 1 --2- 172.21.15.49:0/3533936320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cc003b160 0x7f9cc004ece0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4007f10 tx=0x7f9cc400da30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed11d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed0c052280 0x7fed0c17d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed12d9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed0c054770 0x7fed0c04e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed11d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed0c052280 0x7fed0c17d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48074/0 (socket says 172.21.15.49:48074) 2023-07-21T22:11:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed11d9b700 1 -- 172.21.15.49:0/2719423013 learned_addr learned my addr 172.21.15.49:0/2719423013 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed1259c700 1 --2- 172.21.15.49:0/2719423013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed0c03a810 0x7fed0c047a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fc65b7fe700 1 -- 172.21.15.49:0/407632230 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650011830 con 0x7fc65c0cd530 2023-07-21T22:11:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fc65b7fe700 1 -- 172.21.15.49:0/407632230 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc650011990 con 0x7fc65c0cd530 2023-07-21T22:11:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fc65b7fe700 1 -- 172.21.15.49:0/407632230 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650011d40 con 0x7fc65c0cd530 2023-07-21T22:11:05.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f2338f3a700 1 -- 172.21.15.49:0/2577709034 shutdown_connections 2023-07-21T22:11:05.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f9cbdffb700 1 -- 172.21.15.49:0/3533936320 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4025640 con 0x7f9cc003b160 2023-07-21T22:11:05.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f9cce54a700 1 -- 172.21.15.49:0/3533936320 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc0179280 con 0x7f9cc003b160 2023-07-21T22:11:05.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f3e8dffb700 1 -- 172.21.15.49:0/1617123230 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3e84021030 con 0x7f3e900ca2c0 2023-07-21T22:11:05.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f9cbdffb700 1 -- 172.21.15.49:0/3533936320 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc40257a0 con 0x7f9cc003b160 2023-07-21T22:11:05.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f9cbdffb700 1 -- 172.21.15.49:0/3533936320 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4025b30 con 0x7f9cc003b160 2023-07-21T22:11:05.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f9cce54a700 1 -- 172.21.15.49:0/3533936320 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc0177b00 con 0x7f9cc003b160 2023-07-21T22:11:05.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f0153fff700 1 -- 172.21.15.49:0/1810615626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f014c054800 msgr2=0x7f014c036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f0153fff700 1 --2- 172.21.15.49:0/1810615626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f014c054800 0x7f014c036770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f0153fff700 1 -- 172.21.15.49:0/1810615626 >> v1:172.21.15.49:6789/0 conn(0x7f014c036cb0 legacy=0x7f014c03a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f0153fff700 1 -- 172.21.15.49:0/1810615626 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0ded00 con 0x7f014c052280 2023-07-21T22:11:05.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f0153fff700 1 --2- 172.21.15.49:0/1810615626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f014c052280 0x7f014c053150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f01540664d0 tx=0x7f0154067440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd475f46bc6987a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f01527fc700 1 -- 172.21.15.49:0/1810615626 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01540737b0 con 0x7f014c052280 2023-07-21T22:11:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed1259c700 1 -- 172.21.15.49:0/2719423013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed0c054770 msgr2=0x7fed0c04e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed1259c700 1 --2- 172.21.15.49:0/2719423013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed0c054770 0x7fed0c04e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed1259c700 1 -- 172.21.15.49:0/2719423013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed0c052280 msgr2=0x7fed0c17d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed1259c700 1 --2- 172.21.15.49:0/2719423013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed0c052280 0x7fed0c17d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7fed1259c700 1 -- 172.21.15.49:0/2719423013 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed04009570 con 0x7fed0c03a810 2023-07-21T22:11:05.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f01527fc700 1 -- 172.21.15.49:0/1810615626 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0154073930 con 0x7f014c052280 2023-07-21T22:11:05.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f01527fc700 1 -- 172.21.15.49:0/1810615626 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015406e130 con 0x7f014c052280 2023-07-21T22:11:05.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7fed1259c700 1 --2- 172.21.15.49:0/2719423013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed0c03a810 0x7fed0c047a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fed0800e900 tx=0x7fed0800ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7fc661c20700 1 -- 172.21.15.49:0/407632230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65c0cd530 msgr2=0x7fc65c0cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7fc661c20700 1 --2- 172.21.15.49:0/407632230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65c0cd530 0x7fc65c0cd930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc65c070320 tx=0x7fc650009b30 comp rx=0 tx=0).stop 2023-07-21T22:11:05.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.409+0000 7f2338f3a700 1 -- 172.21.15.49:0/2577709034 wait complete. 2023-07-21T22:11:05.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7fed02ffd700 1 -- 172.21.15.49:0/2719423013 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08013680 con 0x7fed0c03a810 2023-07-21T22:11:05.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7fed02ffd700 1 -- 172.21.15.49:0/2719423013 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed080137e0 con 0x7fed0c03a810 2023-07-21T22:11:05.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f9cce54a700 1 -- 172.21.15.49:0/3533936320 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9cc0007080 con 0x7f9cc003b160 2023-07-21T22:11:05.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f3e8dffb700 1 --2- 172.21.15.49:0/1617123230 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3e7c066340 0x7f3e7c0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7fc661c20700 1 -- 172.21.15.49:0/407632230 shutdown_connections 2023-07-21T22:11:05.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7fc661c20700 1 --2- 172.21.15.49:0/407632230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65c0cd530 0x7fc65c0cd930 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7fc661c20700 1 --2- 172.21.15.49:0/407632230 >> v2:172.21.15.150:3300/0 conn(0x7fc65c15bf70 0x7fc65c0b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7fc661c20700 1 -- 172.21.15.49:0/407632230 >> 172.21.15.49:0/407632230 conn(0x7fc65c06e960 msgr2=0x7fc65c06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f0159be6700 1 -- 172.21.15.49:0/1810615626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f014c052280 msgr2=0x7f014c053150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f0159be6700 1 --2- 172.21.15.49:0/1810615626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f014c052280 0x7f014c053150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f01540664d0 tx=0x7f0154067440 comp rx=0 tx=0).stop 2023-07-21T22:11:05.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7fc661c20700 1 -- 172.21.15.49:0/407632230 shutdown_connections 2023-07-21T22:11:05.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7fed02ffd700 1 -- 172.21.15.49:0/2719423013 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08013b50 con 0x7fed0c03a810 2023-07-21T22:11:05.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f0159be6700 1 -- 172.21.15.49:0/1810615626 shutdown_connections 2023-07-21T22:11:05.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f0159be6700 1 --2- 172.21.15.49:0/1810615626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f014c052280 0x7f014c053150 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f0159be6700 1 --2- 172.21.15.49:0/1810615626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f014c054800 0x7f014c036770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f0159be6700 1 -- 172.21.15.49:0/1810615626 >> 172.21.15.49:0/1810615626 conn(0x7f014c051770 msgr2=0x7f014c051b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f3e8dffb700 1 -- 172.21.15.49:0/1617123230 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3e84085a20 con 0x7f3e900ca2c0 2023-07-21T22:11:05.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f3e8dffb700 1 --2- 172.21.15.49:0/1617123230 >> [v2:172.21.15.49:6808/2983717007,v1:172.21.15.49:6809/2983717007] conn(0x7f3e7c070010 0x7f3e7c072440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f3e8dffb700 1 -- 172.21.15.49:0/1617123230 --> [v2:172.21.15.49:6808/2983717007,v1:172.21.15.49:6809/2983717007] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e7c072b10 con 0x7f3e7c070010 2023-07-21T22:11:05.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f3e8dffb700 1 -- 172.21.15.49:0/1617123230 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e84085ec0 con 0x7f3e900ca2c0 2023-07-21T22:11:05.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f3e95859700 1 --2- 172.21.15.49:0/1617123230 >> [v2:172.21.15.49:6808/2983717007,v1:172.21.15.49:6809/2983717007] conn(0x7f3e7c070010 0x7f3e7c072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f3e95058700 1 --2- 172.21.15.49:0/1617123230 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3e7c066340 0x7f3e7c0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f0159be6700 1 -- 172.21.15.49:0/1810615626 shutdown_connections 2023-07-21T22:11:05.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f3e95058700 1 --2- 172.21.15.49:0/1617123230 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3e7c066340 0x7f3e7c0687f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e88001f80 tx=0x7f3e880015b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7fed1359e700 1 -- 172.21.15.49:0/2719423013 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0c0db3f0 con 0x7fed0c03a810 2023-07-21T22:11:05.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f3e95859700 1 --2- 172.21.15.49:0/1617123230 >> [v2:172.21.15.49:6808/2983717007,v1:172.21.15.49:6809/2983717007] conn(0x7f3e7c070010 0x7f3e7c072440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7fed1359e700 1 -- 172.21.15.49:0/2719423013 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0c0db9b0 con 0x7fed0c03a810 2023-07-21T22:11:05.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7f0159be6700 1 -- 172.21.15.49:0/1810615626 wait complete. 2023-07-21T22:11:05.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.413+0000 7fc661c20700 1 -- 172.21.15.49:0/407632230 wait complete. 2023-07-21T22:11:05.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7fc661c20700 1 Processor -- start 2023-07-21T22:11:05.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7fc661c20700 1 -- start start 2023-07-21T22:11:05.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f2338f3a700 1 Processor -- start 2023-07-21T22:11:05.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f3e8dffb700 1 -- 172.21.15.49:0/1617123230 <== osd.1 v2:172.21.15.49:6808/2983717007 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3e7c072b10 con 0x7f3e7c070010 2023-07-21T22:11:05.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f9cbdffb700 1 -- 172.21.15.49:0/3533936320 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9cc4025c90 con 0x7f9cc003b160 2023-07-21T22:11:05.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f9cbdffb700 1 --2- 172.21.15.49:0/3533936320 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9cac0662f0 0x7f9cac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f9cbdffb700 1 -- 172.21.15.49:0/3533936320 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9cc4095f10 con 0x7f9cc003b160 2023-07-21T22:11:05.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f9cbdffb700 1 --2- 172.21.15.49:0/3533936320 >> [v2:172.21.15.49:6824/3193969798,v1:172.21.15.49:6825/3193969798] conn(0x7f9cac06ffc0 0x7f9cac0723f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f9cbdffb700 1 -- 172.21.15.49:0/3533936320 --> [v2:172.21.15.49:6824/3193969798,v1:172.21.15.49:6825/3193969798] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9cac072ac0 con 0x7f9cac06ffc0 2023-07-21T22:11:05.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f9cbdffb700 1 -- 172.21.15.49:0/3533936320 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cc40962c0 con 0x7f9cc003b160 2023-07-21T22:11:05.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f9ccd548700 1 --2- 172.21.15.49:0/3533936320 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9cac0662f0 0x7f9cac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7fed1359e700 1 -- 172.21.15.49:0/2719423013 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fed0c0068b0 con 0x7fed0c03a810 2023-07-21T22:11:05.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f0159be6700 1 Processor -- start 2023-07-21T22:11:05.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f9ccdd49700 1 --2- 172.21.15.49:0/3533936320 >> [v2:172.21.15.49:6824/3193969798,v1:172.21.15.49:6825/3193969798] conn(0x7f9cac06ffc0 0x7f9cac0723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f9ccd548700 1 --2- 172.21.15.49:0/3533936320 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9cac0662f0 0x7f9cac0687a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0011180 tx=0x7f9cc808a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f22162b5700 1 Processor -- start 2023-07-21T22:11:05.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f9ccdd49700 1 --2- 172.21.15.49:0/3533936320 >> [v2:172.21.15.49:6824/3193969798,v1:172.21.15.49:6825/3193969798] conn(0x7f9cac06ffc0 0x7f9cac0723f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f0159be6700 1 -- start start 2023-07-21T22:11:05.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f0159be6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f014c036cb0 0x7f014c04c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f0159be6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f014c052280 0x7f014c0d3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f0159be6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f014c054800 0x7f014c0d4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f0159be6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0cf5a0 con 0x7f014c052280 2023-07-21T22:11:05.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f0159be6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0cf880 con 0x7f014c036cb0 2023-07-21T22:11:05.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f0159be6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0cfb60 con 0x7f014c054800 2023-07-21T22:11:05.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.417+0000 7f22162b5700 1 -- start start 2023-07-21T22:11:05.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f22162b5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22080541f0 0x7f2208049e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f22162b5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f22080ea670 0x7f220804a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f01537fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f014c036cb0 0x7f014c04c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f01537fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f014c036cb0 0x7f014c04c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:39756/0 (socket says 172.21.15.49:39756) 2023-07-21T22:11:05.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f01537fe700 1 -- 172.21.15.49:0/1978819960 learned_addr learned my addr 172.21.15.49:0/1978819960 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f0153fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f014c054800 0x7f014c0d4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f22162b5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2208055150 con 0x7f22080ea2a0 2023-07-21T22:11:05.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f22162b5700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22080eabd0 con 0x7f22080ea670 2023-07-21T22:11:05.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f22162b5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2208008f50 con 0x7f22080541f0 2023-07-21T22:11:05.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f0152ffd700 1 --2- 172.21.15.49:0/1978819960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f014c052280 0x7f014c0d3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f220ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f22080ea2a0 0x7f2208054a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:58834/0 (socket says 172.21.15.49:58834) 2023-07-21T22:11:05.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f2214852700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f22080ea670 0x7f220804a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f220ffff700 1 -- 172.21.15.49:0/2425836140 learned_addr learned my addr 172.21.15.49:0/2425836140 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:05.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f0153fff700 1 -- 172.21.15.49:0/1978819960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f014c036cb0 msgr2=0x7f014c04c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f0153fff700 1 --2- 172.21.15.49:0/1978819960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f014c036cb0 0x7f014c04c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f0153fff700 1 -- 172.21.15.49:0/1978819960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f014c052280 msgr2=0x7f014c0d3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f9cbdffb700 1 -- 172.21.15.49:0/3533936320 <== osd.2 v2:172.21.15.49:6824/3193969798 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9cac072ac0 con 0x7f9cac06ffc0 2023-07-21T22:11:05.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f2214852700 1 -- 172.21.15.49:0/2425836140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22080541f0 msgr2=0x7f2208049e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f2214852700 1 --2- 172.21.15.49:0/2425836140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22080541f0 0x7f2208049e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f2214852700 1 -- 172.21.15.49:0/2425836140 >> v1:172.21.15.150:6789/0 conn(0x7f22080ea2a0 legacy=0x7f2208054a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f2214852700 1 -- 172.21.15.49:0/2425836140 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22080eae40 con 0x7f22080ea670 2023-07-21T22:11:05.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f2214852700 1 --2- 172.21.15.49:0/2425836140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22080ea670 0x7f220804a370 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f22100664d0 tx=0x7f2210067440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b980acc4779d49c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f220effd700 1 -- 172.21.15.49:0/2425836140 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22100737b0 con 0x7f22080ea670 2023-07-21T22:11:05.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f220effd700 1 -- 172.21.15.49:0/2425836140 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2210073910 con 0x7f22080ea670 2023-07-21T22:11:05.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f220effd700 1 -- 172.21.15.49:0/2425836140 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221006e130 con 0x7f22080ea670 2023-07-21T22:11:05.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7fc661c20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65c0afc80 0x7fc65c148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f22162b5700 1 -- 172.21.15.49:0/2425836140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22080ea670 msgr2=0x7f220804a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f22162b5700 1 --2- 172.21.15.49:0/2425836140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22080ea670 0x7f220804a370 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f22100664d0 tx=0x7f2210067440 comp rx=0 tx=0).stop 2023-07-21T22:11:05.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f0153fff700 1 --2- 172.21.15.49:0/1978819960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f014c052280 0x7f014c0d3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f0153fff700 1 -- 172.21.15.49:0/1978819960 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0cfe40 con 0x7f014c054800 2023-07-21T22:11:05.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f0152ffd700 1 --2- 172.21.15.49:0/1978819960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f014c052280 0x7f014c0d3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:05.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f22162b5700 1 -- 172.21.15.49:0/2425836140 shutdown_connections 2023-07-21T22:11:05.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f22162b5700 1 --2- 172.21.15.49:0/2425836140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22080541f0 0x7f2208049e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f22162b5700 1 --2- 172.21.15.49:0/2425836140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22080ea670 0x7f220804a370 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f22162b5700 1 -- 172.21.15.49:0/2425836140 >> 172.21.15.49:0/2425836140 conn(0x7f2208057b90 msgr2=0x7f2208053980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7fc660c1e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65c0afc80 0x7fc65c148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7fc660c1e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65c0afc80 0x7fc65c148a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48100/0 (socket says 172.21.15.49:48100) 2023-07-21T22:11:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f2338f3a700 1 -- start start 2023-07-21T22:11:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f2338f3a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232c036e80 0x7f232c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f2338f3a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f232c0dd280 0x7f232c0cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f2338f3a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f232c0dfb70 0x7f232c0496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f2338f3a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c049f80 con 0x7f232c0dfb70 2023-07-21T22:11:05.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f2338f3a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c04d480 con 0x7f232c036e80 2023-07-21T22:11:05.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7f2338f3a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c04d760 con 0x7f232c0dd280 2023-07-21T22:11:05.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f0153fff700 1 --2- 172.21.15.49:0/1978819960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f014c054800 0x7f014c0d4300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0154000b60 tx=0x7f0154072230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f22162b5700 1 -- 172.21.15.49:0/2425836140 shutdown_connections 2023-07-21T22:11:05.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7fed02ffd700 1 -- 172.21.15.49:0/2719423013 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed08013cb0 con 0x7fed0c03a810 2023-07-21T22:11:05.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fed02ffd700 1 --2- 172.21.15.49:0/2719423013 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fecf4066320 0x7fecf40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f22162b5700 1 -- 172.21.15.49:0/2425836140 wait complete. 2023-07-21T22:11:05.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fed02ffd700 1 -- 172.21.15.49:0/2719423013 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fed08084260 con 0x7fed0c03a810 2023-07-21T22:11:05.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f013ffff700 1 -- 172.21.15.49:0/1978819960 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01540698a0 con 0x7f014c054800 2023-07-21T22:11:05.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f013ffff700 1 -- 172.21.15.49:0/1978819960 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0154069a00 con 0x7f014c054800 2023-07-21T22:11:05.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f013ffff700 1 -- 172.21.15.49:0/1978819960 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0154069db0 con 0x7f014c054800 2023-07-21T22:11:05.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f0159be6700 1 -- 172.21.15.49:0/1978819960 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c0d0360 con 0x7f014c054800 2023-07-21T22:11:05.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fed02ffd700 1 --2- 172.21.15.49:0/2719423013 >> [v2:172.21.15.150:6800/3591224217,v1:172.21.15.150:6801/3591224217] conn(0x7fecf406fe00 0x7fecf4072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fed02ffd700 1 -- 172.21.15.49:0/2719423013 --> [v2:172.21.15.150:6800/3591224217,v1:172.21.15.150:6801/3591224217] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fecf4072900 con 0x7fecf406fe00 2023-07-21T22:11:05.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fed12d9d700 1 --2- 172.21.15.49:0/2719423013 >> [v2:172.21.15.150:6800/3591224217,v1:172.21.15.150:6801/3591224217] conn(0x7fecf406fe00 0x7fecf4072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f0159be6700 1 -- 172.21.15.49:0/1978819960 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c04eb90 con 0x7f014c054800 2023-07-21T22:11:05.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fed11d9b700 1 --2- 172.21.15.49:0/2719423013 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fecf4066320 0x7fecf40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f22162b5700 1 Processor -- start 2023-07-21T22:11:05.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fed12d9d700 1 --2- 172.21.15.49:0/2719423013 >> [v2:172.21.15.150:6800/3591224217,v1:172.21.15.150:6801/3591224217] conn(0x7fecf406fe00 0x7fecf4072230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f233259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232c036e80 0x7f232c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f233259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232c036e80 0x7f232c0cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:39766/0 (socket says 172.21.15.49:39766) 2023-07-21T22:11:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f233259c700 1 -- 172.21.15.49:0/4066908612 learned_addr learned my addr 172.21.15.49:0/4066908612 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f2331d9b700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f232c0dd280 0x7f232c0cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f2332d9d700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f232c0dfb70 0x7f232c0496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f233259c700 1 -- 172.21.15.49:0/4066908612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f232c0dd280 msgr2=0x7f232c0cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f233259c700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f232c0dd280 0x7f232c0cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f233259c700 1 -- 172.21.15.49:0/4066908612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f232c0dfb70 msgr2=0x7f232c0496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fed11d9b700 1 --2- 172.21.15.49:0/2719423013 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fecf4066320 0x7fecf40687d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fed14078d30 tx=0x7fed1406c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.421+0000 7fc660c1e700 1 -- 172.21.15.49:0/2045688540 learned_addr learned my addr 172.21.15.49:0/2045688540 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fc661c20700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc65c0cd530 0x7fc65c1491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fc65bfff700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc65c0cd530 0x7fc65c1491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fc661c20700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc65c15bf70 0x7fc65c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f22162b5700 1 -- start start 2023-07-21T22:11:05.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fc661c20700 1 -- 172.21.15.49:0/2045688540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0c3d40 con 0x7fc65c0afc80 2023-07-21T22:11:05.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fc661c20700 1 -- 172.21.15.49:0/2045688540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c148f40 con 0x7fc65c15bf70 2023-07-21T22:11:05.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fc661c20700 1 -- 172.21.15.49:0/2045688540 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0c2e90 con 0x7fc65c0cd530 2023-07-21T22:11:05.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7fed02ffd700 1 -- 172.21.15.49:0/2719423013 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed08051350 con 0x7fed0c03a810 2023-07-21T22:11:05.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f233259c700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f232c0dfb70 0x7f232c0496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f233259c700 1 -- 172.21.15.49:0/4066908612 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2324009570 con 0x7f232c036e80 2023-07-21T22:11:05.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f2332d9d700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f232c0dfb70 0x7f232c0496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:05.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.425+0000 7f233259c700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232c036e80 0x7f232c0cf320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2324009c60 tx=0x7f2324004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f0159be6700 1 -- 172.21.15.49:0/1978819960 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0134000fc0 con 0x7f014c054800 2023-07-21T22:11:05.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7fc660c1e700 1 -- 172.21.15.49:0/2045688540 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc65c0cd530 msgr2=0x7fc65c1491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7fc660c1e700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc65c0cd530 0x7fc65c1491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7fc660c1e700 1 -- 172.21.15.49:0/2045688540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc65c15bf70 msgr2=0x7fc65c0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7fc660c1e700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc65c15bf70 0x7fc65c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7fc660c1e700 1 -- 172.21.15.49:0/2045688540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6500094b0 con 0x7fc65c0afc80 2023-07-21T22:11:05.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f2322ffd700 1 -- 172.21.15.49:0/4066908612 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23240038c0 con 0x7f232c036e80 2023-07-21T22:11:05.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f22162b5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22080541f0 0x7f220817bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f22162b5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22080ea670 0x7f220804c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f22162b5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f220804ca70 0x7f2208048d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7fc660c1e700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65c0afc80 0x7fc65c148a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc65400cc80 tx=0x7fc65400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f2322ffd700 1 -- 172.21.15.49:0/4066908612 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2324003a20 con 0x7f232c036e80 2023-07-21T22:11:05.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f2322ffd700 1 -- 172.21.15.49:0/4066908612 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324003dd0 con 0x7f232c036e80 2023-07-21T22:11:05.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f2338f3a700 1 -- 172.21.15.49:0/4066908612 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c04da40 con 0x7f232c036e80 2023-07-21T22:11:05.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f2338f3a700 1 -- 172.21.15.49:0/4066908612 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c049c30 con 0x7f232c036e80 2023-07-21T22:11:05.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f22162b5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22080dafa0 con 0x7f220804ca70 2023-07-21T22:11:05.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f22162b5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220804cf80 con 0x7f22080541f0 2023-07-21T22:11:05.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f22162b5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220804d260 con 0x7f22080ea670 2023-07-21T22:11:05.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f220f7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22080ea670 0x7f220804c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f2214852700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f220804ca70 0x7f2208048d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f2214852700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f220804ca70 0x7f2208048d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48128/0 (socket says 172.21.15.49:48128) 2023-07-21T22:11:05.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f2214852700 1 -- 172.21.15.49:0/1338792421 learned_addr learned my addr 172.21.15.49:0/1338792421 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f220ffff700 1 --2- 172.21.15.49:0/1338792421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22080541f0 0x7f220817bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7fed02ffd700 1 -- 172.21.15.49:0/2719423013 <== osd.4 v2:172.21.15.150:6800/3591224217 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fecf4072900 con 0x7fecf406fe00 2023-07-21T22:11:05.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7fc6597fa700 1 -- 172.21.15.49:0/2045688540 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654003c70 con 0x7fc65c0afc80 2023-07-21T22:11:05.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7fc6597fa700 1 -- 172.21.15.49:0/2045688540 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc654003dd0 con 0x7fc65c0afc80 2023-07-21T22:11:05.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7fc6597fa700 1 -- 172.21.15.49:0/2045688540 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65400ab70 con 0x7fc65c0afc80 2023-07-21T22:11:05.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f013ffff700 1 -- 172.21.15.49:0/1978819960 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0154072d10 con 0x7f014c054800 2023-07-21T22:11:05.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f2338f3a700 1 -- 172.21.15.49:0/4066908612 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f232c0e09f0 con 0x7f232c036e80 2023-07-21T22:11:05.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7fc661c20700 1 -- 172.21.15.49:0/2045688540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65c15e3c0 con 0x7fc65c0afc80 2023-07-21T22:11:05.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7fc661c20700 1 -- 172.21.15.49:0/2045688540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c0c33a0 con 0x7fc65c0afc80 2023-07-21T22:11:05.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f220ffff700 1 -- 172.21.15.49:0/1338792421 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22080ea670 msgr2=0x7f220804c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f220ffff700 1 --2- 172.21.15.49:0/1338792421 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22080ea670 0x7f220804c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f220ffff700 1 -- 172.21.15.49:0/1338792421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f220804ca70 msgr2=0x7f2208048d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f220ffff700 1 --2- 172.21.15.49:0/1338792421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f220804ca70 0x7f2208048d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f220ffff700 1 -- 172.21.15.49:0/1338792421 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22080db260 con 0x7f22080541f0 2023-07-21T22:11:05.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f220ffff700 1 --2- 172.21.15.49:0/1338792421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22080541f0 0x7f220817bf90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f220800bdf0 tx=0x7f220400c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7f220cff9700 1 -- 172.21.15.49:0/1338792421 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204005d90 con 0x7f22080541f0 2023-07-21T22:11:05.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7f220cff9700 1 -- 172.21.15.49:0/1338792421 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220400ce20 con 0x7f22080541f0 2023-07-21T22:11:05.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7f220cff9700 1 -- 172.21.15.49:0/1338792421 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204007310 con 0x7f22080541f0 2023-07-21T22:11:05.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f013ffff700 1 --2- 172.21.15.49:0/1978819960 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01380663c0 0x7f0138068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.429+0000 7f013ffff700 1 -- 172.21.15.49:0/1978819960 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f01540feb20 con 0x7f014c054800 2023-07-21T22:11:05.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7f013ffff700 1 --2- 172.21.15.49:0/1978819960 >> [v2:172.21.15.49:6816/3284520698,v1:172.21.15.49:6817/3284520698] conn(0x7f0138070090 0x7f01380724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7f013ffff700 1 -- 172.21.15.49:0/1978819960 --> [v2:172.21.15.49:6816/3284520698,v1:172.21.15.49:6817/3284520698] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0138072b90 con 0x7f0138070090 2023-07-21T22:11:05.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7f013ffff700 1 -- 172.21.15.49:0/1978819960 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01540feed0 con 0x7f014c054800 2023-07-21T22:11:05.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7f01537fe700 1 --2- 172.21.15.49:0/1978819960 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01380663c0 0x7f0138068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7f01537fe700 1 --2- 172.21.15.49:0/1978819960 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01380663c0 0x7f0138068870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f014800c9a0 tx=0x7f0148008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7f0152ffd700 1 --2- 172.21.15.49:0/1978819960 >> [v2:172.21.15.49:6816/3284520698,v1:172.21.15.49:6817/3284520698] conn(0x7f0138070090 0x7f01380724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7fc661c20700 1 -- 172.21.15.49:0/2045688540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc65c0caf60 con 0x7fc65c0afc80 2023-07-21T22:11:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7f22162b5700 1 -- 172.21.15.49:0/1338792421 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220817c4d0 con 0x7f22080541f0 2023-07-21T22:11:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7f22162b5700 1 -- 172.21.15.49:0/1338792421 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22080ddd20 con 0x7f22080541f0 2023-07-21T22:11:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7fc6597fa700 1 -- 172.21.15.49:0/2045688540 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc65400acd0 con 0x7fc65c0afc80 2023-07-21T22:11:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7f2322ffd700 1 -- 172.21.15.49:0/4066908612 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2324021070 con 0x7f232c036e80 2023-07-21T22:11:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.433+0000 7f2322ffd700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f231c0664d0 0x7f231c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7f2322ffd700 1 -- 172.21.15.49:0/4066908612 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2324085a80 con 0x7f232c036e80 2023-07-21T22:11:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7f2331d9b700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f231c0664d0 0x7f231c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7f2322ffd700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.150:6824/2641155494,v1:172.21.15.150:6825/2641155494] conn(0x7f231c0701a0 0x7f231c0725d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7f2322ffd700 1 -- 172.21.15.49:0/4066908612 --> [v2:172.21.15.150:6824/2641155494,v1:172.21.15.150:6825/2641155494] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f231c072ca0 con 0x7f231c0701a0 2023-07-21T22:11:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7f2322ffd700 1 -- 172.21.15.49:0/4066908612 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2324085df0 con 0x7f232c036e80 2023-07-21T22:11:05.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7f0152ffd700 1 --2- 172.21.15.49:0/1978819960 >> [v2:172.21.15.49:6816/3284520698,v1:172.21.15.49:6817/3284520698] conn(0x7f0138070090 0x7f01380724c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7fc6597fa700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc648066320 0x7fc6480687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7fc6597fa700 1 -- 172.21.15.49:0/2045688540 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc654083860 con 0x7fc65c0afc80 2023-07-21T22:11:05.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7fc65bfff700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc648066320 0x7fc6480687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7fc6597fa700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.150:6807/3465358811,v1:172.21.15.150:6809/3465358811] conn(0x7fc64806ff70 0x7fc6480723a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7fc6597fa700 1 -- 172.21.15.49:0/2045688540 --> [v2:172.21.15.150:6807/3465358811,v1:172.21.15.150:6809/3465358811] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc648072a70 con 0x7fc64806ff70 2023-07-21T22:11:05.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7fc6597fa700 1 -- 172.21.15.49:0/2045688540 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc654083b20 con 0x7fc65c0afc80 2023-07-21T22:11:05.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7f2332d9d700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.150:6824/2641155494,v1:172.21.15.150:6825/2641155494] conn(0x7f231c0701a0 0x7f231c0725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7f22162b5700 1 -- 172.21.15.49:0/1338792421 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22080dae20 con 0x7f22080541f0 2023-07-21T22:11:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7f2331d9b700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f231c0664d0 0x7f231c068980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2334063960 tx=0x7f233406c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7f013ffff700 1 -- 172.21.15.49:0/1978819960 <== osd.3 v2:172.21.15.49:6816/3284520698 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0138072b90 con 0x7f0138070090 2023-07-21T22:11:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7fc65bfff700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc648066320 0x7fc6480687d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc65c15fb50 tx=0x7fc64c016040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7fc66141f700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.150:6807/3465358811,v1:172.21.15.150:6809/3465358811] conn(0x7fc64806ff70 0x7fc6480723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7f220cff9700 1 -- 172.21.15.49:0/1338792421 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2204007470 con 0x7f22080541f0 2023-07-21T22:11:05.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.437+0000 7fc66141f700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.150:6807/3465358811,v1:172.21.15.150:6809/3465358811] conn(0x7fc64806ff70 0x7fc6480723a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.441+0000 7f2332d9d700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.150:6824/2641155494,v1:172.21.15.150:6825/2641155494] conn(0x7f231c0701a0 0x7f231c0725d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.441+0000 7f220cff9700 1 --2- 172.21.15.49:0/1338792421 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f21f4066340 0x7f21f40687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.441+0000 7fc6597fa700 1 -- 172.21.15.49:0/2045688540 <== osd.5 v2:172.21.15.150:6807/3465358811 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc648072a70 con 0x7fc64806ff70 2023-07-21T22:11:05.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.441+0000 7f220cff9700 1 -- 172.21.15.49:0/1338792421 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2204083270 con 0x7f22080541f0 2023-07-21T22:11:05.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.441+0000 7f220f7fe700 1 --2- 172.21.15.49:0/1338792421 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f21f4066340 0x7f21f40687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.441+0000 7f220cff9700 1 --2- 172.21.15.49:0/1338792421 >> [v2:172.21.15.150:6810/597032017,v1:172.21.15.150:6812/597032017] conn(0x7f21f4070010 0x7f21f4072440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.441+0000 7f220cff9700 1 -- 172.21.15.49:0/1338792421 --> [v2:172.21.15.150:6810/597032017,v1:172.21.15.150:6812/597032017] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21f4072b10 con 0x7f21f4070010 2023-07-21T22:11:05.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.441+0000 7f220cff9700 1 -- 172.21.15.49:0/1338792421 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2204085850 con 0x7f22080541f0 2023-07-21T22:11:05.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.441+0000 7f2214852700 1 --2- 172.21.15.49:0/1338792421 >> [v2:172.21.15.150:6810/597032017,v1:172.21.15.150:6812/597032017] conn(0x7f21f4070010 0x7f21f4072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.441+0000 7f220f7fe700 1 --2- 172.21.15.49:0/1338792421 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f21f4066340 0x7f21f40687f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f220800eba0 tx=0x7f21fc0091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.441+0000 7f2322ffd700 1 -- 172.21.15.49:0/4066908612 <== osd.6 v2:172.21.15.150:6824/2641155494 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f231c072ca0 con 0x7f231c0701a0 2023-07-21T22:11:05.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.441+0000 7f2214852700 1 --2- 172.21.15.49:0/1338792421 >> [v2:172.21.15.150:6810/597032017,v1:172.21.15.150:6812/597032017] conn(0x7f21f4070010 0x7f21f4072440 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.445+0000 7f220cff9700 1 -- 172.21.15.49:0/1338792421 <== osd.7 v2:172.21.15.150:6810/597032017 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f21f4072b10 con 0x7f21f4070010 2023-07-21T22:11:05.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.445+0000 7f3e777fe700 1 -- 172.21.15.49:0/1617123230 --> [v2:172.21.15.49:6808/2983717007,v1:172.21.15.49:6809/2983717007] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3e68002d90 con 0x7f3e7c070010 2023-07-21T22:11:05.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.445+0000 7f45e14f2700 1 -- 172.21.15.49:0/100042178 --> [v2:172.21.15.49:6800/5206931,v1:172.21.15.49:6801/5206931] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f45dc0d0630 con 0x7f45c8070090 2023-07-21T22:11:05.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f3e8dffb700 1 -- 172.21.15.49:0/1617123230 <== osd.1 v2:172.21.15.49:6808/2983717007 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3e68002d90 con 0x7f3e7c070010 2023-07-21T22:11:05.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f45d8ff9700 1 -- 172.21.15.49:0/100042178 <== osd.0 v2:172.21.15.49:6800/5206931 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f45cc00c9f0 con 0x7f45c8070090 2023-07-21T22:11:05.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f45e14f2700 1 -- 172.21.15.49:0/100042178 >> [v2:172.21.15.49:6800/5206931,v1:172.21.15.49:6801/5206931] conn(0x7f45c8070090 msgr2=0x7f45c80724c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f45e14f2700 1 --2- 172.21.15.49:0/100042178 >> [v2:172.21.15.49:6800/5206931,v1:172.21.15.49:6801/5206931] conn(0x7f45c8070090 0x7f45c80724c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f3e9605a700 1 -- 172.21.15.49:0/1617123230 >> [v2:172.21.15.49:6808/2983717007,v1:172.21.15.49:6809/2983717007] conn(0x7f3e7c070010 msgr2=0x7f3e7c072440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f3e9605a700 1 --2- 172.21.15.49:0/1617123230 >> [v2:172.21.15.49:6808/2983717007,v1:172.21.15.49:6809/2983717007] conn(0x7f3e7c070010 0x7f3e7c072440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f45e14f2700 1 -- 172.21.15.49:0/100042178 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f45c80663c0 msgr2=0x7f45c8068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f45e14f2700 1 --2- 172.21.15.49:0/100042178 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f45c80663c0 0x7f45c8068870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f45d0007fd0 tx=0x7f45d0007c60 comp rx=0 tx=0).stop 2023-07-21T22:11:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f3e9605a700 1 -- 172.21.15.49:0/1617123230 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3e7c066340 msgr2=0x7f3e7c0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f3e9605a700 1 --2- 172.21.15.49:0/1617123230 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3e7c066340 0x7f3e7c0687f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e88001f80 tx=0x7f3e880015b0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f3e9605a700 1 -- 172.21.15.49:0/1617123230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e900ca2c0 msgr2=0x7f3e900c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f3e9605a700 1 --2- 172.21.15.49:0/1617123230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e900ca2c0 0x7f3e900c77b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e84000c00 tx=0x7f3e84004770 comp rx=0 tx=0).stop 2023-07-21T22:11:05.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f45e14f2700 1 -- 172.21.15.49:0/100042178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45dc163680 msgr2=0x7f45dc212d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f45e14f2700 1 --2- 172.21.15.49:0/100042178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45dc163680 0x7f45dc212d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45d400b370 tx=0x7f45d4004b40 comp rx=0 tx=0).stop 2023-07-21T22:11:05.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f45e0cf1700 1 -- 172.21.15.49:0/100042178 reap_dead start 2023-07-21T22:11:05.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f3e95859700 1 -- 172.21.15.49:0/1617123230 reap_dead start 2023-07-21T22:11:05.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f3e9605a700 1 -- 172.21.15.49:0/1617123230 shutdown_connections 2023-07-21T22:11:05.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f3e9605a700 1 -- 172.21.15.49:0/1617123230 >> 172.21.15.49:0/1617123230 conn(0x7f3e90070450 msgr2=0x7f3e900cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f45e14f2700 1 -- 172.21.15.49:0/100042178 shutdown_connections 2023-07-21T22:11:05.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f45e14f2700 1 -- 172.21.15.49:0/100042178 >> 172.21.15.49:0/100042178 conn(0x7f45dc06e960 msgr2=0x7f45dc0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f3e9605a700 1 -- 172.21.15.49:0/1617123230 shutdown_connections 2023-07-21T22:11:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.449+0000 7f3e9605a700 1 -- 172.21.15.49:0/1617123230 wait complete. 2023-07-21T22:11:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.453+0000 7f45e14f2700 1 -- 172.21.15.49:0/100042178 shutdown_connections 2023-07-21T22:11:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.453+0000 7f9cce54a700 1 -- 172.21.15.49:0/3533936320 --> [v2:172.21.15.49:6824/3193969798,v1:172.21.15.49:6825/3193969798] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9cc0006dc0 con 0x7f9cac06ffc0 2023-07-21T22:11:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.453+0000 7f45e14f2700 1 -- 172.21.15.49:0/100042178 wait complete. 2023-07-21T22:11:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.453+0000 7f9cbdffb700 1 -- 172.21.15.49:0/3533936320 <== osd.2 v2:172.21.15.49:6824/3193969798 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9cb8001190 con 0x7f9cac06ffc0 2023-07-21T22:11:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.453+0000 7f9cce54a700 1 -- 172.21.15.49:0/3533936320 >> [v2:172.21.15.49:6824/3193969798,v1:172.21.15.49:6825/3193969798] conn(0x7f9cac06ffc0 msgr2=0x7f9cac0723f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.453+0000 7f9cce54a700 1 --2- 172.21.15.49:0/3533936320 >> [v2:172.21.15.49:6824/3193969798,v1:172.21.15.49:6825/3193969798] conn(0x7f9cac06ffc0 0x7f9cac0723f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.453+0000 7f9cce54a700 1 -- 172.21.15.49:0/3533936320 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9cac0662f0 msgr2=0x7f9cac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.453+0000 7f9cce54a700 1 --2- 172.21.15.49:0/3533936320 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9cac0662f0 0x7f9cac0687a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0011180 tx=0x7f9cc808a000 comp rx=0 tx=0).stop 2023-07-21T22:11:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.457+0000 7f9cce54a700 1 -- 172.21.15.49:0/3533936320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cc003b160 msgr2=0x7f9cc004ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.457+0000 7f9cce54a700 1 --2- 172.21.15.49:0/3533936320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cc003b160 0x7f9cc004ece0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4007f10 tx=0x7f9cc400da30 comp rx=0 tx=0).stop 2023-07-21T22:11:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.457+0000 7f9ccdd49700 1 -- 172.21.15.49:0/3533936320 reap_dead start 2023-07-21T22:11:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.457+0000 7fed1359e700 1 -- 172.21.15.49:0/2719423013 --> [v2:172.21.15.150:6800/3591224217,v1:172.21.15.150:6801/3591224217] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fed0c17c4e0 con 0x7fecf406fe00 2023-07-21T22:11:05.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.461+0000 7fed02ffd700 1 -- 172.21.15.49:0/2719423013 <== osd.4 v2:172.21.15.150:6800/3591224217 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fed0c17c4e0 con 0x7fecf406fe00 2023-07-21T22:11:05.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.461+0000 7f9cce54a700 1 -- 172.21.15.49:0/3533936320 shutdown_connections 2023-07-21T22:11:05.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.461+0000 7f9cce54a700 1 -- 172.21.15.49:0/3533936320 >> 172.21.15.49:0/3533936320 conn(0x7f9cc0055c20 msgr2=0x7f9cc00e1760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.461+0000 7f9cce54a700 1 -- 172.21.15.49:0/3533936320 shutdown_connections 2023-07-21T22:11:05.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.461+0000 7f9cce54a700 1 -- 172.21.15.49:0/3533936320 wait complete. 2023-07-21T22:11:05.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.461+0000 7fed1359e700 1 -- 172.21.15.49:0/2719423013 >> [v2:172.21.15.150:6800/3591224217,v1:172.21.15.150:6801/3591224217] conn(0x7fecf406fe00 msgr2=0x7fecf4072230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.461+0000 7fed1359e700 1 --2- 172.21.15.49:0/2719423013 >> [v2:172.21.15.150:6800/3591224217,v1:172.21.15.150:6801/3591224217] conn(0x7fecf406fe00 0x7fecf4072230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.465+0000 7fed1359e700 1 -- 172.21.15.49:0/2719423013 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fecf4066320 msgr2=0x7fecf40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.465+0000 7fed1359e700 1 --2- 172.21.15.49:0/2719423013 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fecf4066320 0x7fecf40687d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fed14078d30 tx=0x7fed1406c040 comp rx=0 tx=0).stop 2023-07-21T22:11:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.465+0000 7fed1359e700 1 -- 172.21.15.49:0/2719423013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed0c03a810 msgr2=0x7fed0c047a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.465+0000 7fed1359e700 1 --2- 172.21.15.49:0/2719423013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed0c03a810 0x7fed0c047a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fed0800e900 tx=0x7fed0800ec10 comp rx=0 tx=0).stop 2023-07-21T22:11:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.465+0000 7fed12d9d700 1 -- 172.21.15.49:0/2719423013 reap_dead start 2023-07-21T22:11:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.465+0000 7fed1359e700 1 -- 172.21.15.49:0/2719423013 shutdown_connections 2023-07-21T22:11:05.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.465+0000 7fed1359e700 1 -- 172.21.15.49:0/2719423013 >> 172.21.15.49:0/2719423013 conn(0x7fed0c051770 msgr2=0x7fed0c0de130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.465+0000 7fed1359e700 1 -- 172.21.15.49:0/2719423013 shutdown_connections 2023-07-21T22:11:05.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.465+0000 7fed1359e700 1 -- 172.21.15.49:0/2719423013 wait complete. 2023-07-21T22:11:05.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.465+0000 7f0159be6700 1 -- 172.21.15.49:0/1978819960 --> [v2:172.21.15.49:6816/3284520698,v1:172.21.15.49:6817/3284520698] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0134002d60 con 0x7f0138070090 2023-07-21T22:11:05.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.469+0000 7f013ffff700 1 -- 172.21.15.49:0/1978819960 <== osd.3 v2:172.21.15.49:6816/3284520698 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0134002d60 con 0x7f0138070090 2023-07-21T22:11:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.469+0000 7f0159be6700 1 -- 172.21.15.49:0/1978819960 >> [v2:172.21.15.49:6816/3284520698,v1:172.21.15.49:6817/3284520698] conn(0x7f0138070090 msgr2=0x7f01380724c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.469+0000 7f0159be6700 1 --2- 172.21.15.49:0/1978819960 >> [v2:172.21.15.49:6816/3284520698,v1:172.21.15.49:6817/3284520698] conn(0x7f0138070090 0x7f01380724c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.469+0000 7f0159be6700 1 -- 172.21.15.49:0/1978819960 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01380663c0 msgr2=0x7f0138068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.469+0000 7f0159be6700 1 --2- 172.21.15.49:0/1978819960 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01380663c0 0x7f0138068870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f014800c9a0 tx=0x7f0148008040 comp rx=0 tx=0).stop 2023-07-21T22:11:05.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.469+0000 7f0159be6700 1 -- 172.21.15.49:0/1978819960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f014c054800 msgr2=0x7f014c0d4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.469+0000 7f0159be6700 1 --2- 172.21.15.49:0/1978819960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f014c054800 0x7f014c0d4300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0154000b60 tx=0x7f0154072230 comp rx=0 tx=0).stop 2023-07-21T22:11:05.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.469+0000 7f0153fff700 1 -- 172.21.15.49:0/1978819960 reap_dead start 2023-07-21T22:11:05.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.469+0000 7f0159be6700 1 -- 172.21.15.49:0/1978819960 shutdown_connections 2023-07-21T22:11:05.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.469+0000 7f0159be6700 1 -- 172.21.15.49:0/1978819960 >> 172.21.15.49:0/1978819960 conn(0x7f014c051770 msgr2=0x7f014c0deef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.473+0000 7f0159be6700 1 -- 172.21.15.49:0/1978819960 shutdown_connections 2023-07-21T22:11:05.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.473+0000 7f0159be6700 1 -- 172.21.15.49:0/1978819960 wait complete. 2023-07-21T22:11:05.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.473+0000 7f2338f3a700 1 -- 172.21.15.49:0/4066908612 --> [v2:172.21.15.150:6824/2641155494,v1:172.21.15.150:6825/2641155494] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f232c0e0710 con 0x7f231c0701a0 2023-07-21T22:11:05.566 INFO:teuthology.orchestra.run.smithi049.stdout:60129542157 2023-07-21T22:11:05.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.473+0000 7f2322ffd700 1 -- 172.21.15.49:0/4066908612 <== osd.6 v2:172.21.15.150:6824/2641155494 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2328004020 con 0x7f231c0701a0 2023-07-21T22:11:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.473+0000 7f2338f3a700 1 -- 172.21.15.49:0/4066908612 >> [v2:172.21.15.150:6824/2641155494,v1:172.21.15.150:6825/2641155494] conn(0x7f231c0701a0 msgr2=0x7f231c0725d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.473+0000 7f2338f3a700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.150:6824/2641155494,v1:172.21.15.150:6825/2641155494] conn(0x7f231c0701a0 0x7f231c0725d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.567 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-21T22:11:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.473+0000 7f22162b5700 1 -- 172.21.15.49:0/1338792421 --> [v2:172.21.15.150:6810/597032017,v1:172.21.15.150:6812/597032017] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22080eb400 con 0x7f21f4070010 2023-07-21T22:11:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.473+0000 7f2338f3a700 1 -- 172.21.15.49:0/4066908612 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f231c0664d0 msgr2=0x7f231c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.473+0000 7f2338f3a700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f231c0664d0 0x7f231c068980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2334063960 tx=0x7f233406c040 comp rx=0 tx=0).stop 2023-07-21T22:11:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.473+0000 7f2338f3a700 1 -- 172.21.15.49:0/4066908612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232c036e80 msgr2=0x7f232c0cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.473+0000 7f2338f3a700 1 --2- 172.21.15.49:0/4066908612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232c036e80 0x7f232c0cf320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2324009c60 tx=0x7f2324004770 comp rx=0 tx=0).stop 2023-07-21T22:11:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.473+0000 7f2332d9d700 1 -- 172.21.15.49:0/4066908612 reap_dead start 2023-07-21T22:11:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f2338f3a700 1 -- 172.21.15.49:0/4066908612 shutdown_connections 2023-07-21T22:11:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f2338f3a700 1 -- 172.21.15.49:0/4066908612 >> 172.21.15.49:0/4066908612 conn(0x7f232c051770 msgr2=0x7f232c054c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f2338f3a700 1 -- 172.21.15.49:0/4066908612 shutdown_connections 2023-07-21T22:11:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f2338f3a700 1 -- 172.21.15.49:0/4066908612 wait complete. 2023-07-21T22:11:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f220cff9700 1 -- 172.21.15.49:0/1338792421 <== osd.7 v2:172.21.15.150:6810/597032017 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2210097040 con 0x7f21f4070010 2023-07-21T22:11:05.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7fc661c20700 1 -- 172.21.15.49:0/2045688540 --> [v2:172.21.15.150:6807/3465358811,v1:172.21.15.150:6809/3465358811] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc65c0cac80 con 0x7fc64806ff70 2023-07-21T22:11:05.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f22162b5700 1 -- 172.21.15.49:0/1338792421 >> [v2:172.21.15.150:6810/597032017,v1:172.21.15.150:6812/597032017] conn(0x7f21f4070010 msgr2=0x7f21f4072440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f22162b5700 1 --2- 172.21.15.49:0/1338792421 >> [v2:172.21.15.150:6810/597032017,v1:172.21.15.150:6812/597032017] conn(0x7f21f4070010 0x7f21f4072440 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f22162b5700 1 -- 172.21.15.49:0/1338792421 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f21f4066340 msgr2=0x7f21f40687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f22162b5700 1 --2- 172.21.15.49:0/1338792421 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f21f4066340 0x7f21f40687f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f220800eba0 tx=0x7f21fc0091c0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f22162b5700 1 -- 172.21.15.49:0/1338792421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22080541f0 msgr2=0x7f220817bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f22162b5700 1 --2- 172.21.15.49:0/1338792421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22080541f0 0x7f220817bf90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f220800bdf0 tx=0x7f220400c7b0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f2214852700 1 -- 172.21.15.49:0/1338792421 reap_dead start 2023-07-21T22:11:05.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f22162b5700 1 -- 172.21.15.49:0/1338792421 shutdown_connections 2023-07-21T22:11:05.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f22162b5700 1 -- 172.21.15.49:0/1338792421 >> 172.21.15.49:0/1338792421 conn(0x7f2208057b90 msgr2=0x7f22080384c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f22162b5700 1 -- 172.21.15.49:0/1338792421 shutdown_connections 2023-07-21T22:11:05.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7fc6597fa700 1 -- 172.21.15.49:0/2045688540 <== osd.5 v2:172.21.15.150:6807/3465358811 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc650011630 con 0x7fc64806ff70 2023-07-21T22:11:05.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7f22162b5700 1 -- 172.21.15.49:0/1338792421 wait complete. 2023-07-21T22:11:05.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7fc661c20700 1 -- 172.21.15.49:0/2045688540 >> [v2:172.21.15.150:6807/3465358811,v1:172.21.15.150:6809/3465358811] conn(0x7fc64806ff70 msgr2=0x7fc6480723a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7fc661c20700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.150:6807/3465358811,v1:172.21.15.150:6809/3465358811] conn(0x7fc64806ff70 0x7fc6480723a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7fc661c20700 1 -- 172.21.15.49:0/2045688540 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc648066320 msgr2=0x7fc6480687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7fc661c20700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc648066320 0x7fc6480687d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc65c15fb50 tx=0x7fc64c016040 comp rx=0 tx=0).stop 2023-07-21T22:11:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7fc661c20700 1 -- 172.21.15.49:0/2045688540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65c0afc80 msgr2=0x7fc65c148a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7fc661c20700 1 --2- 172.21.15.49:0/2045688540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65c0afc80 0x7fc65c148a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc65400cc80 tx=0x7fc65400cf90 comp rx=0 tx=0).stop 2023-07-21T22:11:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.477+0000 7fc66141f700 1 -- 172.21.15.49:0/2045688540 reap_dead start 2023-07-21T22:11:05.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.481+0000 7fc661c20700 1 -- 172.21.15.49:0/2045688540 shutdown_connections 2023-07-21T22:11:05.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.481+0000 7fc661c20700 1 -- 172.21.15.49:0/2045688540 >> 172.21.15.49:0/2045688540 conn(0x7fc65c06e960 msgr2=0x7fc65c0af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.481+0000 7fc661c20700 1 -- 172.21.15.49:0/2045688540 shutdown_connections 2023-07-21T22:11:05.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.481+0000 7fc661c20700 1 -- 172.21.15.49:0/2045688540 wait complete. 2023-07-21T22:11:05.577 INFO:teuthology.orchestra.run.smithi049.stdout:64424509451 2023-07-21T22:11:05.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-21T22:11:05.578 INFO:teuthology.orchestra.run.smithi049.stdout:64424509450 2023-07-21T22:11:05.578 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-21T22:11:05.579 INFO:teuthology.orchestra.run.smithi049.stdout:64424509451 2023-07-21T22:11:05.579 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-21T22:11:05.580 INFO:teuthology.orchestra.run.smithi049.stdout:64424509450 2023-07-21T22:11:05.580 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-21T22:11:05.581 INFO:teuthology.orchestra.run.smithi049.stdout:64424509450 2023-07-21T22:11:05.582 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-21T22:11:05.582 INFO:teuthology.orchestra.run.smithi049.stdout:64424509452 2023-07-21T22:11:05.583 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-21T22:11:05.583 INFO:teuthology.orchestra.run.smithi049.stdout:64424509453 2023-07-21T22:11:05.584 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-21T22:11:05.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.805+0000 7f4eec4b1700 1 Processor -- start 2023-07-21T22:11:05.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.805+0000 7f4eec4b1700 1 -- start start 2023-07-21T22:11:05.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4eec4b1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4ee40cc870 0x7f4ee40cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4eec4b1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ee40c86c0 0x7f4ee40cc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4eec4b1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee415b880 con 0x7f4ee406f470 2023-07-21T22:11:05.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4eec4b1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee415bb20 con 0x7f4ee40cc870 2023-07-21T22:11:05.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4eec4b1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee415be00 con 0x7f4ee40c86c0 2023-07-21T22:11:05.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4eeaa4e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4ee406f470 0x7f4ee40ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44656/0 (socket says 172.21.15.49:44656) 2023-07-21T22:11:05.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4eeaa4e700 1 -- 172.21.15.49:0/2180147793 learned_addr learned my addr 172.21.15.49:0/2180147793 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:05.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4eea24d700 1 --2- 172.21.15.49:0/2180147793 >> v2:172.21.15.150:3300/0 conn(0x7f4ee40cc870 0x7f4ee40cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4ee9a4c700 1 --2- 172.21.15.49:0/2180147793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ee40c86c0 0x7f4ee40cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4ee9a4c700 1 -- 172.21.15.49:0/2180147793 >> v2:172.21.15.150:3300/0 conn(0x7f4ee40cc870 msgr2=0x7f4ee40cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4ee9a4c700 1 --2- 172.21.15.49:0/2180147793 >> v2:172.21.15.150:3300/0 conn(0x7f4ee40cc870 0x7f4ee40cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4ee924b700 1 -- 172.21.15.49:0/2180147793 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076599103 0 0) 0x7f4ee415b880 con 0x7f4ee406f470 2023-07-21T22:11:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4ee9a4c700 1 -- 172.21.15.49:0/2180147793 >> v1:172.21.15.49:6789/0 conn(0x7f4ee406f470 legacy=0x7f4ee40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4ee9a4c700 1 -- 172.21.15.49:0/2180147793 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee415c0e0 con 0x7f4ee40c86c0 2023-07-21T22:11:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4ee9a4c700 1 --2- 172.21.15.49:0/2180147793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ee40c86c0 0x7f4ee40cc180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009850 tx=0x7f4ed8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec67585838185610 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4ee924b700 1 -- 172.21.15.49:0/2180147793 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8011830 con 0x7f4ee40c86c0 2023-07-21T22:11:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4ee924b700 1 -- 172.21.15.49:0/2180147793 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed8011990 con 0x7f4ee40c86c0 2023-07-21T22:11:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.809+0000 7f4ee924b700 1 -- 172.21.15.49:0/2180147793 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8011d40 con 0x7f4ee40c86c0 2023-07-21T22:11:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.813+0000 7f4eec4b1700 1 -- 172.21.15.49:0/2180147793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ee40c86c0 msgr2=0x7f4ee40cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.813+0000 7f4eec4b1700 1 --2- 172.21.15.49:0/2180147793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ee40c86c0 0x7f4ee40cc180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009850 tx=0x7f4ed8009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.813+0000 7f4eec4b1700 1 -- 172.21.15.49:0/2180147793 shutdown_connections 2023-07-21T22:11:05.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.813+0000 7f4eec4b1700 1 --2- 172.21.15.49:0/2180147793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ee40c86c0 0x7f4ee40cc180 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.813+0000 7f4eec4b1700 1 --2- 172.21.15.49:0/2180147793 >> v2:172.21.15.150:3300/0 conn(0x7f4ee40cc870 0x7f4ee40cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.813+0000 7f4eec4b1700 1 -- 172.21.15.49:0/2180147793 >> 172.21.15.49:0/2180147793 conn(0x7f4ee406e960 msgr2=0x7f4ee406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.813+0000 7f4eec4b1700 1 -- 172.21.15.49:0/2180147793 shutdown_connections 2023-07-21T22:11:05.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.813+0000 7f4eec4b1700 1 -- 172.21.15.49:0/2180147793 wait complete. 2023-07-21T22:11:05.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.813+0000 7f4eec4b1700 1 Processor -- start 2023-07-21T22:11:05.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.813+0000 7f4eec4b1700 1 -- start start 2023-07-21T22:11:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eec4b1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ee406f470 0x7f4ee40c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eec4b1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee40c86c0 0x7f4ee414d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eea24d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ee406f470 0x7f4ee40c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eec4b1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ee414d6f0 0x7f4ee40c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eea24d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ee406f470 0x7f4ee40c25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48130/0 (socket says 172.21.15.49:48130) 2023-07-21T22:11:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.813+0000 7f130103e700 1 Processor -- start 2023-07-21T22:11:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.813+0000 7f130103e700 1 -- start start 2023-07-21T22:11:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eea24d700 1 -- 172.21.15.49:0/4222829352 learned_addr learned my addr 172.21.15.49:0/4222829352 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eec4b1700 1 -- 172.21.15.49:0/4222829352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee41508f0 con 0x7f4ee406f470 2023-07-21T22:11:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eec4b1700 1 -- 172.21.15.49:0/4222829352 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee40c2eb0 con 0x7f4ee40c86c0 2023-07-21T22:11:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eec4b1700 1 -- 172.21.15.49:0/4222829352 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee40c2bd0 con 0x7f4ee414d6f0 2023-07-21T22:11:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4ee9a4c700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee40c86c0 0x7f4ee414d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eeaa4e700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ee414d6f0 0x7f4ee40c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f0481289700 1 Processor -- start 2023-07-21T22:11:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eea24d700 1 -- 172.21.15.49:0/4222829352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ee414d6f0 msgr2=0x7f4ee40c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eea24d700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ee414d6f0 0x7f4ee40c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eea24d700 1 -- 172.21.15.49:0/4222829352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee40c86c0 msgr2=0x7f4ee414d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eea24d700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee40c86c0 0x7f4ee414d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eea24d700 1 -- 172.21.15.49:0/4222829352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed80094b0 con 0x7f4ee406f470 2023-07-21T22:11:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4ee9a4c700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee40c86c0 0x7f4ee414d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f4eea24d700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ee406f470 0x7f4ee40c25b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400edb0 tx=0x7f4ed400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f130103e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f12fc15db00 0x7f12fc1646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f130103e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12fc0d1530 0x7f12fc161080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f130103e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f12fc0d2240 0x7f12fc0d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f130103e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12fc160670 con 0x7f12fc0d2240 2023-07-21T22:11:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f130103e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12fc1615c0 con 0x7f12fc15db00 2023-07-21T22:11:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f130103e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc0d1c80 con 0x7f12fc0d1530 2023-07-21T22:11:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f12fad9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f12fc15db00 0x7f12fc1646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f12fb59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f12fc0d2240 0x7f12fc0d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f12fad9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f12fc15db00 0x7f12fc1646e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:39816/0 (socket says 172.21.15.49:39816) 2023-07-21T22:11:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f12fad9d700 1 -- 172.21.15.49:0/3189626363 learned_addr learned my addr 172.21.15.49:0/3189626363 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f12fa59c700 1 --2- 172.21.15.49:0/3189626363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12fc0d1530 0x7f12fc161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f12fad9d700 1 -- 172.21.15.49:0/3189626363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12fc0d1530 msgr2=0x7f12fc161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f12fad9d700 1 --2- 172.21.15.49:0/3189626363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12fc0d1530 0x7f12fc161080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f12fad9d700 1 -- 172.21.15.49:0/3189626363 >> v2:172.21.15.49:3300/0 conn(0x7f12fc0d2240 msgr2=0x7f12fc0d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f12fad9d700 1 --2- 172.21.15.49:0/3189626363 >> v2:172.21.15.49:3300/0 conn(0x7f12fc0d2240 0x7f12fc0d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f12fad9d700 1 -- 172.21.15.49:0/3189626363 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc0d1f60 con 0x7f12fc15db00 2023-07-21T22:11:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f12fb59e700 1 --2- 172.21.15.49:0/3189626363 >> v2:172.21.15.49:3300/0 conn(0x7f12fc0d2240 0x7f12fc0d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f12fad9d700 1 --2- 172.21.15.49:0/3189626363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12fc15db00 0x7f12fc1646e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f12fc08b720 tx=0x7f12f0009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69326a6e350ac1f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f4ee2ffd700 1 -- 172.21.15.49:0/4222829352 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed400cbb0 con 0x7f4ee406f470 2023-07-21T22:11:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f4eec4b1700 1 -- 172.21.15.49:0/4222829352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee41502a0 con 0x7f4ee406f470 2023-07-21T22:11:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.817+0000 7f0481289700 1 -- start start 2023-07-21T22:11:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f4eec4b1700 1 -- 172.21.15.49:0/4222829352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee40c3b90 con 0x7f4ee406f470 2023-07-21T22:11:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f0481289700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f047c06fe80 0x7f047c0ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f0481289700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f047c070250 0x7f047c163c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f0481289700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f047c1641a0 0x7f047c06d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f0481289700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047c0708a0 con 0x7f047c1641a0 2023-07-21T22:11:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f0481289700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047c0cf5e0 con 0x7f047c070250 2023-07-21T22:11:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f0481289700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c070af0 con 0x7f047c06fe80 2023-07-21T22:11:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f12f9d9b700 1 -- 172.21.15.49:0/3189626363 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0011830 con 0x7f12fc15db00 2023-07-21T22:11:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f12f9d9b700 1 -- 172.21.15.49:0/3189626363 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f0011990 con 0x7f12fc15db00 2023-07-21T22:11:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f130103e700 1 -- 172.21.15.49:0/3189626363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12fc15db00 msgr2=0x7f12fc1646e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f130103e700 1 --2- 172.21.15.49:0/3189626363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12fc15db00 0x7f12fc1646e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f12fc08b720 tx=0x7f12f0009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f130103e700 1 -- 172.21.15.49:0/3189626363 shutdown_connections 2023-07-21T22:11:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f130103e700 1 --2- 172.21.15.49:0/3189626363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12fc0d1530 0x7f12fc161080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f130103e700 1 --2- 172.21.15.49:0/3189626363 >> v2:172.21.15.49:3300/0 conn(0x7f12fc0d2240 0x7f12fc0d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f130103e700 1 --2- 172.21.15.49:0/3189626363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12fc15db00 0x7f12fc1646e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f130103e700 1 -- 172.21.15.49:0/3189626363 >> 172.21.15.49:0/3189626363 conn(0x7f12fc06fe40 msgr2=0x7f12fc070210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f130103e700 1 -- 172.21.15.49:0/3189626363 shutdown_connections 2023-07-21T22:11:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f130103e700 1 -- 172.21.15.49:0/3189626363 wait complete. 2023-07-21T22:11:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f4ee2ffd700 1 -- 172.21.15.49:0/4222829352 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed400f040 con 0x7f4ee406f470 2023-07-21T22:11:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f4ee2ffd700 1 -- 172.21.15.49:0/4222829352 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4014480 con 0x7f4ee406f470 2023-07-21T22:11:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f047affd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f047c06fe80 0x7f047c0ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f04727fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f047c070250 0x7f047c163c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f047affd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f047c06fe80 0x7f047c0ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:37268/0 (socket says 172.21.15.49:37268) 2023-07-21T22:11:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f047affd700 1 -- 172.21.15.49:0/2427399595 learned_addr learned my addr 172.21.15.49:0/2427399595 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f047bfff700 1 --2- 172.21.15.49:0/2427399595 >> v2:172.21.15.49:3300/0 conn(0x7f047c1641a0 0x7f047c06d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f047bfff700 1 -- 172.21.15.49:0/2427399595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f047c06fe80 msgr2=0x7f047c0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f047bfff700 1 --2- 172.21.15.49:0/2427399595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f047c06fe80 0x7f047c0ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f047bfff700 1 -- 172.21.15.49:0/2427399595 >> v2:172.21.15.150:3300/0 conn(0x7f047c070250 msgr2=0x7f047c163c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f047bfff700 1 --2- 172.21.15.49:0/2427399595 >> v2:172.21.15.150:3300/0 conn(0x7f047c070250 0x7f047c163c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f047bfff700 1 -- 172.21.15.49:0/2427399595 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c070dd0 con 0x7f047c1641a0 2023-07-21T22:11:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.821+0000 7f047bfff700 1 --2- 172.21.15.49:0/2427399595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047c1641a0 0x7f047c06d630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f047c0cd2a0 tx=0x7f047400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef599376065dc9c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f047a7fc700 1 -- 172.21.15.49:0/2427399595 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047400e070 con 0x7f047c1641a0 2023-07-21T22:11:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f4eec4b1700 1 -- 172.21.15.49:0/4222829352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec4005310 con 0x7f4ee406f470 2023-07-21T22:11:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f85c862c700 1 Processor -- start 2023-07-21T22:11:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7fde7f59e700 1 Processor -- start 2023-07-21T22:11:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7fde7f59e700 1 -- start start 2023-07-21T22:11:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f047a7fc700 1 -- 172.21.15.49:0/2427399595 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047400bb20 con 0x7f047c1641a0 2023-07-21T22:11:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f047a7fc700 1 -- 172.21.15.49:0/2427399595 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0474012430 con 0x7f047c1641a0 2023-07-21T22:11:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f0481289700 1 -- 172.21.15.49:0/2427399595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047c1641a0 msgr2=0x7f047c06d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f0481289700 1 --2- 172.21.15.49:0/2427399595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047c1641a0 0x7f047c06d630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f047c0cd2a0 tx=0x7f047400b330 comp rx=0 tx=0).stop 2023-07-21T22:11:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f0481289700 1 -- 172.21.15.49:0/2427399595 shutdown_connections 2023-07-21T22:11:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f0481289700 1 --2- 172.21.15.49:0/2427399595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047c1641a0 0x7f047c06d630 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f0481289700 1 --2- 172.21.15.49:0/2427399595 >> v2:172.21.15.150:3300/0 conn(0x7f047c070250 0x7f047c163c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f0481289700 1 --2- 172.21.15.49:0/2427399595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f047c06fe80 0x7f047c0ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f0481289700 1 -- 172.21.15.49:0/2427399595 >> 172.21.15.49:0/2427399595 conn(0x7f047c0cc430 msgr2=0x7f047c0cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f0481289700 1 -- 172.21.15.49:0/2427399595 shutdown_connections 2023-07-21T22:11:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f130103e700 1 Processor -- start 2023-07-21T22:11:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f130103e700 1 -- start start 2023-07-21T22:11:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f130103e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12fc0d1530 0x7f12fc0c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f130103e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12fc0d2240 0x7f12fc0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f12fa59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12fc0d2240 0x7f12fc0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f0481289700 1 -- 172.21.15.49:0/2427399595 wait complete. 2023-07-21T22:11:05.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7fde7f59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fde780384d0 0x7fde780553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde7803bfc0 0x7fde78057750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f85c862c700 1 -- start start 2023-07-21T22:11:05.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f85c862c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85c00b7af0 0x7f85c00b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f85c862c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85c00cee10 0x7f85c00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f85c862c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c00b3e80 con 0x7f85c00d1e40 2023-07-21T22:11:05.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f12fa59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12fc0d2240 0x7f12fc0b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48164/0 (socket says 172.21.15.49:48164) 2023-07-21T22:11:05.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f12fa59c700 1 -- 172.21.15.49:0/874347451 learned_addr learned my addr 172.21.15.49:0/874347451 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f130103e700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12fc15db00 0x7f12fc14f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f12fad9d700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12fc0d1530 0x7f12fc0c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f130103e700 1 -- 172.21.15.49:0/874347451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc0b4190 con 0x7f12fc0d2240 2023-07-21T22:11:05.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f130103e700 1 -- 172.21.15.49:0/874347451 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc0b20c0 con 0x7f12fc15db00 2023-07-21T22:11:05.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f130103e700 1 -- 172.21.15.49:0/874347451 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc0b37f0 con 0x7f12fc0d1530 2023-07-21T22:11:05.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.825+0000 7f85c862c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c00cf7d0 con 0x7f85c00cee10 2023-07-21T22:11:05.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f12fb59e700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12fc15db00 0x7f12fc14f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f12fa59c700 1 -- 172.21.15.49:0/874347451 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12fc0d1530 msgr2=0x7f12fc0c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f12fa59c700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12fc0d1530 0x7f12fc0c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f12fa59c700 1 -- 172.21.15.49:0/874347451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12fc15db00 msgr2=0x7f12fc14f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f12fa59c700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12fc15db00 0x7f12fc14f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f12fa59c700 1 -- 172.21.15.49:0/874347451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4009a70 con 0x7f12fc0d2240 2023-07-21T22:11:05.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f85c862c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c015fd40 con 0x7f85c00b7af0 2023-07-21T22:11:05.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f85c6bc9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85c00cee10 0x7f85c00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f85c6bc9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85c00cee10 0x7f85c00cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:39832/0 (socket says 172.21.15.49:39832) 2023-07-21T22:11:05.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f85c6bc9700 1 -- 172.21.15.49:0/2676768083 learned_addr learned my addr 172.21.15.49:0/2676768083 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f0481289700 1 Processor -- start 2023-07-21T22:11:05.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7e59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fde780384d0 0x7fde780553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7dd9b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde7803bfc0 0x7fde78057750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7dd9b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde7803bfc0 0x7fde78057750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:37278/0 (socket says 172.21.15.49:37278) 2023-07-21T22:11:05.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7dd9b700 1 -- 172.21.15.49:0/743952633 learned_addr learned my addr 172.21.15.49:0/743952633 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7e59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fde780384d0 0x7fde780553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:39826/0 (socket says 172.21.15.49:39826) 2023-07-21T22:11:05.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7f59e700 1 -- 172.21.15.49:0/743952633 --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde780537c0 con 0x7fde7800e900 2023-07-21T22:11:05.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7f59e700 1 -- 172.21.15.49:0/743952633 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde78053fd0 con 0x7fde780384d0 2023-07-21T22:11:05.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7f59e700 1 -- 172.21.15.49:0/743952633 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde78006470 con 0x7fde7803bfc0 2023-07-21T22:11:05.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7ed9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fde7800e900 0x7fde78006ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44670/0 (socket says 172.21.15.49:44670) 2023-07-21T22:11:05.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f85c63c8700 1 --2- 172.21.15.49:0/2676768083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85c00b7af0 0x7f85c00b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f85c6bc9700 1 -- 172.21.15.49:0/2676768083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85c00b7af0 msgr2=0x7f85c00b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f85c6bc9700 1 --2- 172.21.15.49:0/2676768083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85c00b7af0 0x7f85c00b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f85c6bc9700 1 -- 172.21.15.49:0/2676768083 >> v1:172.21.15.150:6789/0 conn(0x7f85c00d1e40 legacy=0x7f85c015f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f85c6bc9700 1 -- 172.21.15.49:0/2676768083 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c00cea00 con 0x7f85c00cee10 2023-07-21T22:11:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f12fa59c700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12fc0d2240 0x7f12fc0b45b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f12ec00e7c0 tx=0x7f12ec00ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7dd9b700 1 -- 172.21.15.49:0/743952633 >> v2:172.21.15.150:3300/0 conn(0x7fde780384d0 msgr2=0x7fde780553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7dd9b700 1 --2- 172.21.15.49:0/743952633 >> v2:172.21.15.150:3300/0 conn(0x7fde780384d0 0x7fde780553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7dd9b700 1 -- 172.21.15.49:0/743952633 >> v1:172.21.15.49:6789/0 conn(0x7fde7800e900 legacy=0x7fde78006ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7dd9b700 1 -- 172.21.15.49:0/743952633 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde78006710 con 0x7fde7803bfc0 2023-07-21T22:11:05.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f85c6bc9700 1 --2- 172.21.15.49:0/2676768083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c00cee10 0x7f85c00cf290 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009e50 tx=0x7f85b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5cab91aa955cf01 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7dd9b700 1 --2- 172.21.15.49:0/743952633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde7803bfc0 0x7fde78057750 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde74009910 tx=0x7fde74009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f900f33b76d1798 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f85c53c6700 1 -- 172.21.15.49:0/2676768083 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b800e070 con 0x7f85c00cee10 2023-07-21T22:11:05.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f0481289700 1 -- start start 2023-07-21T22:11:05.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7d59a700 1 -- 172.21.15.49:0/743952633 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7400ba60 con 0x7fde7803bfc0 2023-07-21T22:11:05.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7d59a700 1 -- 172.21.15.49:0/743952633 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7400bbc0 con 0x7fde7803bfc0 2023-07-21T22:11:05.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7fde7d59a700 1 -- 172.21.15.49:0/743952633 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74009e60 con 0x7fde7803bfc0 2023-07-21T22:11:05.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f85c53c6700 1 -- 172.21.15.49:0/2676768083 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b8003a90 con 0x7f85c00cee10 2023-07-21T22:11:05.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f85c53c6700 1 -- 172.21.15.49:0/2676768083 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b8003e40 con 0x7f85c00cee10 2023-07-21T22:11:05.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7fde7f59e700 1 -- 172.21.15.49:0/743952633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde7803bfc0 msgr2=0x7fde78057750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7fde7f59e700 1 --2- 172.21.15.49:0/743952633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde7803bfc0 0x7fde78057750 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde74009910 tx=0x7fde74009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:05.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f85c862c700 1 -- 172.21.15.49:0/2676768083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c00cee10 msgr2=0x7f85c00cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f85c862c700 1 --2- 172.21.15.49:0/2676768083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c00cee10 0x7f85c00cf290 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009e50 tx=0x7f85b800b330 comp rx=0 tx=0).stop 2023-07-21T22:11:05.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f0481289700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f047c06fe80 0x7f047c0b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f0481289700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f047c070250 0x7f047c0c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f0481289700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047c1641a0 0x7f047c0c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7fde7f59e700 1 -- 172.21.15.49:0/743952633 shutdown_connections 2023-07-21T22:11:05.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7fde7f59e700 1 --2- 172.21.15.49:0/743952633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde7803bfc0 0x7fde78057750 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7fde7f59e700 1 --2- 172.21.15.49:0/743952633 >> v2:172.21.15.150:3300/0 conn(0x7fde780384d0 0x7fde780553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7fde7f59e700 1 -- 172.21.15.49:0/743952633 >> 172.21.15.49:0/743952633 conn(0x7fde78059170 msgr2=0x7fde78059570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.829+0000 7f4ee2ffd700 1 -- 172.21.15.49:0/4222829352 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4ed40145e0 con 0x7f4ee406f470 2023-07-21T22:11:05.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f4ee2ffd700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4ed00662f0 0x7f4ed00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f4ee2ffd700 1 -- 172.21.15.49:0/4222829352 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4ed40848b0 con 0x7f4ee406f470 2023-07-21T22:11:05.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7fde7f59e700 1 -- 172.21.15.49:0/743952633 shutdown_connections 2023-07-21T22:11:05.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7fde7f59e700 1 -- 172.21.15.49:0/743952633 wait complete. 2023-07-21T22:11:05.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f4ee9a4c700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4ed00662f0 0x7f4ed00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f047bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047c1641a0 0x7f047c0c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f047affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f047c06fe80 0x7f047c0b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f047bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047c1641a0 0x7f047c0c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48174/0 (socket says 172.21.15.49:48174) 2023-07-21T22:11:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f047bfff700 1 -- 172.21.15.49:0/1164872954 learned_addr learned my addr 172.21.15.49:0/1164872954 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f0481289700 1 -- 172.21.15.49:0/1164872954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047c14fd70 con 0x7f047c1641a0 2023-07-21T22:11:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f0481289700 1 -- 172.21.15.49:0/1164872954 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047c0c8a20 con 0x7f047c06fe80 2023-07-21T22:11:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f0481289700 1 -- 172.21.15.49:0/1164872954 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c0c3cc0 con 0x7f047c070250 2023-07-21T22:11:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f04727fc700 1 --2- 172.21.15.49:0/1164872954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f047c070250 0x7f047c0c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f85c862c700 1 -- 172.21.15.49:0/2676768083 shutdown_connections 2023-07-21T22:11:05.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f85c862c700 1 --2- 172.21.15.49:0/2676768083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c00cee10 0x7f85c00cf290 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f85c862c700 1 --2- 172.21.15.49:0/2676768083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85c00b7af0 0x7f85c00b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f85c862c700 1 -- 172.21.15.49:0/2676768083 >> 172.21.15.49:0/2676768083 conn(0x7f85c006e960 msgr2=0x7f85c006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f047bfff700 1 -- 172.21.15.49:0/1164872954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f047c070250 msgr2=0x7f047c0c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f047bfff700 1 --2- 172.21.15.49:0/1164872954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f047c070250 0x7f047c0c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f047bfff700 1 -- 172.21.15.49:0/1164872954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f047c06fe80 msgr2=0x7f047c0b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f047bfff700 1 --2- 172.21.15.49:0/1164872954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f047c06fe80 0x7f047c0b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f047bfff700 1 -- 172.21.15.49:0/1164872954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0474009a70 con 0x7f047c1641a0 2023-07-21T22:11:05.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f85c862c700 1 -- 172.21.15.49:0/2676768083 shutdown_connections 2023-07-21T22:11:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f12e37fe700 1 -- 172.21.15.49:0/874347451 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec013680 con 0x7f12fc0d2240 2023-07-21T22:11:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f130103e700 1 -- 172.21.15.49:0/874347451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f0009570 con 0x7f12fc0d2240 2023-07-21T22:11:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f047bfff700 1 --2- 172.21.15.49:0/1164872954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047c1641a0 0x7f047c0c3780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0474004570 tx=0x7f0474004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f29b0daf700 1 Processor -- start 2023-07-21T22:11:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f130103e700 1 -- 172.21.15.49:0/874347451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12fc0b34a0 con 0x7f12fc0d2240 2023-07-21T22:11:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f4ee2ffd700 1 -- 172.21.15.49:0/4222829352 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4ed4051a30 con 0x7f4ee406f470 2023-07-21T22:11:05.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f4ee9a4c700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4ed00662f0 0x7f4ed00687a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40c8ad0 tx=0x7f4ed8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f85c862c700 1 -- 172.21.15.49:0/2676768083 wait complete. 2023-07-21T22:11:05.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7fde7f59e700 1 Processor -- start 2023-07-21T22:11:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.833+0000 7f29b0daf700 1 -- start start 2023-07-21T22:11:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7f59e700 1 -- start start 2023-07-21T22:11:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7f12e37fe700 1 -- 172.21.15.49:0/874347451 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec005a40 con 0x7f12fc0d2240 2023-07-21T22:11:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7f12e37fe700 1 -- 172.21.15.49:0/874347451 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec005db0 con 0x7f12fc0d2240 2023-07-21T22:11:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7f29b0daf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f29a4050760 0x7f29a4036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7f29b0daf700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a4052bf0 con 0x7f29a4036cb0 2023-07-21T22:11:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7f29b0daf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a40528c0 con 0x7f29a40dd280 2023-07-21T22:11:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7f29b0daf700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a40dd650 con 0x7f29a4050760 2023-07-21T22:11:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde7800e900 0x7fde78052f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7f85c862c700 1 Processor -- start 2023-07-21T22:11:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fd5845e0700 1 Processor -- start 2023-07-21T22:11:05.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fd5845e0700 1 -- start start 2023-07-21T22:11:05.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde780384d0 0x7fde7803e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7f59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde7803bfc0 0x7fde7803e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7f59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde780e5d30 con 0x7fde780384d0 2023-07-21T22:11:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7e59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde7800e900 0x7fde78052f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7f59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde780e5120 con 0x7fde7803bfc0 2023-07-21T22:11:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde780e5400 con 0x7fde7800e900 2023-07-21T22:11:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7e59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde7800e900 0x7fde78052f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:37294/0 (socket says 172.21.15.49:37294) 2023-07-21T22:11:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7e59c700 1 -- 172.21.15.49:0/3102249868 learned_addr learned my addr 172.21.15.49:0/3102249868 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7ed9d700 1 --2- 172.21.15.49:0/3102249868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde7803bfc0 0x7fde7803e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7f29ab7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f29a40dd280 0x7f29a40dfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:58840/0 (socket says 172.21.15.49:58840) 2023-07-21T22:11:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7f29ab7fe700 1 -- 172.21.15.49:0/4265437765 learned_addr learned my addr 172.21.15.49:0/4265437765 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7ed9d700 1 -- 172.21.15.49:0/3102249868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde7800e900 msgr2=0x7fde78052f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7ed9d700 1 --2- 172.21.15.49:0/3102249868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde7800e900 0x7fde78052f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7ed9d700 1 -- 172.21.15.49:0/3102249868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde780384d0 msgr2=0x7fde7803e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7ed9d700 1 --2- 172.21.15.49:0/3102249868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde780384d0 0x7fde7803e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fde7ed9d700 1 -- 172.21.15.49:0/3102249868 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde74009570 con 0x7fde7803bfc0 2023-07-21T22:11:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7ff52f986700 1 Processor -- start 2023-07-21T22:11:05.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7f85c862c700 1 -- start start 2023-07-21T22:11:05.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fd5845e0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd574004d40 0x7fd5740e2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fd5845e0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd57404f830 0x7fd5740de730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fd5845e0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5740e2410 con 0x7fd574036c60 2023-07-21T22:11:05.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f85c862c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85c00b7af0 0x7f85c00cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fd5845e0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5740518f0 con 0x7fd574004d40 2023-07-21T22:11:05.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7fd5845e0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5740e2660 con 0x7fd57404f830 2023-07-21T22:11:05.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f85c862c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85c00cee10 0x7f85c00b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58337e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd574036c60 0x7fd5740065b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:58842/0 (socket says 172.21.15.49:58842) 2023-07-21T22:11:05.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58337e700 1 -- 172.21.15.49:0/2271551355 learned_addr learned my addr 172.21.15.49:0/2271551355 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:05.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.837+0000 7f130103e700 1 -- 172.21.15.49:0/874347451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12dc005310 con 0x7f12fc0d2240 2023-07-21T22:11:05.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fde7ed9d700 1 --2- 172.21.15.49:0/3102249868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde7803bfc0 0x7fde7803e670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fde8004f580 tx=0x7fde80070f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f0473fff700 1 -- 172.21.15.49:0/1164872954 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0474004990 con 0x7f047c1641a0 2023-07-21T22:11:05.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f0473fff700 1 -- 172.21.15.49:0/1164872954 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0474012630 con 0x7f047c1641a0 2023-07-21T22:11:05.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f0473fff700 1 -- 172.21.15.49:0/1164872954 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04740129c0 con 0x7f047c1641a0 2023-07-21T22:11:05.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f0481289700 1 -- 172.21.15.49:0/1164872954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047c0c94b0 con 0x7f047c1641a0 2023-07-21T22:11:05.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f0481289700 1 -- 172.21.15.49:0/1164872954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047c0c8ef0 con 0x7f047c1641a0 2023-07-21T22:11:05.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fde6effd700 1 -- 172.21.15.49:0/3102249868 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8006e540 con 0x7fde7803bfc0 2023-07-21T22:11:05.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fde6effd700 1 -- 172.21.15.49:0/3102249868 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde80066d40 con 0x7fde7803bfc0 2023-07-21T22:11:05.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fde6effd700 1 -- 172.21.15.49:0/3102249868 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8006eba0 con 0x7fde7803bfc0 2023-07-21T22:11:05.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7ff52f986700 1 -- start start 2023-07-21T22:11:05.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 -- 172.21.15.49:0/2271551355 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046295995 0 0) 0x7fd5740e2410 con 0x7fd574036c60 2023-07-21T22:11:05.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 -- 172.21.15.49:0/2271551355 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5680035d0 con 0x7fd574036c60 2023-07-21T22:11:05.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4265437765 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460582006 0 0) 0x7f29a40528c0 con 0x7f29a40dd280 2023-07-21T22:11:05.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4265437765 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f299c0035d0 con 0x7f29a40dd280 2023-07-21T22:11:05.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4265437765 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1900186735 0 0) 0x7f299c0035d0 con 0x7f29a40dd280 2023-07-21T22:11:05.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4265437765 >> v2:172.21.15.49:3300/0 conn(0x7f29a4050760 msgr2=0x7f29a4036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 --2- 172.21.15.49:0/4265437765 >> v2:172.21.15.49:3300/0 conn(0x7f29a4050760 0x7f29a4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4265437765 >> v1:172.21.15.49:6789/0 conn(0x7f29a4036cb0 legacy=0x7f29a4053080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4265437765 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a40e0430 con 0x7f29a40dd280 2023-07-21T22:11:05.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4265437765 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f29a0001670 con 0x7f29a40dd280 2023-07-21T22:11:05.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4265437765 >> v1:172.21.15.150:6789/0 conn(0x7f29a40dd280 legacy=0x7f29a40dfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 --2- 172.21.15.49:0/4265437765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f299c003a20 0x7f299c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 --2- 172.21.15.49:0/4265437765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c004870 0x7f299c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 --2- 172.21.15.49:0/4265437765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c005220 0x7f299c014630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4265437765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a40dd650 con 0x7f299c005220 2023-07-21T22:11:05.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4265437765 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c014b70 con 0x7f299c004870 2023-07-21T22:11:05.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4265437765 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c014cb0 con 0x7f299c003a20 2023-07-21T22:11:05.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fde7f59e700 1 -- 172.21.15.49:0/3102249868 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde780e56e0 con 0x7fde7803bfc0 2023-07-21T22:11:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 -- 172.21.15.49:0/2271551355 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3389371422 0 0) 0x7fd5680035d0 con 0x7fd574036c60 2023-07-21T22:11:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 -- 172.21.15.49:0/2271551355 >> v2:172.21.15.150:3300/0 conn(0x7fd57404f830 msgr2=0x7fd5740de730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 --2- 172.21.15.49:0/2271551355 >> v2:172.21.15.150:3300/0 conn(0x7fd57404f830 0x7fd5740de730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 -- 172.21.15.49:0/2271551355 >> v2:172.21.15.49:3300/0 conn(0x7fd574004d40 msgr2=0x7fd5740e2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 --2- 172.21.15.49:0/2271551355 >> v2:172.21.15.49:3300/0 conn(0x7fd574004d40 0x7fd5740e2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 -- 172.21.15.49:0/2271551355 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5740e2940 con 0x7fd574036c60 2023-07-21T22:11:05.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 -- 172.21.15.49:0/2271551355 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7fd56c001670 con 0x7fd574036c60 2023-07-21T22:11:05.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 -- 172.21.15.49:0/2271551355 >> v1:172.21.15.150:6789/0 conn(0x7fd574036c60 legacy=0x7fd5740065b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 --2- 172.21.15.49:0/2271551355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd568003a20 0x7fd568003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 --2- 172.21.15.49:0/2271551355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd568004870 0x7fd568004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 --2- 172.21.15.49:0/2271551355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5680052f0 0x7fd56800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 -- 172.21.15.49:0/2271551355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740518f0 con 0x7fd568003a20 2023-07-21T22:11:05.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 -- 172.21.15.49:0/2271551355 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740e2660 con 0x7fd568004870 2023-07-21T22:11:05.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fd58137a700 1 -- 172.21.15.49:0/2271551355 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56800c2a0 con 0x7fd5680052f0 2023-07-21T22:11:05.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f12e37fe700 1 -- 172.21.15.49:0/874347451 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12ec0137e0 con 0x7f12fc0d2240 2023-07-21T22:11:05.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f12e37fe700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f12e80662f0 0x7f12e80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f12e37fe700 1 -- 172.21.15.49:0/874347451 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f12ec083cf0 con 0x7f12fc0d2240 2023-07-21T22:11:05.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f12fad9d700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f12e80662f0 0x7f12e80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7fde7f59e700 1 -- 172.21.15.49:0/3102249868 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7804db30 con 0x7fde7803bfc0 2023-07-21T22:11:05.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29aaffd700 1 --2- 172.21.15.49:0/4265437765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c004870 0x7f299c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f29abfff700 1 --2- 172.21.15.49:0/4265437765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c005220 0x7f299c014630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7ff52f986700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff5200e6d40 0x7ff520054af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7ff52f986700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff520007750 0x7ff5200eb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f85c862c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c00d1e40 0x7f85c006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f85c862c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00c6430 con 0x7f85c00cee10 2023-07-21T22:11:05.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f85c862c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00c6710 con 0x7f85c00d1e40 2023-07-21T22:11:05.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f85c862c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00c69f0 con 0x7f85c00b7af0 2023-07-21T22:11:05.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f85c63c8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85c00b7af0 0x7f85c00cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f85c63c8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85c00b7af0 0x7f85c00cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:37300/0 (socket says 172.21.15.49:37300) 2023-07-21T22:11:05.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f85c63c8700 1 -- 172.21.15.49:0/1278580303 learned_addr learned my addr 172.21.15.49:0/1278580303 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f85c5bc7700 1 --2- 172.21.15.49:0/1278580303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85c00cee10 0x7f85c00b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.841+0000 7f0481289700 1 -- 172.21.15.49:0/1164872954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0460005310 con 0x7f047c1641a0 2023-07-21T22:11:05.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7ff52f986700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5200ea8b0 con 0x7ff52003aae0 2023-07-21T22:11:05.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7ff52f986700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5200e7110 con 0x7ff520007750 2023-07-21T22:11:05.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7ff52f986700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5200551b0 con 0x7ff5200e6d40 2023-07-21T22:11:05.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29aaffd700 1 -- 172.21.15.49:0/4265437765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f299c003a20 msgr2=0x7f299c003e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:11:05.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29aaffd700 1 --2- 172.21.15.49:0/4265437765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f299c003a20 0x7f299c003e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29aaffd700 1 -- 172.21.15.49:0/4265437765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c005220 msgr2=0x7f299c014630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29aaffd700 1 --2- 172.21.15.49:0/4265437765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c005220 0x7f299c014630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29aaffd700 1 -- 172.21.15.49:0/4265437765 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a40e0430 con 0x7f299c004870 2023-07-21T22:11:05.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29abfff700 1 -- 172.21.15.49:0/4265437765 reap_dead start 2023-07-21T22:11:05.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fd581b7b700 1 --2- 172.21.15.49:0/2271551355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd568004870 0x7fd568004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f12fad9d700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f12e80662f0 0x7f12e80687a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0ceac0 tx=0x7f12f001d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7ff52cf21700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff520007750 0x7ff5200eb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7ff52cf21700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff520007750 0x7ff5200eb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48234/0 (socket says 172.21.15.49:48234) 2023-07-21T22:11:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7ff52cf21700 1 -- 172.21.15.49:0/238101960 learned_addr learned my addr 172.21.15.49:0/238101960 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29aaffd700 1 --2- 172.21.15.49:0/4265437765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c004870 0x7f299c004ce0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2998009930 tx=0x7f299c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edd4e1d6af1dd198 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fde6cff9700 1 -- 172.21.15.49:0/3102249868 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde780e5ea0 con 0x7fde7803bfc0 2023-07-21T22:11:05.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fd58337e700 1 --2- 172.21.15.49:0/2271551355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5680052f0 0x7fd56800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4265437765 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29980093a0 con 0x7f299c004870 2023-07-21T22:11:05.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f85c6bc9700 1 --2- 172.21.15.49:0/1278580303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c00d1e40 0x7f85c006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f85c63c8700 1 -- 172.21.15.49:0/1278580303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c00d1e40 msgr2=0x7f85c006cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f85c63c8700 1 --2- 172.21.15.49:0/1278580303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c00d1e40 0x7f85c006cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f85c63c8700 1 -- 172.21.15.49:0/1278580303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85c00cee10 msgr2=0x7f85c00b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f85c63c8700 1 --2- 172.21.15.49:0/1278580303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85c00cee10 0x7f85c00b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f85c63c8700 1 -- 172.21.15.49:0/1278580303 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b8009b30 con 0x7f85c00b7af0 2023-07-21T22:11:05.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7ff52cf21700 1 -- 172.21.15.49:0/238101960 >> v2:172.21.15.150:3300/0 conn(0x7ff5200e6d40 msgr2=0x7ff520054af0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:11:05.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7ff52cf21700 1 --2- 172.21.15.49:0/238101960 >> v2:172.21.15.150:3300/0 conn(0x7ff5200e6d40 0x7ff520054af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7ff52cf21700 1 -- 172.21.15.49:0/238101960 >> v1:172.21.15.150:6789/0 conn(0x7ff52003aae0 legacy=0x7ff52003aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7ff52cf21700 1 -- 172.21.15.49:0/238101960 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff520055490 con 0x7ff520007750 2023-07-21T22:11:05.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fd581b7b700 1 -- 172.21.15.49:0/2271551355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5680052f0 msgr2=0x7fd56800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fd581b7b700 1 --2- 172.21.15.49:0/2271551355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5680052f0 0x7fd56800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fd581b7b700 1 -- 172.21.15.49:0/2271551355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd568003a20 msgr2=0x7fd568003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:05.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fd581b7b700 1 --2- 172.21.15.49:0/2271551355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd568003a20 0x7fd568003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fd581b7b700 1 -- 172.21.15.49:0/2271551355 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5740e2940 con 0x7fd568004870 2023-07-21T22:11:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fd58337e700 1 -- 172.21.15.49:0/2271551355 reap_dead start 2023-07-21T22:11:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4265437765 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2998004250 con 0x7f299c004870 2023-07-21T22:11:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4265437765 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29980036a0 con 0x7f299c004870 2023-07-21T22:11:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f85c63c8700 1 --2- 172.21.15.49:0/1278580303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85c00b7af0 0x7f85c00cbec0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85b000e760 tx=0x7f85b000ea70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fd581b7b700 1 --2- 172.21.15.49:0/2271551355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd568004870 0x7fd568004ce0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd57c04f580 tx=0x7fd5680058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=487ff7d6f0d1fa1d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29b0daf700 1 -- 172.21.15.49:0/4265437765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c004870 msgr2=0x7f299c004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29b0daf700 1 --2- 172.21.15.49:0/4265437765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c004870 0x7f299c004ce0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2998009930 tx=0x7f299c0058a0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f85b6ffd700 1 -- 172.21.15.49:0/1278580303 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0013610 con 0x7f85c00b7af0 2023-07-21T22:11:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7ff52cf21700 1 --2- 172.21.15.49:0/238101960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff520007750 0x7ff5200eb040 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff52004cb20 tx=0x7ff518009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99039a2912f1bef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29b0daf700 1 -- 172.21.15.49:0/4265437765 shutdown_connections 2023-07-21T22:11:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f85b6ffd700 1 -- 172.21.15.49:0/1278580303 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b0013770 con 0x7f85c00b7af0 2023-07-21T22:11:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f85b6ffd700 1 -- 172.21.15.49:0/1278580303 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0013ae0 con 0x7f85c00b7af0 2023-07-21T22:11:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29b0daf700 1 --2- 172.21.15.49:0/4265437765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c004870 0x7f299c004ce0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29b0daf700 1 -- 172.21.15.49:0/4265437765 >> 172.21.15.49:0/4265437765 conn(0x7f29a4051770 msgr2=0x7f29a4051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f85c862c700 1 -- 172.21.15.49:0/1278580303 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c00c6cd0 con 0x7f85c00b7af0 2023-07-21T22:11:05.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fd58137a700 1 -- 172.21.15.49:0/2271551355 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0739b0 con 0x7fd568004870 2023-07-21T22:11:05.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fd58137a700 1 -- 172.21.15.49:0/2271551355 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c073b30 con 0x7fd568004870 2023-07-21T22:11:05.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fd58137a700 1 -- 172.21.15.49:0/2271551355 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c06e370 con 0x7fd568004870 2023-07-21T22:11:05.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29b0daf700 1 -- 172.21.15.49:0/4265437765 shutdown_connections 2023-07-21T22:11:05.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f85c862c700 1 -- 172.21.15.49:0/1278580303 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c015a460 con 0x7f85c00b7af0 2023-07-21T22:11:05.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fd5845e0700 1 -- 172.21.15.49:0/2271551355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd568004870 msgr2=0x7fd568004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fd5845e0700 1 --2- 172.21.15.49:0/2271551355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd568004870 0x7fd568004ce0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd57c04f580 tx=0x7fd5680058a0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7fde6effd700 1 -- 172.21.15.49:0/3102249868 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde8006ed00 con 0x7fde7803bfc0 2023-07-21T22:11:05.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.845+0000 7f29b0daf700 1 -- 172.21.15.49:0/4265437765 wait complete. 2023-07-21T22:11:05.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7fd5845e0700 1 -- 172.21.15.49:0/2271551355 shutdown_connections 2023-07-21T22:11:05.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7fd5845e0700 1 --2- 172.21.15.49:0/2271551355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd568004870 0x7fd568004ce0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7fd5845e0700 1 -- 172.21.15.49:0/2271551355 >> 172.21.15.49:0/2271551355 conn(0x7fd574051c60 msgr2=0x7fd574052060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7fd5845e0700 1 -- 172.21.15.49:0/2271551355 shutdown_connections 2023-07-21T22:11:05.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7f85c862c700 1 -- 172.21.15.49:0/1278580303 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c00c71f0 con 0x7f85c00b7af0 2023-07-21T22:11:05.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7fde6effd700 1 --2- 172.21.15.49:0/3102249868 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fde600663f0 0x7fde600688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7fde6effd700 1 -- 172.21.15.49:0/3102249868 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fde800fb8a0 con 0x7fde7803bfc0 2023-07-21T22:11:05.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7fde7e59c700 1 --2- 172.21.15.49:0/3102249868 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fde600663f0 0x7fde600688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7fd5845e0700 1 -- 172.21.15.49:0/2271551355 wait complete. 2023-07-21T22:11:05.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7f29b0daf700 1 Processor -- start 2023-07-21T22:11:05.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7f12e37fe700 1 -- 172.21.15.49:0/874347451 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12ec050e00 con 0x7f12fc0d2240 2023-07-21T22:11:05.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7fde7e59c700 1 --2- 172.21.15.49:0/3102249868 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fde600663f0 0x7fde600688a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fde70009a10 tx=0x7fde70008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7ff51ffff700 1 -- 172.21.15.49:0/238101960 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518011830 con 0x7ff520007750 2023-07-21T22:11:05.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7ff51ffff700 1 -- 172.21.15.49:0/238101960 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff518011990 con 0x7ff520007750 2023-07-21T22:11:05.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7ff51ffff700 1 -- 172.21.15.49:0/238101960 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518011d20 con 0x7ff520007750 2023-07-21T22:11:05.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7f29b0daf700 1 -- start start 2023-07-21T22:11:05.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7f29b0daf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f299c004870 0x7f29a40d9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7fd5845e0700 1 Processor -- start 2023-07-21T22:11:05.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7f85b6ffd700 1 -- 172.21.15.49:0/1278580303 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85b0013c40 con 0x7f85c00b7af0 2023-07-21T22:11:05.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.849+0000 7f29b0daf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29a4039b90 0x7f29a40cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7ff52f986700 1 -- 172.21.15.49:0/238101960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff520007750 msgr2=0x7ff5200eb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7ff52f986700 1 --2- 172.21.15.49:0/238101960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff520007750 0x7ff5200eb040 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff52004cb20 tx=0x7ff518009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f29ab7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f299c004870 0x7f29a40d9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f29ab7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f299c004870 0x7f29a40d9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:37316/0 (socket says 172.21.15.49:37316) 2023-07-21T22:11:05.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7ff52f986700 1 -- 172.21.15.49:0/238101960 shutdown_connections 2023-07-21T22:11:05.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7ff52f986700 1 --2- 172.21.15.49:0/238101960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff520007750 0x7ff5200eb040 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7ff52f986700 1 --2- 172.21.15.49:0/238101960 >> v2:172.21.15.150:3300/0 conn(0x7ff5200e6d40 0x7ff520054af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7ff52f986700 1 -- 172.21.15.49:0/238101960 >> 172.21.15.49:0/238101960 conn(0x7ff520059060 msgr2=0x7ff520059460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:05.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f29ab7fe700 1 -- 172.21.15.49:0/3609586825 learned_addr learned my addr 172.21.15.49:0/3609586825 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f29b0daf700 1 --2- 172.21.15.49:0/3609586825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29a40d7f40 0x7f29a40d83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f85b6ffd700 1 --2- 172.21.15.49:0/1278580303 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f85a40663c0 0x7f85a4068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f29b0daf700 1 -- 172.21.15.49:0/3609586825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a40cf900 con 0x7f29a4039b90 2023-07-21T22:11:05.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f85b6ffd700 1 -- 172.21.15.49:0/1278580303 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f85b0083fa0 con 0x7f85c00b7af0 2023-07-21T22:11:05.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f29abfff700 1 --2- 172.21.15.49:0/3609586825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29a40d7f40 0x7f29a40d83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f29b0daf700 1 -- 172.21.15.49:0/3609586825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a403a370 con 0x7f29a40d7f40 2023-07-21T22:11:05.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f29b0daf700 1 -- 172.21.15.49:0/3609586825 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a403a650 con 0x7f299c004870 2023-07-21T22:11:05.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f85c5bc7700 1 --2- 172.21.15.49:0/1278580303 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f85a40663c0 0x7f85a4068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f0473fff700 1 -- 172.21.15.49:0/1164872954 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0474012b20 con 0x7f047c1641a0 2023-07-21T22:11:05.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f0473fff700 1 --2- 172.21.15.49:0/1164872954 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f045c066370 0x7f045c068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f0473fff700 1 -- 172.21.15.49:0/1164872954 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f04740861b0 con 0x7f047c1641a0 2023-07-21T22:11:05.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f047affd700 1 --2- 172.21.15.49:0/1164872954 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f045c066370 0x7f045c068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f29abfff700 1 -- 172.21.15.49:0/3609586825 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f299c004870 msgr2=0x7f29a40d9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f29abfff700 1 --2- 172.21.15.49:0/3609586825 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f299c004870 0x7f29a40d9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f29abfff700 1 -- 172.21.15.49:0/3609586825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29a4039b90 msgr2=0x7f29a40cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f29abfff700 1 --2- 172.21.15.49:0/3609586825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29a4039b90 0x7f29a40cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f29abfff700 1 -- 172.21.15.49:0/3609586825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a403a930 con 0x7f29a40d7f40 2023-07-21T22:11:05.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f29abfff700 1 --2- 172.21.15.49:0/3609586825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29a40d7f40 0x7f29a40d83b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29ac04eef0 tx=0x7f29ac073a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7ff52f986700 1 -- 172.21.15.49:0/238101960 shutdown_connections 2023-07-21T22:11:05.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f85c5bc7700 1 --2- 172.21.15.49:0/1278580303 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f85a40663c0 0x7f85a4068870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85c00c5850 tx=0x7f85bc0090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7f047affd700 1 --2- 172.21.15.49:0/1164872954 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f045c066370 0x7f045c068820 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f046c009ae0 tx=0x7f046c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7ff52f986700 1 -- 172.21.15.49:0/238101960 wait complete. 2023-07-21T22:11:05.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7fd5845e0700 1 -- start start 2023-07-21T22:11:05.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7fd5845e0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd568004870 0x7fd57403a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7fd5845e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd57404b3d0 0x7fd5740de500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7fd5845e0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5740dea40 0x7fd5740f1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7fd5845e0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd574039c10 con 0x7fd568004870 2023-07-21T22:11:05.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7fd5845e0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740f3080 con 0x7fd5740dea40 2023-07-21T22:11:05.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.853+0000 7fd5845e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740f3360 con 0x7fd57404b3d0 2023-07-21T22:11:05.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd58237c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd568004870 0x7fd57403a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd58237c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd568004870 0x7fd57403a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48256/0 (socket says 172.21.15.49:48256) 2023-07-21T22:11:05.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd58237c700 1 -- 172.21.15.49:0/4174079791 learned_addr learned my addr 172.21.15.49:0/4174079791 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7f2997fff700 1 -- 172.21.15.49:0/3609586825 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac066a20 con 0x7f29a40d7f40 2023-07-21T22:11:05.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd581b7b700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd57404b3d0 0x7fd5740de500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fde6effd700 1 -- 172.21.15.49:0/3102249868 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde800c8a10 con 0x7fde7803bfc0 2023-07-21T22:11:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd58337e700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5740dea40 0x7fd5740f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7f29b0daf700 1 -- 172.21.15.49:0/3609586825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a40d7740 con 0x7f29a40d7f40 2023-07-21T22:11:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd581b7b700 1 -- 172.21.15.49:0/4174079791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5740dea40 msgr2=0x7fd5740f1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd581b7b700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5740dea40 0x7fd5740f1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd581b7b700 1 -- 172.21.15.49:0/4174079791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd568004870 msgr2=0x7fd57403a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd581b7b700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd568004870 0x7fd57403a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd581b7b700 1 -- 172.21.15.49:0/4174079791 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd574039eb0 con 0x7fd57404b3d0 2023-07-21T22:11:05.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd58237c700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd568004870 0x7fd57403a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:05.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7f29b0daf700 1 -- 172.21.15.49:0/3609586825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a403a000 con 0x7f29a40d7f40 2023-07-21T22:11:05.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd581b7b700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd57404b3d0 0x7fd5740de500 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd57c02c910 tx=0x7fd57c0696b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7f2997fff700 1 -- 172.21.15.49:0/3609586825 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac066b80 con 0x7f29a40d7f40 2023-07-21T22:11:05.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7ff52f986700 1 Processor -- start 2023-07-21T22:11:05.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7f0473fff700 1 -- 172.21.15.49:0/1164872954 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0474053440 con 0x7f047c1641a0 2023-07-21T22:11:05.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd572ffd700 1 -- 172.21.15.49:0/4174079791 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c069aa0 con 0x7fd57404b3d0 2023-07-21T22:11:05.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd572ffd700 1 -- 172.21.15.49:0/4174079791 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c069c00 con 0x7fd57404b3d0 2023-07-21T22:11:05.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd572ffd700 1 -- 172.21.15.49:0/4174079791 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c072d10 con 0x7fd57404b3d0 2023-07-21T22:11:05.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7f85b6ffd700 1 -- 172.21.15.49:0/1278580303 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85b0054ba0 con 0x7f85c00b7af0 2023-07-21T22:11:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7ff52f986700 1 -- start start 2023-07-21T22:11:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd5845e0700 1 -- 172.21.15.49:0/4174079791 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5740f2410 con 0x7fd57404b3d0 2023-07-21T22:11:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7fd5845e0700 1 -- 172.21.15.49:0/4174079791 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57404b840 con 0x7fd57404b3d0 2023-07-21T22:11:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.857+0000 7f2997fff700 1 -- 172.21.15.49:0/3609586825 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac0698a0 con 0x7f29a40d7f40 2023-07-21T22:11:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52f986700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff520007750 0x7ff52017d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52f986700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff52003aae0 0x7ff52003e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52f986700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5200e6d40 0x7ff5200558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52f986700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5200df9f0 con 0x7ff520007750 2023-07-21T22:11:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52f986700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52017d540 con 0x7ff52003aae0 2023-07-21T22:11:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52f986700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5200dede0 con 0x7ff5200e6d40 2023-07-21T22:11:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7f2995ffb700 1 -- 172.21.15.49:0/3609586825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a40556c0 con 0x7f29a40d7f40 2023-07-21T22:11:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52cf21700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff52003aae0 0x7ff52003e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52cf21700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff52003aae0 0x7ff52003e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:39950/0 (socket says 172.21.15.49:39950) 2023-07-21T22:11:05.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52cf21700 1 -- 172.21.15.49:0/1481459366 learned_addr learned my addr 172.21.15.49:0/1481459366 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:05.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7fd5845e0700 1 -- 172.21.15.49:0/4174079791 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd574005a20 con 0x7fd57404b3d0 2023-07-21T22:11:05.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52d722700 1 --2- 172.21.15.49:0/1481459366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff520007750 0x7ff52017d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52cf21700 1 -- 172.21.15.49:0/1481459366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5200e6d40 msgr2=0x7ff5200558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52cf21700 1 --2- 172.21.15.49:0/1481459366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5200e6d40 0x7ff5200558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52cf21700 1 -- 172.21.15.49:0/1481459366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff520007750 msgr2=0x7ff52017d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:05.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52cf21700 1 --2- 172.21.15.49:0/1481459366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff520007750 0x7ff52017d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:05.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52cf21700 1 -- 172.21.15.49:0/1481459366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff518009570 con 0x7ff52003aae0 2023-07-21T22:11:05.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7fd572ffd700 1 -- 172.21.15.49:0/4174079791 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd57c072e70 con 0x7fd57404b3d0 2023-07-21T22:11:05.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7ff52cf21700 1 --2- 172.21.15.49:0/1481459366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff52003aae0 0x7ff52003e570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff520011090 tx=0x7ff518004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7f2997fff700 1 -- 172.21.15.49:0/3609586825 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f29ac069a00 con 0x7f29a40d7f40 2023-07-21T22:11:05.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7fd572ffd700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd5600662f0 0x7fd5600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7fd572ffd700 1 -- 172.21.15.49:0/4174079791 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd57c0fd8f0 con 0x7fd57404b3d0 2023-07-21T22:11:05.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.865+0000 7ff51dffb700 1 -- 172.21.15.49:0/1481459366 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5180038c0 con 0x7ff52003aae0 2023-07-21T22:11:05.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.865+0000 7ff51dffb700 1 -- 172.21.15.49:0/1481459366 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff518003a20 con 0x7ff52003aae0 2023-07-21T22:11:05.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.865+0000 7ff51dffb700 1 -- 172.21.15.49:0/1481459366 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518003dd0 con 0x7ff52003aae0 2023-07-21T22:11:05.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.861+0000 7f2997fff700 1 --2- 172.21.15.49:0/3609586825 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29900663c0 0x7f2990068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.865+0000 7f2997fff700 1 -- 172.21.15.49:0/3609586825 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f29ac0fc7d0 con 0x7f29a40d7f40 2023-07-21T22:11:05.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.865+0000 7ff52f986700 1 -- 172.21.15.49:0/1481459366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5200df0c0 con 0x7ff52003aae0 2023-07-21T22:11:05.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.865+0000 7f29ab7fe700 1 --2- 172.21.15.49:0/3609586825 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29900663c0 0x7f2990068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.865+0000 7ff52f986700 1 -- 172.21.15.49:0/1481459366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5200df680 con 0x7ff52003aae0 2023-07-21T22:11:05.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.865+0000 7fd58237c700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd5600662f0 0x7fd5600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.865+0000 7ff52f986700 1 -- 172.21.15.49:0/1481459366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff520056970 con 0x7ff52003aae0 2023-07-21T22:11:05.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.865+0000 7fd572ffd700 1 -- 172.21.15.49:0/4174079791 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd57c0cab20 con 0x7fd57404b3d0 2023-07-21T22:11:05.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.865+0000 7fd58237c700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd5600662f0 0x7fd5600687a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd578009e10 tx=0x7fd578009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.865+0000 7f29ab7fe700 1 --2- 172.21.15.49:0/3609586825 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29900663c0 0x7f2990068870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f29a0001eb0 tx=0x7f29a0001660 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:05.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.869+0000 7f2997fff700 1 -- 172.21.15.49:0/3609586825 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29ac0c99d0 con 0x7f29a40d7f40 2023-07-21T22:11:05.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.869+0000 7ff51dffb700 1 -- 172.21.15.49:0/1481459366 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff518026450 con 0x7ff52003aae0 2023-07-21T22:11:05.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.873+0000 7ff51dffb700 1 --2- 172.21.15.49:0/1481459366 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff514066550 0x7ff514068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:05.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.873+0000 7ff51dffb700 1 -- 172.21.15.49:0/1481459366 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff518085ea0 con 0x7ff52003aae0 2023-07-21T22:11:05.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.873+0000 7ff52d722700 1 --2- 172.21.15.49:0/1481459366 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff514066550 0x7ff514068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:05.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.877+0000 7ff51dffb700 1 -- 172.21.15.49:0/1481459366 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5180530a0 con 0x7ff52003aae0 2023-07-21T22:11:05.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:05.877+0000 7ff52d722700 1 --2- 172.21.15.49:0/1481459366 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff514066550 0x7ff514068a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff524009980 tx=0x7ff5240090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.161+0000 7f4eec4b1700 1 -- 172.21.15.49:0/4222829352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4ec4005180 con 0x7f4ee406f470 2023-07-21T22:11:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.161+0000 7f4ee2ffd700 1 -- 172.21.15.49:0/4222829352 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ed4055050 con 0x7f4ee406f470 2023-07-21T22:11:06.206 INFO:teuthology.orchestra.run.smithi049.stdout:60129542155 2023-07-21T22:11:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.165+0000 7f4ee0ff9700 1 -- 172.21.15.49:0/4222829352 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4ed00662f0 msgr2=0x7f4ed00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.165+0000 7f4ee0ff9700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4ed00662f0 0x7f4ed00687a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40c8ad0 tx=0x7f4ed8008030 comp rx=0 tx=0).stop 2023-07-21T22:11:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.165+0000 7f4ee0ff9700 1 -- 172.21.15.49:0/4222829352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ee406f470 msgr2=0x7f4ee40c25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.165+0000 7f4ee0ff9700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ee406f470 0x7f4ee40c25b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400edb0 tx=0x7f4ed400c3a0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.165+0000 7f4ee0ff9700 1 -- 172.21.15.49:0/4222829352 shutdown_connections 2023-07-21T22:11:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.165+0000 7f4ee0ff9700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4ed00662f0 0x7f4ed00687a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.165+0000 7f4ee0ff9700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ee414d6f0 0x7f4ee40c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.165+0000 7f4ee0ff9700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee40c86c0 0x7f4ee414d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.165+0000 7f4ee0ff9700 1 --2- 172.21.15.49:0/4222829352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ee406f470 0x7f4ee40c25b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.165+0000 7f4ee0ff9700 1 -- 172.21.15.49:0/4222829352 >> 172.21.15.49:0/4222829352 conn(0x7f4ee406e960 msgr2=0x7f4ee415afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.165+0000 7f4ee0ff9700 1 -- 172.21.15.49:0/4222829352 shutdown_connections 2023-07-21T22:11:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.165+0000 7f4ee0ff9700 1 -- 172.21.15.49:0/4222829352 wait complete. 2023-07-21T22:11:06.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542155 for osd.1 2023-07-21T22:11:06.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.193+0000 7f130103e700 1 -- 172.21.15.49:0/874347451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f12dc0055c0 con 0x7f12fc0d2240 2023-07-21T22:11:06.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.197+0000 7f12e37fe700 1 -- 172.21.15.49:0/874347451 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12ec017090 con 0x7f12fc0d2240 2023-07-21T22:11:06.238 INFO:teuthology.orchestra.run.smithi049.stdout:64424509450 2023-07-21T22:11:06.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.197+0000 7f85c862c700 1 -- 172.21.15.49:0/1278580303 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f85c00c6b30 con 0x7f85c00b7af0 2023-07-21T22:11:06.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.197+0000 7fde6cff9700 1 -- 172.21.15.49:0/3102249868 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fde78005980 con 0x7fde7803bfc0 2023-07-21T22:11:06.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.197+0000 7f85b6ffd700 1 -- 172.21.15.49:0/1278580303 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f85c00c6b30 con 0x7f85c00b7af0 2023-07-21T22:11:06.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.197+0000 7fde6effd700 1 -- 172.21.15.49:0/3102249868 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde800cc030 con 0x7fde7803bfc0 2023-07-21T22:11:06.242 INFO:teuthology.orchestra.run.smithi049.stdout:64424509449 2023-07-21T22:11:06.242 INFO:teuthology.orchestra.run.smithi049.stdout:64424509449 2023-07-21T22:11:06.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.197+0000 7f0481289700 1 -- 172.21.15.49:0/1164872954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0460005890 con 0x7f047c1641a0 2023-07-21T22:11:06.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f130103e700 1 -- 172.21.15.49:0/874347451 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f12e80662f0 msgr2=0x7f12e80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f130103e700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f12e80662f0 0x7f12e80687a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0ceac0 tx=0x7f12f001d040 comp rx=0 tx=0).stop 2023-07-21T22:11:06.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f130103e700 1 -- 172.21.15.49:0/874347451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12fc0d2240 msgr2=0x7f12fc0b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f0473fff700 1 -- 172.21.15.49:0/1164872954 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0474056a60 con 0x7f047c1641a0 2023-07-21T22:11:06.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f130103e700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12fc0d2240 0x7f12fc0b45b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f12ec00e7c0 tx=0x7f12ec00ead0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.245 INFO:teuthology.orchestra.run.smithi049.stdout:64424509450 2023-07-21T22:11:06.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f85c862c700 1 -- 172.21.15.49:0/1278580303 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f85a40663c0 msgr2=0x7f85a4068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f85c862c700 1 --2- 172.21.15.49:0/1278580303 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f85a40663c0 0x7f85a4068870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85c00c5850 tx=0x7f85bc0090e0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f85c862c700 1 -- 172.21.15.49:0/1278580303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85c00b7af0 msgr2=0x7f85c00cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f85c862c700 1 --2- 172.21.15.49:0/1278580303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85c00b7af0 0x7f85c00cbec0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85b000e760 tx=0x7f85b000ea70 comp rx=0 tx=0).stop 2023-07-21T22:11:06.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f130103e700 1 -- 172.21.15.49:0/874347451 shutdown_connections 2023-07-21T22:11:06.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f130103e700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f12e80662f0 0x7f12e80687a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f130103e700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12fc0d2240 0x7f12fc0b45b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7fde6cff9700 1 -- 172.21.15.49:0/3102249868 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fde600663f0 msgr2=0x7fde600688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f130103e700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12fc15db00 0x7f12fc14f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7fde6cff9700 1 --2- 172.21.15.49:0/3102249868 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fde600663f0 0x7fde600688a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fde70009a10 tx=0x7fde70008040 comp rx=0 tx=0).stop 2023-07-21T22:11:06.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f130103e700 1 --2- 172.21.15.49:0/874347451 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12fc0d1530 0x7f12fc0c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f130103e700 1 -- 172.21.15.49:0/874347451 >> 172.21.15.49:0/874347451 conn(0x7f12fc06fe40 msgr2=0x7f12fc0d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:06.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f85c862c700 1 -- 172.21.15.49:0/1278580303 shutdown_connections 2023-07-21T22:11:06.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f85c862c700 1 --2- 172.21.15.49:0/1278580303 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f85a40663c0 0x7f85a4068870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f85c862c700 1 --2- 172.21.15.49:0/1278580303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85c00cee10 0x7f85c00b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f85c862c700 1 --2- 172.21.15.49:0/1278580303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c00d1e40 0x7f85c006cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f85c862c700 1 --2- 172.21.15.49:0/1278580303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85c00b7af0 0x7f85c00cbec0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f85c862c700 1 -- 172.21.15.49:0/1278580303 >> 172.21.15.49:0/1278580303 conn(0x7f85c006e960 msgr2=0x7f85c00b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:06.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f85c862c700 1 -- 172.21.15.49:0/1278580303 shutdown_connections 2023-07-21T22:11:06.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f130103e700 1 -- 172.21.15.49:0/874347451 shutdown_connections 2023-07-21T22:11:06.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7fde6cff9700 1 -- 172.21.15.49:0/3102249868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde7803bfc0 msgr2=0x7fde7803e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7fde6cff9700 1 --2- 172.21.15.49:0/3102249868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde7803bfc0 0x7fde7803e670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fde8004f580 tx=0x7fde80070f40 comp rx=0 tx=0).stop 2023-07-21T22:11:06.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f130103e700 1 -- 172.21.15.49:0/874347451 wait complete. 2023-07-21T22:11:06.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7f85c862c700 1 -- 172.21.15.49:0/1278580303 wait complete. 2023-07-21T22:11:06.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7fde6cff9700 1 -- 172.21.15.49:0/3102249868 shutdown_connections 2023-07-21T22:11:06.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7fde6cff9700 1 --2- 172.21.15.49:0/3102249868 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fde600663f0 0x7fde600688a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7fde6cff9700 1 --2- 172.21.15.49:0/3102249868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde780384d0 0x7fde7803e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7fde6cff9700 1 --2- 172.21.15.49:0/3102249868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde7803bfc0 0x7fde7803e670 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7fde6cff9700 1 --2- 172.21.15.49:0/3102249868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde7800e900 0x7fde78052f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.201+0000 7fde6cff9700 1 -- 172.21.15.49:0/3102249868 >> 172.21.15.49:0/3102249868 conn(0x7fde78059170 msgr2=0x7fde7803c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:06.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.205+0000 7fde6cff9700 1 -- 172.21.15.49:0/3102249868 shutdown_connections 2023-07-21T22:11:06.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.205+0000 7fde6cff9700 1 -- 172.21.15.49:0/3102249868 wait complete. 2023-07-21T22:11:06.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.205+0000 7f0481289700 1 -- 172.21.15.49:0/1164872954 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f045c066370 msgr2=0x7f045c068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.205+0000 7f0481289700 1 --2- 172.21.15.49:0/1164872954 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f045c066370 0x7f045c068820 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f046c009ae0 tx=0x7f046c008040 comp rx=0 tx=0).stop 2023-07-21T22:11:06.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.205+0000 7f0481289700 1 -- 172.21.15.49:0/1164872954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047c1641a0 msgr2=0x7f047c0c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.205+0000 7f0481289700 1 --2- 172.21.15.49:0/1164872954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047c1641a0 0x7f047c0c3780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0474004570 tx=0x7f0474004af0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.205+0000 7f0481289700 1 -- 172.21.15.49:0/1164872954 shutdown_connections 2023-07-21T22:11:06.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.205+0000 7f0481289700 1 --2- 172.21.15.49:0/1164872954 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f045c066370 0x7f045c068820 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.205+0000 7f0481289700 1 --2- 172.21.15.49:0/1164872954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047c1641a0 0x7f047c0c3780 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.205+0000 7f0481289700 1 --2- 172.21.15.49:0/1164872954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f047c070250 0x7f047c0c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.205+0000 7f0481289700 1 --2- 172.21.15.49:0/1164872954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f047c06fe80 0x7f047c0b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.205+0000 7f0481289700 1 -- 172.21.15.49:0/1164872954 >> 172.21.15.49:0/1164872954 conn(0x7f047c0cc430 msgr2=0x7f047c162f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:06.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.205+0000 7f0481289700 1 -- 172.21.15.49:0/1164872954 shutdown_connections 2023-07-21T22:11:06.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.205+0000 7f0481289700 1 -- 172.21.15.49:0/1164872954 wait complete. 2023-07-21T22:11:06.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.209+0000 7fd5845e0700 1 -- 172.21.15.49:0/4174079791 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd574007820 con 0x7fd57404b3d0 2023-07-21T22:11:06.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.209+0000 7fd572ffd700 1 -- 172.21.15.49:0/4174079791 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd57c0ce140 con 0x7fd57404b3d0 2023-07-21T22:11:06.257 INFO:teuthology.orchestra.run.smithi049.stdout:64424509451 2023-07-21T22:11:06.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.213+0000 7fd5845e0700 1 -- 172.21.15.49:0/4174079791 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd5600662f0 msgr2=0x7fd5600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.213+0000 7fd5845e0700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd5600662f0 0x7fd5600687a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd578009e10 tx=0x7fd578009210 comp rx=0 tx=0).stop 2023-07-21T22:11:06.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.213+0000 7fd5845e0700 1 -- 172.21.15.49:0/4174079791 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd57404b3d0 msgr2=0x7fd5740de500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.213+0000 7fd5845e0700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd57404b3d0 0x7fd5740de500 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd57c02c910 tx=0x7fd57c0696b0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.213+0000 7fd5845e0700 1 -- 172.21.15.49:0/4174079791 shutdown_connections 2023-07-21T22:11:06.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.213+0000 7fd5845e0700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd5600662f0 0x7fd5600687a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.213+0000 7fd5845e0700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5740dea40 0x7fd5740f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.213+0000 7fd5845e0700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd57404b3d0 0x7fd5740de500 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.213+0000 7fd5845e0700 1 --2- 172.21.15.49:0/4174079791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd568004870 0x7fd57403a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.213+0000 7fd5845e0700 1 -- 172.21.15.49:0/4174079791 >> 172.21.15.49:0/4174079791 conn(0x7fd574051c60 msgr2=0x7fd5740f6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:06.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.213+0000 7fd5845e0700 1 -- 172.21.15.49:0/4174079791 shutdown_connections 2023-07-21T22:11:06.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.213+0000 7fd5845e0700 1 -- 172.21.15.49:0/4174079791 wait complete. 2023-07-21T22:11:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.217+0000 7f2995ffb700 1 -- 172.21.15.49:0/3609586825 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f29a403a790 con 0x7f29a40d7f40 2023-07-21T22:11:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.217+0000 7ff52f986700 1 -- 172.21.15.49:0/1481459366 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff520056970 con 0x7ff52003aae0 2023-07-21T22:11:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.217+0000 7f2997fff700 1 -- 172.21.15.49:0/3609586825 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f29ac08f020 con 0x7f29a40d7f40 2023-07-21T22:11:06.261 INFO:teuthology.orchestra.run.smithi049.stdout:64424509452 2023-07-21T22:11:06.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.217+0000 7ff51dffb700 1 -- 172.21.15.49:0/1481459366 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff5180566c0 con 0x7ff52003aae0 2023-07-21T22:11:06.261 INFO:teuthology.orchestra.run.smithi049.stdout:64424509449 2023-07-21T22:11:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7f2995ffb700 1 -- 172.21.15.49:0/3609586825 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29900663c0 msgr2=0x7f2990068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7f2995ffb700 1 --2- 172.21.15.49:0/3609586825 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29900663c0 0x7f2990068870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f29a0001eb0 tx=0x7f29a0001660 comp rx=0 tx=0).stop 2023-07-21T22:11:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7f2995ffb700 1 -- 172.21.15.49:0/3609586825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29a40d7f40 msgr2=0x7f29a40d83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7f2995ffb700 1 --2- 172.21.15.49:0/3609586825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29a40d7f40 0x7f29a40d83b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29ac04eef0 tx=0x7f29ac073a90 comp rx=0 tx=0).stop 2023-07-21T22:11:06.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7f2995ffb700 1 -- 172.21.15.49:0/3609586825 shutdown_connections 2023-07-21T22:11:06.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7f2995ffb700 1 --2- 172.21.15.49:0/3609586825 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29900663c0 0x7f2990068870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7f2995ffb700 1 --2- 172.21.15.49:0/3609586825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29a4039b90 0x7f29a40cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7f2995ffb700 1 --2- 172.21.15.49:0/3609586825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29a40d7f40 0x7f29a40d83b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7f2995ffb700 1 --2- 172.21.15.49:0/3609586825 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f299c004870 0x7f29a40d9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7f2995ffb700 1 -- 172.21.15.49:0/3609586825 >> 172.21.15.49:0/3609586825 conn(0x7f29a4051770 msgr2=0x7f29a40e30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:06.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7f2995ffb700 1 -- 172.21.15.49:0/3609586825 shutdown_connections 2023-07-21T22:11:06.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7f2995ffb700 1 -- 172.21.15.49:0/3609586825 wait complete. 2023-07-21T22:11:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7ff52f986700 1 -- 172.21.15.49:0/1481459366 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff514066550 msgr2=0x7ff514068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7ff52f986700 1 --2- 172.21.15.49:0/1481459366 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff514066550 0x7ff514068a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff524009980 tx=0x7ff5240090e0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7ff52f986700 1 -- 172.21.15.49:0/1481459366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff52003aae0 msgr2=0x7ff52003e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7ff52f986700 1 --2- 172.21.15.49:0/1481459366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff52003aae0 0x7ff52003e570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff520011090 tx=0x7ff518004770 comp rx=0 tx=0).stop 2023-07-21T22:11:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7ff52f986700 1 -- 172.21.15.49:0/1481459366 shutdown_connections 2023-07-21T22:11:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7ff52f986700 1 --2- 172.21.15.49:0/1481459366 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff514066550 0x7ff514068a00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7ff52f986700 1 --2- 172.21.15.49:0/1481459366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5200e6d40 0x7ff5200558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7ff52f986700 1 --2- 172.21.15.49:0/1481459366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff52003aae0 0x7ff52003e570 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7ff52f986700 1 --2- 172.21.15.49:0/1481459366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff520007750 0x7ff52017d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7ff52f986700 1 -- 172.21.15.49:0/1481459366 >> 172.21.15.49:0/1481459366 conn(0x7ff520059060 msgr2=0x7ff5200e05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7ff52f986700 1 -- 172.21.15.49:0/1481459366 shutdown_connections 2023-07-21T22:11:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:06.221+0000 7ff52f986700 1 -- 172.21.15.49:0/1481459366 wait complete. 2023-07-21T22:11:06.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.3 2023-07-21T22:11:06.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.2 2023-07-21T22:11:06.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.0 2023-07-21T22:11:06.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.4 2023-07-21T22:11:06.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2023-07-21T22:11:06.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.5 2023-07-21T22:11:06.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.6 2023-07-21T22:11:07.236 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-21T22:11:07.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-21T22:11:07.277 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-21T22:11:07.277 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-21T22:11:07.278 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-21T22:11:07.286 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-21T22:11:07.286 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-21T22:11:07.290 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-21T22:11:07.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.417+0000 7fb43f2e4700 1 Processor -- start 2023-07-21T22:11:07.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.417+0000 7fb43f2e4700 1 -- start start 2023-07-21T22:11:07.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.421+0000 7fb43f2e4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4381601e0 0x7fb4380afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.421+0000 7fb43f2e4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb4380c9d10 0x7fb438163d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.421+0000 7fb43f2e4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb438164290 0x7fb4380c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.421+0000 7fb43f2e4700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4380cef10 con 0x7fb438164290 2023-07-21T22:11:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.421+0000 7fb43f2e4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb438164710 con 0x7fb4380c9d10 2023-07-21T22:11:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.421+0000 7fb43f2e4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380b0230 con 0x7fb4381601e0 2023-07-21T22:11:07.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.421+0000 7fb43dae1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb4380c9d10 0x7fb438163d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.421+0000 7fb43e2e2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4381601e0 0x7fb4380afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.421+0000 7fb43dae1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb4380c9d10 0x7fb438163d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:39962/0 (socket says 172.21.15.49:39962) 2023-07-21T22:11:07.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.421+0000 7fb43e2e2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4381601e0 0x7fb4380afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:37340/0 (socket says 172.21.15.49:37340) 2023-07-21T22:11:07.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.421+0000 7fb43dae1700 1 -- 172.21.15.49:0/91721790 learned_addr learned my addr 172.21.15.49:0/91721790 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:07.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43eae3700 1 --2- 172.21.15.49:0/91721790 >> v2:172.21.15.49:3300/0 conn(0x7fb438164290 0x7fb4380c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43dae1700 1 -- 172.21.15.49:0/91721790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4381601e0 msgr2=0x7fb4380afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:07.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43dae1700 1 --2- 172.21.15.49:0/91721790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4381601e0 0x7fb4380afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43dae1700 1 -- 172.21.15.49:0/91721790 >> v2:172.21.15.49:3300/0 conn(0x7fb438164290 msgr2=0x7fb4380c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:07.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43dae1700 1 --2- 172.21.15.49:0/91721790 >> v2:172.21.15.49:3300/0 conn(0x7fb438164290 0x7fb4380c0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43dae1700 1 -- 172.21.15.49:0/91721790 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4380cb120 con 0x7fb4380c9d10 2023-07-21T22:11:07.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43eae3700 1 --2- 172.21.15.49:0/91721790 >> v2:172.21.15.49:3300/0 conn(0x7fb438164290 0x7fb4380c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43dae1700 1 --2- 172.21.15.49:0/91721790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4380c9d10 0x7fb438163d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb4380cbbf0 tx=0x7fb434009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=365c72e5858561e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43d2e0700 1 -- 172.21.15.49:0/91721790 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434011830 con 0x7fb4380c9d10 2023-07-21T22:11:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43d2e0700 1 -- 172.21.15.49:0/91721790 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb434011990 con 0x7fb4380c9d10 2023-07-21T22:11:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43f2e4700 1 -- 172.21.15.49:0/91721790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4380c9d10 msgr2=0x7fb438163d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43f2e4700 1 --2- 172.21.15.49:0/91721790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4380c9d10 0x7fb438163d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb4380cbbf0 tx=0x7fb434009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43f2e4700 1 -- 172.21.15.49:0/91721790 shutdown_connections 2023-07-21T22:11:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43f2e4700 1 --2- 172.21.15.49:0/91721790 >> v2:172.21.15.49:3300/0 conn(0x7fb438164290 0x7fb4380c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43f2e4700 1 --2- 172.21.15.49:0/91721790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4380c9d10 0x7fb438163d50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43f2e4700 1 --2- 172.21.15.49:0/91721790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4381601e0 0x7fb4380afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.425+0000 7fb43f2e4700 1 -- 172.21.15.49:0/91721790 >> 172.21.15.49:0/91721790 conn(0x7fb43806e960 msgr2=0x7fb43806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.429+0000 7fb43f2e4700 1 -- 172.21.15.49:0/91721790 shutdown_connections 2023-07-21T22:11:07.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.429+0000 7fb43f2e4700 1 -- 172.21.15.49:0/91721790 wait complete. 2023-07-21T22:11:07.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.429+0000 7fb43f2e4700 1 Processor -- start 2023-07-21T22:11:07.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.429+0000 7fb43f2e4700 1 -- start start 2023-07-21T22:11:07.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.433+0000 7fb43f2e4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4381601e0 0x7fb4380b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.433+0000 7fb43f2e4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb438164290 0x7fb438151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.433+0000 7fb43e2e2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4381601e0 0x7fb4380b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.433+0000 7fb43e2e2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4381601e0 0x7fb4380b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48282/0 (socket says 172.21.15.49:48282) 2023-07-21T22:11:07.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.433+0000 7fb43e2e2700 1 -- 172.21.15.49:0/1948258512 learned_addr learned my addr 172.21.15.49:0/1948258512 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:07.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.433+0000 7fb43f2e4700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb43814f870 0x7fb438152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.433+0000 7fb43f2e4700 1 -- 172.21.15.49:0/1948258512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43814ad80 con 0x7fb4381601e0 2023-07-21T22:11:07.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.433+0000 7fb43dae1700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb438164290 0x7fb438151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.433+0000 7fb43f2e4700 1 -- 172.21.15.49:0/1948258512 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43814e580 con 0x7fb438164290 2023-07-21T22:11:07.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.433+0000 7fb43eae3700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb43814f870 0x7fb438152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.433+0000 7fb43f2e4700 1 -- 172.21.15.49:0/1948258512 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43814e7d0 con 0x7fb43814f870 2023-07-21T22:11:07.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.437+0000 7fb43dae1700 1 -- 172.21.15.49:0/1948258512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb43814f870 msgr2=0x7fb438152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.437+0000 7fb43dae1700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb43814f870 0x7fb438152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.437+0000 7fb43dae1700 1 -- 172.21.15.49:0/1948258512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4381601e0 msgr2=0x7fb4380b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.437+0000 7fb43dae1700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4381601e0 0x7fb4380b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.437+0000 7fb43dae1700 1 -- 172.21.15.49:0/1948258512 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb434009570 con 0x7fb438164290 2023-07-21T22:11:07.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.437+0000 7fb43dae1700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb438164290 0x7fb438151c30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb43806f830 tx=0x7fb434004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.437+0000 7fb42effd700 1 -- 172.21.15.49:0/1948258512 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43401ac40 con 0x7fb438164290 2023-07-21T22:11:07.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.437+0000 7fb43f2e4700 1 -- 172.21.15.49:0/1948258512 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43814eab0 con 0x7fb438164290 2023-07-21T22:11:07.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.437+0000 7fb43f2e4700 1 -- 172.21.15.49:0/1948258512 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43814f070 con 0x7fb438164290 2023-07-21T22:11:07.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.437+0000 7fb42effd700 1 -- 172.21.15.49:0/1948258512 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43401f070 con 0x7fb438164290 2023-07-21T22:11:07.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.437+0000 7fb42effd700 1 -- 172.21.15.49:0/1948258512 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434011d20 con 0x7fb438164290 2023-07-21T22:11:07.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.441+0000 7fb42effd700 1 -- 172.21.15.49:0/1948258512 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb434011930 con 0x7fb438164290 2023-07-21T22:11:07.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.441+0000 7fb42effd700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb41c0662f0 0x7fb41c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.441+0000 7fb42effd700 1 -- 172.21.15.49:0/1948258512 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb434085000 con 0x7fb438164290 2023-07-21T22:11:07.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.445+0000 7fb43f2e4700 1 -- 172.21.15.49:0/1948258512 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb420005310 con 0x7fb438164290 2023-07-21T22:11:07.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.445+0000 7fb43e2e2700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb41c0662f0 0x7fb41c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.445+0000 7fb43e2e2700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb41c0662f0 0x7fb41c0687a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb428009b80 tx=0x7fb4280091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.453+0000 7fb42effd700 1 -- 172.21.15.49:0/1948258512 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb434015020 con 0x7fb438164290 2023-07-21T22:11:07.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf46130700 1 Processor -- start 2023-07-21T22:11:07.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf46130700 1 -- start start 2023-07-21T22:11:07.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf46130700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faf380514c0 0x7faf380e4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf46130700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf38038980 0x7faf38038e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf46130700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf380e5260 con 0x7faf38036320 2023-07-21T22:11:07.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf46130700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf38039360 con 0x7faf380514c0 2023-07-21T22:11:07.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf46130700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3803a460 con 0x7faf38038980 2023-07-21T22:11:07.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf4492d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faf380514c0 0x7faf380e4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf4592f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf38038980 0x7faf38038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf4492d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faf380514c0 0x7faf380e4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:39988/0 (socket says 172.21.15.49:39988) 2023-07-21T22:11:07.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf4492d700 1 -- 172.21.15.49:0/381586257 learned_addr learned my addr 172.21.15.49:0/381586257 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:07.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf4492d700 1 -- 172.21.15.49:0/381586257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf38038980 msgr2=0x7faf38038e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:07.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf4492d700 1 --2- 172.21.15.49:0/381586257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf38038980 0x7faf38038e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf4492d700 1 -- 172.21.15.49:0/381586257 >> v1:172.21.15.150:6789/0 conn(0x7faf38036320 legacy=0x7faf38039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.461+0000 7faf4492d700 1 -- 172.21.15.49:0/381586257 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf38053500 con 0x7faf380514c0 2023-07-21T22:11:07.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7faf4492d700 1 --2- 172.21.15.49:0/381586257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf380514c0 0x7faf380e4d20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faf30009910 tx=0x7faf30009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba0ef583eff85032 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7f2a7cb30700 1 Processor -- start 2023-07-21T22:11:07.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7faf37fff700 1 -- 172.21.15.49:0/381586257 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011830 con 0x7faf380514c0 2023-07-21T22:11:07.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7faf37fff700 1 -- 172.21.15.49:0/381586257 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30011990 con 0x7faf380514c0 2023-07-21T22:11:07.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7faf37fff700 1 -- 172.21.15.49:0/381586257 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011d40 con 0x7faf380514c0 2023-07-21T22:11:07.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7faf46130700 1 -- 172.21.15.49:0/381586257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf380514c0 msgr2=0x7faf380e4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7faf46130700 1 --2- 172.21.15.49:0/381586257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf380514c0 0x7faf380e4d20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faf30009910 tx=0x7faf30009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:07.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7faf46130700 1 -- 172.21.15.49:0/381586257 shutdown_connections 2023-07-21T22:11:07.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7faf46130700 1 --2- 172.21.15.49:0/381586257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf38038980 0x7faf38038e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7faf46130700 1 --2- 172.21.15.49:0/381586257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf380514c0 0x7faf380e4d20 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faf30009910 tx=0x7faf30009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:07.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7faf46130700 1 -- 172.21.15.49:0/381586257 >> 172.21.15.49:0/381586257 conn(0x7faf38057b90 msgr2=0x7faf38053980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7faf46130700 1 -- 172.21.15.49:0/381586257 shutdown_connections 2023-07-21T22:11:07.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7faf46130700 1 -- 172.21.15.49:0/381586257 wait complete. 2023-07-21T22:11:07.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7f2a7cb30700 1 -- start start 2023-07-21T22:11:07.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7f2a7cb30700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2a700e6d30 0x7f2a700556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7f2a7cb30700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a700eabc0 con 0x7f2a70006350 2023-07-21T22:11:07.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7f2a7cb30700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a700587f0 con 0x7f2a70058280 2023-07-21T22:11:07.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7f2a7cb30700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a70059090 con 0x7f2a700e6d30 2023-07-21T22:11:07.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.465+0000 7f8a6f169700 1 Processor -- start 2023-07-21T22:11:07.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f2a777fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2a700e6d30 0x7f2a700556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f2a777fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2a700e6d30 0x7f2a700556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48294/0 (socket says 172.21.15.49:48294) 2023-07-21T22:11:07.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f2a777fe700 1 -- 172.21.15.49:0/25258088 learned_addr learned my addr 172.21.15.49:0/25258088 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:07.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f8a6f169700 1 -- start start 2023-07-21T22:11:07.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f2a777fe700 1 -- 172.21.15.49:0/25258088 >> v1:172.21.15.150:6789/0 conn(0x7f2a70058280 legacy=0x7f2a700eb050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:11:07.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f2a777fe700 1 -- 172.21.15.49:0/25258088 >> v1:172.21.15.49:6789/0 conn(0x7f2a70006350 legacy=0x7f2a7003ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f2a777fe700 1 -- 172.21.15.49:0/25258088 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70058ad0 con 0x7f2a700e6d30 2023-07-21T22:11:07.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7faf46130700 1 Processor -- start 2023-07-21T22:11:07.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f2a777fe700 1 --2- 172.21.15.49:0/25258088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a700e6d30 0x7f2a700556f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009910 tx=0x7f2a6c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb6e9ab6675c0f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7faf46130700 1 -- start start 2023-07-21T22:11:07.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f2a767fc700 1 -- 172.21.15.49:0/25258088 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c004230 con 0x7f2a700e6d30 2023-07-21T22:11:07.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f8a6f169700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a60054800 0x7f8a60036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f8a6f169700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a60036cb0 0x7f8a6003a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f8a6f169700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8a6003a640 0x7f8a600e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6d966700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a60036cb0 0x7f8a6003a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6d966700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a60036cb0 0x7f8a6003a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:40002/0 (socket says 172.21.15.49:40002) 2023-07-21T22:11:07.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6d966700 1 -- 172.21.15.49:0/2518262735 learned_addr learned my addr 172.21.15.49:0/2518262735 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:07.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6e968700 1 --2- 172.21.15.49:0/2518262735 >> v2:172.21.15.49:3300/0 conn(0x7f8a6003a640 0x7f8a600e23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f8a6f169700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a600070b0 con 0x7f8a6003a640 2023-07-21T22:11:07.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6e167700 1 --2- 172.21.15.49:0/2518262735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a60054800 0x7f8a60036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f2a767fc700 1 -- 172.21.15.49:0/25258088 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c004390 con 0x7f2a700e6d30 2023-07-21T22:11:07.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7f2a767fc700 1 -- 172.21.15.49:0/25258088 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c009e60 con 0x7f2a700e6d30 2023-07-21T22:11:07.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7faf46130700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf38036320 0x7faf380506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.469+0000 7faf4512e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf38036320 0x7faf380506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf4512e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf38036320 0x7faf380506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48300/0 (socket says 172.21.15.49:48300) 2023-07-21T22:11:07.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf4512e700 1 -- 172.21.15.49:0/3957409851 learned_addr learned my addr 172.21.15.49:0/3957409851 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:07.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf46130700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf38038980 0x7faf380e0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf46130700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf380cbd30 0x7faf380cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf46130700 1 -- 172.21.15.49:0/3957409851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf380cc6e0 con 0x7faf38036320 2023-07-21T22:11:07.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6f169700 1 -- 172.21.15.49:0/2518262735 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a60037120 con 0x7f8a60036cb0 2023-07-21T22:11:07.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6f169700 1 -- 172.21.15.49:0/2518262735 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600060c0 con 0x7f8a60054800 2023-07-21T22:11:07.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf46130700 1 -- 172.21.15.49:0/3957409851 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf380cced0 con 0x7faf38038980 2023-07-21T22:11:07.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf46130700 1 -- 172.21.15.49:0/3957409851 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf380cd190 con 0x7faf380cbd30 2023-07-21T22:11:07.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f2a7cb30700 1 -- 172.21.15.49:0/25258088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a700e6d30 msgr2=0x7f2a700556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f2a7cb30700 1 --2- 172.21.15.49:0/25258088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a700e6d30 0x7f2a700556f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009910 tx=0x7f2a6c009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:07.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf4492d700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf38038980 0x7faf380e0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf4512e700 1 -- 172.21.15.49:0/3957409851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf380cbd30 msgr2=0x7faf380cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf4512e700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf380cbd30 0x7faf380cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf4512e700 1 -- 172.21.15.49:0/3957409851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf38038980 msgr2=0x7faf380e0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf4512e700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf38038980 0x7faf380e0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf4512e700 1 -- 172.21.15.49:0/3957409851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf30009570 con 0x7faf38036320 2023-07-21T22:11:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6d966700 1 -- 172.21.15.49:0/2518262735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a60054800 msgr2=0x7f8a60036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6d966700 1 --2- 172.21.15.49:0/2518262735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a60054800 0x7f8a60036770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6d966700 1 -- 172.21.15.49:0/2518262735 >> v2:172.21.15.49:3300/0 conn(0x7f8a6003a640 msgr2=0x7f8a600e23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6d966700 1 --2- 172.21.15.49:0/2518262735 >> v2:172.21.15.49:3300/0 conn(0x7f8a6003a640 0x7f8a600e23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6d966700 1 -- 172.21.15.49:0/2518262735 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a600ded00 con 0x7f8a60036cb0 2023-07-21T22:11:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6d966700 1 --2- 172.21.15.49:0/2518262735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60036cb0 0x7f8a6003a100 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8a68066610 tx=0x7f8a68067440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23b7c632dd8bca08 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf4512e700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf38036320 0x7faf380506e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00c500 tx=0x7faf3c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6d165700 1 -- 172.21.15.49:0/2518262735 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680739b0 con 0x7f8a60036cb0 2023-07-21T22:11:07.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6d165700 1 -- 172.21.15.49:0/2518262735 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68073b10 con 0x7f8a60036cb0 2023-07-21T22:11:07.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6d165700 1 -- 172.21.15.49:0/2518262735 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68066a20 con 0x7f8a60036cb0 2023-07-21T22:11:07.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf35ffb700 1 -- 172.21.15.49:0/3957409851 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0052d0 con 0x7faf38036320 2023-07-21T22:11:07.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf35ffb700 1 -- 172.21.15.49:0/3957409851 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c005470 con 0x7faf38036320 2023-07-21T22:11:07.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7faf35ffb700 1 -- 172.21.15.49:0/3957409851 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c006ac0 con 0x7faf38036320 2023-07-21T22:11:07.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7f8a6f169700 1 -- 172.21.15.49:0/2518262735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60036cb0 msgr2=0x7f8a6003a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7f8a6f169700 1 --2- 172.21.15.49:0/2518262735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60036cb0 0x7f8a6003a100 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8a68066610 tx=0x7f8a68067440 comp rx=0 tx=0).stop 2023-07-21T22:11:07.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7faf46130700 1 -- 172.21.15.49:0/3957409851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf380cd470 con 0x7faf38036320 2023-07-21T22:11:07.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7faf46130700 1 -- 172.21.15.49:0/3957409851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf380cda30 con 0x7faf38036320 2023-07-21T22:11:07.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7f8a6f169700 1 -- 172.21.15.49:0/2518262735 shutdown_connections 2023-07-21T22:11:07.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7f8a6f169700 1 --2- 172.21.15.49:0/2518262735 >> v2:172.21.15.49:3300/0 conn(0x7f8a6003a640 0x7f8a600e23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7faf237fe700 1 -- 172.21.15.49:0/3957409851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1c005310 con 0x7faf38036320 2023-07-21T22:11:07.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7f8a6f169700 1 --2- 172.21.15.49:0/2518262735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60036cb0 0x7f8a6003a100 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7f8a6f169700 1 --2- 172.21.15.49:0/2518262735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a60054800 0x7f8a60036770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7f8a6f169700 1 -- 172.21.15.49:0/2518262735 >> 172.21.15.49:0/2518262735 conn(0x7f8a60051770 msgr2=0x7f8a60051b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7f8a6f169700 1 -- 172.21.15.49:0/2518262735 shutdown_connections 2023-07-21T22:11:07.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7f8a6f169700 1 -- 172.21.15.49:0/2518262735 wait complete. 2023-07-21T22:11:07.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7f2a7cb30700 1 -- 172.21.15.49:0/25258088 shutdown_connections 2023-07-21T22:11:07.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7f2a7cb30700 1 --2- 172.21.15.49:0/25258088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a700e6d30 0x7f2a700556f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7f2a7cb30700 1 -- 172.21.15.49:0/25258088 >> 172.21.15.49:0/25258088 conn(0x7f2a70055c80 msgr2=0x7f2a70056050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7fee5a3be700 1 Processor -- start 2023-07-21T22:11:07.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.473+0000 7fee5a3be700 1 -- start start 2023-07-21T22:11:07.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7fee5a3be700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fee4c009910 0x7fee4c007d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7fee5a3be700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee4c00c410 0x7fee4c00c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7fee5a3be700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c0e7530 con 0x7fee4c035c40 2023-07-21T22:11:07.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7fee5a3be700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c0e7340 con 0x7fee4c009910 2023-07-21T22:11:07.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7fee5a3be700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c00cdd0 con 0x7fee4c00c410 2023-07-21T22:11:07.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7fee593bc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fee4c009910 0x7fee4c007d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7fee59bbd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fee4c035c40 0x7fee4c0360c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44692/0 (socket says 172.21.15.49:44692) 2023-07-21T22:11:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7fee59bbd700 1 -- 172.21.15.49:0/1343591046 learned_addr learned my addr 172.21.15.49:0/1343591046 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7fee593bc700 1 -- 172.21.15.49:0/1343591046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee4c00c410 msgr2=0x7fee4c00c890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:11:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7fee593bc700 1 --2- 172.21.15.49:0/1343591046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee4c00c410 0x7fee4c00c890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7fee593bc700 1 -- 172.21.15.49:0/1343591046 >> v1:172.21.15.49:6789/0 conn(0x7fee4c035c40 legacy=0x7fee4c0360c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7fee593bc700 1 -- 172.21.15.49:0/1343591046 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0e7810 con 0x7fee4c009910 2023-07-21T22:11:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7fee593bc700 1 --2- 172.21.15.49:0/1343591046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c009910 0x7fee4c007d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fee540664d0 tx=0x7fee54067440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3a2377e6f4c8b84 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7f2a7cb30700 1 -- 172.21.15.49:0/25258088 shutdown_connections 2023-07-21T22:11:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.477+0000 7f2a7cb30700 1 -- 172.21.15.49:0/25258088 wait complete. 2023-07-21T22:11:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.481+0000 7fee4bfff700 1 -- 172.21.15.49:0/1343591046 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540737b0 con 0x7fee4c009910 2023-07-21T22:11:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.481+0000 7fee4bfff700 1 -- 172.21.15.49:0/1343591046 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee54073910 con 0x7fee4c009910 2023-07-21T22:11:07.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.481+0000 7fee5a3be700 1 -- 172.21.15.49:0/1343591046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c009910 msgr2=0x7fee4c007d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.481+0000 7fee5a3be700 1 --2- 172.21.15.49:0/1343591046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c009910 0x7fee4c007d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fee540664d0 tx=0x7fee54067440 comp rx=0 tx=0).stop 2023-07-21T22:11:07.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.481+0000 7f2a7cb30700 1 Processor -- start 2023-07-21T22:11:07.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.481+0000 7fee5a3be700 1 -- 172.21.15.49:0/1343591046 shutdown_connections 2023-07-21T22:11:07.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.481+0000 7fee5a3be700 1 --2- 172.21.15.49:0/1343591046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee4c00c410 0x7fee4c00c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.481+0000 7fee5a3be700 1 --2- 172.21.15.49:0/1343591046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c009910 0x7fee4c007d50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.481+0000 7fee5a3be700 1 -- 172.21.15.49:0/1343591046 >> 172.21.15.49:0/1343591046 conn(0x7fee4c056f00 msgr2=0x7fee4c057300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.481+0000 7f2a7cb30700 1 -- start start 2023-07-21T22:11:07.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a7cb30700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a70006350 0x7f2a7004ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.481+0000 7faf35ffb700 1 -- 172.21.15.49:0/3957409851 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf3c006c20 con 0x7faf38036320 2023-07-21T22:11:07.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.481+0000 7faf35ffb700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faf240663f0 0x7faf240688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.481+0000 7faf35ffb700 1 -- 172.21.15.49:0/3957409851 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faf3c0830f0 con 0x7faf38036320 2023-07-21T22:11:07.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.481+0000 7faf4492d700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faf240663f0 0x7faf240688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a7cb30700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a70058280 0x7f2a700e0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a7cb30700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a700e6d30 0x7f2a700e75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7faf4492d700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faf240663f0 0x7faf240688a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faf380e4270 tx=0x7faf30008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a7cb30700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700d6900 con 0x7f2a700e6d30 2023-07-21T22:11:07.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a7cb30700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7004e1c0 con 0x7f2a70006350 2023-07-21T22:11:07.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a777fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a70006350 0x7f2a7004ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a7cb30700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700ea190 con 0x7f2a70058280 2023-07-21T22:11:07.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a777fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a70006350 0x7f2a7004ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:40042/0 (socket says 172.21.15.49:40042) 2023-07-21T22:11:07.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a777fe700 1 -- 172.21.15.49:0/4173084495 learned_addr learned my addr 172.21.15.49:0/4173084495 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:07.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f8a6f169700 1 Processor -- start 2023-07-21T22:11:07.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a76ffd700 1 --2- 172.21.15.49:0/4173084495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a70058280 0x7f2a700e0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a777fe700 1 -- 172.21.15.49:0/4173084495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a70058280 msgr2=0x7f2a700e0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a777fe700 1 --2- 172.21.15.49:0/4173084495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a70058280 0x7f2a700e0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a777fe700 1 -- 172.21.15.49:0/4173084495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a700e6d30 msgr2=0x7f2a700e75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a777fe700 1 --2- 172.21.15.49:0/4173084495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a700e6d30 0x7f2a700e75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a777fe700 1 -- 172.21.15.49:0/4173084495 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c009570 con 0x7f2a70006350 2023-07-21T22:11:07.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a777fe700 1 --2- 172.21.15.49:0/4173084495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a70006350 0x7f2a7004ecb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c000c00 tx=0x7f2a6c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7fee5a3be700 1 -- 172.21.15.49:0/1343591046 shutdown_connections 2023-07-21T22:11:07.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f8a6f169700 1 -- start start 2023-07-21T22:11:07.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a63fff700 1 -- 172.21.15.49:0/4173084495 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0036c0 con 0x7f2a70006350 2023-07-21T22:11:07.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a63fff700 1 -- 172.21.15.49:0/4173084495 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c003820 con 0x7f2a70006350 2023-07-21T22:11:07.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a63fff700 1 -- 172.21.15.49:0/4173084495 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c003bd0 con 0x7f2a70006350 2023-07-21T22:11:07.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a7cb30700 1 -- 172.21.15.49:0/4173084495 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a700e9eb0 con 0x7f2a70006350 2023-07-21T22:11:07.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7f2a7cb30700 1 -- 172.21.15.49:0/4173084495 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7004de50 con 0x7f2a70006350 2023-07-21T22:11:07.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6f169700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60036cb0 0x7f8a600dc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6f169700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a6003a640 0x7f8a600d4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6f169700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a60054800 0x7f8a60173c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6d966700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a6003a640 0x7f8a600d4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6e167700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60036cb0 0x7f8a600dc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6e167700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60036cb0 0x7f8a600dc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:40048/0 (socket says 172.21.15.49:40048) 2023-07-21T22:11:07.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6e167700 1 -- 172.21.15.49:0/1445140682 learned_addr learned my addr 172.21.15.49:0/1445140682 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:07.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6f169700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a60048080 con 0x7f8a6003a640 2023-07-21T22:11:07.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6f169700 1 -- 172.21.15.49:0/1445140682 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600db590 con 0x7f8a60036cb0 2023-07-21T22:11:07.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6f169700 1 -- 172.21.15.49:0/1445140682 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600db870 con 0x7f8a60054800 2023-07-21T22:11:07.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6e968700 1 --2- 172.21.15.49:0/1445140682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a60054800 0x7f8a60173c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.485+0000 7fee5a3be700 1 -- 172.21.15.49:0/1343591046 wait complete. 2023-07-21T22:11:07.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7fee5a3be700 1 Processor -- start 2023-07-21T22:11:07.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f2a63fff700 1 -- 172.21.15.49:0/4173084495 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2a6c021070 con 0x7f2a70006350 2023-07-21T22:11:07.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6e167700 1 -- 172.21.15.49:0/1445140682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a60054800 msgr2=0x7f8a60173c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6e167700 1 --2- 172.21.15.49:0/1445140682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a60054800 0x7f8a60173c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6e167700 1 -- 172.21.15.49:0/1445140682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a6003a640 msgr2=0x7f8a600d4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6e167700 1 --2- 172.21.15.49:0/1445140682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a6003a640 0x7f8a600d4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6e167700 1 -- 172.21.15.49:0/1445140682 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6804eb70 con 0x7f8a60036cb0 2023-07-21T22:11:07.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6e968700 1 --2- 172.21.15.49:0/1445140682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a60054800 0x7f8a60173c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:07.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7faf35ffb700 1 -- 172.21.15.49:0/3957409851 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf3c050320 con 0x7faf38036320 2023-07-21T22:11:07.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a6e167700 1 --2- 172.21.15.49:0/1445140682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60036cb0 0x7f8a600dc630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800e840 tx=0x7f8a5800eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a5effd700 1 -- 172.21.15.49:0/1445140682 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a580095a0 con 0x7f8a60036cb0 2023-07-21T22:11:07.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a5effd700 1 -- 172.21.15.49:0/1445140682 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a58013680 con 0x7f8a60036cb0 2023-07-21T22:11:07.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7f8a5effd700 1 -- 172.21.15.49:0/1445140682 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a580139f0 con 0x7f8a60036cb0 2023-07-21T22:11:07.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7f8a6f169700 1 -- 172.21.15.49:0/1445140682 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a600dbb50 con 0x7f8a60036cb0 2023-07-21T22:11:07.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7f2a63fff700 1 --2- 172.21.15.49:0/4173084495 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a5c0662f0 0x7f2a5c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7f8a6f169700 1 -- 172.21.15.49:0/1445140682 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a600dc110 con 0x7f8a60036cb0 2023-07-21T22:11:07.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7f2a76ffd700 1 --2- 172.21.15.49:0/4173084495 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a5c0662f0 0x7f2a5c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.489+0000 7fee5a3be700 1 -- start start 2023-07-21T22:11:07.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7f2a63fff700 1 -- 172.21.15.49:0/4173084495 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a6c0857d0 con 0x7f2a70006350 2023-07-21T22:11:07.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7fee5a3be700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c009910 0x7fee4c03bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7fee5a3be700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee4c00c410 0x7fee4c039d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7fee5a3be700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee4c035c40 0x7fee4c0d2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7fee593bc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c009910 0x7fee4c03bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7fee593bc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c009910 0x7fee4c03bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:40054/0 (socket says 172.21.15.49:40054) 2023-07-21T22:11:07.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7fee58bbb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee4c00c410 0x7fee4c039d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7fee58bbb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee4c00c410 0x7fee4c039d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:37414/0 (socket says 172.21.15.49:37414) 2023-07-21T22:11:07.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7fee59bbd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee4c035c40 0x7fee4c0d2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7fee59bbd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee4c035c40 0x7fee4c0d2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48336/0 (socket says 172.21.15.49:48336) 2023-07-21T22:11:07.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7fee593bc700 1 -- 172.21.15.49:0/4079216425 learned_addr learned my addr 172.21.15.49:0/4079216425 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:07.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7f2a76ffd700 1 --2- 172.21.15.49:0/4173084495 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a5c0662f0 0x7f2a5c0687a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2a7017fea0 tx=0x7f2a64009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7fee5a3be700 1 -- 172.21.15.49:0/4079216425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c03a270 con 0x7fee4c035c40 2023-07-21T22:11:07.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7fee5a3be700 1 -- 172.21.15.49:0/4079216425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c03a510 con 0x7fee4c009910 2023-07-21T22:11:07.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7f8a6f169700 1 -- 172.21.15.49:0/1445140682 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a60005530 con 0x7f8a60036cb0 2023-07-21T22:11:07.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.493+0000 7fee5a3be700 1 -- 172.21.15.49:0/4079216425 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c03a7f0 con 0x7fee4c00c410 2023-07-21T22:11:07.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7f8a5effd700 1 -- 172.21.15.49:0/1445140682 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8a58013b50 con 0x7f8a60036cb0 2023-07-21T22:11:07.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7fee58bbb700 1 -- 172.21.15.49:0/4079216425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c009910 msgr2=0x7fee4c03bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7fee58bbb700 1 --2- 172.21.15.49:0/4079216425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c009910 0x7fee4c03bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7fee58bbb700 1 -- 172.21.15.49:0/4079216425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee4c035c40 msgr2=0x7fee4c0d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7fee58bbb700 1 --2- 172.21.15.49:0/4079216425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee4c035c40 0x7fee4c0d2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7fee58bbb700 1 -- 172.21.15.49:0/4079216425 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0d2680 con 0x7fee4c00c410 2023-07-21T22:11:07.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7f8a5effd700 1 --2- 172.21.15.49:0/1445140682 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8a4c0662f0 0x7f8a4c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7f8a5effd700 1 -- 172.21.15.49:0/1445140682 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8a58083ef0 con 0x7f8a60036cb0 2023-07-21T22:11:07.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7fee58bbb700 1 --2- 172.21.15.49:0/4079216425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee4c00c410 0x7fee4c039d30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee4400b470 tx=0x7fee4400b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7f8a6d966700 1 --2- 172.21.15.49:0/1445140682 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8a4c0662f0 0x7f8a4c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7f2a7cb30700 1 -- 172.21.15.49:0/4173084495 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a58005310 con 0x7f2a70006350 2023-07-21T22:11:07.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7fee49ffb700 1 -- 172.21.15.49:0/4079216425 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44011830 con 0x7fee4c00c410 2023-07-21T22:11:07.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7f8a6d966700 1 --2- 172.21.15.49:0/1445140682 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8a4c0662f0 0x7f8a4c0687a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8a68091000 tx=0x7f8a6808a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7fee5a3be700 1 -- 172.21.15.49:0/4079216425 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c0d2960 con 0x7fee4c00c410 2023-07-21T22:11:07.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7fee5a3be700 1 -- 172.21.15.49:0/4079216425 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c03aad0 con 0x7fee4c00c410 2023-07-21T22:11:07.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7fee49ffb700 1 -- 172.21.15.49:0/4079216425 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee440119b0 con 0x7fee4c00c410 2023-07-21T22:11:07.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.497+0000 7fee49ffb700 1 -- 172.21.15.49:0/4079216425 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44011d60 con 0x7fee4c00c410 2023-07-21T22:11:07.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.501+0000 7fee3f7fe700 1 -- 172.21.15.49:0/4079216425 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2c005310 con 0x7fee4c00c410 2023-07-21T22:11:07.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.501+0000 7fee49ffb700 1 -- 172.21.15.49:0/4079216425 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee4401a400 con 0x7fee4c00c410 2023-07-21T22:11:07.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.505+0000 7f8a5effd700 1 -- 172.21.15.49:0/1445140682 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a58054b00 con 0x7f8a60036cb0 2023-07-21T22:11:07.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.505+0000 7fee49ffb700 1 --2- 172.21.15.49:0/4079216425 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fee38066340 0x7fee380687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.505+0000 7fee49ffb700 1 -- 172.21.15.49:0/4079216425 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fee44083eb0 con 0x7fee4c00c410 2023-07-21T22:11:07.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.505+0000 7fee593bc700 1 --2- 172.21.15.49:0/4079216425 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fee38066340 0x7fee380687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.505+0000 7fee593bc700 1 --2- 172.21.15.49:0/4079216425 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fee38066340 0x7fee380687f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fee5404ea30 tx=0x7fee5406c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.509+0000 7f2a63fff700 1 -- 172.21.15.49:0/4173084495 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2a6c052a70 con 0x7f2a70006350 2023-07-21T22:11:07.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.513+0000 7fee49ffb700 1 -- 172.21.15.49:0/4079216425 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee440510e0 con 0x7fee4c00c410 2023-07-21T22:11:07.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.529+0000 7faee24dd700 1 Processor -- start 2023-07-21T22:11:07.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.529+0000 7faee24dd700 1 -- start start 2023-07-21T22:11:07.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7f00dc192700 1 Processor -- start 2023-07-21T22:11:07.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7f00dc192700 1 -- start start 2023-07-21T22:11:07.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faee24dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faedc0caef0 0x7faedc0ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faee24dd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faedc15c2a0 0x7faedc0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faee24dd700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faedc0cbef0 con 0x7faedc0b01c0 2023-07-21T22:11:07.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faee24dd700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faedc0ab8d0 con 0x7faedc15c2a0 2023-07-21T22:11:07.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faee24dd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0b0640 con 0x7faedc0caef0 2023-07-21T22:11:07.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faee0a7a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faedc0b01c0 0x7faedc15f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44694/0 (socket says 172.21.15.49:44694) 2023-07-21T22:11:07.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faee0a7a700 1 -- 172.21.15.49:0/4197030013 learned_addr learned my addr 172.21.15.49:0/4197030013 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:07.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faedbfff700 1 --2- 172.21.15.49:0/4197030013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faedc0caef0 0x7faedc0ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faedb7fe700 1 --2- 172.21.15.49:0/4197030013 >> v2:172.21.15.49:3300/0 conn(0x7faedc15c2a0 0x7faedc0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7f00dc192700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f00d4158c00 0x7f00d415d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7f00dc192700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d4158fd0 con 0x7f00d406da70 2023-07-21T22:11:07.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7f00dc192700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d406c9d0 con 0x7f00d40c90d0 2023-07-21T22:11:07.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7f00dc192700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d406d650 con 0x7f00d4158c00 2023-07-21T22:11:07.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faedbfff700 1 -- 172.21.15.49:0/4197030013 >> v2:172.21.15.49:3300/0 conn(0x7faedc15c2a0 msgr2=0x7faedc0afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:07.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faedbfff700 1 --2- 172.21.15.49:0/4197030013 >> v2:172.21.15.49:3300/0 conn(0x7faedc15c2a0 0x7faedc0afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faedbfff700 1 -- 172.21.15.49:0/4197030013 >> v1:172.21.15.49:6789/0 conn(0x7faedc0b01c0 legacy=0x7faedc15f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faedbfff700 1 -- 172.21.15.49:0/4197030013 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc15c840 con 0x7faedc0caef0 2023-07-21T22:11:07.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faedb7fe700 1 --2- 172.21.15.49:0/4197030013 >> v2:172.21.15.49:3300/0 conn(0x7faedc15c2a0 0x7faedc0afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:07.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7f00da72f700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f00d40c90d0 0x7f00d40c94f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:58876/0 (socket says 172.21.15.49:58876) 2023-07-21T22:11:07.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7f00da72f700 1 -- 172.21.15.49:0/3804948463 learned_addr learned my addr 172.21.15.49:0/3804948463 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:07.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.533+0000 7faedbfff700 1 --2- 172.21.15.49:0/4197030013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faedc0caef0 0x7faedc0ad400 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faecc009840 tx=0x7faecc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=677cbfb2c02afd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7faedaffd700 1 -- 172.21.15.49:0/4197030013 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc005e50 con 0x7faedc0caef0 2023-07-21T22:11:07.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7faedaffd700 1 -- 172.21.15.49:0/4197030013 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc006030 con 0x7faedc0caef0 2023-07-21T22:11:07.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7faedaffd700 1 -- 172.21.15.49:0/4197030013 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc0063a0 con 0x7faedc0caef0 2023-07-21T22:11:07.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7f00d9f2e700 1 --2- 172.21.15.49:0/3804948463 >> v2:172.21.15.49:3300/0 conn(0x7f00d4158c00 0x7f00d415d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7f00d8f2c700 1 -- 172.21.15.49:0/3804948463 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563080334 0 0) 0x7f00d406c9d0 con 0x7f00d40c90d0 2023-07-21T22:11:07.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7f00d8f2c700 1 -- 172.21.15.49:0/3804948463 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c00035d0 con 0x7f00d40c90d0 2023-07-21T22:11:07.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7faee24dd700 1 -- 172.21.15.49:0/4197030013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faedc0caef0 msgr2=0x7faedc0ad400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7faee24dd700 1 --2- 172.21.15.49:0/4197030013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faedc0caef0 0x7faedc0ad400 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faecc009840 tx=0x7faecc009b50 comp rx=0 tx=0).stop 2023-07-21T22:11:07.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7f00d9f2e700 1 -- 172.21.15.49:0/3804948463 >> v1:172.21.15.150:6789/0 conn(0x7f00d40c90d0 legacy=0x7f00d40c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7f00d9f2e700 1 -- 172.21.15.49:0/3804948463 >> v1:172.21.15.49:6789/0 conn(0x7f00d406da70 legacy=0x7f00d406c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7f00d9f2e700 1 -- 172.21.15.49:0/3804948463 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d406ccb0 con 0x7f00d4158c00 2023-07-21T22:11:07.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7faee24dd700 1 -- 172.21.15.49:0/4197030013 shutdown_connections 2023-07-21T22:11:07.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7faee24dd700 1 --2- 172.21.15.49:0/4197030013 >> v2:172.21.15.49:3300/0 conn(0x7faedc15c2a0 0x7faedc0afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7faee24dd700 1 --2- 172.21.15.49:0/4197030013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faedc0caef0 0x7faedc0ad400 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7faee24dd700 1 -- 172.21.15.49:0/4197030013 >> 172.21.15.49:0/4197030013 conn(0x7faedc06e960 msgr2=0x7faedc06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7f00d9f2e700 1 --2- 172.21.15.49:0/3804948463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d4158c00 0x7f00d415d180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f00d000ba70 tx=0x7f00d000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6739ad5e5c2b11 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7faee24dd700 1 -- 172.21.15.49:0/4197030013 shutdown_connections 2023-07-21T22:11:07.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7faee24dd700 1 -- 172.21.15.49:0/4197030013 wait complete. 2023-07-21T22:11:07.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7f00d8f2c700 1 -- 172.21.15.49:0/3804948463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0019f0 con 0x7f00d4158c00 2023-07-21T22:11:07.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7f00d8f2c700 1 -- 172.21.15.49:0/3804948463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d000d970 con 0x7f00d4158c00 2023-07-21T22:11:07.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7f00dc192700 1 -- 172.21.15.49:0/3804948463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d4158c00 msgr2=0x7f00d415d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.537+0000 7f00dc192700 1 --2- 172.21.15.49:0/3804948463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d4158c00 0x7f00d415d180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f00d000ba70 tx=0x7f00d000be00 comp rx=0 tx=0).stop 2023-07-21T22:11:07.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7f00dc192700 1 -- 172.21.15.49:0/3804948463 shutdown_connections 2023-07-21T22:11:07.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7f00dc192700 1 --2- 172.21.15.49:0/3804948463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d4158c00 0x7f00d415d180 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7f00dc192700 1 -- 172.21.15.49:0/3804948463 >> 172.21.15.49:0/3804948463 conn(0x7f00d4070450 msgr2=0x7f00d4070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7f00dc192700 1 -- 172.21.15.49:0/3804948463 shutdown_connections 2023-07-21T22:11:07.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7f00dc192700 1 -- 172.21.15.49:0/3804948463 wait complete. 2023-07-21T22:11:07.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7faee24dd700 1 Processor -- start 2023-07-21T22:11:07.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7faee24dd700 1 -- start start 2023-07-21T22:11:07.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7fb174df7700 1 Processor -- start 2023-07-21T22:11:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7faee24dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faedc0b01c0 0x7faedc1f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7faee24dd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faedc0caef0 0x7faedc0b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7fb174df7700 1 -- start start 2023-07-21T22:11:07.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7f00dc192700 1 Processor -- start 2023-07-21T22:11:07.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7faedb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faedc0caef0 0x7faedc0b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7faedbfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faedc0b01c0 0x7faedc1f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7faedb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faedc0caef0 0x7faedc0b2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48364/0 (socket says 172.21.15.49:48364) 2023-07-21T22:11:07.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7faedbfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faedc0b01c0 0x7faedc1f4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:37430/0 (socket says 172.21.15.49:37430) 2023-07-21T22:11:07.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7faedb7fe700 1 -- 172.21.15.49:0/4178685874 learned_addr learned my addr 172.21.15.49:0/4178685874 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:07.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7faee24dd700 1 --2- 172.21.15.49:0/4178685874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faedc15c2a0 0x7faedc158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.541+0000 7f00dc192700 1 -- start start 2023-07-21T22:11:07.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faee24dd700 1 -- 172.21.15.49:0/4178685874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc1f49d0 con 0x7faedc0caef0 2023-07-21T22:11:07.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faee24dd700 1 -- 172.21.15.49:0/4178685874 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0c5650 con 0x7faedc15c2a0 2023-07-21T22:11:07.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faee24dd700 1 -- 172.21.15.49:0/4178685874 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0c5930 con 0x7faedc0b01c0 2023-07-21T22:11:07.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7fb174df7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb168051170 0x7fb168036630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7fb174df7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb168036fb0 con 0x7fb1680e6d20 2023-07-21T22:11:07.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7fb174df7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16804f910 con 0x7fb168036b70 2023-07-21T22:11:07.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7fb174df7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb168048570 con 0x7fb168051170 2023-07-21T22:11:07.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faee0a7a700 1 --2- 172.21.15.49:0/4178685874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faedc15c2a0 0x7faedc158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faedb7fe700 1 -- 172.21.15.49:0/4178685874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faedc0b01c0 msgr2=0x7faedc1f4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faedb7fe700 1 --2- 172.21.15.49:0/4178685874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faedc0b01c0 0x7faedc1f4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faedb7fe700 1 -- 172.21.15.49:0/4178685874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faedc15c2a0 msgr2=0x7faedc158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faedb7fe700 1 --2- 172.21.15.49:0/4178685874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faedc15c2a0 0x7faedc158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faedb7fe700 1 -- 172.21.15.49:0/4178685874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc009450 con 0x7faedc0caef0 2023-07-21T22:11:07.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7fb16e59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb1680e6d20 0x7fb16804f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44706/0 (socket says 172.21.15.49:44706) 2023-07-21T22:11:07.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7fb16e59c700 1 -- 172.21.15.49:0/3468131281 learned_addr learned my addr 172.21.15.49:0/3468131281 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:07.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faedb7fe700 1 --2- 172.21.15.49:0/4178685874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faedc0caef0 0x7faedc0b2e40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faed400cf60 tx=0x7faed400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7f00dc192700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00d406da70 0x7f00d414c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7f00dc192700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00d40c90d0 0x7f00d40b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7f00dc192700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d4158c00 0x7f00d40adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7fb16dd9b700 1 --2- 172.21.15.49:0/3468131281 >> v2:172.21.15.150:3300/0 conn(0x7fb168051170 0x7fb168036630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faed8ff9700 1 -- 172.21.15.49:0/4178685874 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed400ada0 con 0x7faedc0caef0 2023-07-21T22:11:07.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faed8ff9700 1 -- 172.21.15.49:0/4178685874 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed4015440 con 0x7faedc0caef0 2023-07-21T22:11:07.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faed8ff9700 1 -- 172.21.15.49:0/4178685874 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed40157d0 con 0x7faedc0caef0 2023-07-21T22:11:07.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faee24dd700 1 -- 172.21.15.49:0/4178685874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc0c5c10 con 0x7faedc0caef0 2023-07-21T22:11:07.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.545+0000 7faee24dd700 1 -- 172.21.15.49:0/4178685874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc0b3380 con 0x7faedc0caef0 2023-07-21T22:11:07.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7fb16dd9b700 1 -- 172.21.15.49:0/3468131281 >> v1:172.21.15.150:6789/0 conn(0x7fb168036b70 legacy=0x7fb168052ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7fb16d59a700 1 -- 172.21.15.49:0/3468131281 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191262741 0 0) 0x7fb168036fb0 con 0x7fb1680e6d20 2023-07-21T22:11:07.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00d9f2e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00d406da70 0x7f00d414c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00d9f2e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00d406da70 0x7f00d414c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:40076/0 (socket says 172.21.15.49:40076) 2023-07-21T22:11:07.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00d9f2e700 1 -- 172.21.15.49:0/67375603 learned_addr learned my addr 172.21.15.49:0/67375603 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:07.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00dc192700 1 -- 172.21.15.49:0/67375603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40b0fd0 con 0x7f00d4158c00 2023-07-21T22:11:07.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00dc192700 1 -- 172.21.15.49:0/67375603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40b12b0 con 0x7f00d406da70 2023-07-21T22:11:07.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00dc192700 1 -- 172.21.15.49:0/67375603 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40b1590 con 0x7f00d40c90d0 2023-07-21T22:11:07.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7fb16dd9b700 1 -- 172.21.15.49:0/3468131281 >> v1:172.21.15.49:6789/0 conn(0x7fb1680e6d20 legacy=0x7fb16804f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00d972d700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00d40c90d0 0x7f00d40b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00da72f700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d4158c00 0x7f00d40adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7fb16dd9b700 1 -- 172.21.15.49:0/3468131281 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168033940 con 0x7fb168051170 2023-07-21T22:11:07.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00d9f2e700 1 -- 172.21.15.49:0/67375603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00d40c90d0 msgr2=0x7f00d40b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00d9f2e700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00d40c90d0 0x7f00d40b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00d9f2e700 1 -- 172.21.15.49:0/67375603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d4158c00 msgr2=0x7f00d40adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00d9f2e700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d4158c00 0x7f00d40adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00d9f2e700 1 -- 172.21.15.49:0/67375603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d000b750 con 0x7f00d406da70 2023-07-21T22:11:07.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00da72f700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d4158c00 0x7f00d40adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:07.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00d9f2e700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00d406da70 0x7f00d414c4f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f00d406bac0 tx=0x7f00d0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7fb16dd9b700 1 --2- 172.21.15.49:0/3468131281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb168051170 0x7fb168036630 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb1600097d0 tx=0x7fb160009ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c555375ea5fab7b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7fb16d59a700 1 -- 172.21.15.49:0/3468131281 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160004230 con 0x7fb168051170 2023-07-21T22:11:07.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7fb16d59a700 1 -- 172.21.15.49:0/3468131281 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb160004390 con 0x7fb168051170 2023-07-21T22:11:07.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7fb174df7700 1 -- 172.21.15.49:0/3468131281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb168051170 msgr2=0x7fb168036630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7fb174df7700 1 --2- 172.21.15.49:0/3468131281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb168051170 0x7fb168036630 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb1600097d0 tx=0x7fb160009ae0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00ca7fc700 1 -- 172.21.15.49:0/67375603 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0010470 con 0x7f00d406da70 2023-07-21T22:11:07.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00ca7fc700 1 -- 172.21.15.49:0/67375603 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d001f040 con 0x7f00d406da70 2023-07-21T22:11:07.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7f00dc192700 1 -- 172.21.15.49:0/67375603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d40b1870 con 0x7f00d406da70 2023-07-21T22:11:07.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.549+0000 7faed8ff9700 1 -- 172.21.15.49:0/4178685874 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faed4015930 con 0x7faedc0caef0 2023-07-21T22:11:07.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7fb174df7700 1 -- 172.21.15.49:0/3468131281 shutdown_connections 2023-07-21T22:11:07.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7fb174df7700 1 --2- 172.21.15.49:0/3468131281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb168051170 0x7fb168036630 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7fb174df7700 1 -- 172.21.15.49:0/3468131281 >> 172.21.15.49:0/3468131281 conn(0x7fb168051630 msgr2=0x7fb168051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7fb174df7700 1 -- 172.21.15.49:0/3468131281 shutdown_connections 2023-07-21T22:11:07.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7f00ca7fc700 1 -- 172.21.15.49:0/67375603 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0010810 con 0x7f00d406da70 2023-07-21T22:11:07.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7f00dc192700 1 -- 172.21.15.49:0/67375603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d40b0880 con 0x7f00d406da70 2023-07-21T22:11:07.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7faed8ff9700 1 --2- 172.21.15.49:0/4178685874 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faec80663f0 0x7faec80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7faed8ff9700 1 -- 172.21.15.49:0/4178685874 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faed4084380 con 0x7faedc0caef0 2023-07-21T22:11:07.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7faedbfff700 1 --2- 172.21.15.49:0/4178685874 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faec80663f0 0x7faec80688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7faedbfff700 1 --2- 172.21.15.49:0/4178685874 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faec80663f0 0x7faec80688a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faecc013040 tx=0x7faecc008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7f00dc192700 1 -- 172.21.15.49:0/67375603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d40b1c90 con 0x7f00d406da70 2023-07-21T22:11:07.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7fb174df7700 1 -- 172.21.15.49:0/3468131281 wait complete. 2023-07-21T22:11:07.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7f00ca7fc700 1 -- 172.21.15.49:0/67375603 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00d002c410 con 0x7f00d406da70 2023-07-21T22:11:07.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7fb174df7700 1 Processor -- start 2023-07-21T22:11:07.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.553+0000 7fb174df7700 1 -- start start 2023-07-21T22:11:07.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7f00ca7fc700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f00b8066320 0x7f00b80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7f00ca7fc700 1 -- 172.21.15.49:0/67375603 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f00d00878f0 con 0x7f00d406da70 2023-07-21T22:11:07.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7fb174df7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb168036b70 0x7fb168007670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7fb174df7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168051170 0x7fb16804ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7f00d972d700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f00b8066320 0x7f00b80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7fb16e59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb168036b70 0x7fb168007670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7fb174df7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1680e6d20 0x7fb1680e8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7fb16e59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb168036b70 0x7fb168007670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:40088/0 (socket says 172.21.15.49:40088) 2023-07-21T22:11:07.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7fb16dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168051170 0x7fb16804ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7f00d972d700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f00b8066320 0x7f00b80687d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f00d41e2630 tx=0x7f00c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7fb16dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168051170 0x7fb16804ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48388/0 (socket says 172.21.15.49:48388) 2023-07-21T22:11:07.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7fb16e59c700 1 -- 172.21.15.49:0/3566108103 learned_addr learned my addr 172.21.15.49:0/3566108103 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:07.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7fb174df7700 1 -- 172.21.15.49:0/3566108103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168184730 con 0x7fb168051170 2023-07-21T22:11:07.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7fb174df7700 1 -- 172.21.15.49:0/3566108103 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16804b3d0 con 0x7fb168036b70 2023-07-21T22:11:07.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7fb174df7700 1 -- 172.21.15.49:0/3566108103 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680e1bb0 con 0x7fb1680e6d20 2023-07-21T22:11:07.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7fb16ed9d700 1 --2- 172.21.15.49:0/3566108103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1680e6d20 0x7fb1680e8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.561+0000 7fb16dd9b700 1 -- 172.21.15.49:0/3566108103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1680e6d20 msgr2=0x7fb1680e8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.561+0000 7fb16dd9b700 1 --2- 172.21.15.49:0/3566108103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1680e6d20 0x7fb1680e8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.561+0000 7fb16dd9b700 1 -- 172.21.15.49:0/3566108103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb168036b70 msgr2=0x7fb168007670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.561+0000 7fb16dd9b700 1 --2- 172.21.15.49:0/3566108103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb168036b70 0x7fb168007670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.561+0000 7fb16dd9b700 1 -- 172.21.15.49:0/3566108103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600094b0 con 0x7fb168051170 2023-07-21T22:11:07.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.561+0000 7fb16e59c700 1 --2- 172.21.15.49:0/3566108103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb168036b70 0x7fb168007670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:07.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.561+0000 7fb16dd9b700 1 --2- 172.21.15.49:0/3566108103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168051170 0x7fb16804ae90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb160013000 tx=0x7fb160004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.561+0000 7f00ca7fc700 1 -- 172.21.15.49:0/67375603 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00d0054bc0 con 0x7f00d406da70 2023-07-21T22:11:07.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.557+0000 7faec27fc700 1 -- 172.21.15.49:0/4178685874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faedc0c6410 con 0x7faedc0caef0 2023-07-21T22:11:07.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.569+0000 7faed8ff9700 1 -- 172.21.15.49:0/4178685874 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faed4051630 con 0x7faedc0caef0 2023-07-21T22:11:07.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.573+0000 7fb15effd700 1 -- 172.21.15.49:0/3566108103 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160004110 con 0x7fb168051170 2023-07-21T22:11:07.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.573+0000 7fb15effd700 1 -- 172.21.15.49:0/3566108103 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb160011840 con 0x7fb168051170 2023-07-21T22:11:07.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.573+0000 7fb15effd700 1 -- 172.21.15.49:0/3566108103 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160011c10 con 0x7fb168051170 2023-07-21T22:11:07.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.573+0000 7fb174df7700 1 -- 172.21.15.49:0/3566108103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1680e98e0 con 0x7fb168051170 2023-07-21T22:11:07.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.573+0000 7fb174df7700 1 -- 172.21.15.49:0/3566108103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1680e1e70 con 0x7fb168051170 2023-07-21T22:11:07.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.577+0000 7fb15effd700 1 -- 172.21.15.49:0/3566108103 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb16001c420 con 0x7fb168051170 2023-07-21T22:11:07.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.577+0000 7fb15effd700 1 --2- 172.21.15.49:0/3566108103 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb150066340 0x7fb1500687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:07.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.577+0000 7fb15effd700 1 -- 172.21.15.49:0/3566108103 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb16005a290 con 0x7fb168051170 2023-07-21T22:11:07.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.577+0000 7fb16e59c700 1 --2- 172.21.15.49:0/3566108103 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb150066340 0x7fb1500687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:07.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.581+0000 7fb16e59c700 1 --2- 172.21.15.49:0/3566108103 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb150066340 0x7fb1500687f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb1700689a0 tx=0x7fb170072230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:07.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.581+0000 7fb15cff9700 1 -- 172.21.15.49:0/3566108103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1680053f0 con 0x7fb168051170 2023-07-21T22:11:07.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.589+0000 7fb15effd700 1 -- 172.21.15.49:0/3566108103 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb160052da0 con 0x7fb168051170 2023-07-21T22:11:07.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.773+0000 7fb43f2e4700 1 -- 172.21.15.49:0/1948258512 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb4200055c0 con 0x7fb438164290 2023-07-21T22:11:07.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.777+0000 7fb42effd700 1 -- 172.21.15.49:0/1948258512 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb434021070 con 0x7fb438164290 2023-07-21T22:11:07.819 INFO:teuthology.orchestra.run.smithi049.stdout:60129542157 2023-07-21T22:11:07.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.777+0000 7fb42cff9700 1 -- 172.21.15.49:0/1948258512 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb41c0662f0 msgr2=0x7fb41c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.777+0000 7fb42cff9700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb41c0662f0 0x7fb41c0687a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb428009b80 tx=0x7fb4280091c0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.777+0000 7fb42cff9700 1 -- 172.21.15.49:0/1948258512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb438164290 msgr2=0x7fb438151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.777+0000 7fb42cff9700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb438164290 0x7fb438151c30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb43806f830 tx=0x7fb434004770 comp rx=0 tx=0).stop 2023-07-21T22:11:07.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.781+0000 7fb42cff9700 1 -- 172.21.15.49:0/1948258512 shutdown_connections 2023-07-21T22:11:07.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.781+0000 7fb42cff9700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb41c0662f0 0x7fb41c0687a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.781+0000 7fb42cff9700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb43814f870 0x7fb438152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.781+0000 7fb42cff9700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb438164290 0x7fb438151c30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.781+0000 7fb42cff9700 1 --2- 172.21.15.49:0/1948258512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4381601e0 0x7fb4380b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.781+0000 7fb42cff9700 1 -- 172.21.15.49:0/1948258512 >> 172.21.15.49:0/1948258512 conn(0x7fb43806e960 msgr2=0x7fb43806c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.781+0000 7fb42cff9700 1 -- 172.21.15.49:0/1948258512 shutdown_connections 2023-07-21T22:11:07.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.781+0000 7fb42cff9700 1 -- 172.21.15.49:0/1948258512 wait complete. 2023-07-21T22:11:07.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542157 for osd.1 2023-07-21T22:11:07.849 DEBUG:teuthology.parallel:result is None 2023-07-21T22:11:07.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.821+0000 7faf237fe700 1 -- 172.21.15.49:0/3957409851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faf1c0055c0 con 0x7faf38036320 2023-07-21T22:11:07.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.821+0000 7faf35ffb700 1 -- 172.21.15.49:0/3957409851 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf3c053940 con 0x7faf38036320 2023-07-21T22:11:07.865 INFO:teuthology.orchestra.run.smithi049.stdout:64424509451 2023-07-21T22:11:07.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.825+0000 7faf237fe700 1 -- 172.21.15.49:0/3957409851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faf240663f0 msgr2=0x7faf240688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.825+0000 7faf237fe700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faf240663f0 0x7faf240688a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faf380e4270 tx=0x7faf30008030 comp rx=0 tx=0).stop 2023-07-21T22:11:07.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.825+0000 7faf237fe700 1 -- 172.21.15.49:0/3957409851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf38036320 msgr2=0x7faf380506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.825+0000 7faf237fe700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf38036320 0x7faf380506e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00c500 tx=0x7faf3c00c8c0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.825+0000 7faf237fe700 1 -- 172.21.15.49:0/3957409851 shutdown_connections 2023-07-21T22:11:07.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.825+0000 7faf237fe700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faf240663f0 0x7faf240688a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.825+0000 7faf237fe700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf380cbd30 0x7faf380cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.825+0000 7faf237fe700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf38038980 0x7faf380e0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.825+0000 7faf237fe700 1 --2- 172.21.15.49:0/3957409851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf38036320 0x7faf380506e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.825+0000 7faf237fe700 1 -- 172.21.15.49:0/3957409851 >> 172.21.15.49:0/3957409851 conn(0x7faf38057b90 msgr2=0x7faf38053910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.825+0000 7faf237fe700 1 -- 172.21.15.49:0/3957409851 shutdown_connections 2023-07-21T22:11:07.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.825+0000 7faf237fe700 1 -- 172.21.15.49:0/3957409851 wait complete. 2023-07-21T22:11:07.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.833+0000 7f8a6f169700 1 -- 172.21.15.49:0/1445140682 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8a600078e0 con 0x7f8a60036cb0 2023-07-21T22:11:07.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.833+0000 7f8a5effd700 1 -- 172.21.15.49:0/1445140682 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a58017020 con 0x7f8a60036cb0 2023-07-21T22:11:07.877 INFO:teuthology.orchestra.run.smithi049.stdout:64424509450 2023-07-21T22:11:07.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.837+0000 7f8a6f169700 1 -- 172.21.15.49:0/1445140682 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8a4c0662f0 msgr2=0x7f8a4c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.837+0000 7f8a6f169700 1 --2- 172.21.15.49:0/1445140682 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8a4c0662f0 0x7f8a4c0687a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8a68091000 tx=0x7f8a6808a000 comp rx=0 tx=0).stop 2023-07-21T22:11:07.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.837+0000 7f8a6f169700 1 -- 172.21.15.49:0/1445140682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60036cb0 msgr2=0x7f8a600dc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.837+0000 7f8a6f169700 1 --2- 172.21.15.49:0/1445140682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60036cb0 0x7f8a600dc630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800e840 tx=0x7f8a5800eb50 comp rx=0 tx=0).stop 2023-07-21T22:11:07.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.837+0000 7f8a6f169700 1 -- 172.21.15.49:0/1445140682 shutdown_connections 2023-07-21T22:11:07.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.837+0000 7f8a6f169700 1 --2- 172.21.15.49:0/1445140682 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8a4c0662f0 0x7f8a4c0687a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.837+0000 7f8a6f169700 1 --2- 172.21.15.49:0/1445140682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a6003a640 0x7f8a600d4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.837+0000 7f8a6f169700 1 --2- 172.21.15.49:0/1445140682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a60054800 0x7f8a60173c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.837+0000 7f8a6f169700 1 --2- 172.21.15.49:0/1445140682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60036cb0 0x7f8a600dc630 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.837+0000 7f8a6f169700 1 -- 172.21.15.49:0/1445140682 >> 172.21.15.49:0/1445140682 conn(0x7f8a60051770 msgr2=0x7f8a600e1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.837+0000 7f8a6f169700 1 -- 172.21.15.49:0/1445140682 shutdown_connections 2023-07-21T22:11:07.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.837+0000 7f8a6f169700 1 -- 172.21.15.49:0/1445140682 wait complete. 2023-07-21T22:11:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.845+0000 7f2a7cb30700 1 -- 172.21.15.49:0/4173084495 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2a580055c0 con 0x7f2a70006350 2023-07-21T22:11:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.845+0000 7f2a63fff700 1 -- 172.21.15.49:0/4173084495 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a6c029020 con 0x7f2a70006350 2023-07-21T22:11:07.889 INFO:teuthology.orchestra.run.smithi049.stdout:64424509450 2023-07-21T22:11:07.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.849+0000 7f2a7cb30700 1 -- 172.21.15.49:0/4173084495 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a5c0662f0 msgr2=0x7f2a5c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.849+0000 7f2a7cb30700 1 --2- 172.21.15.49:0/4173084495 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a5c0662f0 0x7f2a5c0687a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2a7017fea0 tx=0x7f2a64009190 comp rx=0 tx=0).stop 2023-07-21T22:11:07.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.849+0000 7f2a7cb30700 1 -- 172.21.15.49:0/4173084495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a70006350 msgr2=0x7f2a7004ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.849+0000 7f2a7cb30700 1 --2- 172.21.15.49:0/4173084495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a70006350 0x7f2a7004ecb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c000c00 tx=0x7f2a6c004770 comp rx=0 tx=0).stop 2023-07-21T22:11:07.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.849+0000 7f2a7cb30700 1 -- 172.21.15.49:0/4173084495 shutdown_connections 2023-07-21T22:11:07.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.849+0000 7f2a7cb30700 1 --2- 172.21.15.49:0/4173084495 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a5c0662f0 0x7f2a5c0687a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.849+0000 7f2a7cb30700 1 --2- 172.21.15.49:0/4173084495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a700e6d30 0x7f2a700e75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.849+0000 7f2a7cb30700 1 --2- 172.21.15.49:0/4173084495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a70058280 0x7f2a700e0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.849+0000 7f2a7cb30700 1 --2- 172.21.15.49:0/4173084495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a70006350 0x7f2a7004ecb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.849+0000 7f2a7cb30700 1 -- 172.21.15.49:0/4173084495 >> 172.21.15.49:0/4173084495 conn(0x7f2a70055c80 msgr2=0x7f2a700d8610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.849+0000 7f2a7cb30700 1 -- 172.21.15.49:0/4173084495 shutdown_connections 2023-07-21T22:11:07.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.849+0000 7f2a7cb30700 1 -- 172.21.15.49:0/4173084495 wait complete. 2023-07-21T22:11:07.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.0 2023-07-21T22:11:07.895 DEBUG:teuthology.parallel:result is None 2023-07-21T22:11:07.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.853+0000 7fee3f7fe700 1 -- 172.21.15.49:0/4079216425 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fee2c0055c0 con 0x7fee4c00c410 2023-07-21T22:11:07.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.853+0000 7fee49ffb700 1 -- 172.21.15.49:0/4079216425 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee44015090 con 0x7fee4c00c410 2023-07-21T22:11:07.897 INFO:teuthology.orchestra.run.smithi049.stdout:64424509451 2023-07-21T22:11:07.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.857+0000 7fee3f7fe700 1 -- 172.21.15.49:0/4079216425 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fee38066340 msgr2=0x7fee380687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.857+0000 7fee3f7fe700 1 --2- 172.21.15.49:0/4079216425 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fee38066340 0x7fee380687f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fee5404ea30 tx=0x7fee5406c000 comp rx=0 tx=0).stop 2023-07-21T22:11:07.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.857+0000 7fee3f7fe700 1 -- 172.21.15.49:0/4079216425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee4c00c410 msgr2=0x7fee4c039d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.857+0000 7fee3f7fe700 1 --2- 172.21.15.49:0/4079216425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee4c00c410 0x7fee4c039d30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee4400b470 tx=0x7fee4400b780 comp rx=0 tx=0).stop 2023-07-21T22:11:07.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.857+0000 7fee3f7fe700 1 -- 172.21.15.49:0/4079216425 shutdown_connections 2023-07-21T22:11:07.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.857+0000 7fee3f7fe700 1 --2- 172.21.15.49:0/4079216425 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fee38066340 0x7fee380687f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.857+0000 7fee3f7fe700 1 --2- 172.21.15.49:0/4079216425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee4c035c40 0x7fee4c0d2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.857+0000 7fee3f7fe700 1 --2- 172.21.15.49:0/4079216425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee4c00c410 0x7fee4c039d30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.857+0000 7fee3f7fe700 1 --2- 172.21.15.49:0/4079216425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c009910 0x7fee4c03bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.857+0000 7fee3f7fe700 1 -- 172.21.15.49:0/4079216425 >> 172.21.15.49:0/4079216425 conn(0x7fee4c056f00 msgr2=0x7fee4c04ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.857+0000 7fee3f7fe700 1 -- 172.21.15.49:0/4079216425 shutdown_connections 2023-07-21T22:11:07.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.857+0000 7fee3f7fe700 1 -- 172.21.15.49:0/4079216425 wait complete. 2023-07-21T22:11:07.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.3 2023-07-21T22:11:07.908 DEBUG:teuthology.parallel:result is None 2023-07-21T22:11:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.865+0000 7faec27fc700 1 -- 172.21.15.49:0/4178685874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7faedc04dcb0 con 0x7faedc0caef0 2023-07-21T22:11:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.865+0000 7faed8ff9700 1 -- 172.21.15.49:0/4178685874 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faed401a030 con 0x7faedc0caef0 2023-07-21T22:11:07.909 INFO:teuthology.orchestra.run.smithi049.stdout:64424509450 2023-07-21T22:11:07.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.869+0000 7faec27fc700 1 -- 172.21.15.49:0/4178685874 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faec80663f0 msgr2=0x7faec80688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.869+0000 7faec27fc700 1 --2- 172.21.15.49:0/4178685874 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faec80663f0 0x7faec80688a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faecc013040 tx=0x7faecc008070 comp rx=0 tx=0).stop 2023-07-21T22:11:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.869+0000 7faec27fc700 1 -- 172.21.15.49:0/4178685874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faedc0caef0 msgr2=0x7faedc0b2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.869+0000 7faec27fc700 1 --2- 172.21.15.49:0/4178685874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faedc0caef0 0x7faedc0b2e40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faed400cf60 tx=0x7faed400cf90 comp rx=0 tx=0).stop 2023-07-21T22:11:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.869+0000 7faec27fc700 1 -- 172.21.15.49:0/4178685874 shutdown_connections 2023-07-21T22:11:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.869+0000 7faec27fc700 1 --2- 172.21.15.49:0/4178685874 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faec80663f0 0x7faec80688a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.869+0000 7faec27fc700 1 --2- 172.21.15.49:0/4178685874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faedc0caef0 0x7faedc0b2e40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.869+0000 7faec27fc700 1 --2- 172.21.15.49:0/4178685874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faedc15c2a0 0x7faedc158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.869+0000 7faec27fc700 1 --2- 172.21.15.49:0/4178685874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faedc0b01c0 0x7faedc1f4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.869+0000 7faec27fc700 1 -- 172.21.15.49:0/4178685874 >> 172.21.15.49:0/4178685874 conn(0x7faedc06e960 msgr2=0x7faedc15d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.869+0000 7faec27fc700 1 -- 172.21.15.49:0/4178685874 shutdown_connections 2023-07-21T22:11:07.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.869+0000 7faec27fc700 1 -- 172.21.15.49:0/4178685874 wait complete. 2023-07-21T22:11:07.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.2 2023-07-21T22:11:07.919 DEBUG:teuthology.parallel:result is None 2023-07-21T22:11:07.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.4 2023-07-21T22:11:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.881+0000 7f00dc192700 1 -- 172.21.15.49:0/67375603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f00d40b13f0 con 0x7f00d406da70 2023-07-21T22:11:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.881+0000 7f00ca7fc700 1 -- 172.21.15.49:0/67375603 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f00d40b13f0 con 0x7f00d406da70 2023-07-21T22:11:07.924 DEBUG:teuthology.parallel:result is None 2023-07-21T22:11:07.925 INFO:teuthology.orchestra.run.smithi049.stdout:64424509453 2023-07-21T22:11:07.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.881+0000 7f00dc192700 1 -- 172.21.15.49:0/67375603 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f00b8066320 msgr2=0x7f00b80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.881+0000 7f00dc192700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f00b8066320 0x7f00b80687d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f00d41e2630 tx=0x7f00c4009040 comp rx=0 tx=0).stop 2023-07-21T22:11:07.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.881+0000 7f00dc192700 1 -- 172.21.15.49:0/67375603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00d406da70 msgr2=0x7f00d414c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.881+0000 7f00dc192700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00d406da70 0x7f00d414c4f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f00d406bac0 tx=0x7f00d0004770 comp rx=0 tx=0).stop 2023-07-21T22:11:07.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.881+0000 7f00dc192700 1 -- 172.21.15.49:0/67375603 shutdown_connections 2023-07-21T22:11:07.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.881+0000 7f00dc192700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f00b8066320 0x7f00b80687d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.881+0000 7f00dc192700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d4158c00 0x7f00d40adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.881+0000 7f00dc192700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00d40c90d0 0x7f00d40b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.881+0000 7f00dc192700 1 --2- 172.21.15.49:0/67375603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00d406da70 0x7f00d414c4f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.881+0000 7f00dc192700 1 -- 172.21.15.49:0/67375603 >> 172.21.15.49:0/67375603 conn(0x7f00d4070450 msgr2=0x7f00d4157c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.881+0000 7f00dc192700 1 -- 172.21.15.49:0/67375603 shutdown_connections 2023-07-21T22:11:07.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.881+0000 7f00dc192700 1 -- 172.21.15.49:0/67375603 wait complete. 2023-07-21T22:11:07.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2023-07-21T22:11:07.931 DEBUG:teuthology.parallel:result is None 2023-07-21T22:11:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.893+0000 7fb15cff9700 1 -- 172.21.15.49:0/3566108103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb168036450 con 0x7fb168051170 2023-07-21T22:11:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.893+0000 7fb15effd700 1 -- 172.21.15.49:0/3566108103 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb160020030 con 0x7fb168051170 2023-07-21T22:11:07.937 INFO:teuthology.orchestra.run.smithi049.stdout:64424509452 2023-07-21T22:11:07.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.897+0000 7fb15cff9700 1 -- 172.21.15.49:0/3566108103 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb150066340 msgr2=0x7fb1500687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.897+0000 7fb15cff9700 1 --2- 172.21.15.49:0/3566108103 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb150066340 0x7fb1500687f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb1700689a0 tx=0x7fb170072230 comp rx=0 tx=0).stop 2023-07-21T22:11:07.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.897+0000 7fb15cff9700 1 -- 172.21.15.49:0/3566108103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168051170 msgr2=0x7fb16804ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:07.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.897+0000 7fb15cff9700 1 --2- 172.21.15.49:0/3566108103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168051170 0x7fb16804ae90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb160013000 tx=0x7fb160004770 comp rx=0 tx=0).stop 2023-07-21T22:11:07.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.897+0000 7fb15cff9700 1 -- 172.21.15.49:0/3566108103 shutdown_connections 2023-07-21T22:11:07.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.897+0000 7fb15cff9700 1 --2- 172.21.15.49:0/3566108103 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb150066340 0x7fb1500687f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.897+0000 7fb15cff9700 1 --2- 172.21.15.49:0/3566108103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168051170 0x7fb16804ae90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.897+0000 7fb15cff9700 1 --2- 172.21.15.49:0/3566108103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1680e6d20 0x7fb1680e8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.897+0000 7fb15cff9700 1 --2- 172.21.15.49:0/3566108103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb168036b70 0x7fb168007670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:07.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.897+0000 7fb15cff9700 1 -- 172.21.15.49:0/3566108103 >> 172.21.15.49:0/3566108103 conn(0x7fb168051630 msgr2=0x7fb1680379e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:07.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.897+0000 7fb15cff9700 1 -- 172.21.15.49:0/3566108103 shutdown_connections 2023-07-21T22:11:07.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:07.897+0000 7fb15cff9700 1 -- 172.21.15.49:0/3566108103 wait complete. 2023-07-21T22:11:07.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.6 2023-07-21T22:11:07.943 DEBUG:teuthology.parallel:result is None 2023-07-21T22:11:07.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.5 2023-07-21T22:11:07.961 DEBUG:teuthology.parallel:result is None 2023-07-21T22:11:07.961 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-21T22:11:07.961 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:11:08.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.137+0000 7fb56299e700 1 Processor -- start 2023-07-21T22:11:08.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.137+0000 7fb56299e700 1 -- start start 2023-07-21T22:11:08.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.137+0000 7fb56299e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb55c160370 0x7fb55c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:08.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.137+0000 7fb56299e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb55c0c1470 0x7fb55c0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:08.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.137+0000 7fb56299e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c06e010 con 0x7fb55c0ca2c0 2023-07-21T22:11:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.137+0000 7fb56299e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c160740 con 0x7fb55c160370 2023-07-21T22:11:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.137+0000 7fb56299e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0ccc50 con 0x7fb55c0c1470 2023-07-21T22:11:08.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.137+0000 7fb56199c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb55c160370 0x7fb55c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:08.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.137+0000 7fb56199c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb55c160370 0x7fb55c06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48398/0 (socket says 172.21.15.49:48398) 2023-07-21T22:11:08.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.137+0000 7fb56199c700 1 -- 172.21.15.49:0/1369910246 learned_addr learned my addr 172.21.15.49:0/1369910246 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:08.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.137+0000 7fb56119b700 1 --2- 172.21.15.49:0/1369910246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb55c0c1470 0x7fb55c0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:08.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56199c700 1 -- 172.21.15.49:0/1369910246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb55c0c1470 msgr2=0x7fb55c0c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:08.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56199c700 1 --2- 172.21.15.49:0/1369910246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb55c0c1470 0x7fb55c0c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56199c700 1 -- 172.21.15.49:0/1369910246 >> v1:172.21.15.150:6789/0 conn(0x7fb55c0ca2c0 legacy=0x7fb55c0caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:08.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56199c700 1 -- 172.21.15.49:0/1369910246 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0afc90 con 0x7fb55c160370 2023-07-21T22:11:08.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56199c700 1 --2- 172.21.15.49:0/1369910246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb55c160370 0x7fb55c06d7e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb558009910 tx=0x7fb558009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68eab06a6c1f3226 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:08.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56099a700 1 -- 172.21.15.49:0/1369910246 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55800ba60 con 0x7fb55c160370 2023-07-21T22:11:08.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56099a700 1 -- 172.21.15.49:0/1369910246 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55800bbc0 con 0x7fb55c160370 2023-07-21T22:11:08.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56099a700 1 -- 172.21.15.49:0/1369910246 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558009e60 con 0x7fb55c160370 2023-07-21T22:11:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56299e700 1 -- 172.21.15.49:0/1369910246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb55c160370 msgr2=0x7fb55c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56299e700 1 --2- 172.21.15.49:0/1369910246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb55c160370 0x7fb55c06d7e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb558009910 tx=0x7fb558009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56299e700 1 -- 172.21.15.49:0/1369910246 shutdown_connections 2023-07-21T22:11:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56299e700 1 --2- 172.21.15.49:0/1369910246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb55c0c1470 0x7fb55c0c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56299e700 1 --2- 172.21.15.49:0/1369910246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb55c160370 0x7fb55c06d7e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56299e700 1 -- 172.21.15.49:0/1369910246 >> 172.21.15.49:0/1369910246 conn(0x7fb55c070450 msgr2=0x7fb55c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56299e700 1 -- 172.21.15.49:0/1369910246 shutdown_connections 2023-07-21T22:11:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.141+0000 7fb56299e700 1 -- 172.21.15.49:0/1369910246 wait complete. 2023-07-21T22:11:08.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.145+0000 7fb56299e700 1 Processor -- start 2023-07-21T22:11:08.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.145+0000 7fb56299e700 1 -- start start 2023-07-21T22:11:08.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.145+0000 7fb56299e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb55c0c1470 0x7fb55c15a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:08.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.145+0000 7fb56299e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb55c0ca2c0 0x7fb55c0b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:08.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.145+0000 7fb56299e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb55c160370 0x7fb55c0b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:08.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.145+0000 7fb56299e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c15adc0 con 0x7fb55c160370 2023-07-21T22:11:08.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.145+0000 7fb56299e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0b1cb0 con 0x7fb55c0c1470 2023-07-21T22:11:08.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.145+0000 7fb56299e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0b1f90 con 0x7fb55c0ca2c0 2023-07-21T22:11:08.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.145+0000 7fb56219d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb55c160370 0x7fb55c0b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:08.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.145+0000 7fb56199c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb55c0c1470 0x7fb55c15a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:08.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.145+0000 7fb56119b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb55c0ca2c0 0x7fb55c0b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:08.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.145+0000 7fb56219d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb55c160370 0x7fb55c0b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48414/0 (socket says 172.21.15.49:48414) 2023-07-21T22:11:08.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.145+0000 7fb56219d700 1 -- 172.21.15.49:0/635433089 learned_addr learned my addr 172.21.15.49:0/635433089 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:08.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.149+0000 7fb56219d700 1 -- 172.21.15.49:0/635433089 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb55c0ca2c0 msgr2=0x7fb55c0b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:08.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.149+0000 7fb56219d700 1 --2- 172.21.15.49:0/635433089 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb55c0ca2c0 0x7fb55c0b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.149+0000 7fb56219d700 1 -- 172.21.15.49:0/635433089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb55c0c1470 msgr2=0x7fb55c15a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:08.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.149+0000 7fb56219d700 1 --2- 172.21.15.49:0/635433089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb55c0c1470 0x7fb55c15a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.149+0000 7fb56219d700 1 -- 172.21.15.49:0/635433089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558009570 con 0x7fb55c160370 2023-07-21T22:11:08.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.149+0000 7fb56219d700 1 --2- 172.21.15.49:0/635433089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb55c160370 0x7fb55c0b3680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb55400cc50 tx=0x7fb55400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:08.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.149+0000 7fb5527fc700 1 -- 172.21.15.49:0/635433089 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554003c20 con 0x7fb55c160370 2023-07-21T22:11:08.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.149+0000 7fb5527fc700 1 -- 172.21.15.49:0/635433089 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb554003d80 con 0x7fb55c160370 2023-07-21T22:11:08.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.149+0000 7fb5527fc700 1 -- 172.21.15.49:0/635433089 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55400aab0 con 0x7fb55c160370 2023-07-21T22:11:08.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.149+0000 7fb56299e700 1 -- 172.21.15.49:0/635433089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c0b2270 con 0x7fb55c160370 2023-07-21T22:11:08.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.149+0000 7fb56299e700 1 -- 172.21.15.49:0/635433089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c0b0f30 con 0x7fb55c160370 2023-07-21T22:11:08.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.149+0000 7fb56299e700 1 -- 172.21.15.49:0/635433089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c04dcb0 con 0x7fb55c160370 2023-07-21T22:11:08.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.153+0000 7fb5527fc700 1 -- 172.21.15.49:0/635433089 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb55400ac10 con 0x7fb55c160370 2023-07-21T22:11:08.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.153+0000 7fb5527fc700 1 --2- 172.21.15.49:0/635433089 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb5400662f0 0x7fb5400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:08.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.153+0000 7fb5527fc700 1 -- 172.21.15.49:0/635433089 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb554084030 con 0x7fb55c160370 2023-07-21T22:11:08.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.153+0000 7fb56199c700 1 --2- 172.21.15.49:0/635433089 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb5400662f0 0x7fb5400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:08.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.153+0000 7fb56199c700 1 --2- 172.21.15.49:0/635433089 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb5400662f0 0x7fb5400687a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb558000c00 tx=0x7fb558008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:08.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.161+0000 7fb5527fc700 1 -- 172.21.15.49:0/635433089 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb5540b4700 con 0x7fb55c160370 2023-07-21T22:11:08.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.321+0000 7fb56299e700 1 -- 172.21.15.49:0/635433089 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb55c0b0250 con 0x7fb5400662f0 2023-07-21T22:11:08.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.337+0000 7fb5527fc700 1 -- 172.21.15.49:0/635433089 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367121 (secure 0 0 0) 0x7fb55800b8e0 con 0x7fb5400662f0 2023-07-21T22:11:08.389 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:08.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.349+0000 7fb56299e700 1 -- 172.21.15.49:0/635433089 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb5400662f0 msgr2=0x7fb5400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:08.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.349+0000 7fb56299e700 1 --2- 172.21.15.49:0/635433089 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb5400662f0 0x7fb5400687a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb558000c00 tx=0x7fb558008030 comp rx=0 tx=0).stop 2023-07-21T22:11:08.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.349+0000 7fb56299e700 1 -- 172.21.15.49:0/635433089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb55c160370 msgr2=0x7fb55c0b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:08.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.349+0000 7fb56299e700 1 --2- 172.21.15.49:0/635433089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb55c160370 0x7fb55c0b3680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb55400cc50 tx=0x7fb55400cf60 comp rx=0 tx=0).stop 2023-07-21T22:11:08.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.349+0000 7fb56299e700 1 -- 172.21.15.49:0/635433089 shutdown_connections 2023-07-21T22:11:08.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.349+0000 7fb56299e700 1 --2- 172.21.15.49:0/635433089 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb5400662f0 0x7fb5400687a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.349+0000 7fb56299e700 1 --2- 172.21.15.49:0/635433089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb55c160370 0x7fb55c0b3680 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.349+0000 7fb56299e700 1 --2- 172.21.15.49:0/635433089 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb55c0ca2c0 0x7fb55c0b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.349+0000 7fb56299e700 1 --2- 172.21.15.49:0/635433089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb55c0c1470 0x7fb55c15a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.349+0000 7fb56299e700 1 -- 172.21.15.49:0/635433089 >> 172.21.15.49:0/635433089 conn(0x7fb55c070450 msgr2=0x7fb55c0ae910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:08.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.349+0000 7fb56299e700 1 -- 172.21.15.49:0/635433089 shutdown_connections 2023-07-21T22:11:08.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.349+0000 7fb56299e700 1 -- 172.21.15.49:0/635433089 wait complete. 2023-07-21T22:11:08.394 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:11:08.411 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2023-07-21T22:11:08.314307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231624,"kb_used_data":3720,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754743096,"statfs":{"total":773094113280,"available":772856930304,"internally_reserved":0,"allocated":3809280,"data_stored":2233358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005491"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148041+0000","last_change":"2023-07-21T22:10:39.285920+0000","last_active":"2023-07-21T22:10:41.148041+0000","last_peered":"2023-07-21T22:10:41.148041+0000","last_clean":"2023-07-21T22:10:41.148041+0000","last_became_active":"2023-07-21T22:10:39.285402+0000","last_became_peered":"2023-07-21T22:10:39.285402+0000","last_unstale":"2023-07-21T22:10:41.148041+0000","last_undegraded":"2023-07-21T22:10:41.148041+0000","last_fullsized":"2023-07-21T22:10:41.148041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:53.331934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146444+0000","last_change":"2023-07-21T22:10:34.187231+0000","last_active":"2023-07-21T22:10:41.146444+0000","last_peered":"2023-07-21T22:10:41.146444+0000","last_clean":"2023-07-21T22:10:41.146444+0000","last_became_active":"2023-07-21T22:10:34.186893+0000","last_became_peered":"2023-07-21T22:10:34.186893+0000","last_unstale":"2023-07-21T22:10:41.146444+0000","last_undegraded":"2023-07-21T22:10:41.146444+0000","last_fullsized":"2023-07-21T22:10:41.146444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:35:27.556960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263558+0000","last_change":"2023-07-21T22:10:35.187303+0000","last_active":"2023-07-21T22:10:40.263558+0000","last_peered":"2023-07-21T22:10:40.263558+0000","last_clean":"2023-07-21T22:10:40.263558+0000","last_became_active":"2023-07-21T22:10:35.186998+0000","last_became_peered":"2023-07-21T22:10:35.186998+0000","last_unstale":"2023-07-21T22:10:40.263558+0000","last_undegraded":"2023-07-21T22:10:40.263558+0000","last_fullsized":"2023-07-21T22:10:40.263558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:14.259344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263311+0000","last_change":"2023-07-21T22:10:39.284321+0000","last_active":"2023-07-21T22:10:40.263311+0000","last_peered":"2023-07-21T22:10:40.263311+0000","last_clean":"2023-07-21T22:10:40.263311+0000","last_became_active":"2023-07-21T22:10:39.283184+0000","last_became_peered":"2023-07-21T22:10:39.283184+0000","last_unstale":"2023-07-21T22:10:40.263311+0000","last_undegraded":"2023-07-21T22:10:40.263311+0000","last_fullsized":"2023-07-21T22:10:40.263311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:02:07.314838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643758+0000","last_change":"2023-07-21T22:10:34.183067+0000","last_active":"2023-07-21T22:10:40.643758+0000","last_peered":"2023-07-21T22:10:40.643758+0000","last_clean":"2023-07-21T22:10:40.643758+0000","last_became_active":"2023-07-21T22:10:34.182744+0000","last_became_peered":"2023-07-21T22:10:34.182744+0000","last_unstale":"2023-07-21T22:10:40.643758+0000","last_undegraded":"2023-07-21T22:10:40.643758+0000","last_fullsized":"2023-07-21T22:10:40.643758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:16:50.409495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643472+0000","last_change":"2023-07-21T22:10:35.193952+0000","last_active":"2023-07-21T22:10:40.643472+0000","last_peered":"2023-07-21T22:10:40.643472+0000","last_clean":"2023-07-21T22:10:40.643472+0000","last_became_active":"2023-07-21T22:10:35.193594+0000","last_became_peered":"2023-07-21T22:10:35.193594+0000","last_unstale":"2023-07-21T22:10:40.643472+0000","last_undegraded":"2023-07-21T22:10:40.643472+0000","last_fullsized":"2023-07-21T22:10:40.643472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:23:35.116197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265724+0000","last_change":"2023-07-21T22:10:39.275701+0000","last_active":"2023-07-21T22:10:40.265724+0000","last_peered":"2023-07-21T22:10:40.265724+0000","last_clean":"2023-07-21T22:10:40.265724+0000","last_became_active":"2023-07-21T22:10:39.275276+0000","last_became_peered":"2023-07-21T22:10:39.275276+0000","last_unstale":"2023-07-21T22:10:40.265724+0000","last_undegraded":"2023-07-21T22:10:40.265724+0000","last_fullsized":"2023-07-21T22:10:40.265724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:52.259693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266022+0000","last_change":"2023-07-21T22:10:34.189037+0000","last_active":"2023-07-21T22:10:40.266022+0000","last_peered":"2023-07-21T22:10:40.266022+0000","last_clean":"2023-07-21T22:10:40.266022+0000","last_became_active":"2023-07-21T22:10:34.188705+0000","last_became_peered":"2023-07-21T22:10:34.188705+0000","last_unstale":"2023-07-21T22:10:40.266022+0000","last_undegraded":"2023-07-21T22:10:40.266022+0000","last_fullsized":"2023-07-21T22:10:40.266022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:32:09.815085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264089+0000","last_change":"2023-07-21T22:10:35.190920+0000","last_active":"2023-07-21T22:10:40.264089+0000","last_peered":"2023-07-21T22:10:40.264089+0000","last_clean":"2023-07-21T22:10:40.264089+0000","last_became_active":"2023-07-21T22:10:35.190624+0000","last_became_peered":"2023-07-21T22:10:35.190624+0000","last_unstale":"2023-07-21T22:10:40.264089+0000","last_undegraded":"2023-07-21T22:10:40.264089+0000","last_fullsized":"2023-07-21T22:10:40.264089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:24:44.643941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145887+0000","last_change":"2023-07-21T22:10:39.288143+0000","last_active":"2023-07-21T22:10:41.145887+0000","last_peered":"2023-07-21T22:10:41.145887+0000","last_clean":"2023-07-21T22:10:41.145887+0000","last_became_active":"2023-07-21T22:10:39.287727+0000","last_became_peered":"2023-07-21T22:10:39.287727+0000","last_unstale":"2023-07-21T22:10:41.145887+0000","last_undegraded":"2023-07-21T22:10:41.145887+0000","last_fullsized":"2023-07-21T22:10:41.145887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:55:32.701346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265495+0000","last_change":"2023-07-21T22:10:34.189233+0000","last_active":"2023-07-21T22:10:40.265495+0000","last_peered":"2023-07-21T22:10:40.265495+0000","last_clean":"2023-07-21T22:10:40.265495+0000","last_became_active":"2023-07-21T22:10:34.188693+0000","last_became_peered":"2023-07-21T22:10:34.188693+0000","last_unstale":"2023-07-21T22:10:40.265495+0000","last_undegraded":"2023-07-21T22:10:40.265495+0000","last_fullsized":"2023-07-21T22:10:40.265495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:19.034773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263831+0000","last_change":"2023-07-21T22:10:35.196227+0000","last_active":"2023-07-21T22:10:40.263831+0000","last_peered":"2023-07-21T22:10:40.263831+0000","last_clean":"2023-07-21T22:10:40.263831+0000","last_became_active":"2023-07-21T22:10:35.195975+0000","last_became_peered":"2023-07-21T22:10:35.195975+0000","last_unstale":"2023-07-21T22:10:40.263831+0000","last_undegraded":"2023-07-21T22:10:40.263831+0000","last_fullsized":"2023-07-21T22:10:40.263831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:42:02.828468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147542+0000","last_change":"2023-07-21T22:10:39.286940+0000","last_active":"2023-07-21T22:10:41.147542+0000","last_peered":"2023-07-21T22:10:41.147542+0000","last_clean":"2023-07-21T22:10:41.147542+0000","last_became_active":"2023-07-21T22:10:39.286471+0000","last_became_peered":"2023-07-21T22:10:39.286471+0000","last_unstale":"2023-07-21T22:10:41.147542+0000","last_undegraded":"2023-07-21T22:10:41.147542+0000","last_fullsized":"2023-07-21T22:10:41.147542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:44.332920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147513+0000","last_change":"2023-07-21T22:10:34.195078+0000","last_active":"2023-07-21T22:10:41.147513+0000","last_peered":"2023-07-21T22:10:41.147513+0000","last_clean":"2023-07-21T22:10:41.147513+0000","last_became_active":"2023-07-21T22:10:34.194778+0000","last_became_peered":"2023-07-21T22:10:34.194778+0000","last_unstale":"2023-07-21T22:10:41.147513+0000","last_undegraded":"2023-07-21T22:10:41.147513+0000","last_fullsized":"2023-07-21T22:10:41.147513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:13:31.016122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262886+0000","last_change":"2023-07-21T22:10:35.184187+0000","last_active":"2023-07-21T22:10:40.262886+0000","last_peered":"2023-07-21T22:10:40.262886+0000","last_clean":"2023-07-21T22:10:40.262886+0000","last_became_active":"2023-07-21T22:10:35.183664+0000","last_became_peered":"2023-07-21T22:10:35.183664+0000","last_unstale":"2023-07-21T22:10:40.262886+0000","last_undegraded":"2023-07-21T22:10:40.262886+0000","last_fullsized":"2023-07-21T22:10:40.262886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:17:19.358440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264275+0000","last_change":"2023-07-21T22:10:39.277910+0000","last_active":"2023-07-21T22:10:40.264275+0000","last_peered":"2023-07-21T22:10:40.264275+0000","last_clean":"2023-07-21T22:10:40.264275+0000","last_became_active":"2023-07-21T22:10:39.277601+0000","last_became_peered":"2023-07-21T22:10:39.277601+0000","last_unstale":"2023-07-21T22:10:40.264275+0000","last_undegraded":"2023-07-21T22:10:40.264275+0000","last_fullsized":"2023-07-21T22:10:40.264275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:41:03.813859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264319+0000","last_change":"2023-07-21T22:10:34.181116+0000","last_active":"2023-07-21T22:10:40.264319+0000","last_peered":"2023-07-21T22:10:40.264319+0000","last_clean":"2023-07-21T22:10:40.264319+0000","last_became_active":"2023-07-21T22:10:34.180817+0000","last_became_peered":"2023-07-21T22:10:34.180817+0000","last_unstale":"2023-07-21T22:10:40.264319+0000","last_undegraded":"2023-07-21T22:10:40.264319+0000","last_fullsized":"2023-07-21T22:10:40.264319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:29.537599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644380+0000","last_change":"2023-07-21T22:10:35.198715+0000","last_active":"2023-07-21T22:10:40.644380+0000","last_peered":"2023-07-21T22:10:40.644380+0000","last_clean":"2023-07-21T22:10:40.644380+0000","last_became_active":"2023-07-21T22:10:35.196452+0000","last_became_peered":"2023-07-21T22:10:35.196452+0000","last_unstale":"2023-07-21T22:10:40.644380+0000","last_undegraded":"2023-07-21T22:10:40.644380+0000","last_fullsized":"2023-07-21T22:10:40.644380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:54.017939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146548+0000","last_change":"2023-07-21T22:10:39.282183+0000","last_active":"2023-07-21T22:10:41.146548+0000","last_peered":"2023-07-21T22:10:41.146548+0000","last_clean":"2023-07-21T22:10:41.146548+0000","last_became_active":"2023-07-21T22:10:39.281786+0000","last_became_peered":"2023-07-21T22:10:39.281786+0000","last_unstale":"2023-07-21T22:10:41.146548+0000","last_undegraded":"2023-07-21T22:10:41.146548+0000","last_fullsized":"2023-07-21T22:10:41.146548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:36.102033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148156+0000","last_change":"2023-07-21T22:10:34.189390+0000","last_active":"2023-07-21T22:10:41.148156+0000","last_peered":"2023-07-21T22:10:41.148156+0000","last_clean":"2023-07-21T22:10:41.148156+0000","last_became_active":"2023-07-21T22:10:34.189100+0000","last_became_peered":"2023-07-21T22:10:34.189100+0000","last_unstale":"2023-07-21T22:10:41.148156+0000","last_undegraded":"2023-07-21T22:10:41.148156+0000","last_fullsized":"2023-07-21T22:10:41.148156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:51:46.906168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146955+0000","last_change":"2023-07-21T22:10:35.186334+0000","last_active":"2023-07-21T22:10:41.146955+0000","last_peered":"2023-07-21T22:10:41.146955+0000","last_clean":"2023-07-21T22:10:41.146955+0000","last_became_active":"2023-07-21T22:10:35.186027+0000","last_became_peered":"2023-07-21T22:10:35.186027+0000","last_unstale":"2023-07-21T22:10:41.146955+0000","last_undegraded":"2023-07-21T22:10:41.146955+0000","last_fullsized":"2023-07-21T22:10:41.146955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:26.382303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146339+0000","last_change":"2023-07-21T22:10:39.283921+0000","last_active":"2023-07-21T22:10:41.146339+0000","last_peered":"2023-07-21T22:10:41.146339+0000","last_clean":"2023-07-21T22:10:41.146339+0000","last_became_active":"2023-07-21T22:10:39.283579+0000","last_became_peered":"2023-07-21T22:10:39.283579+0000","last_unstale":"2023-07-21T22:10:41.146339+0000","last_undegraded":"2023-07-21T22:10:41.146339+0000","last_fullsized":"2023-07-21T22:10:41.146339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:33:27.956737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643473+0000","last_change":"2023-07-21T22:10:34.185811+0000","last_active":"2023-07-21T22:10:40.643473+0000","last_peered":"2023-07-21T22:10:40.643473+0000","last_clean":"2023-07-21T22:10:40.643473+0000","last_became_active":"2023-07-21T22:10:34.185528+0000","last_became_peered":"2023-07-21T22:10:34.185528+0000","last_unstale":"2023-07-21T22:10:40.643473+0000","last_undegraded":"2023-07-21T22:10:40.643473+0000","last_fullsized":"2023-07-21T22:10:40.643473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:32:55.911711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146562+0000","last_change":"2023-07-21T22:10:35.181437+0000","last_active":"2023-07-21T22:10:41.146562+0000","last_peered":"2023-07-21T22:10:41.146562+0000","last_clean":"2023-07-21T22:10:41.146562+0000","last_became_active":"2023-07-21T22:10:35.181153+0000","last_became_peered":"2023-07-21T22:10:35.181153+0000","last_unstale":"2023-07-21T22:10:41.146562+0000","last_undegraded":"2023-07-21T22:10:41.146562+0000","last_fullsized":"2023-07-21T22:10:41.146562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:15.974063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643126+0000","last_change":"2023-07-21T22:10:35.191719+0000","last_active":"2023-07-21T22:10:40.643126+0000","last_peered":"2023-07-21T22:10:40.643126+0000","last_clean":"2023-07-21T22:10:40.643126+0000","last_became_active":"2023-07-21T22:10:35.191220+0000","last_became_peered":"2023-07-21T22:10:35.191220+0000","last_unstale":"2023-07-21T22:10:40.643126+0000","last_undegraded":"2023-07-21T22:10:40.643126+0000","last_fullsized":"2023-07-21T22:10:40.643126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:33.738041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146486+0000","last_change":"2023-07-21T22:10:34.187207+0000","last_active":"2023-07-21T22:10:41.146486+0000","last_peered":"2023-07-21T22:10:41.146486+0000","last_clean":"2023-07-21T22:10:41.146486+0000","last_became_active":"2023-07-21T22:10:34.185806+0000","last_became_peered":"2023-07-21T22:10:34.185806+0000","last_unstale":"2023-07-21T22:10:41.146486+0000","last_undegraded":"2023-07-21T22:10:41.146486+0000","last_fullsized":"2023-07-21T22:10:41.146486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:17.068811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144651+0000","last_change":"2023-07-21T22:10:39.284138+0000","last_active":"2023-07-21T22:10:41.144651+0000","last_peered":"2023-07-21T22:10:41.144651+0000","last_clean":"2023-07-21T22:10:41.144651+0000","last_became_active":"2023-07-21T22:10:39.283678+0000","last_became_peered":"2023-07-21T22:10:39.283678+0000","last_unstale":"2023-07-21T22:10:41.144651+0000","last_undegraded":"2023-07-21T22:10:41.144651+0000","last_fullsized":"2023-07-21T22:10:41.144651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:52.307715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643341+0000","last_change":"2023-07-21T22:10:35.193661+0000","last_active":"2023-07-21T22:10:40.643341+0000","last_peered":"2023-07-21T22:10:40.643341+0000","last_clean":"2023-07-21T22:10:40.643341+0000","last_became_active":"2023-07-21T22:10:35.193205+0000","last_became_peered":"2023-07-21T22:10:35.193205+0000","last_unstale":"2023-07-21T22:10:40.643341+0000","last_undegraded":"2023-07-21T22:10:40.643341+0000","last_fullsized":"2023-07-21T22:10:40.643341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:44:13.704282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266550+0000","last_change":"2023-07-21T22:10:34.178085+0000","last_active":"2023-07-21T22:10:40.266550+0000","last_peered":"2023-07-21T22:10:40.266550+0000","last_clean":"2023-07-21T22:10:40.266550+0000","last_became_active":"2023-07-21T22:10:34.177713+0000","last_became_peered":"2023-07-21T22:10:34.177713+0000","last_unstale":"2023-07-21T22:10:40.266550+0000","last_undegraded":"2023-07-21T22:10:40.266550+0000","last_fullsized":"2023-07-21T22:10:40.266550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:20:06.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144877+0000","last_change":"2023-07-21T22:10:39.284566+0000","last_active":"2023-07-21T22:10:41.144877+0000","last_peered":"2023-07-21T22:10:41.144877+0000","last_clean":"2023-07-21T22:10:41.144877+0000","last_became_active":"2023-07-21T22:10:39.284100+0000","last_became_peered":"2023-07-21T22:10:39.284100+0000","last_unstale":"2023-07-21T22:10:41.144877+0000","last_undegraded":"2023-07-21T22:10:41.144877+0000","last_fullsized":"2023-07-21T22:10:41.144877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:31:22.286788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146666+0000","last_change":"2023-07-21T22:10:34.190125+0000","last_active":"2023-07-21T22:10:41.146666+0000","last_peered":"2023-07-21T22:10:41.146666+0000","last_clean":"2023-07-21T22:10:41.146666+0000","last_became_active":"2023-07-21T22:10:34.189780+0000","last_became_peered":"2023-07-21T22:10:34.189780+0000","last_unstale":"2023-07-21T22:10:41.146666+0000","last_undegraded":"2023-07-21T22:10:41.146666+0000","last_fullsized":"2023-07-21T22:10:41.146666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:53.502850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147220+0000","last_change":"2023-07-21T22:10:35.186228+0000","last_active":"2023-07-21T22:10:41.147220+0000","last_peered":"2023-07-21T22:10:41.147220+0000","last_clean":"2023-07-21T22:10:41.147220+0000","last_became_active":"2023-07-21T22:10:35.185965+0000","last_became_peered":"2023-07-21T22:10:35.185965+0000","last_unstale":"2023-07-21T22:10:41.147220+0000","last_undegraded":"2023-07-21T22:10:41.147220+0000","last_fullsized":"2023-07-21T22:10:41.147220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:15:55.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643839+0000","last_change":"2023-07-21T22:10:39.283587+0000","last_active":"2023-07-21T22:10:40.643839+0000","last_peered":"2023-07-21T22:10:40.643839+0000","last_clean":"2023-07-21T22:10:40.643839+0000","last_became_active":"2023-07-21T22:10:39.283180+0000","last_became_peered":"2023-07-21T22:10:39.283180+0000","last_unstale":"2023-07-21T22:10:40.643839+0000","last_undegraded":"2023-07-21T22:10:40.643839+0000","last_fullsized":"2023-07-21T22:10:40.643839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:38.593377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"30'10","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:52.945484+0000","last_change":"2023-07-21T22:10:34.185183+0000","last_active":"2023-07-21T22:10:52.945484+0000","last_peered":"2023-07-21T22:10:52.945484+0000","last_clean":"2023-07-21T22:10:52.945484+0000","last_became_active":"2023-07-21T22:10:34.184368+0000","last_became_peered":"2023-07-21T22:10:34.184368+0000","last_unstale":"2023-07-21T22:10:52.945484+0000","last_undegraded":"2023-07-21T22:10:52.945484+0000","last_fullsized":"2023-07-21T22:10:52.945484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:08:24.257997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263920+0000","last_change":"2023-07-21T22:10:35.177131+0000","last_active":"2023-07-21T22:10:40.263920+0000","last_peered":"2023-07-21T22:10:40.263920+0000","last_clean":"2023-07-21T22:10:40.263920+0000","last_became_active":"2023-07-21T22:10:35.176633+0000","last_became_peered":"2023-07-21T22:10:35.176633+0000","last_unstale":"2023-07-21T22:10:40.263920+0000","last_undegraded":"2023-07-21T22:10:40.263920+0000","last_fullsized":"2023-07-21T22:10:40.263920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:20:38.535159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145828+0000","last_change":"2023-07-21T22:10:39.287688+0000","last_active":"2023-07-21T22:10:41.145828+0000","last_peered":"2023-07-21T22:10:41.145828+0000","last_clean":"2023-07-21T22:10:41.145828+0000","last_became_active":"2023-07-21T22:10:39.285544+0000","last_became_peered":"2023-07-21T22:10:39.285544+0000","last_unstale":"2023-07-21T22:10:41.145828+0000","last_undegraded":"2023-07-21T22:10:41.145828+0000","last_fullsized":"2023-07-21T22:10:41.145828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:36.370365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264245+0000","last_change":"2023-07-21T22:10:35.176961+0000","last_active":"2023-07-21T22:10:40.264245+0000","last_peered":"2023-07-21T22:10:40.264245+0000","last_clean":"2023-07-21T22:10:40.264245+0000","last_became_active":"2023-07-21T22:10:35.175909+0000","last_became_peered":"2023-07-21T22:10:35.175909+0000","last_unstale":"2023-07-21T22:10:40.264245+0000","last_undegraded":"2023-07-21T22:10:40.264245+0000","last_fullsized":"2023-07-21T22:10:40.264245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:47:46.146151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146724+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:10:41.146724+0000","last_peered":"2023-07-21T22:10:41.146724+0000","last_clean":"2023-07-21T22:10:41.146724+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:10:41.146724+0000","last_undegraded":"2023-07-21T22:10:41.146724+0000","last_fullsized":"2023-07-21T22:10:41.146724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:47:22.065189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147620+0000","last_change":"2023-07-21T22:10:34.185463+0000","last_active":"2023-07-21T22:10:41.147620+0000","last_peered":"2023-07-21T22:10:41.147620+0000","last_clean":"2023-07-21T22:10:41.147620+0000","last_became_active":"2023-07-21T22:10:34.185164+0000","last_became_peered":"2023-07-21T22:10:34.185164+0000","last_unstale":"2023-07-21T22:10:41.147620+0000","last_undegraded":"2023-07-21T22:10:41.147620+0000","last_fullsized":"2023-07-21T22:10:41.147620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:07.490045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643172+0000","last_change":"2023-07-21T22:10:39.295728+0000","last_active":"2023-07-21T22:10:40.643172+0000","last_peered":"2023-07-21T22:10:40.643172+0000","last_clean":"2023-07-21T22:10:40.643172+0000","last_became_active":"2023-07-21T22:10:39.295285+0000","last_became_peered":"2023-07-21T22:10:39.295285+0000","last_unstale":"2023-07-21T22:10:40.643172+0000","last_undegraded":"2023-07-21T22:10:40.643172+0000","last_fullsized":"2023-07-21T22:10:40.643172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:42.629475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643332+0000","last_change":"2023-07-21T22:10:35.191518+0000","last_active":"2023-07-21T22:10:40.643332+0000","last_peered":"2023-07-21T22:10:40.643332+0000","last_clean":"2023-07-21T22:10:40.643332+0000","last_became_active":"2023-07-21T22:10:35.190851+0000","last_became_peered":"2023-07-21T22:10:35.190851+0000","last_unstale":"2023-07-21T22:10:40.643332+0000","last_undegraded":"2023-07-21T22:10:40.643332+0000","last_fullsized":"2023-07-21T22:10:40.643332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:31.644944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148333+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:10:41.148333+0000","last_peered":"2023-07-21T22:10:41.148333+0000","last_clean":"2023-07-21T22:10:41.148333+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:10:41.148333+0000","last_undegraded":"2023-07-21T22:10:41.148333+0000","last_fullsized":"2023-07-21T22:10:41.148333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:52.095138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644583+0000","last_change":"2023-07-21T22:10:34.180214+0000","last_active":"2023-07-21T22:10:40.644583+0000","last_peered":"2023-07-21T22:10:40.644583+0000","last_clean":"2023-07-21T22:10:40.644583+0000","last_became_active":"2023-07-21T22:10:34.179689+0000","last_became_peered":"2023-07-21T22:10:34.179689+0000","last_unstale":"2023-07-21T22:10:40.644583+0000","last_undegraded":"2023-07-21T22:10:40.644583+0000","last_fullsized":"2023-07-21T22:10:40.644583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:49.373811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263542+0000","last_change":"2023-07-21T22:10:39.277033+0000","last_active":"2023-07-21T22:10:40.263542+0000","last_peered":"2023-07-21T22:10:40.263542+0000","last_clean":"2023-07-21T22:10:40.263542+0000","last_became_active":"2023-07-21T22:10:39.276652+0000","last_became_peered":"2023-07-21T22:10:39.276652+0000","last_unstale":"2023-07-21T22:10:40.263542+0000","last_undegraded":"2023-07-21T22:10:40.263542+0000","last_fullsized":"2023-07-21T22:10:40.263542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:15:28.734422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146510+0000","last_change":"2023-07-21T22:10:35.183693+0000","last_active":"2023-07-21T22:10:41.146510+0000","last_peered":"2023-07-21T22:10:41.146510+0000","last_clean":"2023-07-21T22:10:41.146510+0000","last_became_active":"2023-07-21T22:10:35.182990+0000","last_became_peered":"2023-07-21T22:10:35.182990+0000","last_unstale":"2023-07-21T22:10:41.146510+0000","last_undegraded":"2023-07-21T22:10:41.146510+0000","last_fullsized":"2023-07-21T22:10:41.146510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:19:08.043869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147014+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:10:41.147014+0000","last_peered":"2023-07-21T22:10:41.147014+0000","last_clean":"2023-07-21T22:10:41.147014+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:10:41.147014+0000","last_undegraded":"2023-07-21T22:10:41.147014+0000","last_fullsized":"2023-07-21T22:10:41.147014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:42.440048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147957+0000","last_change":"2023-07-21T22:10:34.181525+0000","last_active":"2023-07-21T22:10:41.147957+0000","last_peered":"2023-07-21T22:10:41.147957+0000","last_clean":"2023-07-21T22:10:41.147957+0000","last_became_active":"2023-07-21T22:10:34.180865+0000","last_became_peered":"2023-07-21T22:10:34.180865+0000","last_unstale":"2023-07-21T22:10:41.147957+0000","last_undegraded":"2023-07-21T22:10:41.147957+0000","last_fullsized":"2023-07-21T22:10:41.147957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:18.845683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145191+0000","last_change":"2023-07-21T22:10:39.285010+0000","last_active":"2023-07-21T22:10:41.145191+0000","last_peered":"2023-07-21T22:10:41.145191+0000","last_clean":"2023-07-21T22:10:41.145191+0000","last_became_active":"2023-07-21T22:10:39.283077+0000","last_became_peered":"2023-07-21T22:10:39.283077+0000","last_unstale":"2023-07-21T22:10:41.145191+0000","last_undegraded":"2023-07-21T22:10:41.145191+0000","last_fullsized":"2023-07-21T22:10:41.145191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:07.012665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147524+0000","last_change":"2023-07-21T22:10:35.181554+0000","last_active":"2023-07-21T22:10:41.147524+0000","last_peered":"2023-07-21T22:10:41.147524+0000","last_clean":"2023-07-21T22:10:41.147524+0000","last_became_active":"2023-07-21T22:10:35.180489+0000","last_became_peered":"2023-07-21T22:10:35.180489+0000","last_unstale":"2023-07-21T22:10:41.147524+0000","last_undegraded":"2023-07-21T22:10:41.147524+0000","last_fullsized":"2023-07-21T22:10:41.147524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:10.196079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147886+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:10:41.147886+0000","last_peered":"2023-07-21T22:10:41.147886+0000","last_clean":"2023-07-21T22:10:41.147886+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:10:41.147886+0000","last_undegraded":"2023-07-21T22:10:41.147886+0000","last_fullsized":"2023-07-21T22:10:41.147886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:13.984747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266059+0000","last_change":"2023-07-21T22:10:34.190035+0000","last_active":"2023-07-21T22:10:40.266059+0000","last_peered":"2023-07-21T22:10:40.266059+0000","last_clean":"2023-07-21T22:10:40.266059+0000","last_became_active":"2023-07-21T22:10:34.188881+0000","last_became_peered":"2023-07-21T22:10:34.188881+0000","last_unstale":"2023-07-21T22:10:40.266059+0000","last_undegraded":"2023-07-21T22:10:40.266059+0000","last_fullsized":"2023-07-21T22:10:40.266059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:09.950174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146612+0000","last_change":"2023-07-21T22:10:39.279664+0000","last_active":"2023-07-21T22:10:41.146612+0000","last_peered":"2023-07-21T22:10:41.146612+0000","last_clean":"2023-07-21T22:10:41.146612+0000","last_became_active":"2023-07-21T22:10:39.279267+0000","last_became_peered":"2023-07-21T22:10:39.279267+0000","last_unstale":"2023-07-21T22:10:41.146612+0000","last_undegraded":"2023-07-21T22:10:41.146612+0000","last_fullsized":"2023-07-21T22:10:41.146612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:09.200877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147703+0000","last_change":"2023-07-21T22:10:35.182579+0000","last_active":"2023-07-21T22:10:41.147703+0000","last_peered":"2023-07-21T22:10:41.147703+0000","last_clean":"2023-07-21T22:10:41.147703+0000","last_became_active":"2023-07-21T22:10:35.182269+0000","last_became_peered":"2023-07-21T22:10:35.182269+0000","last_unstale":"2023-07-21T22:10:41.147703+0000","last_undegraded":"2023-07-21T22:10:41.147703+0000","last_fullsized":"2023-07-21T22:10:41.147703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:48.503179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264029+0000","last_change":"2023-07-21T22:10:34.188309+0000","last_active":"2023-07-21T22:10:40.264029+0000","last_peered":"2023-07-21T22:10:40.264029+0000","last_clean":"2023-07-21T22:10:40.264029+0000","last_became_active":"2023-07-21T22:10:34.187999+0000","last_became_peered":"2023-07-21T22:10:34.187999+0000","last_unstale":"2023-07-21T22:10:40.264029+0000","last_undegraded":"2023-07-21T22:10:40.264029+0000","last_fullsized":"2023-07-21T22:10:40.264029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:13:37.870348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265143+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:10:40.265143+0000","last_peered":"2023-07-21T22:10:40.265143+0000","last_clean":"2023-07-21T22:10:40.265143+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:10:40.265143+0000","last_undegraded":"2023-07-21T22:10:40.265143+0000","last_fullsized":"2023-07-21T22:10:40.265143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:42.440048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146356+0000","last_change":"2023-07-21T22:10:39.279822+0000","last_active":"2023-07-21T22:10:41.146356+0000","last_peered":"2023-07-21T22:10:41.146356+0000","last_clean":"2023-07-21T22:10:41.146356+0000","last_became_active":"2023-07-21T22:10:39.279315+0000","last_became_peered":"2023-07-21T22:10:39.279315+0000","last_unstale":"2023-07-21T22:10:41.146356+0000","last_undegraded":"2023-07-21T22:10:41.146356+0000","last_fullsized":"2023-07-21T22:10:41.146356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:04:04.200991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147521+0000","last_change":"2023-07-21T22:10:35.184632+0000","last_active":"2023-07-21T22:10:41.147521+0000","last_peered":"2023-07-21T22:10:41.147521+0000","last_clean":"2023-07-21T22:10:41.147521+0000","last_became_active":"2023-07-21T22:10:35.184294+0000","last_became_peered":"2023-07-21T22:10:35.184294+0000","last_unstale":"2023-07-21T22:10:41.147521+0000","last_undegraded":"2023-07-21T22:10:41.147521+0000","last_fullsized":"2023-07-21T22:10:41.147521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:54.515955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146420+0000","last_change":"2023-07-21T22:10:34.182197+0000","last_active":"2023-07-21T22:10:41.146420+0000","last_peered":"2023-07-21T22:10:41.146420+0000","last_clean":"2023-07-21T22:10:41.146420+0000","last_became_active":"2023-07-21T22:10:34.181919+0000","last_became_peered":"2023-07-21T22:10:34.181919+0000","last_unstale":"2023-07-21T22:10:41.146420+0000","last_undegraded":"2023-07-21T22:10:41.146420+0000","last_fullsized":"2023-07-21T22:10:41.146420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:55:27.605200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261707+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:10:40.261707+0000","last_peered":"2023-07-21T22:10:40.261707+0000","last_clean":"2023-07-21T22:10:40.261707+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:10:40.261707+0000","last_undegraded":"2023-07-21T22:10:40.261707+0000","last_fullsized":"2023-07-21T22:10:40.261707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:52.407450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262619+0000","last_change":"2023-07-21T22:10:39.289595+0000","last_active":"2023-07-21T22:10:40.262619+0000","last_peered":"2023-07-21T22:10:40.262619+0000","last_clean":"2023-07-21T22:10:40.262619+0000","last_became_active":"2023-07-21T22:10:39.289158+0000","last_became_peered":"2023-07-21T22:10:39.289158+0000","last_unstale":"2023-07-21T22:10:40.262619+0000","last_undegraded":"2023-07-21T22:10:40.262619+0000","last_fullsized":"2023-07-21T22:10:40.262619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:06:55.084320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147467+0000","last_change":"2023-07-21T22:10:35.185318+0000","last_active":"2023-07-21T22:10:41.147467+0000","last_peered":"2023-07-21T22:10:41.147467+0000","last_clean":"2023-07-21T22:10:41.147467+0000","last_became_active":"2023-07-21T22:10:35.185029+0000","last_became_peered":"2023-07-21T22:10:35.185029+0000","last_unstale":"2023-07-21T22:10:41.147467+0000","last_undegraded":"2023-07-21T22:10:41.147467+0000","last_fullsized":"2023-07-21T22:10:41.147467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:10.274416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145597+0000","last_change":"2023-07-21T22:10:34.189207+0000","last_active":"2023-07-21T22:10:41.145597+0000","last_peered":"2023-07-21T22:10:41.145597+0000","last_clean":"2023-07-21T22:10:41.145597+0000","last_became_active":"2023-07-21T22:10:34.188853+0000","last_became_peered":"2023-07-21T22:10:34.188853+0000","last_unstale":"2023-07-21T22:10:41.145597+0000","last_undegraded":"2023-07-21T22:10:41.145597+0000","last_fullsized":"2023-07-21T22:10:41.145597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:37:58.265151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145150+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:10:41.145150+0000","last_peered":"2023-07-21T22:10:41.145150+0000","last_clean":"2023-07-21T22:10:41.145150+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:10:41.145150+0000","last_undegraded":"2023-07-21T22:10:41.145150+0000","last_fullsized":"2023-07-21T22:10:41.145150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:03:10.317005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266651+0000","last_change":"2023-07-21T22:10:39.280697+0000","last_active":"2023-07-21T22:10:40.266651+0000","last_peered":"2023-07-21T22:10:40.266651+0000","last_clean":"2023-07-21T22:10:40.266651+0000","last_became_active":"2023-07-21T22:10:39.279870+0000","last_became_peered":"2023-07-21T22:10:39.279870+0000","last_unstale":"2023-07-21T22:10:40.266651+0000","last_undegraded":"2023-07-21T22:10:40.266651+0000","last_fullsized":"2023-07-21T22:10:40.266651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:32:46.379437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146280+0000","last_change":"2023-07-21T22:10:35.182836+0000","last_active":"2023-07-21T22:10:41.146280+0000","last_peered":"2023-07-21T22:10:41.146280+0000","last_clean":"2023-07-21T22:10:41.146280+0000","last_became_active":"2023-07-21T22:10:35.182544+0000","last_became_peered":"2023-07-21T22:10:35.182544+0000","last_unstale":"2023-07-21T22:10:41.146280+0000","last_undegraded":"2023-07-21T22:10:41.146280+0000","last_fullsized":"2023-07-21T22:10:41.146280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:50:33.337315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643783+0000","last_change":"2023-07-21T22:10:34.179261+0000","last_active":"2023-07-21T22:10:40.643783+0000","last_peered":"2023-07-21T22:10:40.643783+0000","last_clean":"2023-07-21T22:10:40.643783+0000","last_became_active":"2023-07-21T22:10:34.178960+0000","last_became_peered":"2023-07-21T22:10:34.178960+0000","last_unstale":"2023-07-21T22:10:40.643783+0000","last_undegraded":"2023-07-21T22:10:40.643783+0000","last_fullsized":"2023-07-21T22:10:40.643783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:06.437405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265850+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:10:40.265850+0000","last_peered":"2023-07-21T22:10:40.265850+0000","last_clean":"2023-07-21T22:10:40.265850+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:10:40.265850+0000","last_undegraded":"2023-07-21T22:10:40.265850+0000","last_fullsized":"2023-07-21T22:10:40.265850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:19:33.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":181,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145465+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:10:41.145465+0000","last_peered":"2023-07-21T22:10:41.145465+0000","last_clean":"2023-07-21T22:10:41.145465+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:10:41.145465+0000","last_undegraded":"2023-07-21T22:10:41.145465+0000","last_fullsized":"2023-07-21T22:10:41.145465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:21.070954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146227+0000","last_change":"2023-07-21T22:10:39.284150+0000","last_active":"2023-07-21T22:10:41.146227+0000","last_peered":"2023-07-21T22:10:41.146227+0000","last_clean":"2023-07-21T22:10:41.146227+0000","last_became_active":"2023-07-21T22:10:39.283381+0000","last_became_peered":"2023-07-21T22:10:39.283381+0000","last_unstale":"2023-07-21T22:10:41.146227+0000","last_undegraded":"2023-07-21T22:10:41.146227+0000","last_fullsized":"2023-07-21T22:10:41.146227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:15:59.402797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147452+0000","last_change":"2023-07-21T22:10:35.197136+0000","last_active":"2023-07-21T22:10:41.147452+0000","last_peered":"2023-07-21T22:10:41.147452+0000","last_clean":"2023-07-21T22:10:41.147452+0000","last_became_active":"2023-07-21T22:10:35.196793+0000","last_became_peered":"2023-07-21T22:10:35.196793+0000","last_unstale":"2023-07-21T22:10:41.147452+0000","last_undegraded":"2023-07-21T22:10:41.147452+0000","last_fullsized":"2023-07-21T22:10:41.147452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:58:58.416910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643562+0000","last_change":"2023-07-21T22:10:34.182106+0000","last_active":"2023-07-21T22:10:40.643562+0000","last_peered":"2023-07-21T22:10:40.643562+0000","last_clean":"2023-07-21T22:10:40.643562+0000","last_became_active":"2023-07-21T22:10:34.181808+0000","last_became_peered":"2023-07-21T22:10:34.181808+0000","last_unstale":"2023-07-21T22:10:40.643562+0000","last_undegraded":"2023-07-21T22:10:40.643562+0000","last_fullsized":"2023-07-21T22:10:40.643562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:42:55.768979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265150+0000","last_change":"2023-07-21T22:10:39.278199+0000","last_active":"2023-07-21T22:10:40.265150+0000","last_peered":"2023-07-21T22:10:40.265150+0000","last_clean":"2023-07-21T22:10:40.265150+0000","last_became_active":"2023-07-21T22:10:39.277773+0000","last_became_peered":"2023-07-21T22:10:39.277773+0000","last_unstale":"2023-07-21T22:10:40.265150+0000","last_undegraded":"2023-07-21T22:10:40.265150+0000","last_fullsized":"2023-07-21T22:10:40.265150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:32:06.176345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265331+0000","last_change":"2023-07-21T22:10:35.183217+0000","last_active":"2023-07-21T22:10:40.265331+0000","last_peered":"2023-07-21T22:10:40.265331+0000","last_clean":"2023-07-21T22:10:40.265331+0000","last_became_active":"2023-07-21T22:10:35.182856+0000","last_became_peered":"2023-07-21T22:10:35.182856+0000","last_unstale":"2023-07-21T22:10:40.265331+0000","last_undegraded":"2023-07-21T22:10:40.265331+0000","last_fullsized":"2023-07-21T22:10:40.265331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:30:25.920287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264485+0000","last_change":"2023-07-21T22:10:34.187410+0000","last_active":"2023-07-21T22:10:40.264485+0000","last_peered":"2023-07-21T22:10:40.264485+0000","last_clean":"2023-07-21T22:10:40.264485+0000","last_became_active":"2023-07-21T22:10:34.185501+0000","last_became_peered":"2023-07-21T22:10:34.185501+0000","last_unstale":"2023-07-21T22:10:40.264485+0000","last_undegraded":"2023-07-21T22:10:40.264485+0000","last_fullsized":"2023-07-21T22:10:40.264485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:39:44.435404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266593+0000","last_change":"2023-07-21T22:10:39.280745+0000","last_active":"2023-07-21T22:10:40.266593+0000","last_peered":"2023-07-21T22:10:40.266593+0000","last_clean":"2023-07-21T22:10:40.266593+0000","last_became_active":"2023-07-21T22:10:39.279223+0000","last_became_peered":"2023-07-21T22:10:39.279223+0000","last_unstale":"2023-07-21T22:10:40.266593+0000","last_undegraded":"2023-07-21T22:10:40.266593+0000","last_fullsized":"2023-07-21T22:10:40.266593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:54.403892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264956+0000","last_change":"2023-07-21T22:10:35.181575+0000","last_active":"2023-07-21T22:10:40.264956+0000","last_peered":"2023-07-21T22:10:40.264956+0000","last_clean":"2023-07-21T22:10:40.264956+0000","last_became_active":"2023-07-21T22:10:35.181328+0000","last_became_peered":"2023-07-21T22:10:35.181328+0000","last_unstale":"2023-07-21T22:10:40.264956+0000","last_undegraded":"2023-07-21T22:10:40.264956+0000","last_fullsized":"2023-07-21T22:10:40.264956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:42:35.913798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145748+0000","last_change":"2023-07-21T22:10:34.190677+0000","last_active":"2023-07-21T22:10:41.145748+0000","last_peered":"2023-07-21T22:10:41.145748+0000","last_clean":"2023-07-21T22:10:41.145748+0000","last_became_active":"2023-07-21T22:10:34.190379+0000","last_became_peered":"2023-07-21T22:10:34.190379+0000","last_unstale":"2023-07-21T22:10:41.145748+0000","last_undegraded":"2023-07-21T22:10:41.145748+0000","last_fullsized":"2023-07-21T22:10:41.145748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:28:46.376238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147094+0000","last_change":"2023-07-21T22:10:39.285099+0000","last_active":"2023-07-21T22:10:41.147094+0000","last_peered":"2023-07-21T22:10:41.147094+0000","last_clean":"2023-07-21T22:10:41.147094+0000","last_became_active":"2023-07-21T22:10:39.284046+0000","last_became_peered":"2023-07-21T22:10:39.284046+0000","last_unstale":"2023-07-21T22:10:41.147094+0000","last_undegraded":"2023-07-21T22:10:41.147094+0000","last_fullsized":"2023-07-21T22:10:41.147094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:49.251705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264528+0000","last_change":"2023-07-21T22:10:35.193709+0000","last_active":"2023-07-21T22:10:40.264528+0000","last_peered":"2023-07-21T22:10:40.264528+0000","last_clean":"2023-07-21T22:10:40.264528+0000","last_became_active":"2023-07-21T22:10:35.193409+0000","last_became_peered":"2023-07-21T22:10:35.193409+0000","last_unstale":"2023-07-21T22:10:40.264528+0000","last_undegraded":"2023-07-21T22:10:40.264528+0000","last_fullsized":"2023-07-21T22:10:40.264528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:01.253948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644277+0000","last_change":"2023-07-21T22:10:34.185707+0000","last_active":"2023-07-21T22:10:40.644277+0000","last_peered":"2023-07-21T22:10:40.644277+0000","last_clean":"2023-07-21T22:10:40.644277+0000","last_became_active":"2023-07-21T22:10:34.185415+0000","last_became_peered":"2023-07-21T22:10:34.185415+0000","last_unstale":"2023-07-21T22:10:40.644277+0000","last_undegraded":"2023-07-21T22:10:40.644277+0000","last_fullsized":"2023-07-21T22:10:40.644277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:01:57.132624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262536+0000","last_change":"2023-07-21T22:10:39.288923+0000","last_active":"2023-07-21T22:10:40.262536+0000","last_peered":"2023-07-21T22:10:40.262536+0000","last_clean":"2023-07-21T22:10:40.262536+0000","last_became_active":"2023-07-21T22:10:39.284848+0000","last_became_peered":"2023-07-21T22:10:39.284848+0000","last_unstale":"2023-07-21T22:10:40.262536+0000","last_undegraded":"2023-07-21T22:10:40.262536+0000","last_fullsized":"2023-07-21T22:10:40.262536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:54:17.869022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146100+0000","last_change":"2023-07-21T22:10:35.183881+0000","last_active":"2023-07-21T22:10:41.146100+0000","last_peered":"2023-07-21T22:10:41.146100+0000","last_clean":"2023-07-21T22:10:41.146100+0000","last_became_active":"2023-07-21T22:10:35.183392+0000","last_became_peered":"2023-07-21T22:10:35.183392+0000","last_unstale":"2023-07-21T22:10:41.146100+0000","last_undegraded":"2023-07-21T22:10:41.146100+0000","last_fullsized":"2023-07-21T22:10:41.146100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:17:44.809522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265587+0000","last_change":"2023-07-21T22:10:34.189475+0000","last_active":"2023-07-21T22:10:40.265587+0000","last_peered":"2023-07-21T22:10:40.265587+0000","last_clean":"2023-07-21T22:10:40.265587+0000","last_became_active":"2023-07-21T22:10:34.189101+0000","last_became_peered":"2023-07-21T22:10:34.189101+0000","last_unstale":"2023-07-21T22:10:40.265587+0000","last_undegraded":"2023-07-21T22:10:40.265587+0000","last_fullsized":"2023-07-21T22:10:40.265587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:48.235788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261969+0000","last_change":"2023-07-21T22:10:39.288287+0000","last_active":"2023-07-21T22:10:40.261969+0000","last_peered":"2023-07-21T22:10:40.261969+0000","last_clean":"2023-07-21T22:10:40.261969+0000","last_became_active":"2023-07-21T22:10:39.285298+0000","last_became_peered":"2023-07-21T22:10:39.285298+0000","last_unstale":"2023-07-21T22:10:40.261969+0000","last_undegraded":"2023-07-21T22:10:40.261969+0000","last_fullsized":"2023-07-21T22:10:40.261969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:50:45.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145472+0000","last_change":"2023-07-21T22:10:35.189604+0000","last_active":"2023-07-21T22:10:41.145472+0000","last_peered":"2023-07-21T22:10:41.145472+0000","last_clean":"2023-07-21T22:10:41.145472+0000","last_became_active":"2023-07-21T22:10:35.189358+0000","last_became_peered":"2023-07-21T22:10:35.189358+0000","last_unstale":"2023-07-21T22:10:41.145472+0000","last_undegraded":"2023-07-21T22:10:41.145472+0000","last_fullsized":"2023-07-21T22:10:41.145472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:57.173528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146814+0000","last_change":"2023-07-21T22:10:34.178611+0000","last_active":"2023-07-21T22:10:41.146814+0000","last_peered":"2023-07-21T22:10:41.146814+0000","last_clean":"2023-07-21T22:10:41.146814+0000","last_became_active":"2023-07-21T22:10:34.178321+0000","last_became_peered":"2023-07-21T22:10:34.178321+0000","last_unstale":"2023-07-21T22:10:41.146814+0000","last_undegraded":"2023-07-21T22:10:41.146814+0000","last_fullsized":"2023-07-21T22:10:41.146814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:39.236774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261985+0000","last_change":"2023-07-21T22:10:39.285122+0000","last_active":"2023-07-21T22:10:40.261985+0000","last_peered":"2023-07-21T22:10:40.261985+0000","last_clean":"2023-07-21T22:10:40.261985+0000","last_became_active":"2023-07-21T22:10:39.284637+0000","last_became_peered":"2023-07-21T22:10:39.284637+0000","last_unstale":"2023-07-21T22:10:40.261985+0000","last_undegraded":"2023-07-21T22:10:40.261985+0000","last_fullsized":"2023-07-21T22:10:40.261985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:54:50.939333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263932+0000","last_change":"2023-07-21T22:10:35.188636+0000","last_active":"2023-07-21T22:10:40.263932+0000","last_peered":"2023-07-21T22:10:40.263932+0000","last_clean":"2023-07-21T22:10:40.263932+0000","last_became_active":"2023-07-21T22:10:35.188298+0000","last_became_peered":"2023-07-21T22:10:35.188298+0000","last_unstale":"2023-07-21T22:10:40.263932+0000","last_undegraded":"2023-07-21T22:10:40.263932+0000","last_fullsized":"2023-07-21T22:10:40.263932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:18:45.368754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147220+0000","last_change":"2023-07-21T22:10:34.194251+0000","last_active":"2023-07-21T22:10:41.147220+0000","last_peered":"2023-07-21T22:10:41.147220+0000","last_clean":"2023-07-21T22:10:41.147220+0000","last_became_active":"2023-07-21T22:10:34.193914+0000","last_became_peered":"2023-07-21T22:10:34.193914+0000","last_unstale":"2023-07-21T22:10:41.147220+0000","last_undegraded":"2023-07-21T22:10:41.147220+0000","last_fullsized":"2023-07-21T22:10:41.147220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:18.845683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261519+0000","last_change":"2023-07-21T22:10:39.284893+0000","last_active":"2023-07-21T22:10:40.261519+0000","last_peered":"2023-07-21T22:10:40.261519+0000","last_clean":"2023-07-21T22:10:40.261519+0000","last_became_active":"2023-07-21T22:10:39.284465+0000","last_became_peered":"2023-07-21T22:10:39.284465+0000","last_unstale":"2023-07-21T22:10:40.261519+0000","last_undegraded":"2023-07-21T22:10:40.261519+0000","last_fullsized":"2023-07-21T22:10:40.261519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:08.368632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263217+0000","last_change":"2023-07-21T22:10:35.179108+0000","last_active":"2023-07-21T22:10:40.263217+0000","last_peered":"2023-07-21T22:10:40.263217+0000","last_clean":"2023-07-21T22:10:40.263217+0000","last_became_active":"2023-07-21T22:10:35.178860+0000","last_became_peered":"2023-07-21T22:10:35.178860+0000","last_unstale":"2023-07-21T22:10:40.263217+0000","last_undegraded":"2023-07-21T22:10:40.263217+0000","last_fullsized":"2023-07-21T22:10:40.263217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:10.196079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147218+0000","last_change":"2023-07-21T22:10:34.191213+0000","last_active":"2023-07-21T22:10:41.147218+0000","last_peered":"2023-07-21T22:10:41.147218+0000","last_clean":"2023-07-21T22:10:41.147218+0000","last_became_active":"2023-07-21T22:10:34.190864+0000","last_became_peered":"2023-07-21T22:10:34.190864+0000","last_unstale":"2023-07-21T22:10:41.147218+0000","last_undegraded":"2023-07-21T22:10:41.147218+0000","last_fullsized":"2023-07-21T22:10:41.147218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:48.235788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146089+0000","last_change":"2023-07-21T22:10:39.285659+0000","last_active":"2023-07-21T22:10:41.146089+0000","last_peered":"2023-07-21T22:10:41.146089+0000","last_clean":"2023-07-21T22:10:41.146089+0000","last_became_active":"2023-07-21T22:10:39.285107+0000","last_became_peered":"2023-07-21T22:10:39.285107+0000","last_unstale":"2023-07-21T22:10:41.146089+0000","last_undegraded":"2023-07-21T22:10:41.146089+0000","last_fullsized":"2023-07-21T22:10:41.146089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:49.251705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265541+0000","last_change":"2023-07-21T22:10:39.283176+0000","last_active":"2023-07-21T22:10:40.265541+0000","last_peered":"2023-07-21T22:10:40.265541+0000","last_clean":"2023-07-21T22:10:40.265541+0000","last_became_active":"2023-07-21T22:10:39.282822+0000","last_became_peered":"2023-07-21T22:10:39.282822+0000","last_unstale":"2023-07-21T22:10:40.265541+0000","last_undegraded":"2023-07-21T22:10:40.265541+0000","last_fullsized":"2023-07-21T22:10:40.265541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:44:45.486837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'8","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144843+0000","last_change":"2023-07-21T22:10:34.187632+0000","last_active":"2023-07-21T22:10:41.144843+0000","last_peered":"2023-07-21T22:10:41.144843+0000","last_clean":"2023-07-21T22:10:41.144843+0000","last_became_active":"2023-07-21T22:10:34.187327+0000","last_became_peered":"2023-07-21T22:10:34.187327+0000","last_unstale":"2023-07-21T22:10:41.144843+0000","last_undegraded":"2023-07-21T22:10:41.144843+0000","last_fullsized":"2023-07-21T22:10:41.144843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:29.738382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644454+0000","last_change":"2023-07-21T22:10:35.196258+0000","last_active":"2023-07-21T22:10:40.644454+0000","last_peered":"2023-07-21T22:10:40.644454+0000","last_clean":"2023-07-21T22:10:40.644454+0000","last_became_active":"2023-07-21T22:10:35.195943+0000","last_became_peered":"2023-07-21T22:10:35.195943+0000","last_unstale":"2023-07-21T22:10:40.644454+0000","last_undegraded":"2023-07-21T22:10:40.644454+0000","last_fullsized":"2023-07-21T22:10:40.644454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:53:55.769220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644298+0000","last_change":"2023-07-21T22:10:39.285606+0000","last_active":"2023-07-21T22:10:40.644298+0000","last_peered":"2023-07-21T22:10:40.644298+0000","last_clean":"2023-07-21T22:10:40.644298+0000","last_became_active":"2023-07-21T22:10:39.285013+0000","last_became_peered":"2023-07-21T22:10:39.285013+0000","last_unstale":"2023-07-21T22:10:40.644298+0000","last_undegraded":"2023-07-21T22:10:40.644298+0000","last_fullsized":"2023-07-21T22:10:40.644298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:09:27.124262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146727+0000","last_change":"2023-07-21T22:10:34.194383+0000","last_active":"2023-07-21T22:10:41.146727+0000","last_peered":"2023-07-21T22:10:41.146727+0000","last_clean":"2023-07-21T22:10:41.146727+0000","last_became_active":"2023-07-21T22:10:34.194063+0000","last_became_peered":"2023-07-21T22:10:34.194063+0000","last_unstale":"2023-07-21T22:10:41.146727+0000","last_undegraded":"2023-07-21T22:10:41.146727+0000","last_fullsized":"2023-07-21T22:10:41.146727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:09.182975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147842+0000","last_change":"2023-07-21T22:10:35.193372+0000","last_active":"2023-07-21T22:10:41.147842+0000","last_peered":"2023-07-21T22:10:41.147842+0000","last_clean":"2023-07-21T22:10:41.147842+0000","last_became_active":"2023-07-21T22:10:35.193099+0000","last_became_peered":"2023-07-21T22:10:35.193099+0000","last_unstale":"2023-07-21T22:10:41.147842+0000","last_undegraded":"2023-07-21T22:10:41.147842+0000","last_fullsized":"2023-07-21T22:10:41.147842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:18:34.792098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145663+0000","last_change":"2023-07-21T22:10:34.174760+0000","last_active":"2023-07-21T22:10:41.145663+0000","last_peered":"2023-07-21T22:10:41.145663+0000","last_clean":"2023-07-21T22:10:41.145663+0000","last_became_active":"2023-07-21T22:10:34.174412+0000","last_became_peered":"2023-07-21T22:10:34.174412+0000","last_unstale":"2023-07-21T22:10:41.145663+0000","last_undegraded":"2023-07-21T22:10:41.145663+0000","last_fullsized":"2023-07-21T22:10:41.145663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:49.434373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265838+0000","last_change":"2023-07-21T22:10:35.181797+0000","last_active":"2023-07-21T22:10:40.265838+0000","last_peered":"2023-07-21T22:10:40.265838+0000","last_clean":"2023-07-21T22:10:40.265838+0000","last_became_active":"2023-07-21T22:10:35.180383+0000","last_became_peered":"2023-07-21T22:10:35.180383+0000","last_unstale":"2023-07-21T22:10:40.265838+0000","last_undegraded":"2023-07-21T22:10:40.265838+0000","last_fullsized":"2023-07-21T22:10:40.265838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:58.158269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644090+0000","last_change":"2023-07-21T22:10:39.283924+0000","last_active":"2023-07-21T22:10:40.644090+0000","last_peered":"2023-07-21T22:10:40.644090+0000","last_clean":"2023-07-21T22:10:40.644090+0000","last_became_active":"2023-07-21T22:10:39.283524+0000","last_became_peered":"2023-07-21T22:10:39.283524+0000","last_unstale":"2023-07-21T22:10:40.644090+0000","last_undegraded":"2023-07-21T22:10:40.644090+0000","last_fullsized":"2023-07-21T22:10:40.644090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:10:21.482474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147082+0000","last_change":"2023-07-21T22:10:34.195049+0000","last_active":"2023-07-21T22:10:41.147082+0000","last_peered":"2023-07-21T22:10:41.147082+0000","last_clean":"2023-07-21T22:10:41.147082+0000","last_became_active":"2023-07-21T22:10:34.194734+0000","last_became_peered":"2023-07-21T22:10:34.194734+0000","last_unstale":"2023-07-21T22:10:41.147082+0000","last_undegraded":"2023-07-21T22:10:41.147082+0000","last_fullsized":"2023-07-21T22:10:41.147082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:19.034773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644242+0000","last_change":"2023-07-21T22:10:35.192516+0000","last_active":"2023-07-21T22:10:40.644242+0000","last_peered":"2023-07-21T22:10:40.644242+0000","last_clean":"2023-07-21T22:10:40.644242+0000","last_became_active":"2023-07-21T22:10:35.192223+0000","last_became_peered":"2023-07-21T22:10:35.192223+0000","last_unstale":"2023-07-21T22:10:40.644242+0000","last_undegraded":"2023-07-21T22:10:40.644242+0000","last_fullsized":"2023-07-21T22:10:40.644242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:35:11.828421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265637+0000","last_change":"2023-07-21T22:10:39.279488+0000","last_active":"2023-07-21T22:10:40.265637+0000","last_peered":"2023-07-21T22:10:40.265637+0000","last_clean":"2023-07-21T22:10:40.265637+0000","last_became_active":"2023-07-21T22:10:39.279003+0000","last_became_peered":"2023-07-21T22:10:39.279003+0000","last_unstale":"2023-07-21T22:10:40.265637+0000","last_undegraded":"2023-07-21T22:10:40.265637+0000","last_fullsized":"2023-07-21T22:10:40.265637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:23.941829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144554+0000","last_change":"2023-07-21T22:10:35.179763+0000","last_active":"2023-07-21T22:10:41.144554+0000","last_peered":"2023-07-21T22:10:41.144554+0000","last_clean":"2023-07-21T22:10:41.144554+0000","last_became_active":"2023-07-21T22:10:35.179461+0000","last_became_peered":"2023-07-21T22:10:35.179461+0000","last_unstale":"2023-07-21T22:10:41.144554+0000","last_undegraded":"2023-07-21T22:10:41.144554+0000","last_fullsized":"2023-07-21T22:10:41.144554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:26:37.683815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643259+0000","last_change":"2023-07-21T22:10:35.198489+0000","last_active":"2023-07-21T22:10:40.643259+0000","last_peered":"2023-07-21T22:10:40.643259+0000","last_clean":"2023-07-21T22:10:40.643259+0000","last_became_active":"2023-07-21T22:10:35.196445+0000","last_became_peered":"2023-07-21T22:10:35.196445+0000","last_unstale":"2023-07-21T22:10:40.643259+0000","last_undegraded":"2023-07-21T22:10:40.643259+0000","last_fullsized":"2023-07-21T22:10:40.643259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:44:28.401234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264788+0000","last_change":"2023-07-21T22:10:35.187176+0000","last_active":"2023-07-21T22:10:40.264788+0000","last_peered":"2023-07-21T22:10:40.264788+0000","last_clean":"2023-07-21T22:10:40.264788+0000","last_became_active":"2023-07-21T22:10:35.186863+0000","last_became_peered":"2023-07-21T22:10:35.186863+0000","last_unstale":"2023-07-21T22:10:40.264788+0000","last_undegraded":"2023-07-21T22:10:40.264788+0000","last_fullsized":"2023-07-21T22:10:40.264788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:06:49.659850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644061+0000","last_change":"2023-07-21T22:10:35.198787+0000","last_active":"2023-07-21T22:10:40.644061+0000","last_peered":"2023-07-21T22:10:40.644061+0000","last_clean":"2023-07-21T22:10:40.644061+0000","last_became_active":"2023-07-21T22:10:35.198500+0000","last_became_peered":"2023-07-21T22:10:35.198500+0000","last_unstale":"2023-07-21T22:10:40.644061+0000","last_undegraded":"2023-07-21T22:10:40.644061+0000","last_fullsized":"2023-07-21T22:10:40.644061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:53:24.242935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147817+0000","last_change":"2023-07-21T22:10:35.179417+0000","last_active":"2023-07-21T22:10:41.147817+0000","last_peered":"2023-07-21T22:10:41.147817+0000","last_clean":"2023-07-21T22:10:41.147817+0000","last_became_active":"2023-07-21T22:10:35.179102+0000","last_became_peered":"2023-07-21T22:10:35.179102+0000","last_unstale":"2023-07-21T22:10:41.147817+0000","last_undegraded":"2023-07-21T22:10:41.147817+0000","last_fullsized":"2023-07-21T22:10:41.147817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:44:41.403795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265823+0000","last_change":"2023-07-21T22:10:35.183678+0000","last_active":"2023-07-21T22:10:40.265823+0000","last_peered":"2023-07-21T22:10:40.265823+0000","last_clean":"2023-07-21T22:10:40.265823+0000","last_became_active":"2023-07-21T22:10:35.181954+0000","last_became_peered":"2023-07-21T22:10:35.181954+0000","last_unstale":"2023-07-21T22:10:40.265823+0000","last_undegraded":"2023-07-21T22:10:40.265823+0000","last_fullsized":"2023-07-21T22:10:40.265823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:51:47.919272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148183+0000","last_change":"2023-07-21T22:10:35.183172+0000","last_active":"2023-07-21T22:10:41.148183+0000","last_peered":"2023-07-21T22:10:41.148183+0000","last_clean":"2023-07-21T22:10:41.148183+0000","last_became_active":"2023-07-21T22:10:35.182810+0000","last_became_peered":"2023-07-21T22:10:35.182810+0000","last_unstale":"2023-07-21T22:10:41.148183+0000","last_undegraded":"2023-07-21T22:10:41.148183+0000","last_fullsized":"2023-07-21T22:10:41.148183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:48.176651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147386+0000","last_change":"2023-07-21T22:10:35.185656+0000","last_active":"2023-07-21T22:10:41.147386+0000","last_peered":"2023-07-21T22:10:41.147386+0000","last_clean":"2023-07-21T22:10:41.147386+0000","last_became_active":"2023-07-21T22:10:35.185351+0000","last_became_peered":"2023-07-21T22:10:35.185351+0000","last_unstale":"2023-07-21T22:10:41.147386+0000","last_undegraded":"2023-07-21T22:10:41.147386+0000","last_fullsized":"2023-07-21T22:10:41.147386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:37:12.318204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145095+0000","last_change":"2023-07-21T22:10:35.196481+0000","last_active":"2023-07-21T22:10:41.145095+0000","last_peered":"2023-07-21T22:10:41.145095+0000","last_clean":"2023-07-21T22:10:41.145095+0000","last_became_active":"2023-07-21T22:10:35.196158+0000","last_became_peered":"2023-07-21T22:10:35.196158+0000","last_unstale":"2023-07-21T22:10:41.145095+0000","last_undegraded":"2023-07-21T22:10:41.145095+0000","last_fullsized":"2023-07-21T22:10:41.145095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:32.007914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643201+0000","last_change":"2023-07-21T22:10:35.194616+0000","last_active":"2023-07-21T22:10:40.643201+0000","last_peered":"2023-07-21T22:10:40.643201+0000","last_clean":"2023-07-21T22:10:40.643201+0000","last_became_active":"2023-07-21T22:10:35.194326+0000","last_became_peered":"2023-07-21T22:10:35.194326+0000","last_unstale":"2023-07-21T22:10:40.643201+0000","last_undegraded":"2023-07-21T22:10:40.643201+0000","last_fullsized":"2023-07-21T22:10:40.643201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:54:51.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145426+0000","last_change":"2023-07-21T22:10:35.181759+0000","last_active":"2023-07-21T22:10:41.145426+0000","last_peered":"2023-07-21T22:10:41.145426+0000","last_clean":"2023-07-21T22:10:41.145426+0000","last_became_active":"2023-07-21T22:10:35.179939+0000","last_became_peered":"2023-07-21T22:10:35.179939+0000","last_unstale":"2023-07-21T22:10:41.145426+0000","last_undegraded":"2023-07-21T22:10:41.145426+0000","last_fullsized":"2023-07-21T22:10:41.145426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:59:17.361629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147050+0000","last_change":"2023-07-21T22:10:35.201621+0000","last_active":"2023-07-21T22:10:41.147050+0000","last_peered":"2023-07-21T22:10:41.147050+0000","last_clean":"2023-07-21T22:10:41.147050+0000","last_became_active":"2023-07-21T22:10:35.201242+0000","last_became_peered":"2023-07-21T22:10:35.201242+0000","last_unstale":"2023-07-21T22:10:41.147050+0000","last_undegraded":"2023-07-21T22:10:41.147050+0000","last_fullsized":"2023-07-21T22:10:41.147050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:44:41.403795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264570+0000","last_change":"2023-07-21T22:10:35.181975+0000","last_active":"2023-07-21T22:10:40.264570+0000","last_peered":"2023-07-21T22:10:40.264570+0000","last_clean":"2023-07-21T22:10:40.264570+0000","last_became_active":"2023-07-21T22:10:35.181368+0000","last_became_peered":"2023-07-21T22:10:35.181368+0000","last_unstale":"2023-07-21T22:10:40.264570+0000","last_undegraded":"2023-07-21T22:10:40.264570+0000","last_fullsized":"2023-07-21T22:10:40.264570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:44.586259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262782+0000","last_change":"2023-07-21T22:10:35.182687+0000","last_active":"2023-07-21T22:10:40.262782+0000","last_peered":"2023-07-21T22:10:40.262782+0000","last_clean":"2023-07-21T22:10:40.262782+0000","last_became_active":"2023-07-21T22:10:35.182369+0000","last_became_peered":"2023-07-21T22:10:35.182369+0000","last_unstale":"2023-07-21T22:10:40.262782+0000","last_undegraded":"2023-07-21T22:10:40.262782+0000","last_fullsized":"2023-07-21T22:10:40.262782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:47:37.395408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265158+0000","last_change":"2023-07-21T22:10:35.181596+0000","last_active":"2023-07-21T22:10:40.265158+0000","last_peered":"2023-07-21T22:10:40.265158+0000","last_clean":"2023-07-21T22:10:40.265158+0000","last_became_active":"2023-07-21T22:10:35.181343+0000","last_became_peered":"2023-07-21T22:10:35.181343+0000","last_unstale":"2023-07-21T22:10:40.265158+0000","last_undegraded":"2023-07-21T22:10:40.265158+0000","last_fullsized":"2023-07-21T22:10:40.265158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:00.862980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146323+0000","last_change":"2023-07-21T22:10:35.191662+0000","last_active":"2023-07-21T22:10:41.146323+0000","last_peered":"2023-07-21T22:10:41.146323+0000","last_clean":"2023-07-21T22:10:41.146323+0000","last_became_active":"2023-07-21T22:10:35.191389+0000","last_became_peered":"2023-07-21T22:10:35.191389+0000","last_unstale":"2023-07-21T22:10:41.146323+0000","last_undegraded":"2023-07-21T22:10:41.146323+0000","last_fullsized":"2023-07-21T22:10:41.146323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:49.731806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263421+0000","last_change":"2023-07-21T22:10:35.180343+0000","last_active":"2023-07-21T22:10:40.263421+0000","last_peered":"2023-07-21T22:10:40.263421+0000","last_clean":"2023-07-21T22:10:40.263421+0000","last_became_active":"2023-07-21T22:10:35.178216+0000","last_became_peered":"2023-07-21T22:10:35.178216+0000","last_unstale":"2023-07-21T22:10:40.263421+0000","last_undegraded":"2023-07-21T22:10:40.263421+0000","last_fullsized":"2023-07-21T22:10:40.263421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:28:03.815256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146613+0000","last_change":"2023-07-21T22:10:35.188474+0000","last_active":"2023-07-21T22:10:41.146613+0000","last_peered":"2023-07-21T22:10:41.146613+0000","last_clean":"2023-07-21T22:10:41.146613+0000","last_became_active":"2023-07-21T22:10:35.187957+0000","last_became_peered":"2023-07-21T22:10:35.187957+0000","last_unstale":"2023-07-21T22:10:41.146613+0000","last_undegraded":"2023-07-21T22:10:41.146613+0000","last_fullsized":"2023-07-21T22:10:41.146613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:58:58.416910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264825+0000","last_change":"2023-07-21T22:10:35.172559+0000","last_active":"2023-07-21T22:10:40.264825+0000","last_peered":"2023-07-21T22:10:40.264825+0000","last_clean":"2023-07-21T22:10:40.264825+0000","last_became_active":"2023-07-21T22:10:35.172297+0000","last_became_peered":"2023-07-21T22:10:35.172297+0000","last_unstale":"2023-07-21T22:10:40.264825+0000","last_undegraded":"2023-07-21T22:10:40.264825+0000","last_fullsized":"2023-07-21T22:10:40.264825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:40.249878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261736+0000","last_change":"2023-07-21T22:10:35.197849+0000","last_active":"2023-07-21T22:10:40.261736+0000","last_peered":"2023-07-21T22:10:40.261736+0000","last_clean":"2023-07-21T22:10:40.261736+0000","last_became_active":"2023-07-21T22:10:35.197518+0000","last_became_peered":"2023-07-21T22:10:35.197518+0000","last_unstale":"2023-07-21T22:10:40.261736+0000","last_undegraded":"2023-07-21T22:10:40.261736+0000","last_fullsized":"2023-07-21T22:10:40.261736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:14.080646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262913+0000","last_change":"2023-07-21T22:10:35.181027+0000","last_active":"2023-07-21T22:10:40.262913+0000","last_peered":"2023-07-21T22:10:40.262913+0000","last_clean":"2023-07-21T22:10:40.262913+0000","last_became_active":"2023-07-21T22:10:35.180649+0000","last_became_peered":"2023-07-21T22:10:35.180649+0000","last_unstale":"2023-07-21T22:10:40.262913+0000","last_undegraded":"2023-07-21T22:10:40.262913+0000","last_fullsized":"2023-07-21T22:10:40.262913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:43.732515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265501+0000","last_change":"2023-07-21T22:10:35.188747+0000","last_active":"2023-07-21T22:10:40.265501+0000","last_peered":"2023-07-21T22:10:40.265501+0000","last_clean":"2023-07-21T22:10:40.265501+0000","last_became_active":"2023-07-21T22:10:35.188468+0000","last_became_peered":"2023-07-21T22:10:35.188468+0000","last_unstale":"2023-07-21T22:10:40.265501+0000","last_undegraded":"2023-07-21T22:10:40.265501+0000","last_fullsized":"2023-07-21T22:10:40.265501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:36:18.273058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266392+0000","last_change":"2023-07-21T22:10:35.186280+0000","last_active":"2023-07-21T22:10:40.266392+0000","last_peered":"2023-07-21T22:10:40.266392+0000","last_clean":"2023-07-21T22:10:40.266392+0000","last_became_active":"2023-07-21T22:10:35.185899+0000","last_became_peered":"2023-07-21T22:10:35.185899+0000","last_unstale":"2023-07-21T22:10:40.266392+0000","last_undegraded":"2023-07-21T22:10:40.266392+0000","last_fullsized":"2023-07-21T22:10:40.266392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:58:24.147605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146096+0000","last_change":"2023-07-21T22:10:35.194217+0000","last_active":"2023-07-21T22:10:41.146096+0000","last_peered":"2023-07-21T22:10:41.146096+0000","last_clean":"2023-07-21T22:10:41.146096+0000","last_became_active":"2023-07-21T22:10:35.193943+0000","last_became_peered":"2023-07-21T22:10:35.193943+0000","last_unstale":"2023-07-21T22:10:41.146096+0000","last_undegraded":"2023-07-21T22:10:41.146096+0000","last_fullsized":"2023-07-21T22:10:41.146096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:08:11.726615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263158+0000","last_change":"2023-07-21T22:10:35.175314+0000","last_active":"2023-07-21T22:10:40.263158+0000","last_peered":"2023-07-21T22:10:40.263158+0000","last_clean":"2023-07-21T22:10:40.263158+0000","last_became_active":"2023-07-21T22:10:35.175046+0000","last_became_peered":"2023-07-21T22:10:35.175046+0000","last_unstale":"2023-07-21T22:10:40.263158+0000","last_undegraded":"2023-07-21T22:10:40.263158+0000","last_fullsized":"2023-07-21T22:10:40.263158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:54.515955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146323+0000","last_change":"2023-07-21T22:10:35.187761+0000","last_active":"2023-07-21T22:10:41.146323+0000","last_peered":"2023-07-21T22:10:41.146323+0000","last_clean":"2023-07-21T22:10:41.146323+0000","last_became_active":"2023-07-21T22:10:35.187432+0000","last_became_peered":"2023-07-21T22:10:35.187432+0000","last_unstale":"2023-07-21T22:10:41.146323+0000","last_undegraded":"2023-07-21T22:10:41.146323+0000","last_fullsized":"2023-07-21T22:10:41.146323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:37:12.318204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263742+0000","last_change":"2023-07-21T22:10:35.180975+0000","last_active":"2023-07-21T22:10:40.263742+0000","last_peered":"2023-07-21T22:10:40.263742+0000","last_clean":"2023-07-21T22:10:40.263742+0000","last_became_active":"2023-07-21T22:10:35.180610+0000","last_became_peered":"2023-07-21T22:10:35.180610+0000","last_unstale":"2023-07-21T22:10:40.263742+0000","last_undegraded":"2023-07-21T22:10:40.263742+0000","last_fullsized":"2023-07-21T22:10:40.263742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:24.993895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146787+0000","last_change":"2023-07-21T22:10:35.202116+0000","last_active":"2023-07-21T22:10:41.146787+0000","last_peered":"2023-07-21T22:10:41.146787+0000","last_clean":"2023-07-21T22:10:41.146787+0000","last_became_active":"2023-07-21T22:10:35.201807+0000","last_became_peered":"2023-07-21T22:10:35.201807+0000","last_unstale":"2023-07-21T22:10:41.146787+0000","last_undegraded":"2023-07-21T22:10:41.146787+0000","last_fullsized":"2023-07-21T22:10:41.146787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:03:42.309634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145678+0000","last_change":"2023-07-21T22:10:35.182990+0000","last_active":"2023-07-21T22:10:41.145678+0000","last_peered":"2023-07-21T22:10:41.145678+0000","last_clean":"2023-07-21T22:10:41.145678+0000","last_became_active":"2023-07-21T22:10:35.182451+0000","last_became_peered":"2023-07-21T22:10:35.182451+0000","last_unstale":"2023-07-21T22:10:41.145678+0000","last_undegraded":"2023-07-21T22:10:41.145678+0000","last_fullsized":"2023-07-21T22:10:41.145678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:52:17.840975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264696+0000","last_change":"2023-07-21T22:10:35.181124+0000","last_active":"2023-07-21T22:10:40.264696+0000","last_peered":"2023-07-21T22:10:40.264696+0000","last_clean":"2023-07-21T22:10:40.264696+0000","last_became_active":"2023-07-21T22:10:35.180857+0000","last_became_peered":"2023-07-21T22:10:35.180857+0000","last_unstale":"2023-07-21T22:10:40.264696+0000","last_undegraded":"2023-07-21T22:10:40.264696+0000","last_fullsized":"2023-07-21T22:10:40.264696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:20:59.226705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266167+0000","last_change":"2023-07-21T22:10:35.178260+0000","last_active":"2023-07-21T22:10:40.266167+0000","last_peered":"2023-07-21T22:10:40.266167+0000","last_clean":"2023-07-21T22:10:40.266167+0000","last_became_active":"2023-07-21T22:10:35.178006+0000","last_became_peered":"2023-07-21T22:10:35.178006+0000","last_unstale":"2023-07-21T22:10:40.266167+0000","last_undegraded":"2023-07-21T22:10:40.266167+0000","last_fullsized":"2023-07-21T22:10:40.266167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:58:45.344226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262442+0000","last_change":"2023-07-21T22:10:35.197676+0000","last_active":"2023-07-21T22:10:40.262442+0000","last_peered":"2023-07-21T22:10:40.262442+0000","last_clean":"2023-07-21T22:10:40.262442+0000","last_became_active":"2023-07-21T22:10:35.197328+0000","last_became_peered":"2023-07-21T22:10:35.197328+0000","last_unstale":"2023-07-21T22:10:40.262442+0000","last_undegraded":"2023-07-21T22:10:40.262442+0000","last_fullsized":"2023-07-21T22:10:40.262442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:17:58.266481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":724807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":130430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.544}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]}]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":327680,"data_stored":131082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":339968,"data_stored":134279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.46}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":323584,"data_stored":130520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":319488,"data_stored":130430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":917504,"data_stored":721380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":130430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:11:08.420 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:11:08.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.585+0000 7fcaa16b3700 1 Processor -- start 2023-07-21T22:11:08.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.585+0000 7fcaa16b3700 1 -- start start 2023-07-21T22:11:08.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fcaa16b3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fca9c0b7af0 0x7fca9c0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:08.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fcaa16b3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fca9c0d1e40 0x7fca9c15f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:08.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fcaa16b3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9c0b3e80 con 0x7fca9c0cee10 2023-07-21T22:11:08.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fcaa16b3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c0cea00 con 0x7fca9c0d1e40 2023-07-21T22:11:08.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fcaa16b3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c0ccbf0 con 0x7fca9c0b7af0 2023-07-21T22:11:08.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fca9a7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fca9c0d1e40 0x7fca9c15f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:08.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fca9a7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fca9c0d1e40 0x7fca9c15f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48426/0 (socket says 172.21.15.49:48426) 2023-07-21T22:11:08.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fca9a7fc700 1 -- 172.21.15.49:0/4203817390 learned_addr learned my addr 172.21.15.49:0/4203817390 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:08.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fca9affd700 1 --2- 172.21.15.49:0/4203817390 >> v2:172.21.15.150:3300/0 conn(0x7fca9c0b7af0 0x7fca9c0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:08.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fca9a7fc700 1 -- 172.21.15.49:0/4203817390 >> v2:172.21.15.150:3300/0 conn(0x7fca9c0b7af0 msgr2=0x7fca9c0b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:08.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fca9a7fc700 1 --2- 172.21.15.49:0/4203817390 >> v2:172.21.15.150:3300/0 conn(0x7fca9c0b7af0 0x7fca9c0b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fca9a7fc700 1 -- 172.21.15.49:0/4203817390 >> v1:172.21.15.49:6789/0 conn(0x7fca9c0cee10 legacy=0x7fca9c0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:08.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fca9a7fc700 1 -- 172.21.15.49:0/4203817390 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c0cced0 con 0x7fca9c0d1e40 2023-07-21T22:11:08.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fca9a7fc700 1 --2- 172.21.15.49:0/4203817390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca9c0d1e40 0x7fca9c15f630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0cede0 tx=0x7fca90009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44afada6c0a5b2ae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:08.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fca99ffb700 1 -- 172.21.15.49:0/4203817390 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca90011830 con 0x7fca9c0d1e40 2023-07-21T22:11:08.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fca99ffb700 1 -- 172.21.15.49:0/4203817390 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca90011990 con 0x7fca9c0d1e40 2023-07-21T22:11:08.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fca99ffb700 1 -- 172.21.15.49:0/4203817390 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca90011d20 con 0x7fca9c0d1e40 2023-07-21T22:11:08.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fcaa16b3700 1 -- 172.21.15.49:0/4203817390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca9c0d1e40 msgr2=0x7fca9c15f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:08.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.589+0000 7fcaa16b3700 1 --2- 172.21.15.49:0/4203817390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca9c0d1e40 0x7fca9c15f630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0cede0 tx=0x7fca90009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.593+0000 7fcaa16b3700 1 -- 172.21.15.49:0/4203817390 shutdown_connections 2023-07-21T22:11:08.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.593+0000 7fcaa16b3700 1 --2- 172.21.15.49:0/4203817390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca9c0d1e40 0x7fca9c15f630 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.593+0000 7fcaa16b3700 1 --2- 172.21.15.49:0/4203817390 >> v2:172.21.15.150:3300/0 conn(0x7fca9c0b7af0 0x7fca9c0b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.593+0000 7fcaa16b3700 1 -- 172.21.15.49:0/4203817390 >> 172.21.15.49:0/4203817390 conn(0x7fca9c06e960 msgr2=0x7fca9c06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:08.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.593+0000 7fcaa16b3700 1 -- 172.21.15.49:0/4203817390 shutdown_connections 2023-07-21T22:11:08.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.593+0000 7fcaa16b3700 1 -- 172.21.15.49:0/4203817390 wait complete. 2023-07-21T22:11:08.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.593+0000 7fcaa16b3700 1 Processor -- start 2023-07-21T22:11:08.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.593+0000 7fcaa16b3700 1 -- start start 2023-07-21T22:11:08.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fcaa16b3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca9c0b7af0 0x7fca9c150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:08.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fcaa16b3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca9c0cee10 0x7fca9c15caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:08.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fcaa16b3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca9c0d1e40 0x7fca9c1e81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:08.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fcaa16b3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c15e9c0 con 0x7fca9c0d1e40 2023-07-21T22:11:08.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fcaa16b3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c1510e0 con 0x7fca9c0b7af0 2023-07-21T22:11:08.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fcaa16b3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c15cfe0 con 0x7fca9c0cee10 2023-07-21T22:11:08.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fca9b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca9c0d1e40 0x7fca9c1e81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:08.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fca9b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca9c0d1e40 0x7fca9c1e81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48436/0 (socket says 172.21.15.49:48436) 2023-07-21T22:11:08.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fca9b7fe700 1 -- 172.21.15.49:0/2905050996 learned_addr learned my addr 172.21.15.49:0/2905050996 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:08.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fca9a7fc700 1 --2- 172.21.15.49:0/2905050996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca9c0cee10 0x7fca9c15caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:08.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fca9affd700 1 --2- 172.21.15.49:0/2905050996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca9c0b7af0 0x7fca9c150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:08.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fca9b7fe700 1 -- 172.21.15.49:0/2905050996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca9c0cee10 msgr2=0x7fca9c15caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:08.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fca9b7fe700 1 --2- 172.21.15.49:0/2905050996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca9c0cee10 0x7fca9c15caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fca9b7fe700 1 -- 172.21.15.49:0/2905050996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca9c0b7af0 msgr2=0x7fca9c150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:08.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fca9b7fe700 1 --2- 172.21.15.49:0/2905050996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca9c0b7af0 0x7fca9c150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fca9b7fe700 1 -- 172.21.15.49:0/2905050996 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca90009570 con 0x7fca9c0d1e40 2023-07-21T22:11:08.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fca9b7fe700 1 --2- 172.21.15.49:0/2905050996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca9c0d1e40 0x7fca9c1e81f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca9400cb90 tx=0x7fca9400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:08.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fca837fe700 1 -- 172.21.15.49:0/2905050996 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94003c70 con 0x7fca9c0d1e40 2023-07-21T22:11:08.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fca837fe700 1 -- 172.21.15.49:0/2905050996 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca94003df0 con 0x7fca9c0d1e40 2023-07-21T22:11:08.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fcaa16b3700 1 -- 172.21.15.49:0/2905050996 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c1e5d70 con 0x7fca9c0d1e40 2023-07-21T22:11:08.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fca837fe700 1 -- 172.21.15.49:0/2905050996 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9400aae0 con 0x7fca9c0d1e40 2023-07-21T22:11:08.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.597+0000 7fcaa16b3700 1 -- 172.21.15.49:0/2905050996 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c1e6330 con 0x7fca9c0d1e40 2023-07-21T22:11:08.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.601+0000 7fcaa16b3700 1 -- 172.21.15.49:0/2905050996 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c072a50 con 0x7fca9c0d1e40 2023-07-21T22:11:08.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.601+0000 7fca837fe700 1 -- 172.21.15.49:0/2905050996 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca9400ac40 con 0x7fca9c0d1e40 2023-07-21T22:11:08.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.605+0000 7fca837fe700 1 --2- 172.21.15.49:0/2905050996 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fca880662f0 0x7fca880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:08.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.605+0000 7fca837fe700 1 -- 172.21.15.49:0/2905050996 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fca94083f80 con 0x7fca9c0d1e40 2023-07-21T22:11:08.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.605+0000 7fca9affd700 1 --2- 172.21.15.49:0/2905050996 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fca880662f0 0x7fca880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:08.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.605+0000 7fca9affd700 1 --2- 172.21.15.49:0/2905050996 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fca880662f0 0x7fca880687a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009bf0 tx=0x7fca8c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:08.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.609+0000 7fca837fe700 1 -- 172.21.15.49:0/2905050996 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fca940b4700 con 0x7fca9c0d1e40 2023-07-21T22:11:08.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.777+0000 7fcaa16b3700 1 -- 172.21.15.49:0/2905050996 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca9c0b7ec0 con 0x7fca880662f0 2023-07-21T22:11:08.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.793+0000 7fca837fe700 1 -- 172.21.15.49:0/2905050996 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367121 (secure 0 0 0) 0x7fca8c0118c0 con 0x7fca880662f0 2023-07-21T22:11:08.839 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:08.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.801+0000 7fcaa16b3700 1 -- 172.21.15.49:0/2905050996 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fca880662f0 msgr2=0x7fca880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:08.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.801+0000 7fcaa16b3700 1 --2- 172.21.15.49:0/2905050996 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fca880662f0 0x7fca880687a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009bf0 tx=0x7fca8c009240 comp rx=0 tx=0).stop 2023-07-21T22:11:08.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.801+0000 7fcaa16b3700 1 -- 172.21.15.49:0/2905050996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca9c0d1e40 msgr2=0x7fca9c1e81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:08.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.801+0000 7fcaa16b3700 1 --2- 172.21.15.49:0/2905050996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca9c0d1e40 0x7fca9c1e81f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca9400cb90 tx=0x7fca9400cea0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.801+0000 7fcaa16b3700 1 -- 172.21.15.49:0/2905050996 shutdown_connections 2023-07-21T22:11:08.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.801+0000 7fcaa16b3700 1 --2- 172.21.15.49:0/2905050996 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fca880662f0 0x7fca880687a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.801+0000 7fcaa16b3700 1 --2- 172.21.15.49:0/2905050996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca9c0d1e40 0x7fca9c1e81f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.801+0000 7fcaa16b3700 1 --2- 172.21.15.49:0/2905050996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca9c0cee10 0x7fca9c15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.801+0000 7fcaa16b3700 1 --2- 172.21.15.49:0/2905050996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca9c0b7af0 0x7fca9c150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:08.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.801+0000 7fcaa16b3700 1 -- 172.21.15.49:0/2905050996 >> 172.21.15.49:0/2905050996 conn(0x7fca9c06e960 msgr2=0x7fca9c0b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:08.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.801+0000 7fcaa16b3700 1 -- 172.21.15.49:0/2905050996 shutdown_connections 2023-07-21T22:11:08.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:08.801+0000 7fcaa16b3700 1 -- 172.21.15.49:0/2905050996 wait complete. 2023-07-21T22:11:08.848 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:11:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2023-07-21T22:11:08.314307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231624,"kb_used_data":3720,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754743096,"statfs":{"total":773094113280,"available":772856930304,"internally_reserved":0,"allocated":3809280,"data_stored":2233358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005491"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148041+0000","last_change":"2023-07-21T22:10:39.285920+0000","last_active":"2023-07-21T22:10:41.148041+0000","last_peered":"2023-07-21T22:10:41.148041+0000","last_clean":"2023-07-21T22:10:41.148041+0000","last_became_active":"2023-07-21T22:10:39.285402+0000","last_became_peered":"2023-07-21T22:10:39.285402+0000","last_unstale":"2023-07-21T22:10:41.148041+0000","last_undegraded":"2023-07-21T22:10:41.148041+0000","last_fullsized":"2023-07-21T22:10:41.148041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:53.331934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146444+0000","last_change":"2023-07-21T22:10:34.187231+0000","last_active":"2023-07-21T22:10:41.146444+0000","last_peered":"2023-07-21T22:10:41.146444+0000","last_clean":"2023-07-21T22:10:41.146444+0000","last_became_active":"2023-07-21T22:10:34.186893+0000","last_became_peered":"2023-07-21T22:10:34.186893+0000","last_unstale":"2023-07-21T22:10:41.146444+0000","last_undegraded":"2023-07-21T22:10:41.146444+0000","last_fullsized":"2023-07-21T22:10:41.146444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:35:27.556960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263558+0000","last_change":"2023-07-21T22:10:35.187303+0000","last_active":"2023-07-21T22:10:40.263558+0000","last_peered":"2023-07-21T22:10:40.263558+0000","last_clean":"2023-07-21T22:10:40.263558+0000","last_became_active":"2023-07-21T22:10:35.186998+0000","last_became_peered":"2023-07-21T22:10:35.186998+0000","last_unstale":"2023-07-21T22:10:40.263558+0000","last_undegraded":"2023-07-21T22:10:40.263558+0000","last_fullsized":"2023-07-21T22:10:40.263558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:14.259344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263311+0000","last_change":"2023-07-21T22:10:39.284321+0000","last_active":"2023-07-21T22:10:40.263311+0000","last_peered":"2023-07-21T22:10:40.263311+0000","last_clean":"2023-07-21T22:10:40.263311+0000","last_became_active":"2023-07-21T22:10:39.283184+0000","last_became_peered":"2023-07-21T22:10:39.283184+0000","last_unstale":"2023-07-21T22:10:40.263311+0000","last_undegraded":"2023-07-21T22:10:40.263311+0000","last_fullsized":"2023-07-21T22:10:40.263311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:02:07.314838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643758+0000","last_change":"2023-07-21T22:10:34.183067+0000","last_active":"2023-07-21T22:10:40.643758+0000","last_peered":"2023-07-21T22:10:40.643758+0000","last_clean":"2023-07-21T22:10:40.643758+0000","last_became_active":"2023-07-21T22:10:34.182744+0000","last_became_peered":"2023-07-21T22:10:34.182744+0000","last_unstale":"2023-07-21T22:10:40.643758+0000","last_undegraded":"2023-07-21T22:10:40.643758+0000","last_fullsized":"2023-07-21T22:10:40.643758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:16:50.409495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643472+0000","last_change":"2023-07-21T22:10:35.193952+0000","last_active":"2023-07-21T22:10:40.643472+0000","last_peered":"2023-07-21T22:10:40.643472+0000","last_clean":"2023-07-21T22:10:40.643472+0000","last_became_active":"2023-07-21T22:10:35.193594+0000","last_became_peered":"2023-07-21T22:10:35.193594+0000","last_unstale":"2023-07-21T22:10:40.643472+0000","last_undegraded":"2023-07-21T22:10:40.643472+0000","last_fullsized":"2023-07-21T22:10:40.643472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:23:35.116197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265724+0000","last_change":"2023-07-21T22:10:39.275701+0000","last_active":"2023-07-21T22:10:40.265724+0000","last_peered":"2023-07-21T22:10:40.265724+0000","last_clean":"2023-07-21T22:10:40.265724+0000","last_became_active":"2023-07-21T22:10:39.275276+0000","last_became_peered":"2023-07-21T22:10:39.275276+0000","last_unstale":"2023-07-21T22:10:40.265724+0000","last_undegraded":"2023-07-21T22:10:40.265724+0000","last_fullsized":"2023-07-21T22:10:40.265724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:52.259693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266022+0000","last_change":"2023-07-21T22:10:34.189037+0000","last_active":"2023-07-21T22:10:40.266022+0000","last_peered":"2023-07-21T22:10:40.266022+0000","last_clean":"2023-07-21T22:10:40.266022+0000","last_became_active":"2023-07-21T22:10:34.188705+0000","last_became_peered":"2023-07-21T22:10:34.188705+0000","last_unstale":"2023-07-21T22:10:40.266022+0000","last_undegraded":"2023-07-21T22:10:40.266022+0000","last_fullsized":"2023-07-21T22:10:40.266022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:32:09.815085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264089+0000","last_change":"2023-07-21T22:10:35.190920+0000","last_active":"2023-07-21T22:10:40.264089+0000","last_peered":"2023-07-21T22:10:40.264089+0000","last_clean":"2023-07-21T22:10:40.264089+0000","last_became_active":"2023-07-21T22:10:35.190624+0000","last_became_peered":"2023-07-21T22:10:35.190624+0000","last_unstale":"2023-07-21T22:10:40.264089+0000","last_undegraded":"2023-07-21T22:10:40.264089+0000","last_fullsized":"2023-07-21T22:10:40.264089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:24:44.643941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145887+0000","last_change":"2023-07-21T22:10:39.288143+0000","last_active":"2023-07-21T22:10:41.145887+0000","last_peered":"2023-07-21T22:10:41.145887+0000","last_clean":"2023-07-21T22:10:41.145887+0000","last_became_active":"2023-07-21T22:10:39.287727+0000","last_became_peered":"2023-07-21T22:10:39.287727+0000","last_unstale":"2023-07-21T22:10:41.145887+0000","last_undegraded":"2023-07-21T22:10:41.145887+0000","last_fullsized":"2023-07-21T22:10:41.145887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:55:32.701346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265495+0000","last_change":"2023-07-21T22:10:34.189233+0000","last_active":"2023-07-21T22:10:40.265495+0000","last_peered":"2023-07-21T22:10:40.265495+0000","last_clean":"2023-07-21T22:10:40.265495+0000","last_became_active":"2023-07-21T22:10:34.188693+0000","last_became_peered":"2023-07-21T22:10:34.188693+0000","last_unstale":"2023-07-21T22:10:40.265495+0000","last_undegraded":"2023-07-21T22:10:40.265495+0000","last_fullsized":"2023-07-21T22:10:40.265495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:19.034773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263831+0000","last_change":"2023-07-21T22:10:35.196227+0000","last_active":"2023-07-21T22:10:40.263831+0000","last_peered":"2023-07-21T22:10:40.263831+0000","last_clean":"2023-07-21T22:10:40.263831+0000","last_became_active":"2023-07-21T22:10:35.195975+0000","last_became_peered":"2023-07-21T22:10:35.195975+0000","last_unstale":"2023-07-21T22:10:40.263831+0000","last_undegraded":"2023-07-21T22:10:40.263831+0000","last_fullsized":"2023-07-21T22:10:40.263831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:42:02.828468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147542+0000","last_change":"2023-07-21T22:10:39.286940+0000","last_active":"2023-07-21T22:10:41.147542+0000","last_peered":"2023-07-21T22:10:41.147542+0000","last_clean":"2023-07-21T22:10:41.147542+0000","last_became_active":"2023-07-21T22:10:39.286471+0000","last_became_peered":"2023-07-21T22:10:39.286471+0000","last_unstale":"2023-07-21T22:10:41.147542+0000","last_undegraded":"2023-07-21T22:10:41.147542+0000","last_fullsized":"2023-07-21T22:10:41.147542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:44.332920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147513+0000","last_change":"2023-07-21T22:10:34.195078+0000","last_active":"2023-07-21T22:10:41.147513+0000","last_peered":"2023-07-21T22:10:41.147513+0000","last_clean":"2023-07-21T22:10:41.147513+0000","last_became_active":"2023-07-21T22:10:34.194778+0000","last_became_peered":"2023-07-21T22:10:34.194778+0000","last_unstale":"2023-07-21T22:10:41.147513+0000","last_undegraded":"2023-07-21T22:10:41.147513+0000","last_fullsized":"2023-07-21T22:10:41.147513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:13:31.016122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262886+0000","last_change":"2023-07-21T22:10:35.184187+0000","last_active":"2023-07-21T22:10:40.262886+0000","last_peered":"2023-07-21T22:10:40.262886+0000","last_clean":"2023-07-21T22:10:40.262886+0000","last_became_active":"2023-07-21T22:10:35.183664+0000","last_became_peered":"2023-07-21T22:10:35.183664+0000","last_unstale":"2023-07-21T22:10:40.262886+0000","last_undegraded":"2023-07-21T22:10:40.262886+0000","last_fullsized":"2023-07-21T22:10:40.262886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:17:19.358440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264275+0000","last_change":"2023-07-21T22:10:39.277910+0000","last_active":"2023-07-21T22:10:40.264275+0000","last_peered":"2023-07-21T22:10:40.264275+0000","last_clean":"2023-07-21T22:10:40.264275+0000","last_became_active":"2023-07-21T22:10:39.277601+0000","last_became_peered":"2023-07-21T22:10:39.277601+0000","last_unstale":"2023-07-21T22:10:40.264275+0000","last_undegraded":"2023-07-21T22:10:40.264275+0000","last_fullsized":"2023-07-21T22:10:40.264275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:41:03.813859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264319+0000","last_change":"2023-07-21T22:10:34.181116+0000","last_active":"2023-07-21T22:10:40.264319+0000","last_peered":"2023-07-21T22:10:40.264319+0000","last_clean":"2023-07-21T22:10:40.264319+0000","last_became_active":"2023-07-21T22:10:34.180817+0000","last_became_peered":"2023-07-21T22:10:34.180817+0000","last_unstale":"2023-07-21T22:10:40.264319+0000","last_undegraded":"2023-07-21T22:10:40.264319+0000","last_fullsized":"2023-07-21T22:10:40.264319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:29.537599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644380+0000","last_change":"2023-07-21T22:10:35.198715+0000","last_active":"2023-07-21T22:10:40.644380+0000","last_peered":"2023-07-21T22:10:40.644380+0000","last_clean":"2023-07-21T22:10:40.644380+0000","last_became_active":"2023-07-21T22:10:35.196452+0000","last_became_peered":"2023-07-21T22:10:35.196452+0000","last_unstale":"2023-07-21T22:10:40.644380+0000","last_undegraded":"2023-07-21T22:10:40.644380+0000","last_fullsized":"2023-07-21T22:10:40.644380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:54.017939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146548+0000","last_change":"2023-07-21T22:10:39.282183+0000","last_active":"2023-07-21T22:10:41.146548+0000","last_peered":"2023-07-21T22:10:41.146548+0000","last_clean":"2023-07-21T22:10:41.146548+0000","last_became_active":"2023-07-21T22:10:39.281786+0000","last_became_peered":"2023-07-21T22:10:39.281786+0000","last_unstale":"2023-07-21T22:10:41.146548+0000","last_undegraded":"2023-07-21T22:10:41.146548+0000","last_fullsized":"2023-07-21T22:10:41.146548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:36.102033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148156+0000","last_change":"2023-07-21T22:10:34.189390+0000","last_active":"2023-07-21T22:10:41.148156+0000","last_peered":"2023-07-21T22:10:41.148156+0000","last_clean":"2023-07-21T22:10:41.148156+0000","last_became_active":"2023-07-21T22:10:34.189100+0000","last_became_peered":"2023-07-21T22:10:34.189100+0000","last_unstale":"2023-07-21T22:10:41.148156+0000","last_undegraded":"2023-07-21T22:10:41.148156+0000","last_fullsized":"2023-07-21T22:10:41.148156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:51:46.906168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146955+0000","last_change":"2023-07-21T22:10:35.186334+0000","last_active":"2023-07-21T22:10:41.146955+0000","last_peered":"2023-07-21T22:10:41.146955+0000","last_clean":"2023-07-21T22:10:41.146955+0000","last_became_active":"2023-07-21T22:10:35.186027+0000","last_became_peered":"2023-07-21T22:10:35.186027+0000","last_unstale":"2023-07-21T22:10:41.146955+0000","last_undegraded":"2023-07-21T22:10:41.146955+0000","last_fullsized":"2023-07-21T22:10:41.146955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:26.382303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146339+0000","last_change":"2023-07-21T22:10:39.283921+0000","last_active":"2023-07-21T22:10:41.146339+0000","last_peered":"2023-07-21T22:10:41.146339+0000","last_clean":"2023-07-21T22:10:41.146339+0000","last_became_active":"2023-07-21T22:10:39.283579+0000","last_became_peered":"2023-07-21T22:10:39.283579+0000","last_unstale":"2023-07-21T22:10:41.146339+0000","last_undegraded":"2023-07-21T22:10:41.146339+0000","last_fullsized":"2023-07-21T22:10:41.146339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:33:27.956737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643473+0000","last_change":"2023-07-21T22:10:34.185811+0000","last_active":"2023-07-21T22:10:40.643473+0000","last_peered":"2023-07-21T22:10:40.643473+0000","last_clean":"2023-07-21T22:10:40.643473+0000","last_became_active":"2023-07-21T22:10:34.185528+0000","last_became_peered":"2023-07-21T22:10:34.185528+0000","last_unstale":"2023-07-21T22:10:40.643473+0000","last_undegraded":"2023-07-21T22:10:40.643473+0000","last_fullsized":"2023-07-21T22:10:40.643473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:32:55.911711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146562+0000","last_change":"2023-07-21T22:10:35.181437+0000","last_active":"2023-07-21T22:10:41.146562+0000","last_peered":"2023-07-21T22:10:41.146562+0000","last_clean":"2023-07-21T22:10:41.146562+0000","last_became_active":"2023-07-21T22:10:35.181153+0000","last_became_peered":"2023-07-21T22:10:35.181153+0000","last_unstale":"2023-07-21T22:10:41.146562+0000","last_undegraded":"2023-07-21T22:10:41.146562+0000","last_fullsized":"2023-07-21T22:10:41.146562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:15.974063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643126+0000","last_change":"2023-07-21T22:10:35.191719+0000","last_active":"2023-07-21T22:10:40.643126+0000","last_peered":"2023-07-21T22:10:40.643126+0000","last_clean":"2023-07-21T22:10:40.643126+0000","last_became_active":"2023-07-21T22:10:35.191220+0000","last_became_peered":"2023-07-21T22:10:35.191220+0000","last_unstale":"2023-07-21T22:10:40.643126+0000","last_undegraded":"2023-07-21T22:10:40.643126+0000","last_fullsized":"2023-07-21T22:10:40.643126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:33.738041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146486+0000","last_change":"2023-07-21T22:10:34.187207+0000","last_active":"2023-07-21T22:10:41.146486+0000","last_peered":"2023-07-21T22:10:41.146486+0000","last_clean":"2023-07-21T22:10:41.146486+0000","last_became_active":"2023-07-21T22:10:34.185806+0000","last_became_peered":"2023-07-21T22:10:34.185806+0000","last_unstale":"2023-07-21T22:10:41.146486+0000","last_undegraded":"2023-07-21T22:10:41.146486+0000","last_fullsized":"2023-07-21T22:10:41.146486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:17.068811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144651+0000","last_change":"2023-07-21T22:10:39.284138+0000","last_active":"2023-07-21T22:10:41.144651+0000","last_peered":"2023-07-21T22:10:41.144651+0000","last_clean":"2023-07-21T22:10:41.144651+0000","last_became_active":"2023-07-21T22:10:39.283678+0000","last_became_peered":"2023-07-21T22:10:39.283678+0000","last_unstale":"2023-07-21T22:10:41.144651+0000","last_undegraded":"2023-07-21T22:10:41.144651+0000","last_fullsized":"2023-07-21T22:10:41.144651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:52.307715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643341+0000","last_change":"2023-07-21T22:10:35.193661+0000","last_active":"2023-07-21T22:10:40.643341+0000","last_peered":"2023-07-21T22:10:40.643341+0000","last_clean":"2023-07-21T22:10:40.643341+0000","last_became_active":"2023-07-21T22:10:35.193205+0000","last_became_peered":"2023-07-21T22:10:35.193205+0000","last_unstale":"2023-07-21T22:10:40.643341+0000","last_undegraded":"2023-07-21T22:10:40.643341+0000","last_fullsized":"2023-07-21T22:10:40.643341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:44:13.704282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266550+0000","last_change":"2023-07-21T22:10:34.178085+0000","last_active":"2023-07-21T22:10:40.266550+0000","last_peered":"2023-07-21T22:10:40.266550+0000","last_clean":"2023-07-21T22:10:40.266550+0000","last_became_active":"2023-07-21T22:10:34.177713+0000","last_became_peered":"2023-07-21T22:10:34.177713+0000","last_unstale":"2023-07-21T22:10:40.266550+0000","last_undegraded":"2023-07-21T22:10:40.266550+0000","last_fullsized":"2023-07-21T22:10:40.266550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:20:06.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144877+0000","last_change":"2023-07-21T22:10:39.284566+0000","last_active":"2023-07-21T22:10:41.144877+0000","last_peered":"2023-07-21T22:10:41.144877+0000","last_clean":"2023-07-21T22:10:41.144877+0000","last_became_active":"2023-07-21T22:10:39.284100+0000","last_became_peered":"2023-07-21T22:10:39.284100+0000","last_unstale":"2023-07-21T22:10:41.144877+0000","last_undegraded":"2023-07-21T22:10:41.144877+0000","last_fullsized":"2023-07-21T22:10:41.144877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:31:22.286788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146666+0000","last_change":"2023-07-21T22:10:34.190125+0000","last_active":"2023-07-21T22:10:41.146666+0000","last_peered":"2023-07-21T22:10:41.146666+0000","last_clean":"2023-07-21T22:10:41.146666+0000","last_became_active":"2023-07-21T22:10:34.189780+0000","last_became_peered":"2023-07-21T22:10:34.189780+0000","last_unstale":"2023-07-21T22:10:41.146666+0000","last_undegraded":"2023-07-21T22:10:41.146666+0000","last_fullsized":"2023-07-21T22:10:41.146666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:53.502850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147220+0000","last_change":"2023-07-21T22:10:35.186228+0000","last_active":"2023-07-21T22:10:41.147220+0000","last_peered":"2023-07-21T22:10:41.147220+0000","last_clean":"2023-07-21T22:10:41.147220+0000","last_became_active":"2023-07-21T22:10:35.185965+0000","last_became_peered":"2023-07-21T22:10:35.185965+0000","last_unstale":"2023-07-21T22:10:41.147220+0000","last_undegraded":"2023-07-21T22:10:41.147220+0000","last_fullsized":"2023-07-21T22:10:41.147220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:15:55.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643839+0000","last_change":"2023-07-21T22:10:39.283587+0000","last_active":"2023-07-21T22:10:40.643839+0000","last_peered":"2023-07-21T22:10:40.643839+0000","last_clean":"2023-07-21T22:10:40.643839+0000","last_became_active":"2023-07-21T22:10:39.283180+0000","last_became_peered":"2023-07-21T22:10:39.283180+0000","last_unstale":"2023-07-21T22:10:40.643839+0000","last_undegraded":"2023-07-21T22:10:40.643839+0000","last_fullsized":"2023-07-21T22:10:40.643839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:38.593377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"30'10","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:52.945484+0000","last_change":"2023-07-21T22:10:34.185183+0000","last_active":"2023-07-21T22:10:52.945484+0000","last_peered":"2023-07-21T22:10:52.945484+0000","last_clean":"2023-07-21T22:10:52.945484+0000","last_became_active":"2023-07-21T22:10:34.184368+0000","last_became_peered":"2023-07-21T22:10:34.184368+0000","last_unstale":"2023-07-21T22:10:52.945484+0000","last_undegraded":"2023-07-21T22:10:52.945484+0000","last_fullsized":"2023-07-21T22:10:52.945484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:08:24.257997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263920+0000","last_change":"2023-07-21T22:10:35.177131+0000","last_active":"2023-07-21T22:10:40.263920+0000","last_peered":"2023-07-21T22:10:40.263920+0000","last_clean":"2023-07-21T22:10:40.263920+0000","last_became_active":"2023-07-21T22:10:35.176633+0000","last_became_peered":"2023-07-21T22:10:35.176633+0000","last_unstale":"2023-07-21T22:10:40.263920+0000","last_undegraded":"2023-07-21T22:10:40.263920+0000","last_fullsized":"2023-07-21T22:10:40.263920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:20:38.535159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145828+0000","last_change":"2023-07-21T22:10:39.287688+0000","last_active":"2023-07-21T22:10:41.145828+0000","last_peered":"2023-07-21T22:10:41.145828+0000","last_clean":"2023-07-21T22:10:41.145828+0000","last_became_active":"2023-07-21T22:10:39.285544+0000","last_became_peered":"2023-07-21T22:10:39.285544+0000","last_unstale":"2023-07-21T22:10:41.145828+0000","last_undegraded":"2023-07-21T22:10:41.145828+0000","last_fullsized":"2023-07-21T22:10:41.145828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:36.370365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264245+0000","last_change":"2023-07-21T22:10:35.176961+0000","last_active":"2023-07-21T22:10:40.264245+0000","last_peered":"2023-07-21T22:10:40.264245+0000","last_clean":"2023-07-21T22:10:40.264245+0000","last_became_active":"2023-07-21T22:10:35.175909+0000","last_became_peered":"2023-07-21T22:10:35.175909+0000","last_unstale":"2023-07-21T22:10:40.264245+0000","last_undegraded":"2023-07-21T22:10:40.264245+0000","last_fullsized":"2023-07-21T22:10:40.264245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:47:46.146151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146724+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:10:41.146724+0000","last_peered":"2023-07-21T22:10:41.146724+0000","last_clean":"2023-07-21T22:10:41.146724+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:10:41.146724+0000","last_undegraded":"2023-07-21T22:10:41.146724+0000","last_fullsized":"2023-07-21T22:10:41.146724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:47:22.065189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147620+0000","last_change":"2023-07-21T22:10:34.185463+0000","last_active":"2023-07-21T22:10:41.147620+0000","last_peered":"2023-07-21T22:10:41.147620+0000","last_clean":"2023-07-21T22:10:41.147620+0000","last_became_active":"2023-07-21T22:10:34.185164+0000","last_became_peered":"2023-07-21T22:10:34.185164+0000","last_unstale":"2023-07-21T22:10:41.147620+0000","last_undegraded":"2023-07-21T22:10:41.147620+0000","last_fullsized":"2023-07-21T22:10:41.147620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:07.490045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643172+0000","last_change":"2023-07-21T22:10:39.295728+0000","last_active":"2023-07-21T22:10:40.643172+0000","last_peered":"2023-07-21T22:10:40.643172+0000","last_clean":"2023-07-21T22:10:40.643172+0000","last_became_active":"2023-07-21T22:10:39.295285+0000","last_became_peered":"2023-07-21T22:10:39.295285+0000","last_unstale":"2023-07-21T22:10:40.643172+0000","last_undegraded":"2023-07-21T22:10:40.643172+0000","last_fullsized":"2023-07-21T22:10:40.643172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:42.629475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643332+0000","last_change":"2023-07-21T22:10:35.191518+0000","last_active":"2023-07-21T22:10:40.643332+0000","last_peered":"2023-07-21T22:10:40.643332+0000","last_clean":"2023-07-21T22:10:40.643332+0000","last_became_active":"2023-07-21T22:10:35.190851+0000","last_became_peered":"2023-07-21T22:10:35.190851+0000","last_unstale":"2023-07-21T22:10:40.643332+0000","last_undegraded":"2023-07-21T22:10:40.643332+0000","last_fullsized":"2023-07-21T22:10:40.643332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:31.644944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148333+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:10:41.148333+0000","last_peered":"2023-07-21T22:10:41.148333+0000","last_clean":"2023-07-21T22:10:41.148333+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:10:41.148333+0000","last_undegraded":"2023-07-21T22:10:41.148333+0000","last_fullsized":"2023-07-21T22:10:41.148333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:52.095138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644583+0000","last_change":"2023-07-21T22:10:34.180214+0000","last_active":"2023-07-21T22:10:40.644583+0000","last_peered":"2023-07-21T22:10:40.644583+0000","last_clean":"2023-07-21T22:10:40.644583+0000","last_became_active":"2023-07-21T22:10:34.179689+0000","last_became_peered":"2023-07-21T22:10:34.179689+0000","last_unstale":"2023-07-21T22:10:40.644583+0000","last_undegraded":"2023-07-21T22:10:40.644583+0000","last_fullsized":"2023-07-21T22:10:40.644583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:49.373811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263542+0000","last_change":"2023-07-21T22:10:39.277033+0000","last_active":"2023-07-21T22:10:40.263542+0000","last_peered":"2023-07-21T22:10:40.263542+0000","last_clean":"2023-07-21T22:10:40.263542+0000","last_became_active":"2023-07-21T22:10:39.276652+0000","last_became_peered":"2023-07-21T22:10:39.276652+0000","last_unstale":"2023-07-21T22:10:40.263542+0000","last_undegraded":"2023-07-21T22:10:40.263542+0000","last_fullsized":"2023-07-21T22:10:40.263542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:15:28.734422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146510+0000","last_change":"2023-07-21T22:10:35.183693+0000","last_active":"2023-07-21T22:10:41.146510+0000","last_peered":"2023-07-21T22:10:41.146510+0000","last_clean":"2023-07-21T22:10:41.146510+0000","last_became_active":"2023-07-21T22:10:35.182990+0000","last_became_peered":"2023-07-21T22:10:35.182990+0000","last_unstale":"2023-07-21T22:10:41.146510+0000","last_undegraded":"2023-07-21T22:10:41.146510+0000","last_fullsized":"2023-07-21T22:10:41.146510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:19:08.043869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147014+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:10:41.147014+0000","last_peered":"2023-07-21T22:10:41.147014+0000","last_clean":"2023-07-21T22:10:41.147014+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:10:41.147014+0000","last_undegraded":"2023-07-21T22:10:41.147014+0000","last_fullsized":"2023-07-21T22:10:41.147014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:42.440048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147957+0000","last_change":"2023-07-21T22:10:34.181525+0000","last_active":"2023-07-21T22:10:41.147957+0000","last_peered":"2023-07-21T22:10:41.147957+0000","last_clean":"2023-07-21T22:10:41.147957+0000","last_became_active":"2023-07-21T22:10:34.180865+0000","last_became_peered":"2023-07-21T22:10:34.180865+0000","last_unstale":"2023-07-21T22:10:41.147957+0000","last_undegraded":"2023-07-21T22:10:41.147957+0000","last_fullsized":"2023-07-21T22:10:41.147957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:18.845683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145191+0000","last_change":"2023-07-21T22:10:39.285010+0000","last_active":"2023-07-21T22:10:41.145191+0000","last_peered":"2023-07-21T22:10:41.145191+0000","last_clean":"2023-07-21T22:10:41.145191+0000","last_became_active":"2023-07-21T22:10:39.283077+0000","last_became_peered":"2023-07-21T22:10:39.283077+0000","last_unstale":"2023-07-21T22:10:41.145191+0000","last_undegraded":"2023-07-21T22:10:41.145191+0000","last_fullsized":"2023-07-21T22:10:41.145191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:07.012665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147524+0000","last_change":"2023-07-21T22:10:35.181554+0000","last_active":"2023-07-21T22:10:41.147524+0000","last_peered":"2023-07-21T22:10:41.147524+0000","last_clean":"2023-07-21T22:10:41.147524+0000","last_became_active":"2023-07-21T22:10:35.180489+0000","last_became_peered":"2023-07-21T22:10:35.180489+0000","last_unstale":"2023-07-21T22:10:41.147524+0000","last_undegraded":"2023-07-21T22:10:41.147524+0000","last_fullsized":"2023-07-21T22:10:41.147524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:10.196079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147886+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:10:41.147886+0000","last_peered":"2023-07-21T22:10:41.147886+0000","last_clean":"2023-07-21T22:10:41.147886+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:10:41.147886+0000","last_undegraded":"2023-07-21T22:10:41.147886+0000","last_fullsized":"2023-07-21T22:10:41.147886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:13.984747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266059+0000","last_change":"2023-07-21T22:10:34.190035+0000","last_active":"2023-07-21T22:10:40.266059+0000","last_peered":"2023-07-21T22:10:40.266059+0000","last_clean":"2023-07-21T22:10:40.266059+0000","last_became_active":"2023-07-21T22:10:34.188881+0000","last_became_peered":"2023-07-21T22:10:34.188881+0000","last_unstale":"2023-07-21T22:10:40.266059+0000","last_undegraded":"2023-07-21T22:10:40.266059+0000","last_fullsized":"2023-07-21T22:10:40.266059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:09.950174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146612+0000","last_change":"2023-07-21T22:10:39.279664+0000","last_active":"2023-07-21T22:10:41.146612+0000","last_peered":"2023-07-21T22:10:41.146612+0000","last_clean":"2023-07-21T22:10:41.146612+0000","last_became_active":"2023-07-21T22:10:39.279267+0000","last_became_peered":"2023-07-21T22:10:39.279267+0000","last_unstale":"2023-07-21T22:10:41.146612+0000","last_undegraded":"2023-07-21T22:10:41.146612+0000","last_fullsized":"2023-07-21T22:10:41.146612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:09.200877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147703+0000","last_change":"2023-07-21T22:10:35.182579+0000","last_active":"2023-07-21T22:10:41.147703+0000","last_peered":"2023-07-21T22:10:41.147703+0000","last_clean":"2023-07-21T22:10:41.147703+0000","last_became_active":"2023-07-21T22:10:35.182269+0000","last_became_peered":"2023-07-21T22:10:35.182269+0000","last_unstale":"2023-07-21T22:10:41.147703+0000","last_undegraded":"2023-07-21T22:10:41.147703+0000","last_fullsized":"2023-07-21T22:10:41.147703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:48.503179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264029+0000","last_change":"2023-07-21T22:10:34.188309+0000","last_active":"2023-07-21T22:10:40.264029+0000","last_peered":"2023-07-21T22:10:40.264029+0000","last_clean":"2023-07-21T22:10:40.264029+0000","last_became_active":"2023-07-21T22:10:34.187999+0000","last_became_peered":"2023-07-21T22:10:34.187999+0000","last_unstale":"2023-07-21T22:10:40.264029+0000","last_undegraded":"2023-07-21T22:10:40.264029+0000","last_fullsized":"2023-07-21T22:10:40.264029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:13:37.870348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265143+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:10:40.265143+0000","last_peered":"2023-07-21T22:10:40.265143+0000","last_clean":"2023-07-21T22:10:40.265143+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:10:40.265143+0000","last_undegraded":"2023-07-21T22:10:40.265143+0000","last_fullsized":"2023-07-21T22:10:40.265143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:42.440048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146356+0000","last_change":"2023-07-21T22:10:39.279822+0000","last_active":"2023-07-21T22:10:41.146356+0000","last_peered":"2023-07-21T22:10:41.146356+0000","last_clean":"2023-07-21T22:10:41.146356+0000","last_became_active":"2023-07-21T22:10:39.279315+0000","last_became_peered":"2023-07-21T22:10:39.279315+0000","last_unstale":"2023-07-21T22:10:41.146356+0000","last_undegraded":"2023-07-21T22:10:41.146356+0000","last_fullsized":"2023-07-21T22:10:41.146356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:04:04.200991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147521+0000","last_change":"2023-07-21T22:10:35.184632+0000","last_active":"2023-07-21T22:10:41.147521+0000","last_peered":"2023-07-21T22:10:41.147521+0000","last_clean":"2023-07-21T22:10:41.147521+0000","last_became_active":"2023-07-21T22:10:35.184294+0000","last_became_peered":"2023-07-21T22:10:35.184294+0000","last_unstale":"2023-07-21T22:10:41.147521+0000","last_undegraded":"2023-07-21T22:10:41.147521+0000","last_fullsized":"2023-07-21T22:10:41.147521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:54.515955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146420+0000","last_change":"2023-07-21T22:10:34.182197+0000","last_active":"2023-07-21T22:10:41.146420+0000","last_peered":"2023-07-21T22:10:41.146420+0000","last_clean":"2023-07-21T22:10:41.146420+0000","last_became_active":"2023-07-21T22:10:34.181919+0000","last_became_peered":"2023-07-21T22:10:34.181919+0000","last_unstale":"2023-07-21T22:10:41.146420+0000","last_undegraded":"2023-07-21T22:10:41.146420+0000","last_fullsized":"2023-07-21T22:10:41.146420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:55:27.605200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261707+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:10:40.261707+0000","last_peered":"2023-07-21T22:10:40.261707+0000","last_clean":"2023-07-21T22:10:40.261707+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:10:40.261707+0000","last_undegraded":"2023-07-21T22:10:40.261707+0000","last_fullsized":"2023-07-21T22:10:40.261707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:52.407450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262619+0000","last_change":"2023-07-21T22:10:39.289595+0000","last_active":"2023-07-21T22:10:40.262619+0000","last_peered":"2023-07-21T22:10:40.262619+0000","last_clean":"2023-07-21T22:10:40.262619+0000","last_became_active":"2023-07-21T22:10:39.289158+0000","last_became_peered":"2023-07-21T22:10:39.289158+0000","last_unstale":"2023-07-21T22:10:40.262619+0000","last_undegraded":"2023-07-21T22:10:40.262619+0000","last_fullsized":"2023-07-21T22:10:40.262619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:06:55.084320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147467+0000","last_change":"2023-07-21T22:10:35.185318+0000","last_active":"2023-07-21T22:10:41.147467+0000","last_peered":"2023-07-21T22:10:41.147467+0000","last_clean":"2023-07-21T22:10:41.147467+0000","last_became_active":"2023-07-21T22:10:35.185029+0000","last_became_peered":"2023-07-21T22:10:35.185029+0000","last_unstale":"2023-07-21T22:10:41.147467+0000","last_undegraded":"2023-07-21T22:10:41.147467+0000","last_fullsized":"2023-07-21T22:10:41.147467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:10.274416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145597+0000","last_change":"2023-07-21T22:10:34.189207+0000","last_active":"2023-07-21T22:10:41.145597+0000","last_peered":"2023-07-21T22:10:41.145597+0000","last_clean":"2023-07-21T22:10:41.145597+0000","last_became_active":"2023-07-21T22:10:34.188853+0000","last_became_peered":"2023-07-21T22:10:34.188853+0000","last_unstale":"2023-07-21T22:10:41.145597+0000","last_undegraded":"2023-07-21T22:10:41.145597+0000","last_fullsized":"2023-07-21T22:10:41.145597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:37:58.265151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145150+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:10:41.145150+0000","last_peered":"2023-07-21T22:10:41.145150+0000","last_clean":"2023-07-21T22:10:41.145150+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:10:41.145150+0000","last_undegraded":"2023-07-21T22:10:41.145150+0000","last_fullsized":"2023-07-21T22:10:41.145150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:03:10.317005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266651+0000","last_change":"2023-07-21T22:10:39.280697+0000","last_active":"2023-07-21T22:10:40.266651+0000","last_peered":"2023-07-21T22:10:40.266651+0000","last_clean":"2023-07-21T22:10:40.266651+0000","last_became_active":"2023-07-21T22:10:39.279870+0000","last_became_peered":"2023-07-21T22:10:39.279870+0000","last_unstale":"2023-07-21T22:10:40.266651+0000","last_undegraded":"2023-07-21T22:10:40.266651+0000","last_fullsized":"2023-07-21T22:10:40.266651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:32:46.379437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146280+0000","last_change":"2023-07-21T22:10:35.182836+0000","last_active":"2023-07-21T22:10:41.146280+0000","last_peered":"2023-07-21T22:10:41.146280+0000","last_clean":"2023-07-21T22:10:41.146280+0000","last_became_active":"2023-07-21T22:10:35.182544+0000","last_became_peered":"2023-07-21T22:10:35.182544+0000","last_unstale":"2023-07-21T22:10:41.146280+0000","last_undegraded":"2023-07-21T22:10:41.146280+0000","last_fullsized":"2023-07-21T22:10:41.146280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:50:33.337315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643783+0000","last_change":"2023-07-21T22:10:34.179261+0000","last_active":"2023-07-21T22:10:40.643783+0000","last_peered":"2023-07-21T22:10:40.643783+0000","last_clean":"2023-07-21T22:10:40.643783+0000","last_became_active":"2023-07-21T22:10:34.178960+0000","last_became_peered":"2023-07-21T22:10:34.178960+0000","last_unstale":"2023-07-21T22:10:40.643783+0000","last_undegraded":"2023-07-21T22:10:40.643783+0000","last_fullsized":"2023-07-21T22:10:40.643783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:06.437405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265850+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:10:40.265850+0000","last_peered":"2023-07-21T22:10:40.265850+0000","last_clean":"2023-07-21T22:10:40.265850+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:10:40.265850+0000","last_undegraded":"2023-07-21T22:10:40.265850+0000","last_fullsized":"2023-07-21T22:10:40.265850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:19:33.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":181,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145465+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:10:41.145465+0000","last_peered":"2023-07-21T22:10:41.145465+0000","last_clean":"2023-07-21T22:10:41.145465+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:10:41.145465+0000","last_undegraded":"2023-07-21T22:10:41.145465+0000","last_fullsized":"2023-07-21T22:10:41.145465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:21.070954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146227+0000","last_change":"2023-07-21T22:10:39.284150+0000","last_active":"2023-07-21T22:10:41.146227+0000","last_peered":"2023-07-21T22:10:41.146227+0000","last_clean":"2023-07-21T22:10:41.146227+0000","last_became_active":"2023-07-21T22:10:39.283381+0000","last_became_peered":"2023-07-21T22:10:39.283381+0000","last_unstale":"2023-07-21T22:10:41.146227+0000","last_undegraded":"2023-07-21T22:10:41.146227+0000","last_fullsized":"2023-07-21T22:10:41.146227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:15:59.402797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147452+0000","last_change":"2023-07-21T22:10:35.197136+0000","last_active":"2023-07-21T22:10:41.147452+0000","last_peered":"2023-07-21T22:10:41.147452+0000","last_clean":"2023-07-21T22:10:41.147452+0000","last_became_active":"2023-07-21T22:10:35.196793+0000","last_became_peered":"2023-07-21T22:10:35.196793+0000","last_unstale":"2023-07-21T22:10:41.147452+0000","last_undegraded":"2023-07-21T22:10:41.147452+0000","last_fullsized":"2023-07-21T22:10:41.147452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:58:58.416910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643562+0000","last_change":"2023-07-21T22:10:34.182106+0000","last_active":"2023-07-21T22:10:40.643562+0000","last_peered":"2023-07-21T22:10:40.643562+0000","last_clean":"2023-07-21T22:10:40.643562+0000","last_became_active":"2023-07-21T22:10:34.181808+0000","last_became_peered":"2023-07-21T22:10:34.181808+0000","last_unstale":"2023-07-21T22:10:40.643562+0000","last_undegraded":"2023-07-21T22:10:40.643562+0000","last_fullsized":"2023-07-21T22:10:40.643562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:42:55.768979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265150+0000","last_change":"2023-07-21T22:10:39.278199+0000","last_active":"2023-07-21T22:10:40.265150+0000","last_peered":"2023-07-21T22:10:40.265150+0000","last_clean":"2023-07-21T22:10:40.265150+0000","last_became_active":"2023-07-21T22:10:39.277773+0000","last_became_peered":"2023-07-21T22:10:39.277773+0000","last_unstale":"2023-07-21T22:10:40.265150+0000","last_undegraded":"2023-07-21T22:10:40.265150+0000","last_fullsized":"2023-07-21T22:10:40.265150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:32:06.176345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265331+0000","last_change":"2023-07-21T22:10:35.183217+0000","last_active":"2023-07-21T22:10:40.265331+0000","last_peered":"2023-07-21T22:10:40.265331+0000","last_clean":"2023-07-21T22:10:40.265331+0000","last_became_active":"2023-07-21T22:10:35.182856+0000","last_became_peered":"2023-07-21T22:10:35.182856+0000","last_unstale":"2023-07-21T22:10:40.265331+0000","last_undegraded":"2023-07-21T22:10:40.265331+0000","last_fullsized":"2023-07-21T22:10:40.265331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:30:25.920287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264485+0000","last_change":"2023-07-21T22:10:34.187410+0000","last_active":"2023-07-21T22:10:40.264485+0000","last_peered":"2023-07-21T22:10:40.264485+0000","last_clean":"2023-07-21T22:10:40.264485+0000","last_became_active":"2023-07-21T22:10:34.185501+0000","last_became_peered":"2023-07-21T22:10:34.185501+0000","last_unstale":"2023-07-21T22:10:40.264485+0000","last_undegraded":"2023-07-21T22:10:40.264485+0000","last_fullsized":"2023-07-21T22:10:40.264485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:39:44.435404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266593+0000","last_change":"2023-07-21T22:10:39.280745+0000","last_active":"2023-07-21T22:10:40.266593+0000","last_peered":"2023-07-21T22:10:40.266593+0000","last_clean":"2023-07-21T22:10:40.266593+0000","last_became_active":"2023-07-21T22:10:39.279223+0000","last_became_peered":"2023-07-21T22:10:39.279223+0000","last_unstale":"2023-07-21T22:10:40.266593+0000","last_undegraded":"2023-07-21T22:10:40.266593+0000","last_fullsized":"2023-07-21T22:10:40.266593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:54.403892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264956+0000","last_change":"2023-07-21T22:10:35.181575+0000","last_active":"2023-07-21T22:10:40.264956+0000","last_peered":"2023-07-21T22:10:40.264956+0000","last_clean":"2023-07-21T22:10:40.264956+0000","last_became_active":"2023-07-21T22:10:35.181328+0000","last_became_peered":"2023-07-21T22:10:35.181328+0000","last_unstale":"2023-07-21T22:10:40.264956+0000","last_undegraded":"2023-07-21T22:10:40.264956+0000","last_fullsized":"2023-07-21T22:10:40.264956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:42:35.913798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145748+0000","last_change":"2023-07-21T22:10:34.190677+0000","last_active":"2023-07-21T22:10:41.145748+0000","last_peered":"2023-07-21T22:10:41.145748+0000","last_clean":"2023-07-21T22:10:41.145748+0000","last_became_active":"2023-07-21T22:10:34.190379+0000","last_became_peered":"2023-07-21T22:10:34.190379+0000","last_unstale":"2023-07-21T22:10:41.145748+0000","last_undegraded":"2023-07-21T22:10:41.145748+0000","last_fullsized":"2023-07-21T22:10:41.145748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:28:46.376238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147094+0000","last_change":"2023-07-21T22:10:39.285099+0000","last_active":"2023-07-21T22:10:41.147094+0000","last_peered":"2023-07-21T22:10:41.147094+0000","last_clean":"2023-07-21T22:10:41.147094+0000","last_became_active":"2023-07-21T22:10:39.284046+0000","last_became_peered":"2023-07-21T22:10:39.284046+0000","last_unstale":"2023-07-21T22:10:41.147094+0000","last_undegraded":"2023-07-21T22:10:41.147094+0000","last_fullsized":"2023-07-21T22:10:41.147094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:49.251705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264528+0000","last_change":"2023-07-21T22:10:35.193709+0000","last_active":"2023-07-21T22:10:40.264528+0000","last_peered":"2023-07-21T22:10:40.264528+0000","last_clean":"2023-07-21T22:10:40.264528+0000","last_became_active":"2023-07-21T22:10:35.193409+0000","last_became_peered":"2023-07-21T22:10:35.193409+0000","last_unstale":"2023-07-21T22:10:40.264528+0000","last_undegraded":"2023-07-21T22:10:40.264528+0000","last_fullsized":"2023-07-21T22:10:40.264528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:01.253948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644277+0000","last_change":"2023-07-21T22:10:34.185707+0000","last_active":"2023-07-21T22:10:40.644277+0000","last_peered":"2023-07-21T22:10:40.644277+0000","last_clean":"2023-07-21T22:10:40.644277+0000","last_became_active":"2023-07-21T22:10:34.185415+0000","last_became_peered":"2023-07-21T22:10:34.185415+0000","last_unstale":"2023-07-21T22:10:40.644277+0000","last_undegraded":"2023-07-21T22:10:40.644277+0000","last_fullsized":"2023-07-21T22:10:40.644277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:01:57.132624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262536+0000","last_change":"2023-07-21T22:10:39.288923+0000","last_active":"2023-07-21T22:10:40.262536+0000","last_peered":"2023-07-21T22:10:40.262536+0000","last_clean":"2023-07-21T22:10:40.262536+0000","last_became_active":"2023-07-21T22:10:39.284848+0000","last_became_peered":"2023-07-21T22:10:39.284848+0000","last_unstale":"2023-07-21T22:10:40.262536+0000","last_undegraded":"2023-07-21T22:10:40.262536+0000","last_fullsized":"2023-07-21T22:10:40.262536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:54:17.869022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146100+0000","last_change":"2023-07-21T22:10:35.183881+0000","last_active":"2023-07-21T22:10:41.146100+0000","last_peered":"2023-07-21T22:10:41.146100+0000","last_clean":"2023-07-21T22:10:41.146100+0000","last_became_active":"2023-07-21T22:10:35.183392+0000","last_became_peered":"2023-07-21T22:10:35.183392+0000","last_unstale":"2023-07-21T22:10:41.146100+0000","last_undegraded":"2023-07-21T22:10:41.146100+0000","last_fullsized":"2023-07-21T22:10:41.146100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:17:44.809522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265587+0000","last_change":"2023-07-21T22:10:34.189475+0000","last_active":"2023-07-21T22:10:40.265587+0000","last_peered":"2023-07-21T22:10:40.265587+0000","last_clean":"2023-07-21T22:10:40.265587+0000","last_became_active":"2023-07-21T22:10:34.189101+0000","last_became_peered":"2023-07-21T22:10:34.189101+0000","last_unstale":"2023-07-21T22:10:40.265587+0000","last_undegraded":"2023-07-21T22:10:40.265587+0000","last_fullsized":"2023-07-21T22:10:40.265587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:48.235788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261969+0000","last_change":"2023-07-21T22:10:39.288287+0000","last_active":"2023-07-21T22:10:40.261969+0000","last_peered":"2023-07-21T22:10:40.261969+0000","last_clean":"2023-07-21T22:10:40.261969+0000","last_became_active":"2023-07-21T22:10:39.285298+0000","last_became_peered":"2023-07-21T22:10:39.285298+0000","last_unstale":"2023-07-21T22:10:40.261969+0000","last_undegraded":"2023-07-21T22:10:40.261969+0000","last_fullsized":"2023-07-21T22:10:40.261969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:50:45.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145472+0000","last_change":"2023-07-21T22:10:35.189604+0000","last_active":"2023-07-21T22:10:41.145472+0000","last_peered":"2023-07-21T22:10:41.145472+0000","last_clean":"2023-07-21T22:10:41.145472+0000","last_became_active":"2023-07-21T22:10:35.189358+0000","last_became_peered":"2023-07-21T22:10:35.189358+0000","last_unstale":"2023-07-21T22:10:41.145472+0000","last_undegraded":"2023-07-21T22:10:41.145472+0000","last_fullsized":"2023-07-21T22:10:41.145472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:57.173528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146814+0000","last_change":"2023-07-21T22:10:34.178611+0000","last_active":"2023-07-21T22:10:41.146814+0000","last_peered":"2023-07-21T22:10:41.146814+0000","last_clean":"2023-07-21T22:10:41.146814+0000","last_became_active":"2023-07-21T22:10:34.178321+0000","last_became_peered":"2023-07-21T22:10:34.178321+0000","last_unstale":"2023-07-21T22:10:41.146814+0000","last_undegraded":"2023-07-21T22:10:41.146814+0000","last_fullsized":"2023-07-21T22:10:41.146814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:39.236774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261985+0000","last_change":"2023-07-21T22:10:39.285122+0000","last_active":"2023-07-21T22:10:40.261985+0000","last_peered":"2023-07-21T22:10:40.261985+0000","last_clean":"2023-07-21T22:10:40.261985+0000","last_became_active":"2023-07-21T22:10:39.284637+0000","last_became_peered":"2023-07-21T22:10:39.284637+0000","last_unstale":"2023-07-21T22:10:40.261985+0000","last_undegraded":"2023-07-21T22:10:40.261985+0000","last_fullsized":"2023-07-21T22:10:40.261985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:54:50.939333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263932+0000","last_change":"2023-07-21T22:10:35.188636+0000","last_active":"2023-07-21T22:10:40.263932+0000","last_peered":"2023-07-21T22:10:40.263932+0000","last_clean":"2023-07-21T22:10:40.263932+0000","last_became_active":"2023-07-21T22:10:35.188298+0000","last_became_peered":"2023-07-21T22:10:35.188298+0000","last_unstale":"2023-07-21T22:10:40.263932+0000","last_undegraded":"2023-07-21T22:10:40.263932+0000","last_fullsized":"2023-07-21T22:10:40.263932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:18:45.368754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147220+0000","last_change":"2023-07-21T22:10:34.194251+0000","last_active":"2023-07-21T22:10:41.147220+0000","last_peered":"2023-07-21T22:10:41.147220+0000","last_clean":"2023-07-21T22:10:41.147220+0000","last_became_active":"2023-07-21T22:10:34.193914+0000","last_became_peered":"2023-07-21T22:10:34.193914+0000","last_unstale":"2023-07-21T22:10:41.147220+0000","last_undegraded":"2023-07-21T22:10:41.147220+0000","last_fullsized":"2023-07-21T22:10:41.147220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:18.845683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261519+0000","last_change":"2023-07-21T22:10:39.284893+0000","last_active":"2023-07-21T22:10:40.261519+0000","last_peered":"2023-07-21T22:10:40.261519+0000","last_clean":"2023-07-21T22:10:40.261519+0000","last_became_active":"2023-07-21T22:10:39.284465+0000","last_became_peered":"2023-07-21T22:10:39.284465+0000","last_unstale":"2023-07-21T22:10:40.261519+0000","last_undegraded":"2023-07-21T22:10:40.261519+0000","last_fullsized":"2023-07-21T22:10:40.261519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:08.368632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263217+0000","last_change":"2023-07-21T22:10:35.179108+0000","last_active":"2023-07-21T22:10:40.263217+0000","last_peered":"2023-07-21T22:10:40.263217+0000","last_clean":"2023-07-21T22:10:40.263217+0000","last_became_active":"2023-07-21T22:10:35.178860+0000","last_became_peered":"2023-07-21T22:10:35.178860+0000","last_unstale":"2023-07-21T22:10:40.263217+0000","last_undegraded":"2023-07-21T22:10:40.263217+0000","last_fullsized":"2023-07-21T22:10:40.263217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:10.196079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147218+0000","last_change":"2023-07-21T22:10:34.191213+0000","last_active":"2023-07-21T22:10:41.147218+0000","last_peered":"2023-07-21T22:10:41.147218+0000","last_clean":"2023-07-21T22:10:41.147218+0000","last_became_active":"2023-07-21T22:10:34.190864+0000","last_became_peered":"2023-07-21T22:10:34.190864+0000","last_unstale":"2023-07-21T22:10:41.147218+0000","last_undegraded":"2023-07-21T22:10:41.147218+0000","last_fullsized":"2023-07-21T22:10:41.147218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:48.235788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146089+0000","last_change":"2023-07-21T22:10:39.285659+0000","last_active":"2023-07-21T22:10:41.146089+0000","last_peered":"2023-07-21T22:10:41.146089+0000","last_clean":"2023-07-21T22:10:41.146089+0000","last_became_active":"2023-07-21T22:10:39.285107+0000","last_became_peered":"2023-07-21T22:10:39.285107+0000","last_unstale":"2023-07-21T22:10:41.146089+0000","last_undegraded":"2023-07-21T22:10:41.146089+0000","last_fullsized":"2023-07-21T22:10:41.146089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:49.251705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265541+0000","last_change":"2023-07-21T22:10:39.283176+0000","last_active":"2023-07-21T22:10:40.265541+0000","last_peered":"2023-07-21T22:10:40.265541+0000","last_clean":"2023-07-21T22:10:40.265541+0000","last_became_active":"2023-07-21T22:10:39.282822+0000","last_became_peered":"2023-07-21T22:10:39.282822+0000","last_unstale":"2023-07-21T22:10:40.265541+0000","last_undegraded":"2023-07-21T22:10:40.265541+0000","last_fullsized":"2023-07-21T22:10:40.265541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:44:45.486837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'8","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144843+0000","last_change":"2023-07-21T22:10:34.187632+0000","last_active":"2023-07-21T22:10:41.144843+0000","last_peered":"2023-07-21T22:10:41.144843+0000","last_clean":"2023-07-21T22:10:41.144843+0000","last_became_active":"2023-07-21T22:10:34.187327+0000","last_became_peered":"2023-07-21T22:10:34.187327+0000","last_unstale":"2023-07-21T22:10:41.144843+0000","last_undegraded":"2023-07-21T22:10:41.144843+0000","last_fullsized":"2023-07-21T22:10:41.144843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:29.738382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644454+0000","last_change":"2023-07-21T22:10:35.196258+0000","last_active":"2023-07-21T22:10:40.644454+0000","last_peered":"2023-07-21T22:10:40.644454+0000","last_clean":"2023-07-21T22:10:40.644454+0000","last_became_active":"2023-07-21T22:10:35.195943+0000","last_became_peered":"2023-07-21T22:10:35.195943+0000","last_unstale":"2023-07-21T22:10:40.644454+0000","last_undegraded":"2023-07-21T22:10:40.644454+0000","last_fullsized":"2023-07-21T22:10:40.644454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:53:55.769220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644298+0000","last_change":"2023-07-21T22:10:39.285606+0000","last_active":"2023-07-21T22:10:40.644298+0000","last_peered":"2023-07-21T22:10:40.644298+0000","last_clean":"2023-07-21T22:10:40.644298+0000","last_became_active":"2023-07-21T22:10:39.285013+0000","last_became_peered":"2023-07-21T22:10:39.285013+0000","last_unstale":"2023-07-21T22:10:40.644298+0000","last_undegraded":"2023-07-21T22:10:40.644298+0000","last_fullsized":"2023-07-21T22:10:40.644298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:09:27.124262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146727+0000","last_change":"2023-07-21T22:10:34.194383+0000","last_active":"2023-07-21T22:10:41.146727+0000","last_peered":"2023-07-21T22:10:41.146727+0000","last_clean":"2023-07-21T22:10:41.146727+0000","last_became_active":"2023-07-21T22:10:34.194063+0000","last_became_peered":"2023-07-21T22:10:34.194063+0000","last_unstale":"2023-07-21T22:10:41.146727+0000","last_undegraded":"2023-07-21T22:10:41.146727+0000","last_fullsized":"2023-07-21T22:10:41.146727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:09.182975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147842+0000","last_change":"2023-07-21T22:10:35.193372+0000","last_active":"2023-07-21T22:10:41.147842+0000","last_peered":"2023-07-21T22:10:41.147842+0000","last_clean":"2023-07-21T22:10:41.147842+0000","last_became_active":"2023-07-21T22:10:35.193099+0000","last_became_peered":"2023-07-21T22:10:35.193099+0000","last_unstale":"2023-07-21T22:10:41.147842+0000","last_undegraded":"2023-07-21T22:10:41.147842+0000","last_fullsized":"2023-07-21T22:10:41.147842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:18:34.792098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145663+0000","last_change":"2023-07-21T22:10:34.174760+0000","last_active":"2023-07-21T22:10:41.145663+0000","last_peered":"2023-07-21T22:10:41.145663+0000","last_clean":"2023-07-21T22:10:41.145663+0000","last_became_active":"2023-07-21T22:10:34.174412+0000","last_became_peered":"2023-07-21T22:10:34.174412+0000","last_unstale":"2023-07-21T22:10:41.145663+0000","last_undegraded":"2023-07-21T22:10:41.145663+0000","last_fullsized":"2023-07-21T22:10:41.145663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:49.434373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265838+0000","last_change":"2023-07-21T22:10:35.181797+0000","last_active":"2023-07-21T22:10:40.265838+0000","last_peered":"2023-07-21T22:10:40.265838+0000","last_clean":"2023-07-21T22:10:40.265838+0000","last_became_active":"2023-07-21T22:10:35.180383+0000","last_became_peered":"2023-07-21T22:10:35.180383+0000","last_unstale":"2023-07-21T22:10:40.265838+0000","last_undegraded":"2023-07-21T22:10:40.265838+0000","last_fullsized":"2023-07-21T22:10:40.265838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:58.158269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644090+0000","last_change":"2023-07-21T22:10:39.283924+0000","last_active":"2023-07-21T22:10:40.644090+0000","last_peered":"2023-07-21T22:10:40.644090+0000","last_clean":"2023-07-21T22:10:40.644090+0000","last_became_active":"2023-07-21T22:10:39.283524+0000","last_became_peered":"2023-07-21T22:10:39.283524+0000","last_unstale":"2023-07-21T22:10:40.644090+0000","last_undegraded":"2023-07-21T22:10:40.644090+0000","last_fullsized":"2023-07-21T22:10:40.644090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:10:21.482474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147082+0000","last_change":"2023-07-21T22:10:34.195049+0000","last_active":"2023-07-21T22:10:41.147082+0000","last_peered":"2023-07-21T22:10:41.147082+0000","last_clean":"2023-07-21T22:10:41.147082+0000","last_became_active":"2023-07-21T22:10:34.194734+0000","last_became_peered":"2023-07-21T22:10:34.194734+0000","last_unstale":"2023-07-21T22:10:41.147082+0000","last_undegraded":"2023-07-21T22:10:41.147082+0000","last_fullsized":"2023-07-21T22:10:41.147082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:33.127991+0000","last_clean_scrub_stamp":"2023-07-21T22:10:33.127991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:19.034773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644242+0000","last_change":"2023-07-21T22:10:35.192516+0000","last_active":"2023-07-21T22:10:40.644242+0000","last_peered":"2023-07-21T22:10:40.644242+0000","last_clean":"2023-07-21T22:10:40.644242+0000","last_became_active":"2023-07-21T22:10:35.192223+0000","last_became_peered":"2023-07-21T22:10:35.192223+0000","last_unstale":"2023-07-21T22:10:40.644242+0000","last_undegraded":"2023-07-21T22:10:40.644242+0000","last_fullsized":"2023-07-21T22:10:40.644242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:35:11.828421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265637+0000","last_change":"2023-07-21T22:10:39.279488+0000","last_active":"2023-07-21T22:10:40.265637+0000","last_peered":"2023-07-21T22:10:40.265637+0000","last_clean":"2023-07-21T22:10:40.265637+0000","last_became_active":"2023-07-21T22:10:39.279003+0000","last_became_peered":"2023-07-21T22:10:39.279003+0000","last_unstale":"2023-07-21T22:10:40.265637+0000","last_undegraded":"2023-07-21T22:10:40.265637+0000","last_fullsized":"2023-07-21T22:10:40.265637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:38.224137+0000","last_clean_scrub_stamp":"2023-07-21T22:10:38.224137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:23.941829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.144554+0000","last_change":"2023-07-21T22:10:35.179763+0000","last_active":"2023-07-21T22:10:41.144554+0000","last_peered":"2023-07-21T22:10:41.144554+0000","last_clean":"2023-07-21T22:10:41.144554+0000","last_became_active":"2023-07-21T22:10:35.179461+0000","last_became_peered":"2023-07-21T22:10:35.179461+0000","last_unstale":"2023-07-21T22:10:41.144554+0000","last_undegraded":"2023-07-21T22:10:41.144554+0000","last_fullsized":"2023-07-21T22:10:41.144554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:26:37.683815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643259+0000","last_change":"2023-07-21T22:10:35.198489+0000","last_active":"2023-07-21T22:10:40.643259+0000","last_peered":"2023-07-21T22:10:40.643259+0000","last_clean":"2023-07-21T22:10:40.643259+0000","last_became_active":"2023-07-21T22:10:35.196445+0000","last_became_peered":"2023-07-21T22:10:35.196445+0000","last_unstale":"2023-07-21T22:10:40.643259+0000","last_undegraded":"2023-07-21T22:10:40.643259+0000","last_fullsized":"2023-07-21T22:10:40.643259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:44:28.401234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264788+0000","last_change":"2023-07-21T22:10:35.187176+0000","last_active":"2023-07-21T22:10:40.264788+0000","last_peered":"2023-07-21T22:10:40.264788+0000","last_clean":"2023-07-21T22:10:40.264788+0000","last_became_active":"2023-07-21T22:10:35.186863+0000","last_became_peered":"2023-07-21T22:10:35.186863+0000","last_unstale":"2023-07-21T22:10:40.264788+0000","last_undegraded":"2023-07-21T22:10:40.264788+0000","last_fullsized":"2023-07-21T22:10:40.264788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:06:49.659850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.644061+0000","last_change":"2023-07-21T22:10:35.198787+0000","last_active":"2023-07-21T22:10:40.644061+0000","last_peered":"2023-07-21T22:10:40.644061+0000","last_clean":"2023-07-21T22:10:40.644061+0000","last_became_active":"2023-07-21T22:10:35.198500+0000","last_became_peered":"2023-07-21T22:10:35.198500+0000","last_unstale":"2023-07-21T22:10:40.644061+0000","last_undegraded":"2023-07-21T22:10:40.644061+0000","last_fullsized":"2023-07-21T22:10:40.644061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:53:24.242935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147817+0000","last_change":"2023-07-21T22:10:35.179417+0000","last_active":"2023-07-21T22:10:41.147817+0000","last_peered":"2023-07-21T22:10:41.147817+0000","last_clean":"2023-07-21T22:10:41.147817+0000","last_became_active":"2023-07-21T22:10:35.179102+0000","last_became_peered":"2023-07-21T22:10:35.179102+0000","last_unstale":"2023-07-21T22:10:41.147817+0000","last_undegraded":"2023-07-21T22:10:41.147817+0000","last_fullsized":"2023-07-21T22:10:41.147817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:44:41.403795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265823+0000","last_change":"2023-07-21T22:10:35.183678+0000","last_active":"2023-07-21T22:10:40.265823+0000","last_peered":"2023-07-21T22:10:40.265823+0000","last_clean":"2023-07-21T22:10:40.265823+0000","last_became_active":"2023-07-21T22:10:35.181954+0000","last_became_peered":"2023-07-21T22:10:35.181954+0000","last_unstale":"2023-07-21T22:10:40.265823+0000","last_undegraded":"2023-07-21T22:10:40.265823+0000","last_fullsized":"2023-07-21T22:10:40.265823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:51:47.919272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.148183+0000","last_change":"2023-07-21T22:10:35.183172+0000","last_active":"2023-07-21T22:10:41.148183+0000","last_peered":"2023-07-21T22:10:41.148183+0000","last_clean":"2023-07-21T22:10:41.148183+0000","last_became_active":"2023-07-21T22:10:35.182810+0000","last_became_peered":"2023-07-21T22:10:35.182810+0000","last_unstale":"2023-07-21T22:10:41.148183+0000","last_undegraded":"2023-07-21T22:10:41.148183+0000","last_fullsized":"2023-07-21T22:10:41.148183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:48.176651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147386+0000","last_change":"2023-07-21T22:10:35.185656+0000","last_active":"2023-07-21T22:10:41.147386+0000","last_peered":"2023-07-21T22:10:41.147386+0000","last_clean":"2023-07-21T22:10:41.147386+0000","last_became_active":"2023-07-21T22:10:35.185351+0000","last_became_peered":"2023-07-21T22:10:35.185351+0000","last_unstale":"2023-07-21T22:10:41.147386+0000","last_undegraded":"2023-07-21T22:10:41.147386+0000","last_fullsized":"2023-07-21T22:10:41.147386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:37:12.318204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145095+0000","last_change":"2023-07-21T22:10:35.196481+0000","last_active":"2023-07-21T22:10:41.145095+0000","last_peered":"2023-07-21T22:10:41.145095+0000","last_clean":"2023-07-21T22:10:41.145095+0000","last_became_active":"2023-07-21T22:10:35.196158+0000","last_became_peered":"2023-07-21T22:10:35.196158+0000","last_unstale":"2023-07-21T22:10:41.145095+0000","last_undegraded":"2023-07-21T22:10:41.145095+0000","last_fullsized":"2023-07-21T22:10:41.145095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:32.007914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.643201+0000","last_change":"2023-07-21T22:10:35.194616+0000","last_active":"2023-07-21T22:10:40.643201+0000","last_peered":"2023-07-21T22:10:40.643201+0000","last_clean":"2023-07-21T22:10:40.643201+0000","last_became_active":"2023-07-21T22:10:35.194326+0000","last_became_peered":"2023-07-21T22:10:35.194326+0000","last_unstale":"2023-07-21T22:10:40.643201+0000","last_undegraded":"2023-07-21T22:10:40.643201+0000","last_fullsized":"2023-07-21T22:10:40.643201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:54:51.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145426+0000","last_change":"2023-07-21T22:10:35.181759+0000","last_active":"2023-07-21T22:10:41.145426+0000","last_peered":"2023-07-21T22:10:41.145426+0000","last_clean":"2023-07-21T22:10:41.145426+0000","last_became_active":"2023-07-21T22:10:35.179939+0000","last_became_peered":"2023-07-21T22:10:35.179939+0000","last_unstale":"2023-07-21T22:10:41.145426+0000","last_undegraded":"2023-07-21T22:10:41.145426+0000","last_fullsized":"2023-07-21T22:10:41.145426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:59:17.361629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.147050+0000","last_change":"2023-07-21T22:10:35.201621+0000","last_active":"2023-07-21T22:10:41.147050+0000","last_peered":"2023-07-21T22:10:41.147050+0000","last_clean":"2023-07-21T22:10:41.147050+0000","last_became_active":"2023-07-21T22:10:35.201242+0000","last_became_peered":"2023-07-21T22:10:35.201242+0000","last_unstale":"2023-07-21T22:10:41.147050+0000","last_undegraded":"2023-07-21T22:10:41.147050+0000","last_fullsized":"2023-07-21T22:10:41.147050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:44:41.403795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264570+0000","last_change":"2023-07-21T22:10:35.181975+0000","last_active":"2023-07-21T22:10:40.264570+0000","last_peered":"2023-07-21T22:10:40.264570+0000","last_clean":"2023-07-21T22:10:40.264570+0000","last_became_active":"2023-07-21T22:10:35.181368+0000","last_became_peered":"2023-07-21T22:10:35.181368+0000","last_unstale":"2023-07-21T22:10:40.264570+0000","last_undegraded":"2023-07-21T22:10:40.264570+0000","last_fullsized":"2023-07-21T22:10:40.264570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:44.586259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262782+0000","last_change":"2023-07-21T22:10:35.182687+0000","last_active":"2023-07-21T22:10:40.262782+0000","last_peered":"2023-07-21T22:10:40.262782+0000","last_clean":"2023-07-21T22:10:40.262782+0000","last_became_active":"2023-07-21T22:10:35.182369+0000","last_became_peered":"2023-07-21T22:10:35.182369+0000","last_unstale":"2023-07-21T22:10:40.262782+0000","last_undegraded":"2023-07-21T22:10:40.262782+0000","last_fullsized":"2023-07-21T22:10:40.262782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:47:37.395408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265158+0000","last_change":"2023-07-21T22:10:35.181596+0000","last_active":"2023-07-21T22:10:40.265158+0000","last_peered":"2023-07-21T22:10:40.265158+0000","last_clean":"2023-07-21T22:10:40.265158+0000","last_became_active":"2023-07-21T22:10:35.181343+0000","last_became_peered":"2023-07-21T22:10:35.181343+0000","last_unstale":"2023-07-21T22:10:40.265158+0000","last_undegraded":"2023-07-21T22:10:40.265158+0000","last_fullsized":"2023-07-21T22:10:40.265158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:00.862980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146323+0000","last_change":"2023-07-21T22:10:35.191662+0000","last_active":"2023-07-21T22:10:41.146323+0000","last_peered":"2023-07-21T22:10:41.146323+0000","last_clean":"2023-07-21T22:10:41.146323+0000","last_became_active":"2023-07-21T22:10:35.191389+0000","last_became_peered":"2023-07-21T22:10:35.191389+0000","last_unstale":"2023-07-21T22:10:41.146323+0000","last_undegraded":"2023-07-21T22:10:41.146323+0000","last_fullsized":"2023-07-21T22:10:41.146323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:49.731806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263421+0000","last_change":"2023-07-21T22:10:35.180343+0000","last_active":"2023-07-21T22:10:40.263421+0000","last_peered":"2023-07-21T22:10:40.263421+0000","last_clean":"2023-07-21T22:10:40.263421+0000","last_became_active":"2023-07-21T22:10:35.178216+0000","last_became_peered":"2023-07-21T22:10:35.178216+0000","last_unstale":"2023-07-21T22:10:40.263421+0000","last_undegraded":"2023-07-21T22:10:40.263421+0000","last_fullsized":"2023-07-21T22:10:40.263421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:28:03.815256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146613+0000","last_change":"2023-07-21T22:10:35.188474+0000","last_active":"2023-07-21T22:10:41.146613+0000","last_peered":"2023-07-21T22:10:41.146613+0000","last_clean":"2023-07-21T22:10:41.146613+0000","last_became_active":"2023-07-21T22:10:35.187957+0000","last_became_peered":"2023-07-21T22:10:35.187957+0000","last_unstale":"2023-07-21T22:10:41.146613+0000","last_undegraded":"2023-07-21T22:10:41.146613+0000","last_fullsized":"2023-07-21T22:10:41.146613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:58:58.416910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264825+0000","last_change":"2023-07-21T22:10:35.172559+0000","last_active":"2023-07-21T22:10:40.264825+0000","last_peered":"2023-07-21T22:10:40.264825+0000","last_clean":"2023-07-21T22:10:40.264825+0000","last_became_active":"2023-07-21T22:10:35.172297+0000","last_became_peered":"2023-07-21T22:10:35.172297+0000","last_unstale":"2023-07-21T22:10:40.264825+0000","last_undegraded":"2023-07-21T22:10:40.264825+0000","last_fullsized":"2023-07-21T22:10:40.264825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:40.249878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.261736+0000","last_change":"2023-07-21T22:10:35.197849+0000","last_active":"2023-07-21T22:10:40.261736+0000","last_peered":"2023-07-21T22:10:40.261736+0000","last_clean":"2023-07-21T22:10:40.261736+0000","last_became_active":"2023-07-21T22:10:35.197518+0000","last_became_peered":"2023-07-21T22:10:35.197518+0000","last_unstale":"2023-07-21T22:10:40.261736+0000","last_undegraded":"2023-07-21T22:10:40.261736+0000","last_fullsized":"2023-07-21T22:10:40.261736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:14.080646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262913+0000","last_change":"2023-07-21T22:10:35.181027+0000","last_active":"2023-07-21T22:10:40.262913+0000","last_peered":"2023-07-21T22:10:40.262913+0000","last_clean":"2023-07-21T22:10:40.262913+0000","last_became_active":"2023-07-21T22:10:35.180649+0000","last_became_peered":"2023-07-21T22:10:35.180649+0000","last_unstale":"2023-07-21T22:10:40.262913+0000","last_undegraded":"2023-07-21T22:10:40.262913+0000","last_fullsized":"2023-07-21T22:10:40.262913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:43.732515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.265501+0000","last_change":"2023-07-21T22:10:35.188747+0000","last_active":"2023-07-21T22:10:40.265501+0000","last_peered":"2023-07-21T22:10:40.265501+0000","last_clean":"2023-07-21T22:10:40.265501+0000","last_became_active":"2023-07-21T22:10:35.188468+0000","last_became_peered":"2023-07-21T22:10:35.188468+0000","last_unstale":"2023-07-21T22:10:40.265501+0000","last_undegraded":"2023-07-21T22:10:40.265501+0000","last_fullsized":"2023-07-21T22:10:40.265501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:36:18.273058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266392+0000","last_change":"2023-07-21T22:10:35.186280+0000","last_active":"2023-07-21T22:10:40.266392+0000","last_peered":"2023-07-21T22:10:40.266392+0000","last_clean":"2023-07-21T22:10:40.266392+0000","last_became_active":"2023-07-21T22:10:35.185899+0000","last_became_peered":"2023-07-21T22:10:35.185899+0000","last_unstale":"2023-07-21T22:10:40.266392+0000","last_undegraded":"2023-07-21T22:10:40.266392+0000","last_fullsized":"2023-07-21T22:10:40.266392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:58:24.147605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146096+0000","last_change":"2023-07-21T22:10:35.194217+0000","last_active":"2023-07-21T22:10:41.146096+0000","last_peered":"2023-07-21T22:10:41.146096+0000","last_clean":"2023-07-21T22:10:41.146096+0000","last_became_active":"2023-07-21T22:10:35.193943+0000","last_became_peered":"2023-07-21T22:10:35.193943+0000","last_unstale":"2023-07-21T22:10:41.146096+0000","last_undegraded":"2023-07-21T22:10:41.146096+0000","last_fullsized":"2023-07-21T22:10:41.146096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:08:11.726615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263158+0000","last_change":"2023-07-21T22:10:35.175314+0000","last_active":"2023-07-21T22:10:40.263158+0000","last_peered":"2023-07-21T22:10:40.263158+0000","last_clean":"2023-07-21T22:10:40.263158+0000","last_became_active":"2023-07-21T22:10:35.175046+0000","last_became_peered":"2023-07-21T22:10:35.175046+0000","last_unstale":"2023-07-21T22:10:40.263158+0000","last_undegraded":"2023-07-21T22:10:40.263158+0000","last_fullsized":"2023-07-21T22:10:40.263158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:54.515955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146323+0000","last_change":"2023-07-21T22:10:35.187761+0000","last_active":"2023-07-21T22:10:41.146323+0000","last_peered":"2023-07-21T22:10:41.146323+0000","last_clean":"2023-07-21T22:10:41.146323+0000","last_became_active":"2023-07-21T22:10:35.187432+0000","last_became_peered":"2023-07-21T22:10:35.187432+0000","last_unstale":"2023-07-21T22:10:41.146323+0000","last_undegraded":"2023-07-21T22:10:41.146323+0000","last_fullsized":"2023-07-21T22:10:41.146323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:37:12.318204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.263742+0000","last_change":"2023-07-21T22:10:35.180975+0000","last_active":"2023-07-21T22:10:40.263742+0000","last_peered":"2023-07-21T22:10:40.263742+0000","last_clean":"2023-07-21T22:10:40.263742+0000","last_became_active":"2023-07-21T22:10:35.180610+0000","last_became_peered":"2023-07-21T22:10:35.180610+0000","last_unstale":"2023-07-21T22:10:40.263742+0000","last_undegraded":"2023-07-21T22:10:40.263742+0000","last_fullsized":"2023-07-21T22:10:40.263742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:24.993895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.146787+0000","last_change":"2023-07-21T22:10:35.202116+0000","last_active":"2023-07-21T22:10:41.146787+0000","last_peered":"2023-07-21T22:10:41.146787+0000","last_clean":"2023-07-21T22:10:41.146787+0000","last_became_active":"2023-07-21T22:10:35.201807+0000","last_became_peered":"2023-07-21T22:10:35.201807+0000","last_unstale":"2023-07-21T22:10:41.146787+0000","last_undegraded":"2023-07-21T22:10:41.146787+0000","last_fullsized":"2023-07-21T22:10:41.146787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:03:42.309634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:41.145678+0000","last_change":"2023-07-21T22:10:35.182990+0000","last_active":"2023-07-21T22:10:41.145678+0000","last_peered":"2023-07-21T22:10:41.145678+0000","last_clean":"2023-07-21T22:10:41.145678+0000","last_became_active":"2023-07-21T22:10:35.182451+0000","last_became_peered":"2023-07-21T22:10:35.182451+0000","last_unstale":"2023-07-21T22:10:41.145678+0000","last_undegraded":"2023-07-21T22:10:41.145678+0000","last_fullsized":"2023-07-21T22:10:41.145678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:52:17.840975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.264696+0000","last_change":"2023-07-21T22:10:35.181124+0000","last_active":"2023-07-21T22:10:40.264696+0000","last_peered":"2023-07-21T22:10:40.264696+0000","last_clean":"2023-07-21T22:10:40.264696+0000","last_became_active":"2023-07-21T22:10:35.180857+0000","last_became_peered":"2023-07-21T22:10:35.180857+0000","last_unstale":"2023-07-21T22:10:40.264696+0000","last_undegraded":"2023-07-21T22:10:40.264696+0000","last_fullsized":"2023-07-21T22:10:40.264696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:20:59.226705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.266167+0000","last_change":"2023-07-21T22:10:35.178260+0000","last_active":"2023-07-21T22:10:40.266167+0000","last_peered":"2023-07-21T22:10:40.266167+0000","last_clean":"2023-07-21T22:10:40.266167+0000","last_became_active":"2023-07-21T22:10:35.178006+0000","last_became_peered":"2023-07-21T22:10:35.178006+0000","last_unstale":"2023-07-21T22:10:40.266167+0000","last_undegraded":"2023-07-21T22:10:40.266167+0000","last_fullsized":"2023-07-21T22:10:40.266167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:58:45.344226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-21T22:10:40.262442+0000","last_change":"2023-07-21T22:10:35.197676+0000","last_active":"2023-07-21T22:10:40.262442+0000","last_peered":"2023-07-21T22:10:40.262442+0000","last_clean":"2023-07-21T22:10:40.262442+0000","last_became_active":"2023-07-21T22:10:35.197328+0000","last_became_peered":"2023-07-21T22:10:35.197328+0000","last_unstale":"2023-07-21T22:10:40.262442+0000","last_undegraded":"2023-07-21T22:10:40.262442+0000","last_fullsized":"2023-07-21T22:10:40.262442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:34.141096+0000","last_clean_scrub_stamp":"2023-07-21T22:10:34.141096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:17:58.266481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":724807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":130430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.544}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]}]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":327680,"data_stored":131082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":339968,"data_stored":134279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.46}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":323584,"data_stored":130520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":319488,"data_stored":130430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":917504,"data_stored":721380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":130430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:11:08.876 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-21T22:11:08.876 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-21T22:11:08.876 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-21T22:11:08.877 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-21T22:11:09.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.041+0000 7f91112cd700 1 Processor -- start 2023-07-21T22:11:09.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.041+0000 7f91112cd700 1 -- start start 2023-07-21T22:11:09.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.041+0000 7f91112cd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f910c0b36b0 0x7f910c06d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.041+0000 7f91112cd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f910c0713c0 0x7f910c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.041+0000 7f91112cd700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910c070690 con 0x7f910c0c9da0 2023-07-21T22:11:09.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.041+0000 7f91112cd700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910c06e260 con 0x7f910c0713c0 2023-07-21T22:11:09.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.041+0000 7f91112cd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910c070f30 con 0x7f910c0b36b0 2023-07-21T22:11:09.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f910b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f910c0713c0 0x7f910c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f9103fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f910c0c9da0 0x7f910c0c8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44724/0 (socket says 172.21.15.49:44724) 2023-07-21T22:11:09.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f9103fff700 1 -- 172.21.15.49:0/2402593840 learned_addr learned my addr 172.21.15.49:0/2402593840 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:09.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f910affd700 1 --2- 172.21.15.49:0/2402593840 >> v2:172.21.15.150:3300/0 conn(0x7f910c0b36b0 0x7f910c06d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f910b7fe700 1 -- 172.21.15.49:0/2402593840 >> v2:172.21.15.150:3300/0 conn(0x7f910c0b36b0 msgr2=0x7f910c06d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:09.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f910b7fe700 1 --2- 172.21.15.49:0/2402593840 >> v2:172.21.15.150:3300/0 conn(0x7f910c0b36b0 0x7f910c06d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f910b7fe700 1 -- 172.21.15.49:0/2402593840 >> v1:172.21.15.49:6789/0 conn(0x7f910c0c9da0 legacy=0x7f910c0c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f910b7fe700 1 -- 172.21.15.49:0/2402593840 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c06df20 con 0x7f910c0713c0 2023-07-21T22:11:09.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f910a7fc700 1 -- 172.21.15.49:0/2402593840 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236395485 0 0) 0x7f910c070690 con 0x7f910c0c9da0 2023-07-21T22:11:09.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f910b7fe700 1 --2- 172.21.15.49:0/2402593840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f910c0713c0 0x7f910c06d9e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f910c06a6d0 tx=0x7f910400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce72a6c65888aa2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:09.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f910a7fc700 1 -- 172.21.15.49:0/2402593840 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910400e070 con 0x7f910c0713c0 2023-07-21T22:11:09.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f910a7fc700 1 -- 172.21.15.49:0/2402593840 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910400bbd0 con 0x7f910c0713c0 2023-07-21T22:11:09.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f910a7fc700 1 -- 172.21.15.49:0/2402593840 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104012430 con 0x7f910c0713c0 2023-07-21T22:11:09.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f91112cd700 1 -- 172.21.15.49:0/2402593840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f910c0713c0 msgr2=0x7f910c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f91112cd700 1 --2- 172.21.15.49:0/2402593840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f910c0713c0 0x7f910c06d9e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f910c06a6d0 tx=0x7f910400b330 comp rx=0 tx=0).stop 2023-07-21T22:11:09.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f91112cd700 1 -- 172.21.15.49:0/2402593840 shutdown_connections 2023-07-21T22:11:09.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f91112cd700 1 --2- 172.21.15.49:0/2402593840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f910c0713c0 0x7f910c06d9e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f91112cd700 1 --2- 172.21.15.49:0/2402593840 >> v2:172.21.15.150:3300/0 conn(0x7f910c0b36b0 0x7f910c06d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f91112cd700 1 -- 172.21.15.49:0/2402593840 >> 172.21.15.49:0/2402593840 conn(0x7f910c06f5a0 msgr2=0x7f910c0afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:09.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f91112cd700 1 -- 172.21.15.49:0/2402593840 shutdown_connections 2023-07-21T22:11:09.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.045+0000 7f91112cd700 1 -- 172.21.15.49:0/2402593840 wait complete. 2023-07-21T22:11:09.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.049+0000 7f91112cd700 1 Processor -- start 2023-07-21T22:11:09.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.049+0000 7f91112cd700 1 -- start start 2023-07-21T22:11:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f91112cd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f910c0713c0 0x7f910c157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f91112cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f910c0b36b0 0x7f910c157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f91112cd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f910c0c9da0 0x7f910c158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f91112cd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c157170 con 0x7f910c0b36b0 2023-07-21T22:11:09.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f91112cd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c1568a0 con 0x7f910c0c9da0 2023-07-21T22:11:09.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f91112cd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c141360 con 0x7f910c0713c0 2023-07-21T22:11:09.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f9103fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f910c0b36b0 0x7f910c157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f910affd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f910c0713c0 0x7f910c157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f910b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f910c0c9da0 0x7f910c158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f9103fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f910c0b36b0 0x7f910c157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48454/0 (socket says 172.21.15.49:48454) 2023-07-21T22:11:09.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f9103fff700 1 -- 172.21.15.49:0/2192471050 learned_addr learned my addr 172.21.15.49:0/2192471050 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f9103fff700 1 -- 172.21.15.49:0/2192471050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f910c0713c0 msgr2=0x7f910c157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f9103fff700 1 --2- 172.21.15.49:0/2192471050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f910c0713c0 0x7f910c157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f9103fff700 1 -- 172.21.15.49:0/2192471050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f910c0c9da0 msgr2=0x7f910c158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f9103fff700 1 --2- 172.21.15.49:0/2192471050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f910c0c9da0 0x7f910c158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f9103fff700 1 -- 172.21.15.49:0/2192471050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9104009a70 con 0x7f910c0b36b0 2023-07-21T22:11:09.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.053+0000 7f9103fff700 1 --2- 172.21.15.49:0/2192471050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f910c0b36b0 0x7f910c157b40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f90f400c5b0 tx=0x7f90f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:09.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.057+0000 7f91037fe700 1 -- 172.21.15.49:0/2192471050 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f4004ca0 con 0x7f910c0b36b0 2023-07-21T22:11:09.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.057+0000 7f91037fe700 1 -- 172.21.15.49:0/2192471050 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f4004e20 con 0x7f910c0b36b0 2023-07-21T22:11:09.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.057+0000 7f91037fe700 1 -- 172.21.15.49:0/2192471050 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f4007310 con 0x7f910c0b36b0 2023-07-21T22:11:09.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.057+0000 7f91112cd700 1 -- 172.21.15.49:0/2192471050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910c0c42c0 con 0x7f910c0b36b0 2023-07-21T22:11:09.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.057+0000 7f91112cd700 1 -- 172.21.15.49:0/2192471050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910c156e00 con 0x7f910c0b36b0 2023-07-21T22:11:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.057+0000 7f91112cd700 1 -- 172.21.15.49:0/2192471050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910c1572e0 con 0x7f910c0b36b0 2023-07-21T22:11:09.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.061+0000 7f91037fe700 1 -- 172.21.15.49:0/2192471050 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f90f4007470 con 0x7f910c0b36b0 2023-07-21T22:11:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.061+0000 7f91037fe700 1 --2- 172.21.15.49:0/2192471050 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f90ec066320 0x7f90ec0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.061+0000 7f91037fe700 1 -- 172.21.15.49:0/2192471050 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f90f4083c40 con 0x7f910c0b36b0 2023-07-21T22:11:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.061+0000 7f910affd700 1 --2- 172.21.15.49:0/2192471050 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f90ec066320 0x7f90ec0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.065+0000 7f910affd700 1 --2- 172.21.15.49:0/2192471050 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f90ec066320 0x7f90ec0687d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009a00 tx=0x7f90fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:09.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.069+0000 7f91037fe700 1 -- 172.21.15.49:0/2192471050 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f90f4050dc0 con 0x7f910c0b36b0 2023-07-21T22:11:09.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.269+0000 7f91112cd700 1 -- 172.21.15.49:0/2192471050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f910c04dd20 con 0x7f910c0b36b0 2023-07-21T22:11:09.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.269+0000 7f91037fe700 1 -- 172.21.15.49:0/2192471050 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f90f4007720 con 0x7f910c0b36b0 2023-07-21T22:11:09.314 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:09.314 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-21T22:11:09.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.273+0000 7f91112cd700 1 -- 172.21.15.49:0/2192471050 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f90ec066320 msgr2=0x7f90ec0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.273+0000 7f91112cd700 1 --2- 172.21.15.49:0/2192471050 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f90ec066320 0x7f90ec0687d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009a00 tx=0x7f90fc008040 comp rx=0 tx=0).stop 2023-07-21T22:11:09.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.273+0000 7f91112cd700 1 -- 172.21.15.49:0/2192471050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f910c0b36b0 msgr2=0x7f910c157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.273+0000 7f91112cd700 1 --2- 172.21.15.49:0/2192471050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f910c0b36b0 0x7f910c157b40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f90f400c5b0 tx=0x7f90f400c8c0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.273+0000 7f91112cd700 1 -- 172.21.15.49:0/2192471050 shutdown_connections 2023-07-21T22:11:09.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.273+0000 7f91112cd700 1 --2- 172.21.15.49:0/2192471050 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f90ec066320 0x7f90ec0687d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.273+0000 7f91112cd700 1 --2- 172.21.15.49:0/2192471050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f910c0b36b0 0x7f910c157b40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.273+0000 7f91112cd700 1 --2- 172.21.15.49:0/2192471050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f910c0c9da0 0x7f910c158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.273+0000 7f91112cd700 1 --2- 172.21.15.49:0/2192471050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f910c0713c0 0x7f910c157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.273+0000 7f91112cd700 1 -- 172.21.15.49:0/2192471050 >> 172.21.15.49:0/2192471050 conn(0x7f910c06f5a0 msgr2=0x7f910c0afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:09.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.273+0000 7f91112cd700 1 -- 172.21.15.49:0/2192471050 shutdown_connections 2023-07-21T22:11:09.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.273+0000 7f91112cd700 1 -- 172.21.15.49:0/2192471050 wait complete. 2023-07-21T22:11:09.336 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-21T22:11:09.336 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:09.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.469+0000 7fb827169700 1 Processor -- start 2023-07-21T22:11:09.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.469+0000 7fb827169700 1 -- start start 2023-07-21T22:11:09.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.469+0000 7fb827169700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb820155dd0 0x7fb8200cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.469+0000 7fb827169700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8201561a0 0x7fb8200cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.469+0000 7fb827169700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8200afc20 0x7fb8200b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.469+0000 7fb827169700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8200b0580 con 0x7fb8200afc20 2023-07-21T22:11:09.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.469+0000 7fb827169700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82015bf50 con 0x7fb820155dd0 2023-07-21T22:11:09.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.469+0000 7fb827169700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82015c230 con 0x7fb8201561a0 2023-07-21T22:11:09.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.469+0000 7fb825706700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8200afc20 0x7fb8200b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.469+0000 7fb825706700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8200afc20 0x7fb8200b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48460/0 (socket says 172.21.15.49:48460) 2023-07-21T22:11:09.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.469+0000 7fb825706700 1 -- 172.21.15.49:0/2395020252 learned_addr learned my addr 172.21.15.49:0/2395020252 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:09.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.469+0000 7fb81ffff700 1 --2- 172.21.15.49:0/2395020252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8201561a0 0x7fb8200cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.469+0000 7fb824f05700 1 --2- 172.21.15.49:0/2395020252 >> v2:172.21.15.150:3300/0 conn(0x7fb820155dd0 0x7fb8200cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb825706700 1 -- 172.21.15.49:0/2395020252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8201561a0 msgr2=0x7fb8200cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:09.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb825706700 1 --2- 172.21.15.49:0/2395020252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8201561a0 0x7fb8200cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb825706700 1 -- 172.21.15.49:0/2395020252 >> v2:172.21.15.150:3300/0 conn(0x7fb820155dd0 msgr2=0x7fb8200cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:09.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb825706700 1 --2- 172.21.15.49:0/2395020252 >> v2:172.21.15.150:3300/0 conn(0x7fb820155dd0 0x7fb8200cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb825706700 1 -- 172.21.15.49:0/2395020252 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82015c510 con 0x7fb8200afc20 2023-07-21T22:11:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb825706700 1 --2- 172.21.15.49:0/2395020252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8200afc20 0x7fb8200b0040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb82006e670 tx=0x7fb81800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98477fff1b2ce474 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb81f7fe700 1 -- 172.21.15.49:0/2395020252 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818010070 con 0x7fb8200afc20 2023-07-21T22:11:09.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb81f7fe700 1 -- 172.21.15.49:0/2395020252 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81800dce0 con 0x7fb8200afc20 2023-07-21T22:11:09.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb81f7fe700 1 -- 172.21.15.49:0/2395020252 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81800b310 con 0x7fb8200afc20 2023-07-21T22:11:09.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb827169700 1 -- 172.21.15.49:0/2395020252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8200afc20 msgr2=0x7fb8200b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb827169700 1 --2- 172.21.15.49:0/2395020252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8200afc20 0x7fb8200b0040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb82006e670 tx=0x7fb81800d430 comp rx=0 tx=0).stop 2023-07-21T22:11:09.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb827169700 1 -- 172.21.15.49:0/2395020252 shutdown_connections 2023-07-21T22:11:09.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb827169700 1 --2- 172.21.15.49:0/2395020252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8201561a0 0x7fb8200cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb827169700 1 --2- 172.21.15.49:0/2395020252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8200afc20 0x7fb8200b0040 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb827169700 1 --2- 172.21.15.49:0/2395020252 >> v2:172.21.15.150:3300/0 conn(0x7fb820155dd0 0x7fb8200cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb827169700 1 -- 172.21.15.49:0/2395020252 >> 172.21.15.49:0/2395020252 conn(0x7fb82006f5a0 msgr2=0x7fb8200cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:09.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb827169700 1 -- 172.21.15.49:0/2395020252 shutdown_connections 2023-07-21T22:11:09.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.473+0000 7fb827169700 1 -- 172.21.15.49:0/2395020252 wait complete. 2023-07-21T22:11:09.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb827169700 1 Processor -- start 2023-07-21T22:11:09.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb827169700 1 -- start start 2023-07-21T22:11:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb827169700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8200afc20 0x7fb8200ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb827169700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb820155dd0 0x7fb8200c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb827169700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200c48f0 0x7fb8201512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb827169700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8200b1390 con 0x7fb820155dd0 2023-07-21T22:11:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb827169700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8200b1670 con 0x7fb8200c48f0 2023-07-21T22:11:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb827169700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8200b1950 con 0x7fb8200afc20 2023-07-21T22:11:09.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb81ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb820155dd0 0x7fb8200c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb81ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb820155dd0 0x7fb8200c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48468/0 (socket says 172.21.15.49:48468) 2023-07-21T22:11:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb81ffff700 1 -- 172.21.15.49:0/1379667496 learned_addr learned my addr 172.21.15.49:0/1379667496 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb824f05700 1 --2- 172.21.15.49:0/1379667496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8200afc20 0x7fb8200ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb825706700 1 --2- 172.21.15.49:0/1379667496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200c48f0 0x7fb8201512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb81ffff700 1 -- 172.21.15.49:0/1379667496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8200afc20 msgr2=0x7fb8200ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb81ffff700 1 --2- 172.21.15.49:0/1379667496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8200afc20 0x7fb8200ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb81ffff700 1 -- 172.21.15.49:0/1379667496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200c48f0 msgr2=0x7fb8201512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb81ffff700 1 --2- 172.21.15.49:0/1379667496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200c48f0 0x7fb8201512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.477+0000 7fb81ffff700 1 -- 172.21.15.49:0/1379667496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81800bd40 con 0x7fb820155dd0 2023-07-21T22:11:09.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.481+0000 7fb81ffff700 1 --2- 172.21.15.49:0/1379667496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb820155dd0 0x7fb8200c43b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00ebe0 tx=0x7fb80c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:09.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.481+0000 7fb81d7fa700 1 -- 172.21.15.49:0/1379667496 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c009740 con 0x7fb820155dd0 2023-07-21T22:11:09.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.481+0000 7fb81d7fa700 1 -- 172.21.15.49:0/1379667496 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c00c850 con 0x7fb820155dd0 2023-07-21T22:11:09.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.481+0000 7fb81d7fa700 1 -- 172.21.15.49:0/1379667496 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c00cbe0 con 0x7fb820155dd0 2023-07-21T22:11:09.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.481+0000 7fb827169700 1 -- 172.21.15.49:0/1379667496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8200b1c30 con 0x7fb820155dd0 2023-07-21T22:11:09.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.481+0000 7fb827169700 1 -- 172.21.15.49:0/1379667496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8200b0fd0 con 0x7fb820155dd0 2023-07-21T22:11:09.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.481+0000 7fb827169700 1 -- 172.21.15.49:0/1379667496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb820073130 con 0x7fb820155dd0 2023-07-21T22:11:09.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.485+0000 7fb81d7fa700 1 -- 172.21.15.49:0/1379667496 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb80c00cd40 con 0x7fb820155dd0 2023-07-21T22:11:09.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.485+0000 7fb81d7fa700 1 --2- 172.21.15.49:0/1379667496 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8040662f0 0x7fb8040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.485+0000 7fb81d7fa700 1 -- 172.21.15.49:0/1379667496 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb80c0840b0 con 0x7fb820155dd0 2023-07-21T22:11:09.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.485+0000 7fb824f05700 1 --2- 172.21.15.49:0/1379667496 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8040662f0 0x7fb8040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.485+0000 7fb824f05700 1 --2- 172.21.15.49:0/1379667496 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8040662f0 0x7fb8040687a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb814009b50 tx=0x7fb814009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:09.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.493+0000 7fb81d7fa700 1 -- 172.21.15.49:0/1379667496 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb80c0b4700 con 0x7fb820155dd0 2023-07-21T22:11:09.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.665+0000 7fb827169700 1 -- 172.21.15.49:0/1379667496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8200b2150 con 0x7fb820155dd0 2023-07-21T22:11:09.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.669+0000 7fb81d7fa700 1 -- 172.21.15.49:0/1379667496 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20084 (secure 0 0 0) 0x7fb80c054bb0 con 0x7fb820155dd0 2023-07-21T22:11:09.712 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:09.712 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:39.728219+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:09.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.669+0000 7fb827169700 1 -- 172.21.15.49:0/1379667496 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8040662f0 msgr2=0x7fb8040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.669+0000 7fb827169700 1 --2- 172.21.15.49:0/1379667496 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8040662f0 0x7fb8040687a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb814009b50 tx=0x7fb814009240 comp rx=0 tx=0).stop 2023-07-21T22:11:09.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.669+0000 7fb827169700 1 -- 172.21.15.49:0/1379667496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb820155dd0 msgr2=0x7fb8200c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.669+0000 7fb827169700 1 --2- 172.21.15.49:0/1379667496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb820155dd0 0x7fb8200c43b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00ebe0 tx=0x7fb80c00eef0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.673+0000 7fb827169700 1 -- 172.21.15.49:0/1379667496 shutdown_connections 2023-07-21T22:11:09.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.673+0000 7fb827169700 1 --2- 172.21.15.49:0/1379667496 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8040662f0 0x7fb8040687a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.673+0000 7fb827169700 1 --2- 172.21.15.49:0/1379667496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb820155dd0 0x7fb8200c43b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.673+0000 7fb827169700 1 --2- 172.21.15.49:0/1379667496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200c48f0 0x7fb8201512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.673+0000 7fb827169700 1 --2- 172.21.15.49:0/1379667496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8200afc20 0x7fb8200ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.673+0000 7fb827169700 1 -- 172.21.15.49:0/1379667496 >> 172.21.15.49:0/1379667496 conn(0x7fb82006f5a0 msgr2=0x7fb820157150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:09.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.673+0000 7fb827169700 1 -- 172.21.15.49:0/1379667496 shutdown_connections 2023-07-21T22:11:09.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.673+0000 7fb827169700 1 -- 172.21.15.49:0/1379667496 wait complete. 2023-07-21T22:11:09.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:11:09.737 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:11:09.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.873+0000 7f5c46058700 1 Processor -- start 2023-07-21T22:11:09.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.873+0000 7f5c46058700 1 -- start start 2023-07-21T22:11:09.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c46058700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c400cabe0 0x7f5c400cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c46058700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c400c88c0 con 0x7f5c4015f9d0 2023-07-21T22:11:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c46058700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c400cb4f0 con 0x7f5c400c9610 2023-07-21T22:11:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c46058700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4015c220 con 0x7f5c400cabe0 2023-07-21T22:11:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c3effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5c4015f9d0 0x7f5c4015fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44736/0 (socket says 172.21.15.49:44736) 2023-07-21T22:11:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c3effd700 1 -- 172.21.15.49:0/418838842 learned_addr learned my addr 172.21.15.49:0/418838842 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c3f7fe700 1 --2- 172.21.15.49:0/418838842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c400cabe0 0x7f5c400cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c3f7fe700 1 -- 172.21.15.49:0/418838842 >> v1:172.21.15.150:6789/0 conn(0x7f5c400c9610 legacy=0x7f5c400c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c3e7fc700 1 -- 172.21.15.49:0/418838842 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657303752 0 0) 0x7f5c400c88c0 con 0x7f5c4015f9d0 2023-07-21T22:11:09.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c3f7fe700 1 -- 172.21.15.49:0/418838842 >> v1:172.21.15.49:6789/0 conn(0x7f5c4015f9d0 legacy=0x7f5c4015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c3f7fe700 1 -- 172.21.15.49:0/418838842 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c400c8b30 con 0x7f5c400cabe0 2023-07-21T22:11:09.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c3f7fe700 1 --2- 172.21.15.49:0/418838842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c400cabe0 0x7f5c400cafb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009880 tx=0x7f5c30009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16fa245ca4ea731b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:09.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c3e7fc700 1 -- 172.21.15.49:0/418838842 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30011830 con 0x7f5c400cabe0 2023-07-21T22:11:09.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c3e7fc700 1 -- 172.21.15.49:0/418838842 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c30011990 con 0x7f5c400cabe0 2023-07-21T22:11:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.877+0000 7f5c3e7fc700 1 -- 172.21.15.49:0/418838842 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30011d20 con 0x7f5c400cabe0 2023-07-21T22:11:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.881+0000 7f5c46058700 1 -- 172.21.15.49:0/418838842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c400cabe0 msgr2=0x7f5c400cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.881+0000 7f5c46058700 1 --2- 172.21.15.49:0/418838842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c400cabe0 0x7f5c400cafb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009880 tx=0x7f5c30009b90 comp rx=0 tx=0).stop 2023-07-21T22:11:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.881+0000 7f5c46058700 1 -- 172.21.15.49:0/418838842 shutdown_connections 2023-07-21T22:11:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.881+0000 7f5c46058700 1 --2- 172.21.15.49:0/418838842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c400cabe0 0x7f5c400cafb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.881+0000 7f5c46058700 1 -- 172.21.15.49:0/418838842 >> 172.21.15.49:0/418838842 conn(0x7f5c4006e960 msgr2=0x7f5c4006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:09.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.881+0000 7f5c46058700 1 -- 172.21.15.49:0/418838842 shutdown_connections 2023-07-21T22:11:09.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.881+0000 7f5c46058700 1 -- 172.21.15.49:0/418838842 wait complete. 2023-07-21T22:11:09.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.881+0000 7f5c46058700 1 Processor -- start 2023-07-21T22:11:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c46058700 1 -- start start 2023-07-21T22:11:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c46058700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c400c9610 0x7f5c401f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c46058700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c400cabe0 0x7f5c40149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c46058700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4015f9d0 0x7f5c400adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c46058700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400af230 con 0x7f5c400cabe0 2023-07-21T22:11:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c46058700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400ae620 con 0x7f5c400c9610 2023-07-21T22:11:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c46058700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400ae900 con 0x7f5c4015f9d0 2023-07-21T22:11:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c3effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c400cabe0 0x7f5c40149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c3effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c400cabe0 0x7f5c40149480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48476/0 (socket says 172.21.15.49:48476) 2023-07-21T22:11:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c3effd700 1 -- 172.21.15.49:0/3009911576 learned_addr learned my addr 172.21.15.49:0/3009911576 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c3f7fe700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c400c9610 0x7f5c401f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c3ffff700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4015f9d0 0x7f5c400adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c3effd700 1 -- 172.21.15.49:0/3009911576 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4015f9d0 msgr2=0x7f5c400adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c3effd700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4015f9d0 0x7f5c400adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c3effd700 1 -- 172.21.15.49:0/3009911576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c400c9610 msgr2=0x7f5c401f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c3effd700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c400c9610 0x7f5c401f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c3effd700 1 -- 172.21.15.49:0/3009911576 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c300094b0 con 0x7f5c400cabe0 2023-07-21T22:11:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c3f7fe700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c400c9610 0x7f5c401f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:09.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c3ffff700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4015f9d0 0x7f5c400adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:09.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c3effd700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c400cabe0 0x7f5c40149480 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c750 tx=0x7f5c3400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:09.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c27fff700 1 -- 172.21.15.49:0/3009911576 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c340074e0 con 0x7f5c400cabe0 2023-07-21T22:11:09.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c27fff700 1 -- 172.21.15.49:0/3009911576 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c34007640 con 0x7f5c400cabe0 2023-07-21T22:11:09.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c27fff700 1 -- 172.21.15.49:0/3009911576 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34005a90 con 0x7f5c400cabe0 2023-07-21T22:11:09.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c46058700 1 -- 172.21.15.49:0/3009911576 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c400aebe0 con 0x7f5c400cabe0 2023-07-21T22:11:09.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.885+0000 7f5c46058700 1 -- 172.21.15.49:0/3009911576 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c401f1d50 con 0x7f5c400cabe0 2023-07-21T22:11:09.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.889+0000 7f5c46058700 1 -- 172.21.15.49:0/3009911576 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40066230 con 0x7f5c400cabe0 2023-07-21T22:11:09.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.889+0000 7f5c27fff700 1 -- 172.21.15.49:0/3009911576 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5c34005bf0 con 0x7f5c400cabe0 2023-07-21T22:11:09.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.893+0000 7f5c27fff700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5c2c0662f0 0x7f5c2c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:09.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.893+0000 7f5c27fff700 1 -- 172.21.15.49:0/3009911576 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5c340836a0 con 0x7f5c400cabe0 2023-07-21T22:11:09.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.893+0000 7f5c3f7fe700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5c2c0662f0 0x7f5c2c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:09.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.893+0000 7f5c3f7fe700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5c2c0662f0 0x7f5c2c0687a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5c30014040 tx=0x7f5c30008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:09.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:09.897+0000 7f5c27fff700 1 -- 172.21.15.49:0/3009911576 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5c34050700 con 0x7f5c400cabe0 2023-07-21T22:11:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.069+0000 7f5c46058700 1 -- 172.21.15.49:0/3009911576 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c4004dd50 con 0x7f5c400cabe0 2023-07-21T22:11:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.069+0000 7f5c27fff700 1 -- 172.21.15.49:0/3009911576 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c340170a0 con 0x7f5c400cabe0 2023-07-21T22:11:10.114 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:11:10.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.073+0000 7f5c46058700 1 -- 172.21.15.49:0/3009911576 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5c2c0662f0 msgr2=0x7f5c2c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.073+0000 7f5c46058700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5c2c0662f0 0x7f5c2c0687a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5c30014040 tx=0x7f5c30008030 comp rx=0 tx=0).stop 2023-07-21T22:11:10.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.073+0000 7f5c46058700 1 -- 172.21.15.49:0/3009911576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c400cabe0 msgr2=0x7f5c40149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.073+0000 7f5c46058700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c400cabe0 0x7f5c40149480 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c750 tx=0x7f5c3400cb10 comp rx=0 tx=0).stop 2023-07-21T22:11:10.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.073+0000 7f5c46058700 1 -- 172.21.15.49:0/3009911576 shutdown_connections 2023-07-21T22:11:10.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.073+0000 7f5c46058700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5c2c0662f0 0x7f5c2c0687a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.073+0000 7f5c46058700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c400cabe0 0x7f5c40149480 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.073+0000 7f5c46058700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4015f9d0 0x7f5c400adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.073+0000 7f5c46058700 1 --2- 172.21.15.49:0/3009911576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c400c9610 0x7f5c401f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.073+0000 7f5c46058700 1 -- 172.21.15.49:0/3009911576 >> 172.21.15.49:0/3009911576 conn(0x7f5c4006e960 msgr2=0x7f5c4015fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:10.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.073+0000 7f5c46058700 1 -- 172.21.15.49:0/3009911576 shutdown_connections 2023-07-21T22:11:10.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.073+0000 7f5c46058700 1 -- 172.21.15.49:0/3009911576 wait complete. 2023-07-21T22:11:10.139 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:11:10.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.285+0000 7fd7a1cf5700 1 Processor -- start 2023-07-21T22:11:10.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.285+0000 7fd7a1cf5700 1 -- start start 2023-07-21T22:11:10.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd7a1cf5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd79c164a00 0x7fd79c166de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:10.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd7a1cf5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79c0cca20 con 0x7fd79c06fa70 2023-07-21T22:11:10.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd7a1cf5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79c0cb720 con 0x7fd79c0cabe0 2023-07-21T22:11:10.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd7a1cf5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c0cb980 con 0x7fd79c164a00 2023-07-21T22:11:10.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd79b7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd79c06fa70 0x7fd79c06fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44744/0 (socket says 172.21.15.49:44744) 2023-07-21T22:11:10.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd79b7fe700 1 -- 172.21.15.49:0/3345546152 learned_addr learned my addr 172.21.15.49:0/3345546152 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:10.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd79bfff700 1 --2- 172.21.15.49:0/3345546152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd79c164a00 0x7fd79c166de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:10.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd79affd700 1 -- 172.21.15.49:0/3345546152 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849267447 0 0) 0x7fd79c0cca20 con 0x7fd79c06fa70 2023-07-21T22:11:10.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd79affd700 1 -- 172.21.15.49:0/3345546152 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7880035d0 con 0x7fd79c06fa70 2023-07-21T22:11:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd79affd700 1 -- 172.21.15.49:0/3345546152 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368200936 0 0) 0x7fd79c0cb720 con 0x7fd79c0cabe0 2023-07-21T22:11:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd79affd700 1 -- 172.21.15.49:0/3345546152 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd79c0cca20 con 0x7fd79c0cabe0 2023-07-21T22:11:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd79bfff700 1 -- 172.21.15.49:0/3345546152 >> v1:172.21.15.150:6789/0 conn(0x7fd79c0cabe0 legacy=0x7fd79c0cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd79bfff700 1 -- 172.21.15.49:0/3345546152 >> v1:172.21.15.49:6789/0 conn(0x7fd79c06fa70 legacy=0x7fd79c06fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd79affd700 1 -- 172.21.15.49:0/3345546152 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1308566763 0 0) 0x7fd7880035d0 con 0x7fd79c06fa70 2023-07-21T22:11:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.289+0000 7fd79bfff700 1 -- 172.21.15.49:0/3345546152 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c0cbc60 con 0x7fd79c164a00 2023-07-21T22:11:10.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.293+0000 7fd79bfff700 1 --2- 172.21.15.49:0/3345546152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd79c164a00 0x7fd79c166de0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd794009dc0 tx=0x7fd79400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d15ca870ef24e58 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:10.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.293+0000 7fd79affd700 1 -- 172.21.15.49:0/3345546152 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79400e070 con 0x7fd79c164a00 2023-07-21T22:11:10.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.293+0000 7fd79affd700 1 -- 172.21.15.49:0/3345546152 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd794003a40 con 0x7fd79c164a00 2023-07-21T22:11:10.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.293+0000 7fd79affd700 1 -- 172.21.15.49:0/3345546152 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c001670 con 0x7fd79c164a00 2023-07-21T22:11:10.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.293+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3345546152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd79c164a00 msgr2=0x7fd79c166de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.293+0000 7fd7a1cf5700 1 --2- 172.21.15.49:0/3345546152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd79c164a00 0x7fd79c166de0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd794009dc0 tx=0x7fd79400b330 comp rx=0 tx=0).stop 2023-07-21T22:11:10.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.293+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3345546152 shutdown_connections 2023-07-21T22:11:10.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.293+0000 7fd7a1cf5700 1 --2- 172.21.15.49:0/3345546152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd79c164a00 0x7fd79c166de0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.293+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3345546152 >> 172.21.15.49:0/3345546152 conn(0x7fd79c06f280 msgr2=0x7fd79c0997a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:10.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.293+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3345546152 shutdown_connections 2023-07-21T22:11:10.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.293+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3345546152 wait complete. 2023-07-21T22:11:10.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd7a1cf5700 1 Processor -- start 2023-07-21T22:11:10.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd7a1cf5700 1 -- start start 2023-07-21T22:11:10.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd7a1cf5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd79c06fa70 0x7fd79c1f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:10.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd7a1cf5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd79c0cabe0 0x7fd79c0b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:10.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd7a1cf5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd79c164a00 0x7fd79c0b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:10.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd7a1cf5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c154280 con 0x7fd79c0cabe0 2023-07-21T22:11:10.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd7a1cf5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c158240 con 0x7fd79c06fa70 2023-07-21T22:11:10.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd7a1cf5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c0c9560 con 0x7fd79c164a00 2023-07-21T22:11:10.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd793fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd79c0cabe0 0x7fd79c0b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:10.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd793fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd79c0cabe0 0x7fd79c0b51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48484/0 (socket says 172.21.15.49:48484) 2023-07-21T22:11:10.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd793fff700 1 -- 172.21.15.49:0/3841107508 learned_addr learned my addr 172.21.15.49:0/3841107508 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:10.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd79b7fe700 1 --2- 172.21.15.49:0/3841107508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd79c06fa70 0x7fd79c1f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:10.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd79bfff700 1 --2- 172.21.15.49:0/3841107508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd79c164a00 0x7fd79c0b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:10.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd793fff700 1 -- 172.21.15.49:0/3841107508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd79c164a00 msgr2=0x7fd79c0b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd793fff700 1 --2- 172.21.15.49:0/3841107508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd79c164a00 0x7fd79c0b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd793fff700 1 -- 172.21.15.49:0/3841107508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd79c06fa70 msgr2=0x7fd79c1f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd793fff700 1 --2- 172.21.15.49:0/3841107508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd79c06fa70 0x7fd79c1f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd793fff700 1 -- 172.21.15.49:0/3841107508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd794009a70 con 0x7fd79c0cabe0 2023-07-21T22:11:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd793fff700 1 --2- 172.21.15.49:0/3841107508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd79c0cabe0 0x7fd79c0b51e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c730 tx=0x7fd78400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.297+0000 7fd798ff9700 1 -- 172.21.15.49:0/3841107508 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7840052d0 con 0x7fd79c0cabe0 2023-07-21T22:11:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.301+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3841107508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79c0c9840 con 0x7fd79c0cabe0 2023-07-21T22:11:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.301+0000 7fd798ff9700 1 -- 172.21.15.49:0/3841107508 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd784005450 con 0x7fd79c0cabe0 2023-07-21T22:11:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.301+0000 7fd798ff9700 1 -- 172.21.15.49:0/3841107508 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7840038e0 con 0x7fd79c0cabe0 2023-07-21T22:11:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.301+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3841107508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79c0c9e00 con 0x7fd79c0cabe0 2023-07-21T22:11:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.301+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3841107508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79c158010 con 0x7fd79c0cabe0 2023-07-21T22:11:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.301+0000 7fd798ff9700 1 -- 172.21.15.49:0/3841107508 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd784003a40 con 0x7fd79c0cabe0 2023-07-21T22:11:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.305+0000 7fd798ff9700 1 --2- 172.21.15.49:0/3841107508 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd77c0662f0 0x7fd77c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.305+0000 7fd798ff9700 1 -- 172.21.15.49:0/3841107508 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd7840834c0 con 0x7fd79c0cabe0 2023-07-21T22:11:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.305+0000 7fd79b7fe700 1 --2- 172.21.15.49:0/3841107508 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd77c0662f0 0x7fd77c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.305+0000 7fd79b7fe700 1 --2- 172.21.15.49:0/3841107508 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd77c0662f0 0x7fd77c0687a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd78c001380 tx=0x7fd78c001770 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:10.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.309+0000 7fd798ff9700 1 -- 172.21.15.49:0/3841107508 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd79c158010 con 0x7fd79c0cabe0 2023-07-21T22:11:10.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.485+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3841107508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd79c158010 con 0x7fd79c0cabe0 2023-07-21T22:11:10.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.489+0000 7fd798ff9700 1 -- 172.21.15.49:0/3841107508 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd79c158010 con 0x7fd79c0cabe0 2023-07-21T22:11:10.531 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:11:10.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.493+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3841107508 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd77c0662f0 msgr2=0x7fd77c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.493+0000 7fd7a1cf5700 1 --2- 172.21.15.49:0/3841107508 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd77c0662f0 0x7fd77c0687a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd78c001380 tx=0x7fd78c001770 comp rx=0 tx=0).stop 2023-07-21T22:11:10.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.493+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3841107508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd79c0cabe0 msgr2=0x7fd79c0b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.493+0000 7fd7a1cf5700 1 --2- 172.21.15.49:0/3841107508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd79c0cabe0 0x7fd79c0b51e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c730 tx=0x7fd78400ca40 comp rx=0 tx=0).stop 2023-07-21T22:11:10.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.493+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3841107508 shutdown_connections 2023-07-21T22:11:10.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.493+0000 7fd7a1cf5700 1 --2- 172.21.15.49:0/3841107508 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd77c0662f0 0x7fd77c0687a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.493+0000 7fd7a1cf5700 1 --2- 172.21.15.49:0/3841107508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd79c0cabe0 0x7fd79c0b51e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.493+0000 7fd7a1cf5700 1 --2- 172.21.15.49:0/3841107508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd79c164a00 0x7fd79c0b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.493+0000 7fd7a1cf5700 1 --2- 172.21.15.49:0/3841107508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd79c06fa70 0x7fd79c1f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.493+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3841107508 >> 172.21.15.49:0/3841107508 conn(0x7fd79c06f280 msgr2=0x7fd79c0c3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:10.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.493+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3841107508 shutdown_connections 2023-07-21T22:11:10.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.493+0000 7fd7a1cf5700 1 -- 172.21.15.49:0/3841107508 wait complete. 2023-07-21T22:11:10.559 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:11:10.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.697+0000 7ff164da0700 1 Processor -- start 2023-07-21T22:11:10.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.697+0000 7ff164da0700 1 -- start start 2023-07-21T22:11:10.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff164da0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff160160110 0x7ff1600cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:10.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff164da0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff1600cb2f0 0x7ff160163d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:10.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff164da0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1600cdf00 con 0x7ff160071220 2023-07-21T22:11:10.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff164da0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1600cd730 con 0x7ff1600cb2f0 2023-07-21T22:11:10.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff164da0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1600ce600 con 0x7ff160160110 2023-07-21T22:11:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff155d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff160071220 0x7ff1600cabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44754/0 (socket says 172.21.15.49:44754) 2023-07-21T22:11:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff155d9b700 1 -- 172.21.15.49:0/3817569829 learned_addr learned my addr 172.21.15.49:0/3817569829 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff15ed9d700 1 --2- 172.21.15.49:0/3817569829 >> v2:172.21.15.49:3300/0 conn(0x7ff1600cb2f0 0x7ff160163d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:10.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff15e59c700 1 --2- 172.21.15.49:0/3817569829 >> v2:172.21.15.150:3300/0 conn(0x7ff160160110 0x7ff1600cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:10.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff15dd9b700 1 -- 172.21.15.49:0/3817569829 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454478797 0 0) 0x7ff1600cdf00 con 0x7ff160071220 2023-07-21T22:11:10.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff15dd9b700 1 -- 172.21.15.49:0/3817569829 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff14c0035d0 con 0x7ff160071220 2023-07-21T22:11:10.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff15e59c700 1 -- 172.21.15.49:0/3817569829 >> v2:172.21.15.49:3300/0 conn(0x7ff1600cb2f0 msgr2=0x7ff160163d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff15e59c700 1 --2- 172.21.15.49:0/3817569829 >> v2:172.21.15.49:3300/0 conn(0x7ff1600cb2f0 0x7ff160163d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff15e59c700 1 -- 172.21.15.49:0/3817569829 >> v1:172.21.15.49:6789/0 conn(0x7ff160071220 legacy=0x7ff1600cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff15e59c700 1 -- 172.21.15.49:0/3817569829 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1600cefd0 con 0x7ff160160110 2023-07-21T22:11:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.701+0000 7ff15ed9d700 1 --2- 172.21.15.49:0/3817569829 >> v2:172.21.15.49:3300/0 conn(0x7ff1600cb2f0 0x7ff160163d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:10.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.705+0000 7ff15e59c700 1 --2- 172.21.15.49:0/3817569829 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff160160110 0x7ff1600cea90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff1600cabb0 tx=0x7ff150009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=269d3c381f44bb18 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:10.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.705+0000 7ff15dd9b700 1 -- 172.21.15.49:0/3817569829 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150011830 con 0x7ff160160110 2023-07-21T22:11:10.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.705+0000 7ff15dd9b700 1 -- 172.21.15.49:0/3817569829 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff150011990 con 0x7ff160160110 2023-07-21T22:11:10.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.705+0000 7ff15dd9b700 1 -- 172.21.15.49:0/3817569829 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150011d20 con 0x7ff160160110 2023-07-21T22:11:10.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.705+0000 7ff164da0700 1 -- 172.21.15.49:0/3817569829 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff160160110 msgr2=0x7ff1600cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.705+0000 7ff164da0700 1 --2- 172.21.15.49:0/3817569829 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff160160110 0x7ff1600cea90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff1600cabb0 tx=0x7ff150009b30 comp rx=0 tx=0).stop 2023-07-21T22:11:10.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.705+0000 7ff164da0700 1 -- 172.21.15.49:0/3817569829 shutdown_connections 2023-07-21T22:11:10.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.705+0000 7ff164da0700 1 --2- 172.21.15.49:0/3817569829 >> v2:172.21.15.49:3300/0 conn(0x7ff1600cb2f0 0x7ff160163d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.705+0000 7ff164da0700 1 --2- 172.21.15.49:0/3817569829 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff160160110 0x7ff1600cea90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.705+0000 7ff164da0700 1 -- 172.21.15.49:0/3817569829 >> 172.21.15.49:0/3817569829 conn(0x7ff16006e960 msgr2=0x7ff16006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:10.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.705+0000 7ff164da0700 1 -- 172.21.15.49:0/3817569829 shutdown_connections 2023-07-21T22:11:10.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.705+0000 7ff164da0700 1 -- 172.21.15.49:0/3817569829 wait complete. 2023-07-21T22:11:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.709+0000 7ff164da0700 1 Processor -- start 2023-07-21T22:11:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.709+0000 7ff164da0700 1 -- start start 2023-07-21T22:11:10.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff164da0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff160071220 0x7ff16015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:10.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff164da0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1600cb2f0 0x7ff1600c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:10.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff164da0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff160160110 0x7ff1600b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:10.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff164da0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600c7750 con 0x7ff160160110 2023-07-21T22:11:10.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff164da0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1601604e0 con 0x7ff160071220 2023-07-21T22:11:10.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff164da0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1601607c0 con 0x7ff1600cb2f0 2023-07-21T22:11:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff15ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff160160110 0x7ff1600b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff15ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff160160110 0x7ff1600b13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48490/0 (socket says 172.21.15.49:48490) 2023-07-21T22:11:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff15ed9d700 1 -- 172.21.15.49:0/1333934412 learned_addr learned my addr 172.21.15.49:0/1333934412 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff15e59c700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff160071220 0x7ff16015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff155d9b700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1600cb2f0 0x7ff1600c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff15ed9d700 1 -- 172.21.15.49:0/1333934412 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1600cb2f0 msgr2=0x7ff1600c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff15ed9d700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1600cb2f0 0x7ff1600c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff15ed9d700 1 -- 172.21.15.49:0/1333934412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff160071220 msgr2=0x7ff16015aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff15ed9d700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff160071220 0x7ff16015aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff15ed9d700 1 -- 172.21.15.49:0/1333934412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff158009a70 con 0x7ff160160110 2023-07-21T22:11:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff15e59c700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff160071220 0x7ff16015aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff15ed9d700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff160160110 0x7ff1600b13e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff15800efb0 tx=0x7ff15800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff1577fe700 1 -- 172.21.15.49:0/1333934412 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158009cb0 con 0x7ff160160110 2023-07-21T22:11:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff1577fe700 1 -- 172.21.15.49:0/1333934412 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15800f040 con 0x7ff160160110 2023-07-21T22:11:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff1577fe700 1 -- 172.21.15.49:0/1333934412 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158014480 con 0x7ff160160110 2023-07-21T22:11:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff164da0700 1 -- 172.21.15.49:0/1333934412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1500094b0 con 0x7ff160160110 2023-07-21T22:11:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.713+0000 7ff164da0700 1 -- 172.21.15.49:0/1333934412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff160160d80 con 0x7ff160160110 2023-07-21T22:11:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.717+0000 7ff164da0700 1 -- 172.21.15.49:0/1333934412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16004dd50 con 0x7ff160160110 2023-07-21T22:11:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.717+0000 7ff1577fe700 1 -- 172.21.15.49:0/1333934412 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1580145e0 con 0x7ff160160110 2023-07-21T22:11:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.717+0000 7ff1577fe700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff1400662f0 0x7ff1400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.721+0000 7ff1577fe700 1 -- 172.21.15.49:0/1333934412 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff158084cb0 con 0x7ff160160110 2023-07-21T22:11:10.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.721+0000 7ff15e59c700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff1400662f0 0x7ff1400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:10.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.721+0000 7ff15e59c700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff1400662f0 0x7ff1400687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff150000c00 tx=0x7ff150008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:10.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.725+0000 7ff1577fe700 1 -- 172.21.15.49:0/1333934412 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff158051e30 con 0x7ff160160110 2023-07-21T22:11:10.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.901+0000 7ff164da0700 1 -- 172.21.15.49:0/1333934412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff160071000 con 0x7ff160160110 2023-07-21T22:11:10.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.901+0000 7ff1577fe700 1 -- 172.21.15.49:0/1333934412 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff158018020 con 0x7ff160160110 2023-07-21T22:11:10.944 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:10.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.905+0000 7ff164da0700 1 -- 172.21.15.49:0/1333934412 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff1400662f0 msgr2=0x7ff1400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.905+0000 7ff164da0700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff1400662f0 0x7ff1400687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff150000c00 tx=0x7ff150008030 comp rx=0 tx=0).stop 2023-07-21T22:11:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.905+0000 7ff164da0700 1 -- 172.21.15.49:0/1333934412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff160160110 msgr2=0x7ff1600b13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.905+0000 7ff164da0700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff160160110 0x7ff1600b13e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff15800efb0 tx=0x7ff15800c3a0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.905+0000 7ff164da0700 1 -- 172.21.15.49:0/1333934412 shutdown_connections 2023-07-21T22:11:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.905+0000 7ff164da0700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff1400662f0 0x7ff1400687a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.905+0000 7ff164da0700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff160160110 0x7ff1600b13e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.905+0000 7ff164da0700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1600cb2f0 0x7ff1600c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.905+0000 7ff164da0700 1 --2- 172.21.15.49:0/1333934412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff160071220 0x7ff16015aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.905+0000 7ff164da0700 1 -- 172.21.15.49:0/1333934412 >> 172.21.15.49:0/1333934412 conn(0x7ff16006e960 msgr2=0x7ff16006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.905+0000 7ff164da0700 1 -- 172.21.15.49:0/1333934412 shutdown_connections 2023-07-21T22:11:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:10.905+0000 7ff164da0700 1 -- 172.21.15.49:0/1333934412 wait complete. 2023-07-21T22:11:10.969 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:11:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.109+0000 7fc76d6aa700 1 Processor -- start 2023-07-21T22:11:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.109+0000 7fc76d6aa700 1 -- start start 2023-07-21T22:11:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc76d6aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7680d1e40 0x7fc7680b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc76d6aa700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7680cee10 0x7fc7680cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc76d6aa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7680b3e80 con 0x7fc7680b7af0 2023-07-21T22:11:11.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc76d6aa700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7680cf7d0 con 0x7fc7680cee10 2023-07-21T22:11:11.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc76d6aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76815fd40 con 0x7fc7680d1e40 2023-07-21T22:11:11.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc7677fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7680cee10 0x7fc7680cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc75e7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7680d1e40 0x7fc7680b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc7677fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7680cee10 0x7fc7680cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48498/0 (socket says 172.21.15.49:48498) 2023-07-21T22:11:11.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc7677fe700 1 -- 172.21.15.49:0/3125170602 learned_addr learned my addr 172.21.15.49:0/3125170602 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc75e7fc700 1 -- 172.21.15.49:0/3125170602 >> v2:172.21.15.49:3300/0 conn(0x7fc7680cee10 msgr2=0x7fc7680cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc75e7fc700 1 --2- 172.21.15.49:0/3125170602 >> v2:172.21.15.49:3300/0 conn(0x7fc7680cee10 0x7fc7680cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc75e7fc700 1 -- 172.21.15.49:0/3125170602 >> v1:172.21.15.150:6789/0 conn(0x7fc7680b7af0 legacy=0x7fc76815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc75e7fc700 1 -- 172.21.15.49:0/3125170602 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7680cea00 con 0x7fc7680d1e40 2023-07-21T22:11:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc7677fe700 1 --2- 172.21.15.49:0/3125170602 >> v2:172.21.15.49:3300/0 conn(0x7fc7680cee10 0x7fc7680cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc75e7fc700 1 --2- 172.21.15.49:0/3125170602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7680d1e40 0x7fc7680b1630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc750009850 tx=0x7fc750009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e1e361baa6e65d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc7667fc700 1 -- 172.21.15.49:0/3125170602 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750011830 con 0x7fc7680d1e40 2023-07-21T22:11:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc7667fc700 1 -- 172.21.15.49:0/3125170602 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc750011990 con 0x7fc7680d1e40 2023-07-21T22:11:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.113+0000 7fc7667fc700 1 -- 172.21.15.49:0/3125170602 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750011d40 con 0x7fc7680d1e40 2023-07-21T22:11:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.117+0000 7fc76d6aa700 1 -- 172.21.15.49:0/3125170602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7680d1e40 msgr2=0x7fc7680b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.117+0000 7fc76d6aa700 1 --2- 172.21.15.49:0/3125170602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7680d1e40 0x7fc7680b1630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc750009850 tx=0x7fc750009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.117+0000 7fc76d6aa700 1 -- 172.21.15.49:0/3125170602 shutdown_connections 2023-07-21T22:11:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.117+0000 7fc76d6aa700 1 --2- 172.21.15.49:0/3125170602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7680d1e40 0x7fc7680b1630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.117+0000 7fc76d6aa700 1 --2- 172.21.15.49:0/3125170602 >> v2:172.21.15.49:3300/0 conn(0x7fc7680cee10 0x7fc7680cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.117+0000 7fc76d6aa700 1 -- 172.21.15.49:0/3125170602 >> 172.21.15.49:0/3125170602 conn(0x7fc76806e960 msgr2=0x7fc76806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.117+0000 7fc76d6aa700 1 -- 172.21.15.49:0/3125170602 shutdown_connections 2023-07-21T22:11:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.117+0000 7fc76d6aa700 1 -- 172.21.15.49:0/3125170602 wait complete. 2023-07-21T22:11:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.117+0000 7fc76d6aa700 1 Processor -- start 2023-07-21T22:11:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.117+0000 7fc76d6aa700 1 -- start start 2023-07-21T22:11:11.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc76d6aa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7680b7af0 0x7fc76815a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc76d6aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7680cee10 0x7fc7680c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc76d6aa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7680d1e40 0x7fc76815c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc76d6aa700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76815c670 con 0x7fc7680b7af0 2023-07-21T22:11:11.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc76d6aa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76815c8d0 con 0x7fc7680d1e40 2023-07-21T22:11:11.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc76d6aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76815cbb0 con 0x7fc7680cee10 2023-07-21T22:11:11.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc766ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7680b7af0 0x7fc76815a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc766ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7680b7af0 0x7fc76815a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48506/0 (socket says 172.21.15.49:48506) 2023-07-21T22:11:11.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc766ffd700 1 -- 172.21.15.49:0/177388026 learned_addr learned my addr 172.21.15.49:0/177388026 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:11.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc75e7fc700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7680cee10 0x7fc7680c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc7677fe700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7680d1e40 0x7fc76815c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc766ffd700 1 -- 172.21.15.49:0/177388026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7680cee10 msgr2=0x7fc7680c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc766ffd700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7680cee10 0x7fc7680c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc766ffd700 1 -- 172.21.15.49:0/177388026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7680d1e40 msgr2=0x7fc76815c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc766ffd700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7680d1e40 0x7fc76815c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc766ffd700 1 -- 172.21.15.49:0/177388026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc760009b30 con 0x7fc7680b7af0 2023-07-21T22:11:11.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc75e7fc700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7680cee10 0x7fc7680c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:11.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc7677fe700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7680d1e40 0x7fc76815c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:11.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc766ffd700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7680b7af0 0x7fc76815a080 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc75800c500 tx=0x7fc75800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:11.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc75ffff700 1 -- 172.21.15.49:0/177388026 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7580052d0 con 0x7fc7680b7af0 2023-07-21T22:11:11.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc75ffff700 1 -- 172.21.15.49:0/177388026 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc758005430 con 0x7fc7680b7af0 2023-07-21T22:11:11.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc76d6aa700 1 -- 172.21.15.49:0/177388026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7500094b0 con 0x7fc7680b7af0 2023-07-21T22:11:11.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc75ffff700 1 -- 172.21.15.49:0/177388026 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7580055a0 con 0x7fc7680b7af0 2023-07-21T22:11:11.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.121+0000 7fc76d6aa700 1 -- 172.21.15.49:0/177388026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76815d170 con 0x7fc7680b7af0 2023-07-21T22:11:11.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.125+0000 7fc76d6aa700 1 -- 172.21.15.49:0/177388026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76804dcb0 con 0x7fc7680b7af0 2023-07-21T22:11:11.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.125+0000 7fc75ffff700 1 -- 172.21.15.49:0/177388026 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7580038e0 con 0x7fc7680b7af0 2023-07-21T22:11:11.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.129+0000 7fc75ffff700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc74c066320 0x7fc74c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.129+0000 7fc75ffff700 1 -- 172.21.15.49:0/177388026 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc758083510 con 0x7fc7680b7af0 2023-07-21T22:11:11.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.129+0000 7fc75e7fc700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc74c066320 0x7fc74c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.129+0000 7fc75e7fc700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc74c066320 0x7fc74c0687d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc7500090b0 tx=0x7fc750008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:11.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.133+0000 7fc75ffff700 1 -- 172.21.15.49:0/177388026 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc758050600 con 0x7fc7680b7af0 2023-07-21T22:11:11.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.313+0000 7fc76d6aa700 1 -- 172.21.15.49:0/177388026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc76815a700 con 0x7fc7680b7af0 2023-07-21T22:11:11.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.313+0000 7fc75ffff700 1 -- 172.21.15.49:0/177388026 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc758053c20 con 0x7fc7680b7af0 2023-07-21T22:11:11.358 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:11:11.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.317+0000 7fc76d6aa700 1 -- 172.21.15.49:0/177388026 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc74c066320 msgr2=0x7fc74c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.317+0000 7fc76d6aa700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc74c066320 0x7fc74c0687d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc7500090b0 tx=0x7fc750008030 comp rx=0 tx=0).stop 2023-07-21T22:11:11.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.317+0000 7fc76d6aa700 1 -- 172.21.15.49:0/177388026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7680b7af0 msgr2=0x7fc76815a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.321+0000 7fc76d6aa700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7680b7af0 0x7fc76815a080 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc75800c500 tx=0x7fc75800c8c0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.321+0000 7fc76d6aa700 1 -- 172.21.15.49:0/177388026 shutdown_connections 2023-07-21T22:11:11.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.321+0000 7fc76d6aa700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc74c066320 0x7fc74c0687d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.321+0000 7fc76d6aa700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7680d1e40 0x7fc76815c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.321+0000 7fc76d6aa700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7680cee10 0x7fc7680c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.321+0000 7fc76d6aa700 1 --2- 172.21.15.49:0/177388026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7680b7af0 0x7fc76815a080 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.321+0000 7fc76d6aa700 1 -- 172.21.15.49:0/177388026 >> 172.21.15.49:0/177388026 conn(0x7fc76806e960 msgr2=0x7fc7680b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.321+0000 7fc76d6aa700 1 -- 172.21.15.49:0/177388026 shutdown_connections 2023-07-21T22:11:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.321+0000 7fc76d6aa700 1 -- 172.21.15.49:0/177388026 wait complete. 2023-07-21T22:11:11.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:11:11.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.525+0000 7f7fb6dfe700 1 Processor -- start 2023-07-21T22:11:11.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.525+0000 7f7fb6dfe700 1 -- start start 2023-07-21T22:11:11.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.525+0000 7f7fb6dfe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7fb00b7af0 0x7f7fb00b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.525+0000 7f7fb6dfe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fb00d1e40 0x7f7fb015f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.525+0000 7f7fb6dfe700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb00b3e80 con 0x7f7fb00cee10 2023-07-21T22:11:11.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.525+0000 7f7fb6dfe700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb00cea00 con 0x7f7fb00b7af0 2023-07-21T22:11:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.525+0000 7f7fb6dfe700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00ccbf0 con 0x7f7fb00d1e40 2023-07-21T22:11:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb5dfc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7fb00b7af0 0x7f7fb00b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb5dfc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7fb00b7af0 0x7f7fb00b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48518/0 (socket says 172.21.15.49:48518) 2023-07-21T22:11:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb5dfc700 1 -- 172.21.15.49:0/2889632177 learned_addr learned my addr 172.21.15.49:0/2889632177 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb55fb700 1 --2- 172.21.15.49:0/2889632177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fb00d1e40 0x7f7fb015f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb5dfc700 1 -- 172.21.15.49:0/2889632177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fb00d1e40 msgr2=0x7f7fb015f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb5dfc700 1 --2- 172.21.15.49:0/2889632177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fb00d1e40 0x7f7fb015f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb5dfc700 1 -- 172.21.15.49:0/2889632177 >> v1:172.21.15.49:6789/0 conn(0x7f7fb00cee10 legacy=0x7f7fb00b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb5dfc700 1 -- 172.21.15.49:0/2889632177 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb00cced0 con 0x7f7fb00b7af0 2023-07-21T22:11:11.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb5dfc700 1 --2- 172.21.15.49:0/2889632177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fb00b7af0 0x7f7fb00b1630 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009910 tx=0x7f7fac009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807ca9976ed399fc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:11.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb4dfa700 1 -- 172.21.15.49:0/2889632177 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac00ba60 con 0x7f7fb00b7af0 2023-07-21T22:11:11.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb4dfa700 1 -- 172.21.15.49:0/2889632177 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac00bbc0 con 0x7f7fb00b7af0 2023-07-21T22:11:11.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb4dfa700 1 -- 172.21.15.49:0/2889632177 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac009e60 con 0x7f7fb00b7af0 2023-07-21T22:11:11.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/2889632177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fb00b7af0 msgr2=0x7f7fb00b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb6dfe700 1 --2- 172.21.15.49:0/2889632177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fb00b7af0 0x7f7fb00b1630 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009910 tx=0x7f7fac009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/2889632177 shutdown_connections 2023-07-21T22:11:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb6dfe700 1 --2- 172.21.15.49:0/2889632177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fb00d1e40 0x7f7fb015f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb6dfe700 1 --2- 172.21.15.49:0/2889632177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fb00b7af0 0x7f7fb00b1630 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.529+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/2889632177 >> 172.21.15.49:0/2889632177 conn(0x7f7fb006e960 msgr2=0x7f7fb006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.533+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/2889632177 shutdown_connections 2023-07-21T22:11:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.533+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/2889632177 wait complete. 2023-07-21T22:11:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.533+0000 7f7fb6dfe700 1 Processor -- start 2023-07-21T22:11:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.533+0000 7f7fb6dfe700 1 -- start start 2023-07-21T22:11:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb6dfe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fb00b7af0 0x7f7fb00cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb6dfe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fb00cee10 0x7f7fb00c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb6dfe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb00d1e40 0x7f7fb0153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb6dfe700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00c7220 con 0x7f7fb00b7af0 2023-07-21T22:11:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb6dfe700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb01f1360 con 0x7f7fb00d1e40 2023-07-21T22:11:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb6dfe700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00c7770 con 0x7f7fb00cee10 2023-07-21T22:11:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb5dfc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fb00b7af0 0x7f7fb00cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb5dfc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fb00b7af0 0x7f7fb00cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48524/0 (socket says 172.21.15.49:48524) 2023-07-21T22:11:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb5dfc700 1 -- 172.21.15.49:0/225054136 learned_addr learned my addr 172.21.15.49:0/225054136 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb55fb700 1 --2- 172.21.15.49:0/225054136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fb00cee10 0x7f7fb00c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb65fd700 1 --2- 172.21.15.49:0/225054136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb00d1e40 0x7f7fb0153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb5dfc700 1 -- 172.21.15.49:0/225054136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fb00cee10 msgr2=0x7f7fb00c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb5dfc700 1 --2- 172.21.15.49:0/225054136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fb00cee10 0x7f7fb00c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb5dfc700 1 -- 172.21.15.49:0/225054136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb00d1e40 msgr2=0x7f7fb0153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb5dfc700 1 --2- 172.21.15.49:0/225054136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb00d1e40 0x7f7fb0153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb5dfc700 1 -- 172.21.15.49:0/225054136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac009570 con 0x7f7fb00b7af0 2023-07-21T22:11:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb5dfc700 1 --2- 172.21.15.49:0/225054136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fb00b7af0 0x7f7fb00cf500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00b4ff0 tx=0x7f7fac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:11.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fa67fc700 1 -- 172.21.15.49:0/225054136 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac004610 con 0x7f7fb00b7af0 2023-07-21T22:11:11.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fa67fc700 1 -- 172.21.15.49:0/225054136 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac01f070 con 0x7f7fb00b7af0 2023-07-21T22:11:11.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fa67fc700 1 -- 172.21.15.49:0/225054136 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac003900 con 0x7f7fb00b7af0 2023-07-21T22:11:11.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/225054136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb00c6980 con 0x7f7fb00b7af0 2023-07-21T22:11:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.537+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/225054136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb00c6f40 con 0x7f7fb00b7af0 2023-07-21T22:11:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.541+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/225054136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb00c75d0 con 0x7f7fb00b7af0 2023-07-21T22:11:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.541+0000 7f7fa67fc700 1 -- 172.21.15.49:0/225054136 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fac003a60 con 0x7f7fb00b7af0 2023-07-21T22:11:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.541+0000 7f7fa67fc700 1 --2- 172.21.15.49:0/225054136 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7f940662f0 0x7f7f940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.541+0000 7f7fa67fc700 1 -- 172.21.15.49:0/225054136 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7fac021070 con 0x7f7fb00b7af0 2023-07-21T22:11:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.545+0000 7f7fb55fb700 1 --2- 172.21.15.49:0/225054136 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7f940662f0 0x7f7f940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.545+0000 7f7fb55fb700 1 --2- 172.21.15.49:0/225054136 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7f940662f0 0x7f7f940687a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00b7600 tx=0x7f7fa0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:11.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.549+0000 7f7fa67fc700 1 -- 172.21.15.49:0/225054136 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fb00c75d0 con 0x7f7fb00b7af0 2023-07-21T22:11:11.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.725+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/225054136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7fb00c75d0 con 0x7f7fb00b7af0 2023-07-21T22:11:11.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.725+0000 7f7fa67fc700 1 -- 172.21.15.49:0/225054136 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7fb00c75d0 con 0x7f7fb00b7af0 2023-07-21T22:11:11.768 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.725+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/225054136 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7f940662f0 msgr2=0x7f7f940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.725+0000 7f7fb6dfe700 1 --2- 172.21.15.49:0/225054136 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7f940662f0 0x7f7f940687a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00b7600 tx=0x7f7fa0008040 comp rx=0 tx=0).stop 2023-07-21T22:11:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.725+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/225054136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fb00b7af0 msgr2=0x7f7fb00cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.725+0000 7f7fb6dfe700 1 --2- 172.21.15.49:0/225054136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fb00b7af0 0x7f7fb00cf500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00b4ff0 tx=0x7f7fac004770 comp rx=0 tx=0).stop 2023-07-21T22:11:11.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.729+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/225054136 shutdown_connections 2023-07-21T22:11:11.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.729+0000 7f7fb6dfe700 1 --2- 172.21.15.49:0/225054136 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7f940662f0 0x7f7f940687a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.729+0000 7f7fb6dfe700 1 --2- 172.21.15.49:0/225054136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb00d1e40 0x7f7fb0153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.729+0000 7f7fb6dfe700 1 --2- 172.21.15.49:0/225054136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fb00cee10 0x7f7fb00c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.729+0000 7f7fb6dfe700 1 --2- 172.21.15.49:0/225054136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fb00b7af0 0x7f7fb00cf500 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.729+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/225054136 >> 172.21.15.49:0/225054136 conn(0x7f7fb006e960 msgr2=0x7f7fb00b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:11.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.729+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/225054136 shutdown_connections 2023-07-21T22:11:11.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.729+0000 7f7fb6dfe700 1 -- 172.21.15.49:0/225054136 wait complete. 2023-07-21T22:11:11.792 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:11:11.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.921+0000 7fbbcd3ae700 1 Processor -- start 2023-07-21T22:11:11.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.921+0000 7fbbcd3ae700 1 -- start start 2023-07-21T22:11:11.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbcd3ae700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbbc80cbbd0 0x7fbbc806e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbcd3ae700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc815d610 con 0x7fbbc806d630 2023-07-21T22:11:11.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbcd3ae700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc815deb0 con 0x7fbbc8070d30 2023-07-21T22:11:11.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbcd3ae700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc80cc0b0 con 0x7fbbc80cbbd0 2023-07-21T22:11:11.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc6ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbbc806d630 0x7fbbc806da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44762/0 (socket says 172.21.15.49:44762) 2023-07-21T22:11:11.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc6ffd700 1 -- 172.21.15.49:0/3499343230 learned_addr learned my addr 172.21.15.49:0/3499343230 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:11.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc7fff700 1 --2- 172.21.15.49:0/3499343230 >> v2:172.21.15.150:3300/0 conn(0x7fbbc80cbbd0 0x7fbbc806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410546799 0 0) 0x7fbbc815d610 con 0x7fbbc806d630 2023-07-21T22:11:11.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba80035d0 con 0x7fbbc806d630 2023-07-21T22:11:11.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010482097 0 0) 0x7fbbc815deb0 con 0x7fbbc8070d30 2023-07-21T22:11:11.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc815d610 con 0x7fbbc8070d30 2023-07-21T22:11:11.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2576636017 0 0) 0x7fbba80035d0 con 0x7fbbc806d630 2023-07-21T22:11:11.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 >> v2:172.21.15.150:3300/0 conn(0x7fbbc80cbbd0 msgr2=0x7fbbc806e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:11.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 --2- 172.21.15.49:0/3499343230 >> v2:172.21.15.150:3300/0 conn(0x7fbbc80cbbd0 0x7fbbc806e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 >> v1:172.21.15.150:6789/0 conn(0x7fbbc8070d30 legacy=0x7fbbc8159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc815d860 con 0x7fbbc806d630 2023-07-21T22:11:11.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7fbbb8001670 con 0x7fbbc806d630 2023-07-21T22:11:11.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 >> v1:172.21.15.49:6789/0 conn(0x7fbbc806d630 legacy=0x7fbbc806da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 --2- 172.21.15.49:0/3499343230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba8003c20 0x7fbba8003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 --2- 172.21.15.49:0/3499343230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba8004870 0x7fbba8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 --2- 172.21.15.49:0/3499343230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba8005270 0x7fbba800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80cc0b0 con 0x7fbba8004870 2023-07-21T22:11:11.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba800c180 con 0x7fbba8005270 2023-07-21T22:11:11.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba800c340 con 0x7fbba8003c20 2023-07-21T22:11:11.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.925+0000 7fbbbe7fc700 1 --2- 172.21.15.49:0/3499343230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba8004870 0x7fbba8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbc7fff700 1 --2- 172.21.15.49:0/3499343230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba8005270 0x7fbba800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbc6ffd700 1 --2- 172.21.15.49:0/3499343230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba8003c20 0x7fbba8003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbc7fff700 1 -- 172.21.15.49:0/3499343230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba8003c20 msgr2=0x7fbba8003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbc7fff700 1 --2- 172.21.15.49:0/3499343230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba8003c20 0x7fbba8003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbc7fff700 1 -- 172.21.15.49:0/3499343230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba8004870 msgr2=0x7fbba8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbc7fff700 1 --2- 172.21.15.49:0/3499343230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba8004870 0x7fbba8004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbc7fff700 1 -- 172.21.15.49:0/3499343230 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba80035d0 con 0x7fbba8005270 2023-07-21T22:11:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbc7fff700 1 -- 172.21.15.49:0/3499343230 reap_dead start 2023-07-21T22:11:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbc7fff700 1 --2- 172.21.15.49:0/3499343230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba8005270 0x7fbba800ba30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbbc806d400 tx=0x7fbba80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c8ea5b5c00a74be server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0018070 con 0x7fbba8005270 2023-07-21T22:11:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc000f040 con 0x7fbba8005270 2023-07-21T22:11:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbc67fc700 1 -- 172.21.15.49:0/3499343230 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000ebe0 con 0x7fbba8005270 2023-07-21T22:11:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/3499343230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba8005270 msgr2=0x7fbba800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbcd3ae700 1 --2- 172.21.15.49:0/3499343230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba8005270 0x7fbba800ba30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbbc806d400 tx=0x7fbba80058a0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/3499343230 shutdown_connections 2023-07-21T22:11:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbcd3ae700 1 --2- 172.21.15.49:0/3499343230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba8005270 0x7fbba800ba30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/3499343230 >> 172.21.15.49:0/3499343230 conn(0x7fbbc80cc430 msgr2=0x7fbbc80cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:11.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/3499343230 shutdown_connections 2023-07-21T22:11:11.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.929+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/3499343230 wait complete. 2023-07-21T22:11:11.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.933+0000 7fbbcd3ae700 1 Processor -- start 2023-07-21T22:11:11.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.933+0000 7fbbcd3ae700 1 -- start start 2023-07-21T22:11:11.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbcd3ae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba8005270 0x7fbbc8148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbcd3ae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc815c9b0 0x7fbbc8149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbcd3ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbc8151180 0x7fbbc8151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbcd3ae700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc8152220 con 0x7fbbc815c9b0 2023-07-21T22:11:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbcd3ae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc814d1c0 con 0x7fbba8005270 2023-07-21T22:11:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbcd3ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc814d4a0 con 0x7fbbc8151180 2023-07-21T22:11:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbbe7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc815c9b0 0x7fbbc8149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbbe7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc815c9b0 0x7fbbc8149440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48540/0 (socket says 172.21.15.49:48540) 2023-07-21T22:11:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbbe7fc700 1 -- 172.21.15.49:0/1520191652 learned_addr learned my addr 172.21.15.49:0/1520191652 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbc6ffd700 1 --2- 172.21.15.49:0/1520191652 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba8005270 0x7fbbc8148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbc7fff700 1 --2- 172.21.15.49:0/1520191652 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbc8151180 0x7fbbc8151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbbe7fc700 1 -- 172.21.15.49:0/1520191652 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbc8151180 msgr2=0x7fbbc8151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbbe7fc700 1 --2- 172.21.15.49:0/1520191652 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbc8151180 0x7fbbc8151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbbe7fc700 1 -- 172.21.15.49:0/1520191652 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba8005270 msgr2=0x7fbbc8148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbbe7fc700 1 --2- 172.21.15.49:0/1520191652 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba8005270 0x7fbbc8148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbbe7fc700 1 -- 172.21.15.49:0/1520191652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc814d780 con 0x7fbbc815c9b0 2023-07-21T22:11:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbbe7fc700 1 --2- 172.21.15.49:0/1520191652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc815c9b0 0x7fbbc8149440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000f7c0 tx=0x7fbbb000fad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbbffff700 1 -- 172.21.15.49:0/1520191652 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00052e0 con 0x7fbbc815c9b0 2023-07-21T22:11:11.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbbffff700 1 -- 172.21.15.49:0/1520191652 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb0005440 con 0x7fbbc815c9b0 2023-07-21T22:11:11.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/1520191652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc8151b60 con 0x7fbbc815c9b0 2023-07-21T22:11:11.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbbffff700 1 -- 172.21.15.49:0/1520191652 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00055b0 con 0x7fbbc815c9b0 2023-07-21T22:11:11.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.937+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/1520191652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc8151fc0 con 0x7fbbc815c9b0 2023-07-21T22:11:11.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.941+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/1520191652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc814d020 con 0x7fbbc815c9b0 2023-07-21T22:11:11.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.941+0000 7fbbbffff700 1 -- 172.21.15.49:0/1520191652 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbbb0003930 con 0x7fbbc815c9b0 2023-07-21T22:11:11.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.945+0000 7fbbbffff700 1 --2- 172.21.15.49:0/1520191652 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbbac066320 0x7fbbac0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:11.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.945+0000 7fbbbffff700 1 -- 172.21.15.49:0/1520191652 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbbb0083df0 con 0x7fbbc815c9b0 2023-07-21T22:11:11.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.945+0000 7fbbc6ffd700 1 --2- 172.21.15.49:0/1520191652 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbbac066320 0x7fbbac0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:11.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.945+0000 7fbbc6ffd700 1 --2- 172.21.15.49:0/1520191652 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbbac066320 0x7fbbac0687d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8001200 tx=0x7fbbb8001470 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:11.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:11.949+0000 7fbbbffff700 1 -- 172.21.15.49:0/1520191652 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbbc814d020 con 0x7fbbc815c9b0 2023-07-21T22:11:12.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.161+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/1520191652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbc814d9c0 con 0x7fbbc815c9b0 2023-07-21T22:11:12.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.161+0000 7fbbbffff700 1 -- 172.21.15.49:0/1520191652 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fbbc814d9c0 con 0x7fbbc815c9b0 2023-07-21T22:11:12.204 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:12.204 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/1894793298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1894793298},{"type":"v1","addr":"172.21.15.150:6833","nonce":1894793298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1984862419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1984862419},{"type":"v1","addr":"172.21.15.49:6836","nonce":1984862419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1331451608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1331451608},{"type":"v1","addr":"172.21.15.49:6837","nonce":1331451608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:10:34.629989+0000","modified":"2023-07-21T22:11:01.997441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2478678672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2478678672},{"type":"v1","addr":"172.21.15.150:6835","nonce":2478678672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:11:12.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.161+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/1520191652 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbbac066320 msgr2=0x7fbbac0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:12.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.161+0000 7fbbcd3ae700 1 --2- 172.21.15.49:0/1520191652 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbbac066320 0x7fbbac0687d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8001200 tx=0x7fbbb8001470 comp rx=0 tx=0).stop 2023-07-21T22:11:12.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.161+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/1520191652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc815c9b0 msgr2=0x7fbbc8149440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:12.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.161+0000 7fbbcd3ae700 1 --2- 172.21.15.49:0/1520191652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc815c9b0 0x7fbbc8149440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000f7c0 tx=0x7fbbb000fad0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.165+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/1520191652 shutdown_connections 2023-07-21T22:11:12.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.165+0000 7fbbcd3ae700 1 --2- 172.21.15.49:0/1520191652 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbbac066320 0x7fbbac0687d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.165+0000 7fbbcd3ae700 1 --2- 172.21.15.49:0/1520191652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc815c9b0 0x7fbbc8149440 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.165+0000 7fbbcd3ae700 1 --2- 172.21.15.49:0/1520191652 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbc8151180 0x7fbbc8151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.165+0000 7fbbcd3ae700 1 --2- 172.21.15.49:0/1520191652 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba8005270 0x7fbbc8148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.165+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/1520191652 >> 172.21.15.49:0/1520191652 conn(0x7fbbc80cc430 msgr2=0x7fbbc80cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:12.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.165+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/1520191652 shutdown_connections 2023-07-21T22:11:12.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.165+0000 7fbbcd3ae700 1 -- 172.21.15.49:0/1520191652 wait complete. 2023-07-21T22:11:12.209 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2023-07-21T22:11:12.228 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:12.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.365+0000 7fd9d359e700 1 Processor -- start 2023-07-21T22:11:12.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.365+0000 7fd9d359e700 1 -- start start 2023-07-21T22:11:12.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.365+0000 7fd9d359e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9d406d380 0x7fd9d406d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.365+0000 7fd9d359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9d4071c70 0x7fd9d40b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d40cab20 con 0x7fd9d40b1400 2023-07-21T22:11:12.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d359e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d40c9e80 con 0x7fd9d406d380 2023-07-21T22:11:12.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40afeb0 con 0x7fd9d4071c70 2023-07-21T22:11:12.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9d406d380 0x7fd9d406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9d406d380 0x7fd9d406d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48546/0 (socket says 172.21.15.49:48546) 2023-07-21T22:11:12.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d259c700 1 -- 172.21.15.49:0/3076669493 learned_addr learned my addr 172.21.15.49:0/3076669493 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:12.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9c9d9b700 1 --2- 172.21.15.49:0/3076669493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9d4071c70 0x7fd9d40b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d259c700 1 -- 172.21.15.49:0/3076669493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9d4071c70 msgr2=0x7fd9d40b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:12.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d259c700 1 --2- 172.21.15.49:0/3076669493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9d4071c70 0x7fd9d40b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d259c700 1 -- 172.21.15.49:0/3076669493 >> v1:172.21.15.150:6789/0 conn(0x7fd9d40b1400 legacy=0x7fd9d40cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:12.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d259c700 1 -- 172.21.15.49:0/3076669493 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d406dc90 con 0x7fd9d406d380 2023-07-21T22:11:12.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d259c700 1 --2- 172.21.15.49:0/3076669493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d406d380 0x7fd9d406d750 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009e50 tx=0x7fd9c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ac5bcfa0cf0792 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:12.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d1d9b700 1 -- 172.21.15.49:0/3076669493 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c400e070 con 0x7fd9d406d380 2023-07-21T22:11:12.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d1d9b700 1 -- 172.21.15.49:0/3076669493 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c400b910 con 0x7fd9d406d380 2023-07-21T22:11:12.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d1d9b700 1 -- 172.21.15.49:0/3076669493 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c400bcc0 con 0x7fd9d406d380 2023-07-21T22:11:12.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d359e700 1 -- 172.21.15.49:0/3076669493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d406d380 msgr2=0x7fd9d406d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:12.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d359e700 1 --2- 172.21.15.49:0/3076669493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d406d380 0x7fd9d406d750 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009e50 tx=0x7fd9c400b330 comp rx=0 tx=0).stop 2023-07-21T22:11:12.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d359e700 1 -- 172.21.15.49:0/3076669493 shutdown_connections 2023-07-21T22:11:12.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d359e700 1 --2- 172.21.15.49:0/3076669493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9d4071c70 0x7fd9d40b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d359e700 1 --2- 172.21.15.49:0/3076669493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d406d380 0x7fd9d406d750 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d359e700 1 -- 172.21.15.49:0/3076669493 >> 172.21.15.49:0/3076669493 conn(0x7fd9d4070450 msgr2=0x7fd9d4070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:12.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d359e700 1 -- 172.21.15.49:0/3076669493 shutdown_connections 2023-07-21T22:11:12.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.369+0000 7fd9d359e700 1 -- 172.21.15.49:0/3076669493 wait complete. 2023-07-21T22:11:12.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.373+0000 7fd9d359e700 1 Processor -- start 2023-07-21T22:11:12.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.373+0000 7fd9d359e700 1 -- start start 2023-07-21T22:11:12.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d406d380 0x7fd9d41f1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9d4071c70 0x7fd9d4143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9d40b1400 0x7fd9d40b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d4141840 con 0x7fd9d406d380 2023-07-21T22:11:12.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d415cfa0 con 0x7fd9d40b1400 2023-07-21T22:11:12.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d41f16d0 con 0x7fd9d4071c70 2023-07-21T22:11:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d406d380 0x7fd9d41f1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d406d380 0x7fd9d41f1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48550/0 (socket says 172.21.15.49:48550) 2023-07-21T22:11:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d259c700 1 -- 172.21.15.49:0/3127185818 learned_addr learned my addr 172.21.15.49:0/3127185818 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9c9d9b700 1 --2- 172.21.15.49:0/3127185818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9d4071c70 0x7fd9d4143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d2d9d700 1 --2- 172.21.15.49:0/3127185818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9d40b1400 0x7fd9d40b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d259c700 1 -- 172.21.15.49:0/3127185818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9d4071c70 msgr2=0x7fd9d4143a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:12.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d259c700 1 --2- 172.21.15.49:0/3127185818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9d4071c70 0x7fd9d4143a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d259c700 1 -- 172.21.15.49:0/3127185818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9d40b1400 msgr2=0x7fd9d40b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:12.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d259c700 1 --2- 172.21.15.49:0/3127185818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9d40b1400 0x7fd9d40b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d259c700 1 -- 172.21.15.49:0/3127185818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c4009b30 con 0x7fd9d406d380 2023-07-21T22:11:12.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d259c700 1 --2- 172.21.15.49:0/3127185818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d406d380 0x7fd9d41f1190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400b370 tx=0x7fd9c4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:12.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9cb7fe700 1 -- 172.21.15.49:0/3127185818 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4004960 con 0x7fd9d406d380 2023-07-21T22:11:12.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9cb7fe700 1 -- 172.21.15.49:0/3127185818 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c40092e0 con 0x7fd9d406d380 2023-07-21T22:11:12.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9cb7fe700 1 -- 172.21.15.49:0/3127185818 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c401c6a0 con 0x7fd9d406d380 2023-07-21T22:11:12.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d359e700 1 -- 172.21.15.49:0/3127185818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d415ccc0 con 0x7fd9d406d380 2023-07-21T22:11:12.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.377+0000 7fd9d359e700 1 -- 172.21.15.49:0/3127185818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d4141460 con 0x7fd9d406d380 2023-07-21T22:11:12.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.381+0000 7fd9d359e700 1 -- 172.21.15.49:0/3127185818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d4141980 con 0x7fd9d406d380 2023-07-21T22:11:12.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.381+0000 7fd9cb7fe700 1 -- 172.21.15.49:0/3127185818 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd9c401c800 con 0x7fd9d406d380 2023-07-21T22:11:12.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.381+0000 7fd9cb7fe700 1 --2- 172.21.15.49:0/3127185818 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd9b40662f0 0x7fd9b40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.381+0000 7fd9cb7fe700 1 -- 172.21.15.49:0/3127185818 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd9c4085cd0 con 0x7fd9d406d380 2023-07-21T22:11:12.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.381+0000 7fd9c9d9b700 1 --2- 172.21.15.49:0/3127185818 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd9b40662f0 0x7fd9b40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.385+0000 7fd9c9d9b700 1 --2- 172.21.15.49:0/3127185818 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd9b40662f0 0x7fd9b40687a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd9d41f4d20 tx=0x7fd9bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:12.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.389+0000 7fd9cb7fe700 1 -- 172.21.15.49:0/3127185818 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9d4141980 con 0x7fd9d406d380 2023-07-21T22:11:12.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.565+0000 7fd9d359e700 1 -- 172.21.15.49:0/3127185818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9d4141980 con 0x7fd9d406d380 2023-07-21T22:11:12.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.565+0000 7fd9cb7fe700 1 -- 172.21.15.49:0/3127185818 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20084 (secure 0 0 0) 0x7fd9d4141980 con 0x7fd9d406d380 2023-07-21T22:11:12.610 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:12.610 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:10:39.728219+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.569+0000 7fd9d359e700 1 -- 172.21.15.49:0/3127185818 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd9b40662f0 msgr2=0x7fd9b40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.569+0000 7fd9d359e700 1 --2- 172.21.15.49:0/3127185818 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd9b40662f0 0x7fd9b40687a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd9d41f4d20 tx=0x7fd9bc008040 comp rx=0 tx=0).stop 2023-07-21T22:11:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.569+0000 7fd9d359e700 1 -- 172.21.15.49:0/3127185818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d406d380 msgr2=0x7fd9d41f1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.569+0000 7fd9d359e700 1 --2- 172.21.15.49:0/3127185818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d406d380 0x7fd9d41f1190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400b370 tx=0x7fd9c4004af0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.569+0000 7fd9d359e700 1 -- 172.21.15.49:0/3127185818 shutdown_connections 2023-07-21T22:11:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.569+0000 7fd9d359e700 1 --2- 172.21.15.49:0/3127185818 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd9b40662f0 0x7fd9b40687a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.569+0000 7fd9d359e700 1 --2- 172.21.15.49:0/3127185818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9d40b1400 0x7fd9d40b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.569+0000 7fd9d359e700 1 --2- 172.21.15.49:0/3127185818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9d4071c70 0x7fd9d4143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.569+0000 7fd9d359e700 1 --2- 172.21.15.49:0/3127185818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d406d380 0x7fd9d41f1190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.569+0000 7fd9d359e700 1 -- 172.21.15.49:0/3127185818 >> 172.21.15.49:0/3127185818 conn(0x7fd9d4070450 msgr2=0x7fd9d40cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:12.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.569+0000 7fd9d359e700 1 -- 172.21.15.49:0/3127185818 shutdown_connections 2023-07-21T22:11:12.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.569+0000 7fd9d359e700 1 -- 172.21.15.49:0/3127185818 wait complete. 2023-07-21T22:11:12.636 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:11:12.637 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:11:12.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.781+0000 7fea408f5700 1 Processor -- start 2023-07-21T22:11:12.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.781+0000 7fea408f5700 1 -- start start 2023-07-21T22:11:12.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.781+0000 7fea408f5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea3c1564c0 0x7fea3c0cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.781+0000 7fea408f5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fea3c0c9990 0x7fea3c0ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.781+0000 7fea408f5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c0c8bd0 con 0x7fea3c15c890 2023-07-21T22:11:12.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.781+0000 7fea408f5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3c0c9570 con 0x7fea3c0c9990 2023-07-21T22:11:12.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.781+0000 7fea408f5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c15d420 con 0x7fea3c1564c0 2023-07-21T22:11:12.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.781+0000 7fea3ad9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fea3c15c890 0x7fea3c15cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44776/0 (socket says 172.21.15.49:44776) 2023-07-21T22:11:12.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.781+0000 7fea3ad9d700 1 -- 172.21.15.49:0/43978780 learned_addr learned my addr 172.21.15.49:0/43978780 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:12.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.781+0000 7fea3a59c700 1 --2- 172.21.15.49:0/43978780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea3c1564c0 0x7fea3c0cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.781+0000 7fea39d9b700 1 --2- 172.21.15.49:0/43978780 >> v2:172.21.15.150:3300/0 conn(0x7fea3c0c9990 0x7fea3c0ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.781+0000 7fea3959a700 1 -- 172.21.15.49:0/43978780 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524016990 0 0) 0x7fea3c0c8bd0 con 0x7fea3c15c890 2023-07-21T22:11:12.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.781+0000 7fea3959a700 1 -- 172.21.15.49:0/43978780 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea240057e0 con 0x7fea3c15c890 2023-07-21T22:11:12.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 -- 172.21.15.49:0/43978780 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1097158408 0 0) 0x7fea240057e0 con 0x7fea3c15c890 2023-07-21T22:11:12.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 -- 172.21.15.49:0/43978780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea3c1564c0 msgr2=0x7fea3c0cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:12.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 --2- 172.21.15.49:0/43978780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea3c1564c0 0x7fea3c0cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 -- 172.21.15.49:0/43978780 >> v2:172.21.15.150:3300/0 conn(0x7fea3c0c9990 msgr2=0x7fea3c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:12.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 --2- 172.21.15.49:0/43978780 >> v2:172.21.15.150:3300/0 conn(0x7fea3c0c9990 0x7fea3c0ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 -- 172.21.15.49:0/43978780 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c0c8eb0 con 0x7fea3c15c890 2023-07-21T22:11:12.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 -- 172.21.15.49:0/43978780 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7fea340019f0 con 0x7fea3c15c890 2023-07-21T22:11:12.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 -- 172.21.15.49:0/43978780 >> v1:172.21.15.49:6789/0 conn(0x7fea3c15c890 legacy=0x7fea3c15cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:12.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 --2- 172.21.15.49:0/43978780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea24005c30 0x7fea24006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 --2- 172.21.15.49:0/43978780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea3c1564c0 0x7fea24006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 --2- 172.21.15.49:0/43978780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea24006fc0 0x7fea24007430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 -- 172.21.15.49:0/43978780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c0c9570 con 0x7fea24006fc0 2023-07-21T22:11:12.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 -- 172.21.15.49:0/43978780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2400dc40 con 0x7fea24005c30 2023-07-21T22:11:12.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 -- 172.21.15.49:0/43978780 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2400dd80 con 0x7fea3c1564c0 2023-07-21T22:11:12.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3ad9d700 1 --2- 172.21.15.49:0/43978780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea24006fc0 0x7fea24007430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3a59c700 1 --2- 172.21.15.49:0/43978780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea24005c30 0x7fea24006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea39d9b700 1 --2- 172.21.15.49:0/43978780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea3c1564c0 0x7fea24006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3ad9d700 1 -- 172.21.15.49:0/43978780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea3c1564c0 msgr2=0x7fea24006a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:12.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3ad9d700 1 --2- 172.21.15.49:0/43978780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea3c1564c0 0x7fea24006a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3ad9d700 1 -- 172.21.15.49:0/43978780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea24005c30 msgr2=0x7fea24006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:12.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3ad9d700 1 --2- 172.21.15.49:0/43978780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea24005c30 0x7fea24006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3ad9d700 1 -- 172.21.15.49:0/43978780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea240057e0 con 0x7fea24006fc0 2023-07-21T22:11:12.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3ad9d700 1 --2- 172.21.15.49:0/43978780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea24006fc0 0x7fea24007430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fea3400a830 tx=0x7fea24007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eeb9ab1c04597e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:12.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 -- 172.21.15.49:0/43978780 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea340072d0 con 0x7fea24006fc0 2023-07-21T22:11:12.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 -- 172.21.15.49:0/43978780 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3400ae90 con 0x7fea24006fc0 2023-07-21T22:11:12.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3959a700 1 -- 172.21.15.49:0/43978780 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34007670 con 0x7fea24006fc0 2023-07-21T22:11:12.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea408f5700 1 -- 172.21.15.49:0/43978780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea24006fc0 msgr2=0x7fea24007430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:12.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea408f5700 1 --2- 172.21.15.49:0/43978780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea24006fc0 0x7fea24007430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fea3400a830 tx=0x7fea24007ab0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea3ad9d700 1 -- 172.21.15.49:0/43978780 reap_dead start 2023-07-21T22:11:12.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea408f5700 1 -- 172.21.15.49:0/43978780 shutdown_connections 2023-07-21T22:11:12.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea408f5700 1 -- 172.21.15.49:0/43978780 >> 172.21.15.49:0/43978780 conn(0x7fea3c06e960 msgr2=0x7fea3c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:12.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea408f5700 1 -- 172.21.15.49:0/43978780 shutdown_connections 2023-07-21T22:11:12.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.785+0000 7fea408f5700 1 -- 172.21.15.49:0/43978780 wait complete. 2023-07-21T22:11:12.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.789+0000 7fea408f5700 1 Processor -- start 2023-07-21T22:11:12.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.789+0000 7fea408f5700 1 -- start start 2023-07-21T22:11:12.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea408f5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea24006fc0 0x7fea3c0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea408f5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea3c14a6f0 0x7fea3c14da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea408f5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea3c146fd0 0x7fea3c147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea408f5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c0b29c0 con 0x7fea3c14a6f0 2023-07-21T22:11:12.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea408f5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c147980 con 0x7fea3c146fd0 2023-07-21T22:11:12.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea408f5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c0b13e0 con 0x7fea24006fc0 2023-07-21T22:11:12.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea39d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea3c14a6f0 0x7fea3c14da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea39d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea3c14a6f0 0x7fea3c14da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48576/0 (socket says 172.21.15.49:48576) 2023-07-21T22:11:12.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea39d9b700 1 -- 172.21.15.49:0/4141967978 learned_addr learned my addr 172.21.15.49:0/4141967978 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:12.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea3a59c700 1 --2- 172.21.15.49:0/4141967978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea24006fc0 0x7fea3c0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea3ad9d700 1 --2- 172.21.15.49:0/4141967978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea3c146fd0 0x7fea3c147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea39d9b700 1 -- 172.21.15.49:0/4141967978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea24006fc0 msgr2=0x7fea3c0b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:12.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea39d9b700 1 --2- 172.21.15.49:0/4141967978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea24006fc0 0x7fea3c0b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea39d9b700 1 -- 172.21.15.49:0/4141967978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea3c146fd0 msgr2=0x7fea3c147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:12.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea39d9b700 1 --2- 172.21.15.49:0/4141967978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea3c146fd0 0x7fea3c147440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:12.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea39d9b700 1 -- 172.21.15.49:0/4141967978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c0b16c0 con 0x7fea3c14a6f0 2023-07-21T22:11:12.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea39d9b700 1 --2- 172.21.15.49:0/4141967978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea3c14a6f0 0x7fea3c14da50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fea300116f0 tx=0x7fea30011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:12.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea2affd700 1 -- 172.21.15.49:0/4141967978 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30015870 con 0x7fea3c14a6f0 2023-07-21T22:11:12.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea2affd700 1 -- 172.21.15.49:0/4141967978 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea300159d0 con 0x7fea3c14a6f0 2023-07-21T22:11:12.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea408f5700 1 -- 172.21.15.49:0/4141967978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3c0b19a0 con 0x7fea3c14a6f0 2023-07-21T22:11:12.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea2affd700 1 -- 172.21.15.49:0/4141967978 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30015d40 con 0x7fea3c14a6f0 2023-07-21T22:11:12.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.793+0000 7fea408f5700 1 -- 172.21.15.49:0/4141967978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3c0b1f60 con 0x7fea3c14a6f0 2023-07-21T22:11:12.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.797+0000 7fea408f5700 1 -- 172.21.15.49:0/4141967978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c0b2120 con 0x7fea3c14a6f0 2023-07-21T22:11:12.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.797+0000 7fea2affd700 1 -- 172.21.15.49:0/4141967978 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea300143e0 con 0x7fea3c14a6f0 2023-07-21T22:11:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.801+0000 7fea2affd700 1 --2- 172.21.15.49:0/4141967978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fea1c0662f0 0x7fea1c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:12.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.801+0000 7fea2affd700 1 -- 172.21.15.49:0/4141967978 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fea30084770 con 0x7fea3c14a6f0 2023-07-21T22:11:12.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.801+0000 7fea3a59c700 1 --2- 172.21.15.49:0/4141967978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fea1c0662f0 0x7fea1c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:12.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.801+0000 7fea3a59c700 1 --2- 172.21.15.49:0/4141967978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fea1c0662f0 0x7fea1c0687a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009bf0 tx=0x7fea2c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:12.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.805+0000 7fea2affd700 1 -- 172.21.15.49:0/4141967978 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea300553a0 con 0x7fea3c14a6f0 2023-07-21T22:11:13.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.977+0000 7fea408f5700 1 -- 172.21.15.49:0/4141967978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea3c04dd50 con 0x7fea3c14a6f0 2023-07-21T22:11:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.977+0000 7fea2affd700 1 -- 172.21.15.49:0/4141967978 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea30054f30 con 0x7fea3c14a6f0 2023-07-21T22:11:13.022 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:11:13.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.981+0000 7fea408f5700 1 -- 172.21.15.49:0/4141967978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fea1c0662f0 msgr2=0x7fea1c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.981+0000 7fea408f5700 1 --2- 172.21.15.49:0/4141967978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fea1c0662f0 0x7fea1c0687a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009bf0 tx=0x7fea2c009240 comp rx=0 tx=0).stop 2023-07-21T22:11:13.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.981+0000 7fea408f5700 1 -- 172.21.15.49:0/4141967978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea3c14a6f0 msgr2=0x7fea3c14da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.981+0000 7fea408f5700 1 --2- 172.21.15.49:0/4141967978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea3c14a6f0 0x7fea3c14da50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fea300116f0 tx=0x7fea30011a00 comp rx=0 tx=0).stop 2023-07-21T22:11:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.981+0000 7fea408f5700 1 -- 172.21.15.49:0/4141967978 shutdown_connections 2023-07-21T22:11:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.981+0000 7fea408f5700 1 --2- 172.21.15.49:0/4141967978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fea1c0662f0 0x7fea1c0687a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.981+0000 7fea408f5700 1 --2- 172.21.15.49:0/4141967978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea3c14a6f0 0x7fea3c14da50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.981+0000 7fea408f5700 1 --2- 172.21.15.49:0/4141967978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea3c146fd0 0x7fea3c147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.981+0000 7fea408f5700 1 --2- 172.21.15.49:0/4141967978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea24006fc0 0x7fea3c0b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.981+0000 7fea408f5700 1 -- 172.21.15.49:0/4141967978 >> 172.21.15.49:0/4141967978 conn(0x7fea3c06e960 msgr2=0x7fea3c06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:13.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.981+0000 7fea408f5700 1 -- 172.21.15.49:0/4141967978 shutdown_connections 2023-07-21T22:11:13.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:12.981+0000 7fea408f5700 1 -- 172.21.15.49:0/4141967978 wait complete. 2023-07-21T22:11:13.046 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:11:13.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.185+0000 7f15955e0700 1 Processor -- start 2023-07-21T22:11:13.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.185+0000 7f15955e0700 1 -- start start 2023-07-21T22:11:13.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.189+0000 7f15955e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15900cbc10 0x7f15900cc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:13.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.189+0000 7f15955e0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15900cc570 con 0x7f1590160010 2023-07-21T22:11:13.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.189+0000 7f15955e0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1590163ee0 con 0x7f15901603e0 2023-07-21T22:11:13.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.189+0000 7f15955e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15900cdf70 con 0x7f15900cbc10 2023-07-21T22:11:13.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.189+0000 7f158effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1590160010 0x7f15900ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44784/0 (socket says 172.21.15.49:44784) 2023-07-21T22:11:13.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.189+0000 7f158effd700 1 -- 172.21.15.49:0/1241900213 learned_addr learned my addr 172.21.15.49:0/1241900213 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:13.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.189+0000 7f158f7fe700 1 --2- 172.21.15.49:0/1241900213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15900cbc10 0x7f15900cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:13.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.189+0000 7f158dffb700 1 -- 172.21.15.49:0/1241900213 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731321260 0 0) 0x7f1580001110 con 0x7f1590160010 2023-07-21T22:11:13.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.193+0000 7f158f7fe700 1 -- 172.21.15.49:0/1241900213 >> v1:172.21.15.150:6789/0 conn(0x7f15901603e0 legacy=0x7f1590164370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.193+0000 7f158f7fe700 1 -- 172.21.15.49:0/1241900213 >> v1:172.21.15.49:6789/0 conn(0x7f1590160010 legacy=0x7f15900ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.193+0000 7f158f7fe700 1 -- 172.21.15.49:0/1241900213 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15900cd6d0 con 0x7f15900cbc10 2023-07-21T22:11:13.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.193+0000 7f158f7fe700 1 --2- 172.21.15.49:0/1241900213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15900cbc10 0x7f15900cc030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1588009dc0 tx=0x7f158800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b96a25caea08990f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:13.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.193+0000 7f158dffb700 1 -- 172.21.15.49:0/1241900213 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158800e070 con 0x7f15900cbc10 2023-07-21T22:11:13.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.193+0000 7f158dffb700 1 -- 172.21.15.49:0/1241900213 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158800bad0 con 0x7f15900cbc10 2023-07-21T22:11:13.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.193+0000 7f158dffb700 1 -- 172.21.15.49:0/1241900213 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158800be80 con 0x7f15900cbc10 2023-07-21T22:11:13.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.193+0000 7f15955e0700 1 -- 172.21.15.49:0/1241900213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15900cbc10 msgr2=0x7f15900cc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.193+0000 7f15955e0700 1 --2- 172.21.15.49:0/1241900213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15900cbc10 0x7f15900cc030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1588009dc0 tx=0x7f158800b330 comp rx=0 tx=0).stop 2023-07-21T22:11:13.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.193+0000 7f15955e0700 1 -- 172.21.15.49:0/1241900213 shutdown_connections 2023-07-21T22:11:13.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.193+0000 7f15955e0700 1 --2- 172.21.15.49:0/1241900213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15900cbc10 0x7f15900cc030 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.193+0000 7f15955e0700 1 -- 172.21.15.49:0/1241900213 >> 172.21.15.49:0/1241900213 conn(0x7f15900ce0d0 msgr2=0x7f15900ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:13.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.193+0000 7f15955e0700 1 -- 172.21.15.49:0/1241900213 shutdown_connections 2023-07-21T22:11:13.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.193+0000 7f15955e0700 1 -- 172.21.15.49:0/1241900213 wait complete. 2023-07-21T22:11:13.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.197+0000 7f15955e0700 1 Processor -- start 2023-07-21T22:11:13.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.197+0000 7f15955e0700 1 -- start start 2023-07-21T22:11:13.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.197+0000 7f15955e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15900cbc10 0x7f15901485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:13.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.197+0000 7f15955e0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1590160010 0x7f15900c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:13.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.197+0000 7f15955e0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15901603e0 0x7f15901eb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:13.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.197+0000 7f15955e0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1590148b20 con 0x7f1590160010 2023-07-21T22:11:13.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.197+0000 7f15955e0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15900c7a40 con 0x7f15901603e0 2023-07-21T22:11:13.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.197+0000 7f15955e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15900c6b90 con 0x7f15900cbc10 2023-07-21T22:11:13.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.197+0000 7f158e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1590160010 0x7f15900c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:13.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.197+0000 7f158e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1590160010 0x7f15900c5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48592/0 (socket says 172.21.15.49:48592) 2023-07-21T22:11:13.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.197+0000 7f158e7fc700 1 -- 172.21.15.49:0/190755155 learned_addr learned my addr 172.21.15.49:0/190755155 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:13.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.197+0000 7f158effd700 1 --2- 172.21.15.49:0/190755155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15900cbc10 0x7f15901485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:13.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.197+0000 7f158f7fe700 1 --2- 172.21.15.49:0/190755155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15901603e0 0x7f15901eb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:13.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.201+0000 7f158e7fc700 1 -- 172.21.15.49:0/190755155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15900cbc10 msgr2=0x7f15901485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.201+0000 7f158e7fc700 1 --2- 172.21.15.49:0/190755155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15900cbc10 0x7f15901485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.201+0000 7f158e7fc700 1 -- 172.21.15.49:0/190755155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15901603e0 msgr2=0x7f15901eb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.201+0000 7f158e7fc700 1 --2- 172.21.15.49:0/190755155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15901603e0 0x7f15901eb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.201+0000 7f158e7fc700 1 -- 172.21.15.49:0/190755155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1588009a70 con 0x7f1590160010 2023-07-21T22:11:13.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.201+0000 7f158e7fc700 1 --2- 172.21.15.49:0/190755155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1590160010 0x7f15900c5110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f158400c780 tx=0x7f158400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:13.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.201+0000 7f15777fe700 1 -- 172.21.15.49:0/190755155 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15840054e0 con 0x7f1590160010 2023-07-21T22:11:13.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.201+0000 7f15777fe700 1 -- 172.21.15.49:0/190755155 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15840036a0 con 0x7f1590160010 2023-07-21T22:11:13.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.201+0000 7f15955e0700 1 -- 172.21.15.49:0/190755155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15900c6e30 con 0x7f1590160010 2023-07-21T22:11:13.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.201+0000 7f15777fe700 1 -- 172.21.15.49:0/190755155 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584003a50 con 0x7f1590160010 2023-07-21T22:11:13.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.201+0000 7f15955e0700 1 -- 172.21.15.49:0/190755155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15900c73f0 con 0x7f1590160010 2023-07-21T22:11:13.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.201+0000 7f15955e0700 1 -- 172.21.15.49:0/190755155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159004dcb0 con 0x7f1590160010 2023-07-21T22:11:13.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.205+0000 7f15777fe700 1 -- 172.21.15.49:0/190755155 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1584003bb0 con 0x7f1590160010 2023-07-21T22:11:13.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.205+0000 7f15777fe700 1 --2- 172.21.15.49:0/190755155 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f157c0662f0 0x7f157c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:13.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.205+0000 7f15777fe700 1 -- 172.21.15.49:0/190755155 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1584083410 con 0x7f1590160010 2023-07-21T22:11:13.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.205+0000 7f158effd700 1 --2- 172.21.15.49:0/190755155 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f157c0662f0 0x7f157c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:13.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.205+0000 7f158effd700 1 --2- 172.21.15.49:0/190755155 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f157c0662f0 0x7f157c0687a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1580000f60 tx=0x7f1580004a70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:13.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.213+0000 7f15777fe700 1 -- 172.21.15.49:0/190755155 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f15840505b0 con 0x7f1590160010 2023-07-21T22:11:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.389+0000 7f15955e0700 1 -- 172.21.15.49:0/190755155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f15900cb940 con 0x7f1590160010 2023-07-21T22:11:13.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.389+0000 7f15777fe700 1 -- 172.21.15.49:0/190755155 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1584017020 con 0x7f1590160010 2023-07-21T22:11:13.432 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:11:13.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.393+0000 7f15955e0700 1 -- 172.21.15.49:0/190755155 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f157c0662f0 msgr2=0x7f157c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.393+0000 7f15955e0700 1 --2- 172.21.15.49:0/190755155 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f157c0662f0 0x7f157c0687a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1580000f60 tx=0x7f1580004a70 comp rx=0 tx=0).stop 2023-07-21T22:11:13.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.393+0000 7f15955e0700 1 -- 172.21.15.49:0/190755155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1590160010 msgr2=0x7f15900c5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.393+0000 7f15955e0700 1 --2- 172.21.15.49:0/190755155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1590160010 0x7f15900c5110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f158400c780 tx=0x7f158400ca90 comp rx=0 tx=0).stop 2023-07-21T22:11:13.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.393+0000 7f15955e0700 1 -- 172.21.15.49:0/190755155 shutdown_connections 2023-07-21T22:11:13.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.393+0000 7f15955e0700 1 --2- 172.21.15.49:0/190755155 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f157c0662f0 0x7f157c0687a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.393+0000 7f15955e0700 1 --2- 172.21.15.49:0/190755155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1590160010 0x7f15900c5110 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.393+0000 7f15955e0700 1 --2- 172.21.15.49:0/190755155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15901603e0 0x7f15901eb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.393+0000 7f15955e0700 1 --2- 172.21.15.49:0/190755155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15900cbc10 0x7f15901485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.393+0000 7f15955e0700 1 -- 172.21.15.49:0/190755155 >> 172.21.15.49:0/190755155 conn(0x7f15900ce0d0 msgr2=0x7f15901607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:13.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.393+0000 7f15955e0700 1 -- 172.21.15.49:0/190755155 shutdown_connections 2023-07-21T22:11:13.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.393+0000 7f15955e0700 1 -- 172.21.15.49:0/190755155 wait complete. 2023-07-21T22:11:13.457 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:11:13.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.597+0000 7fbf79784700 1 Processor -- start 2023-07-21T22:11:13.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.597+0000 7fbf79784700 1 -- start start 2023-07-21T22:11:13.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.601+0000 7fbf79784700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf7415bbd0 0x7fbf740cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:13.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.601+0000 7fbf79784700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbf740afbd0 0x7fbf740b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:13.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.601+0000 7fbf79784700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf740b0570 con 0x7fbf740ccc00 2023-07-21T22:11:13.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.601+0000 7fbf79784700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf740ccfd0 con 0x7fbf7415bbd0 2023-07-21T22:11:13.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.601+0000 7fbf79784700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7415c120 con 0x7fbf740afbd0 2023-07-21T22:11:13.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.601+0000 7fbf6b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf7415bbd0 0x7fbf740cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:13.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.601+0000 7fbf6b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf7415bbd0 0x7fbf740cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48604/0 (socket says 172.21.15.49:48604) 2023-07-21T22:11:13.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.601+0000 7fbf6b7fe700 1 -- 172.21.15.49:0/2319657826 learned_addr learned my addr 172.21.15.49:0/2319657826 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:13.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.601+0000 7fbf78f83700 1 --2- 172.21.15.49:0/2319657826 >> v2:172.21.15.150:3300/0 conn(0x7fbf740afbd0 0x7fbf740b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:13.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf6b7fe700 1 -- 172.21.15.49:0/2319657826 >> v2:172.21.15.150:3300/0 conn(0x7fbf740afbd0 msgr2=0x7fbf740b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:13.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf6b7fe700 1 --2- 172.21.15.49:0/2319657826 >> v2:172.21.15.150:3300/0 conn(0x7fbf740afbd0 0x7fbf740b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf6b7fe700 1 -- 172.21.15.49:0/2319657826 >> v1:172.21.15.150:6789/0 conn(0x7fbf740ccc00 legacy=0x7fbf740cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf6b7fe700 1 -- 172.21.15.49:0/2319657826 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7415c400 con 0x7fbf7415bbd0 2023-07-21T22:11:13.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf6b7fe700 1 --2- 172.21.15.49:0/2319657826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf7415bbd0 0x7fbf740cbc10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbf7415ccd0 tx=0x7fbf5c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadd930d464ee536 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:13.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf737fe700 1 -- 172.21.15.49:0/2319657826 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c011830 con 0x7fbf7415bbd0 2023-07-21T22:11:13.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf737fe700 1 -- 172.21.15.49:0/2319657826 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c011990 con 0x7fbf7415bbd0 2023-07-21T22:11:13.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf737fe700 1 -- 172.21.15.49:0/2319657826 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c011d20 con 0x7fbf7415bbd0 2023-07-21T22:11:13.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf79784700 1 -- 172.21.15.49:0/2319657826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf7415bbd0 msgr2=0x7fbf740cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf79784700 1 --2- 172.21.15.49:0/2319657826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf7415bbd0 0x7fbf740cbc10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbf7415ccd0 tx=0x7fbf5c009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf79784700 1 -- 172.21.15.49:0/2319657826 shutdown_connections 2023-07-21T22:11:13.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf79784700 1 --2- 172.21.15.49:0/2319657826 >> v2:172.21.15.150:3300/0 conn(0x7fbf740afbd0 0x7fbf740b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf79784700 1 --2- 172.21.15.49:0/2319657826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf7415bbd0 0x7fbf740cbc10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf79784700 1 -- 172.21.15.49:0/2319657826 >> 172.21.15.49:0/2319657826 conn(0x7fbf740ce0d0 msgr2=0x7fbf740ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:13.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf79784700 1 -- 172.21.15.49:0/2319657826 shutdown_connections 2023-07-21T22:11:13.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.605+0000 7fbf79784700 1 -- 172.21.15.49:0/2319657826 wait complete. 2023-07-21T22:11:13.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.609+0000 7fbf79784700 1 Processor -- start 2023-07-21T22:11:13.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.609+0000 7fbf79784700 1 -- start start 2023-07-21T22:11:13.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf79784700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf740afbd0 0x7fbf740c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:13.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf79784700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf740ccc00 0x7fbf740c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:13.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf79784700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf7415bbd0 0x7fbf740cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:13.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf79784700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf74158a70 con 0x7fbf740ccc00 2023-07-21T22:11:13.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf79784700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf740c7f10 con 0x7fbf740afbd0 2023-07-21T22:11:13.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf79784700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf740c67b0 con 0x7fbf7415bbd0 2023-07-21T22:11:13.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf6b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf740ccc00 0x7fbf740c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:13.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf6b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf740ccc00 0x7fbf740c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48608/0 (socket says 172.21.15.49:48608) 2023-07-21T22:11:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf6b7fe700 1 -- 172.21.15.49:0/3619158028 learned_addr learned my addr 172.21.15.49:0/3619158028 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf73fff700 1 --2- 172.21.15.49:0/3619158028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf740afbd0 0x7fbf740c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf78f83700 1 --2- 172.21.15.49:0/3619158028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf7415bbd0 0x7fbf740cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf6b7fe700 1 -- 172.21.15.49:0/3619158028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf7415bbd0 msgr2=0x7fbf740cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf6b7fe700 1 --2- 172.21.15.49:0/3619158028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf7415bbd0 0x7fbf740cad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf6b7fe700 1 -- 172.21.15.49:0/3619158028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf740afbd0 msgr2=0x7fbf740c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf6b7fe700 1 --2- 172.21.15.49:0/3619158028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf740afbd0 0x7fbf740c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf6b7fe700 1 -- 172.21.15.49:0/3619158028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c009570 con 0x7fbf740ccc00 2023-07-21T22:11:13.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf6b7fe700 1 --2- 172.21.15.49:0/3619158028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf740ccc00 0x7fbf740c79d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbf74071dd0 tx=0x7fbf5c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:13.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf717fa700 1 -- 172.21.15.49:0/3619158028 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c004450 con 0x7fbf740ccc00 2023-07-21T22:11:13.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf717fa700 1 -- 172.21.15.49:0/3619158028 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c01f070 con 0x7fbf740ccc00 2023-07-21T22:11:13.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf717fa700 1 -- 172.21.15.49:0/3619158028 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c003900 con 0x7fbf740ccc00 2023-07-21T22:11:13.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf79784700 1 -- 172.21.15.49:0/3619158028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf740c6a90 con 0x7fbf740ccc00 2023-07-21T22:11:13.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.613+0000 7fbf79784700 1 -- 172.21.15.49:0/3619158028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf740c7050 con 0x7fbf740ccc00 2023-07-21T22:11:13.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.617+0000 7fbf79784700 1 -- 172.21.15.49:0/3619158028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf74158c20 con 0x7fbf740ccc00 2023-07-21T22:11:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.617+0000 7fbf717fa700 1 -- 172.21.15.49:0/3619158028 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf5c003a60 con 0x7fbf740ccc00 2023-07-21T22:11:13.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.621+0000 7fbf717fa700 1 --2- 172.21.15.49:0/3619158028 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf54066370 0x7fbf54068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:13.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.621+0000 7fbf717fa700 1 -- 172.21.15.49:0/3619158028 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbf5c021070 con 0x7fbf740ccc00 2023-07-21T22:11:13.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.621+0000 7fbf73fff700 1 --2- 172.21.15.49:0/3619158028 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf54066370 0x7fbf54068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.621+0000 7fbf73fff700 1 --2- 172.21.15.49:0/3619158028 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf54066370 0x7fbf54068820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbf640012e0 tx=0x7fbf64009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:13.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.625+0000 7fbf717fa700 1 -- 172.21.15.49:0/3619158028 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf74158c20 con 0x7fbf740ccc00 2023-07-21T22:11:13.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.801+0000 7fbf79784700 1 -- 172.21.15.49:0/3619158028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf74158c20 con 0x7fbf740ccc00 2023-07-21T22:11:13.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.801+0000 7fbf717fa700 1 -- 172.21.15.49:0/3619158028 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf74158c20 con 0x7fbf740ccc00 2023-07-21T22:11:13.846 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:13.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.805+0000 7fbf79784700 1 -- 172.21.15.49:0/3619158028 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf54066370 msgr2=0x7fbf54068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.805+0000 7fbf79784700 1 --2- 172.21.15.49:0/3619158028 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf54066370 0x7fbf54068820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbf640012e0 tx=0x7fbf64009040 comp rx=0 tx=0).stop 2023-07-21T22:11:13.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.805+0000 7fbf79784700 1 -- 172.21.15.49:0/3619158028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf740ccc00 msgr2=0x7fbf740c79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:13.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.805+0000 7fbf79784700 1 --2- 172.21.15.49:0/3619158028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf740ccc00 0x7fbf740c79d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbf74071dd0 tx=0x7fbf5c004770 comp rx=0 tx=0).stop 2023-07-21T22:11:13.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.805+0000 7fbf79784700 1 -- 172.21.15.49:0/3619158028 shutdown_connections 2023-07-21T22:11:13.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.805+0000 7fbf79784700 1 --2- 172.21.15.49:0/3619158028 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf54066370 0x7fbf54068820 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.805+0000 7fbf79784700 1 --2- 172.21.15.49:0/3619158028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf740ccc00 0x7fbf740c79d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.805+0000 7fbf79784700 1 --2- 172.21.15.49:0/3619158028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf7415bbd0 0x7fbf740cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.805+0000 7fbf79784700 1 --2- 172.21.15.49:0/3619158028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf740afbd0 0x7fbf740c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:13.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.805+0000 7fbf79784700 1 -- 172.21.15.49:0/3619158028 >> 172.21.15.49:0/3619158028 conn(0x7fbf740ce0d0 msgr2=0x7fbf7406cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:13.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.805+0000 7fbf79784700 1 -- 172.21.15.49:0/3619158028 shutdown_connections 2023-07-21T22:11:13.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:13.805+0000 7fbf79784700 1 -- 172.21.15.49:0/3619158028 wait complete. 2023-07-21T22:11:13.870 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:11:14.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.013+0000 7fac9ef4c700 1 Processor -- start 2023-07-21T22:11:14.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.013+0000 7fac9ef4c700 1 -- start start 2023-07-21T22:11:14.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.017+0000 7fac9ef4c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fac98160010 0x7fac980ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.017+0000 7fac9ef4c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac980ca680 0x7fac980cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.017+0000 7fac9ef4c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac98163ee0 con 0x7fac981603e0 2023-07-21T22:11:14.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.017+0000 7fac9ef4c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac980cdf70 con 0x7fac980ca680 2023-07-21T22:11:14.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.017+0000 7fac9ef4c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac980cd6d0 con 0x7fac98160010 2023-07-21T22:11:14.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.017+0000 7fac9e74b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac980ca680 0x7fac980cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.017+0000 7fac9e74b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac980ca680 0x7fac980cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48610/0 (socket says 172.21.15.49:48610) 2023-07-21T22:11:14.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.017+0000 7fac9e74b700 1 -- 172.21.15.49:0/130427822 learned_addr learned my addr 172.21.15.49:0/130427822 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:14.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.017+0000 7fac9df4a700 1 --2- 172.21.15.49:0/130427822 >> v2:172.21.15.150:3300/0 conn(0x7fac98160010 0x7fac980ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.017+0000 7fac9e74b700 1 -- 172.21.15.49:0/130427822 >> v2:172.21.15.150:3300/0 conn(0x7fac98160010 msgr2=0x7fac980ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.017+0000 7fac9e74b700 1 --2- 172.21.15.49:0/130427822 >> v2:172.21.15.150:3300/0 conn(0x7fac98160010 0x7fac980ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.017+0000 7fac9e74b700 1 -- 172.21.15.49:0/130427822 >> v1:172.21.15.49:6789/0 conn(0x7fac981603e0 legacy=0x7fac98164370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.017+0000 7fac9e74b700 1 -- 172.21.15.49:0/130427822 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac980cd9b0 con 0x7fac980ca680 2023-07-21T22:11:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.017+0000 7fac9cf48700 1 -- 172.21.15.49:0/130427822 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764759566 0 0) 0x7fac98163ee0 con 0x7fac981603e0 2023-07-21T22:11:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.021+0000 7fac9e74b700 1 --2- 172.21.15.49:0/130427822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac980ca680 0x7fac980cbc10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fac980cedb0 tx=0x7fac9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c38fe7ff2cac8e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.021+0000 7fac9cf48700 1 -- 172.21.15.49:0/130427822 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000e070 con 0x7fac980ca680 2023-07-21T22:11:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.021+0000 7fac9cf48700 1 -- 172.21.15.49:0/130427822 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9000b910 con 0x7fac980ca680 2023-07-21T22:11:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.021+0000 7fac9cf48700 1 -- 172.21.15.49:0/130427822 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000bcc0 con 0x7fac980ca680 2023-07-21T22:11:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.021+0000 7fac9ef4c700 1 -- 172.21.15.49:0/130427822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac980ca680 msgr2=0x7fac980cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.021+0000 7fac9ef4c700 1 --2- 172.21.15.49:0/130427822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac980ca680 0x7fac980cbc10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fac980cedb0 tx=0x7fac9000b330 comp rx=0 tx=0).stop 2023-07-21T22:11:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.021+0000 7fac9ef4c700 1 -- 172.21.15.49:0/130427822 shutdown_connections 2023-07-21T22:11:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.021+0000 7fac9ef4c700 1 --2- 172.21.15.49:0/130427822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac980ca680 0x7fac980cbc10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.021+0000 7fac9ef4c700 1 --2- 172.21.15.49:0/130427822 >> v2:172.21.15.150:3300/0 conn(0x7fac98160010 0x7fac980ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.021+0000 7fac9ef4c700 1 -- 172.21.15.49:0/130427822 >> 172.21.15.49:0/130427822 conn(0x7fac980ce0d0 msgr2=0x7fac980ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.021+0000 7fac9ef4c700 1 -- 172.21.15.49:0/130427822 shutdown_connections 2023-07-21T22:11:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.021+0000 7fac9ef4c700 1 -- 172.21.15.49:0/130427822 wait complete. 2023-07-21T22:11:14.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9ef4c700 1 Processor -- start 2023-07-21T22:11:14.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9ef4c700 1 -- start start 2023-07-21T22:11:14.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9ef4c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac980ca680 0x7fac98154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9ef4c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac98160010 0x7fac980cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9ef4c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac981603e0 0x7fac980cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9ef4c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac98154ba0 con 0x7fac981603e0 2023-07-21T22:11:14.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9ef4c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac980afaf0 con 0x7fac98160010 2023-07-21T22:11:14.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9ef4c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac980aea50 con 0x7fac980ca680 2023-07-21T22:11:14.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9e74b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac981603e0 0x7fac980cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9e74b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac981603e0 0x7fac980cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48626/0 (socket says 172.21.15.49:48626) 2023-07-21T22:11:14.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9e74b700 1 -- 172.21.15.49:0/1380052997 learned_addr learned my addr 172.21.15.49:0/1380052997 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:14.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9df4a700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac980ca680 0x7fac98154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9d749700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac98160010 0x7fac980cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9e74b700 1 -- 172.21.15.49:0/1380052997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac980ca680 msgr2=0x7fac98154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9e74b700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac980ca680 0x7fac98154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9e74b700 1 -- 172.21.15.49:0/1380052997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac98160010 msgr2=0x7fac980cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9e74b700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac98160010 0x7fac980cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9e74b700 1 -- 172.21.15.49:0/1380052997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac90009b30 con 0x7fac981603e0 2023-07-21T22:11:14.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9d749700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac98160010 0x7fac980cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:14.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.025+0000 7fac9e74b700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac981603e0 0x7fac980cc150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fac98071ec0 tx=0x7fac90004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:14.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.029+0000 7fac8e7fc700 1 -- 172.21.15.49:0/1380052997 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac900099b0 con 0x7fac981603e0 2023-07-21T22:11:14.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.029+0000 7fac8e7fc700 1 -- 172.21.15.49:0/1380052997 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac900092e0 con 0x7fac981603e0 2023-07-21T22:11:14.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.029+0000 7fac8e7fc700 1 -- 172.21.15.49:0/1380052997 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9001b650 con 0x7fac981603e0 2023-07-21T22:11:14.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.029+0000 7fac9ef4c700 1 -- 172.21.15.49:0/1380052997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac980aed30 con 0x7fac981603e0 2023-07-21T22:11:14.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.029+0000 7fac9ef4c700 1 -- 172.21.15.49:0/1380052997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac980af2f0 con 0x7fac981603e0 2023-07-21T22:11:14.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.029+0000 7fac9ef4c700 1 -- 172.21.15.49:0/1380052997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac98071210 con 0x7fac981603e0 2023-07-21T22:11:14.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.029+0000 7fac8e7fc700 1 -- 172.21.15.49:0/1380052997 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fac9001b7b0 con 0x7fac981603e0 2023-07-21T22:11:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.033+0000 7fac8e7fc700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac7c0662f0 0x7fac7c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.033+0000 7fac8e7fc700 1 -- 172.21.15.49:0/1380052997 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fac900859b0 con 0x7fac981603e0 2023-07-21T22:11:14.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.033+0000 7fac9df4a700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac7c0662f0 0x7fac7c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.033+0000 7fac9df4a700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac7c0662f0 0x7fac7c0687a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fac94009b80 tx=0x7fac94008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.037+0000 7fac8e7fc700 1 -- 172.21.15.49:0/1380052997 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac90052b30 con 0x7fac981603e0 2023-07-21T22:11:14.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.213+0000 7fac9ef4c700 1 -- 172.21.15.49:0/1380052997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac9804dcb0 con 0x7fac981603e0 2023-07-21T22:11:14.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.213+0000 7fac8e7fc700 1 -- 172.21.15.49:0/1380052997 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac90056150 con 0x7fac981603e0 2023-07-21T22:11:14.258 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:11:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.217+0000 7fac9ef4c700 1 -- 172.21.15.49:0/1380052997 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac7c0662f0 msgr2=0x7fac7c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.217+0000 7fac9ef4c700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac7c0662f0 0x7fac7c0687a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fac94009b80 tx=0x7fac94008040 comp rx=0 tx=0).stop 2023-07-21T22:11:14.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.217+0000 7fac9ef4c700 1 -- 172.21.15.49:0/1380052997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac981603e0 msgr2=0x7fac980cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.217+0000 7fac9ef4c700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac981603e0 0x7fac980cc150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fac98071ec0 tx=0x7fac90004af0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.217+0000 7fac9ef4c700 1 -- 172.21.15.49:0/1380052997 shutdown_connections 2023-07-21T22:11:14.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.217+0000 7fac9ef4c700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac7c0662f0 0x7fac7c0687a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.217+0000 7fac9ef4c700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac981603e0 0x7fac980cc150 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.217+0000 7fac9ef4c700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac98160010 0x7fac980cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.217+0000 7fac9ef4c700 1 --2- 172.21.15.49:0/1380052997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac980ca680 0x7fac98154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.217+0000 7fac9ef4c700 1 -- 172.21.15.49:0/1380052997 >> 172.21.15.49:0/1380052997 conn(0x7fac980ce0d0 msgr2=0x7fac9806cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:14.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.217+0000 7fac9ef4c700 1 -- 172.21.15.49:0/1380052997 shutdown_connections 2023-07-21T22:11:14.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.217+0000 7fac9ef4c700 1 -- 172.21.15.49:0/1380052997 wait complete. 2023-07-21T22:11:14.281 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:11:14.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.421+0000 7f1a992a2700 1 Processor -- start 2023-07-21T22:11:14.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.421+0000 7f1a992a2700 1 -- start start 2023-07-21T22:11:14.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.421+0000 7f1a992a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a94160110 0x7f1a940cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.421+0000 7f1a992a2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1a940cb2f0 0x7f1a94163d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.421+0000 7f1a992a2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a940cdf00 con 0x7f1a94071220 2023-07-21T22:11:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.421+0000 7f1a992a2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a940cd730 con 0x7f1a940cb2f0 2023-07-21T22:11:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.421+0000 7f1a992a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940ce600 con 0x7f1a94160110 2023-07-21T22:11:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.421+0000 7f1a937fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1a940cb2f0 0x7f1a94163d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.421+0000 7f1a8bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1a94071220 0x7f1a940cabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44810/0 (socket says 172.21.15.49:44810) 2023-07-21T22:11:14.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.421+0000 7f1a8bfff700 1 -- 172.21.15.49:0/3934433521 learned_addr learned my addr 172.21.15.49:0/3934433521 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:14.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.421+0000 7f1a92ffd700 1 --2- 172.21.15.49:0/3934433521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a94160110 0x7f1a940cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a937fe700 1 -- 172.21.15.49:0/3934433521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a94160110 msgr2=0x7f1a940cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:14.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a937fe700 1 --2- 172.21.15.49:0/3934433521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a94160110 0x7f1a940cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a937fe700 1 -- 172.21.15.49:0/3934433521 >> v1:172.21.15.49:6789/0 conn(0x7f1a94071220 legacy=0x7f1a940cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a937fe700 1 -- 172.21.15.49:0/3934433521 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a940cefd0 con 0x7f1a940cb2f0 2023-07-21T22:11:14.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a927fc700 1 -- 172.21.15.49:0/3934433521 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907442839 0 0) 0x7f1a940cdf00 con 0x7f1a94071220 2023-07-21T22:11:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a937fe700 1 --2- 172.21.15.49:0/3934433521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a940cb2f0 0x7f1a94163d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009d90 tx=0x7f1a8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2799c30724ffbd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a927fc700 1 -- 172.21.15.49:0/3934433521 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00e070 con 0x7f1a940cb2f0 2023-07-21T22:11:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a927fc700 1 -- 172.21.15.49:0/3934433521 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c00bb20 con 0x7f1a940cb2f0 2023-07-21T22:11:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a927fc700 1 -- 172.21.15.49:0/3934433521 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c012430 con 0x7f1a940cb2f0 2023-07-21T22:11:14.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a992a2700 1 -- 172.21.15.49:0/3934433521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a940cb2f0 msgr2=0x7f1a94163d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a992a2700 1 --2- 172.21.15.49:0/3934433521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a940cb2f0 0x7f1a94163d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009d90 tx=0x7f1a8c00b330 comp rx=0 tx=0).stop 2023-07-21T22:11:14.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a992a2700 1 -- 172.21.15.49:0/3934433521 shutdown_connections 2023-07-21T22:11:14.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a992a2700 1 --2- 172.21.15.49:0/3934433521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a940cb2f0 0x7f1a94163d40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a992a2700 1 --2- 172.21.15.49:0/3934433521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a94160110 0x7f1a940cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a992a2700 1 -- 172.21.15.49:0/3934433521 >> 172.21.15.49:0/3934433521 conn(0x7f1a9406e960 msgr2=0x7f1a9406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:14.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a992a2700 1 -- 172.21.15.49:0/3934433521 shutdown_connections 2023-07-21T22:11:14.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.425+0000 7f1a992a2700 1 -- 172.21.15.49:0/3934433521 wait complete. 2023-07-21T22:11:14.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.429+0000 7f1a992a2700 1 Processor -- start 2023-07-21T22:11:14.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.429+0000 7f1a992a2700 1 -- start start 2023-07-21T22:11:14.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a992a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a94071220 0x7f1a9415e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a992a2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a940cb2f0 0x7f1a941f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a992a2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a94160110 0x7f1a94160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a992a2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a941f6110 con 0x7f1a940cb2f0 2023-07-21T22:11:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a992a2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a941f63f0 con 0x7f1a94160110 2023-07-21T22:11:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a992a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a941f66d0 con 0x7f1a94071220 2023-07-21T22:11:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a8bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a940cb2f0 0x7f1a941f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a8bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a940cb2f0 0x7f1a941f5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48642/0 (socket says 172.21.15.49:48642) 2023-07-21T22:11:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a8bfff700 1 -- 172.21.15.49:0/50096637 learned_addr learned my addr 172.21.15.49:0/50096637 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:14.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a92ffd700 1 --2- 172.21.15.49:0/50096637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a94071220 0x7f1a9415e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a937fe700 1 --2- 172.21.15.49:0/50096637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a94160110 0x7f1a94160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a8bfff700 1 -- 172.21.15.49:0/50096637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a94071220 msgr2=0x7f1a9415e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a8bfff700 1 --2- 172.21.15.49:0/50096637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a94071220 0x7f1a9415e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a8bfff700 1 -- 172.21.15.49:0/50096637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a94160110 msgr2=0x7f1a94160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a8bfff700 1 --2- 172.21.15.49:0/50096637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a94160110 0x7f1a94160ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a8bfff700 1 -- 172.21.15.49:0/50096637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c009a70 con 0x7f1a940cb2f0 2023-07-21T22:11:14.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a8bfff700 1 --2- 172.21.15.49:0/50096637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a940cb2f0 0x7f1a941f5670 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00c480 tx=0x7f1a7c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:14.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a8b7fe700 1 -- 172.21.15.49:0/50096637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c004ca0 con 0x7f1a940cb2f0 2023-07-21T22:11:14.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a8b7fe700 1 -- 172.21.15.49:0/50096637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c00ce90 con 0x7f1a940cb2f0 2023-07-21T22:11:14.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a8b7fe700 1 -- 172.21.15.49:0/50096637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c007310 con 0x7f1a940cb2f0 2023-07-21T22:11:14.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a992a2700 1 -- 172.21.15.49:0/50096637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a941604e0 con 0x7f1a940cb2f0 2023-07-21T22:11:14.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.433+0000 7f1a992a2700 1 -- 172.21.15.49:0/50096637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a94163a80 con 0x7f1a940cb2f0 2023-07-21T22:11:14.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.437+0000 7f1a992a2700 1 -- 172.21.15.49:0/50096637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a94160a00 con 0x7f1a940cb2f0 2023-07-21T22:11:14.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.437+0000 7f1a8b7fe700 1 -- 172.21.15.49:0/50096637 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a7c007470 con 0x7f1a940cb2f0 2023-07-21T22:11:14.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.437+0000 7f1a8b7fe700 1 --2- 172.21.15.49:0/50096637 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1a74066320 0x7f1a740687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.441+0000 7f1a8b7fe700 1 -- 172.21.15.49:0/50096637 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1a7c083c20 con 0x7f1a940cb2f0 2023-07-21T22:11:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.441+0000 7f1a92ffd700 1 --2- 172.21.15.49:0/50096637 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1a74066320 0x7f1a740687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.441+0000 7f1a92ffd700 1 --2- 172.21.15.49:0/50096637 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1a74066320 0x7f1a740687d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009bf0 tx=0x7f1a84009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:14.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.445+0000 7f1a8b7fe700 1 -- 172.21.15.49:0/50096637 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a94160a00 con 0x7f1a940cb2f0 2023-07-21T22:11:14.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.617+0000 7f1a992a2700 1 -- 172.21.15.49:0/50096637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1a94160a00 con 0x7f1a940cb2f0 2023-07-21T22:11:14.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.617+0000 7f1a8b7fe700 1 -- 172.21.15.49:0/50096637 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1a94160a00 con 0x7f1a940cb2f0 2023-07-21T22:11:14.660 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.621+0000 7f1a992a2700 1 -- 172.21.15.49:0/50096637 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1a74066320 msgr2=0x7f1a740687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.621+0000 7f1a992a2700 1 --2- 172.21.15.49:0/50096637 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1a74066320 0x7f1a740687d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009bf0 tx=0x7f1a84009240 comp rx=0 tx=0).stop 2023-07-21T22:11:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.621+0000 7f1a992a2700 1 -- 172.21.15.49:0/50096637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a940cb2f0 msgr2=0x7f1a941f5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.621+0000 7f1a992a2700 1 --2- 172.21.15.49:0/50096637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a940cb2f0 0x7f1a941f5670 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00c480 tx=0x7f1a7c00c790 comp rx=0 tx=0).stop 2023-07-21T22:11:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.621+0000 7f1a992a2700 1 -- 172.21.15.49:0/50096637 shutdown_connections 2023-07-21T22:11:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.621+0000 7f1a992a2700 1 --2- 172.21.15.49:0/50096637 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1a74066320 0x7f1a740687d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.621+0000 7f1a992a2700 1 --2- 172.21.15.49:0/50096637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a940cb2f0 0x7f1a941f5670 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.621+0000 7f1a992a2700 1 --2- 172.21.15.49:0/50096637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a94160110 0x7f1a94160ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.621+0000 7f1a992a2700 1 --2- 172.21.15.49:0/50096637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a94071220 0x7f1a9415e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.621+0000 7f1a992a2700 1 -- 172.21.15.49:0/50096637 >> 172.21.15.49:0/50096637 conn(0x7f1a9406e960 msgr2=0x7f1a9406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.621+0000 7f1a992a2700 1 -- 172.21.15.49:0/50096637 shutdown_connections 2023-07-21T22:11:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.621+0000 7f1a992a2700 1 -- 172.21.15.49:0/50096637 wait complete. 2023-07-21T22:11:14.684 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:11:14.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.817+0000 7f3e195ac700 1 Processor -- start 2023-07-21T22:11:14.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.817+0000 7f3e195ac700 1 -- start start 2023-07-21T22:11:14.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.821+0000 7f3e195ac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e14070600 0x7f3e1406d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.821+0000 7f3e195ac700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3e14159c30 0x7f3e140c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.821+0000 7f3e195ac700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e140cba20 con 0x7f3e140cb5d0 2023-07-21T22:11:14.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.821+0000 7f3e195ac700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1415a0b0 con 0x7f3e14159c30 2023-07-21T22:11:14.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.821+0000 7f3e195ac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1406c780 con 0x7f3e14070600 2023-07-21T22:11:14.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.821+0000 7f3e127fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3e140cb5d0 0x7f3e140709d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:32802/0 (socket says 172.21.15.49:32802) 2023-07-21T22:11:14.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.821+0000 7f3e127fc700 1 -- 172.21.15.49:0/2647304196 learned_addr learned my addr 172.21.15.49:0/2647304196 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:14.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e137fe700 1 --2- 172.21.15.49:0/2647304196 >> v2:172.21.15.150:3300/0 conn(0x7f3e14159c30 0x7f3e140c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e12ffd700 1 --2- 172.21.15.49:0/2647304196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e14070600 0x7f3e1406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e11ffb700 1 -- 172.21.15.49:0/2647304196 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019195649 0 0) 0x7f3e140cba20 con 0x7f3e140cb5d0 2023-07-21T22:11:14.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e137fe700 1 -- 172.21.15.49:0/2647304196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e14070600 msgr2=0x7f3e1406d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:14.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e137fe700 1 --2- 172.21.15.49:0/2647304196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e14070600 0x7f3e1406d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e137fe700 1 -- 172.21.15.49:0/2647304196 >> v1:172.21.15.49:6789/0 conn(0x7f3e140cb5d0 legacy=0x7f3e140709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e137fe700 1 -- 172.21.15.49:0/2647304196 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1406ca60 con 0x7f3e14159c30 2023-07-21T22:11:14.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e137fe700 1 --2- 172.21.15.49:0/2647304196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e14159c30 0x7f3e140c87f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009d90 tx=0x7f3e0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cb6ce791881a3cb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:14.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e11ffb700 1 -- 172.21.15.49:0/2647304196 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00e070 con 0x7f3e14159c30 2023-07-21T22:11:14.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e11ffb700 1 -- 172.21.15.49:0/2647304196 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c00bb20 con 0x7f3e14159c30 2023-07-21T22:11:14.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e11ffb700 1 -- 172.21.15.49:0/2647304196 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c012430 con 0x7f3e14159c30 2023-07-21T22:11:14.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e195ac700 1 -- 172.21.15.49:0/2647304196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e14159c30 msgr2=0x7f3e140c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e195ac700 1 --2- 172.21.15.49:0/2647304196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e14159c30 0x7f3e140c87f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009d90 tx=0x7f3e0c00b330 comp rx=0 tx=0).stop 2023-07-21T22:11:14.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e195ac700 1 -- 172.21.15.49:0/2647304196 shutdown_connections 2023-07-21T22:11:14.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e195ac700 1 --2- 172.21.15.49:0/2647304196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e14159c30 0x7f3e140c87f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e195ac700 1 --2- 172.21.15.49:0/2647304196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e14070600 0x7f3e1406d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e195ac700 1 -- 172.21.15.49:0/2647304196 >> 172.21.15.49:0/2647304196 conn(0x7f3e1406f5a0 msgr2=0x7f3e140cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:14.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e195ac700 1 -- 172.21.15.49:0/2647304196 shutdown_connections 2023-07-21T22:11:14.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.825+0000 7f3e195ac700 1 -- 172.21.15.49:0/2647304196 wait complete. 2023-07-21T22:11:14.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.829+0000 7f3e195ac700 1 Processor -- start 2023-07-21T22:11:14.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.829+0000 7f3e195ac700 1 -- start start 2023-07-21T22:11:14.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.829+0000 7f3e195ac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e14070600 0x7f3e140acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.829+0000 7f3e195ac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e140cb5d0 0x7f3e140ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.829+0000 7f3e195ac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e14159c30 0x7f3e141f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.829+0000 7f3e195ac700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e140ce8e0 con 0x7f3e140cb5d0 2023-07-21T22:11:14.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.829+0000 7f3e195ac700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e140ada00 con 0x7f3e14070600 2023-07-21T22:11:14.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.829+0000 7f3e195ac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e140b3cb0 con 0x7f3e14159c30 2023-07-21T22:11:14.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3e127fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e140cb5d0 0x7f3e140ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3e127fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e140cb5d0 0x7f3e140ae4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60406/0 (socket says 172.21.15.49:60406) 2023-07-21T22:11:14.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3e127fc700 1 -- 172.21.15.49:0/834015828 learned_addr learned my addr 172.21.15.49:0/834015828 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:14.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3e12ffd700 1 --2- 172.21.15.49:0/834015828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e14070600 0x7f3e140acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3e137fe700 1 --2- 172.21.15.49:0/834015828 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e14159c30 0x7f3e141f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3e127fc700 1 -- 172.21.15.49:0/834015828 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e14159c30 msgr2=0x7f3e141f1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3e127fc700 1 --2- 172.21.15.49:0/834015828 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e14159c30 0x7f3e141f1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3e127fc700 1 -- 172.21.15.49:0/834015828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e14070600 msgr2=0x7f3e140acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:14.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3e127fc700 1 --2- 172.21.15.49:0/834015828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e14070600 0x7f3e140acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:14.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3e127fc700 1 -- 172.21.15.49:0/834015828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c009a70 con 0x7f3e140cb5d0 2023-07-21T22:11:14.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3e127fc700 1 --2- 172.21.15.49:0/834015828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e140cb5d0 0x7f3e140ae4a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800c580 tx=0x7f3e0800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:14.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3dfb7fe700 1 -- 172.21.15.49:0/834015828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e08004ca0 con 0x7f3e140cb5d0 2023-07-21T22:11:14.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3dfb7fe700 1 -- 172.21.15.49:0/834015828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e08004e00 con 0x7f3e140cb5d0 2023-07-21T22:11:14.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3dfb7fe700 1 -- 172.21.15.49:0/834015828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e080072f0 con 0x7f3e140cb5d0 2023-07-21T22:11:14.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3e195ac700 1 -- 172.21.15.49:0/834015828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e141f28a0 con 0x7f3e140cb5d0 2023-07-21T22:11:14.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.833+0000 7f3e195ac700 1 -- 172.21.15.49:0/834015828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e140adcc0 con 0x7f3e140cb5d0 2023-07-21T22:11:14.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.837+0000 7f3e195ac700 1 -- 172.21.15.49:0/834015828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1404dcb0 con 0x7f3e140cb5d0 2023-07-21T22:11:14.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.837+0000 7f3dfb7fe700 1 -- 172.21.15.49:0/834015828 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3e08007450 con 0x7f3e140cb5d0 2023-07-21T22:11:14.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.841+0000 7f3dfb7fe700 1 --2- 172.21.15.49:0/834015828 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3e000662f0 0x7f3e000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:14.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.841+0000 7f3dfb7fe700 1 -- 172.21.15.49:0/834015828 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3e08083db0 con 0x7f3e140cb5d0 2023-07-21T22:11:14.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.841+0000 7f3e12ffd700 1 --2- 172.21.15.49:0/834015828 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3e000662f0 0x7f3e000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:14.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.841+0000 7f3e12ffd700 1 --2- 172.21.15.49:0/834015828 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3e000662f0 0x7f3e000687a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009bf0 tx=0x7f3e04009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:14.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:14.845+0000 7f3dfb7fe700 1 -- 172.21.15.49:0/834015828 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3e08088070 con 0x7f3e140cb5d0 2023-07-21T22:11:15.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.053+0000 7f3e195ac700 1 -- 172.21.15.49:0/834015828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e14158720 con 0x7f3e140cb5d0 2023-07-21T22:11:15.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.053+0000 7f3dfb7fe700 1 -- 172.21.15.49:0/834015828 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f3e08050ea0 con 0x7f3e140cb5d0 2023-07-21T22:11:15.098 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:15.099 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/1894793298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1894793298},{"type":"v1","addr":"172.21.15.150:6833","nonce":1894793298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1984862419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1984862419},{"type":"v1","addr":"172.21.15.49:6836","nonce":1984862419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1331451608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1331451608},{"type":"v1","addr":"172.21.15.49:6837","nonce":1331451608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:10:34.629989+0000","modified":"2023-07-21T22:11:01.997441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2478678672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2478678672},{"type":"v1","addr":"172.21.15.150:6835","nonce":2478678672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:11:15.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.057+0000 7f3e195ac700 1 -- 172.21.15.49:0/834015828 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3e000662f0 msgr2=0x7f3e000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:15.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.057+0000 7f3e195ac700 1 --2- 172.21.15.49:0/834015828 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3e000662f0 0x7f3e000687a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009bf0 tx=0x7f3e04009240 comp rx=0 tx=0).stop 2023-07-21T22:11:15.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.057+0000 7f3e195ac700 1 -- 172.21.15.49:0/834015828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e140cb5d0 msgr2=0x7f3e140ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:15.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.057+0000 7f3e195ac700 1 --2- 172.21.15.49:0/834015828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e140cb5d0 0x7f3e140ae4a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800c580 tx=0x7f3e0800c890 comp rx=0 tx=0).stop 2023-07-21T22:11:15.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.057+0000 7f3e195ac700 1 -- 172.21.15.49:0/834015828 shutdown_connections 2023-07-21T22:11:15.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.057+0000 7f3e195ac700 1 --2- 172.21.15.49:0/834015828 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3e000662f0 0x7f3e000687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.057+0000 7f3e195ac700 1 --2- 172.21.15.49:0/834015828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e140cb5d0 0x7f3e140ae4a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.057+0000 7f3e195ac700 1 --2- 172.21.15.49:0/834015828 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e14159c30 0x7f3e141f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.057+0000 7f3e195ac700 1 --2- 172.21.15.49:0/834015828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e14070600 0x7f3e140acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.057+0000 7f3e195ac700 1 -- 172.21.15.49:0/834015828 >> 172.21.15.49:0/834015828 conn(0x7f3e1406f5a0 msgr2=0x7f3e1406d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:15.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.057+0000 7f3e195ac700 1 -- 172.21.15.49:0/834015828 shutdown_connections 2023-07-21T22:11:15.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.057+0000 7f3e195ac700 1 -- 172.21.15.49:0/834015828 wait complete. 2023-07-21T22:11:15.104 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2023-07-21T22:11:15.124 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:15.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.257+0000 7fd135984700 1 Processor -- start 2023-07-21T22:11:15.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.257+0000 7fd135984700 1 -- start start 2023-07-21T22:11:15.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.257+0000 7fd135984700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd130160370 0x7fd13006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:15.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.257+0000 7fd135984700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd1300c1470 0x7fd1300c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:15.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.257+0000 7fd135984700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13006e010 con 0x7fd1300ca2c0 2023-07-21T22:11:15.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.257+0000 7fd135984700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd130160740 con 0x7fd1300c1470 2023-07-21T22:11:15.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.257+0000 7fd135984700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300ccc50 con 0x7fd130160370 2023-07-21T22:11:15.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.257+0000 7fd12ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd1300c1470 0x7fd1300c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:15.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.257+0000 7fd135183700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd1300ca2c0 0x7fd1300caa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:39588/0 (socket says 172.21.15.49:39588) 2023-07-21T22:11:15.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.257+0000 7fd135183700 1 -- 172.21.15.49:0/2612085593 learned_addr learned my addr 172.21.15.49:0/2612085593 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:15.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.257+0000 7fd134982700 1 --2- 172.21.15.49:0/2612085593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd130160370 0x7fd13006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:15.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd12f7fe700 1 -- 172.21.15.49:0/2612085593 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788230589 0 0) 0x7fd13006e010 con 0x7fd1300ca2c0 2023-07-21T22:11:15.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd12f7fe700 1 -- 172.21.15.49:0/2612085593 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1200035d0 con 0x7fd1300ca2c0 2023-07-21T22:11:15.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd134982700 1 -- 172.21.15.49:0/2612085593 >> v2:172.21.15.49:3300/0 conn(0x7fd1300c1470 msgr2=0x7fd1300c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:15.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd134982700 1 --2- 172.21.15.49:0/2612085593 >> v2:172.21.15.49:3300/0 conn(0x7fd1300c1470 0x7fd1300c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd134982700 1 -- 172.21.15.49:0/2612085593 >> v1:172.21.15.150:6789/0 conn(0x7fd1300ca2c0 legacy=0x7fd1300caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:15.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd134982700 1 -- 172.21.15.49:0/2612085593 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1300afc90 con 0x7fd130160370 2023-07-21T22:11:15.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd12ffff700 1 --2- 172.21.15.49:0/2612085593 >> v2:172.21.15.49:3300/0 conn(0x7fd1300c1470 0x7fd1300c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:15.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd134982700 1 --2- 172.21.15.49:0/2612085593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd130160370 0x7fd13006d7e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd124009850 tx=0x7fd124009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=987826fd0eb12412 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:15.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd12f7fe700 1 -- 172.21.15.49:0/2612085593 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124011830 con 0x7fd130160370 2023-07-21T22:11:15.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd12f7fe700 1 -- 172.21.15.49:0/2612085593 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd124011990 con 0x7fd130160370 2023-07-21T22:11:15.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd12f7fe700 1 -- 172.21.15.49:0/2612085593 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124011d00 con 0x7fd130160370 2023-07-21T22:11:15.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd135984700 1 -- 172.21.15.49:0/2612085593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd130160370 msgr2=0x7fd13006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:15.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd135984700 1 --2- 172.21.15.49:0/2612085593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd130160370 0x7fd13006d7e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd124009850 tx=0x7fd124009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:15.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd135984700 1 -- 172.21.15.49:0/2612085593 shutdown_connections 2023-07-21T22:11:15.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd135984700 1 --2- 172.21.15.49:0/2612085593 >> v2:172.21.15.49:3300/0 conn(0x7fd1300c1470 0x7fd1300c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd135984700 1 --2- 172.21.15.49:0/2612085593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd130160370 0x7fd13006d7e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd135984700 1 -- 172.21.15.49:0/2612085593 >> 172.21.15.49:0/2612085593 conn(0x7fd130070450 msgr2=0x7fd130070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:15.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd135984700 1 -- 172.21.15.49:0/2612085593 shutdown_connections 2023-07-21T22:11:15.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.261+0000 7fd135984700 1 -- 172.21.15.49:0/2612085593 wait complete. 2023-07-21T22:11:15.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.265+0000 7fd135984700 1 Processor -- start 2023-07-21T22:11:15.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.265+0000 7fd135984700 1 -- start start 2023-07-21T22:11:15.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd135984700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1300c1470 0x7fd1301515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:15.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd135984700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1300ca2c0 0x7fd1300b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:15.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd135984700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd130160370 0x7fd1301f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:15.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd135984700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300b13e0 con 0x7fd1300ca2c0 2023-07-21T22:11:15.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd135984700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1301f59a0 con 0x7fd1300c1470 2023-07-21T22:11:15.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd135984700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300b1680 con 0x7fd130160370 2023-07-21T22:11:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd12ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1300ca2c0 0x7fd1300b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd12ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1300ca2c0 0x7fd1300b0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60424/0 (socket says 172.21.15.49:60424) 2023-07-21T22:11:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd12ffff700 1 -- 172.21.15.49:0/3363254664 learned_addr learned my addr 172.21.15.49:0/3363254664 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd135183700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd130160370 0x7fd1301f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd134982700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1300c1470 0x7fd1301515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd12ffff700 1 -- 172.21.15.49:0/3363254664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd130160370 msgr2=0x7fd1301f5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:15.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd12ffff700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd130160370 0x7fd1301f5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd12ffff700 1 -- 172.21.15.49:0/3363254664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1300c1470 msgr2=0x7fd1301515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:15.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd12ffff700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1300c1470 0x7fd1301515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd12ffff700 1 -- 172.21.15.49:0/3363254664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c0094b0 con 0x7fd1300ca2c0 2023-07-21T22:11:15.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd135183700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd130160370 0x7fd1301f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:15.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd134982700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1300c1470 0x7fd1301515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:15.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd12ffff700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1300ca2c0 0x7fd1300b0ea0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd11c00ebe0 tx=0x7fd11c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:15.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd12d7fa700 1 -- 172.21.15.49:0/3363254664 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c00c850 con 0x7fd1300ca2c0 2023-07-21T22:11:15.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd12d7fa700 1 -- 172.21.15.49:0/3363254664 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c00c9b0 con 0x7fd1300ca2c0 2023-07-21T22:11:15.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd12d7fa700 1 -- 172.21.15.49:0/3363254664 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c00cd40 con 0x7fd1300ca2c0 2023-07-21T22:11:15.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.269+0000 7fd135984700 1 -- 172.21.15.49:0/3363254664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1240094b0 con 0x7fd1300ca2c0 2023-07-21T22:11:15.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.273+0000 7fd135984700 1 -- 172.21.15.49:0/3363254664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1300b1c40 con 0x7fd1300ca2c0 2023-07-21T22:11:15.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.273+0000 7fd135984700 1 -- 172.21.15.49:0/3363254664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13004dcb0 con 0x7fd1300ca2c0 2023-07-21T22:11:15.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.273+0000 7fd12d7fa700 1 -- 172.21.15.49:0/3363254664 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd11c013470 con 0x7fd1300ca2c0 2023-07-21T22:11:15.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.277+0000 7fd12d7fa700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd1140662f0 0x7fd1140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:15.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.277+0000 7fd12d7fa700 1 -- 172.21.15.49:0/3363254664 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd11c084140 con 0x7fd1300ca2c0 2023-07-21T22:11:15.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.277+0000 7fd134982700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd1140662f0 0x7fd1140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:15.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.281+0000 7fd134982700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd1140662f0 0x7fd1140687a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1240090b0 tx=0x7fd124008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:15.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.285+0000 7fd12d7fa700 1 -- 172.21.15.49:0/3363254664 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd11c0511f0 con 0x7fd1300ca2c0 2023-07-21T22:11:15.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.465+0000 7fd135984700 1 -- 172.21.15.49:0/3363254664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1300ad7b0 con 0x7fd1300ca2c0 2023-07-21T22:11:15.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.469+0000 7fd12d7fa700 1 -- 172.21.15.49:0/3363254664 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20179 (secure 0 0 0) 0x7fd11c00cea0 con 0x7fd1300ca2c0 2023-07-21T22:11:15.511 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:15.511 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":31,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:15.089557+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.469+0000 7fd135984700 1 -- 172.21.15.49:0/3363254664 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd1140662f0 msgr2=0x7fd1140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.469+0000 7fd135984700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd1140662f0 0x7fd1140687a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1240090b0 tx=0x7fd124008030 comp rx=0 tx=0).stop 2023-07-21T22:11:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.469+0000 7fd135984700 1 -- 172.21.15.49:0/3363254664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1300ca2c0 msgr2=0x7fd1300b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.469+0000 7fd135984700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1300ca2c0 0x7fd1300b0ea0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd11c00ebe0 tx=0x7fd11c00eef0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.469+0000 7fd135984700 1 -- 172.21.15.49:0/3363254664 shutdown_connections 2023-07-21T22:11:15.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.469+0000 7fd135984700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd1140662f0 0x7fd1140687a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.469+0000 7fd135984700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1300ca2c0 0x7fd1300b0ea0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.469+0000 7fd135984700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd130160370 0x7fd1301f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.469+0000 7fd135984700 1 --2- 172.21.15.49:0/3363254664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1300c1470 0x7fd1301515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.469+0000 7fd135984700 1 -- 172.21.15.49:0/3363254664 >> 172.21.15.49:0/3363254664 conn(0x7fd130070450 msgr2=0x7fd1300caa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:15.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.469+0000 7fd135984700 1 -- 172.21.15.49:0/3363254664 shutdown_connections 2023-07-21T22:11:15.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.469+0000 7fd135984700 1 -- 172.21.15.49:0/3363254664 wait complete. 2023-07-21T22:11:15.536 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:11:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.669+0000 7fcb4b59e700 1 Processor -- start 2023-07-21T22:11:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.669+0000 7fcb4b59e700 1 -- start start 2023-07-21T22:11:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.673+0000 7fcb4b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb4c158c00 0x7fcb4c15d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.673+0000 7fcb4b59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb4c06da70 0x7fcb4c06c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.673+0000 7fcb4b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4c158fd0 con 0x7fcb4c0c90d0 2023-07-21T22:11:15.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.673+0000 7fcb4b59e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4c06d650 con 0x7fcb4c06da70 2023-07-21T22:11:15.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.673+0000 7fcb4b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c06c9d0 con 0x7fcb4c158c00 2023-07-21T22:11:15.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb4a59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb4c158c00 0x7fcb4c15d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:15.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb4a59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb4c158c00 0x7fcb4c15d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:42710/0 (socket says 172.21.15.49:42710) 2023-07-21T22:11:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb4a59c700 1 -- 172.21.15.49:0/4184854889 learned_addr learned my addr 172.21.15.49:0/4184854889 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb49d9b700 1 --2- 172.21.15.49:0/4184854889 >> v2:172.21.15.49:3300/0 conn(0x7fcb4c06da70 0x7fcb4c06c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb49d9b700 1 -- 172.21.15.49:0/4184854889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb4c158c00 msgr2=0x7fcb4c15d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb49d9b700 1 --2- 172.21.15.49:0/4184854889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb4c158c00 0x7fcb4c15d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb49d9b700 1 -- 172.21.15.49:0/4184854889 >> v1:172.21.15.150:6789/0 conn(0x7fcb4c0c90d0 legacy=0x7fcb4c0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:15.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb49d9b700 1 -- 172.21.15.49:0/4184854889 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c06ccb0 con 0x7fcb4c06da70 2023-07-21T22:11:15.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb49d9b700 1 --2- 172.21.15.49:0/4184854889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb4c06da70 0x7fcb4c06c180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009850 tx=0x7fcb40009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f843256d1f93aaf2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:15.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb4959a700 1 -- 172.21.15.49:0/4184854889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40011830 con 0x7fcb4c06da70 2023-07-21T22:11:15.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb4959a700 1 -- 172.21.15.49:0/4184854889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb40011990 con 0x7fcb4c06da70 2023-07-21T22:11:15.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb4959a700 1 -- 172.21.15.49:0/4184854889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40011d40 con 0x7fcb4c06da70 2023-07-21T22:11:15.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb4b59e700 1 -- 172.21.15.49:0/4184854889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb4c06da70 msgr2=0x7fcb4c06c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:15.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb4b59e700 1 --2- 172.21.15.49:0/4184854889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb4c06da70 0x7fcb4c06c180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009850 tx=0x7fcb40009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:15.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb4b59e700 1 -- 172.21.15.49:0/4184854889 shutdown_connections 2023-07-21T22:11:15.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb4b59e700 1 --2- 172.21.15.49:0/4184854889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb4c06da70 0x7fcb4c06c180 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb4b59e700 1 --2- 172.21.15.49:0/4184854889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb4c158c00 0x7fcb4c15d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.677+0000 7fcb4b59e700 1 -- 172.21.15.49:0/4184854889 >> 172.21.15.49:0/4184854889 conn(0x7fcb4c070450 msgr2=0x7fcb4c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:15.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.681+0000 7fcb4b59e700 1 -- 172.21.15.49:0/4184854889 shutdown_connections 2023-07-21T22:11:15.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.681+0000 7fcb4b59e700 1 -- 172.21.15.49:0/4184854889 wait complete. 2023-07-21T22:11:15.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.681+0000 7fcb4b59e700 1 Processor -- start 2023-07-21T22:11:15.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.681+0000 7fcb4b59e700 1 -- start start 2023-07-21T22:11:15.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb4c06da70 0x7fcb4c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:15.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb4c0c90d0 0x7fcb4c0c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:15.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb4c158c00 0x7fcb4c1f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:15.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4b59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0c8b50 con 0x7fcb4c158c00 2023-07-21T22:11:15.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c154d20 con 0x7fcb4c0c90d0 2023-07-21T22:11:15.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c1f7200 con 0x7fcb4c06da70 2023-07-21T22:11:15.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb4c158c00 0x7fcb4c1f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:15.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb4c158c00 0x7fcb4c1f6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60436/0 (socket says 172.21.15.49:60436) 2023-07-21T22:11:15.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb49d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb4c0c90d0 0x7fcb4c0c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:15.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4ad9d700 1 -- 172.21.15.49:0/3120439253 learned_addr learned my addr 172.21.15.49:0/3120439253 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:15.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4a59c700 1 --2- 172.21.15.49:0/3120439253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb4c06da70 0x7fcb4c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:15.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4ad9d700 1 -- 172.21.15.49:0/3120439253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb4c06da70 msgr2=0x7fcb4c0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:15.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4ad9d700 1 --2- 172.21.15.49:0/3120439253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb4c06da70 0x7fcb4c0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4ad9d700 1 -- 172.21.15.49:0/3120439253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb4c0c90d0 msgr2=0x7fcb4c0c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:15.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4ad9d700 1 --2- 172.21.15.49:0/3120439253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb4c0c90d0 0x7fcb4c0c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4ad9d700 1 -- 172.21.15.49:0/3120439253 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb400094b0 con 0x7fcb4c158c00 2023-07-21T22:11:15.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb49d9b700 1 --2- 172.21.15.49:0/3120439253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb4c0c90d0 0x7fcb4c0c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4ad9d700 1 --2- 172.21.15.49:0/3120439253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb4c158c00 0x7fcb4c1f6cc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400cb50 tx=0x7fcb4400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb3affd700 1 -- 172.21.15.49:0/3120439253 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44003c20 con 0x7fcb4c158c00 2023-07-21T22:11:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb3affd700 1 -- 172.21.15.49:0/3120439253 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb44003d80 con 0x7fcb4c158c00 2023-07-21T22:11:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4b59e700 1 -- 172.21.15.49:0/3120439253 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c0c2e00 con 0x7fcb4c158c00 2023-07-21T22:11:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb3affd700 1 -- 172.21.15.49:0/3120439253 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400aa20 con 0x7fcb4c158c00 2023-07-21T22:11:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.685+0000 7fcb4b59e700 1 -- 172.21.15.49:0/3120439253 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c0c36a0 con 0x7fcb4c158c00 2023-07-21T22:11:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.689+0000 7fcb4b59e700 1 -- 172.21.15.49:0/3120439253 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4c0c3830 con 0x7fcb4c158c00 2023-07-21T22:11:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.689+0000 7fcb3affd700 1 -- 172.21.15.49:0/3120439253 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcb4400ab80 con 0x7fcb4c158c00 2023-07-21T22:11:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.693+0000 7fcb3affd700 1 --2- 172.21.15.49:0/3120439253 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb2c066320 0x7fcb2c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:15.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.693+0000 7fcb3affd700 1 -- 172.21.15.49:0/3120439253 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcb44084020 con 0x7fcb4c158c00 2023-07-21T22:11:15.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.693+0000 7fcb4a59c700 1 --2- 172.21.15.49:0/3120439253 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb2c066320 0x7fcb2c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:15.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.693+0000 7fcb4a59c700 1 --2- 172.21.15.49:0/3120439253 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb2c066320 0x7fcb2c0687d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00b260 tx=0x7fcb3c00b4f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:15.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.697+0000 7fcb3affd700 1 -- 172.21.15.49:0/3120439253 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb44051180 con 0x7fcb4c158c00 2023-07-21T22:11:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.901+0000 7fcb4b59e700 1 -- 172.21.15.49:0/3120439253 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb4c155cd0 con 0x7fcb4c158c00 2023-07-21T22:11:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.905+0000 7fcb3affd700 1 -- 172.21.15.49:0/3120439253 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fcb440547a0 con 0x7fcb4c158c00 2023-07-21T22:11:15.949 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:15.949 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/1894793298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1894793298},{"type":"v1","addr":"172.21.15.150:6833","nonce":1894793298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1984862419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1984862419},{"type":"v1","addr":"172.21.15.49:6836","nonce":1984862419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1331451608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1331451608},{"type":"v1","addr":"172.21.15.49:6837","nonce":1331451608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:10:34.629989+0000","modified":"2023-07-21T22:11:01.997441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2478678672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2478678672},{"type":"v1","addr":"172.21.15.150:6835","nonce":2478678672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:11:15.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.909+0000 7fcb4b59e700 1 -- 172.21.15.49:0/3120439253 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb2c066320 msgr2=0x7fcb2c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:15.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.909+0000 7fcb4b59e700 1 --2- 172.21.15.49:0/3120439253 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb2c066320 0x7fcb2c0687d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00b260 tx=0x7fcb3c00b4f0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.909+0000 7fcb4b59e700 1 -- 172.21.15.49:0/3120439253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb4c158c00 msgr2=0x7fcb4c1f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.909+0000 7fcb4b59e700 1 --2- 172.21.15.49:0/3120439253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb4c158c00 0x7fcb4c1f6cc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400cb50 tx=0x7fcb4400ce60 comp rx=0 tx=0).stop 2023-07-21T22:11:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.909+0000 7fcb4b59e700 1 -- 172.21.15.49:0/3120439253 shutdown_connections 2023-07-21T22:11:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.909+0000 7fcb4b59e700 1 --2- 172.21.15.49:0/3120439253 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb2c066320 0x7fcb2c0687d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.909+0000 7fcb4b59e700 1 --2- 172.21.15.49:0/3120439253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb4c158c00 0x7fcb4c1f6cc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.909+0000 7fcb4b59e700 1 --2- 172.21.15.49:0/3120439253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb4c0c90d0 0x7fcb4c0c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.909+0000 7fcb4b59e700 1 --2- 172.21.15.49:0/3120439253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb4c06da70 0x7fcb4c0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.909+0000 7fcb4b59e700 1 -- 172.21.15.49:0/3120439253 >> 172.21.15.49:0/3120439253 conn(0x7fcb4c070450 msgr2=0x7fcb4c15b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.909+0000 7fcb4b59e700 1 -- 172.21.15.49:0/3120439253 shutdown_connections 2023-07-21T22:11:15.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:15.909+0000 7fcb4b59e700 1 -- 172.21.15.49:0/3120439253 wait complete. 2023-07-21T22:11:15.954 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2023-07-21T22:11:16.374 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:10:34.629989+0000', 'modified': '2023-07-21T22:11:01.997441+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/2478678672', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 2478678672}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 2478678672}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:11:16.374 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:11:16.375 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-21T22:11:16.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.517+0000 7f1819d4c700 1 Processor -- start 2023-07-21T22:11:16.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.517+0000 7f1819d4c700 1 -- start start 2023-07-21T22:11:16.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.517+0000 7f1819d4c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18140c1470 0x7f18140c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.517+0000 7f1819d4c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181406e010 con 0x7f18140ca2c0 2023-07-21T22:11:16.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.517+0000 7f1819d4c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1814160740 con 0x7f1814160370 2023-07-21T22:11:16.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.517+0000 7f1819d4c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18140ccc50 con 0x7f18140c1470 2023-07-21T22:11:16.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f1813fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18140c1470 0x7f18140c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f1813fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18140c1470 0x7f18140c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60448/0 (socket says 172.21.15.49:60448) 2023-07-21T22:11:16.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f1813fff700 1 -- 172.21.15.49:0/2214893330 learned_addr learned my addr 172.21.15.49:0/2214893330 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:16.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f1813fff700 1 -- 172.21.15.49:0/2214893330 >> v1:172.21.15.150:6789/0 conn(0x7f1814160370 legacy=0x7f181406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:16.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f1813fff700 1 -- 172.21.15.49:0/2214893330 >> v1:172.21.15.49:6789/0 conn(0x7f18140ca2c0 legacy=0x7f1814163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:16.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f1813fff700 1 -- 172.21.15.49:0/2214893330 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18140afc90 con 0x7f18140c1470 2023-07-21T22:11:16.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f1813fff700 1 --2- 172.21.15.49:0/2214893330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18140c1470 0x7f18140c9d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1800009910 tx=0x7f1800009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19635a072e0095e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:16.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f18137fe700 1 -- 172.21.15.49:0/2214893330 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180000ba60 con 0x7f18140c1470 2023-07-21T22:11:16.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f18137fe700 1 -- 172.21.15.49:0/2214893330 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180000bbc0 con 0x7f18140c1470 2023-07-21T22:11:16.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f18137fe700 1 -- 172.21.15.49:0/2214893330 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800009e60 con 0x7f18140c1470 2023-07-21T22:11:16.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f1819d4c700 1 -- 172.21.15.49:0/2214893330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18140c1470 msgr2=0x7f18140c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:16.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f1819d4c700 1 --2- 172.21.15.49:0/2214893330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18140c1470 0x7f18140c9d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1800009910 tx=0x7f1800009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:16.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f1819d4c700 1 -- 172.21.15.49:0/2214893330 shutdown_connections 2023-07-21T22:11:16.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f1819d4c700 1 --2- 172.21.15.49:0/2214893330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18140c1470 0x7f18140c9d80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f1819d4c700 1 -- 172.21.15.49:0/2214893330 >> 172.21.15.49:0/2214893330 conn(0x7f1814070450 msgr2=0x7f1814070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:16.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f1819d4c700 1 -- 172.21.15.49:0/2214893330 shutdown_connections 2023-07-21T22:11:16.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.521+0000 7f1819d4c700 1 -- 172.21.15.49:0/2214893330 wait complete. 2023-07-21T22:11:16.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.525+0000 7f1819d4c700 1 Processor -- start 2023-07-21T22:11:16.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.525+0000 7f1819d4c700 1 -- start start 2023-07-21T22:11:16.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f1819d4c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18140c1470 0x7f181415e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f1819d4c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18140ca2c0 0x7f18140c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f1819d4c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1814160370 0x7f18140b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f1819d4c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18140c6fc0 con 0x7f1814160370 2023-07-21T22:11:16.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f1819d4c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18140c4aa0 con 0x7f18140c1470 2023-07-21T22:11:16.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f1819d4c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18140c6970 con 0x7f18140ca2c0 2023-07-21T22:11:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f181954b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1814160370 0x7f18140b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f181954b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1814160370 0x7f18140b3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60464/0 (socket says 172.21.15.49:60464) 2023-07-21T22:11:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f181954b700 1 -- 172.21.15.49:0/1569959612 learned_addr learned my addr 172.21.15.49:0/1569959612 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f1818d4a700 1 --2- 172.21.15.49:0/1569959612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18140c1470 0x7f181415e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f1813fff700 1 --2- 172.21.15.49:0/1569959612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18140ca2c0 0x7f18140c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f181954b700 1 -- 172.21.15.49:0/1569959612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18140ca2c0 msgr2=0x7f18140c2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f181954b700 1 --2- 172.21.15.49:0/1569959612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18140ca2c0 0x7f18140c2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f181954b700 1 -- 172.21.15.49:0/1569959612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18140c1470 msgr2=0x7f181415e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f181954b700 1 --2- 172.21.15.49:0/1569959612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18140c1470 0x7f181415e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f181954b700 1 -- 172.21.15.49:0/1569959612 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1800009570 con 0x7f1814160370 2023-07-21T22:11:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f181954b700 1 --2- 172.21.15.49:0/1569959612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1814160370 0x7f18140b3070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f180c00cc50 tx=0x7f180c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:16.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f18117fa700 1 -- 172.21.15.49:0/1569959612 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c003c20 con 0x7f1814160370 2023-07-21T22:11:16.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f18117fa700 1 -- 172.21.15.49:0/1569959612 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c003d80 con 0x7f1814160370 2023-07-21T22:11:16.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.529+0000 7f1819d4c700 1 -- 172.21.15.49:0/1569959612 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18140c6c50 con 0x7f1814160370 2023-07-21T22:11:16.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.533+0000 7f18117fa700 1 -- 172.21.15.49:0/1569959612 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c00aab0 con 0x7f1814160370 2023-07-21T22:11:16.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.533+0000 7f1819d4c700 1 -- 172.21.15.49:0/1569959612 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18140c4750 con 0x7f1814160370 2023-07-21T22:11:16.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.537+0000 7f18117fa700 1 -- 172.21.15.49:0/1569959612 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f180c00ac10 con 0x7f1814160370 2023-07-21T22:11:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.537+0000 7f18117fa700 1 --2- 172.21.15.49:0/1569959612 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17f80662f0 0x7f17f80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.537+0000 7f18117fa700 1 -- 172.21.15.49:0/1569959612 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f180c0840a0 con 0x7f1814160370 2023-07-21T22:11:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.537+0000 7f1818d4a700 1 --2- 172.21.15.49:0/1569959612 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17f80662f0 0x7f17f80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.537+0000 7f181e23c740 1 Processor -- start 2023-07-21T22:11:16.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.537+0000 7f1818d4a700 1 --2- 172.21.15.49:0/1569959612 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17f80662f0 0x7f17f80687a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1808000f60 tx=0x7f1808009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:16.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.537+0000 7f181e23c740 1 -- start start 2023-07-21T22:11:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f181e23c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9eb0 0x1992840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f181e23c740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9ae0 0x1992d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f181e23c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x1947d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f181e23c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1866270 con 0x16d9eb0 2023-07-21T22:11:16.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f181e23c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x18b93a0 con 0x16d9710 2023-07-21T22:11:16.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f181e23c740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x18b2600 con 0x16d9ae0 2023-07-21T22:11:16.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f1818d4a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9eb0 0x1992840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f1818d4a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9eb0 0x1992840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60476/0 (socket says 172.21.15.49:60476) 2023-07-21T22:11:16.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f1818d4a700 1 -- 172.21.15.49:0/3113813952 learned_addr learned my addr 172.21.15.49:0/3113813952 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f181954b700 1 --2- 172.21.15.49:0/3113813952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x1947d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f1813fff700 1 --2- 172.21.15.49:0/3113813952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9ae0 0x1992d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f1818d4a700 1 -- 172.21.15.49:0/3113813952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9ae0 msgr2=0x1992d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f1818d4a700 1 --2- 172.21.15.49:0/3113813952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9ae0 0x1992d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f1818d4a700 1 -- 172.21.15.49:0/3113813952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 msgr2=0x1947d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f1818d4a700 1 --2- 172.21.15.49:0/3113813952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x1947d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f1818d4a700 1 -- 172.21.15.49:0/3113813952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x17259e0 con 0x16d9eb0 2023-07-21T22:11:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f1813fff700 1 --2- 172.21.15.49:0/3113813952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9ae0 0x1992d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f1818d4a700 1 --2- 172.21.15.49:0/3113813952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9eb0 0x1992840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f180800f750 tx=0x7f1808012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b588a489e5b4f54a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f17fe7fc700 1 -- 172.21.15.49:0/3113813952 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180800fed0 con 0x16d9eb0 2023-07-21T22:11:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f17fe7fc700 1 -- 172.21.15.49:0/3113813952 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1808014450 con 0x16d9eb0 2023-07-21T22:11:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.541+0000 7f17fe7fc700 1 -- 172.21.15.49:0/3113813952 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18080147c0 con 0x16d9eb0 2023-07-21T22:11:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.545+0000 7f181e23c740 1 -- 172.21.15.49:0/3113813952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9eb0 msgr2=0x1992840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.545+0000 7f181e23c740 1 --2- 172.21.15.49:0/3113813952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9eb0 0x1992840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f180800f750 tx=0x7f1808012000 comp rx=0 tx=0).stop 2023-07-21T22:11:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.545+0000 7f181e23c740 1 -- 172.21.15.49:0/3113813952 shutdown_connections 2023-07-21T22:11:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.545+0000 7f181e23c740 1 --2- 172.21.15.49:0/3113813952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x1947d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.545+0000 7f181e23c740 1 --2- 172.21.15.49:0/3113813952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9ae0 0x1992d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.545+0000 7f181e23c740 1 --2- 172.21.15.49:0/3113813952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9eb0 0x1992840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.545+0000 7f181e23c740 1 -- 172.21.15.49:0/3113813952 >> 172.21.15.49:0/3113813952 conn(0x1943b60 msgr2=0x194e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:16.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.545+0000 7f181e23c740 1 -- 172.21.15.49:0/3113813952 shutdown_connections 2023-07-21T22:11:16.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.545+0000 7f181e23c740 1 -- 172.21.15.49:0/3113813952 wait complete. 2023-07-21T22:11:16.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.545+0000 7f181e23c740 1 -- start start 2023-07-21T22:11:16.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.545+0000 7f181e23c740 1 Processor -- start 2023-07-21T22:11:16.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181e23c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x1978700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181e23c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x199bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181e23c740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 0x199c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181e23c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1874b00 con 0x16d9ae0 2023-07-21T22:11:16.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181e23c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x1873470 con 0x16d9710 2023-07-21T22:11:16.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181e23c740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x175eb20 con 0x16d9eb0 2023-07-21T22:11:16.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181e23c740 10 client.0 _ll_register_callbacks cb 0x18d8530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:11:16.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f1813fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x199bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f1813fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x199bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60480/0 (socket says 172.21.15.49:60480) 2023-07-21T22:11:16.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f1813fff700 1 -- 172.21.15.49:0/4032706331 learned_addr learned my addr 172.21.15.49:0/4032706331 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:16.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181954b700 1 --2- 172.21.15.49:0/4032706331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 0x199c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f1818d4a700 1 --2- 172.21.15.49:0/4032706331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x1978700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f1813fff700 1 -- 172.21.15.49:0/4032706331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 msgr2=0x199c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:16.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f1813fff700 1 --2- 172.21.15.49:0/4032706331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 0x199c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f1813fff700 1 -- 172.21.15.49:0/4032706331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 msgr2=0x1978700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:16.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f1813fff700 1 --2- 172.21.15.49:0/4032706331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x1978700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f1813fff700 1 -- 172.21.15.49:0/4032706331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1814160740 con 0x16d9ae0 2023-07-21T22:11:16.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f1813fff700 1 --2- 172.21.15.49:0/4032706331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x199bee0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f180000bf80 tx=0x7f18000047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a033436c8a54b461 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:16.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f17f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-07-21T22:11:16.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f17f37fe700 1 -- 172.21.15.49:0/4032706331 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800021070 con 0x16d9ae0 2023-07-21T22:11:16.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181e23c740 1 -- 172.21.15.49:0/4032706331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x18ab5e0 con 0x16d9ae0 2023-07-21T22:11:16.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f17f37fe700 1 -- 172.21.15.49:0/4032706331 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1800004250 con 0x16d9ae0 2023-07-21T22:11:16.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f17f37fe700 1 -- 172.21.15.49:0/4032706331 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1800004410 con 0x16d9ae0 2023-07-21T22:11:16.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181e23c740 10 client.4878 fetch_fsmap learned FSMap version 9 2023-07-21T22:11:16.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181e23c740 1 -- 172.21.15.49:0/4032706331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x1878250 con 0x16d9ae0 2023-07-21T22:11:16.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f17f37fe700 1 -- 172.21.15.49:0/4032706331 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x18ab5e0 con 0x16d9ae0 2023-07-21T22:11:16.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f17f37fe700 1 -- 172.21.15.49:0/4032706331 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f18000036c0 con 0x16d9ae0 2023-07-21T22:11:16.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181e23c740 10 client.4878 fetch_fsmap finished waiting for FSMap version 9 2023-07-21T22:11:16.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181e23c740 10 client.4878 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-21T22:11:16.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181e23c740 20 client.4878 populate_metadata read hostname 'smithi049' 2023-07-21T22:11:16.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.549+0000 7f181e23c740 1 --2- 172.21.15.49:0/4032706331 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x1724790 0x1979fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.553+0000 7f181e23c740 4 client.4878 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:11:16.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.553+0000 7f181e23c740 1 -- 172.21.15.49:0/4032706331 --> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x18ab300 con 0x1724790 2023-07-21T22:11:16.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.553+0000 7f1818d4a700 1 --2- 172.21.15.49:0/4032706331 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x1724790 0x1979fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.553+0000 7f17f37fe700 10 client.4878 ms_handle_connect on v2:172.21.15.150:6834/2478678672 2023-07-21T22:11:16.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.553+0000 7f1818d4a700 1 --2- 172.21.15.49:0/4032706331 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x1724790 0x1979fa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a0fde4327553396 server_cookie=30f226f88ff122d6 in_seq=0 out_seq=0 2023-07-21T22:11:16.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.553+0000 7f17f37fe700 1 -- 172.21.15.49:0/4032706331 <== mds.0 v2:172.21.15.150:6834/2478678672 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x18ab300 con 0x1724790 2023-07-21T22:11:16.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.553+0000 7f17f37fe700 10 client.4878 handle_command_reply: tid=0 2023-07-21T22:11:16.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.553+0000 7f181e23c740 1 client.4878 shutdown 2023-07-21T22:11:16.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.553+0000 7f181e23c740 1 -- 172.21.15.49:0/4032706331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 msgr2=0x199bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:16.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.553+0000 7f181e23c740 1 --2- 172.21.15.49:0/4032706331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x199bee0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f180000bf80 tx=0x7f18000047e0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.557+0000 7f181e23c740 1 -- 172.21.15.49:0/4032706331 shutdown_connections 2023-07-21T22:11:16.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.557+0000 7f181e23c740 1 --2- 172.21.15.49:0/4032706331 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x1724790 0x1979fa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.557+0000 7f181e23c740 1 --2- 172.21.15.49:0/4032706331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x199bee0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.557+0000 7f181e23c740 1 --2- 172.21.15.49:0/4032706331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 0x199c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.557+0000 7f181e23c740 1 --2- 172.21.15.49:0/4032706331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x1978700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.557+0000 7f181e23c740 1 -- 172.21.15.49:0/4032706331 >> 172.21.15.49:0/4032706331 conn(0x1943b60 msgr2=0x1975180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:16.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.557+0000 7f17f37fe700 0 client.4878 ms_handle_reset on v2:172.21.15.150:6834/2478678672 2023-07-21T22:11:16.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.557+0000 7f181e23c740 1 -- 172.21.15.49:0/4032706331 shutdown_connections 2023-07-21T22:11:16.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.557+0000 7f181e23c740 1 -- 172.21.15.49:0/4032706331 wait complete. 2023-07-21T22:11:16.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.557+0000 7f181e23c740 20 client.4878 trim_cache size 0 max 16384 2023-07-21T22:11:16.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f181e23c740 1 Processor -- start 2023-07-21T22:11:16.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f181e23c740 1 -- start start 2023-07-21T22:11:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f181e23c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x1947db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f181e23c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x1970df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f181e23c740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 0x1971330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f181e23c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x18adf70 con 0x16d9ae0 2023-07-21T22:11:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f181e23c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x1881d50 con 0x16d9710 2023-07-21T22:11:16.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f181e23c740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x18b1490 con 0x16d9eb0 2023-07-21T22:11:16.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f1813fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x1970df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f1813fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x1970df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60488/0 (socket says 172.21.15.49:60488) 2023-07-21T22:11:16.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f1813fff700 1 -- 172.21.15.49:0/2666201387 learned_addr learned my addr 172.21.15.49:0/2666201387 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:16.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f1818d4a700 1 --2- 172.21.15.49:0/2666201387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x1947db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f181954b700 1 --2- 172.21.15.49:0/2666201387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 0x1971330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f1813fff700 1 -- 172.21.15.49:0/2666201387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 msgr2=0x1971330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:16.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f1813fff700 1 --2- 172.21.15.49:0/2666201387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 0x1971330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f1813fff700 1 -- 172.21.15.49:0/2666201387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 msgr2=0x1947db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:16.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f1813fff700 1 --2- 172.21.15.49:0/2666201387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x1947db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f1813fff700 1 -- 172.21.15.49:0/2666201387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18140bcf90 con 0x16d9ae0 2023-07-21T22:11:16.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f181954b700 1 --2- 172.21.15.49:0/2666201387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 0x1971330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:16.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f1813fff700 1 --2- 172.21.15.49:0/2666201387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x1970df0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1800006f80 tx=0x7f1800021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953147d8d805344e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:16.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f17feffd700 1 -- 172.21.15.49:0/2666201387 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800003b30 con 0x16d9ae0 2023-07-21T22:11:16.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f17feffd700 1 -- 172.21.15.49:0/2666201387 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1800003d70 con 0x16d9ae0 2023-07-21T22:11:16.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.577+0000 7f17feffd700 1 -- 172.21.15.49:0/2666201387 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800003ee0 con 0x16d9ae0 2023-07-21T22:11:16.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 -- 172.21.15.49:0/2666201387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 msgr2=0x1970df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:16.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 --2- 172.21.15.49:0/2666201387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x1970df0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1800006f80 tx=0x7f1800021000 comp rx=0 tx=0).stop 2023-07-21T22:11:16.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 -- 172.21.15.49:0/2666201387 shutdown_connections 2023-07-21T22:11:16.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 --2- 172.21.15.49:0/2666201387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x1970df0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 --2- 172.21.15.49:0/2666201387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 0x1971330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 --2- 172.21.15.49:0/2666201387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x1947db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 -- 172.21.15.49:0/2666201387 >> 172.21.15.49:0/2666201387 conn(0x1943b60 msgr2=0x1947490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:16.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 -- 172.21.15.49:0/2666201387 shutdown_connections 2023-07-21T22:11:16.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 -- 172.21.15.49:0/2666201387 wait complete. 2023-07-21T22:11:16.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 -- start start 2023-07-21T22:11:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 Processor -- start 2023-07-21T22:11:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x19ef900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x19a8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 0x19a86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1870ea0 con 0x16d9ae0 2023-07-21T22:11:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x18ac900 con 0x16d9710 2023-07-21T22:11:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x18afe10 con 0x16d9eb0 2023-07-21T22:11:16.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181e23c740 10 client.0 _ll_register_callbacks cb 0x186a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:11:16.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f1813fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x19a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f1813fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x19a8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60504/0 (socket says 172.21.15.49:60504) 2023-07-21T22:11:16.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f1813fff700 1 -- 172.21.15.49:0/1132470232 learned_addr learned my addr 172.21.15.49:0/1132470232 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:16.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f1818d4a700 1 --2- 172.21.15.49:0/1132470232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x19ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.581+0000 7f181954b700 1 --2- 172.21.15.49:0/1132470232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 0x19a86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f1813fff700 1 -- 172.21.15.49:0/1132470232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 msgr2=0x19a86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:16.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f1813fff700 1 --2- 172.21.15.49:0/1132470232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 0x19a86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f1813fff700 1 -- 172.21.15.49:0/1132470232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 msgr2=0x19ef900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:16.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f1813fff700 1 --2- 172.21.15.49:0/1132470232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x19ef900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f1813fff700 1 -- 172.21.15.49:0/1132470232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1878250 con 0x16d9ae0 2023-07-21T22:11:16.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f1813fff700 1 --2- 172.21.15.49:0/1132470232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x19a8190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1800024000 tx=0x7f18000092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b387ae475369bc83 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:16.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f17f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-07-21T22:11:16.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f17f37fe700 1 -- 172.21.15.49:0/1132470232 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800021040 con 0x16d9ae0 2023-07-21T22:11:16.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f181e23c740 1 -- 172.21.15.49:0/1132470232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x194ccf0 con 0x16d9ae0 2023-07-21T22:11:16.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f17f37fe700 1 -- 172.21.15.49:0/1132470232 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1800000e40 con 0x16d9ae0 2023-07-21T22:11:16.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f17f37fe700 1 -- 172.21.15.49:0/1132470232 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1800003b30 con 0x16d9ae0 2023-07-21T22:11:16.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f181e23c740 10 client.4884 fetch_fsmap learned FSMap version 9 2023-07-21T22:11:16.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f181e23c740 1 -- 172.21.15.49:0/1132470232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x185e5c0 con 0x16d9ae0 2023-07-21T22:11:16.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f17f37fe700 1 -- 172.21.15.49:0/1132470232 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x194ccf0 con 0x16d9ae0 2023-07-21T22:11:16.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f17f37fe700 1 -- 172.21.15.49:0/1132470232 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f180003a070 con 0x16d9ae0 2023-07-21T22:11:16.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f181e23c740 10 client.4884 fetch_fsmap finished waiting for FSMap version 9 2023-07-21T22:11:16.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f181e23c740 10 client.4884 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-21T22:11:16.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f181e23c740 20 client.4884 populate_metadata read hostname 'smithi049' 2023-07-21T22:11:16.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f181e23c740 1 --2- 172.21.15.49:0/1132470232 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x19a8c10 0x1990050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:16.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f181e23c740 4 client.4884 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-07-21T22:11:16.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f181e23c740 1 -- 172.21.15.49:0/1132470232 --> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f1808014450 con 0x19a8c10 2023-07-21T22:11:16.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f1818d4a700 1 --2- 172.21.15.49:0/1132470232 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x19a8c10 0x1990050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:16.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f1818d4a700 1 --2- 172.21.15.49:0/1132470232 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x19a8c10 0x1990050 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42a85f32ed63a711 server_cookie=80c9050097ad034a in_seq=0 out_seq=0 2023-07-21T22:11:16.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.585+0000 7f17f37fe700 10 client.4884 ms_handle_connect on v2:172.21.15.150:6834/2478678672 2023-07-21T22:11:16.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f17f37fe700 1 -- 172.21.15.49:0/1132470232 <== mds.0 v2:172.21.15.150:6834/2478678672 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7f1808014450 con 0x19a8c10 2023-07-21T22:11:16.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f17f37fe700 10 client.4884 handle_command_reply: tid=0 2023-07-21T22:11:16.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f181e23c740 1 client.4884 shutdown 2023-07-21T22:11:16.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f181e23c740 1 -- 172.21.15.49:0/1132470232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 msgr2=0x19a8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:16.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f181e23c740 1 --2- 172.21.15.49:0/1132470232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x19a8190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1800024000 tx=0x7f18000092e0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f181e23c740 1 -- 172.21.15.49:0/1132470232 shutdown_connections 2023-07-21T22:11:16.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f181e23c740 1 --2- 172.21.15.49:0/1132470232 >> [v2:172.21.15.150:6834/2478678672,v1:172.21.15.150:6835/2478678672] conn(0x19a8c10 0x1990050 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f181e23c740 1 --2- 172.21.15.49:0/1132470232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16d9ae0 0x19a8190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f181e23c740 1 --2- 172.21.15.49:0/1132470232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x16d9eb0 0x19a86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f181e23c740 1 --2- 172.21.15.49:0/1132470232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x16d9710 0x19ef900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f181e23c740 1 -- 172.21.15.49:0/1132470232 >> 172.21.15.49:0/1132470232 conn(0x1943b60 msgr2=0x1975130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:16.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f17f37fe700 0 client.4884 ms_handle_reset on v2:172.21.15.150:6834/2478678672 2023-07-21T22:11:16.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f181e23c740 1 -- 172.21.15.49:0/1132470232 shutdown_connections 2023-07-21T22:11:16.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f181e23c740 1 -- 172.21.15.49:0/1132470232 wait complete. 2023-07-21T22:11:16.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f181e23c740 20 client.4884 trim_cache size 0 max 16384 2023-07-21T22:11:16.643 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:11:16.643 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "c1346180-e695-42c2-8f5b-b72be8101116", 2023-07-21T22:11:16.644 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-07-21T22:11:16.644 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4291, 2023-07-21T22:11:16.644 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-07-21T22:11:16.644 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-07-21T22:11:16.644 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-07-21T22:11:16.644 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 41.399648128000003, 2023-07-21T22:11:16.644 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 9, 2023-07-21T22:11:16.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 32, 2023-07-21T22:11:16.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 30, 2023-07-21T22:11:16.645 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 47.299271343999997 2023-07-21T22:11:16.645 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:11:16.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f1819d4c700 1 -- 172.21.15.49:0/1569959612 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17f80662f0 msgr2=0x7f17f80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:16.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f1819d4c700 1 --2- 172.21.15.49:0/1569959612 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17f80662f0 0x7f17f80687a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1808000f60 tx=0x7f1808009040 comp rx=0 tx=0).stop 2023-07-21T22:11:16.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f1819d4c700 1 -- 172.21.15.49:0/1569959612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1814160370 msgr2=0x7f18140b3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:16.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f1819d4c700 1 --2- 172.21.15.49:0/1569959612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1814160370 0x7f18140b3070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f180c00cc50 tx=0x7f180c00cf60 comp rx=0 tx=0).stop 2023-07-21T22:11:16.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f1819d4c700 1 -- 172.21.15.49:0/1569959612 shutdown_connections 2023-07-21T22:11:16.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f1819d4c700 1 --2- 172.21.15.49:0/1569959612 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17f80662f0 0x7f17f80687a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f1819d4c700 1 --2- 172.21.15.49:0/1569959612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1814160370 0x7f18140b3070 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f1819d4c700 1 --2- 172.21.15.49:0/1569959612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18140ca2c0 0x7f18140c2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f1819d4c700 1 --2- 172.21.15.49:0/1569959612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18140c1470 0x7f181415e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:16.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f1819d4c700 1 -- 172.21.15.49:0/1569959612 >> 172.21.15.49:0/1569959612 conn(0x7f1814070450 msgr2=0x7f18140caa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:16.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f1819d4c700 1 -- 172.21.15.49:0/1569959612 shutdown_connections 2023-07-21T22:11:16.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:16.589+0000 7f1819d4c700 1 -- 172.21.15.49:0/1569959612 wait complete. 2023-07-21T22:11:16.656 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-07-21T22:11:16.667 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-07-21T22:11:16.667 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-21T22:11:16.667 INFO:tasks.ceph_fuse:client.0 config is {} 2023-07-21T22:11:16.668 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T22:11:16.668 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:11:16.668 INFO:tasks.ceph_fuse:client.2 config is {} 2023-07-21T22:11:16.668 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T22:11:16.668 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-21T22:11:16.669 INFO:tasks.ceph_fuse:client.1 config is {} 2023-07-21T22:11:16.669 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T22:11:16.669 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-21T22:11:16.669 INFO:tasks.ceph_fuse:client.3 config is {} 2023-07-21T22:11:16.669 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T22:11:16.670 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-21T22:11:16.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:16.670 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-07-21T22:11:16.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:16.690 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2023-07-21T22:11:16.775 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2023-07-21T22:11:16.778 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:11:16.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:16.780 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-07-21T22:11:16.801 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-07-21T22:11:16.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:16.802 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-21T22:11:16.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:16.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2023-07-21T22:11:17.090 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-07-21T22:11:17.091 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:11:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.225+0000 7f45bf59e700 1 Processor -- start 2023-07-21T22:11:17.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.225+0000 7f45bf59e700 1 -- start start 2023-07-21T22:11:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45bf59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45c006d380 0x7f45c006d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45bf59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c0071c70 0x7f45c00b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45bf59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f45c00b1400 0x7f45c00cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45bf59e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c00c9e80 con 0x7f45c006d380 2023-07-21T22:11:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45bf59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c00afeb0 con 0x7f45c00b1400 2023-07-21T22:11:17.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45bf59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00cab20 con 0x7f45c0071c70 2023-07-21T22:11:17.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45be59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45c006d380 0x7f45c006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:17.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45be59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45c006d380 0x7f45c006d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60506/0 (socket says 172.21.15.49:60506) 2023-07-21T22:11:17.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45be59c700 1 -- 172.21.15.49:0/4143025054 learned_addr learned my addr 172.21.15.49:0/4143025054 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:17.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45bed9d700 1 --2- 172.21.15.49:0/4143025054 >> v2:172.21.15.150:3300/0 conn(0x7f45c00b1400 0x7f45c00cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:17.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45bdd9b700 1 --2- 172.21.15.49:0/4143025054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c0071c70 0x7f45c00b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:17.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45be59c700 1 -- 172.21.15.49:0/4143025054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c0071c70 msgr2=0x7f45c00b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45be59c700 1 --2- 172.21.15.49:0/4143025054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c0071c70 0x7f45c00b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45be59c700 1 -- 172.21.15.49:0/4143025054 >> v2:172.21.15.150:3300/0 conn(0x7f45c00b1400 msgr2=0x7f45c00cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45be59c700 1 --2- 172.21.15.49:0/4143025054 >> v2:172.21.15.150:3300/0 conn(0x7f45c00b1400 0x7f45c00cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45be59c700 1 -- 172.21.15.49:0/4143025054 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c006dc90 con 0x7f45c006d380 2023-07-21T22:11:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45bdd9b700 1 --2- 172.21.15.49:0/4143025054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c0071c70 0x7f45c00b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.229+0000 7f45bed9d700 1 --2- 172.21.15.49:0/4143025054 >> v2:172.21.15.150:3300/0 conn(0x7f45c00b1400 0x7f45c00cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.233+0000 7f45be59c700 1 --2- 172.21.15.49:0/4143025054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c006d380 0x7f45c006d750 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f45c00c1940 tx=0x7f45b0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81d2d5886a61eb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.233+0000 7f45bd59a700 1 -- 172.21.15.49:0/4143025054 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b000b8a0 con 0x7f45c006d380 2023-07-21T22:11:17.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.233+0000 7f45bd59a700 1 -- 172.21.15.49:0/4143025054 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b000ba00 con 0x7f45c006d380 2023-07-21T22:11:17.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.233+0000 7f45bd59a700 1 -- 172.21.15.49:0/4143025054 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b000bd90 con 0x7f45c006d380 2023-07-21T22:11:17.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.233+0000 7f45bf59e700 1 -- 172.21.15.49:0/4143025054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c006d380 msgr2=0x7f45c006d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:17.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.233+0000 7f45bf59e700 1 --2- 172.21.15.49:0/4143025054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c006d380 0x7f45c006d750 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f45c00c1940 tx=0x7f45b0009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:17.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.233+0000 7f45bf59e700 1 -- 172.21.15.49:0/4143025054 shutdown_connections 2023-07-21T22:11:17.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.233+0000 7f45bf59e700 1 --2- 172.21.15.49:0/4143025054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c0071c70 0x7f45c00b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:17.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.233+0000 7f45bf59e700 1 --2- 172.21.15.49:0/4143025054 >> v2:172.21.15.150:3300/0 conn(0x7f45c00b1400 0x7f45c00cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:17.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.233+0000 7f45bf59e700 1 --2- 172.21.15.49:0/4143025054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c006d380 0x7f45c006d750 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:17.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.233+0000 7f45bf59e700 1 -- 172.21.15.49:0/4143025054 >> 172.21.15.49:0/4143025054 conn(0x7f45c0070450 msgr2=0x7f45c0070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:17.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.233+0000 7f45bf59e700 1 -- 172.21.15.49:0/4143025054 shutdown_connections 2023-07-21T22:11:17.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.233+0000 7f45bf59e700 1 -- 172.21.15.49:0/4143025054 wait complete. 2023-07-21T22:11:17.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.233+0000 7f45bf59e700 1 Processor -- start 2023-07-21T22:11:17.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bf59e700 1 -- start start 2023-07-21T22:11:17.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bf59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c006d380 0x7f45c00c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:17.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bf59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c0071c70 0x7f45c00a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:17.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bf59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c00b1400 0x7f45c00a7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:17.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bf59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c0148eb0 con 0x7f45c0071c70 2023-07-21T22:11:17.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bf59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c0149190 con 0x7f45c006d380 2023-07-21T22:11:17.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bf59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c0149470 con 0x7f45c00b1400 2023-07-21T22:11:17.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bdd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c0071c70 0x7f45c00a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:17.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bdd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c0071c70 0x7f45c00a74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60510/0 (socket says 172.21.15.49:60510) 2023-07-21T22:11:17.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bdd9b700 1 -- 172.21.15.49:0/1760104549 learned_addr learned my addr 172.21.15.49:0/1760104549 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:17.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bed9d700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c00b1400 0x7f45c00a7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:17.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45be59c700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c006d380 0x7f45c00c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:17.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bdd9b700 1 -- 172.21.15.49:0/1760104549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c00b1400 msgr2=0x7f45c00a7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:17.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bdd9b700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c00b1400 0x7f45c00a7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:17.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bdd9b700 1 -- 172.21.15.49:0/1760104549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c006d380 msgr2=0x7f45c00c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:17.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bdd9b700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c006d380 0x7f45c00c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:17.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bdd9b700 1 -- 172.21.15.49:0/1760104549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b0009570 con 0x7f45c0071c70 2023-07-21T22:11:17.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bed9d700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c00b1400 0x7f45c00a7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:17.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45be59c700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c006d380 0x7f45c00c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:17.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bdd9b700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c0071c70 0x7f45c00a74c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f45b400c7c0 tx=0x7f45b400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:17.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45aeffd700 1 -- 172.21.15.49:0/1760104549 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4011800 con 0x7f45c0071c70 2023-07-21T22:11:17.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45aeffd700 1 -- 172.21.15.49:0/1760104549 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4011960 con 0x7f45c0071c70 2023-07-21T22:11:17.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bf59e700 1 -- 172.21.15.49:0/1760104549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c0149750 con 0x7f45c0071c70 2023-07-21T22:11:17.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45aeffd700 1 -- 172.21.15.49:0/1760104549 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4011cd0 con 0x7f45c0071c70 2023-07-21T22:11:17.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.237+0000 7f45bf59e700 1 -- 172.21.15.49:0/1760104549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c0149f50 con 0x7f45c0071c70 2023-07-21T22:11:17.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.241+0000 7f45bf59e700 1 -- 172.21.15.49:0/1760104549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c0149c70 con 0x7f45c0071c70 2023-07-21T22:11:17.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.241+0000 7f45aeffd700 1 -- 172.21.15.49:0/1760104549 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f45b4021350 con 0x7f45c0071c70 2023-07-21T22:11:17.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.241+0000 7f45aeffd700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f45a0066340 0x7f45a00687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:17.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.245+0000 7f45aeffd700 1 -- 172.21.15.49:0/1760104549 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f45b4083e10 con 0x7f45c0071c70 2023-07-21T22:11:17.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.245+0000 7f45be59c700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f45a0066340 0x7f45a00687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:17.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.245+0000 7f45be59c700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f45a0066340 0x7f45a00687f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f45b0000c00 tx=0x7f45b0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:17.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.249+0000 7f45aeffd700 1 -- 172.21.15.49:0/1760104549 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45c0149c70 con 0x7f45c0071c70 2023-07-21T22:11:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.461+0000 7f45bf59e700 1 -- 172.21.15.49:0/1760104549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f45c0149c70 con 0x7f45c0071c70 2023-07-21T22:11:17.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.461+0000 7f45aeffd700 1 -- 172.21.15.49:0/1760104549 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f45b401e070 con 0x7f45c0071c70 2023-07-21T22:11:17.505 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-21T22:11:17.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.465+0000 7f45bf59e700 1 -- 172.21.15.49:0/1760104549 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f45a0066340 msgr2=0x7f45a00687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:17.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.465+0000 7f45bf59e700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f45a0066340 0x7f45a00687f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f45b0000c00 tx=0x7f45b0008030 comp rx=0 tx=0).stop 2023-07-21T22:11:17.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.465+0000 7f45bf59e700 1 -- 172.21.15.49:0/1760104549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c0071c70 msgr2=0x7f45c00a74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:17.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.465+0000 7f45bf59e700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c0071c70 0x7f45c00a74c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f45b400c7c0 tx=0x7f45b400cb80 comp rx=0 tx=0).stop 2023-07-21T22:11:17.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.465+0000 7f45bf59e700 1 -- 172.21.15.49:0/1760104549 shutdown_connections 2023-07-21T22:11:17.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.465+0000 7f45bf59e700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f45a0066340 0x7f45a00687f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:17.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.465+0000 7f45bf59e700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c0071c70 0x7f45c00a74c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:17.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.465+0000 7f45bf59e700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c00b1400 0x7f45c00a7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:17.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.465+0000 7f45bf59e700 1 --2- 172.21.15.49:0/1760104549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c006d380 0x7f45c00c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:17.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.465+0000 7f45bf59e700 1 -- 172.21.15.49:0/1760104549 >> 172.21.15.49:0/1760104549 conn(0x7f45c0070450 msgr2=0x7f45c01590e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:17.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.465+0000 7f45bf59e700 1 -- 172.21.15.49:0/1760104549 shutdown_connections 2023-07-21T22:11:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:17.465+0000 7f45bf59e700 1 -- 172.21.15.49:0/1760104549 wait complete. 2023-07-21T22:11:17.532 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:11:17.533 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:11:17.533 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-07-21T22:11:17.533 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:11:17.534 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:11:17.534 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:11:17.534 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:11:17.534 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:11:17.534 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:11:17.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:17.535 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-07-21T22:11:17.551 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:11:17.552 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:11:17.552 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:11:17.552 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:17.552 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-07-21T22:11:17.552 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:17.552 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:11:17.553 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:17.553 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-07-21T22:11:17.553 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:11:17.553 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:17.553 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-07-21T22:11:17.553 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:11:17.553 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:17.554 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-07-21T22:11:17.554 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:11:17.554 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42277sec preferred_lft 42277sec 2023-07-21T22:11:17.554 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-07-21T22:11:17.554 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:17.554 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:11:17.554 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:17.555 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-07-21T22:11:17.555 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:11:17.555 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:19:e1:20:16 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:17.555 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:11:17.555 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:17.556 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-21T22:11:17.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:17.557 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:11:17.557 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:11:17.557 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2023-07-21T22:11:17.557 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2023-07-21T22:11:17.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2023-07-21T22:11:17.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-21T22:11:17.558 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:11:17.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:17.713 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:11:17.748 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-07-21T22:11:17.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:17.751 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-07-21T22:11:17.818 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-07-21T22:11:17.819 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:11:17.819 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:11:17.819 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:11:17.819 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:11:17.819 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:11:17.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:17.820 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:11:17.821 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:11:17.821 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:11:17.821 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:11:17.821 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:11:17.822 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:11:17.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:17.964 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-07-21T22:11:17.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:17.985 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2023-07-21T22:11:18.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:18.045 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:11:18.045 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:11:18.046 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:11:18.046 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-21T22:11:18.046 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:11:18.157 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-21T22:11:18.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:18.158 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:11:18.158 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:11:18.158 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-21T22:11:18.159 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-21T22:11:18.159 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-21T22:11:18.159 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-21T22:11:18.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-21T22:11:18.160 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:11:18.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:18.308 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:11:18.308 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:11:18.309 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-07-21T22:11:18.309 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2023-07-21T22:11:18.309 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:11:18.380 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-21T22:11:18.380 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:11:18.381 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:11:18.397 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:11:18.397 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:11:18.398 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:11:18.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:11:18.533 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:11:18.533 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:11:18.610 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:11:18.612 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:11:18.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:18.613 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:11:18.676 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-21T22:11:18.676 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-21T22:11:18.724 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:11:18.761 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:11:18.761 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:11:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:11:18.840 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:11:18.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:18.841 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:11:18.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2023-07-21T22:11:18.833+0000 7fdd5ede8640 -1 init, newargv = 0x5607a0c90c20 newargc=15 2023-07-21T22:11:18.878 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[41439]: starting ceph client 2023-07-21T22:11:18.891 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[41439]: starting fuse 2023-07-21T22:11:18.892 INFO:teuthology.orchestra.run.smithi049.stdout:49 2023-07-21T22:11:18.893 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-07-21T22:11:18.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T22:11:18.894 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2023-07-21T22:11:18.894 DEBUG:teuthology.orchestra.run.smithi049:> import re 2023-07-21T22:11:18.895 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-07-21T22:11:18.895 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-07-21T22:11:18.896 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:11:18.897 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2023-07-21T22:11:18.897 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-21T22:11:18.898 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2023-07-21T22:11:18.898 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-21T22:11:18.899 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:11:18.899 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2023-07-21T22:11:18.900 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2023-07-21T22:11:18.900 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2023-07-21T22:11:18.900 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2023-07-21T22:11:18.900 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:11:18.901 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2023-07-21T22:11:18.901 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T22:11:18.901 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T22:11:18.901 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T22:11:18.901 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2023-07-21T22:11:18.902 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2023-07-21T22:11:18.902 DEBUG:teuthology.orchestra.run.smithi049:> return f 2023-07-21T22:11:18.902 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T22:11:18.902 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:11:18.903 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2023-07-21T22:11:18.903 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-07-21T22:11:19.055 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.41439.asok 2023-07-21T22:11:19.237 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.41439.asok 2023-07-21T22:11:19.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:19.238 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.41439.asok status 2023-07-21T22:11:19.441 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:11:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2023-07-21T22:11:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea", 2023-07-21T22:11:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:11:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2023-07-21T22:11:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2023-07-21T22:11:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-21T22:11:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "41439", 2023-07-21T22:11:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2023-07-21T22:11:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:11:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2023-07-21T22:11:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2023-07-21T22:11:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4896, 2023-07-21T22:11:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2023-07-21T22:11:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2023-07-21T22:11:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2023-07-21T22:11:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4896 2023-07-21T22:11:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:11:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:11:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:11:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:11:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1656788443 2023-07-21T22:11:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:11:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:11:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:11:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:11:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:11:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1656788443 2023-07-21T22:11:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:11:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4896 192.168.0.1:0/1656788443", 2023-07-21T22:11:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/1656788443", 2023-07-21T22:11:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2023-07-21T22:11:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 9, 2023-07-21T22:11:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 32, 2023-07-21T22:11:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2023-07-21T22:11:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2023-07-21T22:11:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2023-07-21T22:11:19.447 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:11:19.456 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:11:19.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.593+0000 7f9bdc912700 1 Processor -- start 2023-07-21T22:11:19.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.597+0000 7f9bdc912700 1 -- start start 2023-07-21T22:11:19.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.597+0000 7f9bdc912700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9bd8158c00 0x7f9bd815d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:19.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.597+0000 7f9bdc912700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9bd806da70 0x7f9bd806c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:19.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.597+0000 7f9bdc912700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd8158fd0 con 0x7f9bd80c90d0 2023-07-21T22:11:19.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.597+0000 7f9bdc912700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd806d650 con 0x7f9bd806da70 2023-07-21T22:11:19.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.597+0000 7f9bdc912700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd806c9d0 con 0x7f9bd8158c00 2023-07-21T22:11:19.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.597+0000 7f9bd659c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9bd806da70 0x7f9bd806c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:19.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.597+0000 7f9bd6d9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9bd8158c00 0x7f9bd815d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:19.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.597+0000 7f9bd659c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9bd806da70 0x7f9bd806c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:58682/0 (socket says 172.21.15.49:58682) 2023-07-21T22:11:19.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.597+0000 7f9bd659c700 1 -- 172.21.15.49:0/2507087305 learned_addr learned my addr 172.21.15.49:0/2507087305 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:19.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.597+0000 7f9bd759e700 1 --1- 172.21.15.49:0/2507087305 >> v1:172.21.15.150:6789/0 conn(0x7f9bd80c90d0 0x7f9bd80cbc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:39614/0 (socket says 172.21.15.49:39614) 2023-07-21T22:11:19.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bd5d9b700 1 -- 172.21.15.49:0/2507087305 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776532075 0 0) 0x7f9bd8158fd0 con 0x7f9bd80c90d0 2023-07-21T22:11:19.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bd5d9b700 1 -- 172.21.15.49:0/2507087305 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bc00035d0 con 0x7f9bd80c90d0 2023-07-21T22:11:19.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bd6d9d700 1 -- 172.21.15.49:0/2507087305 >> v2:172.21.15.150:3300/0 conn(0x7f9bd806da70 msgr2=0x7f9bd806c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:19.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bd6d9d700 1 --2- 172.21.15.49:0/2507087305 >> v2:172.21.15.150:3300/0 conn(0x7f9bd806da70 0x7f9bd806c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bd6d9d700 1 -- 172.21.15.49:0/2507087305 >> v1:172.21.15.150:6789/0 conn(0x7f9bd80c90d0 legacy=0x7f9bd80cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:19.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bd6d9d700 1 -- 172.21.15.49:0/2507087305 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd806ccb0 con 0x7f9bd8158c00 2023-07-21T22:11:19.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bd659c700 1 --2- 172.21.15.49:0/2507087305 >> v2:172.21.15.150:3300/0 conn(0x7f9bd806da70 0x7f9bd806c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:19.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bd6d9d700 1 --2- 172.21.15.49:0/2507087305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9bd8158c00 0x7f9bd815d180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009d90 tx=0x7f9bc800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b0b9a02212be4bf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:19.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bd5d9b700 1 -- 172.21.15.49:0/2507087305 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc800e070 con 0x7f9bd8158c00 2023-07-21T22:11:19.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bd5d9b700 1 -- 172.21.15.49:0/2507087305 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc800bb20 con 0x7f9bd8158c00 2023-07-21T22:11:19.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bd5d9b700 1 -- 172.21.15.49:0/2507087305 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8012430 con 0x7f9bd8158c00 2023-07-21T22:11:19.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bdc912700 1 -- 172.21.15.49:0/2507087305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9bd8158c00 msgr2=0x7f9bd815d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:19.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bdc912700 1 --2- 172.21.15.49:0/2507087305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9bd8158c00 0x7f9bd815d180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009d90 tx=0x7f9bc800b330 comp rx=0 tx=0).stop 2023-07-21T22:11:19.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bdc912700 1 -- 172.21.15.49:0/2507087305 shutdown_connections 2023-07-21T22:11:19.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bdc912700 1 --2- 172.21.15.49:0/2507087305 >> v2:172.21.15.150:3300/0 conn(0x7f9bd806da70 0x7f9bd806c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bdc912700 1 --2- 172.21.15.49:0/2507087305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9bd8158c00 0x7f9bd815d180 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bdc912700 1 -- 172.21.15.49:0/2507087305 >> 172.21.15.49:0/2507087305 conn(0x7f9bd8070450 msgr2=0x7f9bd8070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:19.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bdc912700 1 -- 172.21.15.49:0/2507087305 shutdown_connections 2023-07-21T22:11:19.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.601+0000 7f9bdc912700 1 -- 172.21.15.49:0/2507087305 wait complete. 2023-07-21T22:11:19.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.605+0000 7f9bdc912700 1 Processor -- start 2023-07-21T22:11:19.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.605+0000 7f9bdc912700 1 -- start start 2023-07-21T22:11:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.605+0000 7f9bdc912700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9bd806da70 0x7f9bd80c2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.605+0000 7f9bdc912700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd80c90d0 0x7f9bd80adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.605+0000 7f9bdc912700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bd8158c00 0x7f9bd814de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.605+0000 7f9bdc912700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd814e920 con 0x7f9bd80c90d0 2023-07-21T22:11:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.605+0000 7f9bdc912700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd80c2c80 con 0x7f9bd8158c00 2023-07-21T22:11:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.605+0000 7f9bdc912700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd80ae440 con 0x7f9bd806da70 2023-07-21T22:11:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bd659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd80c90d0 0x7f9bd80adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bd659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd80c90d0 0x7f9bd80adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60524/0 (socket says 172.21.15.49:60524) 2023-07-21T22:11:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bd659c700 1 -- 172.21.15.49:0/2812235749 learned_addr learned my addr 172.21.15.49:0/2812235749 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bd6d9d700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9bd806da70 0x7f9bd80c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bd759e700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bd8158c00 0x7f9bd814de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:19.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bd6d9d700 1 -- 172.21.15.49:0/2812235749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bd8158c00 msgr2=0x7f9bd814de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:19.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bd6d9d700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bd8158c00 0x7f9bd814de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bd6d9d700 1 -- 172.21.15.49:0/2812235749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd80c90d0 msgr2=0x7f9bd80adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:19.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bd6d9d700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd80c90d0 0x7f9bd80adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bd6d9d700 1 -- 172.21.15.49:0/2812235749 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc009570 con 0x7f9bd806da70 2023-07-21T22:11:19.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bd659c700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd80c90d0 0x7f9bd80adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:19.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bd6d9d700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9bd806da70 0x7f9bd80c2740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8016000 tx=0x7f9bc8004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:19.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bbf7fe700 1 -- 172.21.15.49:0/2812235749 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8012430 con 0x7f9bd806da70 2023-07-21T22:11:19.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bbf7fe700 1 -- 172.21.15.49:0/2812235749 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc8020070 con 0x7f9bd806da70 2023-07-21T22:11:19.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bbf7fe700 1 -- 172.21.15.49:0/2812235749 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc80098f0 con 0x7f9bd806da70 2023-07-21T22:11:19.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bdc912700 1 -- 172.21.15.49:0/2812235749 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc8009a70 con 0x7f9bd806da70 2023-07-21T22:11:19.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.609+0000 7f9bdc912700 1 -- 172.21.15.49:0/2812235749 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd80aea00 con 0x7f9bd806da70 2023-07-21T22:11:19.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.613+0000 7f9bdc912700 1 -- 172.21.15.49:0/2812235749 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd814ea60 con 0x7f9bd806da70 2023-07-21T22:11:19.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.613+0000 7f9bbf7fe700 1 -- 172.21.15.49:0/2812235749 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9bc8004040 con 0x7f9bd806da70 2023-07-21T22:11:19.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.617+0000 7f9bbf7fe700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9bc40662f0 0x7f9bc40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:19.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.617+0000 7f9bbf7fe700 1 -- 172.21.15.49:0/2812235749 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9bc8022070 con 0x7f9bd806da70 2023-07-21T22:11:19.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.617+0000 7f9bd659c700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9bc40662f0 0x7f9bc40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:19.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.617+0000 7f9bd659c700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9bc40662f0 0x7f9bc40687a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80aee00 tx=0x7f9bcc0092e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:19.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.625+0000 7f9bbf7fe700 1 -- 172.21.15.49:0/2812235749 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9bd814ea60 con 0x7f9bd806da70 2023-07-21T22:11:19.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.833+0000 7f9bdc912700 1 -- 172.21.15.49:0/2812235749 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9bd814ea60 con 0x7f9bd806da70 2023-07-21T22:11:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.837+0000 7f9bbf7fe700 1 -- 172.21.15.49:0/2812235749 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9bc802c070 con 0x7f9bd806da70 2023-07-21T22:11:19.879 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-21T22:11:19.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.841+0000 7f9bdc912700 1 -- 172.21.15.49:0/2812235749 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9bc40662f0 msgr2=0x7f9bc40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:19.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.841+0000 7f9bdc912700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9bc40662f0 0x7f9bc40687a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80aee00 tx=0x7f9bcc0092e0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.841+0000 7f9bdc912700 1 -- 172.21.15.49:0/2812235749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9bd806da70 msgr2=0x7f9bd80c2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:19.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.841+0000 7f9bdc912700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9bd806da70 0x7f9bd80c2740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8016000 tx=0x7f9bc8004af0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.841+0000 7f9bdc912700 1 -- 172.21.15.49:0/2812235749 shutdown_connections 2023-07-21T22:11:19.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.841+0000 7f9bdc912700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9bc40662f0 0x7f9bc40687a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.841+0000 7f9bdc912700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd80c90d0 0x7f9bd80adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.841+0000 7f9bdc912700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9bd8158c00 0x7f9bd814de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.841+0000 7f9bdc912700 1 --2- 172.21.15.49:0/2812235749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9bd806da70 0x7f9bd80c2740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.841+0000 7f9bdc912700 1 -- 172.21.15.49:0/2812235749 >> 172.21.15.49:0/2812235749 conn(0x7f9bd8070450 msgr2=0x7f9bd80cbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:19.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.841+0000 7f9bdc912700 1 -- 172.21.15.49:0/2812235749 shutdown_connections 2023-07-21T22:11:19.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:19.841+0000 7f9bdc912700 1 -- 172.21.15.49:0/2812235749 wait complete. 2023-07-21T22:11:19.907 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:11:19.907 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:11:19.908 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-07-21T22:11:19.908 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-21T22:11:19.908 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-21T22:11:19.908 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:11:19.909 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:11:19.909 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:11:19.909 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-21T22:11:19.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:19.909 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-07-21T22:11:19.927 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:11:19.927 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:11:19.927 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:11:19.928 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:19.928 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-07-21T22:11:19.928 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:19.928 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:11:19.928 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:19.928 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-07-21T22:11:19.928 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:11:19.929 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:19.929 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-07-21T22:11:19.929 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:11:19.929 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:19.929 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-07-21T22:11:19.929 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:11:19.929 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42274sec preferred_lft 42274sec 2023-07-21T22:11:19.929 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-07-21T22:11:19.930 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:19.930 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:11:19.930 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:19.930 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-07-21T22:11:19.930 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:11:19.930 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:19:e1:20:16 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:19.930 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:11:19.931 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:19.931 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:11:19.931 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether aa:11:6f:e1:a1:5e brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:19.931 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:11:19.931 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:19.931 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec43:77ff:fe1f:6f26/64 scope link 2023-07-21T22:11:19.932 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:19.932 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:11:19.932 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether aa:11:6f:e1:a1:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:11:19.932 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a811:6fff:fee1:a15e/64 scope link tentative 2023-07-21T22:11:19.932 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:19.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:19.934 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:11:20.013 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-07-21T22:11:20.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:20.017 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-07-21T22:11:20.079 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-07-21T22:11:20.080 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:11:20.080 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:11:20.081 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:11:20.081 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:11:20.081 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:11:20.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:20.082 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:11:20.083 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:11:20.083 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:11:20.084 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:11:20.085 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:11:20.085 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:11:20.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:20.227 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-07-21T22:11:20.245 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:11:20.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:20.248 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2023-07-21T22:11:20.309 INFO:teuthology.orchestra.run.smithi049.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-21T22:11:20.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:20.310 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:11:20.310 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:11:20.310 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:11:20.310 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-21T22:11:20.311 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:11:20.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:20.428 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-21T22:11:20.468 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:11:20.469 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:11:20.469 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:11:20.469 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:20.469 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-07-21T22:11:20.469 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:20.469 INFO:teuthology.orchestra.run.smithi049.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:11:20.470 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether d2:81:49:f9:8d:83 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-21T22:11:20.470 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-21T22:11:20.470 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:20.470 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::d081:49ff:fef9:8d83/64 scope link 2023-07-21T22:11:20.470 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:20.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:20.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-21T22:11:20.554 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:11:20.555 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:11:20.555 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:11:20.555 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:20.555 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-07-21T22:11:20.555 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:20.555 INFO:teuthology.orchestra.run.smithi049.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:11:20.555 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether d2:81:49:f9:8d:83 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-21T22:11:20.556 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-21T22:11:20.556 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:20.556 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::d081:49ff:fef9:8d83/64 scope link 2023-07-21T22:11:20.556 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:20.558 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-21T22:11:20.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:20.559 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:11:20.559 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:11:20.559 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-21T22:11:20.560 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-21T22:11:20.560 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-21T22:11:20.560 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-21T22:11:20.560 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-21T22:11:20.560 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:11:20.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:20.768 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:11:20.768 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:11:20.768 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2023-07-21T22:11:20.768 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.1 master ceph-brx 2023-07-21T22:11:20.769 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:11:20.844 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-07-21T22:11:20.844 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:11:20.845 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-21T22:11:20.859 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-21T22:11:20.860 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:11:20.860 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-21T22:11:20.918 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:11:21.006 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:11:21.006 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:11:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:11:21.083 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:11:21.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:21.085 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:11:21.143 INFO:teuthology.orchestra.run.smithi049.stdout:49 2023-07-21T22:11:21.143 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2023-07-21T22:11:21.144 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-07-21T22:11:21.192 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:11:21.225 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:11:21.226 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:11:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:11:21.305 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:11:21.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:21.306 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:11:21.344 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi049.stderr:2023-07-21T22:11:21.301+0000 7fe290cc7640 -1 init, newargv = 0x55db0dfdd2d0 newargc=15 2023-07-21T22:11:21.344 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi049.stderr:ceph-fuse[41575]: starting ceph client 2023-07-21T22:11:21.358 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi049.stderr:ceph-fuse[41575]: starting fuse 2023-07-21T22:11:21.359 INFO:teuthology.orchestra.run.smithi049.stdout:49 2023-07-21T22:11:21.359 INFO:teuthology.orchestra.run.smithi049.stdout:50 2023-07-21T22:11:21.359 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2023-07-21T22:11:21.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T22:11:21.360 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2023-07-21T22:11:21.360 DEBUG:teuthology.orchestra.run.smithi049:> import re 2023-07-21T22:11:21.364 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-07-21T22:11:21.365 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-07-21T22:11:21.366 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:11:21.366 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2023-07-21T22:11:21.367 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-07-21T22:11:21.367 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2023-07-21T22:11:21.368 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-07-21T22:11:21.368 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:11:21.369 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2023-07-21T22:11:21.370 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2023-07-21T22:11:21.370 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2023-07-21T22:11:21.371 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2023-07-21T22:11:21.371 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:11:21.372 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2023-07-21T22:11:21.372 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T22:11:21.373 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T22:11:21.373 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T22:11:21.373 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2023-07-21T22:11:21.374 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2023-07-21T22:11:21.374 DEBUG:teuthology.orchestra.run.smithi049:> return f 2023-07-21T22:11:21.375 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T22:11:21.375 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:11:21.376 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.2")) 2023-07-21T22:11:21.376 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-07-21T22:11:21.522 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.2.41575.asok 2023-07-21T22:11:21.704 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.41575.asok 2023-07-21T22:11:21.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:21.705 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.41575.asok status 2023-07-21T22:11:21.904 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:11:21.904 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2023-07-21T22:11:21.904 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea", 2023-07-21T22:11:21.904 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:11:21.904 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "2", 2023-07-21T22:11:21.905 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2023-07-21T22:11:21.905 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-07-21T22:11:21.905 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "41575", 2023-07-21T22:11:21.905 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2023-07-21T22:11:21.905 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:11:21.905 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2023-07-21T22:11:21.905 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2023-07-21T22:11:21.906 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4908, 2023-07-21T22:11:21.906 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2023-07-21T22:11:21.906 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2023-07-21T22:11:21.906 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2023-07-21T22:11:21.906 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4908 2023-07-21T22:11:21.906 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:11:21.906 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:11:21.906 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:11:21.907 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2023-07-21T22:11:21.907 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2099057897 2023-07-21T22:11:21.907 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:11:21.907 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:11:21.907 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:11:21.907 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:11:21.907 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2023-07-21T22:11:21.908 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2099057897 2023-07-21T22:11:21.908 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:11:21.908 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4908 192.168.0.2:0/2099057897", 2023-07-21T22:11:21.908 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.2:0/2099057897", 2023-07-21T22:11:21.908 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2023-07-21T22:11:21.908 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 9, 2023-07-21T22:11:21.908 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 32, 2023-07-21T22:11:21.909 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2023-07-21T22:11:21.909 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2023-07-21T22:11:21.909 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2023-07-21T22:11:21.909 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:11:21.919 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:11:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.045+0000 7fa244a3d700 1 Processor -- start 2023-07-21T22:11:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.045+0000 7fa244a3d700 1 -- start start 2023-07-21T22:11:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.045+0000 7fa244a3d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa240160370 0x7fa24006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.045+0000 7fa244a3d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2400c1470 0x7fa2400c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.045+0000 7fa244a3d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24006e010 con 0x7fa2400ca2c0 2023-07-21T22:11:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.045+0000 7fa244a3d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa240160740 con 0x7fa240160370 2023-07-21T22:11:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.045+0000 7fa244a3d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400ccc50 con 0x7fa2400c1470 2023-07-21T22:11:22.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.049+0000 7fa237fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2400c1470 0x7fa2400c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:22.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.049+0000 7fa23ed9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa240160370 0x7fa24006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:22.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.049+0000 7fa23f59e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa2400ca2c0 0x7fa2400caa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:39622/0 (socket says 172.21.15.49:39622) 2023-07-21T22:11:22.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.049+0000 7fa23f59e700 1 -- 172.21.15.49:0/1897345915 learned_addr learned my addr 172.21.15.49:0/1897345915 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:22.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.049+0000 7fa23ed9d700 1 -- 172.21.15.49:0/1897345915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2400c1470 msgr2=0x7fa2400c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:22.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.049+0000 7fa23ed9d700 1 --2- 172.21.15.49:0/1897345915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2400c1470 0x7fa2400c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:22.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.049+0000 7fa23ed9d700 1 -- 172.21.15.49:0/1897345915 >> v1:172.21.15.150:6789/0 conn(0x7fa2400ca2c0 legacy=0x7fa2400caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:22.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.049+0000 7fa23ed9d700 1 -- 172.21.15.49:0/1897345915 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2400afc90 con 0x7fa240160370 2023-07-21T22:11:22.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.049+0000 7fa23ed9d700 1 --2- 172.21.15.49:0/1897345915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa240160370 0x7fa24006d7e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa230009850 tx=0x7fa230009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5d14404244f8370 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:22.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.049+0000 7fa23e59c700 1 -- 172.21.15.49:0/1897345915 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa230011830 con 0x7fa240160370 2023-07-21T22:11:22.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.049+0000 7fa23e59c700 1 -- 172.21.15.49:0/1897345915 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa230011990 con 0x7fa240160370 2023-07-21T22:11:22.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.049+0000 7fa23e59c700 1 -- 172.21.15.49:0/1897345915 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa230011d40 con 0x7fa240160370 2023-07-21T22:11:22.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.049+0000 7fa244a3d700 1 -- 172.21.15.49:0/1897345915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa240160370 msgr2=0x7fa24006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:22.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.049+0000 7fa244a3d700 1 --2- 172.21.15.49:0/1897345915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa240160370 0x7fa24006d7e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa230009850 tx=0x7fa230009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:22.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.053+0000 7fa244a3d700 1 -- 172.21.15.49:0/1897345915 shutdown_connections 2023-07-21T22:11:22.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.053+0000 7fa244a3d700 1 --2- 172.21.15.49:0/1897345915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2400c1470 0x7fa2400c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:22.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.053+0000 7fa244a3d700 1 --2- 172.21.15.49:0/1897345915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa240160370 0x7fa24006d7e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:22.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.053+0000 7fa244a3d700 1 -- 172.21.15.49:0/1897345915 >> 172.21.15.49:0/1897345915 conn(0x7fa240070450 msgr2=0x7fa240070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:22.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.053+0000 7fa244a3d700 1 -- 172.21.15.49:0/1897345915 shutdown_connections 2023-07-21T22:11:22.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.053+0000 7fa244a3d700 1 -- 172.21.15.49:0/1897345915 wait complete. 2023-07-21T22:11:22.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa244a3d700 1 Processor -- start 2023-07-21T22:11:22.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa244a3d700 1 -- start start 2023-07-21T22:11:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa244a3d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2400c1470 0x7fa2400c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa244a3d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2400ca2c0 0x7fa2400b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:22.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa244a3d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240160370 0x7fa2401543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:22.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa244a3d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400c5140 con 0x7fa240160370 2023-07-21T22:11:22.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa244a3d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400c5390 con 0x7fa2400ca2c0 2023-07-21T22:11:22.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa244a3d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400c5670 con 0x7fa2400c1470 2023-07-21T22:11:22.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa23f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240160370 0x7fa2401543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:22.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa23f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240160370 0x7fa2401543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60540/0 (socket says 172.21.15.49:60540) 2023-07-21T22:11:22.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa23f59e700 1 -- 172.21.15.49:0/3909373258 learned_addr learned my addr 172.21.15.49:0/3909373258 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:22.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa23ed9d700 1 --2- 172.21.15.49:0/3909373258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2400c1470 0x7fa2400c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:22.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa237fff700 1 --2- 172.21.15.49:0/3909373258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2400ca2c0 0x7fa2400b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:22.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa23f59e700 1 -- 172.21.15.49:0/3909373258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2400c1470 msgr2=0x7fa2400c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:22.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa23f59e700 1 --2- 172.21.15.49:0/3909373258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2400c1470 0x7fa2400c2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:22.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa23f59e700 1 -- 172.21.15.49:0/3909373258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2400ca2c0 msgr2=0x7fa2400b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:22.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa23f59e700 1 --2- 172.21.15.49:0/3909373258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2400ca2c0 0x7fa2400b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:22.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.057+0000 7fa23f59e700 1 -- 172.21.15.49:0/3909373258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300094b0 con 0x7fa240160370 2023-07-21T22:11:22.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.061+0000 7fa23f59e700 1 --2- 172.21.15.49:0/3909373258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240160370 0x7fa2401543b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa23800cbc0 tx=0x7fa23800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:22.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.061+0000 7fa2377fe700 1 -- 172.21.15.49:0/3909373258 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238007480 con 0x7fa240160370 2023-07-21T22:11:22.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.061+0000 7fa2377fe700 1 -- 172.21.15.49:0/3909373258 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2380075e0 con 0x7fa240160370 2023-07-21T22:11:22.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.061+0000 7fa244a3d700 1 -- 172.21.15.49:0/3909373258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2400c5950 con 0x7fa240160370 2023-07-21T22:11:22.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.061+0000 7fa2377fe700 1 -- 172.21.15.49:0/3909373258 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238007950 con 0x7fa240160370 2023-07-21T22:11:22.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.061+0000 7fa244a3d700 1 -- 172.21.15.49:0/3909373258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2400b1df0 con 0x7fa240160370 2023-07-21T22:11:22.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.061+0000 7fa244a3d700 1 -- 172.21.15.49:0/3909373258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24004dcb0 con 0x7fa240160370 2023-07-21T22:11:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.065+0000 7fa2377fe700 1 -- 172.21.15.49:0/3909373258 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa238012400 con 0x7fa240160370 2023-07-21T22:11:22.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.065+0000 7fa2377fe700 1 --2- 172.21.15.49:0/3909373258 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2200662f0 0x7fa2200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:22.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.065+0000 7fa2377fe700 1 -- 172.21.15.49:0/3909373258 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa238083870 con 0x7fa240160370 2023-07-21T22:11:22.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.065+0000 7fa23ed9d700 1 --2- 172.21.15.49:0/3909373258 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2200662f0 0x7fa2200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:22.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.065+0000 7fa23ed9d700 1 --2- 172.21.15.49:0/3909373258 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2200662f0 0x7fa2200687a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa2300090b0 tx=0x7fa23001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:22.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.073+0000 7fa2377fe700 1 -- 172.21.15.49:0/3909373258 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa238050b00 con 0x7fa240160370 2023-07-21T22:11:22.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.293+0000 7fa244a3d700 1 -- 172.21.15.49:0/3909373258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa2400ad7b0 con 0x7fa240160370 2023-07-21T22:11:22.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.293+0000 7fa2377fe700 1 -- 172.21.15.49:0/3909373258 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa238017070 con 0x7fa240160370 2023-07-21T22:11:22.337 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-21T22:11:22.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.297+0000 7fa244a3d700 1 -- 172.21.15.49:0/3909373258 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2200662f0 msgr2=0x7fa2200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:22.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.297+0000 7fa244a3d700 1 --2- 172.21.15.49:0/3909373258 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2200662f0 0x7fa2200687a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa2300090b0 tx=0x7fa23001c040 comp rx=0 tx=0).stop 2023-07-21T22:11:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.297+0000 7fa244a3d700 1 -- 172.21.15.49:0/3909373258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240160370 msgr2=0x7fa2401543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.297+0000 7fa244a3d700 1 --2- 172.21.15.49:0/3909373258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240160370 0x7fa2401543b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa23800cbc0 tx=0x7fa23800cbf0 comp rx=0 tx=0).stop 2023-07-21T22:11:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.297+0000 7fa244a3d700 1 -- 172.21.15.49:0/3909373258 shutdown_connections 2023-07-21T22:11:22.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.297+0000 7fa244a3d700 1 --2- 172.21.15.49:0/3909373258 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2200662f0 0x7fa2200687a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:22.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.297+0000 7fa244a3d700 1 --2- 172.21.15.49:0/3909373258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240160370 0x7fa2401543b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:22.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.297+0000 7fa244a3d700 1 --2- 172.21.15.49:0/3909373258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2400ca2c0 0x7fa2400b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:22.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.297+0000 7fa244a3d700 1 --2- 172.21.15.49:0/3909373258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2400c1470 0x7fa2400c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:22.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.297+0000 7fa244a3d700 1 -- 172.21.15.49:0/3909373258 >> 172.21.15.49:0/3909373258 conn(0x7fa240070450 msgr2=0x7fa2400add20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:22.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.297+0000 7fa244a3d700 1 -- 172.21.15.49:0/3909373258 shutdown_connections 2023-07-21T22:11:22.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:22.297+0000 7fa244a3d700 1 -- 172.21.15.49:0/3909373258 wait complete. 2023-07-21T22:11:22.366 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:11:22.367 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:11:22.367 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2023-07-21T22:11:22.367 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-21T22:11:22.368 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-21T22:11:22.368 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:11:22.368 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:11:22.369 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:11:22.369 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-21T22:11:22.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:22.370 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2023-07-21T22:11:22.387 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:11:22.388 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:11:22.388 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:11:22.388 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:22.388 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-07-21T22:11:22.388 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:22.388 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:11:22.388 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:22.389 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2023-07-21T22:11:22.389 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:11:22.389 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:22.389 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2023-07-21T22:11:22.389 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:11:22.389 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:22.389 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:11:22.390 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:22.390 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-21T22:11:22.390 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42325sec preferred_lft 42325sec 2023-07-21T22:11:22.390 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2023-07-21T22:11:22.390 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:22.390 INFO:teuthology.orchestra.run.smithi150.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:11:22.390 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 02:42:9a:f4:f0:80 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:22.391 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:11:22.391 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:22.392 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-21T22:11:22.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:22.392 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-07-21T22:11:22.393 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-07-21T22:11:22.393 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add name ceph-brx type bridge 2023-07-21T22:11:22.393 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr flush dev ceph-brx 2023-07-21T22:11:22.393 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set ceph-brx up 2023-07-21T22:11:22.394 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-21T22:11:22.394 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-07-21T22:11:22.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:22.548 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:11:22.583 INFO:teuthology.orchestra.run.smithi150.stdout:1 2023-07-21T22:11:22.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:22.587 DEBUG:teuthology.orchestra.run.smithi150:> route 2023-07-21T22:11:22.663 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2023-07-21T22:11:22.664 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:11:22.664 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-21T22:11:22.664 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T22:11:22.664 INFO:teuthology.orchestra.run.smithi150.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:11:22.664 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-07-21T22:11:22.664 INFO:teuthology.orchestra.run.smithi150.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-21T22:11:22.664 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:11:22.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:22.665 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-07-21T22:11:22.665 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-07-21T22:11:22.666 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T22:11:22.666 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T22:11:22.666 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T22:11:22.666 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-07-21T22:11:22.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:22.801 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-07-21T22:11:22.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:22.816 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2023-07-21T22:11:22.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:22.877 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-07-21T22:11:22.877 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-07-21T22:11:22.878 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-21T22:11:22.878 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-21T22:11:22.878 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-07-21T22:11:22.991 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-21T22:11:22.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:22.992 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-07-21T22:11:22.993 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-07-21T22:11:22.993 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-21T22:11:22.993 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-21T22:11:22.993 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-21T22:11:22.994 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-21T22:11:22.994 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-21T22:11:22.994 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-07-21T22:11:23.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:23.164 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-07-21T22:11:23.164 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-07-21T22:11:23.164 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2023-07-21T22:11:23.165 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.0 master ceph-brx 2023-07-21T22:11:23.165 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-07-21T22:11:23.235 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-07-21T22:11:23.235 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:11:23.236 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-21T22:11:23.250 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-21T22:11:23.251 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:11:23.251 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-21T22:11:23.313 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2023-07-21T22:11:23.386 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:11:23.387 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:11:23.465 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:11:23.467 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:11:23.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:23.469 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2023-07-21T22:11:23.528 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-21T22:11:23.528 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-07-21T22:11:23.576 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2023-07-21T22:11:23.613 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:11:23.613 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:11:23.687 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:11:23.689 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:11:23.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:23.690 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2023-07-21T22:11:23.717 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:2023-07-21T22:11:23.669+0000 7f190c376640 -1 init, newargv = 0x559a522a9db0 newargc=15 2023-07-21T22:11:23.717 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[40366]: starting ceph client 2023-07-21T22:11:23.729 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[40366]: starting fuse 2023-07-21T22:11:24.829 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2023-07-21T22:11:24.867 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:11:24.868 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:11:24.944 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:11:24.947 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:11:24.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:24.949 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2023-07-21T22:11:25.010 INFO:teuthology.orchestra.run.smithi150.stdout:49 2023-07-21T22:11:25.010 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-07-21T22:11:25.010 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T22:11:25.011 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2023-07-21T22:11:25.011 DEBUG:teuthology.orchestra.run.smithi150:> import re 2023-07-21T22:11:25.011 DEBUG:teuthology.orchestra.run.smithi150:> import os 2023-07-21T22:11:25.011 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2023-07-21T22:11:25.012 DEBUG:teuthology.orchestra.run.smithi150:> 2023-07-21T22:11:25.012 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2023-07-21T22:11:25.012 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-07-21T22:11:25.012 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2023-07-21T22:11:25.013 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-07-21T22:11:25.013 DEBUG:teuthology.orchestra.run.smithi150:> 2023-07-21T22:11:25.013 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2023-07-21T22:11:25.013 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2023-07-21T22:11:25.014 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2023-07-21T22:11:25.014 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2023-07-21T22:11:25.014 DEBUG:teuthology.orchestra.run.smithi150:> 2023-07-21T22:11:25.014 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2023-07-21T22:11:25.015 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T22:11:25.015 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T22:11:25.015 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T22:11:25.015 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2023-07-21T22:11:25.016 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2023-07-21T22:11:25.016 DEBUG:teuthology.orchestra.run.smithi150:> return f 2023-07-21T22:11:25.016 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T22:11:25.016 DEBUG:teuthology.orchestra.run.smithi150:> 2023-07-21T22:11:25.017 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.1")) 2023-07-21T22:11:25.017 DEBUG:teuthology.orchestra.run.smithi150:> ' 2023-07-21T22:11:25.172 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.1.40366.asok 2023-07-21T22:11:25.356 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.40366.asok 2023-07-21T22:11:25.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:25.357 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.40366.asok status 2023-07-21T22:11:25.548 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2023-07-21T22:11:25.548 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2023-07-21T22:11:25.548 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea", 2023-07-21T22:11:25.548 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:11:25.549 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "1", 2023-07-21T22:11:25.549 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2023-07-21T22:11:25.549 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-07-21T22:11:25.549 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "40366", 2023-07-21T22:11:25.549 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2023-07-21T22:11:25.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-07-21T22:11:25.549 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2023-07-21T22:11:25.550 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2023-07-21T22:11:25.550 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4900, 2023-07-21T22:11:25.550 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2023-07-21T22:11:25.550 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2023-07-21T22:11:25.550 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2023-07-21T22:11:25.550 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4900 2023-07-21T22:11:25.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-07-21T22:11:25.551 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2023-07-21T22:11:25.551 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2023-07-21T22:11:25.551 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:11:25.551 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 720712407 2023-07-21T22:11:25.551 INFO:teuthology.orchestra.run.smithi150.stdout: } 2023-07-21T22:11:25.551 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-07-21T22:11:25.551 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2023-07-21T22:11:25.552 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2023-07-21T22:11:25.552 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:11:25.552 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 720712407 2023-07-21T22:11:25.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-07-21T22:11:25.552 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4900 192.168.0.1:0/720712407", 2023-07-21T22:11:25.552 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.1:0/720712407", 2023-07-21T22:11:25.553 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2023-07-21T22:11:25.553 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 9, 2023-07-21T22:11:25.553 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 32, 2023-07-21T22:11:25.553 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2023-07-21T22:11:25.553 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2023-07-21T22:11:25.553 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2023-07-21T22:11:25.553 INFO:teuthology.orchestra.run.smithi150.stdout:} 2023-07-21T22:11:25.563 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:11:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.701+0000 7f43cab7e700 1 Processor -- start 2023-07-21T22:11:25.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.701+0000 7f43cab7e700 1 -- start start 2023-07-21T22:11:25.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.701+0000 7f43cab7e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f43c4160370 0x7f43c406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:25.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.701+0000 7f43cab7e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43c40c1470 0x7f43c40c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:25.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.701+0000 7f43cab7e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c406e010 con 0x7f43c40ca2c0 2023-07-21T22:11:25.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.701+0000 7f43cab7e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c4160740 con 0x7f43c4160370 2023-07-21T22:11:25.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.701+0000 7f43cab7e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40ccc50 con 0x7f43c40c1470 2023-07-21T22:11:25.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43ca37d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f43c40ca2c0 0x7f43c40caa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46248/0 (socket says 172.21.15.49:46248) 2023-07-21T22:11:25.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43ca37d700 1 -- 172.21.15.49:0/1756104409 learned_addr learned my addr 172.21.15.49:0/1756104409 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:25.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43c9b7c700 1 --2- 172.21.15.49:0/1756104409 >> v2:172.21.15.150:3300/0 conn(0x7f43c4160370 0x7f43c406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:25.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43c937b700 1 --2- 172.21.15.49:0/1756104409 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43c40c1470 0x7f43c40c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:25.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43c8b7a700 1 -- 172.21.15.49:0/1756104409 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820740312 0 0) 0x7f43c406e010 con 0x7f43c40ca2c0 2023-07-21T22:11:25.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43c8b7a700 1 -- 172.21.15.49:0/1756104409 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b00035d0 con 0x7f43c40ca2c0 2023-07-21T22:11:25.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43c9b7c700 1 -- 172.21.15.49:0/1756104409 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43c40c1470 msgr2=0x7f43c40c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:25.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43c9b7c700 1 --2- 172.21.15.49:0/1756104409 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43c40c1470 0x7f43c40c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43c9b7c700 1 -- 172.21.15.49:0/1756104409 >> v1:172.21.15.49:6789/0 conn(0x7f43c40ca2c0 legacy=0x7f43c40caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:25.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43c9b7c700 1 -- 172.21.15.49:0/1756104409 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c40afc90 con 0x7f43c4160370 2023-07-21T22:11:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43c9b7c700 1 --2- 172.21.15.49:0/1756104409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c4160370 0x7f43c406d7e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009d90 tx=0x7f43c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1a19d7d6c5236b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43c8b7a700 1 -- 172.21.15.49:0/1756104409 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c000e070 con 0x7f43c4160370 2023-07-21T22:11:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43c8b7a700 1 -- 172.21.15.49:0/1756104409 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c000bb20 con 0x7f43c4160370 2023-07-21T22:11:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43c8b7a700 1 -- 172.21.15.49:0/1756104409 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0012430 con 0x7f43c4160370 2023-07-21T22:11:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43cab7e700 1 -- 172.21.15.49:0/1756104409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c4160370 msgr2=0x7f43c406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.705+0000 7f43cab7e700 1 --2- 172.21.15.49:0/1756104409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c4160370 0x7f43c406d7e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009d90 tx=0x7f43c000b330 comp rx=0 tx=0).stop 2023-07-21T22:11:25.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.709+0000 7f43cab7e700 1 -- 172.21.15.49:0/1756104409 shutdown_connections 2023-07-21T22:11:25.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.709+0000 7f43cab7e700 1 --2- 172.21.15.49:0/1756104409 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43c40c1470 0x7f43c40c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.709+0000 7f43cab7e700 1 --2- 172.21.15.49:0/1756104409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c4160370 0x7f43c406d7e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.709+0000 7f43cab7e700 1 -- 172.21.15.49:0/1756104409 >> 172.21.15.49:0/1756104409 conn(0x7f43c4070450 msgr2=0x7f43c4070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:25.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.709+0000 7f43cab7e700 1 -- 172.21.15.49:0/1756104409 shutdown_connections 2023-07-21T22:11:25.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.709+0000 7f43cab7e700 1 -- 172.21.15.49:0/1756104409 wait complete. 2023-07-21T22:11:25.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43cab7e700 1 Processor -- start 2023-07-21T22:11:25.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43cab7e700 1 -- start start 2023-07-21T22:11:25.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43cab7e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43c40c1470 0x7f43c41f9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:25.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43cab7e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c40ca2c0 0x7f43c40ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:25.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43cab7e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43c4160370 0x7f43c40c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:25.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43cab7e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c7560 con 0x7f43c40c1470 2023-07-21T22:11:25.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43cab7e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c41f93a0 con 0x7f43c40ca2c0 2023-07-21T22:11:25.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43cab7e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c41f9680 con 0x7f43c4160370 2023-07-21T22:11:25.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43c9b7c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43c40c1470 0x7f43c41f9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:25.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43c9b7c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43c40c1470 0x7f43c41f9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58160/0 (socket says 172.21.15.49:58160) 2023-07-21T22:11:25.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43c9b7c700 1 -- 172.21.15.49:0/2704439477 learned_addr learned my addr 172.21.15.49:0/2704439477 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:25.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43c937b700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c40ca2c0 0x7f43c40ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:25.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43ca37d700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43c4160370 0x7f43c40c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:25.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43c9b7c700 1 -- 172.21.15.49:0/2704439477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43c4160370 msgr2=0x7f43c40c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:25.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43c9b7c700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43c4160370 0x7f43c40c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43c9b7c700 1 -- 172.21.15.49:0/2704439477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c40ca2c0 msgr2=0x7f43c40ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:25.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43c9b7c700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c40ca2c0 0x7f43c40ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43c9b7c700 1 -- 172.21.15.49:0/2704439477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0009a70 con 0x7f43c40c1470 2023-07-21T22:11:25.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43ca37d700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43c4160370 0x7f43c40c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:25.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.713+0000 7f43c9b7c700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43c40c1470 0x7f43c41f9e80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f43c0014040 tx=0x7f43c0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:25.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.717+0000 7f43ba7fc700 1 -- 172.21.15.49:0/2704439477 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0012430 con 0x7f43c40c1470 2023-07-21T22:11:25.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.717+0000 7f43ba7fc700 1 -- 172.21.15.49:0/2704439477 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c0020070 con 0x7f43c40c1470 2023-07-21T22:11:25.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.717+0000 7f43cab7e700 1 -- 172.21.15.49:0/2704439477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c41f9960 con 0x7f43c40c1470 2023-07-21T22:11:25.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.717+0000 7f43ba7fc700 1 -- 172.21.15.49:0/2704439477 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0004280 con 0x7f43c40c1470 2023-07-21T22:11:25.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.717+0000 7f43cab7e700 1 -- 172.21.15.49:0/2704439477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c41542f0 con 0x7f43c40c1470 2023-07-21T22:11:25.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.717+0000 7f43cab7e700 1 -- 172.21.15.49:0/2704439477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c404dcb0 con 0x7f43c40c1470 2023-07-21T22:11:25.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.717+0000 7f43ba7fc700 1 -- 172.21.15.49:0/2704439477 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f43c00043e0 con 0x7f43c40c1470 2023-07-21T22:11:25.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.721+0000 7f43ba7fc700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f43a80662f0 0x7f43a80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:25.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.721+0000 7f43ba7fc700 1 -- 172.21.15.49:0/2704439477 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f43c0022070 con 0x7f43c40c1470 2023-07-21T22:11:25.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.721+0000 7f43c937b700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f43a80662f0 0x7f43a80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:25.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.721+0000 7f43c937b700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f43a80662f0 0x7f43a80687a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f43c40c5070 tx=0x7f43b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:25.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.725+0000 7f43ba7fc700 1 -- 172.21.15.49:0/2704439477 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43c00532e0 con 0x7f43c40c1470 2023-07-21T22:11:25.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.941+0000 7f43cab7e700 1 -- 172.21.15.49:0/2704439477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f43c40ad7b0 con 0x7f43c40c1470 2023-07-21T22:11:25.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.941+0000 7f43ba7fc700 1 -- 172.21.15.49:0/2704439477 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f43c0056900 con 0x7f43c40c1470 2023-07-21T22:11:25.985 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-21T22:11:25.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.945+0000 7f43cab7e700 1 -- 172.21.15.49:0/2704439477 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f43a80662f0 msgr2=0x7f43a80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:25.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.945+0000 7f43cab7e700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f43a80662f0 0x7f43a80687a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f43c40c5070 tx=0x7f43b4008040 comp rx=0 tx=0).stop 2023-07-21T22:11:25.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.945+0000 7f43cab7e700 1 -- 172.21.15.49:0/2704439477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43c40c1470 msgr2=0x7f43c41f9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:25.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.945+0000 7f43cab7e700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43c40c1470 0x7f43c41f9e80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f43c0014040 tx=0x7f43c0004af0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.945+0000 7f43cab7e700 1 -- 172.21.15.49:0/2704439477 shutdown_connections 2023-07-21T22:11:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.945+0000 7f43cab7e700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f43a80662f0 0x7f43a80687a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.945+0000 7f43cab7e700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43c4160370 0x7f43c40c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.945+0000 7f43cab7e700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c40ca2c0 0x7f43c40ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.945+0000 7f43cab7e700 1 --2- 172.21.15.49:0/2704439477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43c40c1470 0x7f43c41f9e80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.945+0000 7f43cab7e700 1 -- 172.21.15.49:0/2704439477 >> 172.21.15.49:0/2704439477 conn(0x7f43c4070450 msgr2=0x7f43c40adab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:25.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.945+0000 7f43cab7e700 1 -- 172.21.15.49:0/2704439477 shutdown_connections 2023-07-21T22:11:25.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:25.945+0000 7f43cab7e700 1 -- 172.21.15.49:0/2704439477 wait complete. 2023-07-21T22:11:26.008 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:11:26.008 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:11:26.009 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2023-07-21T22:11:26.009 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-21T22:11:26.009 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-21T22:11:26.009 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:11:26.009 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:11:26.010 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:11:26.010 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-21T22:11:26.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:26.010 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2023-07-21T22:11:26.029 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:11:26.029 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:11:26.030 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:11:26.030 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.030 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-07-21T22:11:26.030 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.030 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:11:26.030 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:26.031 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2023-07-21T22:11:26.031 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:11:26.031 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:26.031 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2023-07-21T22:11:26.031 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:11:26.031 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:26.031 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:11:26.031 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:26.032 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-21T22:11:26.032 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42321sec preferred_lft 42321sec 2023-07-21T22:11:26.032 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2023-07-21T22:11:26.032 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.032 INFO:teuthology.orchestra.run.smithi150.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:11:26.032 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 02:42:9a:f4:f0:80 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:26.032 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:11:26.033 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.033 INFO:teuthology.orchestra.run.smithi150.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:11:26.033 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 7a:90:a7:5f:d0:76 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:11:26.033 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:11:26.033 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.033 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::2003:25ff:fedc:bb07/64 scope link 2023-07-21T22:11:26.033 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.033 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:11:26.034 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 7a:90:a7:5f:d0:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-21T22:11:26.034 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::7890:a7ff:fe5f:d076/64 scope link 2023-07-21T22:11:26.034 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:26.035 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:11:26.110 INFO:teuthology.orchestra.run.smithi150.stdout:1 2023-07-21T22:11:26.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:26.114 DEBUG:teuthology.orchestra.run.smithi150:> route 2023-07-21T22:11:26.176 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2023-07-21T22:11:26.176 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:11:26.177 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-21T22:11:26.177 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T22:11:26.177 INFO:teuthology.orchestra.run.smithi150.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:11:26.177 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-07-21T22:11:26.177 INFO:teuthology.orchestra.run.smithi150.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-21T22:11:26.177 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:11:26.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:26.178 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-07-21T22:11:26.178 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-07-21T22:11:26.178 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T22:11:26.179 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T22:11:26.179 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T22:11:26.179 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-07-21T22:11:26.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:26.311 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-07-21T22:11:26.329 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-21T22:11:26.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:26.331 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2023-07-21T22:11:26.391 INFO:teuthology.orchestra.run.smithi150.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-21T22:11:26.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:26.393 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-07-21T22:11:26.393 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-07-21T22:11:26.393 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-21T22:11:26.393 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-21T22:11:26.394 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-07-21T22:11:26.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:26.508 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-21T22:11:26.542 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:11:26.542 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:11:26.542 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:11:26.542 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.542 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-07-21T22:11:26.543 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.543 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:11:26.543 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether a2:24:39:90:69:1a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-21T22:11:26.543 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-21T22:11:26.543 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.544 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::a024:39ff:fe90:691a/64 scope link 2023-07-21T22:11:26.544 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:26.545 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-21T22:11:26.623 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:11:26.623 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:11:26.623 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:11:26.624 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.624 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-07-21T22:11:26.624 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.624 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:11:26.624 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether a2:24:39:90:69:1a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-21T22:11:26.624 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-21T22:11:26.625 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.625 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::a024:39ff:fe90:691a/64 scope link 2023-07-21T22:11:26.625 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:11:26.626 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-21T22:11:26.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:26.627 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-07-21T22:11:26.627 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-07-21T22:11:26.627 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-21T22:11:26.628 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-21T22:11:26.628 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-21T22:11:26.628 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-21T22:11:26.628 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-21T22:11:26.629 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-07-21T22:11:26.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:26.818 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-07-21T22:11:26.818 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-07-21T22:11:26.818 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.1 up 2023-07-21T22:11:26.818 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.1 master ceph-brx 2023-07-21T22:11:26.819 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-07-21T22:11:26.883 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-07-21T22:11:26.884 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:11:26.884 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-21T22:11:26.902 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-21T22:11:26.903 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:11:26.904 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-21T22:11:26.964 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2023-07-21T22:11:27.042 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:11:27.042 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:11:27.119 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:11:27.121 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:11:27.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:27.123 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2023-07-21T22:11:27.184 INFO:teuthology.orchestra.run.smithi150.stdout:49 2023-07-21T22:11:27.184 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2023-07-21T22:11:27.185 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-07-21T22:11:27.231 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2023-07-21T22:11:27.264 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:11:27.265 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:11:27.339 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:11:27.340 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:11:27.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:27.341 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2023-07-21T22:11:27.371 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:2023-07-21T22:11:27.325+0000 7f730994a640 -1 init, newargv = 0x562c441b8d20 newargc=15 2023-07-21T22:11:27.371 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:ceph-fuse[40481]: starting ceph client 2023-07-21T22:11:27.381 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:ceph-fuse[40481]: starting fuse 2023-07-21T22:11:27.384 INFO:teuthology.orchestra.run.smithi150.stdout:49 2023-07-21T22:11:27.384 INFO:teuthology.orchestra.run.smithi150.stdout:50 2023-07-21T22:11:27.385 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2023-07-21T22:11:27.385 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T22:11:27.385 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2023-07-21T22:11:27.386 DEBUG:teuthology.orchestra.run.smithi150:> import re 2023-07-21T22:11:27.386 DEBUG:teuthology.orchestra.run.smithi150:> import os 2023-07-21T22:11:27.386 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2023-07-21T22:11:27.386 DEBUG:teuthology.orchestra.run.smithi150:> 2023-07-21T22:11:27.386 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2023-07-21T22:11:27.387 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-07-21T22:11:27.387 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2023-07-21T22:11:27.387 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-07-21T22:11:27.387 DEBUG:teuthology.orchestra.run.smithi150:> 2023-07-21T22:11:27.388 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2023-07-21T22:11:27.388 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2023-07-21T22:11:27.388 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2023-07-21T22:11:27.388 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2023-07-21T22:11:27.389 DEBUG:teuthology.orchestra.run.smithi150:> 2023-07-21T22:11:27.389 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2023-07-21T22:11:27.389 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T22:11:27.389 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T22:11:27.389 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T22:11:27.390 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2023-07-21T22:11:27.390 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2023-07-21T22:11:27.390 DEBUG:teuthology.orchestra.run.smithi150:> return f 2023-07-21T22:11:27.390 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T22:11:27.391 DEBUG:teuthology.orchestra.run.smithi150:> 2023-07-21T22:11:27.391 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.3")) 2023-07-21T22:11:27.391 DEBUG:teuthology.orchestra.run.smithi150:> ' 2023-07-21T22:11:27.537 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.3.40481.asok 2023-07-21T22:11:27.724 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.40481.asok 2023-07-21T22:11:27.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:27.724 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.40481.asok status 2023-07-21T22:11:27.916 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2023-07-21T22:11:27.917 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2023-07-21T22:11:27.917 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea", 2023-07-21T22:11:27.917 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:11:27.917 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "3", 2023-07-21T22:11:27.917 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2023-07-21T22:11:27.917 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-07-21T22:11:27.918 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "40481", 2023-07-21T22:11:27.918 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2023-07-21T22:11:27.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-07-21T22:11:27.918 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2023-07-21T22:11:27.918 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2023-07-21T22:11:27.918 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4724, 2023-07-21T22:11:27.919 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2023-07-21T22:11:27.919 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2023-07-21T22:11:27.919 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2023-07-21T22:11:27.919 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4724 2023-07-21T22:11:27.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-07-21T22:11:27.919 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2023-07-21T22:11:27.919 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2023-07-21T22:11:27.919 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.2:0", 2023-07-21T22:11:27.920 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 249512768 2023-07-21T22:11:27.920 INFO:teuthology.orchestra.run.smithi150.stdout: } 2023-07-21T22:11:27.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-07-21T22:11:27.920 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2023-07-21T22:11:27.920 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2023-07-21T22:11:27.920 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.2:0", 2023-07-21T22:11:27.920 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 249512768 2023-07-21T22:11:27.921 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-07-21T22:11:27.921 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4724 192.168.0.2:0/249512768", 2023-07-21T22:11:27.921 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.2:0/249512768", 2023-07-21T22:11:27.921 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2023-07-21T22:11:27.921 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 9, 2023-07-21T22:11:27.921 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 32, 2023-07-21T22:11:27.921 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2023-07-21T22:11:27.922 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2023-07-21T22:11:27.922 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2023-07-21T22:11:27.922 INFO:teuthology.orchestra.run.smithi150.stdout:} 2023-07-21T22:11:27.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:27.932 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2023-07-21T22:11:27.933 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-21T22:11:27.954 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2023-07-21T22:11:27.954 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-21T22:11:27.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:27.955 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:11:28.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:28.038 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2023-07-21T22:11:28.038 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.2 2023-07-21T22:11:28.100 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2023-07-21T22:11:28.101 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-07-21T22:11:28.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:28.102 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-21T22:11:28.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:28.179 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2023-07-21T22:11:28.180 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.1 2023-07-21T22:11:28.200 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2023-07-21T22:11:28.200 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-07-21T22:11:28.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:28.201 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-21T22:11:28.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:28.275 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2023-07-21T22:11:28.275 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.3 2023-07-21T22:11:28.335 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2023-07-21T22:11:28.336 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-07-21T22:11:28.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:28.336 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-21T22:11:28.413 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-21T22:11:28.432 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:28.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.581+0000 7f5000d15700 1 Processor -- start 2023-07-21T22:11:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.581+0000 7f5000d15700 1 -- start start 2023-07-21T22:11:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f5000d15700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4ffc0cbc40 0x7f4ffc0c1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f5000d15700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ffc1601e0 0x7f4ffc0cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f5000d15700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ffc070f90 0x7f4ffc163b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f5000d15700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ffc0ca700 con 0x7f4ffc1601e0 2023-07-21T22:11:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f5000d15700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ffc0cc550 con 0x7f4ffc0cbc40 2023-07-21T22:11:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f5000d15700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc0ca980 con 0x7f4ffc070f90 2023-07-21T22:11:28.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ff2ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ffc1601e0 0x7f4ffc0cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:28.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ff2ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ffc1601e0 0x7f4ffc0cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58174/0 (socket says 172.21.15.49:58174) 2023-07-21T22:11:28.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ff2ffd700 1 -- 172.21.15.49:0/412913565 learned_addr learned my addr 172.21.15.49:0/412913565 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:28.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ffbfff700 1 --2- 172.21.15.49:0/412913565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ffc070f90 0x7f4ffc163b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:28.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ffb7fe700 1 --2- 172.21.15.49:0/412913565 >> v2:172.21.15.150:3300/0 conn(0x7f4ffc0cbc40 0x7f4ffc0c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:28.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ff2ffd700 1 -- 172.21.15.49:0/412913565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ffc070f90 msgr2=0x7f4ffc163b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:28.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ff2ffd700 1 --2- 172.21.15.49:0/412913565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ffc070f90 0x7f4ffc163b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:28.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ff2ffd700 1 -- 172.21.15.49:0/412913565 >> v2:172.21.15.150:3300/0 conn(0x7f4ffc0cbc40 msgr2=0x7f4ffc0c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:28.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ff2ffd700 1 --2- 172.21.15.49:0/412913565 >> v2:172.21.15.150:3300/0 conn(0x7f4ffc0cbc40 0x7f4ffc0c1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:28.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ff2ffd700 1 -- 172.21.15.49:0/412913565 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc0cac60 con 0x7f4ffc1601e0 2023-07-21T22:11:28.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ffb7fe700 1 --2- 172.21.15.49:0/412913565 >> v2:172.21.15.150:3300/0 conn(0x7f4ffc0cbc40 0x7f4ffc0c1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:28.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ff2ffd700 1 --2- 172.21.15.49:0/412913565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ffc1601e0 0x7f4ffc0cc010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc06b130 tx=0x7f4fe4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aedefb69271e27ea server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:28.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ffaffd700 1 -- 172.21.15.49:0/412913565 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe400b8a0 con 0x7f4ffc1601e0 2023-07-21T22:11:28.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ffaffd700 1 -- 172.21.15.49:0/412913565 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe400ba00 con 0x7f4ffc1601e0 2023-07-21T22:11:28.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f4ffaffd700 1 -- 172.21.15.49:0/412913565 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe400bd90 con 0x7f4ffc1601e0 2023-07-21T22:11:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f5000d15700 1 -- 172.21.15.49:0/412913565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ffc1601e0 msgr2=0x7f4ffc0cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.585+0000 7f5000d15700 1 --2- 172.21.15.49:0/412913565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ffc1601e0 0x7f4ffc0cc010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc06b130 tx=0x7f4fe4009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.589+0000 7f5000d15700 1 -- 172.21.15.49:0/412913565 shutdown_connections 2023-07-21T22:11:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.589+0000 7f5000d15700 1 --2- 172.21.15.49:0/412913565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ffc070f90 0x7f4ffc163b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.589+0000 7f5000d15700 1 --2- 172.21.15.49:0/412913565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ffc1601e0 0x7f4ffc0cc010 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.589+0000 7f5000d15700 1 --2- 172.21.15.49:0/412913565 >> v2:172.21.15.150:3300/0 conn(0x7f4ffc0cbc40 0x7f4ffc0c1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.589+0000 7f5000d15700 1 -- 172.21.15.49:0/412913565 >> 172.21.15.49:0/412913565 conn(0x7f4ffc06e960 msgr2=0x7f4ffc06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.589+0000 7f5000d15700 1 -- 172.21.15.49:0/412913565 shutdown_connections 2023-07-21T22:11:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.589+0000 7f5000d15700 1 -- 172.21.15.49:0/412913565 wait complete. 2023-07-21T22:11:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.589+0000 7f5000d15700 1 Processor -- start 2023-07-21T22:11:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.589+0000 7f5000d15700 1 -- start start 2023-07-21T22:11:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f5000d15700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ffc070f90 0x7f4ffc1505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:28.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f5000d15700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ffc0cbc40 0x7f4ffc0c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:28.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f5000d15700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ffc1601e0 0x7f4ffc0c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:28.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f5000d15700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc150ae0 con 0x7f4ffc0cbc40 2023-07-21T22:11:28.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f5000d15700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc0c3230 con 0x7f4ffc1601e0 2023-07-21T22:11:28.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f5000d15700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc0c2620 con 0x7f4ffc070f90 2023-07-21T22:11:28.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ff2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ffc0cbc40 0x7f4ffc0c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:28.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ff2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ffc0cbc40 0x7f4ffc0c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58182/0 (socket says 172.21.15.49:58182) 2023-07-21T22:11:28.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ff2ffd700 1 -- 172.21.15.49:0/3299728128 learned_addr learned my addr 172.21.15.49:0/3299728128 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:28.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ffbfff700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ffc1601e0 0x7f4ffc0c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:28.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ffb7fe700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ffc070f90 0x7f4ffc1505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:28.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ff2ffd700 1 -- 172.21.15.49:0/3299728128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ffc070f90 msgr2=0x7f4ffc1505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:28.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ff2ffd700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ffc070f90 0x7f4ffc1505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:28.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ff2ffd700 1 -- 172.21.15.49:0/3299728128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ffc1601e0 msgr2=0x7f4ffc0c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:28.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ff2ffd700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ffc1601e0 0x7f4ffc0c1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:28.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ff2ffd700 1 -- 172.21.15.49:0/3299728128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe4009570 con 0x7f4ffc0cbc40 2023-07-21T22:11:28.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ffbfff700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ffc1601e0 0x7f4ffc0c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:28.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ff2ffd700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ffc0cbc40 0x7f4ffc0c36c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4013000 tx=0x7f4fe4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:28.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ff8ff9700 1 -- 172.21.15.49:0/3299728128 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4004440 con 0x7f4ffc0cbc40 2023-07-21T22:11:28.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ff8ff9700 1 -- 172.21.15.49:0/3299728128 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe40045a0 con 0x7f4ffc0cbc40 2023-07-21T22:11:28.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f4ff8ff9700 1 -- 172.21.15.49:0/3299728128 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4011ae0 con 0x7f4ffc0cbc40 2023-07-21T22:11:28.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f5000d15700 1 -- 172.21.15.49:0/3299728128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ffc0c2900 con 0x7f4ffc0cbc40 2023-07-21T22:11:28.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.593+0000 7f5000d15700 1 -- 172.21.15.49:0/3299728128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ffc0c2ec0 con 0x7f4ffc0cbc40 2023-07-21T22:11:28.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.597+0000 7f5000d15700 1 -- 172.21.15.49:0/3299728128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ffc0c33e0 con 0x7f4ffc0cbc40 2023-07-21T22:11:28.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.597+0000 7f4ff8ff9700 1 -- 172.21.15.49:0/3299728128 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4fe4021070 con 0x7f4ffc0cbc40 2023-07-21T22:11:28.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.597+0000 7f4ff8ff9700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4fdc066320 0x7f4fdc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:28.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.601+0000 7f4ff8ff9700 1 -- 172.21.15.49:0/3299728128 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4fe4085aa0 con 0x7f4ffc0cbc40 2023-07-21T22:11:28.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.601+0000 7f4ffb7fe700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4fdc066320 0x7f4fdc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.601+0000 7f4ffb7fe700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4fdc066320 0x7f4fdc0687d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00a9a0 tx=0x7f4fec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:28.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.605+0000 7f4ff8ff9700 1 -- 172.21.15.49:0/3299728128 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4ffc0c33e0 con 0x7f4ffc0cbc40 2023-07-21T22:11:28.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.780+0000 7f5000d15700 1 -- 172.21.15.49:0/3299728128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ffc0c33a0 con 0x7f4ffc0cbc40 2023-07-21T22:11:28.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.780+0000 7f4ff8ff9700 1 -- 172.21.15.49:0/3299728128 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7f4fe4052d00 con 0x7f4ffc0cbc40 2023-07-21T22:11:28.825 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:28.826 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:28.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.784+0000 7f5000d15700 1 -- 172.21.15.49:0/3299728128 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4fdc066320 msgr2=0x7f4fdc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:28.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.784+0000 7f5000d15700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4fdc066320 0x7f4fdc0687d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00a9a0 tx=0x7f4fec008040 comp rx=0 tx=0).stop 2023-07-21T22:11:28.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.784+0000 7f5000d15700 1 -- 172.21.15.49:0/3299728128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ffc0cbc40 msgr2=0x7f4ffc0c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:28.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.784+0000 7f5000d15700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ffc0cbc40 0x7f4ffc0c36c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4013000 tx=0x7f4fe4004770 comp rx=0 tx=0).stop 2023-07-21T22:11:28.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.784+0000 7f5000d15700 1 -- 172.21.15.49:0/3299728128 shutdown_connections 2023-07-21T22:11:28.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.784+0000 7f5000d15700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4fdc066320 0x7f4fdc0687d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:28.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.784+0000 7f5000d15700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ffc0cbc40 0x7f4ffc0c36c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:28.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.784+0000 7f5000d15700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ffc1601e0 0x7f4ffc0c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:28.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.784+0000 7f5000d15700 1 --2- 172.21.15.49:0/3299728128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ffc070f90 0x7f4ffc1505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:28.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.784+0000 7f5000d15700 1 -- 172.21.15.49:0/3299728128 >> 172.21.15.49:0/3299728128 conn(0x7f4ffc06e960 msgr2=0x7f4ffc06bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:28.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.784+0000 7f5000d15700 1 -- 172.21.15.49:0/3299728128 shutdown_connections 2023-07-21T22:11:28.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.784+0000 7f5000d15700 1 -- 172.21.15.49:0/3299728128 wait complete. 2023-07-21T22:11:28.849 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:11:28.850 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:11:29.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.988+0000 7f10fa2c4700 1 Processor -- start 2023-07-21T22:11:29.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.988+0000 7f10fa2c4700 1 -- start start 2023-07-21T22:11:29.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10fa2c4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f10f40698a0 0x7f10f4069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10fa2c4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10f40aba80 0x7f10f40abf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10fa2c4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f406a230 con 0x7f10f40c9b80 2023-07-21T22:11:29.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10fa2c4700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f4160710 con 0x7f10f40aba80 2023-07-21T22:11:29.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10fa2c4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f415f880 con 0x7f10f40698a0 2023-07-21T22:11:29.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10f9ac3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10f40aba80 0x7f10f40abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10f9ac3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10f40aba80 0x7f10f40abf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58196/0 (socket says 172.21.15.49:58196) 2023-07-21T22:11:29.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10f9ac3700 1 -- 172.21.15.49:0/1827972529 learned_addr learned my addr 172.21.15.49:0/1827972529 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:29.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10f8ac1700 1 --2- 172.21.15.49:0/1827972529 >> v2:172.21.15.150:3300/0 conn(0x7f10f40698a0 0x7f10f4069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10f9ac3700 1 -- 172.21.15.49:0/1827972529 >> v2:172.21.15.150:3300/0 conn(0x7f10f40698a0 msgr2=0x7f10f4069cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:29.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10f9ac3700 1 --2- 172.21.15.49:0/1827972529 >> v2:172.21.15.150:3300/0 conn(0x7f10f40698a0 0x7f10f4069cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10f9ac3700 1 -- 172.21.15.49:0/1827972529 >> v1:172.21.15.150:6789/0 conn(0x7f10f40c9b80 legacy=0x7f10f40ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10f9ac3700 1 -- 172.21.15.49:0/1827972529 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f415fa90 con 0x7f10f40aba80 2023-07-21T22:11:29.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10f9ac3700 1 --2- 172.21.15.49:0/1827972529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40aba80 0x7f10f40abf00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f10f406b840 tx=0x7f10ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412a73688f551f26 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:29.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10ebfff700 1 -- 172.21.15.49:0/1827972529 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00e070 con 0x7f10f40aba80 2023-07-21T22:11:29.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10ebfff700 1 -- 172.21.15.49:0/1827972529 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec00b910 con 0x7f10f40aba80 2023-07-21T22:11:29.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.992+0000 7f10ebfff700 1 -- 172.21.15.49:0/1827972529 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00bcc0 con 0x7f10f40aba80 2023-07-21T22:11:29.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.996+0000 7f10fa2c4700 1 -- 172.21.15.49:0/1827972529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40aba80 msgr2=0x7f10f40abf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.996+0000 7f10fa2c4700 1 --2- 172.21.15.49:0/1827972529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40aba80 0x7f10f40abf00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f10f406b840 tx=0x7f10ec00b330 comp rx=0 tx=0).stop 2023-07-21T22:11:29.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.996+0000 7f10fa2c4700 1 -- 172.21.15.49:0/1827972529 shutdown_connections 2023-07-21T22:11:29.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.996+0000 7f10fa2c4700 1 --2- 172.21.15.49:0/1827972529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40aba80 0x7f10f40abf00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.996+0000 7f10fa2c4700 1 --2- 172.21.15.49:0/1827972529 >> v2:172.21.15.150:3300/0 conn(0x7f10f40698a0 0x7f10f4069cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.996+0000 7f10fa2c4700 1 -- 172.21.15.49:0/1827972529 >> 172.21.15.49:0/1827972529 conn(0x7f10f40ce0d0 msgr2=0x7f10f40ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:29.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.996+0000 7f10fa2c4700 1 -- 172.21.15.49:0/1827972529 shutdown_connections 2023-07-21T22:11:29.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.996+0000 7f10fa2c4700 1 -- 172.21.15.49:0/1827972529 wait complete. 2023-07-21T22:11:29.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:28.996+0000 7f10fa2c4700 1 Processor -- start 2023-07-21T22:11:29.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10fa2c4700 1 -- start start 2023-07-21T22:11:29.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10fa2c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f40698a0 0x7f10f41529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10fa2c4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f40aba80 0x7f10f415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10fa2c4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40c9b80 0x7f10f406c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10fa2c4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f4152ef0 con 0x7f10f40c9b80 2023-07-21T22:11:29.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10fa2c4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f415d4e0 con 0x7f10f40aba80 2023-07-21T22:11:29.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10fa2c4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f415d760 con 0x7f10f40698a0 2023-07-21T22:11:29.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10f9ac3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40c9b80 0x7f10f406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10f9ac3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40c9b80 0x7f10f406c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58200/0 (socket says 172.21.15.49:58200) 2023-07-21T22:11:29.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10f9ac3700 1 -- 172.21.15.49:0/4258695004 learned_addr learned my addr 172.21.15.49:0/4258695004 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:29.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10f92c2700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f40698a0 0x7f10f41529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10f8ac1700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f40aba80 0x7f10f415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10f9ac3700 1 -- 172.21.15.49:0/4258695004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f40698a0 msgr2=0x7f10f41529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10f9ac3700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f40698a0 0x7f10f41529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10f9ac3700 1 -- 172.21.15.49:0/4258695004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f40aba80 msgr2=0x7f10f415cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10f9ac3700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f40aba80 0x7f10f415cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10f9ac3700 1 -- 172.21.15.49:0/4258695004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec009b30 con 0x7f10f40c9b80 2023-07-21T22:11:29.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10f92c2700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f40698a0 0x7f10f41529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:29.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10f8ac1700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f40aba80 0x7f10f415cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:29.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10f9ac3700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40c9b80 0x7f10f406c300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f10f4071ec0 tx=0x7f10ec004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:29.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.000+0000 7f10e9ffb700 1 -- 172.21.15.49:0/4258695004 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0099b0 con 0x7f10f40c9b80 2023-07-21T22:11:29.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.004+0000 7f10e9ffb700 1 -- 172.21.15.49:0/4258695004 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec0092e0 con 0x7f10f40c9b80 2023-07-21T22:11:29.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.004+0000 7f10fa2c4700 1 -- 172.21.15.49:0/4258695004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f415da40 con 0x7f10f40c9b80 2023-07-21T22:11:29.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.004+0000 7f10e9ffb700 1 -- 172.21.15.49:0/4258695004 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec01c640 con 0x7f10f40c9b80 2023-07-21T22:11:29.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.004+0000 7f10fa2c4700 1 -- 172.21.15.49:0/4258695004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f40af5a0 con 0x7f10f40c9b80 2023-07-21T22:11:29.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.004+0000 7f10fa2c4700 1 -- 172.21.15.49:0/4258695004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f404dcb0 con 0x7f10f40c9b80 2023-07-21T22:11:29.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.008+0000 7f10e9ffb700 1 -- 172.21.15.49:0/4258695004 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10ec01c7a0 con 0x7f10f40c9b80 2023-07-21T22:11:29.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.008+0000 7f10e9ffb700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10d80662f0 0x7f10d80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.008+0000 7f10e9ffb700 1 -- 172.21.15.49:0/4258695004 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f10ec086150 con 0x7f10f40c9b80 2023-07-21T22:11:29.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.008+0000 7f10f92c2700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10d80662f0 0x7f10d80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.008+0000 7f10f92c2700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10d80662f0 0x7f10d80687a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f10f0000f60 tx=0x7f10f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:29.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.012+0000 7f10e9ffb700 1 -- 172.21.15.49:0/4258695004 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f10ec053550 con 0x7f10f40c9b80 2023-07-21T22:11:29.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.188+0000 7f10fa2c4700 1 -- 172.21.15.49:0/4258695004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10f40af790 con 0x7f10f40c9b80 2023-07-21T22:11:29.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.188+0000 7f10e9ffb700 1 -- 172.21.15.49:0/4258695004 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10ec056b70 con 0x7f10f40c9b80 2023-07-21T22:11:29.233 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:11:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.192+0000 7f10fa2c4700 1 -- 172.21.15.49:0/4258695004 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10d80662f0 msgr2=0x7f10d80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.192+0000 7f10fa2c4700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10d80662f0 0x7f10d80687a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f10f0000f60 tx=0x7f10f0009040 comp rx=0 tx=0).stop 2023-07-21T22:11:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.192+0000 7f10fa2c4700 1 -- 172.21.15.49:0/4258695004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40c9b80 msgr2=0x7f10f406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.192+0000 7f10fa2c4700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40c9b80 0x7f10f406c300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f10f4071ec0 tx=0x7f10ec004af0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.192+0000 7f10fa2c4700 1 -- 172.21.15.49:0/4258695004 shutdown_connections 2023-07-21T22:11:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.192+0000 7f10fa2c4700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10d80662f0 0x7f10d80687a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.192+0000 7f10fa2c4700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40c9b80 0x7f10f406c300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.192+0000 7f10fa2c4700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f40aba80 0x7f10f415cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.192+0000 7f10fa2c4700 1 --2- 172.21.15.49:0/4258695004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f40698a0 0x7f10f41529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.192+0000 7f10fa2c4700 1 -- 172.21.15.49:0/4258695004 >> 172.21.15.49:0/4258695004 conn(0x7f10f40ce0d0 msgr2=0x7f10f415b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:29.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.192+0000 7f10fa2c4700 1 -- 172.21.15.49:0/4258695004 shutdown_connections 2023-07-21T22:11:29.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.192+0000 7f10fa2c4700 1 -- 172.21.15.49:0/4258695004 wait complete. 2023-07-21T22:11:29.259 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:11:29.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.400+0000 7f668174c700 1 Processor -- start 2023-07-21T22:11:29.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.400+0000 7f668174c700 1 -- start start 2023-07-21T22:11:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.400+0000 7f668174c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f667c0cf520 0x7f667c0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.400+0000 7f668174c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c0b3e80 con 0x7f667c0b7af0 2023-07-21T22:11:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f668174c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c15fd40 con 0x7f667c0d1e40 2023-07-21T22:11:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f668174c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c0cea00 con 0x7f667c0cf520 2023-07-21T22:11:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f667c0b7af0 0x7f667c15f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46264/0 (socket says 172.21.15.49:46264) 2023-07-21T22:11:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667bfff700 1 -- 172.21.15.49:0/1136277 learned_addr learned my addr 172.21.15.49:0/1136277 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f6680f4b700 1 --2- 172.21.15.49:0/1136277 >> v2:172.21.15.150:3300/0 conn(0x7f667c0cf520 0x7f667c0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246680856 0 0) 0x7f667c0b3e80 con 0x7f667c0b7af0 2023-07-21T22:11:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66640035d0 con 0x7f667c0b7af0 2023-07-21T22:11:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840141945 0 0) 0x7f667c15fd40 con 0x7f667c0d1e40 2023-07-21T22:11:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f667c0b3e80 con 0x7f667c0d1e40 2023-07-21T22:11:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1329309822 0 0) 0x7f66640035d0 con 0x7f667c0b7af0 2023-07-21T22:11:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 >> v2:172.21.15.150:3300/0 conn(0x7f667c0cf520 msgr2=0x7f667c0b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 --2- 172.21.15.49:0/1136277 >> v2:172.21.15.150:3300/0 conn(0x7f667c0cf520 0x7f667c0b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 >> v1:172.21.15.150:6789/0 conn(0x7f667c0d1e40 legacy=0x7f667c0cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0ccbf0 con 0x7f667c0b7af0 2023-07-21T22:11:29.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f666c001670 con 0x7f667c0b7af0 2023-07-21T22:11:29.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 >> v1:172.21.15.49:6789/0 conn(0x7f667c0b7af0 legacy=0x7f667c15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 --2- 172.21.15.49:0/1136277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6664003bb0 0x7f6664003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 --2- 172.21.15.49:0/1136277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6664004870 0x7f6664004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 --2- 172.21.15.49:0/1136277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6664005220 0x7f666400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0cea00 con 0x7f6664004870 2023-07-21T22:11:29.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666400c080 con 0x7f6664003bb0 2023-07-21T22:11:29.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666400c240 con 0x7f6664005220 2023-07-21T22:11:29.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667b7fe700 1 --2- 172.21.15.49:0/1136277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6664004870 0x7f6664004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667bfff700 1 --2- 172.21.15.49:0/1136277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6664003bb0 0x7f6664003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f6680f4b700 1 --2- 172.21.15.49:0/1136277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6664005220 0x7f666400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667b7fe700 1 -- 172.21.15.49:0/1136277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6664005220 msgr2=0x7f666400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:29.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667b7fe700 1 --2- 172.21.15.49:0/1136277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6664005220 0x7f666400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667b7fe700 1 -- 172.21.15.49:0/1136277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6664003bb0 msgr2=0x7f6664003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667b7fe700 1 --2- 172.21.15.49:0/1136277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6664003bb0 0x7f6664003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f667b7fe700 1 -- 172.21.15.49:0/1136277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66640035d0 con 0x7f6664004870 2023-07-21T22:11:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.404+0000 7f6680f4b700 1 -- 172.21.15.49:0/1136277 reap_dead start 2023-07-21T22:11:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.408+0000 7f667b7fe700 1 --2- 172.21.15.49:0/1136277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6664004870 0x7f6664004ce0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6670001960 tx=0x7f66640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c5ce384fb696e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.408+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6670001450 con 0x7f6664004870 2023-07-21T22:11:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.408+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66700052f0 con 0x7f6664004870 2023-07-21T22:11:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.408+0000 7f667affd700 1 -- 172.21.15.49:0/1136277 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66700036a0 con 0x7f6664004870 2023-07-21T22:11:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.408+0000 7f668174c700 1 -- 172.21.15.49:0/1136277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6664004870 msgr2=0x7f6664004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.408+0000 7f668174c700 1 --2- 172.21.15.49:0/1136277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6664004870 0x7f6664004ce0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6670001960 tx=0x7f66640058a0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.408+0000 7f668174c700 1 -- 172.21.15.49:0/1136277 shutdown_connections 2023-07-21T22:11:29.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.408+0000 7f668174c700 1 --2- 172.21.15.49:0/1136277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6664004870 0x7f6664004ce0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.408+0000 7f668174c700 1 -- 172.21.15.49:0/1136277 >> 172.21.15.49:0/1136277 conn(0x7f667c06e960 msgr2=0x7f667c06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:29.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.408+0000 7f668174c700 1 -- 172.21.15.49:0/1136277 shutdown_connections 2023-07-21T22:11:29.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.408+0000 7f668174c700 1 -- 172.21.15.49:0/1136277 wait complete. 2023-07-21T22:11:29.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.412+0000 7f668174c700 1 Processor -- start 2023-07-21T22:11:29.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.412+0000 7f668174c700 1 -- start start 2023-07-21T22:11:29.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.412+0000 7f668174c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6664004870 0x7f667c14a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.412+0000 7f668174c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f667c14ce30 0x7f667c149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.412+0000 7f668174c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f667c0c94d0 0x7f667c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.412+0000 7f668174c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0c7c50 con 0x7f667c14ce30 2023-07-21T22:11:29.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.412+0000 7f668174c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c149d40 con 0x7f6664004870 2023-07-21T22:11:29.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.412+0000 7f668174c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0c72b0 con 0x7f667c0c94d0 2023-07-21T22:11:29.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.412+0000 7f667b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f667c14ce30 0x7f667c149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.412+0000 7f667b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f667c14ce30 0x7f667c149800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58210/0 (socket says 172.21.15.49:58210) 2023-07-21T22:11:29.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.412+0000 7f667b7fe700 1 -- 172.21.15.49:0/2942510655 learned_addr learned my addr 172.21.15.49:0/2942510655 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:29.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.412+0000 7f667bfff700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6664004870 0x7f667c14a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.412+0000 7f6680f4b700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f667c0c94d0 0x7f667c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.416+0000 7f667b7fe700 1 -- 172.21.15.49:0/2942510655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f667c0c94d0 msgr2=0x7f667c0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.416+0000 7f667b7fe700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f667c0c94d0 0x7f667c0b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.416+0000 7f667b7fe700 1 -- 172.21.15.49:0/2942510655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6664004870 msgr2=0x7f667c14a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.416+0000 7f667b7fe700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6664004870 0x7f667c14a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.416+0000 7f667b7fe700 1 -- 172.21.15.49:0/2942510655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0c7590 con 0x7f667c14ce30 2023-07-21T22:11:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.416+0000 7f667bfff700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6664004870 0x7f667c14a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.416+0000 7f667b7fe700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f667c14ce30 0x7f667c149800 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f666400c050 tx=0x7f66700012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.416+0000 7f6678ff9700 1 -- 172.21.15.49:0/2942510655 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6670006a90 con 0x7f667c14ce30 2023-07-21T22:11:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.416+0000 7f6678ff9700 1 -- 172.21.15.49:0/2942510655 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6670006bf0 con 0x7f667c14ce30 2023-07-21T22:11:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.416+0000 7f6678ff9700 1 -- 172.21.15.49:0/2942510655 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6670007040 con 0x7f667c14ce30 2023-07-21T22:11:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.416+0000 7f668174c700 1 -- 172.21.15.49:0/2942510655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c0c7870 con 0x7f667c14ce30 2023-07-21T22:11:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.416+0000 7f668174c700 1 -- 172.21.15.49:0/2942510655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c0b37a0 con 0x7f667c14ce30 2023-07-21T22:11:29.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.416+0000 7f668174c700 1 -- 172.21.15.49:0/2942510655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c0c73f0 con 0x7f667c14ce30 2023-07-21T22:11:29.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.416+0000 7f6678ff9700 1 -- 172.21.15.49:0/2942510655 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f66700071a0 con 0x7f667c14ce30 2023-07-21T22:11:29.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.420+0000 7f6678ff9700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f66680662f0 0x7f66680687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.420+0000 7f6678ff9700 1 -- 172.21.15.49:0/2942510655 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f66700849e0 con 0x7f667c14ce30 2023-07-21T22:11:29.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.420+0000 7f667bfff700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f66680662f0 0x7f66680687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.420+0000 7f667bfff700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f66680662f0 0x7f66680687a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f666c001eb0 tx=0x7f666c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:29.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.428+0000 7f6678ff9700 1 -- 172.21.15.49:0/2942510655 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f667c0c73f0 con 0x7f667c14ce30 2023-07-21T22:11:29.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.600+0000 7f668174c700 1 -- 172.21.15.49:0/2942510655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f667c0c73f0 con 0x7f667c14ce30 2023-07-21T22:11:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.600+0000 7f6678ff9700 1 -- 172.21.15.49:0/2942510655 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f667c0c73f0 con 0x7f667c14ce30 2023-07-21T22:11:29.646 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:11:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.604+0000 7f668174c700 1 -- 172.21.15.49:0/2942510655 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f66680662f0 msgr2=0x7f66680687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.604+0000 7f668174c700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f66680662f0 0x7f66680687a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f666c001eb0 tx=0x7f666c009040 comp rx=0 tx=0).stop 2023-07-21T22:11:29.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.604+0000 7f668174c700 1 -- 172.21.15.49:0/2942510655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f667c14ce30 msgr2=0x7f667c149800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.604+0000 7f668174c700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f667c14ce30 0x7f667c149800 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f666400c050 tx=0x7f66700012d0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.604+0000 7f668174c700 1 -- 172.21.15.49:0/2942510655 shutdown_connections 2023-07-21T22:11:29.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.604+0000 7f668174c700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f66680662f0 0x7f66680687a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.604+0000 7f668174c700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f667c14ce30 0x7f667c149800 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.604+0000 7f668174c700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f667c0c94d0 0x7f667c0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.604+0000 7f668174c700 1 --2- 172.21.15.49:0/2942510655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6664004870 0x7f667c14a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.604+0000 7f668174c700 1 -- 172.21.15.49:0/2942510655 >> 172.21.15.49:0/2942510655 conn(0x7f667c06e960 msgr2=0x7f667c15ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.604+0000 7f668174c700 1 -- 172.21.15.49:0/2942510655 shutdown_connections 2023-07-21T22:11:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.604+0000 7f668174c700 1 -- 172.21.15.49:0/2942510655 wait complete. 2023-07-21T22:11:29.671 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:11:29.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.808+0000 7f1d295dc700 1 Processor -- start 2023-07-21T22:11:29.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.808+0000 7f1d295dc700 1 -- start start 2023-07-21T22:11:29.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d295dc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d24071220 0x7f1d240cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d295dc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d240cdf00 con 0x7f1d24071670 2023-07-21T22:11:29.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d295dc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d240ce600 con 0x7f1d24160110 2023-07-21T22:11:29.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d295dc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d240cd730 con 0x7f1d24071220 2023-07-21T22:11:29.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d237fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1d24071670 0x7f1d24163d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46268/0 (socket says 172.21.15.49:46268) 2023-07-21T22:11:29.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d237fe700 1 -- 172.21.15.49:0/663427915 learned_addr learned my addr 172.21.15.49:0/663427915 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:29.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d227fc700 1 --2- 172.21.15.49:0/663427915 >> v2:172.21.15.49:3300/0 conn(0x7f1d24071220 0x7f1d240cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d227fc700 1 -- 172.21.15.49:0/663427915 >> v1:172.21.15.150:6789/0 conn(0x7f1d24160110 legacy=0x7f1d240cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d227fc700 1 -- 172.21.15.49:0/663427915 >> v1:172.21.15.49:6789/0 conn(0x7f1d24071670 legacy=0x7f1d24163d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d227fc700 1 -- 172.21.15.49:0/663427915 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2406e190 con 0x7f1d24071220 2023-07-21T22:11:29.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d227fc700 1 --2- 172.21.15.49:0/663427915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d24071220 0x7f1d240cabe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009840 tx=0x7f1d18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534e08e8031ea71c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:29.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d21ffb700 1 -- 172.21.15.49:0/663427915 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18005e50 con 0x7f1d24071220 2023-07-21T22:11:29.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d21ffb700 1 -- 172.21.15.49:0/663427915 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d18006030 con 0x7f1d24071220 2023-07-21T22:11:29.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d21ffb700 1 -- 172.21.15.49:0/663427915 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d180063c0 con 0x7f1d24071220 2023-07-21T22:11:29.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d295dc700 1 -- 172.21.15.49:0/663427915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d24071220 msgr2=0x7f1d240cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d295dc700 1 --2- 172.21.15.49:0/663427915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d24071220 0x7f1d240cabe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009840 tx=0x7f1d18009b50 comp rx=0 tx=0).stop 2023-07-21T22:11:29.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d295dc700 1 -- 172.21.15.49:0/663427915 shutdown_connections 2023-07-21T22:11:29.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d295dc700 1 --2- 172.21.15.49:0/663427915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d24071220 0x7f1d240cabe0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d295dc700 1 -- 172.21.15.49:0/663427915 >> 172.21.15.49:0/663427915 conn(0x7f1d2406e960 msgr2=0x7f1d2406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:29.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d295dc700 1 -- 172.21.15.49:0/663427915 shutdown_connections 2023-07-21T22:11:29.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.812+0000 7f1d295dc700 1 -- 172.21.15.49:0/663427915 wait complete. 2023-07-21T22:11:29.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.816+0000 7f1d295dc700 1 Processor -- start 2023-07-21T22:11:29.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.816+0000 7f1d295dc700 1 -- start start 2023-07-21T22:11:29.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.816+0000 7f1d295dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d24071220 0x7f1d24164640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.816+0000 7f1d295dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d24071670 0x7f1d241604e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d295dc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d24160110 0x7f1d2414f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d295dc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d24152f40 con 0x7f1d24071670 2023-07-21T22:11:29.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d295dc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d24160ba0 con 0x7f1d24160110 2023-07-21T22:11:29.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d295dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d24160e80 con 0x7f1d24071220 2023-07-21T22:11:29.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d227fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d24071670 0x7f1d241604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d227fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d24071670 0x7f1d241604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58218/0 (socket says 172.21.15.49:58218) 2023-07-21T22:11:29.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d227fc700 1 -- 172.21.15.49:0/379472305 learned_addr learned my addr 172.21.15.49:0/379472305 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:29.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d22ffd700 1 --2- 172.21.15.49:0/379472305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d24071220 0x7f1d24164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d237fe700 1 --2- 172.21.15.49:0/379472305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d24160110 0x7f1d2414f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d227fc700 1 -- 172.21.15.49:0/379472305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d24071220 msgr2=0x7f1d24164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d227fc700 1 --2- 172.21.15.49:0/379472305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d24071220 0x7f1d24164640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d227fc700 1 -- 172.21.15.49:0/379472305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d24160110 msgr2=0x7f1d2414f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:29.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d227fc700 1 --2- 172.21.15.49:0/379472305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d24160110 0x7f1d2414f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:29.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d227fc700 1 -- 172.21.15.49:0/379472305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d18009450 con 0x7f1d24071670 2023-07-21T22:11:29.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d227fc700 1 --2- 172.21.15.49:0/379472305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d24071670 0x7f1d241604e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009b90 tx=0x7f1d18004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:29.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d0b7fe700 1 -- 172.21.15.49:0/379472305 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18003ad0 con 0x7f1d24071670 2023-07-21T22:11:29.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d0b7fe700 1 -- 172.21.15.49:0/379472305 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d18003c30 con 0x7f1d24071670 2023-07-21T22:11:29.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d0b7fe700 1 -- 172.21.15.49:0/379472305 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d180061a0 con 0x7f1d24071670 2023-07-21T22:11:29.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d295dc700 1 -- 172.21.15.49:0/379472305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d24161160 con 0x7f1d24071670 2023-07-21T22:11:29.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.820+0000 7f1d295dc700 1 -- 172.21.15.49:0/379472305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d24161720 con 0x7f1d24071670 2023-07-21T22:11:29.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.824+0000 7f1d295dc700 1 -- 172.21.15.49:0/379472305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d24161960 con 0x7f1d24071670 2023-07-21T22:11:29.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.824+0000 7f1d0b7fe700 1 -- 172.21.15.49:0/379472305 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1d18022070 con 0x7f1d24071670 2023-07-21T22:11:29.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.828+0000 7f1d0b7fe700 1 --2- 172.21.15.49:0/379472305 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1d100662f0 0x7f1d100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:29.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.828+0000 7f1d0b7fe700 1 -- 172.21.15.49:0/379472305 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1d18085a00 con 0x7f1d24071670 2023-07-21T22:11:29.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.828+0000 7f1d22ffd700 1 --2- 172.21.15.49:0/379472305 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1d100662f0 0x7f1d100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:29.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.828+0000 7f1d22ffd700 1 --2- 172.21.15.49:0/379472305 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1d100662f0 0x7f1d100687a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1d14000f60 tx=0x7f1d14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:29.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:29.832+0000 7f1d0b7fe700 1 -- 172.21.15.49:0/379472305 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d24161960 con 0x7f1d24071670 2023-07-21T22:11:29.958 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:11:29.965 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:11:30.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.008+0000 7f1d295dc700 1 -- 172.21.15.49:0/379472305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d24161960 con 0x7f1d24071670 2023-07-21T22:11:30.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.008+0000 7f1d0b7fe700 1 -- 172.21.15.49:0/379472305 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d24161960 con 0x7f1d24071670 2023-07-21T22:11:30.053 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:30.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.012+0000 7f1d295dc700 1 -- 172.21.15.49:0/379472305 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1d100662f0 msgr2=0x7f1d100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:30.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.012+0000 7f1d295dc700 1 --2- 172.21.15.49:0/379472305 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1d100662f0 0x7f1d100687a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1d14000f60 tx=0x7f1d14009040 comp rx=0 tx=0).stop 2023-07-21T22:11:30.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.012+0000 7f1d295dc700 1 -- 172.21.15.49:0/379472305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d24071670 msgr2=0x7f1d241604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:30.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.012+0000 7f1d295dc700 1 --2- 172.21.15.49:0/379472305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d24071670 0x7f1d241604e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009b90 tx=0x7f1d18004770 comp rx=0 tx=0).stop 2023-07-21T22:11:30.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.012+0000 7f1d295dc700 1 -- 172.21.15.49:0/379472305 shutdown_connections 2023-07-21T22:11:30.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.012+0000 7f1d295dc700 1 --2- 172.21.15.49:0/379472305 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1d100662f0 0x7f1d100687a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.012+0000 7f1d295dc700 1 --2- 172.21.15.49:0/379472305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d24071670 0x7f1d241604e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.012+0000 7f1d295dc700 1 --2- 172.21.15.49:0/379472305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d24160110 0x7f1d2414f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.012+0000 7f1d295dc700 1 --2- 172.21.15.49:0/379472305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1d24071220 0x7f1d24164640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.012+0000 7f1d295dc700 1 -- 172.21.15.49:0/379472305 >> 172.21.15.49:0/379472305 conn(0x7f1d2406e960 msgr2=0x7f1d2406c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:30.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.012+0000 7f1d295dc700 1 -- 172.21.15.49:0/379472305 shutdown_connections 2023-07-21T22:11:30.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.012+0000 7f1d295dc700 1 -- 172.21.15.49:0/379472305 wait complete. 2023-07-21T22:11:30.080 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.268+0000 7f74bad70700 1 Processor -- start 2023-07-21T22:11:30.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.268+0000 7f74bad70700 1 -- start start 2023-07-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74bad70700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74b40cabe0 0x7f74b40cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74bad70700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f74b415f9d0 0x7f74b415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74bad70700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b40c88c0 con 0x7f74b40ce120 2023-07-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74bad70700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b415c220 con 0x7f74b40cabe0 2023-07-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74bad70700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b40ca620 con 0x7f74b415f9d0 2023-07-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74b930d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f74b40ce120 0x7f74b40ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46282/0 (socket says 172.21.15.49:46282) 2023-07-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74b930d700 1 -- 172.21.15.49:0/1663835636 learned_addr learned my addr 172.21.15.49:0/1663835636 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74b8b0c700 1 --2- 172.21.15.49:0/1663835636 >> v2:172.21.15.49:3300/0 conn(0x7f74b40cabe0 0x7f74b40cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74b3fff700 1 --2- 172.21.15.49:0/1663835636 >> v2:172.21.15.150:3300/0 conn(0x7f74b415f9d0 0x7f74b415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74b37fe700 1 -- 172.21.15.49:0/1663835636 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566560914 0 0) 0x7f74b40c88c0 con 0x7f74b40ce120 2023-07-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74b37fe700 1 -- 172.21.15.49:0/1663835636 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74a40035d0 con 0x7f74b40ce120 2023-07-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74b8b0c700 1 -- 172.21.15.49:0/1663835636 >> v2:172.21.15.150:3300/0 conn(0x7f74b415f9d0 msgr2=0x7f74b415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74b8b0c700 1 --2- 172.21.15.49:0/1663835636 >> v2:172.21.15.150:3300/0 conn(0x7f74b415f9d0 0x7f74b415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74b8b0c700 1 -- 172.21.15.49:0/1663835636 >> v1:172.21.15.49:6789/0 conn(0x7f74b40ce120 legacy=0x7f74b40ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74b8b0c700 1 -- 172.21.15.49:0/1663835636 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b40cb4f0 con 0x7f74b40cabe0 2023-07-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74b8b0c700 1 --2- 172.21.15.49:0/1663835636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74b40cabe0 0x7f74b40cafb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f74b406f7d0 tx=0x7f74a8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7455ff2da298c5d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74b37fe700 1 -- 172.21.15.49:0/1663835636 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8011830 con 0x7f74b40cabe0 2023-07-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74b37fe700 1 -- 172.21.15.49:0/1663835636 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a8011990 con 0x7f74b40cabe0 2023-07-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.272+0000 7f74b37fe700 1 -- 172.21.15.49:0/1663835636 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8011d20 con 0x7f74b40cabe0 2023-07-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.276+0000 7f74bad70700 1 -- 172.21.15.49:0/1663835636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74b40cabe0 msgr2=0x7f74b40cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.276+0000 7f74bad70700 1 --2- 172.21.15.49:0/1663835636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74b40cabe0 0x7f74b40cafb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f74b406f7d0 tx=0x7f74a8009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.276+0000 7f74bad70700 1 -- 172.21.15.49:0/1663835636 shutdown_connections 2023-07-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.276+0000 7f74bad70700 1 --2- 172.21.15.49:0/1663835636 >> v2:172.21.15.150:3300/0 conn(0x7f74b415f9d0 0x7f74b415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.276+0000 7f74bad70700 1 --2- 172.21.15.49:0/1663835636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74b40cabe0 0x7f74b40cafb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.276+0000 7f74bad70700 1 -- 172.21.15.49:0/1663835636 >> 172.21.15.49:0/1663835636 conn(0x7f74b406e960 msgr2=0x7f74b406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.276+0000 7f74bad70700 1 -- 172.21.15.49:0/1663835636 shutdown_connections 2023-07-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.276+0000 7f74bad70700 1 -- 172.21.15.49:0/1663835636 wait complete. 2023-07-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.276+0000 7f74bad70700 1 Processor -- start 2023-07-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.276+0000 7f74bad70700 1 -- start start 2023-07-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74bad70700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74b40cabe0 0x7f74b40c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74bad70700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74b40ce120 0x7f74b40c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74bad70700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74b415f9d0 0x7f74b415e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74bad70700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b40c7c00 con 0x7f74b40cabe0 2023-07-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74bad70700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b40c8090 con 0x7f74b40ce120 2023-07-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74bad70700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b40c6ff0 con 0x7f74b415f9d0 2023-07-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b8b0c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74b40cabe0 0x7f74b40c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b8b0c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74b40cabe0 0x7f74b40c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58222/0 (socket says 172.21.15.49:58222) 2023-07-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b8b0c700 1 -- 172.21.15.49:0/4234767320 learned_addr learned my addr 172.21.15.49:0/4234767320 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b3fff700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74b40ce120 0x7f74b40c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b930d700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74b415f9d0 0x7f74b415e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b8b0c700 1 -- 172.21.15.49:0/4234767320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74b415f9d0 msgr2=0x7f74b415e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b8b0c700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74b415f9d0 0x7f74b415e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b8b0c700 1 -- 172.21.15.49:0/4234767320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74b40ce120 msgr2=0x7f74b40c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b8b0c700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74b40ce120 0x7f74b40c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b8b0c700 1 -- 172.21.15.49:0/4234767320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a80094b0 con 0x7f74b40cabe0 2023-07-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b3fff700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74b40ce120 0x7f74b40c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b930d700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74b415f9d0 0x7f74b415e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b8b0c700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74b40cabe0 0x7f74b40c4380 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009ba0 tx=0x7f74a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b17fa700 1 -- 172.21.15.49:0/4234767320 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a80036c0 con 0x7f74b40cabe0 2023-07-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b17fa700 1 -- 172.21.15.49:0/4234767320 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a801e070 con 0x7f74b40cabe0 2023-07-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74bad70700 1 -- 172.21.15.49:0/4234767320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b40c72d0 con 0x7f74b40cabe0 2023-07-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74b17fa700 1 -- 172.21.15.49:0/4234767320 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8003a40 con 0x7f74b40cabe0 2023-07-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.280+0000 7f74bad70700 1 -- 172.21.15.49:0/4234767320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b40c7890 con 0x7f74b40cabe0 2023-07-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.284+0000 7f74bad70700 1 -- 172.21.15.49:0/4234767320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b404dd50 con 0x7f74b40cabe0 2023-07-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.284+0000 7f74b17fa700 1 -- 172.21.15.49:0/4234767320 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74a8003ba0 con 0x7f74b40cabe0 2023-07-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.284+0000 7f74b17fa700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f74980662f0 0x7f74980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.284+0000 7f74b17fa700 1 -- 172.21.15.49:0/4234767320 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f74a8084e60 con 0x7f74b40cabe0 2023-07-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.284+0000 7f74b3fff700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f74980662f0 0x7f74980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.288+0000 7f74b3fff700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f74980662f0 0x7f74980687a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f74b415ba10 tx=0x7f74a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.288+0000 7f74b17fa700 1 -- 172.21.15.49:0/4234767320 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74a8052040 con 0x7f74b40cabe0 2023-07-21T22:11:30.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.464+0000 7f74bad70700 1 -- 172.21.15.49:0/4234767320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74b4071000 con 0x7f74b40cabe0 2023-07-21T22:11:30.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.464+0000 7f74b17fa700 1 -- 172.21.15.49:0/4234767320 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f74a80200a0 con 0x7f74b40cabe0 2023-07-21T22:11:30.509 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:11:30.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.468+0000 7f74bad70700 1 -- 172.21.15.49:0/4234767320 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f74980662f0 msgr2=0x7f74980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:30.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.468+0000 7f74bad70700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f74980662f0 0x7f74980687a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f74b415ba10 tx=0x7f74a0008040 comp rx=0 tx=0).stop 2023-07-21T22:11:30.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.468+0000 7f74bad70700 1 -- 172.21.15.49:0/4234767320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74b40cabe0 msgr2=0x7f74b40c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:30.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.468+0000 7f74bad70700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74b40cabe0 0x7f74b40c4380 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009ba0 tx=0x7f74a8004770 comp rx=0 tx=0).stop 2023-07-21T22:11:30.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.468+0000 7f74bad70700 1 -- 172.21.15.49:0/4234767320 shutdown_connections 2023-07-21T22:11:30.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.468+0000 7f74bad70700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f74980662f0 0x7f74980687a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.468+0000 7f74bad70700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74b415f9d0 0x7f74b415e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.468+0000 7f74bad70700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74b40ce120 0x7f74b40c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.468+0000 7f74bad70700 1 --2- 172.21.15.49:0/4234767320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74b40cabe0 0x7f74b40c4380 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.468+0000 7f74bad70700 1 -- 172.21.15.49:0/4234767320 >> 172.21.15.49:0/4234767320 conn(0x7f74b406e960 msgr2=0x7f74b406cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:30.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.468+0000 7f74bad70700 1 -- 172.21.15.49:0/4234767320 shutdown_connections 2023-07-21T22:11:30.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.468+0000 7f74bad70700 1 -- 172.21.15.49:0/4234767320 wait complete. 2023-07-21T22:11:30.536 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:11:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.680+0000 7f137e3e0700 1 Processor -- start 2023-07-21T22:11:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.680+0000 7f137e3e0700 1 -- start start 2023-07-21T22:11:30.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.680+0000 7f137e3e0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f13780b4b20 0x7f13780cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:30.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.680+0000 7f137e3e0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f13780d0810 0x7f13780d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:30.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.680+0000 7f137e3e0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13780b8170 con 0x7f13780b4040 2023-07-21T22:11:30.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.680+0000 7f137e3e0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13780cfa20 con 0x7f13780b4b20 2023-07-21T22:11:30.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.680+0000 7f137e3e0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13780d03c0 con 0x7f13780d0810 2023-07-21T22:11:30.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f1377fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f13780b4040 0x7f13780b4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:53446/0 (socket says 172.21.15.49:53446) 2023-07-21T22:11:30.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f1377fff700 1 -- 172.21.15.49:0/2490234843 learned_addr learned my addr 172.21.15.49:0/2490234843 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f136ffff700 1 --2- 172.21.15.49:0/2490234843 >> v2:172.21.15.49:3300/0 conn(0x7f13780b4b20 0x7f13780cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f137c97d700 1 --2- 172.21.15.49:0/2490234843 >> v2:172.21.15.150:3300/0 conn(0x7f13780d0810 0x7f13780d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f136ffff700 1 -- 172.21.15.49:0/2490234843 >> v2:172.21.15.150:3300/0 conn(0x7f13780d0810 msgr2=0x7f13780d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f136ffff700 1 --2- 172.21.15.49:0/2490234843 >> v2:172.21.15.150:3300/0 conn(0x7f13780d0810 0x7f13780d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f136ffff700 1 -- 172.21.15.49:0/2490234843 >> v1:172.21.15.150:6789/0 conn(0x7f13780b4040 legacy=0x7f13780b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f136ffff700 1 -- 172.21.15.49:0/2490234843 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780d2350 con 0x7f13780b4b20 2023-07-21T22:11:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f13777fe700 1 -- 172.21.15.49:0/2490234843 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370934493 0 0) 0x7f13780b8170 con 0x7f13780b4040 2023-07-21T22:11:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f136ffff700 1 --2- 172.21.15.49:0/2490234843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13780b4b20 0x7f13780cf320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1378070ac0 tx=0x7f1360009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a164853d173eea2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:30.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f13777fe700 1 -- 172.21.15.49:0/2490234843 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360011830 con 0x7f13780b4b20 2023-07-21T22:11:30.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f13777fe700 1 -- 172.21.15.49:0/2490234843 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1360011990 con 0x7f13780b4b20 2023-07-21T22:11:30.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f13777fe700 1 -- 172.21.15.49:0/2490234843 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360011d20 con 0x7f13780b4b20 2023-07-21T22:11:30.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f137e3e0700 1 -- 172.21.15.49:0/2490234843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13780b4b20 msgr2=0x7f13780cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:30.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f137e3e0700 1 --2- 172.21.15.49:0/2490234843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13780b4b20 0x7f13780cf320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1378070ac0 tx=0x7f1360009b30 comp rx=0 tx=0).stop 2023-07-21T22:11:30.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f137e3e0700 1 -- 172.21.15.49:0/2490234843 shutdown_connections 2023-07-21T22:11:30.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f137e3e0700 1 --2- 172.21.15.49:0/2490234843 >> v2:172.21.15.150:3300/0 conn(0x7f13780d0810 0x7f13780d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f137e3e0700 1 --2- 172.21.15.49:0/2490234843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13780b4b20 0x7f13780cf320 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f137e3e0700 1 -- 172.21.15.49:0/2490234843 >> 172.21.15.49:0/2490234843 conn(0x7f13780658e0 msgr2=0x7f137806fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:30.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f137e3e0700 1 -- 172.21.15.49:0/2490234843 shutdown_connections 2023-07-21T22:11:30.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.684+0000 7f137e3e0700 1 -- 172.21.15.49:0/2490234843 wait complete. 2023-07-21T22:11:30.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.688+0000 7f137e3e0700 1 Processor -- start 2023-07-21T22:11:30.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.688+0000 7f137e3e0700 1 -- start start 2023-07-21T22:11:30.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.688+0000 7f137e3e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13780b4040 0x7f137814c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:30.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.688+0000 7f137e3e0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13780b4b20 0x7f137815c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:30.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.688+0000 7f137e3e0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13780d0810 0x7f137815c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:30.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.688+0000 7f137e3e0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137814c620 con 0x7f13780d0810 2023-07-21T22:11:30.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.688+0000 7f137e3e0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137815dbe0 con 0x7f13780b4b20 2023-07-21T22:11:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.688+0000 7f137e3e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137815cfd0 con 0x7f13780b4040 2023-07-21T22:11:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f137c97d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13780d0810 0x7f137815c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:30.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f137c97d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13780d0810 0x7f137815c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58236/0 (socket says 172.21.15.49:58236) 2023-07-21T22:11:30.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f1377fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13780b4040 0x7f137814c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:30.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f137c97d700 1 -- 172.21.15.49:0/1282210365 learned_addr learned my addr 172.21.15.49:0/1282210365 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:30.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f136ffff700 1 --2- 172.21.15.49:0/1282210365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13780b4b20 0x7f137815c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:30.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f137c97d700 1 -- 172.21.15.49:0/1282210365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13780b4040 msgr2=0x7f137814c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:30.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f137c97d700 1 --2- 172.21.15.49:0/1282210365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13780b4040 0x7f137814c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f137c97d700 1 -- 172.21.15.49:0/1282210365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13780b4b20 msgr2=0x7f137815c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:30.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f137c97d700 1 --2- 172.21.15.49:0/1282210365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13780b4b20 0x7f137815c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f137c97d700 1 -- 172.21.15.49:0/1282210365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600094b0 con 0x7f13780d0810 2023-07-21T22:11:30.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f137c97d700 1 --2- 172.21.15.49:0/1282210365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13780d0810 0x7f137815c9a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f137000efc0 tx=0x7f137000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f13757fa700 1 -- 172.21.15.49:0/1282210365 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370009ea0 con 0x7f13780d0810 2023-07-21T22:11:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f13757fa700 1 -- 172.21.15.49:0/1282210365 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137000f040 con 0x7f13780d0810 2023-07-21T22:11:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f13757fa700 1 -- 172.21.15.49:0/1282210365 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000ced0 con 0x7f13780d0810 2023-07-21T22:11:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f137e3e0700 1 -- 172.21.15.49:0/1282210365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137815d2b0 con 0x7f13780d0810 2023-07-21T22:11:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f137e3e0700 1 -- 172.21.15.49:0/1282210365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137815d870 con 0x7f13780d0810 2023-07-21T22:11:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.692+0000 7f137e3e0700 1 -- 172.21.15.49:0/1282210365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137815dd50 con 0x7f13780d0810 2023-07-21T22:11:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.696+0000 7f13757fa700 1 -- 172.21.15.49:0/1282210365 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1370014480 con 0x7f13780d0810 2023-07-21T22:11:30.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.696+0000 7f13757fa700 1 --2- 172.21.15.49:0/1282210365 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f13580662f0 0x7f13580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:30.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.700+0000 7f13757fa700 1 -- 172.21.15.49:0/1282210365 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1370084bc0 con 0x7f13780d0810 2023-07-21T22:11:30.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.700+0000 7f1377fff700 1 --2- 172.21.15.49:0/1282210365 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f13580662f0 0x7f13580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:30.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.700+0000 7f1377fff700 1 --2- 172.21.15.49:0/1282210365 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f13580662f0 0x7f13580687a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1368000f60 tx=0x7f1368007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.704+0000 7f13757fa700 1 -- 172.21.15.49:0/1282210365 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1370051d20 con 0x7f13780d0810 2023-07-21T22:11:30.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.880+0000 7f137e3e0700 1 -- 172.21.15.49:0/1282210365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f13780cd340 con 0x7f13780d0810 2023-07-21T22:11:30.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.884+0000 7f13757fa700 1 -- 172.21.15.49:0/1282210365 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f13700180a0 con 0x7f13780d0810 2023-07-21T22:11:30.927 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:30.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.888+0000 7f137e3e0700 1 -- 172.21.15.49:0/1282210365 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f13580662f0 msgr2=0x7f13580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:30.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.888+0000 7f137e3e0700 1 --2- 172.21.15.49:0/1282210365 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f13580662f0 0x7f13580687a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1368000f60 tx=0x7f1368007e90 comp rx=0 tx=0).stop 2023-07-21T22:11:30.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.888+0000 7f137e3e0700 1 -- 172.21.15.49:0/1282210365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13780d0810 msgr2=0x7f137815c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:30.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.888+0000 7f137e3e0700 1 --2- 172.21.15.49:0/1282210365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13780d0810 0x7f137815c9a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f137000efc0 tx=0x7f137000c3a0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.888+0000 7f137e3e0700 1 -- 172.21.15.49:0/1282210365 shutdown_connections 2023-07-21T22:11:30.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.888+0000 7f137e3e0700 1 --2- 172.21.15.49:0/1282210365 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f13580662f0 0x7f13580687a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.888+0000 7f137e3e0700 1 --2- 172.21.15.49:0/1282210365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13780d0810 0x7f137815c9a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.888+0000 7f137e3e0700 1 --2- 172.21.15.49:0/1282210365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13780b4b20 0x7f137815c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.888+0000 7f137e3e0700 1 --2- 172.21.15.49:0/1282210365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13780b4040 0x7f137814c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:30.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.888+0000 7f137e3e0700 1 -- 172.21.15.49:0/1282210365 >> 172.21.15.49:0/1282210365 conn(0x7f13780658e0 msgr2=0x7f13780b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:30.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.888+0000 7f137e3e0700 1 -- 172.21.15.49:0/1282210365 shutdown_connections 2023-07-21T22:11:30.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:30.888+0000 7f137e3e0700 1 -- 172.21.15.49:0/1282210365 wait complete. 2023-07-21T22:11:30.953 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:31.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.080+0000 7f30a2513700 1 Processor -- start 2023-07-21T22:11:31.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.084+0000 7f30a2513700 1 -- start start 2023-07-21T22:11:31.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.084+0000 7f30a2513700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f309c159f60 0x7f309c0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.084+0000 7f30a2513700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309c0b0600 con 0x7f309c0b0160 2023-07-21T22:11:31.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.084+0000 7f30a2513700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309c15a470 con 0x7f309c06d5d0 2023-07-21T22:11:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.084+0000 7f30a2513700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309c15a750 con 0x7f309c159f60 2023-07-21T22:11:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.084+0000 7f3093fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f309c159f60 0x7f309c0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.084+0000 7f30a0ab0700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f309c0b0160 0x7f309c15d780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46294/0 (socket says 172.21.15.49:46294) 2023-07-21T22:11:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.084+0000 7f30a0ab0700 1 -- 172.21.15.49:0/1899080501 learned_addr learned my addr 172.21.15.49:0/1899080501 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:31.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f309b7fe700 1 -- 172.21.15.49:0/1899080501 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598814836 0 0) 0x7f309c0b0600 con 0x7f309c0b0160 2023-07-21T22:11:31.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f309b7fe700 1 -- 172.21.15.49:0/1899080501 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30880035d0 con 0x7f309c0b0160 2023-07-21T22:11:31.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f309b7fe700 1 -- 172.21.15.49:0/1899080501 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370659062 0 0) 0x7f309c15a470 con 0x7f309c06d5d0 2023-07-21T22:11:31.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f3093fff700 1 -- 172.21.15.49:0/1899080501 >> v1:172.21.15.150:6789/0 conn(0x7f309c06d5d0 legacy=0x7f309c06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f3093fff700 1 -- 172.21.15.49:0/1899080501 >> v1:172.21.15.49:6789/0 conn(0x7f309c0b0160 legacy=0x7f309c15d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f3093fff700 1 -- 172.21.15.49:0/1899080501 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c15aa30 con 0x7f309c159f60 2023-07-21T22:11:31.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f3093fff700 1 --2- 172.21.15.49:0/1899080501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f309c159f60 0x7f309c0afc20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3084009850 tx=0x7f3084009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b02d7cb434898c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:31.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f309b7fe700 1 -- 172.21.15.49:0/1899080501 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084011830 con 0x7f309c159f60 2023-07-21T22:11:31.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f309b7fe700 1 -- 172.21.15.49:0/1899080501 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3084011990 con 0x7f309c159f60 2023-07-21T22:11:31.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f309b7fe700 1 -- 172.21.15.49:0/1899080501 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084011d40 con 0x7f309c159f60 2023-07-21T22:11:31.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f30a2513700 1 -- 172.21.15.49:0/1899080501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f309c159f60 msgr2=0x7f309c0afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f30a2513700 1 --2- 172.21.15.49:0/1899080501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f309c159f60 0x7f309c0afc20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3084009850 tx=0x7f3084009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:31.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f30a2513700 1 -- 172.21.15.49:0/1899080501 shutdown_connections 2023-07-21T22:11:31.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f30a2513700 1 --2- 172.21.15.49:0/1899080501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f309c159f60 0x7f309c0afc20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f30a2513700 1 -- 172.21.15.49:0/1899080501 >> 172.21.15.49:0/1899080501 conn(0x7f309c06f5a0 msgr2=0x7f309c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f30a2513700 1 -- 172.21.15.49:0/1899080501 shutdown_connections 2023-07-21T22:11:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.088+0000 7f30a2513700 1 -- 172.21.15.49:0/1899080501 wait complete. 2023-07-21T22:11:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.092+0000 7f30a2513700 1 Processor -- start 2023-07-21T22:11:31.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.092+0000 7f30a2513700 1 -- start start 2023-07-21T22:11:31.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.092+0000 7f30a2513700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f309c06d5d0 0x7f309c0ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.092+0000 7f30a2513700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f309c0b0160 0x7f309c1f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.092+0000 7f30a2513700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f309c159f60 0x7f309c1ee980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30a2513700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c1f4fc0 con 0x7f309c159f60 2023-07-21T22:11:31.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30a2513700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c1eeec0 con 0x7f309c0b0160 2023-07-21T22:11:31.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30a2513700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309c1f1440 con 0x7f309c06d5d0 2023-07-21T22:11:31.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30a0ab0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f309c159f60 0x7f309c1ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30a0ab0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f309c159f60 0x7f309c1ee980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58262/0 (socket says 172.21.15.49:58262) 2023-07-21T22:11:31.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30a0ab0700 1 -- 172.21.15.49:0/4175749407 learned_addr learned my addr 172.21.15.49:0/4175749407 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:31.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f3093fff700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f309c0b0160 0x7f309c1f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f309bfff700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f309c06d5d0 0x7f309c0ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30a0ab0700 1 -- 172.21.15.49:0/4175749407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f309c06d5d0 msgr2=0x7f309c0ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30a0ab0700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f309c06d5d0 0x7f309c0ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30a0ab0700 1 -- 172.21.15.49:0/4175749407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f309c0b0160 msgr2=0x7f309c1f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30a0ab0700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f309c0b0160 0x7f309c1f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30a0ab0700 1 -- 172.21.15.49:0/4175749407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30840094b0 con 0x7f309c159f60 2023-07-21T22:11:31.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f309bfff700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f309c06d5d0 0x7f309c0ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:31.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30a0ab0700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f309c159f60 0x7f309c1ee980 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f309400cbb0 tx=0x7f309400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:31.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30997fa700 1 -- 172.21.15.49:0/4175749407 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309400a7b0 con 0x7f309c159f60 2023-07-21T22:11:31.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30997fa700 1 -- 172.21.15.49:0/4175749407 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309400a910 con 0x7f309c159f60 2023-07-21T22:11:31.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30a2513700 1 -- 172.21.15.49:0/4175749407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309c1f51b0 con 0x7f309c159f60 2023-07-21T22:11:31.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30997fa700 1 -- 172.21.15.49:0/4175749407 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309400ac80 con 0x7f309c159f60 2023-07-21T22:11:31.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.096+0000 7f30a2513700 1 -- 172.21.15.49:0/4175749407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309c1f5770 con 0x7f309c159f60 2023-07-21T22:11:31.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.100+0000 7f30a2513700 1 -- 172.21.15.49:0/4175749407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309c073130 con 0x7f309c159f60 2023-07-21T22:11:31.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.100+0000 7f30997fa700 1 -- 172.21.15.49:0/4175749407 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f309401b3b0 con 0x7f309c159f60 2023-07-21T22:11:31.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.100+0000 7f30997fa700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f307c0662f0 0x7f307c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.100+0000 7f30997fa700 1 -- 172.21.15.49:0/4175749407 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3094083990 con 0x7f309c159f60 2023-07-21T22:11:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.100+0000 7f309bfff700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f307c0662f0 0x7f307c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.104+0000 7f309bfff700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f307c0662f0 0x7f307c0687a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f308c000f60 tx=0x7f308c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:31.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.108+0000 7f30997fa700 1 -- 172.21.15.49:0/4175749407 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3094050af0 con 0x7f309c159f60 2023-07-21T22:11:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.288+0000 7f30a2513700 1 -- 172.21.15.49:0/4175749407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f309c1f5960 con 0x7f309c159f60 2023-07-21T22:11:31.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.292+0000 7f30997fa700 1 -- 172.21.15.49:0/4175749407 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7f3094054110 con 0x7f309c159f60 2023-07-21T22:11:31.337 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:31.338 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:31.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.300+0000 7f30a2513700 1 -- 172.21.15.49:0/4175749407 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f307c0662f0 msgr2=0x7f307c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.300+0000 7f30a2513700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f307c0662f0 0x7f307c0687a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f308c000f60 tx=0x7f308c009040 comp rx=0 tx=0).stop 2023-07-21T22:11:31.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.300+0000 7f30a2513700 1 -- 172.21.15.49:0/4175749407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f309c159f60 msgr2=0x7f309c1ee980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.300+0000 7f30a2513700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f309c159f60 0x7f309c1ee980 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f309400cbb0 tx=0x7f309400cbe0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.300+0000 7f30a2513700 1 -- 172.21.15.49:0/4175749407 shutdown_connections 2023-07-21T22:11:31.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.300+0000 7f30a2513700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f307c0662f0 0x7f307c0687a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.300+0000 7f30a2513700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f309c159f60 0x7f309c1ee980 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.300+0000 7f30a2513700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f309c0b0160 0x7f309c1f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.300+0000 7f30a2513700 1 --2- 172.21.15.49:0/4175749407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f309c06d5d0 0x7f309c0ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.300+0000 7f30a2513700 1 -- 172.21.15.49:0/4175749407 >> 172.21.15.49:0/4175749407 conn(0x7f309c06f5a0 msgr2=0x7f309c070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:31.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.300+0000 7f30a2513700 1 -- 172.21.15.49:0/4175749407 shutdown_connections 2023-07-21T22:11:31.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.300+0000 7f30a2513700 1 -- 172.21.15.49:0/4175749407 wait complete. 2023-07-21T22:11:31.364 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:11:31.365 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:11:31.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.504+0000 7f823ec27700 1 Processor -- start 2023-07-21T22:11:31.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.504+0000 7f823ec27700 1 -- start start 2023-07-21T22:11:31.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.504+0000 7f823ec27700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f82380c9b80 0x7f82380ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.504+0000 7f823ec27700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f82380aca90 0x7f8238069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.504+0000 7f823ec27700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823806a230 con 0x7f82380698a0 2023-07-21T22:11:31.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.504+0000 7f823ec27700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8238160710 con 0x7f82380aca90 2023-07-21T22:11:31.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823ec27700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823815f880 con 0x7f82380c9b80 2023-07-21T22:11:31.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823e426700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f82380aca90 0x7f8238069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823e426700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f82380aca90 0x7f8238069cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58268/0 (socket says 172.21.15.49:58268) 2023-07-21T22:11:31.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823e426700 1 -- 172.21.15.49:0/1178013568 learned_addr learned my addr 172.21.15.49:0/1178013568 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:31.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823dc25700 1 --2- 172.21.15.49:0/1178013568 >> v2:172.21.15.150:3300/0 conn(0x7f82380c9b80 0x7f82380ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823e426700 1 -- 172.21.15.49:0/1178013568 >> v2:172.21.15.150:3300/0 conn(0x7f82380c9b80 msgr2=0x7f82380ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823e426700 1 --2- 172.21.15.49:0/1178013568 >> v2:172.21.15.150:3300/0 conn(0x7f82380c9b80 0x7f82380ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823e426700 1 -- 172.21.15.49:0/1178013568 >> v1:172.21.15.150:6789/0 conn(0x7f82380698a0 legacy=0x7f82380afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823e426700 1 -- 172.21.15.49:0/1178013568 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823815fa90 con 0x7f82380aca90 2023-07-21T22:11:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823e426700 1 --2- 172.21.15.49:0/1178013568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82380aca90 0x7f8238069cf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f823806a940 tx=0x7f823000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc3220934d58316 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823cc23700 1 -- 172.21.15.49:0/1178013568 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823000e070 con 0x7f82380aca90 2023-07-21T22:11:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823cc23700 1 -- 172.21.15.49:0/1178013568 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823000b910 con 0x7f82380aca90 2023-07-21T22:11:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823cc23700 1 -- 172.21.15.49:0/1178013568 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823000bcc0 con 0x7f82380aca90 2023-07-21T22:11:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823ec27700 1 -- 172.21.15.49:0/1178013568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82380aca90 msgr2=0x7f8238069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.508+0000 7f823ec27700 1 --2- 172.21.15.49:0/1178013568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82380aca90 0x7f8238069cf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f823806a940 tx=0x7f823000b330 comp rx=0 tx=0).stop 2023-07-21T22:11:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.512+0000 7f823ec27700 1 -- 172.21.15.49:0/1178013568 shutdown_connections 2023-07-21T22:11:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.512+0000 7f823ec27700 1 --2- 172.21.15.49:0/1178013568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82380aca90 0x7f8238069cf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.512+0000 7f823ec27700 1 --2- 172.21.15.49:0/1178013568 >> v2:172.21.15.150:3300/0 conn(0x7f82380c9b80 0x7f82380ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.512+0000 7f823ec27700 1 -- 172.21.15.49:0/1178013568 >> 172.21.15.49:0/1178013568 conn(0x7f82380ce0d0 msgr2=0x7f82380ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.512+0000 7f823ec27700 1 -- 172.21.15.49:0/1178013568 shutdown_connections 2023-07-21T22:11:31.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.512+0000 7f823ec27700 1 -- 172.21.15.49:0/1178013568 wait complete. 2023-07-21T22:11:31.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.512+0000 7f823ec27700 1 Processor -- start 2023-07-21T22:11:31.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823ec27700 1 -- start start 2023-07-21T22:11:31.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823ec27700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82380698a0 0x7f823814e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823ec27700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82380aca90 0x7f82380b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823ec27700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82380c9b80 0x7f82380aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823ec27700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82380ad800 con 0x7f82380698a0 2023-07-21T22:11:31.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823ec27700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82380af4d0 con 0x7f82380c9b80 2023-07-21T22:11:31.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823ec27700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82380ace60 con 0x7f82380aca90 2023-07-21T22:11:31.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823dc25700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82380698a0 0x7f823814e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823dc25700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82380698a0 0x7f823814e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58284/0 (socket says 172.21.15.49:58284) 2023-07-21T22:11:31.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823dc25700 1 -- 172.21.15.49:0/139862933 learned_addr learned my addr 172.21.15.49:0/139862933 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:31.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823e426700 1 --2- 172.21.15.49:0/139862933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82380c9b80 0x7f82380aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823d424700 1 --2- 172.21.15.49:0/139862933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82380aca90 0x7f82380b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823dc25700 1 -- 172.21.15.49:0/139862933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82380aca90 msgr2=0x7f82380b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823dc25700 1 --2- 172.21.15.49:0/139862933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82380aca90 0x7f82380b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823dc25700 1 -- 172.21.15.49:0/139862933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82380c9b80 msgr2=0x7f82380aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823dc25700 1 --2- 172.21.15.49:0/139862933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82380c9b80 0x7f82380aea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823dc25700 1 -- 172.21.15.49:0/139862933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8230009b30 con 0x7f82380698a0 2023-07-21T22:11:31.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.516+0000 7f823dc25700 1 --2- 172.21.15.49:0/139862933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82380698a0 0x7f823814e040 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f823400e9d0 tx=0x7f823400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:31.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.520+0000 7f822e7fc700 1 -- 172.21.15.49:0/139862933 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8234009720 con 0x7f82380698a0 2023-07-21T22:11:31.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.520+0000 7f822e7fc700 1 -- 172.21.15.49:0/139862933 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823400ee70 con 0x7f82380698a0 2023-07-21T22:11:31.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.520+0000 7f823ec27700 1 -- 172.21.15.49:0/139862933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82380ad140 con 0x7f82380698a0 2023-07-21T22:11:31.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.520+0000 7f822e7fc700 1 -- 172.21.15.49:0/139862933 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823400ca50 con 0x7f82380698a0 2023-07-21T22:11:31.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.520+0000 7f823ec27700 1 -- 172.21.15.49:0/139862933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823815aec0 con 0x7f82380698a0 2023-07-21T22:11:31.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.520+0000 7f823ec27700 1 -- 172.21.15.49:0/139862933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823804dcb0 con 0x7f82380698a0 2023-07-21T22:11:31.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.520+0000 7f822e7fc700 1 -- 172.21.15.49:0/139862933 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f823400cbb0 con 0x7f82380698a0 2023-07-21T22:11:31.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.524+0000 7f822e7fc700 1 --2- 172.21.15.49:0/139862933 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f821c0662f0 0x7f821c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.524+0000 7f822e7fc700 1 -- 172.21.15.49:0/139862933 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f82340841b0 con 0x7f82380698a0 2023-07-21T22:11:31.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.524+0000 7f823d424700 1 --2- 172.21.15.49:0/139862933 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f821c0662f0 0x7f821c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.524+0000 7f823d424700 1 --2- 172.21.15.49:0/139862933 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f821c0662f0 0x7f821c0687a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f82381f4fd0 tx=0x7f8228009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:31.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.528+0000 7f822e7fc700 1 -- 172.21.15.49:0/139862933 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8234054c70 con 0x7f82380698a0 2023-07-21T22:11:31.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.700+0000 7f823ec27700 1 -- 172.21.15.49:0/139862933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82380c9580 con 0x7f82380698a0 2023-07-21T22:11:31.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.704+0000 7f822e7fc700 1 -- 172.21.15.49:0/139862933 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f823400ce60 con 0x7f82380698a0 2023-07-21T22:11:31.747 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:11:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.704+0000 7f823ec27700 1 -- 172.21.15.49:0/139862933 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f821c0662f0 msgr2=0x7f821c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.704+0000 7f823ec27700 1 --2- 172.21.15.49:0/139862933 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f821c0662f0 0x7f821c0687a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f82381f4fd0 tx=0x7f8228009040 comp rx=0 tx=0).stop 2023-07-21T22:11:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.704+0000 7f823ec27700 1 -- 172.21.15.49:0/139862933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82380698a0 msgr2=0x7f823814e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.704+0000 7f823ec27700 1 --2- 172.21.15.49:0/139862933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82380698a0 0x7f823814e040 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f823400e9d0 tx=0x7f823400ece0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.704+0000 7f823ec27700 1 -- 172.21.15.49:0/139862933 shutdown_connections 2023-07-21T22:11:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.704+0000 7f823ec27700 1 --2- 172.21.15.49:0/139862933 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f821c0662f0 0x7f821c0687a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.704+0000 7f823ec27700 1 --2- 172.21.15.49:0/139862933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82380c9b80 0x7f82380aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.704+0000 7f823ec27700 1 --2- 172.21.15.49:0/139862933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82380aca90 0x7f82380b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.704+0000 7f823ec27700 1 --2- 172.21.15.49:0/139862933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82380698a0 0x7f823814e040 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.704+0000 7f823ec27700 1 -- 172.21.15.49:0/139862933 >> 172.21.15.49:0/139862933 conn(0x7f82380ce0d0 msgr2=0x7f82380ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:31.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.704+0000 7f823ec27700 1 -- 172.21.15.49:0/139862933 shutdown_connections 2023-07-21T22:11:31.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.704+0000 7f823ec27700 1 -- 172.21.15.49:0/139862933 wait complete. 2023-07-21T22:11:31.772 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:11:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.916+0000 7f767359e700 1 Processor -- start 2023-07-21T22:11:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.916+0000 7f767359e700 1 -- start start 2023-07-21T22:11:31.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.916+0000 7f767359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76740b7af0 0x7f76740b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.916+0000 7f767359e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f76740d1e40 0x7f767415f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f767359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76740b3e80 con 0x7f76740cee10 2023-07-21T22:11:31.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f767359e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76740cea00 con 0x7f76740d1e40 2023-07-21T22:11:31.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f767359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76740ccbf0 con 0x7f76740b7af0 2023-07-21T22:11:31.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f767259c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76740b7af0 0x7f76740b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f767259c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76740b7af0 0x7f76740b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:40510/0 (socket says 172.21.15.49:40510) 2023-07-21T22:11:31.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f767259c700 1 -- 172.21.15.49:0/1236783999 learned_addr learned my addr 172.21.15.49:0/1236783999 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:31.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f766bfff700 1 --2- 172.21.15.49:0/1236783999 >> v2:172.21.15.150:3300/0 conn(0x7f76740d1e40 0x7f767415f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f767259c700 1 -- 172.21.15.49:0/1236783999 >> v2:172.21.15.150:3300/0 conn(0x7f76740d1e40 msgr2=0x7f767415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:31.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f767259c700 1 --2- 172.21.15.49:0/1236783999 >> v2:172.21.15.150:3300/0 conn(0x7f76740d1e40 0x7f767415f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f767259c700 1 -- 172.21.15.49:0/1236783999 >> v1:172.21.15.150:6789/0 conn(0x7f76740cee10 legacy=0x7f76740b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f767259c700 1 -- 172.21.15.49:0/1236783999 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76740cced0 con 0x7f76740b7af0 2023-07-21T22:11:31.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f766bfff700 1 --2- 172.21.15.49:0/1236783999 >> v2:172.21.15.150:3300/0 conn(0x7f76740d1e40 0x7f767415f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:31.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f767259c700 1 --2- 172.21.15.49:0/1236783999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76740b7af0 0x7f76740b1630 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7664009910 tx=0x7f7664009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=875d2449ca807023 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:31.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f7671d9b700 1 -- 172.21.15.49:0/1236783999 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766400ba60 con 0x7f76740b7af0 2023-07-21T22:11:31.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f7671d9b700 1 -- 172.21.15.49:0/1236783999 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766400bbc0 con 0x7f76740b7af0 2023-07-21T22:11:31.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.920+0000 7f7671d9b700 1 -- 172.21.15.49:0/1236783999 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7664009e60 con 0x7f76740b7af0 2023-07-21T22:11:31.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.924+0000 7f767359e700 1 -- 172.21.15.49:0/1236783999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76740b7af0 msgr2=0x7f76740b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.924+0000 7f767359e700 1 --2- 172.21.15.49:0/1236783999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76740b7af0 0x7f76740b1630 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7664009910 tx=0x7f7664009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:31.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.924+0000 7f767359e700 1 -- 172.21.15.49:0/1236783999 shutdown_connections 2023-07-21T22:11:31.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.924+0000 7f767359e700 1 --2- 172.21.15.49:0/1236783999 >> v2:172.21.15.150:3300/0 conn(0x7f76740d1e40 0x7f767415f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.924+0000 7f767359e700 1 --2- 172.21.15.49:0/1236783999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76740b7af0 0x7f76740b1630 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.924+0000 7f767359e700 1 -- 172.21.15.49:0/1236783999 >> 172.21.15.49:0/1236783999 conn(0x7f767406e960 msgr2=0x7f767406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:31.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.924+0000 7f767359e700 1 -- 172.21.15.49:0/1236783999 shutdown_connections 2023-07-21T22:11:31.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.924+0000 7f767359e700 1 -- 172.21.15.49:0/1236783999 wait complete. 2023-07-21T22:11:31.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f767359e700 1 Processor -- start 2023-07-21T22:11:31.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f767359e700 1 -- start start 2023-07-21T22:11:31.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f767359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76740b7af0 0x7f767415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f767359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76740cee10 0x7f76740cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f767359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76740d1e40 0x7f76740c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f767359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76740ca5c0 con 0x7f76740cee10 2023-07-21T22:11:31.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f767359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76740ca8a0 con 0x7f76740d1e40 2023-07-21T22:11:31.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f767359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76740cab80 con 0x7f76740b7af0 2023-07-21T22:11:31.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f766bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76740cee10 0x7f76740cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f766bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76740cee10 0x7f76740cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58296/0 (socket says 172.21.15.49:58296) 2023-07-21T22:11:31.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f766bfff700 1 -- 172.21.15.49:0/1157162993 learned_addr learned my addr 172.21.15.49:0/1157162993 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:31.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f767259c700 1 --2- 172.21.15.49:0/1157162993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76740b7af0 0x7f767415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f7672d9d700 1 --2- 172.21.15.49:0/1157162993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76740d1e40 0x7f76740c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f766bfff700 1 -- 172.21.15.49:0/1157162993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76740b7af0 msgr2=0x7f767415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f766bfff700 1 --2- 172.21.15.49:0/1157162993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76740b7af0 0x7f767415a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f766bfff700 1 -- 172.21.15.49:0/1157162993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76740d1e40 msgr2=0x7f76740c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:31.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f766bfff700 1 --2- 172.21.15.49:0/1157162993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76740d1e40 0x7f76740c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:31.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f766bfff700 1 -- 172.21.15.49:0/1157162993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7664009570 con 0x7f76740cee10 2023-07-21T22:11:31.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.928+0000 7f766bfff700 1 --2- 172.21.15.49:0/1157162993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76740cee10 0x7f76740cbd70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f765c00e810 tx=0x7f765c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:31.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.932+0000 7f766affd700 1 -- 172.21.15.49:0/1157162993 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c00c070 con 0x7f76740cee10 2023-07-21T22:11:31.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.932+0000 7f766affd700 1 -- 172.21.15.49:0/1157162993 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c013610 con 0x7f76740cee10 2023-07-21T22:11:31.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.932+0000 7f767359e700 1 -- 172.21.15.49:0/1157162993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76740cae60 con 0x7f76740cee10 2023-07-21T22:11:31.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.932+0000 7f766affd700 1 -- 172.21.15.49:0/1157162993 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c0139a0 con 0x7f76740cee10 2023-07-21T22:11:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.932+0000 7f767359e700 1 -- 172.21.15.49:0/1157162993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767415ae60 con 0x7f76740cee10 2023-07-21T22:11:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.932+0000 7f767359e700 1 -- 172.21.15.49:0/1157162993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767404dcb0 con 0x7f76740cee10 2023-07-21T22:11:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.932+0000 7f766affd700 1 -- 172.21.15.49:0/1157162993 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f765c013b00 con 0x7f76740cee10 2023-07-21T22:11:31.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.936+0000 7f766affd700 1 --2- 172.21.15.49:0/1157162993 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f76540662f0 0x7f76540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:31.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.936+0000 7f766affd700 1 -- 172.21.15.49:0/1157162993 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f765c083d40 con 0x7f76740cee10 2023-07-21T22:11:31.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.936+0000 7f767259c700 1 --2- 172.21.15.49:0/1157162993 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f76540662f0 0x7f76540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:31.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.936+0000 7f767259c700 1 --2- 172.21.15.49:0/1157162993 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f76540662f0 0x7f76540687a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7664000c00 tx=0x7f7664008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:31.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:31.940+0000 7f766affd700 1 -- 172.21.15.49:0/1157162993 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f765c050e00 con 0x7f76740cee10 2023-07-21T22:11:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.116+0000 7f767359e700 1 -- 172.21.15.49:0/1157162993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7674160220 con 0x7f76740cee10 2023-07-21T22:11:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.116+0000 7f766affd700 1 -- 172.21.15.49:0/1157162993 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f765c013db0 con 0x7f76740cee10 2023-07-21T22:11:32.160 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:11:32.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.116+0000 7f767359e700 1 -- 172.21.15.49:0/1157162993 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f76540662f0 msgr2=0x7f76540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.116+0000 7f767359e700 1 --2- 172.21.15.49:0/1157162993 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f76540662f0 0x7f76540687a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7664000c00 tx=0x7f7664008030 comp rx=0 tx=0).stop 2023-07-21T22:11:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.116+0000 7f767359e700 1 -- 172.21.15.49:0/1157162993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76740cee10 msgr2=0x7f76740cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.116+0000 7f767359e700 1 --2- 172.21.15.49:0/1157162993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76740cee10 0x7f76740cbd70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f765c00e810 tx=0x7f765c00eb20 comp rx=0 tx=0).stop 2023-07-21T22:11:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.116+0000 7f767359e700 1 -- 172.21.15.49:0/1157162993 shutdown_connections 2023-07-21T22:11:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.116+0000 7f767359e700 1 --2- 172.21.15.49:0/1157162993 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f76540662f0 0x7f76540687a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.116+0000 7f767359e700 1 --2- 172.21.15.49:0/1157162993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76740cee10 0x7f76740cbd70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.116+0000 7f767359e700 1 --2- 172.21.15.49:0/1157162993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76740d1e40 0x7f76740c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.116+0000 7f767359e700 1 --2- 172.21.15.49:0/1157162993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76740b7af0 0x7f767415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.116+0000 7f767359e700 1 -- 172.21.15.49:0/1157162993 >> 172.21.15.49:0/1157162993 conn(0x7f767406e960 msgr2=0x7f76740b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:32.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.116+0000 7f767359e700 1 -- 172.21.15.49:0/1157162993 shutdown_connections 2023-07-21T22:11:32.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.116+0000 7f767359e700 1 -- 172.21.15.49:0/1157162993 wait complete. 2023-07-21T22:11:32.181 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:11:32.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.332+0000 7fd1faabc700 1 Processor -- start 2023-07-21T22:11:32.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.332+0000 7fd1faabc700 1 -- start start 2023-07-21T22:11:32.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1faabc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd1f40b4040 0x7fd1f40cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:32.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1faabc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1f40d0810 0x7fd1f40d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:32.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1faabc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f40b8170 con 0x7fd1f40b4410 2023-07-21T22:11:32.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1faabc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f40cfa20 con 0x7fd1f40b4040 2023-07-21T22:11:32.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1faabc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f40d03c0 con 0x7fd1f40d0810 2023-07-21T22:11:32.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1f3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd1f40b4410 0x7fd1f40b4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46298/0 (socket says 172.21.15.49:46298) 2023-07-21T22:11:32.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1f3fff700 1 -- 172.21.15.49:0/2757431815 learned_addr learned my addr 172.21.15.49:0/2757431815 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:32.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1f8858700 1 --2- 172.21.15.49:0/2757431815 >> v2:172.21.15.150:3300/0 conn(0x7fd1f40b4040 0x7fd1f40cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:32.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1f9059700 1 --2- 172.21.15.49:0/2757431815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1f40d0810 0x7fd1f40d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:32.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1f37fe700 1 -- 172.21.15.49:0/2757431815 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434365509 0 0) 0x7fd1f40b8170 con 0x7fd1f40b4410 2023-07-21T22:11:32.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1f37fe700 1 -- 172.21.15.49:0/2757431815 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1e40035d0 con 0x7fd1f40b4410 2023-07-21T22:11:32.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1f9059700 1 -- 172.21.15.49:0/2757431815 >> v2:172.21.15.150:3300/0 conn(0x7fd1f40b4040 msgr2=0x7fd1f40cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:32.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1f9059700 1 --2- 172.21.15.49:0/2757431815 >> v2:172.21.15.150:3300/0 conn(0x7fd1f40b4040 0x7fd1f40cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1f9059700 1 -- 172.21.15.49:0/2757431815 >> v1:172.21.15.49:6789/0 conn(0x7fd1f40b4410 legacy=0x7fd1f40b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:32.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1f9059700 1 -- 172.21.15.49:0/2757431815 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f40d2350 con 0x7fd1f40d0810 2023-07-21T22:11:32.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1f8858700 1 --2- 172.21.15.49:0/2757431815 >> v2:172.21.15.150:3300/0 conn(0x7fd1f40b4040 0x7fd1f40cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:32.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.336+0000 7fd1f9059700 1 --2- 172.21.15.49:0/2757431815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1f40d0810 0x7fd1f40d0c90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009d90 tx=0x7fd1ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c9c523f0346c4ae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:32.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.340+0000 7fd1f37fe700 1 -- 172.21.15.49:0/2757431815 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec00e070 con 0x7fd1f40d0810 2023-07-21T22:11:32.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.340+0000 7fd1f37fe700 1 -- 172.21.15.49:0/2757431815 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ec00bb20 con 0x7fd1f40d0810 2023-07-21T22:11:32.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.340+0000 7fd1f37fe700 1 -- 172.21.15.49:0/2757431815 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec012430 con 0x7fd1f40d0810 2023-07-21T22:11:32.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.340+0000 7fd1faabc700 1 -- 172.21.15.49:0/2757431815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1f40d0810 msgr2=0x7fd1f40d0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:32.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.340+0000 7fd1faabc700 1 --2- 172.21.15.49:0/2757431815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1f40d0810 0x7fd1f40d0c90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009d90 tx=0x7fd1ec00b330 comp rx=0 tx=0).stop 2023-07-21T22:11:32.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.340+0000 7fd1faabc700 1 -- 172.21.15.49:0/2757431815 shutdown_connections 2023-07-21T22:11:32.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.340+0000 7fd1faabc700 1 --2- 172.21.15.49:0/2757431815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1f40d0810 0x7fd1f40d0c90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.340+0000 7fd1faabc700 1 --2- 172.21.15.49:0/2757431815 >> v2:172.21.15.150:3300/0 conn(0x7fd1f40b4040 0x7fd1f40cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.340+0000 7fd1faabc700 1 -- 172.21.15.49:0/2757431815 >> 172.21.15.49:0/2757431815 conn(0x7fd1f40658e0 msgr2=0x7fd1f406fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:32.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.340+0000 7fd1faabc700 1 -- 172.21.15.49:0/2757431815 shutdown_connections 2023-07-21T22:11:32.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.340+0000 7fd1faabc700 1 -- 172.21.15.49:0/2757431815 wait complete. 2023-07-21T22:11:32.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.344+0000 7fd1faabc700 1 Processor -- start 2023-07-21T22:11:32.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.344+0000 7fd1faabc700 1 -- start start 2023-07-21T22:11:32.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.344+0000 7fd1faabc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1f40b4040 0x7fd1f40d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:32.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.344+0000 7fd1faabc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1f40b4410 0x7fd1f40d1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:32.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.344+0000 7fd1faabc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1f40d0810 0x7fd1f414b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:32.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.344+0000 7fd1faabc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f414f4b0 con 0x7fd1f40b4040 2023-07-21T22:11:32.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.344+0000 7fd1faabc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f40b2db0 con 0x7fd1f40d0810 2023-07-21T22:11:32.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.344+0000 7fd1faabc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f40c6290 con 0x7fd1f40b4410 2023-07-21T22:11:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.344+0000 7fd1f8858700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1f40b4040 0x7fd1f40d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.344+0000 7fd1f8858700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1f40b4040 0x7fd1f40d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58310/0 (socket says 172.21.15.49:58310) 2023-07-21T22:11:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.344+0000 7fd1f8858700 1 -- 172.21.15.49:0/3682232231 learned_addr learned my addr 172.21.15.49:0/3682232231 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.344+0000 7fd1f3fff700 1 --2- 172.21.15.49:0/3682232231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1f40b4410 0x7fd1f40d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.344+0000 7fd1f9059700 1 --2- 172.21.15.49:0/3682232231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1f40d0810 0x7fd1f414b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.348+0000 7fd1f8858700 1 -- 172.21.15.49:0/3682232231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1f40b4410 msgr2=0x7fd1f40d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:32.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.348+0000 7fd1f8858700 1 --2- 172.21.15.49:0/3682232231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1f40b4410 0x7fd1f40d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.348+0000 7fd1f8858700 1 -- 172.21.15.49:0/3682232231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1f40d0810 msgr2=0x7fd1f414b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:32.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.348+0000 7fd1f8858700 1 --2- 172.21.15.49:0/3682232231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1f40d0810 0x7fd1f414b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.348+0000 7fd1f8858700 1 -- 172.21.15.49:0/3682232231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80094b0 con 0x7fd1f40b4040 2023-07-21T22:11:32.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.348+0000 7fd1f8858700 1 --2- 172.21.15.49:0/3682232231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1f40b4040 0x7fd1f40d0c10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800ebe0 tx=0x7fd1e800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:32.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.348+0000 7fd1f17fa700 1 -- 172.21.15.49:0/3682232231 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8009770 con 0x7fd1f40b4040 2023-07-21T22:11:32.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.348+0000 7fd1f17fa700 1 -- 172.21.15.49:0/3682232231 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e800c850 con 0x7fd1f40b4040 2023-07-21T22:11:32.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.348+0000 7fd1faabc700 1 -- 172.21.15.49:0/3682232231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec009a70 con 0x7fd1f40b4040 2023-07-21T22:11:32.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.348+0000 7fd1f17fa700 1 -- 172.21.15.49:0/3682232231 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e800cbe0 con 0x7fd1f40b4040 2023-07-21T22:11:32.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.348+0000 7fd1faabc700 1 -- 172.21.15.49:0/3682232231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f40c6850 con 0x7fd1f40b4040 2023-07-21T22:11:32.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.348+0000 7fd1faabc700 1 -- 172.21.15.49:0/3682232231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f40c60f0 con 0x7fd1f40b4040 2023-07-21T22:11:32.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.352+0000 7fd1f17fa700 1 -- 172.21.15.49:0/3682232231 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd1e800cd40 con 0x7fd1f40b4040 2023-07-21T22:11:32.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.352+0000 7fd1f17fa700 1 --2- 172.21.15.49:0/3682232231 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd1d80662f0 0x7fd1d80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:32.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.352+0000 7fd1f17fa700 1 -- 172.21.15.49:0/3682232231 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd1e8084050 con 0x7fd1f40b4040 2023-07-21T22:11:32.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.352+0000 7fd1f3fff700 1 --2- 172.21.15.49:0/3682232231 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd1d80662f0 0x7fd1d80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:32.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.356+0000 7fd1f3fff700 1 --2- 172.21.15.49:0/3682232231 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd1d80662f0 0x7fd1d80687a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd1f415b5b0 tx=0x7fd1e0007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:32.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.360+0000 7fd1f17fa700 1 -- 172.21.15.49:0/3682232231 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd1e80b4700 con 0x7fd1f40b4040 2023-07-21T22:11:32.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.536+0000 7fd1faabc700 1 -- 172.21.15.49:0/3682232231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1f40c7e20 con 0x7fd1f40b4040 2023-07-21T22:11:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.536+0000 7fd1f17fa700 1 -- 172.21.15.49:0/3682232231 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1f40c60f0 con 0x7fd1f40b4040 2023-07-21T22:11:32.581 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.540+0000 7fd1faabc700 1 -- 172.21.15.49:0/3682232231 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd1d80662f0 msgr2=0x7fd1d80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.540+0000 7fd1faabc700 1 --2- 172.21.15.49:0/3682232231 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd1d80662f0 0x7fd1d80687a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd1f415b5b0 tx=0x7fd1e0007de0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.540+0000 7fd1faabc700 1 -- 172.21.15.49:0/3682232231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1f40b4040 msgr2=0x7fd1f40d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.540+0000 7fd1faabc700 1 --2- 172.21.15.49:0/3682232231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1f40b4040 0x7fd1f40d0c10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800ebe0 tx=0x7fd1e800eef0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.540+0000 7fd1faabc700 1 -- 172.21.15.49:0/3682232231 shutdown_connections 2023-07-21T22:11:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.540+0000 7fd1faabc700 1 --2- 172.21.15.49:0/3682232231 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd1d80662f0 0x7fd1d80687a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.540+0000 7fd1faabc700 1 --2- 172.21.15.49:0/3682232231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1f40d0810 0x7fd1f414b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.540+0000 7fd1faabc700 1 --2- 172.21.15.49:0/3682232231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1f40b4410 0x7fd1f40d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.540+0000 7fd1faabc700 1 --2- 172.21.15.49:0/3682232231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1f40b4040 0x7fd1f40d0c10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.540+0000 7fd1faabc700 1 -- 172.21.15.49:0/3682232231 >> 172.21.15.49:0/3682232231 conn(0x7fd1f40658e0 msgr2=0x7fd1f406fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.540+0000 7fd1faabc700 1 -- 172.21.15.49:0/3682232231 shutdown_connections 2023-07-21T22:11:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.540+0000 7fd1faabc700 1 -- 172.21.15.49:0/3682232231 wait complete. 2023-07-21T22:11:32.605 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:11:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.744+0000 7f48d561d700 1 Processor -- start 2023-07-21T22:11:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.744+0000 7f48d561d700 1 -- start start 2023-07-21T22:11:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48d561d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48d00b4b20 0x7f48d00cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48d561d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f48d00d0810 0x7f48d00d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48d561d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d00b8170 con 0x7f48d00b4040 2023-07-21T22:11:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48d561d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d00cfa20 con 0x7f48d00d0810 2023-07-21T22:11:32.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48d561d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00d03c0 con 0x7f48d00b4b20 2023-07-21T22:11:32.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48cf7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f48d00d0810 0x7f48d00d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:32.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48cf7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f48d00d0810 0x7f48d00d0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58322/0 (socket says 172.21.15.49:58322) 2023-07-21T22:11:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48cf7fe700 1 -- 172.21.15.49:0/1896010606 learned_addr learned my addr 172.21.15.49:0/1896010606 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48ce7fc700 1 --2- 172.21.15.49:0/1896010606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48d00b4b20 0x7f48d00cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48cf7fe700 1 -- 172.21.15.49:0/1896010606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48d00b4b20 msgr2=0x7f48d00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48cf7fe700 1 --2- 172.21.15.49:0/1896010606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48d00b4b20 0x7f48d00cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48cf7fe700 1 -- 172.21.15.49:0/1896010606 >> v1:172.21.15.150:6789/0 conn(0x7f48d00b4040 legacy=0x7f48d00b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48cf7fe700 1 -- 172.21.15.49:0/1896010606 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d00d2350 con 0x7f48d00d0810 2023-07-21T22:11:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48cf7fe700 1 --2- 172.21.15.49:0/1896010606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48d00d0810 0x7f48d00d0c90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009e50 tx=0x7f48c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193a84353c91f37f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:32.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.748+0000 7f48cdffb700 1 -- 172.21.15.49:0/1896010606 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c800e070 con 0x7f48d00d0810 2023-07-21T22:11:32.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.752+0000 7f48cdffb700 1 -- 172.21.15.49:0/1896010606 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c800b9c0 con 0x7f48d00d0810 2023-07-21T22:11:32.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.752+0000 7f48cdffb700 1 -- 172.21.15.49:0/1896010606 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c800bd70 con 0x7f48d00d0810 2023-07-21T22:11:32.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.752+0000 7f48d561d700 1 -- 172.21.15.49:0/1896010606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48d00d0810 msgr2=0x7f48d00d0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:32.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.752+0000 7f48d561d700 1 --2- 172.21.15.49:0/1896010606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48d00d0810 0x7f48d00d0c90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009e50 tx=0x7f48c800b330 comp rx=0 tx=0).stop 2023-07-21T22:11:32.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.752+0000 7f48d561d700 1 -- 172.21.15.49:0/1896010606 shutdown_connections 2023-07-21T22:11:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.752+0000 7f48d561d700 1 --2- 172.21.15.49:0/1896010606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48d00b4b20 0x7f48d00cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.752+0000 7f48d561d700 1 --2- 172.21.15.49:0/1896010606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48d00d0810 0x7f48d00d0c90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.752+0000 7f48d561d700 1 -- 172.21.15.49:0/1896010606 >> 172.21.15.49:0/1896010606 conn(0x7f48d00658e0 msgr2=0x7f48d006fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.752+0000 7f48d561d700 1 -- 172.21.15.49:0/1896010606 shutdown_connections 2023-07-21T22:11:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.752+0000 7f48d561d700 1 -- 172.21.15.49:0/1896010606 wait complete. 2023-07-21T22:11:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48d561d700 1 Processor -- start 2023-07-21T22:11:32.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48d561d700 1 -- start start 2023-07-21T22:11:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48d561d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48d00b4040 0x7f48d00cea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48d561d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48d00b4b20 0x7f48d015c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48d561d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48d00d0810 0x7f48d0156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48d561d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00c9b20 con 0x7f48d00b4040 2023-07-21T22:11:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48d561d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00c9e00 con 0x7f48d00b4b20 2023-07-21T22:11:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48d561d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00ca0e0 con 0x7f48d00d0810 2023-07-21T22:11:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48ceffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48d00b4040 0x7f48d00cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48ceffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48d00b4040 0x7f48d00cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58330/0 (socket says 172.21.15.49:58330) 2023-07-21T22:11:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48ceffd700 1 -- 172.21.15.49:0/1213358831 learned_addr learned my addr 172.21.15.49:0/1213358831 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48ce7fc700 1 --2- 172.21.15.49:0/1213358831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48d00b4b20 0x7f48d015c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48cf7fe700 1 --2- 172.21.15.49:0/1213358831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48d00d0810 0x7f48d0156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48ceffd700 1 -- 172.21.15.49:0/1213358831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48d00d0810 msgr2=0x7f48d0156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48ceffd700 1 --2- 172.21.15.49:0/1213358831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48d00d0810 0x7f48d0156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48ceffd700 1 -- 172.21.15.49:0/1213358831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48d00b4b20 msgr2=0x7f48d015c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48ceffd700 1 --2- 172.21.15.49:0/1213358831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48d00b4b20 0x7f48d015c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.756+0000 7f48ceffd700 1 -- 172.21.15.49:0/1213358831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c8009b30 con 0x7f48d00b4040 2023-07-21T22:11:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.760+0000 7f48ceffd700 1 --2- 172.21.15.49:0/1213358831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48d00b4040 0x7f48d00cea40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f48c000c500 tx=0x7f48c000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.760+0000 7f48b77fe700 1 -- 172.21.15.49:0/1213358831 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c00052d0 con 0x7f48d00b4040 2023-07-21T22:11:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.760+0000 7f48b77fe700 1 -- 172.21.15.49:0/1213358831 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c0005430 con 0x7f48d00b4040 2023-07-21T22:11:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.760+0000 7f48b77fe700 1 -- 172.21.15.49:0/1213358831 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c00055a0 con 0x7f48d00b4040 2023-07-21T22:11:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.760+0000 7f48d561d700 1 -- 172.21.15.49:0/1213358831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d00ca3c0 con 0x7f48d00b4040 2023-07-21T22:11:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.760+0000 7f48d561d700 1 -- 172.21.15.49:0/1213358831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d00cef80 con 0x7f48d00b4040 2023-07-21T22:11:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.760+0000 7f48d561d700 1 -- 172.21.15.49:0/1213358831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d004dd50 con 0x7f48d00b4040 2023-07-21T22:11:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.764+0000 7f48b77fe700 1 -- 172.21.15.49:0/1213358831 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48c00038e0 con 0x7f48d00b4040 2023-07-21T22:11:32.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.764+0000 7f48b77fe700 1 --2- 172.21.15.49:0/1213358831 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f48bc0662f0 0x7f48bc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:32.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.764+0000 7f48b77fe700 1 -- 172.21.15.49:0/1213358831 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f48c00835a0 con 0x7f48d00b4040 2023-07-21T22:11:32.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.764+0000 7f48ce7fc700 1 --2- 172.21.15.49:0/1213358831 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f48bc0662f0 0x7f48bc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:32.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.768+0000 7f48ce7fc700 1 --2- 172.21.15.49:0/1213358831 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f48bc0662f0 0x7f48bc0687a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f48d00b3650 tx=0x7f48c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:32.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.772+0000 7f48b77fe700 1 -- 172.21.15.49:0/1213358831 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48c0050650 con 0x7f48d00b4040 2023-07-21T22:11:32.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.952+0000 7f48d561d700 1 -- 172.21.15.49:0/1213358831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48d00c5a40 con 0x7f48d00b4040 2023-07-21T22:11:32.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.956+0000 7f48b77fe700 1 -- 172.21.15.49:0/1213358831 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48c0053c70 con 0x7f48d00b4040 2023-07-21T22:11:32.999 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:11:33.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.956+0000 7f48d561d700 1 -- 172.21.15.49:0/1213358831 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f48bc0662f0 msgr2=0x7f48bc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:33.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.956+0000 7f48d561d700 1 --2- 172.21.15.49:0/1213358831 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f48bc0662f0 0x7f48bc0687a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f48d00b3650 tx=0x7f48c4008040 comp rx=0 tx=0).stop 2023-07-21T22:11:33.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.956+0000 7f48d561d700 1 -- 172.21.15.49:0/1213358831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48d00b4040 msgr2=0x7f48d00cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:33.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.956+0000 7f48d561d700 1 --2- 172.21.15.49:0/1213358831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48d00b4040 0x7f48d00cea40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f48c000c500 tx=0x7f48c000c8c0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.956+0000 7f48d561d700 1 -- 172.21.15.49:0/1213358831 shutdown_connections 2023-07-21T22:11:33.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.956+0000 7f48d561d700 1 --2- 172.21.15.49:0/1213358831 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f48bc0662f0 0x7f48bc0687a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.956+0000 7f48d561d700 1 --2- 172.21.15.49:0/1213358831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48d00d0810 0x7f48d0156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.956+0000 7f48d561d700 1 --2- 172.21.15.49:0/1213358831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48d00b4b20 0x7f48d015c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.956+0000 7f48d561d700 1 --2- 172.21.15.49:0/1213358831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48d00b4040 0x7f48d00cea40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.956+0000 7f48d561d700 1 -- 172.21.15.49:0/1213358831 >> 172.21.15.49:0/1213358831 conn(0x7f48d00658e0 msgr2=0x7f48d00cfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:33.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.960+0000 7f48d561d700 1 -- 172.21.15.49:0/1213358831 shutdown_connections 2023-07-21T22:11:33.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:32.960+0000 7f48d561d700 1 -- 172.21.15.49:0/1213358831 wait complete. 2023-07-21T22:11:33.023 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:11:33.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.164+0000 7f66ced24700 1 Processor -- start 2023-07-21T22:11:33.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.164+0000 7f66ced24700 1 -- start start 2023-07-21T22:11:33.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.164+0000 7f66ced24700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f66c8160010 0x7f66c80ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:33.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.164+0000 7f66ced24700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f66c80ca680 0x7f66c80cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:33.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.164+0000 7f66ced24700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c8163ee0 con 0x7f66c81603e0 2023-07-21T22:11:33.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.164+0000 7f66ced24700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c80cdf70 con 0x7f66c80ca680 2023-07-21T22:11:33.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.164+0000 7f66ced24700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c80cd6d0 con 0x7f66c8160010 2023-07-21T22:11:33.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.164+0000 7f66cd521700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f66c81603e0 0x7f66c8164370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46304/0 (socket says 172.21.15.49:46304) 2023-07-21T22:11:33.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66cd521700 1 -- 172.21.15.49:0/3694834491 learned_addr learned my addr 172.21.15.49:0/3694834491 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:33.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ce523700 1 --2- 172.21.15.49:0/3694834491 >> v2:172.21.15.49:3300/0 conn(0x7f66c80ca680 0x7f66c80cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:33.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66cdd22700 1 --2- 172.21.15.49:0/3694834491 >> v2:172.21.15.150:3300/0 conn(0x7f66c8160010 0x7f66c80ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:33.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ccd20700 1 -- 172.21.15.49:0/3694834491 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727674831 0 0) 0x7f66c8163ee0 con 0x7f66c81603e0 2023-07-21T22:11:33.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ce523700 1 -- 172.21.15.49:0/3694834491 >> v2:172.21.15.150:3300/0 conn(0x7f66c8160010 msgr2=0x7f66c80ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:33.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ce523700 1 --2- 172.21.15.49:0/3694834491 >> v2:172.21.15.150:3300/0 conn(0x7f66c8160010 0x7f66c80ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ce523700 1 -- 172.21.15.49:0/3694834491 >> v1:172.21.15.49:6789/0 conn(0x7f66c81603e0 legacy=0x7f66c8164370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:33.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ce523700 1 -- 172.21.15.49:0/3694834491 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c80cd9b0 con 0x7f66c80ca680 2023-07-21T22:11:33.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ce523700 1 --2- 172.21.15.49:0/3694834491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c80ca680 0x7f66c80cbc10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f66c80cedb0 tx=0x7f66c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbe902950def24 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:33.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ccd20700 1 -- 172.21.15.49:0/3694834491 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c000e070 con 0x7f66c80ca680 2023-07-21T22:11:33.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ccd20700 1 -- 172.21.15.49:0/3694834491 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c000bb20 con 0x7f66c80ca680 2023-07-21T22:11:33.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ccd20700 1 -- 172.21.15.49:0/3694834491 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0012430 con 0x7f66c80ca680 2023-07-21T22:11:33.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ced24700 1 -- 172.21.15.49:0/3694834491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c80ca680 msgr2=0x7f66c80cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:33.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ced24700 1 --2- 172.21.15.49:0/3694834491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c80ca680 0x7f66c80cbc10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f66c80cedb0 tx=0x7f66c000b330 comp rx=0 tx=0).stop 2023-07-21T22:11:33.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ced24700 1 -- 172.21.15.49:0/3694834491 shutdown_connections 2023-07-21T22:11:33.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ced24700 1 --2- 172.21.15.49:0/3694834491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c80ca680 0x7f66c80cbc10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ced24700 1 --2- 172.21.15.49:0/3694834491 >> v2:172.21.15.150:3300/0 conn(0x7f66c8160010 0x7f66c80ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.168+0000 7f66ced24700 1 -- 172.21.15.49:0/3694834491 >> 172.21.15.49:0/3694834491 conn(0x7f66c80ce0d0 msgr2=0x7f66c80ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:33.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.172+0000 7f66ced24700 1 -- 172.21.15.49:0/3694834491 shutdown_connections 2023-07-21T22:11:33.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.172+0000 7f66ced24700 1 -- 172.21.15.49:0/3694834491 wait complete. 2023-07-21T22:11:33.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.172+0000 7f66ced24700 1 Processor -- start 2023-07-21T22:11:33.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.172+0000 7f66ced24700 1 -- start start 2023-07-21T22:11:33.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66ced24700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c80ca680 0x7f66c80b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:33.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66ced24700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c8160010 0x7f66c8162250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:33.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66ced24700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66c81603e0 0x7f66c8162790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:33.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66ced24700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80c7a40 con 0x7f66c80ca680 2023-07-21T22:11:33.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66ced24700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80c5110 con 0x7f66c8160010 2023-07-21T22:11:33.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66ced24700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80aeb90 con 0x7f66c81603e0 2023-07-21T22:11:33.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66cdd22700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c80ca680 0x7f66c80b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:33.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66cdd22700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c80ca680 0x7f66c80b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58356/0 (socket says 172.21.15.49:58356) 2023-07-21T22:11:33.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66cdd22700 1 -- 172.21.15.49:0/1861796836 learned_addr learned my addr 172.21.15.49:0/1861796836 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:33.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66cd521700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c8160010 0x7f66c8162250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:33.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66ce523700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66c81603e0 0x7f66c8162790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:33.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66cdd22700 1 -- 172.21.15.49:0/1861796836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66c81603e0 msgr2=0x7f66c8162790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:33.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66cdd22700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66c81603e0 0x7f66c8162790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66cdd22700 1 -- 172.21.15.49:0/1861796836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c8160010 msgr2=0x7f66c8162250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:33.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66cdd22700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c8160010 0x7f66c8162250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66cdd22700 1 -- 172.21.15.49:0/1861796836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c0009a70 con 0x7f66c80ca680 2023-07-21T22:11:33.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66ce523700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66c81603e0 0x7f66c8162790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:33.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66cdd22700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c80ca680 0x7f66c80b0490 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f66c400e9d0 tx=0x7f66c400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:33.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66be7fc700 1 -- 172.21.15.49:0/1861796836 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4009720 con 0x7f66c80ca680 2023-07-21T22:11:33.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66be7fc700 1 -- 172.21.15.49:0/1861796836 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c400c850 con 0x7f66c80ca680 2023-07-21T22:11:33.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66ced24700 1 -- 172.21.15.49:0/1861796836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c80aee70 con 0x7f66c80ca680 2023-07-21T22:11:33.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66be7fc700 1 -- 172.21.15.49:0/1861796836 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c400cbc0 con 0x7f66c80ca680 2023-07-21T22:11:33.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.176+0000 7f66ced24700 1 -- 172.21.15.49:0/1861796836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c80c56b0 con 0x7f66c80ca680 2023-07-21T22:11:33.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.180+0000 7f66ced24700 1 -- 172.21.15.49:0/1861796836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c804dcb0 con 0x7f66c80ca680 2023-07-21T22:11:33.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.180+0000 7f66be7fc700 1 -- 172.21.15.49:0/1861796836 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f66c400cd20 con 0x7f66c80ca680 2023-07-21T22:11:33.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.184+0000 7f66be7fc700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f66ac0662f0 0x7f66ac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:33.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.184+0000 7f66be7fc700 1 -- 172.21.15.49:0/1861796836 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f66c4084150 con 0x7f66c80ca680 2023-07-21T22:11:33.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.184+0000 7f66cd521700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f66ac0662f0 0x7f66ac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:33.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.184+0000 7f66cd521700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f66ac0662f0 0x7f66ac0687a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f66c806cd80 tx=0x7f66b8007e00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.192+0000 7f66be7fc700 1 -- 172.21.15.49:0/1861796836 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f66c4051210 con 0x7f66c80ca680 2023-07-21T22:11:33.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.364+0000 7f66ced24700 1 -- 172.21.15.49:0/1861796836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f66c80709f0 con 0x7f66c80ca680 2023-07-21T22:11:33.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.364+0000 7f66be7fc700 1 -- 172.21.15.49:0/1861796836 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f66c4054830 con 0x7f66c80ca680 2023-07-21T22:11:33.410 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:33.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.368+0000 7f66ced24700 1 -- 172.21.15.49:0/1861796836 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f66ac0662f0 msgr2=0x7f66ac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:33.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.368+0000 7f66ced24700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f66ac0662f0 0x7f66ac0687a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f66c806cd80 tx=0x7f66b8007e00 comp rx=0 tx=0).stop 2023-07-21T22:11:33.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.368+0000 7f66ced24700 1 -- 172.21.15.49:0/1861796836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c80ca680 msgr2=0x7f66c80b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:33.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.368+0000 7f66ced24700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c80ca680 0x7f66c80b0490 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f66c400e9d0 tx=0x7f66c400ece0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.368+0000 7f66ced24700 1 -- 172.21.15.49:0/1861796836 shutdown_connections 2023-07-21T22:11:33.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.368+0000 7f66ced24700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f66ac0662f0 0x7f66ac0687a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.368+0000 7f66ced24700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66c81603e0 0x7f66c8162790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.368+0000 7f66ced24700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c8160010 0x7f66c8162250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.368+0000 7f66ced24700 1 --2- 172.21.15.49:0/1861796836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c80ca680 0x7f66c80b0490 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.368+0000 7f66ced24700 1 -- 172.21.15.49:0/1861796836 >> 172.21.15.49:0/1861796836 conn(0x7f66c80ce0d0 msgr2=0x7f66c81607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:33.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.368+0000 7f66ced24700 1 -- 172.21.15.49:0/1861796836 shutdown_connections 2023-07-21T22:11:33.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.368+0000 7f66ced24700 1 -- 172.21.15.49:0/1861796836 wait complete. 2023-07-21T22:11:33.434 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:33.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.564+0000 7f572745a700 1 Processor -- start 2023-07-21T22:11:33.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.564+0000 7f572745a700 1 -- start start 2023-07-21T22:11:33.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f572745a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5720071c70 0x7f57200b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:33.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f572745a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f57200b1400 0x7f57200cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:33.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f572745a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57200cab20 con 0x7f572006d380 2023-07-21T22:11:33.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f572745a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57200c9e80 con 0x7f5720071c70 2023-07-21T22:11:33.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f572745a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57200afeb0 con 0x7f57200b1400 2023-07-21T22:11:33.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f5726458700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f572006d380 0x7f572006d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46320/0 (socket says 172.21.15.49:46320) 2023-07-21T22:11:33.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f5726458700 1 -- 172.21.15.49:0/2906031480 learned_addr learned my addr 172.21.15.49:0/2906031480 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:33.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f5725c57700 1 --2- 172.21.15.49:0/2906031480 >> v2:172.21.15.49:3300/0 conn(0x7f5720071c70 0x7f57200b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:33.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f5726c59700 1 --2- 172.21.15.49:0/2906031480 >> v2:172.21.15.150:3300/0 conn(0x7f57200b1400 0x7f57200cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:33.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f5725456700 1 -- 172.21.15.49:0/2906031480 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770972893 0 0) 0x7f57200cab20 con 0x7f572006d380 2023-07-21T22:11:33.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f5725456700 1 -- 172.21.15.49:0/2906031480 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f570c0035d0 con 0x7f572006d380 2023-07-21T22:11:33.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f5725c57700 1 -- 172.21.15.49:0/2906031480 >> v2:172.21.15.150:3300/0 conn(0x7f57200b1400 msgr2=0x7f57200cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:33.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f5725c57700 1 --2- 172.21.15.49:0/2906031480 >> v2:172.21.15.150:3300/0 conn(0x7f57200b1400 0x7f57200cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f5725c57700 1 -- 172.21.15.49:0/2906031480 >> v1:172.21.15.49:6789/0 conn(0x7f572006d380 legacy=0x7f572006d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:33.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.568+0000 7f5725c57700 1 -- 172.21.15.49:0/2906031480 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57200ca1f0 con 0x7f5720071c70 2023-07-21T22:11:33.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.572+0000 7f5725c57700 1 --2- 172.21.15.49:0/2906031480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5720071c70 0x7f57200b0ec0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f572006f8e0 tx=0x7f5710009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75d06f3fb759765 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:33.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.572+0000 7f5725456700 1 -- 172.21.15.49:0/2906031480 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710011830 con 0x7f5720071c70 2023-07-21T22:11:33.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.572+0000 7f5725456700 1 -- 172.21.15.49:0/2906031480 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5710011990 con 0x7f5720071c70 2023-07-21T22:11:33.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.572+0000 7f5725456700 1 -- 172.21.15.49:0/2906031480 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710011d00 con 0x7f5720071c70 2023-07-21T22:11:33.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.572+0000 7f572745a700 1 -- 172.21.15.49:0/2906031480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5720071c70 msgr2=0x7f57200b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:33.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.572+0000 7f572745a700 1 --2- 172.21.15.49:0/2906031480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5720071c70 0x7f57200b0ec0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f572006f8e0 tx=0x7f5710009b30 comp rx=0 tx=0).stop 2023-07-21T22:11:33.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.572+0000 7f572745a700 1 -- 172.21.15.49:0/2906031480 shutdown_connections 2023-07-21T22:11:33.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.572+0000 7f572745a700 1 --2- 172.21.15.49:0/2906031480 >> v2:172.21.15.150:3300/0 conn(0x7f57200b1400 0x7f57200cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.572+0000 7f572745a700 1 --2- 172.21.15.49:0/2906031480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5720071c70 0x7f57200b0ec0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.572+0000 7f572745a700 1 -- 172.21.15.49:0/2906031480 >> 172.21.15.49:0/2906031480 conn(0x7f5720070450 msgr2=0x7f5720070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:33.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.572+0000 7f572745a700 1 -- 172.21.15.49:0/2906031480 shutdown_connections 2023-07-21T22:11:33.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.572+0000 7f572745a700 1 -- 172.21.15.49:0/2906031480 wait complete. 2023-07-21T22:11:33.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f572745a700 1 Processor -- start 2023-07-21T22:11:33.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f572745a700 1 -- start start 2023-07-21T22:11:33.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f572745a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f572006d380 0x7f572015c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:33.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f572745a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5720071c70 0x7f57200c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:33.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f572745a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57200b1400 0x7f57200b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:33.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f572745a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57200c6090 con 0x7f572006d380 2023-07-21T22:11:33.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f572745a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57200c1c20 con 0x7f5720071c70 2023-07-21T22:11:33.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f572745a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57200c1f00 con 0x7f57200b1400 2023-07-21T22:11:33.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f5726458700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f572006d380 0x7f572015c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:33.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f5726458700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f572006d380 0x7f572015c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58378/0 (socket says 172.21.15.49:58378) 2023-07-21T22:11:33.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f5726458700 1 -- 172.21.15.49:0/2621384608 learned_addr learned my addr 172.21.15.49:0/2621384608 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:33.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f5725c57700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5720071c70 0x7f57200c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:33.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f5726c59700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57200b1400 0x7f57200b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:33.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f5726458700 1 -- 172.21.15.49:0/2621384608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57200b1400 msgr2=0x7f57200b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:33.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f5726458700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57200b1400 0x7f57200b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f5726458700 1 -- 172.21.15.49:0/2621384608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5720071c70 msgr2=0x7f57200c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:33.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f5726458700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5720071c70 0x7f57200c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f5726458700 1 -- 172.21.15.49:0/2621384608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57100094b0 con 0x7f572006d380 2023-07-21T22:11:33.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.576+0000 7f5726c59700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57200b1400 0x7f57200b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:33.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.580+0000 7f5726458700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f572006d380 0x7f572015c090 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f571c00c4d0 tx=0x7f571c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:33.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.580+0000 7f5716ffd700 1 -- 172.21.15.49:0/2621384608 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c005d90 con 0x7f572006d380 2023-07-21T22:11:33.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.580+0000 7f5716ffd700 1 -- 172.21.15.49:0/2621384608 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c0070d0 con 0x7f572006d380 2023-07-21T22:11:33.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.580+0000 7f572745a700 1 -- 172.21.15.49:0/2621384608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57200c21e0 con 0x7f572006d380 2023-07-21T22:11:33.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.580+0000 7f5716ffd700 1 -- 172.21.15.49:0/2621384608 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c007480 con 0x7f572006d380 2023-07-21T22:11:33.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.580+0000 7f572745a700 1 -- 172.21.15.49:0/2621384608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57200c27a0 con 0x7f572006d380 2023-07-21T22:11:33.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.580+0000 7f572745a700 1 -- 172.21.15.49:0/2621384608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57200cef70 con 0x7f572006d380 2023-07-21T22:11:33.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.584+0000 7f5716ffd700 1 -- 172.21.15.49:0/2621384608 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f571c0075e0 con 0x7f572006d380 2023-07-21T22:11:33.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.584+0000 7f5716ffd700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f57040662f0 0x7f57040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:33.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.584+0000 7f5716ffd700 1 -- 172.21.15.49:0/2621384608 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f571c083660 con 0x7f572006d380 2023-07-21T22:11:33.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.584+0000 7f5725c57700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f57040662f0 0x7f57040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:33.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.584+0000 7f5725c57700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f57040662f0 0x7f57040687a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5710000c00 tx=0x7f5710008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.588+0000 7f5716ffd700 1 -- 172.21.15.49:0/2621384608 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f571c050720 con 0x7f572006d380 2023-07-21T22:11:33.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.768+0000 7f572745a700 1 -- 172.21.15.49:0/2621384608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f572004dcb0 con 0x7f572006d380 2023-07-21T22:11:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.768+0000 7f5716ffd700 1 -- 172.21.15.49:0/2621384608 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7f571c053d40 con 0x7f572006d380 2023-07-21T22:11:33.815 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:33.815 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:33.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.772+0000 7f572745a700 1 -- 172.21.15.49:0/2621384608 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f57040662f0 msgr2=0x7f57040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:33.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.772+0000 7f572745a700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f57040662f0 0x7f57040687a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5710000c00 tx=0x7f5710008030 comp rx=0 tx=0).stop 2023-07-21T22:11:33.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.772+0000 7f572745a700 1 -- 172.21.15.49:0/2621384608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f572006d380 msgr2=0x7f572015c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:33.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.772+0000 7f572745a700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f572006d380 0x7f572015c090 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f571c00c4d0 tx=0x7f571c00c890 comp rx=0 tx=0).stop 2023-07-21T22:11:33.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.772+0000 7f572745a700 1 -- 172.21.15.49:0/2621384608 shutdown_connections 2023-07-21T22:11:33.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.772+0000 7f572745a700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f57040662f0 0x7f57040687a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.772+0000 7f572745a700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57200b1400 0x7f57200b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.772+0000 7f572745a700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5720071c70 0x7f57200c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.772+0000 7f572745a700 1 --2- 172.21.15.49:0/2621384608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f572006d380 0x7f572015c090 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:33.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.772+0000 7f572745a700 1 -- 172.21.15.49:0/2621384608 >> 172.21.15.49:0/2621384608 conn(0x7f5720070450 msgr2=0x7f57200caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:33.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.772+0000 7f572745a700 1 -- 172.21.15.49:0/2621384608 shutdown_connections 2023-07-21T22:11:33.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.772+0000 7f572745a700 1 -- 172.21.15.49:0/2621384608 wait complete. 2023-07-21T22:11:33.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:11:33.842 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:11:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.992+0000 7ffac1d24700 1 Processor -- start 2023-07-21T22:11:34.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.992+0000 7ffac1d24700 1 -- start start 2023-07-21T22:11:34.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.992+0000 7ffac1d24700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffabc0ca550 0x7ffabc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.992+0000 7ffac1d24700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffabc06d6d0 0x7ffabc0698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1d24700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffabc0c8b80 con 0x7ffabc159be0 2023-07-21T22:11:34.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1d24700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffabc0c9720 con 0x7ffabc06d6d0 2023-07-21T22:11:34.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1d24700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc06db90 con 0x7ffabc0ca550 2023-07-21T22:11:34.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1523700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffabc06d6d0 0x7ffabc0698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac0d22700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ffabc159be0 0x7ffabc0c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46332/0 (socket says 172.21.15.49:46332) 2023-07-21T22:11:34.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1523700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffabc06d6d0 0x7ffabc0698a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58390/0 (socket says 172.21.15.49:58390) 2023-07-21T22:11:34.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac0d22700 1 -- 172.21.15.49:0/2748320429 learned_addr learned my addr 172.21.15.49:0/2748320429 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:34.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffabbfff700 1 --2- 172.21.15.49:0/2748320429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffabc0ca550 0x7ffabc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1523700 1 -- 172.21.15.49:0/2748320429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffabc0ca550 msgr2=0x7ffabc06d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1523700 1 --2- 172.21.15.49:0/2748320429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffabc0ca550 0x7ffabc06d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1523700 1 -- 172.21.15.49:0/2748320429 >> v1:172.21.15.49:6789/0 conn(0x7ffabc159be0 legacy=0x7ffabc0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1523700 1 -- 172.21.15.49:0/2748320429 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc06de70 con 0x7ffabc06d6d0 2023-07-21T22:11:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1523700 1 --2- 172.21.15.49:0/2748320429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffabc06d6d0 0x7ffabc0698a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009d90 tx=0x7ffab400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23239b01e09d3a46 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffabb7fe700 1 -- 172.21.15.49:0/2748320429 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab400e070 con 0x7ffabc06d6d0 2023-07-21T22:11:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffabb7fe700 1 -- 172.21.15.49:0/2748320429 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab400bb20 con 0x7ffabc06d6d0 2023-07-21T22:11:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffabb7fe700 1 -- 172.21.15.49:0/2748320429 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4012430 con 0x7ffabc06d6d0 2023-07-21T22:11:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1d24700 1 -- 172.21.15.49:0/2748320429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffabc06d6d0 msgr2=0x7ffabc0698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1d24700 1 --2- 172.21.15.49:0/2748320429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffabc06d6d0 0x7ffabc0698a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009d90 tx=0x7ffab400b330 comp rx=0 tx=0).stop 2023-07-21T22:11:34.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1d24700 1 -- 172.21.15.49:0/2748320429 shutdown_connections 2023-07-21T22:11:34.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1d24700 1 --2- 172.21.15.49:0/2748320429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffabc06d6d0 0x7ffabc0698a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1d24700 1 --2- 172.21.15.49:0/2748320429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffabc0ca550 0x7ffabc06d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:33.996+0000 7ffac1d24700 1 -- 172.21.15.49:0/2748320429 >> 172.21.15.49:0/2748320429 conn(0x7ffabc0ce0d0 msgr2=0x7ffabc0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:34.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.000+0000 7ffac1d24700 1 -- 172.21.15.49:0/2748320429 shutdown_connections 2023-07-21T22:11:34.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.000+0000 7ffac1d24700 1 -- 172.21.15.49:0/2748320429 wait complete. 2023-07-21T22:11:34.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.000+0000 7ffac1d24700 1 Processor -- start 2023-07-21T22:11:34.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.000+0000 7ffac1d24700 1 -- start start 2023-07-21T22:11:34.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1d24700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffabc06d6d0 0x7ffabc14b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1d24700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffabc0ca550 0x7ffabc14a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1d24700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffabc159be0 0x7ffabc0ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1d24700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc0ac1e0 con 0x7ffabc159be0 2023-07-21T22:11:34.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1d24700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc0ab8d0 con 0x7ffabc06d6d0 2023-07-21T22:11:34.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1d24700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc14b780 con 0x7ffabc0ca550 2023-07-21T22:11:34.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1523700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffabc159be0 0x7ffabc0ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1523700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffabc159be0 0x7ffabc0ae920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58396/0 (socket says 172.21.15.49:58396) 2023-07-21T22:11:34.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1523700 1 -- 172.21.15.49:0/2196911083 learned_addr learned my addr 172.21.15.49:0/2196911083 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:34.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffabbfff700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffabc0ca550 0x7ffabc14a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac0d22700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffabc06d6d0 0x7ffabc14b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1523700 1 -- 172.21.15.49:0/2196911083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffabc0ca550 msgr2=0x7ffabc14a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1523700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffabc0ca550 0x7ffabc14a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1523700 1 -- 172.21.15.49:0/2196911083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffabc06d6d0 msgr2=0x7ffabc14b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1523700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffabc06d6d0 0x7ffabc14b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1523700 1 -- 172.21.15.49:0/2196911083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab4009a70 con 0x7ffabc159be0 2023-07-21T22:11:34.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac0d22700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffabc06d6d0 0x7ffabc14b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:34.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffabbfff700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffabc0ca550 0x7ffabc14a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1523700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffabc159be0 0x7ffabc0ae920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffab4013000 tx=0x7ffab4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffab97fa700 1 -- 172.21.15.49:0/2196911083 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4012430 con 0x7ffabc159be0 2023-07-21T22:11:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffab97fa700 1 -- 172.21.15.49:0/2196911083 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab4020070 con 0x7ffabc159be0 2023-07-21T22:11:34.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffab97fa700 1 -- 172.21.15.49:0/2196911083 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4004280 con 0x7ffabc159be0 2023-07-21T22:11:34.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1d24700 1 -- 172.21.15.49:0/2196911083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc0af300 con 0x7ffabc159be0 2023-07-21T22:11:34.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.004+0000 7ffac1d24700 1 -- 172.21.15.49:0/2196911083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc0abe00 con 0x7ffabc159be0 2023-07-21T22:11:34.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.008+0000 7ffac1d24700 1 -- 172.21.15.49:0/2196911083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc0ac320 con 0x7ffabc159be0 2023-07-21T22:11:34.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.008+0000 7ffab97fa700 1 -- 172.21.15.49:0/2196911083 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffab40043e0 con 0x7ffabc159be0 2023-07-21T22:11:34.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.008+0000 7ffab97fa700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ffaa00662f0 0x7ffaa00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.012+0000 7ffab97fa700 1 -- 172.21.15.49:0/2196911083 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffab4022070 con 0x7ffabc159be0 2023-07-21T22:11:34.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.012+0000 7ffac0d22700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ffaa00662f0 0x7ffaa00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.012+0000 7ffac0d22700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ffaa00662f0 0x7ffaa00687a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffab0007fd0 tx=0x7ffab0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:34.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.016+0000 7ffab97fa700 1 -- 172.21.15.49:0/2196911083 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffabc0ac320 con 0x7ffabc159be0 2023-07-21T22:11:34.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.188+0000 7ffac1d24700 1 -- 172.21.15.49:0/2196911083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffabc0ac320 con 0x7ffabc159be0 2023-07-21T22:11:34.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.188+0000 7ffab97fa700 1 -- 172.21.15.49:0/2196911083 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffab402c020 con 0x7ffabc159be0 2023-07-21T22:11:34.234 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:11:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.192+0000 7ffac1d24700 1 -- 172.21.15.49:0/2196911083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ffaa00662f0 msgr2=0x7ffaa00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.192+0000 7ffac1d24700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ffaa00662f0 0x7ffaa00687a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffab0007fd0 tx=0x7ffab0009040 comp rx=0 tx=0).stop 2023-07-21T22:11:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.192+0000 7ffac1d24700 1 -- 172.21.15.49:0/2196911083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffabc159be0 msgr2=0x7ffabc0ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.192+0000 7ffac1d24700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffabc159be0 0x7ffabc0ae920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffab4013000 tx=0x7ffab4004af0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.196+0000 7ffac1d24700 1 -- 172.21.15.49:0/2196911083 shutdown_connections 2023-07-21T22:11:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.196+0000 7ffac1d24700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ffaa00662f0 0x7ffaa00687a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.196+0000 7ffac1d24700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffabc159be0 0x7ffabc0ae920 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.196+0000 7ffac1d24700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffabc0ca550 0x7ffabc14a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.196+0000 7ffac1d24700 1 --2- 172.21.15.49:0/2196911083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffabc06d6d0 0x7ffabc14b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.196+0000 7ffac1d24700 1 -- 172.21.15.49:0/2196911083 >> 172.21.15.49:0/2196911083 conn(0x7ffabc0ce0d0 msgr2=0x7ffabc0c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.196+0000 7ffac1d24700 1 -- 172.21.15.49:0/2196911083 shutdown_connections 2023-07-21T22:11:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.196+0000 7ffac1d24700 1 -- 172.21.15.49:0/2196911083 wait complete. 2023-07-21T22:11:34.260 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:11:34.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.396+0000 7f25dd603700 1 Processor -- start 2023-07-21T22:11:34.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.396+0000 7f25dd603700 1 -- start start 2023-07-21T22:11:34.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.400+0000 7f25dd603700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25d8160010 0x7f25d80ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.400+0000 7f25dd603700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f25d81603e0 0x7f25d8164370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.400+0000 7f25dd603700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d8163ee0 con 0x7f25d80ca680 2023-07-21T22:11:34.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.400+0000 7f25dd603700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d80cdf70 con 0x7f25d81603e0 2023-07-21T22:11:34.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.400+0000 7f25dd603700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80cd6d0 con 0x7f25d8160010 2023-07-21T22:11:34.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.400+0000 7f25d7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25d8160010 0x7f25d80ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.400+0000 7f25dce02700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f25d80ca680 0x7f25d80cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46340/0 (socket says 172.21.15.49:46340) 2023-07-21T22:11:34.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.400+0000 7f25dce02700 1 -- 172.21.15.49:0/4068079017 learned_addr learned my addr 172.21.15.49:0/4068079017 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:34.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.400+0000 7f25cffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f25d81603e0 0x7f25d8164370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.400+0000 7f25cffff700 1 -- 172.21.15.49:0/4068079017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25d8160010 msgr2=0x7f25d80ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.400+0000 7f25cffff700 1 --2- 172.21.15.49:0/4068079017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25d8160010 0x7f25d80ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.400+0000 7f25cffff700 1 -- 172.21.15.49:0/4068079017 >> v1:172.21.15.49:6789/0 conn(0x7f25d80ca680 legacy=0x7f25d80cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.400+0000 7f25cffff700 1 -- 172.21.15.49:0/4068079017 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d80cd9b0 con 0x7f25d81603e0 2023-07-21T22:11:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.404+0000 7f25cffff700 1 --2- 172.21.15.49:0/4068079017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d81603e0 0x7f25d8164370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009850 tx=0x7f25c0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a054be43b5de3ba9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:34.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.404+0000 7f25d77fe700 1 -- 172.21.15.49:0/4068079017 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0011830 con 0x7f25d81603e0 2023-07-21T22:11:34.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.404+0000 7f25d77fe700 1 -- 172.21.15.49:0/4068079017 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c0011990 con 0x7f25d81603e0 2023-07-21T22:11:34.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.404+0000 7f25d77fe700 1 -- 172.21.15.49:0/4068079017 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0011d40 con 0x7f25d81603e0 2023-07-21T22:11:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.404+0000 7f25dd603700 1 -- 172.21.15.49:0/4068079017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d81603e0 msgr2=0x7f25d8164370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.404+0000 7f25dd603700 1 --2- 172.21.15.49:0/4068079017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d81603e0 0x7f25d8164370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009850 tx=0x7f25c0009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.404+0000 7f25dd603700 1 -- 172.21.15.49:0/4068079017 shutdown_connections 2023-07-21T22:11:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.404+0000 7f25dd603700 1 --2- 172.21.15.49:0/4068079017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d81603e0 0x7f25d8164370 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.404+0000 7f25dd603700 1 --2- 172.21.15.49:0/4068079017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25d8160010 0x7f25d80ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.404+0000 7f25dd603700 1 -- 172.21.15.49:0/4068079017 >> 172.21.15.49:0/4068079017 conn(0x7f25d80ce0d0 msgr2=0x7f25d80ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.404+0000 7f25dd603700 1 -- 172.21.15.49:0/4068079017 shutdown_connections 2023-07-21T22:11:34.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.404+0000 7f25dd603700 1 -- 172.21.15.49:0/4068079017 wait complete. 2023-07-21T22:11:34.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25dd603700 1 Processor -- start 2023-07-21T22:11:34.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25dd603700 1 -- start start 2023-07-21T22:11:34.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25dd603700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25d80ca680 0x7f25d81561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25dd603700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d8160010 0x7f25d80b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25dd603700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25d81603e0 0x7f25d80b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25dd603700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80b0470 con 0x7f25d8160010 2023-07-21T22:11:34.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25dd603700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80af860 con 0x7f25d81603e0 2023-07-21T22:11:34.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25dd603700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80afb40 con 0x7f25d80ca680 2023-07-21T22:11:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25cffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d8160010 0x7f25d80b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25cffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d8160010 0x7f25d80b0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58420/0 (socket says 172.21.15.49:58420) 2023-07-21T22:11:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25cffff700 1 -- 172.21.15.49:0/2861989616 learned_addr learned my addr 172.21.15.49:0/2861989616 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25d7fff700 1 --2- 172.21.15.49:0/2861989616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25d80ca680 0x7f25d81561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25dce02700 1 --2- 172.21.15.49:0/2861989616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25d81603e0 0x7f25d80b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25cffff700 1 -- 172.21.15.49:0/2861989616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25d80ca680 msgr2=0x7f25d81561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25cffff700 1 --2- 172.21.15.49:0/2861989616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25d80ca680 0x7f25d81561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25cffff700 1 -- 172.21.15.49:0/2861989616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25d81603e0 msgr2=0x7f25d80b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25cffff700 1 --2- 172.21.15.49:0/2861989616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25d81603e0 0x7f25d80b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.408+0000 7f25cffff700 1 -- 172.21.15.49:0/2861989616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00094b0 con 0x7f25d8160010 2023-07-21T22:11:34.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.412+0000 7f25cffff700 1 --2- 172.21.15.49:0/2861989616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d8160010 0x7f25d80b0f40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f25c00090b0 tx=0x7f25c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:34.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.412+0000 7f25d57fa700 1 -- 172.21.15.49:0/2861989616 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0004570 con 0x7f25d8160010 2023-07-21T22:11:34.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.412+0000 7f25d57fa700 1 -- 172.21.15.49:0/2861989616 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c001f070 con 0x7f25d8160010 2023-07-21T22:11:34.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.412+0000 7f25dd603700 1 -- 172.21.15.49:0/2861989616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d80afe20 con 0x7f25d8160010 2023-07-21T22:11:34.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.412+0000 7f25d57fa700 1 -- 172.21.15.49:0/2861989616 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0003900 con 0x7f25d8160010 2023-07-21T22:11:34.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.412+0000 7f25dd603700 1 -- 172.21.15.49:0/2861989616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d81569c0 con 0x7f25d8160010 2023-07-21T22:11:34.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.412+0000 7f25dd603700 1 -- 172.21.15.49:0/2861989616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d815c720 con 0x7f25d8160010 2023-07-21T22:11:34.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.412+0000 7f25d57fa700 1 -- 172.21.15.49:0/2861989616 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f25c0021030 con 0x7f25d8160010 2023-07-21T22:11:34.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.416+0000 7f25d57fa700 1 --2- 172.21.15.49:0/2861989616 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f25b80662f0 0x7f25b80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.416+0000 7f25d57fa700 1 -- 172.21.15.49:0/2861989616 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f25c00854b0 con 0x7f25d8160010 2023-07-21T22:11:34.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.416+0000 7f25d7fff700 1 --2- 172.21.15.49:0/2861989616 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f25b80662f0 0x7f25b80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.416+0000 7f25d7fff700 1 --2- 172.21.15.49:0/2861989616 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f25b80662f0 0x7f25b80687a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009ae0 tx=0x7f25c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:34.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.420+0000 7f25d57fa700 1 -- 172.21.15.49:0/2861989616 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f25d815c720 con 0x7f25d8160010 2023-07-21T22:11:34.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.596+0000 7f25dd603700 1 -- 172.21.15.49:0/2861989616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f25d815c720 con 0x7f25d8160010 2023-07-21T22:11:34.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.596+0000 7f25d57fa700 1 -- 172.21.15.49:0/2861989616 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f25d815c720 con 0x7f25d8160010 2023-07-21T22:11:34.641 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:11:34.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.600+0000 7f25dd603700 1 -- 172.21.15.49:0/2861989616 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f25b80662f0 msgr2=0x7f25b80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.600+0000 7f25dd603700 1 --2- 172.21.15.49:0/2861989616 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f25b80662f0 0x7f25b80687a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009ae0 tx=0x7f25c8008040 comp rx=0 tx=0).stop 2023-07-21T22:11:34.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.600+0000 7f25dd603700 1 -- 172.21.15.49:0/2861989616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d8160010 msgr2=0x7f25d80b0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.600+0000 7f25dd603700 1 --2- 172.21.15.49:0/2861989616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d8160010 0x7f25d80b0f40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f25c00090b0 tx=0x7f25c0004770 comp rx=0 tx=0).stop 2023-07-21T22:11:34.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.600+0000 7f25dd603700 1 -- 172.21.15.49:0/2861989616 shutdown_connections 2023-07-21T22:11:34.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.600+0000 7f25dd603700 1 --2- 172.21.15.49:0/2861989616 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f25b80662f0 0x7f25b80687a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.600+0000 7f25dd603700 1 --2- 172.21.15.49:0/2861989616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d8160010 0x7f25d80b0f40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.600+0000 7f25dd603700 1 --2- 172.21.15.49:0/2861989616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25d81603e0 0x7f25d80b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.600+0000 7f25dd603700 1 --2- 172.21.15.49:0/2861989616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25d80ca680 0x7f25d81561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.600+0000 7f25dd603700 1 -- 172.21.15.49:0/2861989616 >> 172.21.15.49:0/2861989616 conn(0x7f25d80ce0d0 msgr2=0x7f25d8072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:34.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.600+0000 7f25dd603700 1 -- 172.21.15.49:0/2861989616 shutdown_connections 2023-07-21T22:11:34.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.600+0000 7f25dd603700 1 -- 172.21.15.49:0/2861989616 wait complete. 2023-07-21T22:11:34.666 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:11:34.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.812+0000 7f2a7b59e700 1 Processor -- start 2023-07-21T22:11:34.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.812+0000 7f2a7b59e700 1 -- start start 2023-07-21T22:11:34.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.812+0000 7f2a7b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a7c0c9b80 0x7f2a7c0ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.812+0000 7f2a7b59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c0b09f0 con 0x7f2a7c0aca90 2023-07-21T22:11:34.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.812+0000 7f2a7b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c15fa90 con 0x7f2a7c0698a0 2023-07-21T22:11:34.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.812+0000 7f2a7b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c160710 con 0x7f2a7c0c9b80 2023-07-21T22:11:34.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.812+0000 7f2a7ad9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2a7c0aca90 0x7f2a7c0b02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44276/0 (socket says 172.21.15.49:44276) 2023-07-21T22:11:34.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.812+0000 7f2a7ad9d700 1 -- 172.21.15.49:0/1753816260 learned_addr learned my addr 172.21.15.49:0/1753816260 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:34.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.812+0000 7f2a7a59c700 1 --2- 172.21.15.49:0/1753816260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a7c0c9b80 0x7f2a7c0ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a79d9b700 1 -- 172.21.15.49:0/1753816260 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168153435 0 0) 0x7f2a7c0b09f0 con 0x7f2a7c0aca90 2023-07-21T22:11:34.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a79d9b700 1 -- 172.21.15.49:0/1753816260 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a680035d0 con 0x7f2a7c0aca90 2023-07-21T22:11:34.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a7a59c700 1 -- 172.21.15.49:0/1753816260 >> v1:172.21.15.150:6789/0 conn(0x7f2a7c0698a0 legacy=0x7f2a7c0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a7a59c700 1 -- 172.21.15.49:0/1753816260 >> v1:172.21.15.49:6789/0 conn(0x7f2a7c0aca90 legacy=0x7f2a7c0b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a7a59c700 1 -- 172.21.15.49:0/1753816260 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c15fd70 con 0x7f2a7c0c9b80 2023-07-21T22:11:34.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a7a59c700 1 --2- 172.21.15.49:0/1753816260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a7c0c9b80 0x7f2a7c0ad3e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0098b0 tx=0x7f2a6c009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5425e87ab8ed8178 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:34.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a79d9b700 1 -- 172.21.15.49:0/1753816260 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c004230 con 0x7f2a7c0c9b80 2023-07-21T22:11:34.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a79d9b700 1 -- 172.21.15.49:0/1753816260 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c004390 con 0x7f2a7c0c9b80 2023-07-21T22:11:34.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a79d9b700 1 -- 172.21.15.49:0/1753816260 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0036c0 con 0x7f2a7c0c9b80 2023-07-21T22:11:34.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a7b59e700 1 -- 172.21.15.49:0/1753816260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a7c0c9b80 msgr2=0x7f2a7c0ad3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a7b59e700 1 --2- 172.21.15.49:0/1753816260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a7c0c9b80 0x7f2a7c0ad3e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0098b0 tx=0x7f2a6c009bc0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a7b59e700 1 -- 172.21.15.49:0/1753816260 shutdown_connections 2023-07-21T22:11:34.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a7b59e700 1 --2- 172.21.15.49:0/1753816260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a7c0c9b80 0x7f2a7c0ad3e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a7b59e700 1 -- 172.21.15.49:0/1753816260 >> 172.21.15.49:0/1753816260 conn(0x7f2a7c0ce0d0 msgr2=0x7f2a7c0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:34.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a7b59e700 1 -- 172.21.15.49:0/1753816260 shutdown_connections 2023-07-21T22:11:34.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.816+0000 7f2a7b59e700 1 -- 172.21.15.49:0/1753816260 wait complete. 2023-07-21T22:11:34.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.820+0000 7f2a7b59e700 1 Processor -- start 2023-07-21T22:11:34.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.820+0000 7f2a7b59e700 1 -- start start 2023-07-21T22:11:34.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.820+0000 7f2a7b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a7c0698a0 0x7f2a7c1546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.820+0000 7f2a7b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a7c0aca90 0x7f2a7c0b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.820+0000 7f2a7b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a7c0c9b80 0x7f2a7c0c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.820+0000 7f2a7b59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0b1df0 con 0x7f2a7c0698a0 2023-07-21T22:11:34.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.820+0000 7f2a7b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0b0f40 con 0x7f2a7c0aca90 2023-07-21T22:11:34.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.820+0000 7f2a7b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0b11e0 con 0x7f2a7c0c9b80 2023-07-21T22:11:34.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.820+0000 7f2a7a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a7c0698a0 0x7f2a7c1546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.820+0000 7f2a7a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a7c0698a0 0x7f2a7c1546d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49468/0 (socket says 172.21.15.49:49468) 2023-07-21T22:11:34.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.820+0000 7f2a7a59c700 1 -- 172.21.15.49:0/3499783437 learned_addr learned my addr 172.21.15.49:0/3499783437 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:34.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.820+0000 7f2a73fff700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a7c0aca90 0x7f2a7c0b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.820+0000 7f2a7ad9d700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a7c0c9b80 0x7f2a7c0c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.824+0000 7f2a7a59c700 1 -- 172.21.15.49:0/3499783437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a7c0c9b80 msgr2=0x7f2a7c0c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.824+0000 7f2a7a59c700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a7c0c9b80 0x7f2a7c0c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.824+0000 7f2a7a59c700 1 -- 172.21.15.49:0/3499783437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a7c0aca90 msgr2=0x7f2a7c0b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:34.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.824+0000 7f2a7a59c700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a7c0aca90 0x7f2a7c0b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:34.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.824+0000 7f2a7a59c700 1 -- 172.21.15.49:0/3499783437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c0094b0 con 0x7f2a7c0698a0 2023-07-21T22:11:34.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.824+0000 7f2a7ad9d700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a7c0c9b80 0x7f2a7c0c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:34.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.824+0000 7f2a7a59c700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a7c0698a0 0x7f2a7c1546d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c000c00 tx=0x7f2a6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:34.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.824+0000 7f2a72ffd700 1 -- 172.21.15.49:0/3499783437 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c006ea0 con 0x7f2a7c0698a0 2023-07-21T22:11:34.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.824+0000 7f2a72ffd700 1 -- 172.21.15.49:0/3499783437 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c01f070 con 0x7f2a7c0698a0 2023-07-21T22:11:34.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.824+0000 7f2a72ffd700 1 -- 172.21.15.49:0/3499783437 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c011870 con 0x7f2a7c0698a0 2023-07-21T22:11:34.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.824+0000 7f2a7b59e700 1 -- 172.21.15.49:0/3499783437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7c0b14c0 con 0x7f2a7c0698a0 2023-07-21T22:11:34.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.824+0000 7f2a7b59e700 1 -- 172.21.15.49:0/3499783437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c0b1a80 con 0x7f2a7c0698a0 2023-07-21T22:11:34.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.824+0000 7f2a7b59e700 1 -- 172.21.15.49:0/3499783437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7c04dcb0 con 0x7f2a7c0698a0 2023-07-21T22:11:34.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.824+0000 7f2a72ffd700 1 -- 172.21.15.49:0/3499783437 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2a6c021030 con 0x7f2a7c0698a0 2023-07-21T22:11:34.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.828+0000 7f2a72ffd700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a5c066320 0x7f2a5c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:34.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.828+0000 7f2a72ffd700 1 -- 172.21.15.49:0/3499783437 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2a6c085540 con 0x7f2a7c0698a0 2023-07-21T22:11:34.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.828+0000 7f2a73fff700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a5c066320 0x7f2a5c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:34.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.828+0000 7f2a73fff700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a5c066320 0x7f2a5c0687d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0ab8a0 tx=0x7f2a64009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:34.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:34.836+0000 7f2a72ffd700 1 -- 172.21.15.49:0/3499783437 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2a6c052680 con 0x7f2a7c0698a0 2023-07-21T22:11:35.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.012+0000 7f2a7b59e700 1 -- 172.21.15.49:0/3499783437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a7c04dcb0 con 0x7f2a7c0698a0 2023-07-21T22:11:35.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.016+0000 7f2a72ffd700 1 -- 172.21.15.49:0/3499783437 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a6c055ca0 con 0x7f2a7c0698a0 2023-07-21T22:11:35.059 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:35.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.016+0000 7f2a7b59e700 1 -- 172.21.15.49:0/3499783437 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a5c066320 msgr2=0x7f2a5c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:35.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.016+0000 7f2a7b59e700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a5c066320 0x7f2a5c0687d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0ab8a0 tx=0x7f2a64009040 comp rx=0 tx=0).stop 2023-07-21T22:11:35.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.016+0000 7f2a7b59e700 1 -- 172.21.15.49:0/3499783437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a7c0698a0 msgr2=0x7f2a7c1546d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:35.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.016+0000 7f2a7b59e700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a7c0698a0 0x7f2a7c1546d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c000c00 tx=0x7f2a6c004770 comp rx=0 tx=0).stop 2023-07-21T22:11:35.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.016+0000 7f2a7b59e700 1 -- 172.21.15.49:0/3499783437 shutdown_connections 2023-07-21T22:11:35.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.016+0000 7f2a7b59e700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a5c066320 0x7f2a5c0687d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.016+0000 7f2a7b59e700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a7c0c9b80 0x7f2a7c0c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.016+0000 7f2a7b59e700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a7c0aca90 0x7f2a7c0b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.016+0000 7f2a7b59e700 1 --2- 172.21.15.49:0/3499783437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a7c0698a0 0x7f2a7c1546d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.016+0000 7f2a7b59e700 1 -- 172.21.15.49:0/3499783437 >> 172.21.15.49:0/3499783437 conn(0x7f2a7c0ce0d0 msgr2=0x7f2a7c06c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:35.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.016+0000 7f2a7b59e700 1 -- 172.21.15.49:0/3499783437 shutdown_connections 2023-07-21T22:11:35.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.016+0000 7f2a7b59e700 1 -- 172.21.15.49:0/3499783437 wait complete. 2023-07-21T22:11:35.086 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:11:35.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.224+0000 7febcb59e700 1 Processor -- start 2023-07-21T22:11:35.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.228+0000 7febcb59e700 1 -- start start 2023-07-21T22:11:35.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.228+0000 7febcb59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7febcc0b1440 0x7febcc06e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:35.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.228+0000 7febcb59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7febcc06eea0 0x7febcc0cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:35.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.228+0000 7febcb59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febcc0cb000 con 0x7febcc159d10 2023-07-21T22:11:35.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.228+0000 7febcb59e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febcc06f320 con 0x7febcc06eea0 2023-07-21T22:11:35.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.228+0000 7febca59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7febcc159d10 0x7febcc0698a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44290/0 (socket says 172.21.15.49:44290) 2023-07-21T22:11:35.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.228+0000 7febca59c700 1 -- 172.21.15.49:0/2901060269 learned_addr learned my addr 172.21.15.49:0/2901060269 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:35.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.228+0000 7febcb59e700 1 -- 172.21.15.49:0/2901060269 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febcc06a0f0 con 0x7febcc0b1440 2023-07-21T22:11:35.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.228+0000 7febc9d9b700 1 --2- 172.21.15.49:0/2901060269 >> v2:172.21.15.150:3300/0 conn(0x7febcc0b1440 0x7febcc06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:35.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.228+0000 7febcad9d700 1 --2- 172.21.15.49:0/2901060269 >> v2:172.21.15.49:3300/0 conn(0x7febcc06eea0 0x7febcc0cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:35.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febc959a700 1 -- 172.21.15.49:0/2901060269 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191991110 0 0) 0x7febcc0cb000 con 0x7febcc159d10 2023-07-21T22:11:35.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febc959a700 1 -- 172.21.15.49:0/2901060269 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febb40035d0 con 0x7febcc159d10 2023-07-21T22:11:35.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febc9d9b700 1 -- 172.21.15.49:0/2901060269 >> v2:172.21.15.49:3300/0 conn(0x7febcc06eea0 msgr2=0x7febcc0cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:35.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febc9d9b700 1 --2- 172.21.15.49:0/2901060269 >> v2:172.21.15.49:3300/0 conn(0x7febcc06eea0 0x7febcc0cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febc9d9b700 1 -- 172.21.15.49:0/2901060269 >> v1:172.21.15.49:6789/0 conn(0x7febcc159d10 legacy=0x7febcc0698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:35.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febc9d9b700 1 -- 172.21.15.49:0/2901060269 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc06a3d0 con 0x7febcc0b1440 2023-07-21T22:11:35.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febc9d9b700 1 --2- 172.21.15.49:0/2901060269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc0b1440 0x7febcc06e960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7febcc15d7f0 tx=0x7febc0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acbff4cc29c3e55b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:35.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febc959a700 1 -- 172.21.15.49:0/2901060269 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0011830 con 0x7febcc0b1440 2023-07-21T22:11:35.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febc959a700 1 -- 172.21.15.49:0/2901060269 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc0011990 con 0x7febcc0b1440 2023-07-21T22:11:35.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febc959a700 1 -- 172.21.15.49:0/2901060269 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0011d20 con 0x7febcc0b1440 2023-07-21T22:11:35.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febcb59e700 1 -- 172.21.15.49:0/2901060269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc0b1440 msgr2=0x7febcc06e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:35.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febcb59e700 1 --2- 172.21.15.49:0/2901060269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc0b1440 0x7febcc06e960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7febcc15d7f0 tx=0x7febc0009b30 comp rx=0 tx=0).stop 2023-07-21T22:11:35.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febcb59e700 1 -- 172.21.15.49:0/2901060269 shutdown_connections 2023-07-21T22:11:35.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febcb59e700 1 --2- 172.21.15.49:0/2901060269 >> v2:172.21.15.49:3300/0 conn(0x7febcc06eea0 0x7febcc0cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febcb59e700 1 --2- 172.21.15.49:0/2901060269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc0b1440 0x7febcc06e960 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febcb59e700 1 -- 172.21.15.49:0/2901060269 >> 172.21.15.49:0/2901060269 conn(0x7febcc06fa70 msgr2=0x7febcc06fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:35.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febcb59e700 1 -- 172.21.15.49:0/2901060269 shutdown_connections 2023-07-21T22:11:35.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.232+0000 7febcb59e700 1 -- 172.21.15.49:0/2901060269 wait complete. 2023-07-21T22:11:35.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.236+0000 7febcb59e700 1 Processor -- start 2023-07-21T22:11:35.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.236+0000 7febcb59e700 1 -- start start 2023-07-21T22:11:35.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.236+0000 7febcb59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febcc06eea0 0x7febcc0ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:35.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febcb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febcc0b1440 0x7febcc0add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:35.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febcb59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc159d10 0x7febcc0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:35.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febcb59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc0cd290 con 0x7febcc06eea0 2023-07-21T22:11:35.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febcb59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc0ae2a0 con 0x7febcc159d10 2023-07-21T22:11:35.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febcb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc0cd4c0 con 0x7febcc0b1440 2023-07-21T22:11:35.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febca59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febcc06eea0 0x7febcc0ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:35.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febca59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febcc06eea0 0x7febcc0ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49476/0 (socket says 172.21.15.49:49476) 2023-07-21T22:11:35.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febca59c700 1 -- 172.21.15.49:0/3927887255 learned_addr learned my addr 172.21.15.49:0/3927887255 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:35.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febcad9d700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc159d10 0x7febcc0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:35.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febc9d9b700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febcc0b1440 0x7febcc0add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:35.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febca59c700 1 -- 172.21.15.49:0/3927887255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febcc0b1440 msgr2=0x7febcc0add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:35.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febca59c700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febcc0b1440 0x7febcc0add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febca59c700 1 -- 172.21.15.49:0/3927887255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc159d10 msgr2=0x7febcc0c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:35.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febca59c700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc159d10 0x7febcc0c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febca59c700 1 -- 172.21.15.49:0/3927887255 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00094b0 con 0x7febcc06eea0 2023-07-21T22:11:35.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febcad9d700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc159d10 0x7febcc0c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:35.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febca59c700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febcc06eea0 0x7febcc0ccd50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7febbc00c4d0 tx=0x7febbc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:35.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febbaffd700 1 -- 172.21.15.49:0/3927887255 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc005d90 con 0x7febcc06eea0 2023-07-21T22:11:35.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febbaffd700 1 -- 172.21.15.49:0/3927887255 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc0070d0 con 0x7febcc06eea0 2023-07-21T22:11:35.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febbaffd700 1 -- 172.21.15.49:0/3927887255 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc007480 con 0x7febcc06eea0 2023-07-21T22:11:35.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febcb59e700 1 -- 172.21.15.49:0/3927887255 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febcc0cd7a0 con 0x7febcc06eea0 2023-07-21T22:11:35.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febcb59e700 1 -- 172.21.15.49:0/3927887255 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febcc0cdd60 con 0x7febcc06eea0 2023-07-21T22:11:35.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.240+0000 7febcb59e700 1 -- 172.21.15.49:0/3927887255 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febcc04dcb0 con 0x7febcc06eea0 2023-07-21T22:11:35.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.244+0000 7febbaffd700 1 -- 172.21.15.49:0/3927887255 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7febbc0075e0 con 0x7febcc06eea0 2023-07-21T22:11:35.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.244+0000 7febbaffd700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7febac0662f0 0x7febac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:35.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.244+0000 7febbaffd700 1 -- 172.21.15.49:0/3927887255 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7febbc0835d0 con 0x7febcc06eea0 2023-07-21T22:11:35.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.244+0000 7febc9d9b700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7febac0662f0 0x7febac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:35.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.248+0000 7febc9d9b700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7febac0662f0 0x7febac0687a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7febc0000c00 tx=0x7febc0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.252+0000 7febbaffd700 1 -- 172.21.15.49:0/3927887255 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7febbc050720 con 0x7febcc06eea0 2023-07-21T22:11:35.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.432+0000 7febcb59e700 1 -- 172.21.15.49:0/3927887255 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7febcc0b0090 con 0x7febcc06eea0 2023-07-21T22:11:35.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.432+0000 7febbaffd700 1 -- 172.21.15.49:0/3927887255 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7febbc053d40 con 0x7febcc06eea0 2023-07-21T22:11:35.483 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:11:35.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.436+0000 7febcb59e700 1 -- 172.21.15.49:0/3927887255 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7febac0662f0 msgr2=0x7febac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:35.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.436+0000 7febcb59e700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7febac0662f0 0x7febac0687a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7febc0000c00 tx=0x7febc0008030 comp rx=0 tx=0).stop 2023-07-21T22:11:35.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.436+0000 7febcb59e700 1 -- 172.21.15.49:0/3927887255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febcc06eea0 msgr2=0x7febcc0ccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:35.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.436+0000 7febcb59e700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febcc06eea0 0x7febcc0ccd50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7febbc00c4d0 tx=0x7febbc00c890 comp rx=0 tx=0).stop 2023-07-21T22:11:35.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.436+0000 7febcb59e700 1 -- 172.21.15.49:0/3927887255 shutdown_connections 2023-07-21T22:11:35.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.436+0000 7febcb59e700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7febac0662f0 0x7febac0687a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.436+0000 7febcb59e700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc159d10 0x7febcc0c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.436+0000 7febcb59e700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febcc0b1440 0x7febcc0add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.436+0000 7febcb59e700 1 --2- 172.21.15.49:0/3927887255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febcc06eea0 0x7febcc0ccd50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.436+0000 7febcb59e700 1 -- 172.21.15.49:0/3927887255 >> 172.21.15.49:0/3927887255 conn(0x7febcc06fa70 msgr2=0x7febcc158f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:35.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.436+0000 7febcb59e700 1 -- 172.21.15.49:0/3927887255 shutdown_connections 2023-07-21T22:11:35.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.436+0000 7febcb59e700 1 -- 172.21.15.49:0/3927887255 wait complete. 2023-07-21T22:11:35.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:11:35.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.644+0000 7f8f8d4c3700 1 Processor -- start 2023-07-21T22:11:35.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.644+0000 7f8f8d4c3700 1 -- start start 2023-07-21T22:11:35.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.648+0000 7f8f8d4c3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8f880b7af0 0x7f8f880b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:35.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.648+0000 7f8f8d4c3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f880cee10 0x7f8f880cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:35.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.648+0000 7f8f8d4c3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f880b3e80 con 0x7f8f880d1e40 2023-07-21T22:11:35.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.648+0000 7f8f8d4c3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f880cf790 con 0x7f8f880cee10 2023-07-21T22:11:35.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.648+0000 7f8f8d4c3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8815fd40 con 0x7f8f880b7af0 2023-07-21T22:11:35.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.648+0000 7f8f877fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8f880d1e40 0x7f8f8815f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44304/0 (socket says 172.21.15.49:44304) 2023-07-21T22:11:35.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.648+0000 7f8f877fe700 1 -- 172.21.15.49:0/2181334888 learned_addr learned my addr 172.21.15.49:0/2181334888 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:35.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.648+0000 7f8f8ccc2700 1 --2- 172.21.15.49:0/2181334888 >> v2:172.21.15.49:3300/0 conn(0x7f8f880cee10 0x7f8f880cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:35.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.648+0000 7f8f87fff700 1 --2- 172.21.15.49:0/2181334888 >> v2:172.21.15.150:3300/0 conn(0x7f8f880b7af0 0x7f8f880b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:35.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f86ffd700 1 -- 172.21.15.49:0/2181334888 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642745635 0 0) 0x7f8f880b3e80 con 0x7f8f880d1e40 2023-07-21T22:11:35.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f86ffd700 1 -- 172.21.15.49:0/2181334888 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f700035d0 con 0x7f8f880d1e40 2023-07-21T22:11:35.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f8ccc2700 1 -- 172.21.15.49:0/2181334888 >> v2:172.21.15.150:3300/0 conn(0x7f8f880b7af0 msgr2=0x7f8f880b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:35.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f8ccc2700 1 --2- 172.21.15.49:0/2181334888 >> v2:172.21.15.150:3300/0 conn(0x7f8f880b7af0 0x7f8f880b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f8ccc2700 1 -- 172.21.15.49:0/2181334888 >> v1:172.21.15.49:6789/0 conn(0x7f8f880d1e40 legacy=0x7f8f8815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:35.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f8ccc2700 1 -- 172.21.15.49:0/2181334888 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f880cea00 con 0x7f8f880cee10 2023-07-21T22:11:35.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f87fff700 1 --2- 172.21.15.49:0/2181334888 >> v2:172.21.15.150:3300/0 conn(0x7f8f880b7af0 0x7f8f880b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:35.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f8ccc2700 1 --2- 172.21.15.49:0/2181334888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f880cee10 0x7f8f880cf250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8f880cede0 tx=0x7f8f8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24eff519f7c9d0b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:35.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f86ffd700 1 -- 172.21.15.49:0/2181334888 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8000e070 con 0x7f8f880cee10 2023-07-21T22:11:35.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f86ffd700 1 -- 172.21.15.49:0/2181334888 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8000bb20 con 0x7f8f880cee10 2023-07-21T22:11:35.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f86ffd700 1 -- 172.21.15.49:0/2181334888 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80012430 con 0x7f8f880cee10 2023-07-21T22:11:35.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/2181334888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f880cee10 msgr2=0x7f8f880cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:35.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f8d4c3700 1 --2- 172.21.15.49:0/2181334888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f880cee10 0x7f8f880cf250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8f880cede0 tx=0x7f8f8000b330 comp rx=0 tx=0).stop 2023-07-21T22:11:35.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/2181334888 shutdown_connections 2023-07-21T22:11:35.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f8d4c3700 1 --2- 172.21.15.49:0/2181334888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f880cee10 0x7f8f880cf250 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f8d4c3700 1 --2- 172.21.15.49:0/2181334888 >> v2:172.21.15.150:3300/0 conn(0x7f8f880b7af0 0x7f8f880b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/2181334888 >> 172.21.15.49:0/2181334888 conn(0x7f8f8806e960 msgr2=0x7f8f8806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:35.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/2181334888 shutdown_connections 2023-07-21T22:11:35.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.652+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/2181334888 wait complete. 2023-07-21T22:11:35.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.656+0000 7f8f8d4c3700 1 Processor -- start 2023-07-21T22:11:35.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.656+0000 7f8f8d4c3700 1 -- start start 2023-07-21T22:11:35.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.656+0000 7f8f8d4c3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f880b7af0 0x7f8f880b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:35.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.656+0000 7f8f8d4c3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f880cee10 0x7f8f881f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:35.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.656+0000 7f8f8d4c3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f880d1e40 0x7f8f880b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:35.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.656+0000 7f8f8d4c3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f881f56e0 con 0x7f8f880d1e40 2023-07-21T22:11:35.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.656+0000 7f8f8d4c3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f881f4750 con 0x7f8f880b7af0 2023-07-21T22:11:35.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.656+0000 7f8f8d4c3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f881f4d10 con 0x7f8f880cee10 2023-07-21T22:11:35.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.656+0000 7f8f8ccc2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f880d1e40 0x7f8f880b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:35.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.656+0000 7f8f8ccc2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f880d1e40 0x7f8f880b63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49496/0 (socket says 172.21.15.49:49496) 2023-07-21T22:11:35.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.656+0000 7f8f8ccc2700 1 -- 172.21.15.49:0/706253234 learned_addr learned my addr 172.21.15.49:0/706253234 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:35.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.656+0000 7f8f87fff700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f880b7af0 0x7f8f880b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:35.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.660+0000 7f8f877fe700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f880cee10 0x7f8f881f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:35.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.660+0000 7f8f8ccc2700 1 -- 172.21.15.49:0/706253234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f880cee10 msgr2=0x7f8f881f51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:35.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.660+0000 7f8f8ccc2700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f880cee10 0x7f8f881f51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.660+0000 7f8f8ccc2700 1 -- 172.21.15.49:0/706253234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f880b7af0 msgr2=0x7f8f880b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:35.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.660+0000 7f8f8ccc2700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f880b7af0 0x7f8f880b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.660+0000 7f8f8ccc2700 1 -- 172.21.15.49:0/706253234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f780094b0 con 0x7f8f880d1e40 2023-07-21T22:11:35.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.660+0000 7f8f877fe700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f880cee10 0x7f8f881f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:35.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.660+0000 7f8f8ccc2700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f880d1e40 0x7f8f880b63b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000b370 tx=0x7f8f80004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:35.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.660+0000 7f8f84ff9700 1 -- 172.21.15.49:0/706253234 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80012430 con 0x7f8f880d1e40 2023-07-21T22:11:35.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.660+0000 7f8f84ff9700 1 -- 172.21.15.49:0/706253234 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f80020070 con 0x7f8f880d1e40 2023-07-21T22:11:35.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.660+0000 7f8f84ff9700 1 -- 172.21.15.49:0/706253234 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80004280 con 0x7f8f880d1e40 2023-07-21T22:11:35.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.660+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/706253234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f80009a70 con 0x7f8f880d1e40 2023-07-21T22:11:35.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.660+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/706253234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f880c8ab0 con 0x7f8f880d1e40 2023-07-21T22:11:35.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.660+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/706253234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f881f4ec0 con 0x7f8f880d1e40 2023-07-21T22:11:35.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.664+0000 7f8f84ff9700 1 -- 172.21.15.49:0/706253234 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8f800043e0 con 0x7f8f880d1e40 2023-07-21T22:11:35.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.664+0000 7f8f84ff9700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8f740662f0 0x7f8f740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:35.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.664+0000 7f8f84ff9700 1 -- 172.21.15.49:0/706253234 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8f80022070 con 0x7f8f880d1e40 2023-07-21T22:11:35.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.664+0000 7f8f87fff700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8f740662f0 0x7f8f740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:35.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.664+0000 7f8f87fff700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8f740662f0 0x7f8f740687a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009d80 tx=0x7f8f78009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:35.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.672+0000 7f8f84ff9700 1 -- 172.21.15.49:0/706253234 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8f881f4ec0 con 0x7f8f880d1e40 2023-07-21T22:11:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.844+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/706253234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8f880c8c40 con 0x7f8f880d1e40 2023-07-21T22:11:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.844+0000 7f8f84ff9700 1 -- 172.21.15.49:0/706253234 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8f8002c020 con 0x7f8f880d1e40 2023-07-21T22:11:35.890 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.848+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/706253234 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8f740662f0 msgr2=0x7f8f740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.848+0000 7f8f8d4c3700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8f740662f0 0x7f8f740687a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009d80 tx=0x7f8f78009240 comp rx=0 tx=0).stop 2023-07-21T22:11:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.848+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/706253234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f880d1e40 msgr2=0x7f8f880b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.848+0000 7f8f8d4c3700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f880d1e40 0x7f8f880b63b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000b370 tx=0x7f8f80004b40 comp rx=0 tx=0).stop 2023-07-21T22:11:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.848+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/706253234 shutdown_connections 2023-07-21T22:11:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.848+0000 7f8f8d4c3700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8f740662f0 0x7f8f740687a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.848+0000 7f8f8d4c3700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f880d1e40 0x7f8f880b63b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.848+0000 7f8f8d4c3700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f880cee10 0x7f8f881f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.848+0000 7f8f8d4c3700 1 --2- 172.21.15.49:0/706253234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f880b7af0 0x7f8f880b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.848+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/706253234 >> 172.21.15.49:0/706253234 conn(0x7f8f8806e960 msgr2=0x7f8f880b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.848+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/706253234 shutdown_connections 2023-07-21T22:11:35.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:35.848+0000 7f8f8d4c3700 1 -- 172.21.15.49:0/706253234 wait complete. 2023-07-21T22:11:35.915 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:36.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.052+0000 7f86f31dc700 1 Processor -- start 2023-07-21T22:11:36.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.052+0000 7f86f31dc700 1 -- start start 2023-07-21T22:11:36.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f31dc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f86ec06d380 0x7f86ec06d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f31dc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86ec071c70 0x7f86ec0b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f31dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86ec0b1400 0x7f86ec0cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f31dc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec0c9e80 con 0x7f86ec071c70 2023-07-21T22:11:36.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f31dc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec0afeb0 con 0x7f86ec06d380 2023-07-21T22:11:36.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f31dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0cab20 con 0x7f86ec0b1400 2023-07-21T22:11:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f19d9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86ec071c70 0x7f86ec0b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f19d9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86ec071c70 0x7f86ec0b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49512/0 (socket says 172.21.15.49:49512) 2023-07-21T22:11:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f19d9700 1 -- 172.21.15.49:0/1015729136 learned_addr learned my addr 172.21.15.49:0/1015729136 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f21da700 1 --2- 172.21.15.49:0/1015729136 >> v2:172.21.15.150:3300/0 conn(0x7f86ec06d380 0x7f86ec06d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f29db700 1 --2- 172.21.15.49:0/1015729136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86ec0b1400 0x7f86ec0cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f19d9700 1 -- 172.21.15.49:0/1015729136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86ec0b1400 msgr2=0x7f86ec0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:36.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f19d9700 1 --2- 172.21.15.49:0/1015729136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86ec0b1400 0x7f86ec0cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f19d9700 1 -- 172.21.15.49:0/1015729136 >> v2:172.21.15.150:3300/0 conn(0x7f86ec06d380 msgr2=0x7f86ec06d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:36.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f19d9700 1 --2- 172.21.15.49:0/1015729136 >> v2:172.21.15.150:3300/0 conn(0x7f86ec06d380 0x7f86ec06d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f19d9700 1 -- 172.21.15.49:0/1015729136 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec06dc90 con 0x7f86ec071c70 2023-07-21T22:11:36.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f21da700 1 --2- 172.21.15.49:0/1015729136 >> v2:172.21.15.150:3300/0 conn(0x7f86ec06d380 0x7f86ec06d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:36.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.056+0000 7f86f19d9700 1 --2- 172.21.15.49:0/1015729136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ec071c70 0x7f86ec0b0ec0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0cbb30 tx=0x7f86dc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6e078ec3afc199 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:36.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.060+0000 7f86f11d8700 1 -- 172.21.15.49:0/1015729136 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc011830 con 0x7f86ec071c70 2023-07-21T22:11:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.060+0000 7f86f11d8700 1 -- 172.21.15.49:0/1015729136 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc011990 con 0x7f86ec071c70 2023-07-21T22:11:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.060+0000 7f86f11d8700 1 -- 172.21.15.49:0/1015729136 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc011d20 con 0x7f86ec071c70 2023-07-21T22:11:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.060+0000 7f86f31dc700 1 -- 172.21.15.49:0/1015729136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ec071c70 msgr2=0x7f86ec0b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.060+0000 7f86f31dc700 1 --2- 172.21.15.49:0/1015729136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ec071c70 0x7f86ec0b0ec0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0cbb30 tx=0x7f86dc009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.060+0000 7f86f31dc700 1 -- 172.21.15.49:0/1015729136 shutdown_connections 2023-07-21T22:11:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.060+0000 7f86f31dc700 1 --2- 172.21.15.49:0/1015729136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86ec0b1400 0x7f86ec0cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.060+0000 7f86f31dc700 1 --2- 172.21.15.49:0/1015729136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ec071c70 0x7f86ec0b0ec0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.060+0000 7f86f31dc700 1 --2- 172.21.15.49:0/1015729136 >> v2:172.21.15.150:3300/0 conn(0x7f86ec06d380 0x7f86ec06d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.060+0000 7f86f31dc700 1 -- 172.21.15.49:0/1015729136 >> 172.21.15.49:0/1015729136 conn(0x7f86ec070450 msgr2=0x7f86ec070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:36.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.060+0000 7f86f31dc700 1 -- 172.21.15.49:0/1015729136 shutdown_connections 2023-07-21T22:11:36.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.060+0000 7f86f31dc700 1 -- 172.21.15.49:0/1015729136 wait complete. 2023-07-21T22:11:36.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.064+0000 7f86f31dc700 1 Processor -- start 2023-07-21T22:11:36.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.064+0000 7f86f31dc700 1 -- start start 2023-07-21T22:11:36.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.064+0000 7f86f31dc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86ec06d380 0x7f86ec1f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.064+0000 7f86f31dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86ec071c70 0x7f86ec159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.064+0000 7f86f31dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ec0b1400 0x7f86ec15a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.064+0000 7f86f31dc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0c3070 con 0x7f86ec0b1400 2023-07-21T22:11:36.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.064+0000 7f86f31dc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0c3350 con 0x7f86ec06d380 2023-07-21T22:11:36.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.064+0000 7f86f31dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0c3630 con 0x7f86ec071c70 2023-07-21T22:11:36.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.064+0000 7f86f29db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ec0b1400 0x7f86ec15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86f29db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ec0b1400 0x7f86ec15a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49518/0 (socket says 172.21.15.49:49518) 2023-07-21T22:11:36.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86f21da700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86ec06d380 0x7f86ec1f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86f29db700 1 -- 172.21.15.49:0/627357533 learned_addr learned my addr 172.21.15.49:0/627357533 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:36.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86f19d9700 1 --2- 172.21.15.49:0/627357533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86ec071c70 0x7f86ec159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86f21da700 1 -- 172.21.15.49:0/627357533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86ec071c70 msgr2=0x7f86ec159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86f21da700 1 --2- 172.21.15.49:0/627357533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86ec071c70 0x7f86ec159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86f21da700 1 -- 172.21.15.49:0/627357533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ec0b1400 msgr2=0x7f86ec15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86f21da700 1 --2- 172.21.15.49:0/627357533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ec0b1400 0x7f86ec15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86f21da700 1 -- 172.21.15.49:0/627357533 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e80094b0 con 0x7f86ec06d380 2023-07-21T22:11:36.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86f29db700 1 --2- 172.21.15.49:0/627357533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ec0b1400 0x7f86ec15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:36.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86f21da700 1 --2- 172.21.15.49:0/627357533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86ec06d380 0x7f86ec1f13c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f86e800e890 tx=0x7f86e800eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:36.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86e2ffd700 1 -- 172.21.15.49:0/627357533 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8004030 con 0x7f86ec06d380 2023-07-21T22:11:36.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86e2ffd700 1 -- 172.21.15.49:0/627357533 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e8004190 con 0x7f86ec06d380 2023-07-21T22:11:36.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86f31dc700 1 -- 172.21.15.49:0/627357533 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86dc009570 con 0x7f86ec06d380 2023-07-21T22:11:36.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86e2ffd700 1 -- 172.21.15.49:0/627357533 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8004520 con 0x7f86ec06d380 2023-07-21T22:11:36.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86f31dc700 1 -- 172.21.15.49:0/627357533 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec0c3bf0 con 0x7f86ec06d380 2023-07-21T22:11:36.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.068+0000 7f86f31dc700 1 -- 172.21.15.49:0/627357533 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ec06f600 con 0x7f86ec06d380 2023-07-21T22:11:36.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.072+0000 7f86e2ffd700 1 -- 172.21.15.49:0/627357533 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f86e803a080 con 0x7f86ec06d380 2023-07-21T22:11:36.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.076+0000 7f86e2ffd700 1 --2- 172.21.15.49:0/627357533 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f86d00662f0 0x7f86d00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.076+0000 7f86e2ffd700 1 -- 172.21.15.49:0/627357533 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f86e80840f0 con 0x7f86ec06d380 2023-07-21T22:11:36.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.076+0000 7f86f19d9700 1 --2- 172.21.15.49:0/627357533 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f86d00662f0 0x7f86d00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.076+0000 7f86f19d9700 1 --2- 172.21.15.49:0/627357533 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f86d00662f0 0x7f86d00687a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009860 tx=0x7f86dc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:36.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.080+0000 7f86e2ffd700 1 -- 172.21.15.49:0/627357533 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f86e8051190 con 0x7f86ec06d380 2023-07-21T22:11:36.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.256+0000 7f86f31dc700 1 -- 172.21.15.49:0/627357533 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86ec0ca4a0 con 0x7f86ec06d380 2023-07-21T22:11:36.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.260+0000 7f86e2ffd700 1 -- 172.21.15.49:0/627357533 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7f86e8020020 con 0x7f86ec06d380 2023-07-21T22:11:36.306 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:36.307 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:36.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.264+0000 7f86f31dc700 1 -- 172.21.15.49:0/627357533 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f86d00662f0 msgr2=0x7f86d00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.264+0000 7f86f31dc700 1 --2- 172.21.15.49:0/627357533 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f86d00662f0 0x7f86d00687a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009860 tx=0x7f86dc008030 comp rx=0 tx=0).stop 2023-07-21T22:11:36.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.264+0000 7f86f31dc700 1 -- 172.21.15.49:0/627357533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86ec06d380 msgr2=0x7f86ec1f13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.264+0000 7f86f31dc700 1 --2- 172.21.15.49:0/627357533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86ec06d380 0x7f86ec1f13c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f86e800e890 tx=0x7f86e800eba0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.264+0000 7f86f31dc700 1 -- 172.21.15.49:0/627357533 shutdown_connections 2023-07-21T22:11:36.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.264+0000 7f86f31dc700 1 --2- 172.21.15.49:0/627357533 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f86d00662f0 0x7f86d00687a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.264+0000 7f86f31dc700 1 --2- 172.21.15.49:0/627357533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ec0b1400 0x7f86ec15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.264+0000 7f86f31dc700 1 --2- 172.21.15.49:0/627357533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86ec071c70 0x7f86ec159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.264+0000 7f86f31dc700 1 --2- 172.21.15.49:0/627357533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86ec06d380 0x7f86ec1f13c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.264+0000 7f86f31dc700 1 -- 172.21.15.49:0/627357533 >> 172.21.15.49:0/627357533 conn(0x7f86ec070450 msgr2=0x7f86ec158ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.264+0000 7f86f31dc700 1 -- 172.21.15.49:0/627357533 shutdown_connections 2023-07-21T22:11:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.264+0000 7f86f31dc700 1 -- 172.21.15.49:0/627357533 wait complete. 2023-07-21T22:11:36.330 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:11:36.331 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:11:36.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.468+0000 7fb0b8907700 1 Processor -- start 2023-07-21T22:11:36.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.468+0000 7fb0b8907700 1 -- start start 2023-07-21T22:11:36.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b8907700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb0b40d1e40 0x7fb0b40b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b8907700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b40b3e80 con 0x7fb0b40cee10 2023-07-21T22:11:36.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b8907700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b415fd40 con 0x7fb0b40b7af0 2023-07-21T22:11:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b8907700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b40cea00 con 0x7fb0b40d1e40 2023-07-21T22:11:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb0b40cee10 0x7fb0b40b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44320/0 (socket says 172.21.15.49:44320) 2023-07-21T22:11:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b3fff700 1 -- 172.21.15.49:0/1514910824 learned_addr learned my addr 172.21.15.49:0/1514910824 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b2ffd700 1 --2- 172.21.15.49:0/1514910824 >> v2:172.21.15.150:3300/0 conn(0x7fb0b40d1e40 0x7fb0b40b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b27fc700 1 -- 172.21.15.49:0/1514910824 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065574212 0 0) 0x7fb0b40b3e80 con 0x7fb0b40cee10 2023-07-21T22:11:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b27fc700 1 -- 172.21.15.49:0/1514910824 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb09c0035d0 con 0x7fb0b40cee10 2023-07-21T22:11:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b27fc700 1 -- 172.21.15.49:0/1514910824 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403550379 0 0) 0x7fb0b415fd40 con 0x7fb0b40b7af0 2023-07-21T22:11:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b27fc700 1 -- 172.21.15.49:0/1514910824 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b40b3e80 con 0x7fb0b40b7af0 2023-07-21T22:11:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b2ffd700 1 -- 172.21.15.49:0/1514910824 >> v1:172.21.15.150:6789/0 conn(0x7fb0b40b7af0 legacy=0x7fb0b415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b27fc700 1 -- 172.21.15.49:0/1514910824 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1527358422 0 0) 0x7fb09c0035d0 con 0x7fb0b40cee10 2023-07-21T22:11:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b2ffd700 1 -- 172.21.15.49:0/1514910824 >> v1:172.21.15.49:6789/0 conn(0x7fb0b40cee10 legacy=0x7fb0b40b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b2ffd700 1 -- 172.21.15.49:0/1514910824 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b40ccbf0 con 0x7fb0b40d1e40 2023-07-21T22:11:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b2ffd700 1 --2- 172.21.15.49:0/1514910824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0b40d1e40 0x7fb0b40b1630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009850 tx=0x7fb0a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be6b1d505af97b48 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.472+0000 7fb0b27fc700 1 -- 172.21.15.49:0/1514910824 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac001a40 con 0x7fb0b40d1e40 2023-07-21T22:11:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.476+0000 7fb0b27fc700 1 -- 172.21.15.49:0/1514910824 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a8004030 con 0x7fb0b40d1e40 2023-07-21T22:11:36.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.476+0000 7fb0b27fc700 1 -- 172.21.15.49:0/1514910824 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80043c0 con 0x7fb0b40d1e40 2023-07-21T22:11:36.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.476+0000 7fb0b8907700 1 -- 172.21.15.49:0/1514910824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0b40d1e40 msgr2=0x7fb0b40b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.476+0000 7fb0b8907700 1 --2- 172.21.15.49:0/1514910824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0b40d1e40 0x7fb0b40b1630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009850 tx=0x7fb0a8009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:36.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.476+0000 7fb0b8907700 1 -- 172.21.15.49:0/1514910824 shutdown_connections 2023-07-21T22:11:36.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.476+0000 7fb0b8907700 1 --2- 172.21.15.49:0/1514910824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0b40d1e40 0x7fb0b40b1630 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.476+0000 7fb0b8907700 1 -- 172.21.15.49:0/1514910824 >> 172.21.15.49:0/1514910824 conn(0x7fb0b406e960 msgr2=0x7fb0b406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:36.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.476+0000 7fb0b8907700 1 -- 172.21.15.49:0/1514910824 shutdown_connections 2023-07-21T22:11:36.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.476+0000 7fb0b8907700 1 -- 172.21.15.49:0/1514910824 wait complete. 2023-07-21T22:11:36.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.476+0000 7fb0b8907700 1 Processor -- start 2023-07-21T22:11:36.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b8907700 1 -- start start 2023-07-21T22:11:36.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b8907700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0b40b7af0 0x7fb0b40c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b8907700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0b40cee10 0x7fb0b40c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b8907700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0b40d1e40 0x7fb0b415b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b8907700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40c6990 con 0x7fb0b40d1e40 2023-07-21T22:11:36.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b8907700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40ca930 con 0x7fb0b40cee10 2023-07-21T22:11:36.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b8907700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40c6060 con 0x7fb0b40b7af0 2023-07-21T22:11:36.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0b40d1e40 0x7fb0b415b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0b40d1e40 0x7fb0b415b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49528/0 (socket says 172.21.15.49:49528) 2023-07-21T22:11:36.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b3fff700 1 -- 172.21.15.49:0/3241965768 learned_addr learned my addr 172.21.15.49:0/3241965768 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:36.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b2ffd700 1 --2- 172.21.15.49:0/3241965768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0b40cee10 0x7fb0b40c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b37fe700 1 --2- 172.21.15.49:0/3241965768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0b40b7af0 0x7fb0b40c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b2ffd700 1 -- 172.21.15.49:0/3241965768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0b40b7af0 msgr2=0x7fb0b40c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b2ffd700 1 --2- 172.21.15.49:0/3241965768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0b40b7af0 0x7fb0b40c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b2ffd700 1 -- 172.21.15.49:0/3241965768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0b40d1e40 msgr2=0x7fb0b415b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b2ffd700 1 --2- 172.21.15.49:0/3241965768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0b40d1e40 0x7fb0b415b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b2ffd700 1 -- 172.21.15.49:0/3241965768 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80094b0 con 0x7fb0b40cee10 2023-07-21T22:11:36.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b2ffd700 1 --2- 172.21.15.49:0/3241965768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0b40cee10 0x7fb0b40c9e90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8015000 tx=0x7fb0a8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:36.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb09bfff700 1 -- 172.21.15.49:0/3241965768 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8003ce0 con 0x7fb0b40cee10 2023-07-21T22:11:36.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b8907700 1 -- 172.21.15.49:0/3241965768 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b40c6340 con 0x7fb0b40cee10 2023-07-21T22:11:36.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb09bfff700 1 -- 172.21.15.49:0/3241965768 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a801f070 con 0x7fb0b40cee10 2023-07-21T22:11:36.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb09bfff700 1 -- 172.21.15.49:0/3241965768 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8011870 con 0x7fb0b40cee10 2023-07-21T22:11:36.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.480+0000 7fb0b8907700 1 -- 172.21.15.49:0/3241965768 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b40c7360 con 0x7fb0b40cee10 2023-07-21T22:11:36.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.484+0000 7fb0b8907700 1 -- 172.21.15.49:0/3241965768 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b404dcb0 con 0x7fb0b40cee10 2023-07-21T22:11:36.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.484+0000 7fb09bfff700 1 -- 172.21.15.49:0/3241965768 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0a8021030 con 0x7fb0b40cee10 2023-07-21T22:11:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.488+0000 7fb09bfff700 1 --2- 172.21.15.49:0/3241965768 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb0a0066320 0x7fb0a00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.488+0000 7fb09bfff700 1 -- 172.21.15.49:0/3241965768 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb0a80852e0 con 0x7fb0b40cee10 2023-07-21T22:11:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.488+0000 7fb0b37fe700 1 --2- 172.21.15.49:0/3241965768 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb0a0066320 0x7fb0a00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.488+0000 7fb0b37fe700 1 --2- 172.21.15.49:0/3241965768 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb0a0066320 0x7fb0a00687d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4001710 tx=0x7fb0a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:36.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.492+0000 7fb09bfff700 1 -- 172.21.15.49:0/3241965768 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0a80523a0 con 0x7fb0b40cee10 2023-07-21T22:11:36.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.664+0000 7fb0b8907700 1 -- 172.21.15.49:0/3241965768 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0b40b1250 con 0x7fb0b40cee10 2023-07-21T22:11:36.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.668+0000 7fb09bfff700 1 -- 172.21.15.49:0/3241965768 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0a80559c0 con 0x7fb0b40cee10 2023-07-21T22:11:36.712 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:11:36.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.668+0000 7fb0b8907700 1 -- 172.21.15.49:0/3241965768 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb0a0066320 msgr2=0x7fb0a00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.668+0000 7fb0b8907700 1 --2- 172.21.15.49:0/3241965768 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb0a0066320 0x7fb0a00687d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4001710 tx=0x7fb0a4009040 comp rx=0 tx=0).stop 2023-07-21T22:11:36.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.668+0000 7fb0b8907700 1 -- 172.21.15.49:0/3241965768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0b40cee10 msgr2=0x7fb0b40c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.668+0000 7fb0b8907700 1 --2- 172.21.15.49:0/3241965768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0b40cee10 0x7fb0b40c9e90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8015000 tx=0x7fb0a8004770 comp rx=0 tx=0).stop 2023-07-21T22:11:36.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.672+0000 7fb0b8907700 1 -- 172.21.15.49:0/3241965768 shutdown_connections 2023-07-21T22:11:36.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.672+0000 7fb0b8907700 1 --2- 172.21.15.49:0/3241965768 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb0a0066320 0x7fb0a00687d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.672+0000 7fb0b8907700 1 --2- 172.21.15.49:0/3241965768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0b40d1e40 0x7fb0b415b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.672+0000 7fb0b8907700 1 --2- 172.21.15.49:0/3241965768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0b40cee10 0x7fb0b40c9e90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.672+0000 7fb0b8907700 1 --2- 172.21.15.49:0/3241965768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0b40b7af0 0x7fb0b40c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.672+0000 7fb0b8907700 1 -- 172.21.15.49:0/3241965768 >> 172.21.15.49:0/3241965768 conn(0x7fb0b406e960 msgr2=0x7fb0b40b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:36.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.672+0000 7fb0b8907700 1 -- 172.21.15.49:0/3241965768 shutdown_connections 2023-07-21T22:11:36.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.672+0000 7fb0b8907700 1 -- 172.21.15.49:0/3241965768 wait complete. 2023-07-21T22:11:36.737 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:11:36.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.872+0000 7f3fc75ae700 1 Processor -- start 2023-07-21T22:11:36.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.872+0000 7f3fc75ae700 1 -- start start 2023-07-21T22:11:36.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc75ae700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3fc0160110 0x7f3fc00cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc75ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc0071220 0x7f3fc00cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc75ae700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3fc0071670 0x7f3fc00cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc75ae700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc00cd730 con 0x7f3fc0071670 2023-07-21T22:11:36.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc75ae700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc00cdf00 con 0x7f3fc0160110 2023-07-21T22:11:36.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc75ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00ce600 con 0x7f3fc0071220 2023-07-21T22:11:36.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc5b4b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3fc0071670 0x7f3fc00cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc5b4b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3fc0071670 0x7f3fc00cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49542/0 (socket says 172.21.15.49:49542) 2023-07-21T22:11:36.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc5b4b700 1 -- 172.21.15.49:0/2462723702 learned_addr learned my addr 172.21.15.49:0/2462723702 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:36.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc534a700 1 --2- 172.21.15.49:0/2462723702 >> v2:172.21.15.150:3300/0 conn(0x7f3fc0160110 0x7f3fc00cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc4b49700 1 --2- 172.21.15.49:0/2462723702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc0071220 0x7f3fc00cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc5b4b700 1 -- 172.21.15.49:0/2462723702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc0071220 msgr2=0x7f3fc00cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:36.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc5b4b700 1 --2- 172.21.15.49:0/2462723702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc0071220 0x7f3fc00cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc5b4b700 1 -- 172.21.15.49:0/2462723702 >> v2:172.21.15.150:3300/0 conn(0x7f3fc0160110 msgr2=0x7f3fc00cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:36.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc5b4b700 1 --2- 172.21.15.49:0/2462723702 >> v2:172.21.15.150:3300/0 conn(0x7f3fc0160110 0x7f3fc00cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc5b4b700 1 -- 172.21.15.49:0/2462723702 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc00cefd0 con 0x7f3fc0071670 2023-07-21T22:11:36.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc4b49700 1 --2- 172.21.15.49:0/2462723702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc0071220 0x7f3fc00cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:36.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc5b4b700 1 --2- 172.21.15.49:0/2462723702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc0071670 0x7f3fc00cb120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00cabb0 tx=0x7f3fb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5aff5440f784bf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fb7fff700 1 -- 172.21.15.49:0/2462723702 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800e070 con 0x7f3fc0071670 2023-07-21T22:11:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fb7fff700 1 -- 172.21.15.49:0/2462723702 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb800b910 con 0x7f3fc0071670 2023-07-21T22:11:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fb7fff700 1 -- 172.21.15.49:0/2462723702 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800bcc0 con 0x7f3fc0071670 2023-07-21T22:11:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc75ae700 1 -- 172.21.15.49:0/2462723702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc0071670 msgr2=0x7f3fc00cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc75ae700 1 --2- 172.21.15.49:0/2462723702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc0071670 0x7f3fc00cb120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00cabb0 tx=0x7f3fb800b330 comp rx=0 tx=0).stop 2023-07-21T22:11:36.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc75ae700 1 -- 172.21.15.49:0/2462723702 shutdown_connections 2023-07-21T22:11:36.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc75ae700 1 --2- 172.21.15.49:0/2462723702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc0071220 0x7f3fc00cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc75ae700 1 --2- 172.21.15.49:0/2462723702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc0071670 0x7f3fc00cb120 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc75ae700 1 --2- 172.21.15.49:0/2462723702 >> v2:172.21.15.150:3300/0 conn(0x7f3fc0160110 0x7f3fc00cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.876+0000 7f3fc75ae700 1 -- 172.21.15.49:0/2462723702 >> 172.21.15.49:0/2462723702 conn(0x7f3fc006e960 msgr2=0x7f3fc006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:36.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.880+0000 7f3fc75ae700 1 -- 172.21.15.49:0/2462723702 shutdown_connections 2023-07-21T22:11:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.880+0000 7f3fc75ae700 1 -- 172.21.15.49:0/2462723702 wait complete. 2023-07-21T22:11:36.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.880+0000 7f3fc75ae700 1 Processor -- start 2023-07-21T22:11:36.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc75ae700 1 -- start start 2023-07-21T22:11:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc75ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc0071220 0x7f3fc014e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc75ae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc0071670 0x7f3fc015bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc75ae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc0160110 0x7f3fc00b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc75ae700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc014ec20 con 0x7f3fc0160110 2023-07-21T22:11:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc75ae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00c55f0 con 0x7f3fc0071670 2023-07-21T22:11:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc75ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00c58d0 con 0x7f3fc0071220 2023-07-21T22:11:36.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc5b4b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc0160110 0x7f3fc00b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc5b4b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc0160110 0x7f3fc00b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49552/0 (socket says 172.21.15.49:49552) 2023-07-21T22:11:36.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc5b4b700 1 -- 172.21.15.49:0/81212980 learned_addr learned my addr 172.21.15.49:0/81212980 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:36.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc534a700 1 --2- 172.21.15.49:0/81212980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc0071220 0x7f3fc014e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc4b49700 1 --2- 172.21.15.49:0/81212980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc0071670 0x7f3fc015bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc5b4b700 1 -- 172.21.15.49:0/81212980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc0071220 msgr2=0x7f3fc014e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc5b4b700 1 --2- 172.21.15.49:0/81212980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc0071220 0x7f3fc014e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc5b4b700 1 -- 172.21.15.49:0/81212980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc0071670 msgr2=0x7f3fc015bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:36.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc5b4b700 1 --2- 172.21.15.49:0/81212980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc0071670 0x7f3fc015bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:36.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.884+0000 7f3fc5b4b700 1 -- 172.21.15.49:0/81212980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb8009b30 con 0x7f3fc0160110 2023-07-21T22:11:36.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.888+0000 7f3fc5b4b700 1 --2- 172.21.15.49:0/81212980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc0160110 0x7f3fc00b32a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3fc006f940 tx=0x7f3fb8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:36.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.888+0000 7f3fb5ffb700 1 -- 172.21.15.49:0/81212980 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb80099b0 con 0x7f3fc0160110 2023-07-21T22:11:36.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.888+0000 7f3fb5ffb700 1 -- 172.21.15.49:0/81212980 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb8004250 con 0x7f3fc0160110 2023-07-21T22:11:36.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.888+0000 7f3fc75ae700 1 -- 172.21.15.49:0/81212980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc00c5bb0 con 0x7f3fc0160110 2023-07-21T22:11:36.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.888+0000 7f3fb5ffb700 1 -- 172.21.15.49:0/81212980 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8004600 con 0x7f3fc0160110 2023-07-21T22:11:36.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.888+0000 7f3fc75ae700 1 -- 172.21.15.49:0/81212980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc00c6170 con 0x7f3fc0160110 2023-07-21T22:11:36.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.888+0000 7f3fc75ae700 1 -- 172.21.15.49:0/81212980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc004dd50 con 0x7f3fc0160110 2023-07-21T22:11:36.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.892+0000 7f3fb5ffb700 1 -- 172.21.15.49:0/81212980 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3fb8004760 con 0x7f3fc0160110 2023-07-21T22:11:36.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.892+0000 7f3fb5ffb700 1 --2- 172.21.15.49:0/81212980 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fa40662f0 0x7f3fa40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:36.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.892+0000 7f3fb5ffb700 1 -- 172.21.15.49:0/81212980 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3fb8085310 con 0x7f3fc0160110 2023-07-21T22:11:36.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.892+0000 7f3fc534a700 1 --2- 172.21.15.49:0/81212980 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fa40662f0 0x7f3fa40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:36.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.892+0000 7f3fc534a700 1 --2- 172.21.15.49:0/81212980 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fa40662f0 0x7f3fa40687a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009a60 tx=0x7f3fbc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:36.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:36.900+0000 7f3fb5ffb700 1 -- 172.21.15.49:0/81212980 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3fb8052480 con 0x7f3fc0160110 2023-07-21T22:11:37.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.076+0000 7f3fc75ae700 1 -- 172.21.15.49:0/81212980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3fc0071000 con 0x7f3fc0160110 2023-07-21T22:11:37.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.076+0000 7f3fb5ffb700 1 -- 172.21.15.49:0/81212980 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3fb8055aa0 con 0x7f3fc0160110 2023-07-21T22:11:37.120 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:11:37.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.080+0000 7f3fc75ae700 1 -- 172.21.15.49:0/81212980 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fa40662f0 msgr2=0x7f3fa40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.080+0000 7f3fc75ae700 1 --2- 172.21.15.49:0/81212980 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fa40662f0 0x7f3fa40687a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009a60 tx=0x7f3fbc008040 comp rx=0 tx=0).stop 2023-07-21T22:11:37.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.080+0000 7f3fc75ae700 1 -- 172.21.15.49:0/81212980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc0160110 msgr2=0x7f3fc00b32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.080+0000 7f3fc75ae700 1 --2- 172.21.15.49:0/81212980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc0160110 0x7f3fc00b32a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3fc006f940 tx=0x7f3fb8004af0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.080+0000 7f3fc75ae700 1 -- 172.21.15.49:0/81212980 shutdown_connections 2023-07-21T22:11:37.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.080+0000 7f3fc75ae700 1 --2- 172.21.15.49:0/81212980 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fa40662f0 0x7f3fa40687a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.080+0000 7f3fc75ae700 1 --2- 172.21.15.49:0/81212980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc0160110 0x7f3fc00b32a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.080+0000 7f3fc75ae700 1 --2- 172.21.15.49:0/81212980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc0071670 0x7f3fc015bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.080+0000 7f3fc75ae700 1 --2- 172.21.15.49:0/81212980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc0071220 0x7f3fc014e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.080+0000 7f3fc75ae700 1 -- 172.21.15.49:0/81212980 >> 172.21.15.49:0/81212980 conn(0x7f3fc006e960 msgr2=0x7f3fc00c9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:37.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.080+0000 7f3fc75ae700 1 -- 172.21.15.49:0/81212980 shutdown_connections 2023-07-21T22:11:37.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.080+0000 7f3fc75ae700 1 -- 172.21.15.49:0/81212980 wait complete. 2023-07-21T22:11:37.144 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:11:37.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.288+0000 7f99b7c60700 1 Processor -- start 2023-07-21T22:11:37.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.288+0000 7f99b7c60700 1 -- start start 2023-07-21T22:11:37.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b7c60700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f99b0159e50 0x7f99b00ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:37.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b7c60700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f99b00ce550 0x7f99b015e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:37.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b7c60700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b008a5a0 con 0x7f99b00af410 2023-07-21T22:11:37.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b7c60700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b00ce9d0 con 0x7f99b00ce550 2023-07-21T22:11:37.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b7c60700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b00adfc0 con 0x7f99b0159e50 2023-07-21T22:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b61fd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f99b00ce550 0x7f99b015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b61fd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f99b00ce550 0x7f99b015e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49558/0 (socket says 172.21.15.49:49558) 2023-07-21T22:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b61fd700 1 -- 172.21.15.49:0/3454217425 learned_addr learned my addr 172.21.15.49:0/3454217425 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b59fc700 1 --2- 172.21.15.49:0/3454217425 >> v2:172.21.15.150:3300/0 conn(0x7f99b0159e50 0x7f99b00ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b61fd700 1 -- 172.21.15.49:0/3454217425 >> v2:172.21.15.150:3300/0 conn(0x7f99b0159e50 msgr2=0x7f99b00ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b61fd700 1 --2- 172.21.15.49:0/3454217425 >> v2:172.21.15.150:3300/0 conn(0x7f99b0159e50 0x7f99b00ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b61fd700 1 -- 172.21.15.49:0/3454217425 >> v1:172.21.15.150:6789/0 conn(0x7f99b00af410 legacy=0x7f99b015d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b61fd700 1 -- 172.21.15.49:0/3454217425 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b015a220 con 0x7f99b00ce550 2023-07-21T22:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b49fa700 1 -- 172.21.15.49:0/3454217425 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191309180 0 0) 0x7f99a0001160 con 0x7f99b00af410 2023-07-21T22:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b61fd700 1 --2- 172.21.15.49:0/3454217425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99b00ce550 0x7f99b015e040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f99b006d500 tx=0x7f99a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e119b537393639a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b49fa700 1 -- 172.21.15.49:0/3454217425 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a800e070 con 0x7f99b00ce550 2023-07-21T22:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b49fa700 1 -- 172.21.15.49:0/3454217425 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a800b910 con 0x7f99b00ce550 2023-07-21T22:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.292+0000 7f99b49fa700 1 -- 172.21.15.49:0/3454217425 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a800bcc0 con 0x7f99b00ce550 2023-07-21T22:11:37.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.296+0000 7f99b7c60700 1 -- 172.21.15.49:0/3454217425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99b00ce550 msgr2=0x7f99b015e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.296+0000 7f99b7c60700 1 --2- 172.21.15.49:0/3454217425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99b00ce550 0x7f99b015e040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f99b006d500 tx=0x7f99a800b330 comp rx=0 tx=0).stop 2023-07-21T22:11:37.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.296+0000 7f99b7c60700 1 -- 172.21.15.49:0/3454217425 shutdown_connections 2023-07-21T22:11:37.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.296+0000 7f99b7c60700 1 --2- 172.21.15.49:0/3454217425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99b00ce550 0x7f99b015e040 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.296+0000 7f99b7c60700 1 --2- 172.21.15.49:0/3454217425 >> v2:172.21.15.150:3300/0 conn(0x7f99b0159e50 0x7f99b00ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.296+0000 7f99b7c60700 1 -- 172.21.15.49:0/3454217425 >> 172.21.15.49:0/3454217425 conn(0x7f99b0089fe0 msgr2=0x7f99b00d0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:37.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.296+0000 7f99b7c60700 1 -- 172.21.15.49:0/3454217425 shutdown_connections 2023-07-21T22:11:37.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.296+0000 7f99b7c60700 1 -- 172.21.15.49:0/3454217425 wait complete. 2023-07-21T22:11:37.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.296+0000 7f99b7c60700 1 Processor -- start 2023-07-21T22:11:37.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.296+0000 7f99b7c60700 1 -- start start 2023-07-21T22:11:37.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b7c60700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99b00af410 0x7f99b01583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:37.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b7c60700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99b00ce550 0x7f99b00caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:37.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b7c60700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99b0159e50 0x7f99b00cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:37.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b7c60700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b0158910 con 0x7f99b0159e50 2023-07-21T22:11:37.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b7c60700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b00cb3c0 con 0x7f99b00ce550 2023-07-21T22:11:37.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b7c60700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b00cb6a0 con 0x7f99b00af410 2023-07-21T22:11:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b61fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99b0159e50 0x7f99b00cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:37.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b61fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99b0159e50 0x7f99b00cd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49564/0 (socket says 172.21.15.49:49564) 2023-07-21T22:11:37.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b61fd700 1 -- 172.21.15.49:0/79810117 learned_addr learned my addr 172.21.15.49:0/79810117 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:37.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b59fc700 1 --2- 172.21.15.49:0/79810117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99b00af410 0x7f99b01583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:37.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b51fb700 1 --2- 172.21.15.49:0/79810117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99b00ce550 0x7f99b00caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:37.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b61fd700 1 -- 172.21.15.49:0/79810117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99b00af410 msgr2=0x7f99b01583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b61fd700 1 --2- 172.21.15.49:0/79810117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99b00af410 0x7f99b01583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b61fd700 1 -- 172.21.15.49:0/79810117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99b00ce550 msgr2=0x7f99b00caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b61fd700 1 --2- 172.21.15.49:0/79810117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99b00ce550 0x7f99b00caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b61fd700 1 -- 172.21.15.49:0/79810117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a8009b30 con 0x7f99b0159e50 2023-07-21T22:11:37.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b61fd700 1 --2- 172.21.15.49:0/79810117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99b0159e50 0x7f99b00cd0a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f99b00b3030 tx=0x7f99a8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:37.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99a67fc700 1 -- 172.21.15.49:0/79810117 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8004970 con 0x7f99b0159e50 2023-07-21T22:11:37.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99a67fc700 1 -- 172.21.15.49:0/79810117 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a80092e0 con 0x7f99b0159e50 2023-07-21T22:11:37.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99a67fc700 1 -- 172.21.15.49:0/79810117 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a801c660 con 0x7f99b0159e50 2023-07-21T22:11:37.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b7c60700 1 -- 172.21.15.49:0/79810117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b00cb980 con 0x7f99b0159e50 2023-07-21T22:11:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.300+0000 7f99b7c60700 1 -- 172.21.15.49:0/79810117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b00cbf40 con 0x7f99b0159e50 2023-07-21T22:11:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.304+0000 7f99b7c60700 1 -- 172.21.15.49:0/79810117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b004dd50 con 0x7f99b0159e50 2023-07-21T22:11:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.304+0000 7f99a67fc700 1 -- 172.21.15.49:0/79810117 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99a801c7c0 con 0x7f99b0159e50 2023-07-21T22:11:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.308+0000 7f99a67fc700 1 --2- 172.21.15.49:0/79810117 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f99940662f0 0x7f99940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:37.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.308+0000 7f99a67fc700 1 -- 172.21.15.49:0/79810117 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f99a8085a60 con 0x7f99b0159e50 2023-07-21T22:11:37.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.308+0000 7f99b59fc700 1 --2- 172.21.15.49:0/79810117 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f99940662f0 0x7f99940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:37.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.308+0000 7f99b59fc700 1 --2- 172.21.15.49:0/79810117 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f99940662f0 0x7f99940687a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f99b00b2170 tx=0x7f99ac0091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:37.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.312+0000 7f99a67fc700 1 -- 172.21.15.49:0/79810117 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99a8052ba0 con 0x7f99b0159e50 2023-07-21T22:11:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.480+0000 7f99b7c60700 1 -- 172.21.15.49:0/79810117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99b006c9a0 con 0x7f99b0159e50 2023-07-21T22:11:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.484+0000 7f99a67fc700 1 -- 172.21.15.49:0/79810117 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f99a80561c0 con 0x7f99b0159e50 2023-07-21T22:11:37.527 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.484+0000 7f99b7c60700 1 -- 172.21.15.49:0/79810117 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f99940662f0 msgr2=0x7f99940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.484+0000 7f99b7c60700 1 --2- 172.21.15.49:0/79810117 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f99940662f0 0x7f99940687a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f99b00b2170 tx=0x7f99ac0091c0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.484+0000 7f99b7c60700 1 -- 172.21.15.49:0/79810117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99b0159e50 msgr2=0x7f99b00cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.484+0000 7f99b7c60700 1 --2- 172.21.15.49:0/79810117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99b0159e50 0x7f99b00cd0a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f99b00b3030 tx=0x7f99a8004af0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.484+0000 7f99b7c60700 1 -- 172.21.15.49:0/79810117 shutdown_connections 2023-07-21T22:11:37.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.484+0000 7f99b7c60700 1 --2- 172.21.15.49:0/79810117 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f99940662f0 0x7f99940687a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.484+0000 7f99b7c60700 1 --2- 172.21.15.49:0/79810117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99b0159e50 0x7f99b00cd0a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.484+0000 7f99b7c60700 1 --2- 172.21.15.49:0/79810117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99b00ce550 0x7f99b00caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.484+0000 7f99b7c60700 1 --2- 172.21.15.49:0/79810117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99b00af410 0x7f99b01583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.484+0000 7f99b7c60700 1 -- 172.21.15.49:0/79810117 >> 172.21.15.49:0/79810117 conn(0x7f99b0089fe0 msgr2=0x7f99b006b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:37.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.484+0000 7f99b7c60700 1 -- 172.21.15.49:0/79810117 shutdown_connections 2023-07-21T22:11:37.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.484+0000 7f99b7c60700 1 -- 172.21.15.49:0/79810117 wait complete. 2023-07-21T22:11:37.552 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:11:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.696+0000 7f86862f5700 1 Processor -- start 2023-07-21T22:11:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.696+0000 7f86862f5700 1 -- start start 2023-07-21T22:11:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.696+0000 7f86862f5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86800b4b20 0x7f86800cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.696+0000 7f86862f5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86800b8170 con 0x7f86800b4040 2023-07-21T22:11:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.696+0000 7f86862f5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86800d2350 con 0x7f86800d0810 2023-07-21T22:11:37.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.696+0000 7f86862f5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86800cfa20 con 0x7f86800b4b20 2023-07-21T22:11:37.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f867ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f86800b4040 0x7f86800b4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44330/0 (socket says 172.21.15.49:44330) 2023-07-21T22:11:37.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f867ffff700 1 -- 172.21.15.49:0/4287173010 learned_addr learned my addr 172.21.15.49:0/4287173010 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:37.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f867f7fe700 1 --2- 172.21.15.49:0/4287173010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86800b4b20 0x7f86800cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:37.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f867effd700 1 -- 172.21.15.49:0/4287173010 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031916254 0 0) 0x7f86800b8170 con 0x7f86800b4040 2023-07-21T22:11:37.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f867effd700 1 -- 172.21.15.49:0/4287173010 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86680035d0 con 0x7f86800b4040 2023-07-21T22:11:37.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f867f7fe700 1 -- 172.21.15.49:0/4287173010 >> v1:172.21.15.150:6789/0 conn(0x7f86800d0810 legacy=0x7f86800d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f867f7fe700 1 -- 172.21.15.49:0/4287173010 >> v1:172.21.15.49:6789/0 conn(0x7f86800b4040 legacy=0x7f86800b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f867effd700 1 -- 172.21.15.49:0/4287173010 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609971758 0 0) 0x7f86800d2350 con 0x7f86800d0810 2023-07-21T22:11:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f867f7fe700 1 -- 172.21.15.49:0/4287173010 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86800cd370 con 0x7f86800b4b20 2023-07-21T22:11:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f867f7fe700 1 --2- 172.21.15.49:0/4287173010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86800b4b20 0x7f86800cf320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8674009880 tx=0x7f8674009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f618b2a5c692648e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f867effd700 1 -- 172.21.15.49:0/4287173010 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674011830 con 0x7f86800b4b20 2023-07-21T22:11:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f867effd700 1 -- 172.21.15.49:0/4287173010 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674011990 con 0x7f86800b4b20 2023-07-21T22:11:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f867effd700 1 -- 172.21.15.49:0/4287173010 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674011d20 con 0x7f86800b4b20 2023-07-21T22:11:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f86862f5700 1 -- 172.21.15.49:0/4287173010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86800b4b20 msgr2=0x7f86800cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f86862f5700 1 --2- 172.21.15.49:0/4287173010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86800b4b20 0x7f86800cf320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8674009880 tx=0x7f8674009b90 comp rx=0 tx=0).stop 2023-07-21T22:11:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f86862f5700 1 -- 172.21.15.49:0/4287173010 shutdown_connections 2023-07-21T22:11:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f86862f5700 1 --2- 172.21.15.49:0/4287173010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86800b4b20 0x7f86800cf320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f86862f5700 1 -- 172.21.15.49:0/4287173010 >> 172.21.15.49:0/4287173010 conn(0x7f86800658e0 msgr2=0x7f868006fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:37.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f86862f5700 1 -- 172.21.15.49:0/4287173010 shutdown_connections 2023-07-21T22:11:37.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.700+0000 7f86862f5700 1 -- 172.21.15.49:0/4287173010 wait complete. 2023-07-21T22:11:37.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.704+0000 7f86862f5700 1 Processor -- start 2023-07-21T22:11:37.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.704+0000 7f86862f5700 1 -- start start 2023-07-21T22:11:37.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f86862f5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800b4040 0x7f868015ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:37.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f86862f5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86800b4b20 0x7f86800ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:37.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f86862f5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86800d0810 0x7f86800ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f86862f5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868015e270 con 0x7f86800b4040 2023-07-21T22:11:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f86862f5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8680142710 con 0x7f86800d0810 2023-07-21T22:11:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f86862f5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8680142430 con 0x7f86800b4b20 2023-07-21T22:11:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f867ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800b4040 0x7f868015ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f867ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800b4040 0x7f868015ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49572/0 (socket says 172.21.15.49:49572) 2023-07-21T22:11:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f867ffff700 1 -- 172.21.15.49:0/1035211309 learned_addr learned my addr 172.21.15.49:0/1035211309 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f8684892700 1 --2- 172.21.15.49:0/1035211309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86800d0810 0x7f86800ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f867f7fe700 1 --2- 172.21.15.49:0/1035211309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86800b4b20 0x7f86800ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:37.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f867ffff700 1 -- 172.21.15.49:0/1035211309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86800b4b20 msgr2=0x7f86800ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f867ffff700 1 --2- 172.21.15.49:0/1035211309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86800b4b20 0x7f86800ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f867ffff700 1 -- 172.21.15.49:0/1035211309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86800d0810 msgr2=0x7f86800ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f867ffff700 1 --2- 172.21.15.49:0/1035211309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86800d0810 0x7f86800ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f867ffff700 1 -- 172.21.15.49:0/1035211309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86740094b0 con 0x7f86800b4040 2023-07-21T22:11:37.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f867ffff700 1 --2- 172.21.15.49:0/1035211309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800b4040 0x7f868015ef60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f867000c520 tx=0x7f867000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f867cff9700 1 -- 172.21.15.49:0/1035211309 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670005d90 con 0x7f86800b4040 2023-07-21T22:11:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f867cff9700 1 -- 172.21.15.49:0/1035211309 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86700070d0 con 0x7f86800b4040 2023-07-21T22:11:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f867cff9700 1 -- 172.21.15.49:0/1035211309 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670007440 con 0x7f86800b4040 2023-07-21T22:11:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f86862f5700 1 -- 172.21.15.49:0/1035211309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868015e480 con 0x7f86800b4040 2023-07-21T22:11:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f86862f5700 1 -- 172.21.15.49:0/1035211309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868015ea40 con 0x7f86800b4040 2023-07-21T22:11:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.708+0000 7f86862f5700 1 -- 172.21.15.49:0/1035211309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868015ec30 con 0x7f86800b4040 2023-07-21T22:11:37.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.712+0000 7f867cff9700 1 -- 172.21.15.49:0/1035211309 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f86700075a0 con 0x7f86800b4040 2023-07-21T22:11:37.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.712+0000 7f867cff9700 1 --2- 172.21.15.49:0/1035211309 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f866c0662f0 0x7f866c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:37.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.712+0000 7f867cff9700 1 -- 172.21.15.49:0/1035211309 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8670083580 con 0x7f86800b4040 2023-07-21T22:11:37.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.712+0000 7f867f7fe700 1 --2- 172.21.15.49:0/1035211309 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f866c0662f0 0x7f866c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:37.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.716+0000 7f867f7fe700 1 --2- 172.21.15.49:0/1035211309 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f866c0662f0 0x7f866c0687a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f86740090b0 tx=0x7f867401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:37.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.720+0000 7f867cff9700 1 -- 172.21.15.49:0/1035211309 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8670050660 con 0x7f86800b4040 2023-07-21T22:11:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.896+0000 7f86862f5700 1 -- 172.21.15.49:0/1035211309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f86800cd060 con 0x7f86800b4040 2023-07-21T22:11:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.896+0000 7f867cff9700 1 -- 172.21.15.49:0/1035211309 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8670053c80 con 0x7f86800b4040 2023-07-21T22:11:37.942 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:11:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.900+0000 7f86862f5700 1 -- 172.21.15.49:0/1035211309 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f866c0662f0 msgr2=0x7f866c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.900+0000 7f86862f5700 1 --2- 172.21.15.49:0/1035211309 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f866c0662f0 0x7f866c0687a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f86740090b0 tx=0x7f867401c040 comp rx=0 tx=0).stop 2023-07-21T22:11:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.900+0000 7f86862f5700 1 -- 172.21.15.49:0/1035211309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800b4040 msgr2=0x7f868015ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.900+0000 7f86862f5700 1 --2- 172.21.15.49:0/1035211309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800b4040 0x7f868015ef60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f867000c520 tx=0x7f867000c8e0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.900+0000 7f86862f5700 1 -- 172.21.15.49:0/1035211309 shutdown_connections 2023-07-21T22:11:37.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.900+0000 7f86862f5700 1 --2- 172.21.15.49:0/1035211309 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f866c0662f0 0x7f866c0687a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.900+0000 7f86862f5700 1 --2- 172.21.15.49:0/1035211309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86800d0810 0x7f86800ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.900+0000 7f86862f5700 1 --2- 172.21.15.49:0/1035211309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86800b4b20 0x7f86800ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.900+0000 7f86862f5700 1 --2- 172.21.15.49:0/1035211309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800b4040 0x7f868015ef60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:37.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.900+0000 7f86862f5700 1 -- 172.21.15.49:0/1035211309 >> 172.21.15.49:0/1035211309 conn(0x7f86800658e0 msgr2=0x7f86800b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:37.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.900+0000 7f86862f5700 1 -- 172.21.15.49:0/1035211309 shutdown_connections 2023-07-21T22:11:37.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:37.900+0000 7f86862f5700 1 -- 172.21.15.49:0/1035211309 wait complete. 2023-07-21T22:11:37.966 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:11:38.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.104+0000 7fa763508700 1 Processor -- start 2023-07-21T22:11:38.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.104+0000 7fa763508700 1 -- start start 2023-07-21T22:11:38.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa763508700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa75c160110 0x7fa75c0cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:38.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa763508700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75c0cdf00 con 0x7fa75c0cb2f0 2023-07-21T22:11:38.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa763508700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75c0ce600 con 0x7fa75c071220 2023-07-21T22:11:38.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa763508700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75c0cd730 con 0x7fa75c160110 2023-07-21T22:11:38.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa761aa5700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa75c0cb2f0 0x7fa75c163d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44332/0 (socket says 172.21.15.49:44332) 2023-07-21T22:11:38.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa761aa5700 1 -- 172.21.15.49:0/3443583669 learned_addr learned my addr 172.21.15.49:0/3443583669 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:38.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa7612a4700 1 --2- 172.21.15.49:0/3443583669 >> v2:172.21.15.150:3300/0 conn(0x7fa75c160110 0x7fa75c0cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:38.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa753fff700 1 -- 172.21.15.49:0/3443583669 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781848493 0 0) 0x7fa75c0cdf00 con 0x7fa75c0cb2f0 2023-07-21T22:11:38.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa753fff700 1 -- 172.21.15.49:0/3443583669 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7480035d0 con 0x7fa75c0cb2f0 2023-07-21T22:11:38.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa7612a4700 1 -- 172.21.15.49:0/3443583669 >> v1:172.21.15.150:6789/0 conn(0x7fa75c071220 legacy=0x7fa75c0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:38.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa7612a4700 1 -- 172.21.15.49:0/3443583669 >> v1:172.21.15.49:6789/0 conn(0x7fa75c0cb2f0 legacy=0x7fa75c163d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:38.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa7612a4700 1 -- 172.21.15.49:0/3443583669 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c0cefd0 con 0x7fa75c160110 2023-07-21T22:11:38.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa7612a4700 1 --2- 172.21.15.49:0/3443583669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c160110 0x7fa75c0cea90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa758009850 tx=0x7fa758009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=456edc3e4cc0b1bd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:38.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa753fff700 1 -- 172.21.15.49:0/3443583669 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa758011830 con 0x7fa75c160110 2023-07-21T22:11:38.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa753fff700 1 -- 172.21.15.49:0/3443583669 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa758011990 con 0x7fa75c160110 2023-07-21T22:11:38.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.108+0000 7fa753fff700 1 -- 172.21.15.49:0/3443583669 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa758011d40 con 0x7fa75c160110 2023-07-21T22:11:38.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.112+0000 7fa763508700 1 -- 172.21.15.49:0/3443583669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c160110 msgr2=0x7fa75c0cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:38.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.112+0000 7fa763508700 1 --2- 172.21.15.49:0/3443583669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c160110 0x7fa75c0cea90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa758009850 tx=0x7fa758009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:38.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.112+0000 7fa763508700 1 -- 172.21.15.49:0/3443583669 shutdown_connections 2023-07-21T22:11:38.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.112+0000 7fa763508700 1 --2- 172.21.15.49:0/3443583669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c160110 0x7fa75c0cea90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:38.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.112+0000 7fa763508700 1 -- 172.21.15.49:0/3443583669 >> 172.21.15.49:0/3443583669 conn(0x7fa75c06e960 msgr2=0x7fa75c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:38.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.112+0000 7fa763508700 1 -- 172.21.15.49:0/3443583669 shutdown_connections 2023-07-21T22:11:38.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.112+0000 7fa763508700 1 -- 172.21.15.49:0/3443583669 wait complete. 2023-07-21T22:11:38.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.112+0000 7fa763508700 1 Processor -- start 2023-07-21T22:11:38.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.112+0000 7fa763508700 1 -- start start 2023-07-21T22:11:38.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa763508700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c071220 0x7fa75c1f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:38.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa763508700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c0cb2f0 0x7fa75c160ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:38.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa763508700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c160110 0x7fa75c1f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:38.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa763508700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0c62f0 con 0x7fa75c071220 2023-07-21T22:11:38.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa763508700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0c65d0 con 0x7fa75c0cb2f0 2023-07-21T22:11:38.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa763508700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0c68b0 con 0x7fa75c160110 2023-07-21T22:11:38.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa7612a4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c071220 0x7fa75c1f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:38.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa7612a4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c071220 0x7fa75c1f58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49588/0 (socket says 172.21.15.49:49588) 2023-07-21T22:11:38.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa7612a4700 1 -- 172.21.15.49:0/1498682390 learned_addr learned my addr 172.21.15.49:0/1498682390 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:38.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa761aa5700 1 --2- 172.21.15.49:0/1498682390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c160110 0x7fa75c1f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:38.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa760aa3700 1 --2- 172.21.15.49:0/1498682390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c0cb2f0 0x7fa75c160ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:38.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa7612a4700 1 -- 172.21.15.49:0/1498682390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c160110 msgr2=0x7fa75c1f8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:38.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa7612a4700 1 --2- 172.21.15.49:0/1498682390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c160110 0x7fa75c1f8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:38.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa7612a4700 1 -- 172.21.15.49:0/1498682390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c0cb2f0 msgr2=0x7fa75c160ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:38.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa7612a4700 1 --2- 172.21.15.49:0/1498682390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c0cb2f0 0x7fa75c160ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:38.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa7612a4700 1 -- 172.21.15.49:0/1498682390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7580094b0 con 0x7fa75c071220 2023-07-21T22:11:38.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa7612a4700 1 --2- 172.21.15.49:0/1498682390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c071220 0x7fa75c1f58a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa758000c00 tx=0x7fa758004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:38.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa751ffb700 1 -- 172.21.15.49:0/1498682390 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75801a990 con 0x7fa75c071220 2023-07-21T22:11:38.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa751ffb700 1 -- 172.21.15.49:0/1498682390 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75801f070 con 0x7fa75c071220 2023-07-21T22:11:38.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa763508700 1 -- 172.21.15.49:0/1498682390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75c0c6b90 con 0x7fa75c071220 2023-07-21T22:11:38.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa751ffb700 1 -- 172.21.15.49:0/1498682390 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75801ad30 con 0x7fa75c071220 2023-07-21T22:11:38.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.116+0000 7fa763508700 1 -- 172.21.15.49:0/1498682390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75c0c7150 con 0x7fa75c071220 2023-07-21T22:11:38.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.120+0000 7fa763508700 1 -- 172.21.15.49:0/1498682390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75c0c7340 con 0x7fa75c071220 2023-07-21T22:11:38.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.120+0000 7fa751ffb700 1 -- 172.21.15.49:0/1498682390 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa75801b430 con 0x7fa75c071220 2023-07-21T22:11:38.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.124+0000 7fa751ffb700 1 --2- 172.21.15.49:0/1498682390 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa7400662f0 0x7fa7400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:38.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.124+0000 7fa751ffb700 1 -- 172.21.15.49:0/1498682390 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa758085070 con 0x7fa75c071220 2023-07-21T22:11:38.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.124+0000 7fa760aa3700 1 --2- 172.21.15.49:0/1498682390 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa7400662f0 0x7fa7400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:38.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.124+0000 7fa760aa3700 1 --2- 172.21.15.49:0/1498682390 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa7400662f0 0x7fa7400687a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa75c071ac0 tx=0x7fa74c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:38.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.128+0000 7fa751ffb700 1 -- 172.21.15.49:0/1498682390 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7580521d0 con 0x7fa75c071220 2023-07-21T22:11:38.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.308+0000 7fa763508700 1 -- 172.21.15.49:0/1498682390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa75c04dd50 con 0x7fa75c071220 2023-07-21T22:11:38.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.308+0000 7fa751ffb700 1 -- 172.21.15.49:0/1498682390 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa758006ce0 con 0x7fa75c071220 2023-07-21T22:11:38.352 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:38.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.308+0000 7fa763508700 1 -- 172.21.15.49:0/1498682390 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa7400662f0 msgr2=0x7fa7400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:38.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.308+0000 7fa763508700 1 --2- 172.21.15.49:0/1498682390 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa7400662f0 0x7fa7400687a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa75c071ac0 tx=0x7fa74c009040 comp rx=0 tx=0).stop 2023-07-21T22:11:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.312+0000 7fa763508700 1 -- 172.21.15.49:0/1498682390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c071220 msgr2=0x7fa75c1f58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.312+0000 7fa763508700 1 --2- 172.21.15.49:0/1498682390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c071220 0x7fa75c1f58a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa758000c00 tx=0x7fa758004770 comp rx=0 tx=0).stop 2023-07-21T22:11:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.312+0000 7fa763508700 1 -- 172.21.15.49:0/1498682390 shutdown_connections 2023-07-21T22:11:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.312+0000 7fa763508700 1 --2- 172.21.15.49:0/1498682390 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa7400662f0 0x7fa7400687a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.312+0000 7fa763508700 1 --2- 172.21.15.49:0/1498682390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c160110 0x7fa75c1f8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.312+0000 7fa763508700 1 --2- 172.21.15.49:0/1498682390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c0cb2f0 0x7fa75c160ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.312+0000 7fa763508700 1 --2- 172.21.15.49:0/1498682390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c071220 0x7fa75c1f58a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.312+0000 7fa763508700 1 -- 172.21.15.49:0/1498682390 >> 172.21.15.49:0/1498682390 conn(0x7fa75c06e960 msgr2=0x7fa75c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.312+0000 7fa763508700 1 -- 172.21.15.49:0/1498682390 shutdown_connections 2023-07-21T22:11:38.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.312+0000 7fa763508700 1 -- 172.21.15.49:0/1498682390 wait complete. 2023-07-21T22:11:38.382 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-07-21T22:11:38.383 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-07-21T22:11:38.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.520+0000 7fcb4f354700 1 Processor -- start 2023-07-21T22:11:38.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.520+0000 7fcb4f354700 1 -- start start 2023-07-21T22:11:38.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.520+0000 7fcb4f354700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb480afc20 0x7fcb480cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:38.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.520+0000 7fcb4f354700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb481604c0 0x7fcb480afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:38.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.520+0000 7fcb4f354700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb480cdeb0 con 0x7fcb480c8860 2023-07-21T22:11:38.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.520+0000 7fcb4f354700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb48071610 con 0x7fcb481604c0 2023-07-21T22:11:38.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4f354700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480b0530 con 0x7fcb480afc20 2023-07-21T22:11:38.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4c8ef700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb481604c0 0x7fcb480afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:38.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4d8f1700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcb480c8860 0x7fcb480cc0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44342/0 (socket says 172.21.15.49:44342) 2023-07-21T22:11:38.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4d8f1700 1 -- 172.21.15.49:0/2787304113 learned_addr learned my addr 172.21.15.49:0/2787304113 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:38.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4d0f0700 1 --2- 172.21.15.49:0/2787304113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb480afc20 0x7fcb480cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:38.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb3ffff700 1 -- 172.21.15.49:0/2787304113 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439422679 0 0) 0x7fcb480cdeb0 con 0x7fcb480c8860 2023-07-21T22:11:38.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb3ffff700 1 -- 172.21.15.49:0/2787304113 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb340035d0 con 0x7fcb480c8860 2023-07-21T22:11:38.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4c8ef700 1 -- 172.21.15.49:0/2787304113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb480afc20 msgr2=0x7fcb480cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:38.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4c8ef700 1 --2- 172.21.15.49:0/2787304113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb480afc20 0x7fcb480cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:38.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4c8ef700 1 -- 172.21.15.49:0/2787304113 >> v1:172.21.15.49:6789/0 conn(0x7fcb480c8860 legacy=0x7fcb480cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:38.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4c8ef700 1 -- 172.21.15.49:0/2787304113 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb48163df0 con 0x7fcb481604c0 2023-07-21T22:11:38.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4c8ef700 1 --2- 172.21.15.49:0/2787304113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb481604c0 0x7fcb480afff0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009850 tx=0x7fcb38009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c27ce13c20da33 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:38.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb3ffff700 1 -- 172.21.15.49:0/2787304113 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb38011830 con 0x7fcb481604c0 2023-07-21T22:11:38.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb3ffff700 1 -- 172.21.15.49:0/2787304113 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb38011990 con 0x7fcb481604c0 2023-07-21T22:11:38.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb3ffff700 1 -- 172.21.15.49:0/2787304113 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb38011d40 con 0x7fcb481604c0 2023-07-21T22:11:38.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4f354700 1 -- 172.21.15.49:0/2787304113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb481604c0 msgr2=0x7fcb480afff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:38.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4f354700 1 --2- 172.21.15.49:0/2787304113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb481604c0 0x7fcb480afff0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009850 tx=0x7fcb38009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:38.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4f354700 1 -- 172.21.15.49:0/2787304113 shutdown_connections 2023-07-21T22:11:38.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4f354700 1 --2- 172.21.15.49:0/2787304113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb481604c0 0x7fcb480afff0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:38.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4f354700 1 --2- 172.21.15.49:0/2787304113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb480afc20 0x7fcb480cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:38.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4f354700 1 -- 172.21.15.49:0/2787304113 >> 172.21.15.49:0/2787304113 conn(0x7fcb4806f5a0 msgr2=0x7fcb480cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:38.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4f354700 1 -- 172.21.15.49:0/2787304113 shutdown_connections 2023-07-21T22:11:38.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.524+0000 7fcb4f354700 1 -- 172.21.15.49:0/2787304113 wait complete. 2023-07-21T22:11:38.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.528+0000 7fcb4f354700 1 Processor -- start 2023-07-21T22:11:38.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.528+0000 7fcb4f354700 1 -- start start 2023-07-21T22:11:38.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.528+0000 7fcb4f354700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb480afc20 0x7fcb4815ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:38.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.528+0000 7fcb4f354700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb480c8860 0x7fcb480ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:38.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.528+0000 7fcb4f354700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb481604c0 0x7fcb480ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:38.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.528+0000 7fcb4f354700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4815b060 con 0x7fcb481604c0 2023-07-21T22:11:38.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.528+0000 7fcb4f354700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480b3da0 con 0x7fcb480afc20 2023-07-21T22:11:38.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.528+0000 7fcb4f354700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48162db0 con 0x7fcb480c8860 2023-07-21T22:11:38.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.528+0000 7fcb4d8f1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb481604c0 0x7fcb480ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:38.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.528+0000 7fcb4d8f1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb481604c0 0x7fcb480ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49616/0 (socket says 172.21.15.49:49616) 2023-07-21T22:11:38.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.528+0000 7fcb4d8f1700 1 -- 172.21.15.49:0/2870079726 learned_addr learned my addr 172.21.15.49:0/2870079726 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:38.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.528+0000 7fcb4c8ef700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb480c8860 0x7fcb480ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:38.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.528+0000 7fcb4d0f0700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb480afc20 0x7fcb4815ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:38.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.532+0000 7fcb4d8f1700 1 -- 172.21.15.49:0/2870079726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb480c8860 msgr2=0x7fcb480ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:38.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.532+0000 7fcb4d8f1700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb480c8860 0x7fcb480ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:38.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.532+0000 7fcb4d8f1700 1 -- 172.21.15.49:0/2870079726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb480afc20 msgr2=0x7fcb4815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:38.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.532+0000 7fcb4d8f1700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb480afc20 0x7fcb4815ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:38.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.532+0000 7fcb4d8f1700 1 -- 172.21.15.49:0/2870079726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb380094b0 con 0x7fcb481604c0 2023-07-21T22:11:38.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.532+0000 7fcb4d0f0700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb480afc20 0x7fcb4815ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:38.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.532+0000 7fcb4d8f1700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb481604c0 0x7fcb480ae8b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000cb40 tx=0x7fcb4000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:38.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.532+0000 7fcb3dffb700 1 -- 172.21.15.49:0/2870079726 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000a9e0 con 0x7fcb481604c0 2023-07-21T22:11:38.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.532+0000 7fcb3dffb700 1 -- 172.21.15.49:0/2870079726 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4000ab40 con 0x7fcb481604c0 2023-07-21T22:11:38.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.532+0000 7fcb3dffb700 1 -- 172.21.15.49:0/2870079726 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000ce60 con 0x7fcb481604c0 2023-07-21T22:11:38.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.532+0000 7fcb4f354700 1 -- 172.21.15.49:0/2870079726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb48163090 con 0x7fcb481604c0 2023-07-21T22:11:38.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.532+0000 7fcb4f354700 1 -- 172.21.15.49:0/2870079726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb481608b0 con 0x7fcb481604c0 2023-07-21T22:11:38.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.532+0000 7fcb4f354700 1 -- 172.21.15.49:0/2870079726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4804dcb0 con 0x7fcb481604c0 2023-07-21T22:11:38.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.536+0000 7fcb3dffb700 1 -- 172.21.15.49:0/2870079726 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcb4001b3b0 con 0x7fcb481604c0 2023-07-21T22:11:38.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.536+0000 7fcb3dffb700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb2c0662f0 0x7fcb2c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:38.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.536+0000 7fcb3dffb700 1 -- 172.21.15.49:0/2870079726 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcb40083b30 con 0x7fcb481604c0 2023-07-21T22:11:38.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.536+0000 7fcb4d0f0700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb2c0662f0 0x7fcb2c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:38.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.540+0000 7fcb4d0f0700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb2c0662f0 0x7fcb2c0687a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009b70 tx=0x7fcb44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:38.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.540+0000 7fcb3dffb700 1 -- 172.21.15.49:0/2870079726 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb40050c70 con 0x7fcb481604c0 2023-07-21T22:11:38.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:38.772+0000 7fcb4f354700 1 -- 172.21.15.49:0/2870079726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7fcb48163b10 con 0x7fcb481604c0 2023-07-21T22:11:39.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.256+0000 7fcb3dffb700 1 -- 172.21.15.49:0/2870079726 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v82) v1 ==== 150+0+0 (secure 0 0 0) 0x7fcb40054290 con 0x7fcb481604c0 2023-07-21T22:11:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.260+0000 7fcb4f354700 1 -- 172.21.15.49:0/2870079726 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb2c0662f0 msgr2=0x7fcb2c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:39.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.260+0000 7fcb4f354700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb2c0662f0 0x7fcb2c0687a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009b70 tx=0x7fcb44008040 comp rx=0 tx=0).stop 2023-07-21T22:11:39.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.260+0000 7fcb4f354700 1 -- 172.21.15.49:0/2870079726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb481604c0 msgr2=0x7fcb480ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:39.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.260+0000 7fcb4f354700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb481604c0 0x7fcb480ae8b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000cb40 tx=0x7fcb4000cc20 comp rx=0 tx=0).stop 2023-07-21T22:11:39.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.260+0000 7fcb4f354700 1 -- 172.21.15.49:0/2870079726 shutdown_connections 2023-07-21T22:11:39.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.260+0000 7fcb4f354700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb2c0662f0 0x7fcb2c0687a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:39.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.260+0000 7fcb4f354700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb481604c0 0x7fcb480ae8b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:39.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.260+0000 7fcb4f354700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb480c8860 0x7fcb480ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:39.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.260+0000 7fcb4f354700 1 --2- 172.21.15.49:0/2870079726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb480afc20 0x7fcb4815ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:39.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.260+0000 7fcb4f354700 1 -- 172.21.15.49:0/2870079726 >> 172.21.15.49:0/2870079726 conn(0x7fcb4806f5a0 msgr2=0x7fcb480c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:39.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.260+0000 7fcb4f354700 1 -- 172.21.15.49:0/2870079726 shutdown_connections 2023-07-21T22:11:39.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.260+0000 7fcb4f354700 1 -- 172.21.15.49:0/2870079726 wait complete. 2023-07-21T22:11:39.331 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T22:11:39.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.476+0000 7fcd5e9e6700 1 Processor -- start 2023-07-21T22:11:39.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.476+0000 7fcd5e9e6700 1 -- start start 2023-07-21T22:11:39.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd5e9e6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcd581564c0 0x7fcd580cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:39.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd5e9e6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5815d3e0 con 0x7fcd5815cfa0 2023-07-21T22:11:39.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd5e9e6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd580c8bd0 con 0x7fcd580c9990 2023-07-21T22:11:39.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd5e9e6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd580c9570 con 0x7fcd581564c0 2023-07-21T22:11:39.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd5cf83700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcd5815cfa0 0x7fcd5806d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44354/0 (socket says 172.21.15.49:44354) 2023-07-21T22:11:39.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd5cf83700 1 -- 172.21.15.49:0/4049317048 learned_addr learned my addr 172.21.15.49:0/4049317048 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:39.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd57fff700 1 --2- 172.21.15.49:0/4049317048 >> v2:172.21.15.150:3300/0 conn(0x7fcd581564c0 0x7fcd580cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:39.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd56ffd700 1 -- 172.21.15.49:0/4049317048 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389325901 0 0) 0x7fcd5815d3e0 con 0x7fcd5815cfa0 2023-07-21T22:11:39.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd56ffd700 1 -- 172.21.15.49:0/4049317048 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd400057e0 con 0x7fcd5815cfa0 2023-07-21T22:11:39.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd57fff700 1 -- 172.21.15.49:0/4049317048 >> v1:172.21.15.150:6789/0 conn(0x7fcd580c9990 legacy=0x7fcd5815c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:39.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd57fff700 1 -- 172.21.15.49:0/4049317048 >> v1:172.21.15.49:6789/0 conn(0x7fcd5815cfa0 legacy=0x7fcd5806d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:39.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd57fff700 1 -- 172.21.15.49:0/4049317048 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd580c8eb0 con 0x7fcd581564c0 2023-07-21T22:11:39.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd57fff700 1 --2- 172.21.15.49:0/4049317048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd581564c0 0x7fcd580cdf40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009850 tx=0x7fcd48009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42efbb90064832e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd56ffd700 1 -- 172.21.15.49:0/4049317048 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48011830 con 0x7fcd581564c0 2023-07-21T22:11:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd56ffd700 1 -- 172.21.15.49:0/4049317048 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd48011990 con 0x7fcd581564c0 2023-07-21T22:11:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.480+0000 7fcd56ffd700 1 -- 172.21.15.49:0/4049317048 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48011d40 con 0x7fcd581564c0 2023-07-21T22:11:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.484+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/4049317048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd581564c0 msgr2=0x7fcd580cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.484+0000 7fcd5e9e6700 1 --2- 172.21.15.49:0/4049317048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd581564c0 0x7fcd580cdf40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009850 tx=0x7fcd48009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.484+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/4049317048 shutdown_connections 2023-07-21T22:11:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.484+0000 7fcd5e9e6700 1 --2- 172.21.15.49:0/4049317048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd581564c0 0x7fcd580cdf40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.484+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/4049317048 >> 172.21.15.49:0/4049317048 conn(0x7fcd5806e960 msgr2=0x7fcd5806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.484+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/4049317048 shutdown_connections 2023-07-21T22:11:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.484+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/4049317048 wait complete. 2023-07-21T22:11:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.484+0000 7fcd5e9e6700 1 Processor -- start 2023-07-21T22:11:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.484+0000 7fcd5e9e6700 1 -- start start 2023-07-21T22:11:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd5e9e6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580c9990 0x7fcd581f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd5e9e6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd581564c0 0x7fcd581ecb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd5e9e6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd5815cfa0 0x7fcd580ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd5e9e6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5815ab00 con 0x7fcd580c9990 2023-07-21T22:11:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd5e9e6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd580b1500 con 0x7fcd5815cfa0 2023-07-21T22:11:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd5e9e6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5815b310 con 0x7fcd581564c0 2023-07-21T22:11:39.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd57fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580c9990 0x7fcd581f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:39.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd57fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580c9990 0x7fcd581f1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49628/0 (socket says 172.21.15.49:49628) 2023-07-21T22:11:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd57fff700 1 -- 172.21.15.49:0/2984574916 learned_addr learned my addr 172.21.15.49:0/2984574916 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd577fe700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd581564c0 0x7fcd581ecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd5cf83700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd5815cfa0 0x7fcd580ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd57fff700 1 -- 172.21.15.49:0/2984574916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd581564c0 msgr2=0x7fcd581ecb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd57fff700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd581564c0 0x7fcd581ecb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd57fff700 1 -- 172.21.15.49:0/2984574916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd5815cfa0 msgr2=0x7fcd580ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:39.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd57fff700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd5815cfa0 0x7fcd580ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:39.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd57fff700 1 -- 172.21.15.49:0/2984574916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd480094b0 con 0x7fcd580c9990 2023-07-21T22:11:39.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd5cf83700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd5815cfa0 0x7fcd580ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:39.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd57fff700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580c9990 0x7fcd581f1240 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcd480090b0 tx=0x7fcd48004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:39.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd54ff9700 1 -- 172.21.15.49:0/2984574916 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4801aac0 con 0x7fcd580c9990 2023-07-21T22:11:39.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd54ff9700 1 -- 172.21.15.49:0/2984574916 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4801f070 con 0x7fcd580c9990 2023-07-21T22:11:39.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd54ff9700 1 -- 172.21.15.49:0/2984574916 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4801ae60 con 0x7fcd580c9990 2023-07-21T22:11:39.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/2984574916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5815ad50 con 0x7fcd580c9990 2023-07-21T22:11:39.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.488+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/2984574916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd58156d40 con 0x7fcd580c9990 2023-07-21T22:11:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.492+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/2984574916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd58156f60 con 0x7fcd580c9990 2023-07-21T22:11:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.492+0000 7fcd54ff9700 1 -- 172.21.15.49:0/2984574916 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcd4801b430 con 0x7fcd580c9990 2023-07-21T22:11:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.492+0000 7fcd54ff9700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd440662f0 0x7fcd440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:39.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.496+0000 7fcd54ff9700 1 -- 172.21.15.49:0/2984574916 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcd48085230 con 0x7fcd580c9990 2023-07-21T22:11:39.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.496+0000 7fcd577fe700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd440662f0 0x7fcd440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:39.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.496+0000 7fcd577fe700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd440662f0 0x7fcd440687a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd580c89b0 tx=0x7fcd4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.500+0000 7fcd54ff9700 1 -- 172.21.15.49:0/2984574916 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd480522f0 con 0x7fcd580c9990 2023-07-21T22:11:39.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.684+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/2984574916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcd5804dd50 con 0x7fcd580c9990 2023-07-21T22:11:39.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.692+0000 7fcd54ff9700 1 -- 172.21.15.49:0/2984574916 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcd48055910 con 0x7fcd580c9990 2023-07-21T22:11:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.696+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/2984574916 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd440662f0 msgr2=0x7fcd440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.696+0000 7fcd5e9e6700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd440662f0 0x7fcd440687a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd580c89b0 tx=0x7fcd4c009040 comp rx=0 tx=0).stop 2023-07-21T22:11:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.696+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/2984574916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580c9990 msgr2=0x7fcd581f1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.696+0000 7fcd5e9e6700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580c9990 0x7fcd581f1240 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcd480090b0 tx=0x7fcd48004770 comp rx=0 tx=0).stop 2023-07-21T22:11:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.696+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/2984574916 shutdown_connections 2023-07-21T22:11:39.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.696+0000 7fcd5e9e6700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd440662f0 0x7fcd440687a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:39.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.696+0000 7fcd5e9e6700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd5815cfa0 0x7fcd580ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:39.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.696+0000 7fcd5e9e6700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd581564c0 0x7fcd581ecb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:39.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.696+0000 7fcd5e9e6700 1 --2- 172.21.15.49:0/2984574916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580c9990 0x7fcd581f1240 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:39.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.696+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/2984574916 >> 172.21.15.49:0/2984574916 conn(0x7fcd5806e960 msgr2=0x7fcd580cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:39.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.696+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/2984574916 shutdown_connections 2023-07-21T22:11:39.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:39.696+0000 7fcd5e9e6700 1 -- 172.21.15.49:0/2984574916 wait complete. 2023-07-21T22:11:39.764 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:11:39.765 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:11:39.807 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:11:39.848 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:11:39.849 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:11:39.849 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:11:39.871 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:11:39.871 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:11:39.937 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:40.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.124+0000 7f6d24e20700 1 Processor -- start 2023-07-21T22:11:40.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.124+0000 7f6d24e20700 1 -- start start 2023-07-21T22:11:40.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d24e20700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6d20071c70 0x7f6d200b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:40.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d24e20700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d200cab20 con 0x7f6d2006d380 2023-07-21T22:11:40.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d24e20700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d200ca1f0 con 0x7f6d200b1400 2023-07-21T22:11:40.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d24e20700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d200c9e80 con 0x7f6d20071c70 2023-07-21T22:11:40.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d1f7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6d2006d380 0x7f6d2006d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44356/0 (socket says 172.21.15.49:44356) 2023-07-21T22:11:40.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d1f7fe700 1 -- 172.21.15.49:0/2151400664 learned_addr learned my addr 172.21.15.49:0/2151400664 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:40.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d16ffd700 1 --2- 172.21.15.49:0/2151400664 >> v2:172.21.15.150:3300/0 conn(0x7f6d20071c70 0x7f6d200b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:40.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264232432 0 0) 0x7f6d200cab20 con 0x7f6d2006d380 2023-07-21T22:11:40.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d0c0035d0 con 0x7f6d2006d380 2023-07-21T22:11:40.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722311668 0 0) 0x7f6d200ca1f0 con 0x7f6d200b1400 2023-07-21T22:11:40.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d200cab20 con 0x7f6d200b1400 2023-07-21T22:11:40.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1828364133 0 0) 0x7f6d0c0035d0 con 0x7f6d2006d380 2023-07-21T22:11:40.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 >> v2:172.21.15.150:3300/0 conn(0x7f6d20071c70 msgr2=0x7f6d200b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:40.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d1effd700 1 --2- 172.21.15.49:0/2151400664 >> v2:172.21.15.150:3300/0 conn(0x7f6d20071c70 0x7f6d200b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 >> v1:172.21.15.150:6789/0 conn(0x7f6d200b1400 legacy=0x7f6d200cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:40.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d200ca4d0 con 0x7f6d2006d380 2023-07-21T22:11:40.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f6d100019f0 con 0x7f6d2006d380 2023-07-21T22:11:40.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.128+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 >> v1:172.21.15.49:6789/0 conn(0x7f6d2006d380 legacy=0x7f6d2006d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:40.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d1effd700 1 --2- 172.21.15.49:0/2151400664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d0c003bb0 0x7f6d0c003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:40.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d1effd700 1 --2- 172.21.15.49:0/2151400664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d0c004870 0x7f6d0c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:40.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d1effd700 1 --2- 172.21.15.49:0/2151400664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d0c005220 0x7f6d0c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:40.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c00c050 con 0x7f6d0c004870 2023-07-21T22:11:40.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c00c1c0 con 0x7f6d0c003bb0 2023-07-21T22:11:40.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c00c380 con 0x7f6d0c005220 2023-07-21T22:11:40.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d16ffd700 1 --2- 172.21.15.49:0/2151400664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d0c004870 0x7f6d0c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:40.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d1f7fe700 1 --2- 172.21.15.49:0/2151400664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d0c003bb0 0x7f6d0c003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:40.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d1ffff700 1 --2- 172.21.15.49:0/2151400664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d0c005220 0x7f6d0c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:40.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d16ffd700 1 -- 172.21.15.49:0/2151400664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d0c005220 msgr2=0x7f6d0c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:40.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d16ffd700 1 --2- 172.21.15.49:0/2151400664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d0c005220 0x7f6d0c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d16ffd700 1 -- 172.21.15.49:0/2151400664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d0c003bb0 msgr2=0x7f6d0c003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:40.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d16ffd700 1 --2- 172.21.15.49:0/2151400664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d0c003bb0 0x7f6d0c003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d16ffd700 1 -- 172.21.15.49:0/2151400664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c0035d0 con 0x7f6d0c004870 2023-07-21T22:11:40.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d1ffff700 1 -- 172.21.15.49:0/2151400664 reap_dead start 2023-07-21T22:11:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d16ffd700 1 --2- 172.21.15.49:0/2151400664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d0c004870 0x7f6d0c004ce0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009b70 tx=0x7f6d0c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359821b5573a593d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0800e6c0 con 0x7f6d0c004870 2023-07-21T22:11:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0800e820 con 0x7f6d0c004870 2023-07-21T22:11:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d1effd700 1 -- 172.21.15.49:0/2151400664 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0800eb90 con 0x7f6d0c004870 2023-07-21T22:11:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d24e20700 1 -- 172.21.15.49:0/2151400664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d0c004870 msgr2=0x7f6d0c004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d24e20700 1 --2- 172.21.15.49:0/2151400664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d0c004870 0x7f6d0c004ce0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009b70 tx=0x7f6d0c0058a0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d24e20700 1 -- 172.21.15.49:0/2151400664 shutdown_connections 2023-07-21T22:11:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d24e20700 1 --2- 172.21.15.49:0/2151400664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d0c004870 0x7f6d0c004ce0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d24e20700 1 -- 172.21.15.49:0/2151400664 >> 172.21.15.49:0/2151400664 conn(0x7f6d20070450 msgr2=0x7f6d20070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d24e20700 1 -- 172.21.15.49:0/2151400664 shutdown_connections 2023-07-21T22:11:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.132+0000 7f6d24e20700 1 -- 172.21.15.49:0/2151400664 wait complete. 2023-07-21T22:11:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.136+0000 7f6d24e20700 1 Processor -- start 2023-07-21T22:11:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.136+0000 7f6d24e20700 1 -- start start 2023-07-21T22:11:40.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d24e20700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d0c004870 0x7f6d20148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:40.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d24e20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d200cbc40 0x7f6d20159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:40.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d24e20700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d200cc0b0 0x7f6d2015a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:40.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d24e20700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200c32e0 con 0x7f6d200cbc40 2023-07-21T22:11:40.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d24e20700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200c3b40 con 0x7f6d200cc0b0 2023-07-21T22:11:40.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d24e20700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d201f22b0 con 0x7f6d0c004870 2023-07-21T22:11:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d16ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d200cbc40 0x7f6d20159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d16ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d200cbc40 0x7f6d20159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49642/0 (socket says 172.21.15.49:49642) 2023-07-21T22:11:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d16ffd700 1 -- 172.21.15.49:0/770294851 learned_addr learned my addr 172.21.15.49:0/770294851 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d1f7fe700 1 --2- 172.21.15.49:0/770294851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d0c004870 0x7f6d20148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d1ffff700 1 --2- 172.21.15.49:0/770294851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d200cc0b0 0x7f6d2015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d16ffd700 1 -- 172.21.15.49:0/770294851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d0c004870 msgr2=0x7f6d20148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d16ffd700 1 --2- 172.21.15.49:0/770294851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d0c004870 0x7f6d20148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d16ffd700 1 -- 172.21.15.49:0/770294851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d200cc0b0 msgr2=0x7f6d2015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d16ffd700 1 --2- 172.21.15.49:0/770294851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d200cc0b0 0x7f6d2015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d16ffd700 1 -- 172.21.15.49:0/770294851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d200c34f0 con 0x7f6d200cbc40 2023-07-21T22:11:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d16ffd700 1 --2- 172.21.15.49:0/770294851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d200cbc40 0x7f6d20159ec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800e4b0 tx=0x7f6d080047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d1cff9700 1 -- 172.21.15.49:0/770294851 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0800e6c0 con 0x7f6d200cbc40 2023-07-21T22:11:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d1cff9700 1 -- 172.21.15.49:0/770294851 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d080038e0 con 0x7f6d200cbc40 2023-07-21T22:11:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d24e20700 1 -- 172.21.15.49:0/770294851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d200c37d0 con 0x7f6d200cbc40 2023-07-21T22:11:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d1cff9700 1 -- 172.21.15.49:0/770294851 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d08003c90 con 0x7f6d200cbc40 2023-07-21T22:11:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.140+0000 7f6d24e20700 1 -- 172.21.15.49:0/770294851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d200c3fd0 con 0x7f6d200cbc40 2023-07-21T22:11:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.144+0000 7f6d24e20700 1 -- 172.21.15.49:0/770294851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2004dcb0 con 0x7f6d200cbc40 2023-07-21T22:11:40.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.144+0000 7f6d1cff9700 1 -- 172.21.15.49:0/770294851 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6d08013470 con 0x7f6d200cbc40 2023-07-21T22:11:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.144+0000 7f6d1cff9700 1 --2- 172.21.15.49:0/770294851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6d000662f0 0x7f6d000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.144+0000 7f6d1cff9700 1 -- 172.21.15.49:0/770294851 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6d080853f0 con 0x7f6d200cbc40 2023-07-21T22:11:40.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.148+0000 7f6d1f7fe700 1 --2- 172.21.15.49:0/770294851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6d000662f0 0x7f6d000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:40.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.148+0000 7f6d1f7fe700 1 --2- 172.21.15.49:0/770294851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6d000662f0 0x7f6d000687a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d10002230 tx=0x7f6d10006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:40.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.152+0000 7f6d1cff9700 1 -- 172.21.15.49:0/770294851 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6d08052530 con 0x7f6d200cbc40 2023-07-21T22:11:40.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.328+0000 7f6d24e20700 1 -- 172.21.15.49:0/770294851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d200c3c80 con 0x7f6d200cbc40 2023-07-21T22:11:40.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.332+0000 7f6d1cff9700 1 -- 172.21.15.49:0/770294851 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7f6d08055b50 con 0x7f6d200cbc40 2023-07-21T22:11:40.375 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:40.376 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:40.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.332+0000 7f6d24e20700 1 -- 172.21.15.49:0/770294851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6d000662f0 msgr2=0x7f6d000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:40.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.332+0000 7f6d24e20700 1 --2- 172.21.15.49:0/770294851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6d000662f0 0x7f6d000687a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d10002230 tx=0x7f6d10006040 comp rx=0 tx=0).stop 2023-07-21T22:11:40.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.332+0000 7f6d24e20700 1 -- 172.21.15.49:0/770294851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d200cbc40 msgr2=0x7f6d20159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:40.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.332+0000 7f6d24e20700 1 --2- 172.21.15.49:0/770294851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d200cbc40 0x7f6d20159ec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800e4b0 tx=0x7f6d080047e0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.332+0000 7f6d24e20700 1 -- 172.21.15.49:0/770294851 shutdown_connections 2023-07-21T22:11:40.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.332+0000 7f6d24e20700 1 --2- 172.21.15.49:0/770294851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6d000662f0 0x7f6d000687a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.332+0000 7f6d24e20700 1 --2- 172.21.15.49:0/770294851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d200cbc40 0x7f6d20159ec0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.332+0000 7f6d24e20700 1 --2- 172.21.15.49:0/770294851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d200cc0b0 0x7f6d2015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.332+0000 7f6d24e20700 1 --2- 172.21.15.49:0/770294851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d0c004870 0x7f6d20148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.332+0000 7f6d24e20700 1 -- 172.21.15.49:0/770294851 >> 172.21.15.49:0/770294851 conn(0x7f6d20070450 msgr2=0x7f6d200b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:40.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.332+0000 7f6d24e20700 1 -- 172.21.15.49:0/770294851 shutdown_connections 2023-07-21T22:11:40.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.336+0000 7f6d24e20700 1 -- 172.21.15.49:0/770294851 wait complete. 2023-07-21T22:11:40.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:11:40.403 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:11:40.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.544+0000 7f37b1836700 1 Processor -- start 2023-07-21T22:11:40.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.544+0000 7f37b1836700 1 -- start start 2023-07-21T22:11:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37b1836700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f37ac0698a0 0x7f37ac069d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37b1836700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ac0c8b80 con 0x7f37ac0ca550 2023-07-21T22:11:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37b1836700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ac06db90 con 0x7f37ac159be0 2023-07-21T22:11:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37b1836700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ac06a260 con 0x7f37ac0698a0 2023-07-21T22:11:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37a3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f37ac0ca550 0x7f37ac06d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44370/0 (socket says 172.21.15.49:44370) 2023-07-21T22:11:40.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37a3fff700 1 -- 172.21.15.49:0/2413923957 learned_addr learned my addr 172.21.15.49:0/2413923957 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:40.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37b1035700 1 --2- 172.21.15.49:0/2413923957 >> v2:172.21.15.150:3300/0 conn(0x7f37ac0698a0 0x7f37ac069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:40.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37a37fe700 1 -- 172.21.15.49:0/2413923957 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627734102 0 0) 0x7f37ac0c8b80 con 0x7f37ac0ca550 2023-07-21T22:11:40.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37a37fe700 1 -- 172.21.15.49:0/2413923957 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37940035d0 con 0x7f37ac0ca550 2023-07-21T22:11:40.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37b1035700 1 -- 172.21.15.49:0/2413923957 >> v1:172.21.15.150:6789/0 conn(0x7f37ac159be0 legacy=0x7f37ac0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:40.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37b1035700 1 -- 172.21.15.49:0/2413923957 >> v1:172.21.15.49:6789/0 conn(0x7f37ac0ca550 legacy=0x7f37ac06d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:40.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37b1035700 1 -- 172.21.15.49:0/2413923957 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac06de70 con 0x7f37ac0698a0 2023-07-21T22:11:40.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37b1035700 1 --2- 172.21.15.49:0/2413923957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ac0698a0 0x7f37ac069d20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009d90 tx=0x7f37a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e707b201b853f80c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:40.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37a37fe700 1 -- 172.21.15.49:0/2413923957 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a400e070 con 0x7f37ac0698a0 2023-07-21T22:11:40.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37a37fe700 1 -- 172.21.15.49:0/2413923957 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a400bb20 con 0x7f37ac0698a0 2023-07-21T22:11:40.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.548+0000 7f37a37fe700 1 -- 172.21.15.49:0/2413923957 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a4012430 con 0x7f37ac0698a0 2023-07-21T22:11:40.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.552+0000 7f37b1836700 1 -- 172.21.15.49:0/2413923957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ac0698a0 msgr2=0x7f37ac069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:40.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.552+0000 7f37b1836700 1 --2- 172.21.15.49:0/2413923957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ac0698a0 0x7f37ac069d20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009d90 tx=0x7f37a400b330 comp rx=0 tx=0).stop 2023-07-21T22:11:40.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.552+0000 7f37b1836700 1 -- 172.21.15.49:0/2413923957 shutdown_connections 2023-07-21T22:11:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.552+0000 7f37b1836700 1 --2- 172.21.15.49:0/2413923957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ac0698a0 0x7f37ac069d20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.552+0000 7f37b1836700 1 -- 172.21.15.49:0/2413923957 >> 172.21.15.49:0/2413923957 conn(0x7f37ac0ce0d0 msgr2=0x7f37ac0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.552+0000 7f37b1836700 1 -- 172.21.15.49:0/2413923957 shutdown_connections 2023-07-21T22:11:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.552+0000 7f37b1836700 1 -- 172.21.15.49:0/2413923957 wait complete. 2023-07-21T22:11:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.556+0000 7f37b1836700 1 Processor -- start 2023-07-21T22:11:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.556+0000 7f37b1836700 1 -- start start 2023-07-21T22:11:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.556+0000 7f37b1836700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37ac0698a0 0x7f37ac0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.556+0000 7f37b1836700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37ac0ca550 0x7f37ac0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.556+0000 7f37b1836700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ac159be0 0x7f37ac1f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.556+0000 7f37b1836700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac0b2420 con 0x7f37ac0ca550 2023-07-21T22:11:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.556+0000 7f37b1836700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac0b2700 con 0x7f37ac159be0 2023-07-21T22:11:40.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.556+0000 7f37b1836700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac0b29e0 con 0x7f37ac0698a0 2023-07-21T22:11:40.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.556+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37ac0ca550 0x7f37ac0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:40.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.556+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37ac0ca550 0x7f37ac0b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49650/0 (socket says 172.21.15.49:49650) 2023-07-21T22:11:40.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.556+0000 7f37a3fff700 1 -- 172.21.15.49:0/1561738827 learned_addr learned my addr 172.21.15.49:0/1561738827 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:40.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.556+0000 7f37b1035700 1 --2- 172.21.15.49:0/1561738827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ac159be0 0x7f37ac1f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:40.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.556+0000 7f37b0834700 1 --2- 172.21.15.49:0/1561738827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37ac0698a0 0x7f37ac0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:40.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.560+0000 7f37a3fff700 1 -- 172.21.15.49:0/1561738827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37ac0698a0 msgr2=0x7f37ac0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:40.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.560+0000 7f37a3fff700 1 --2- 172.21.15.49:0/1561738827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37ac0698a0 0x7f37ac0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.560+0000 7f37a3fff700 1 -- 172.21.15.49:0/1561738827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ac159be0 msgr2=0x7f37ac1f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:40.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.560+0000 7f37a3fff700 1 --2- 172.21.15.49:0/1561738827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ac159be0 0x7f37ac1f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.560+0000 7f37a3fff700 1 -- 172.21.15.49:0/1561738827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a4009a70 con 0x7f37ac0ca550 2023-07-21T22:11:40.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.560+0000 7f37a3fff700 1 --2- 172.21.15.49:0/1561738827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37ac0ca550 0x7f37ac0b34c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f379c00c4d0 tx=0x7f379c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:40.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.560+0000 7f37a17fa700 1 -- 172.21.15.49:0/1561738827 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c005d90 con 0x7f37ac0ca550 2023-07-21T22:11:40.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.560+0000 7f37a17fa700 1 -- 172.21.15.49:0/1561738827 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379c0070d0 con 0x7f37ac0ca550 2023-07-21T22:11:40.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.560+0000 7f37b1836700 1 -- 172.21.15.49:0/1561738827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ac0b2cc0 con 0x7f37ac0ca550 2023-07-21T22:11:40.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.560+0000 7f37a17fa700 1 -- 172.21.15.49:0/1561738827 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c007480 con 0x7f37ac0ca550 2023-07-21T22:11:40.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.560+0000 7f37b1836700 1 -- 172.21.15.49:0/1561738827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ac0ccae0 con 0x7f37ac0ca550 2023-07-21T22:11:40.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.560+0000 7f37b1836700 1 -- 172.21.15.49:0/1561738827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ac0b31e0 con 0x7f37ac0ca550 2023-07-21T22:11:40.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.564+0000 7f37a17fa700 1 -- 172.21.15.49:0/1561738827 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f379c0075e0 con 0x7f37ac0ca550 2023-07-21T22:11:40.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.564+0000 7f37a17fa700 1 --2- 172.21.15.49:0/1561738827 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37980662f0 0x7f37980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:40.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.568+0000 7f37a17fa700 1 -- 172.21.15.49:0/1561738827 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f379c083460 con 0x7f37ac0ca550 2023-07-21T22:11:40.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.568+0000 7f37b0834700 1 --2- 172.21.15.49:0/1561738827 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37980662f0 0x7f37980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:40.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.568+0000 7f37b0834700 1 --2- 172.21.15.49:0/1561738827 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37980662f0 0x7f37980687a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f37a8000f60 tx=0x7f37a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:40.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.572+0000 7f37a17fa700 1 -- 172.21.15.49:0/1561738827 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f37ac0b31e0 con 0x7f37ac0ca550 2023-07-21T22:11:40.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.748+0000 7f37b1836700 1 -- 172.21.15.49:0/1561738827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37ac0b31e0 con 0x7f37ac0ca550 2023-07-21T22:11:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.748+0000 7f37a17fa700 1 -- 172.21.15.49:0/1561738827 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37ac0b31e0 con 0x7f37ac0ca550 2023-07-21T22:11:40.794 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:11:40.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.756+0000 7f37b1836700 1 -- 172.21.15.49:0/1561738827 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37980662f0 msgr2=0x7f37980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:40.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.756+0000 7f37b1836700 1 --2- 172.21.15.49:0/1561738827 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37980662f0 0x7f37980687a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f37a8000f60 tx=0x7f37a8009040 comp rx=0 tx=0).stop 2023-07-21T22:11:40.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.756+0000 7f37b1836700 1 -- 172.21.15.49:0/1561738827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37ac0ca550 msgr2=0x7f37ac0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:40.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.756+0000 7f37b1836700 1 --2- 172.21.15.49:0/1561738827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37ac0ca550 0x7f37ac0b34c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f379c00c4d0 tx=0x7f379c00c7e0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.756+0000 7f37b1836700 1 -- 172.21.15.49:0/1561738827 shutdown_connections 2023-07-21T22:11:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.756+0000 7f37b1836700 1 --2- 172.21.15.49:0/1561738827 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37980662f0 0x7f37980687a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.756+0000 7f37b1836700 1 --2- 172.21.15.49:0/1561738827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37ac0ca550 0x7f37ac0b34c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.756+0000 7f37b1836700 1 --2- 172.21.15.49:0/1561738827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ac159be0 0x7f37ac1f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.756+0000 7f37b1836700 1 --2- 172.21.15.49:0/1561738827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37ac0698a0 0x7f37ac0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.756+0000 7f37b1836700 1 -- 172.21.15.49:0/1561738827 >> 172.21.15.49:0/1561738827 conn(0x7f37ac0ce0d0 msgr2=0x7f37ac158e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.756+0000 7f37b1836700 1 -- 172.21.15.49:0/1561738827 shutdown_connections 2023-07-21T22:11:40.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.756+0000 7f37b1836700 1 -- 172.21.15.49:0/1561738827 wait complete. 2023-07-21T22:11:40.821 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:11:41.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.960+0000 7f37e0c36700 1 Processor -- start 2023-07-21T22:11:41.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.960+0000 7f37e0c36700 1 -- start start 2023-07-21T22:11:41.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.964+0000 7f37e0c36700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc0d1e40 0x7f37dc0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.964+0000 7f37e0c36700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f37dc0cee10 0x7f37dc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.964+0000 7f37e0c36700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc0b3e80 con 0x7f37dc0b7af0 2023-07-21T22:11:41.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.964+0000 7f37e0c36700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37dc0cf7d0 con 0x7f37dc0cee10 2023-07-21T22:11:41.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.964+0000 7f37e0c36700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc15fd40 con 0x7f37dc0d1e40 2023-07-21T22:11:41.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.964+0000 7f37dbfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f37dc0cee10 0x7f37dc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.964+0000 7f37dbfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f37dc0cee10 0x7f37dc0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49656/0 (socket says 172.21.15.49:49656) 2023-07-21T22:11:41.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.964+0000 7f37dbfff700 1 -- 172.21.15.49:0/420644637 learned_addr learned my addr 172.21.15.49:0/420644637 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:41.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.964+0000 7f37daffd700 1 --2- 172.21.15.49:0/420644637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc0d1e40 0x7f37dc0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37dbfff700 1 -- 172.21.15.49:0/420644637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc0d1e40 msgr2=0x7f37dc0b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:41.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37dbfff700 1 --2- 172.21.15.49:0/420644637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc0d1e40 0x7f37dc0b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37dbfff700 1 -- 172.21.15.49:0/420644637 >> v1:172.21.15.150:6789/0 conn(0x7f37dc0b7af0 legacy=0x7f37dc15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37dbfff700 1 -- 172.21.15.49:0/420644637 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc0cea00 con 0x7f37dc0cee10 2023-07-21T22:11:41.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37da7fc700 1 -- 172.21.15.49:0/420644637 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609780876 0 0) 0x7f37dc0b3e80 con 0x7f37dc0b7af0 2023-07-21T22:11:41.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37dbfff700 1 --2- 172.21.15.49:0/420644637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0cee10 0x7f37dc0cf290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009e50 tx=0x7f37d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8694ac44fb237089 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:41.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37da7fc700 1 -- 172.21.15.49:0/420644637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d400e070 con 0x7f37dc0cee10 2023-07-21T22:11:41.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37da7fc700 1 -- 172.21.15.49:0/420644637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d400b910 con 0x7f37dc0cee10 2023-07-21T22:11:41.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37da7fc700 1 -- 172.21.15.49:0/420644637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d400bcc0 con 0x7f37dc0cee10 2023-07-21T22:11:41.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37e0c36700 1 -- 172.21.15.49:0/420644637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0cee10 msgr2=0x7f37dc0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37e0c36700 1 --2- 172.21.15.49:0/420644637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0cee10 0x7f37dc0cf290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009e50 tx=0x7f37d400b330 comp rx=0 tx=0).stop 2023-07-21T22:11:41.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37e0c36700 1 -- 172.21.15.49:0/420644637 shutdown_connections 2023-07-21T22:11:41.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37e0c36700 1 --2- 172.21.15.49:0/420644637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc0d1e40 0x7f37dc0b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37e0c36700 1 --2- 172.21.15.49:0/420644637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0cee10 0x7f37dc0cf290 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37e0c36700 1 -- 172.21.15.49:0/420644637 >> 172.21.15.49:0/420644637 conn(0x7f37dc06e960 msgr2=0x7f37dc06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:41.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37e0c36700 1 -- 172.21.15.49:0/420644637 shutdown_connections 2023-07-21T22:11:41.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.968+0000 7f37e0c36700 1 -- 172.21.15.49:0/420644637 wait complete. 2023-07-21T22:11:41.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.972+0000 7f37e0c36700 1 Processor -- start 2023-07-21T22:11:41.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.972+0000 7f37e0c36700 1 -- start start 2023-07-21T22:11:41.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37e0c36700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0b7af0 0x7f37dc0c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37e0c36700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc0cee10 0x7f37dc15b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37e0c36700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc0d1e40 0x7f37dc150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37e0c36700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc15db30 con 0x7f37dc0b7af0 2023-07-21T22:11:41.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37e0c36700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0c72d0 con 0x7f37dc0d1e40 2023-07-21T22:11:41.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37e0c36700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0c7590 con 0x7f37dc0cee10 2023-07-21T22:11:41.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37db7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0b7af0 0x7f37dc0c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37db7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0b7af0 0x7f37dc0c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49662/0 (socket says 172.21.15.49:49662) 2023-07-21T22:11:41.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37db7fe700 1 -- 172.21.15.49:0/1404384526 learned_addr learned my addr 172.21.15.49:0/1404384526 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:41.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37daffd700 1 --2- 172.21.15.49:0/1404384526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc0cee10 0x7f37dc15b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37dbfff700 1 --2- 172.21.15.49:0/1404384526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc0d1e40 0x7f37dc150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37db7fe700 1 -- 172.21.15.49:0/1404384526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc0cee10 msgr2=0x7f37dc15b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37db7fe700 1 --2- 172.21.15.49:0/1404384526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc0cee10 0x7f37dc15b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37db7fe700 1 -- 172.21.15.49:0/1404384526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc0d1e40 msgr2=0x7f37dc150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37db7fe700 1 --2- 172.21.15.49:0/1404384526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc0d1e40 0x7f37dc150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37db7fe700 1 -- 172.21.15.49:0/1404384526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d4009b30 con 0x7f37dc0b7af0 2023-07-21T22:11:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37db7fe700 1 --2- 172.21.15.49:0/1404384526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0b7af0 0x7f37dc0c5f30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00c550 tx=0x7f37cc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37c3fff700 1 -- 172.21.15.49:0/1404384526 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc0054e0 con 0x7f37dc0b7af0 2023-07-21T22:11:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37e0c36700 1 -- 172.21.15.49:0/1404384526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc0c6780 con 0x7f37dc0b7af0 2023-07-21T22:11:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37c3fff700 1 -- 172.21.15.49:0/1404384526 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37cc0036a0 con 0x7f37dc0b7af0 2023-07-21T22:11:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37c3fff700 1 -- 172.21.15.49:0/1404384526 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc003a50 con 0x7f37dc0b7af0 2023-07-21T22:11:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.976+0000 7f37e0c36700 1 -- 172.21.15.49:0/1404384526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37dc0c6d40 con 0x7f37dc0b7af0 2023-07-21T22:11:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.980+0000 7f37e0c36700 1 -- 172.21.15.49:0/1404384526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37dc0c6f00 con 0x7f37dc0b7af0 2023-07-21T22:11:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.980+0000 7f37c3fff700 1 -- 172.21.15.49:0/1404384526 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f37cc003bb0 con 0x7f37dc0b7af0 2023-07-21T22:11:41.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.980+0000 7f37c3fff700 1 --2- 172.21.15.49:0/1404384526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37c80662f0 0x7f37c80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.980+0000 7f37c3fff700 1 -- 172.21.15.49:0/1404384526 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f37cc083570 con 0x7f37dc0b7af0 2023-07-21T22:11:41.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.984+0000 7f37daffd700 1 --2- 172.21.15.49:0/1404384526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37c80662f0 0x7f37c80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.984+0000 7f37daffd700 1 --2- 172.21.15.49:0/1404384526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37c80662f0 0x7f37c80687a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f37dc1f8bd0 tx=0x7f37d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:41.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:40.984+0000 7f37c3fff700 1 -- 172.21.15.49:0/1404384526 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f37cc0506b0 con 0x7f37dc0b7af0 2023-07-21T22:11:41.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.156+0000 7f37e0c36700 1 -- 172.21.15.49:0/1404384526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f37dc04dcb0 con 0x7f37dc0b7af0 2023-07-21T22:11:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.156+0000 7f37c3fff700 1 -- 172.21.15.49:0/1404384526 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f37cc003e60 con 0x7f37dc0b7af0 2023-07-21T22:11:41.200 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:11:41.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.160+0000 7f37e0c36700 1 -- 172.21.15.49:0/1404384526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37c80662f0 msgr2=0x7f37c80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.160+0000 7f37e0c36700 1 --2- 172.21.15.49:0/1404384526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37c80662f0 0x7f37c80687a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f37dc1f8bd0 tx=0x7f37d0008040 comp rx=0 tx=0).stop 2023-07-21T22:11:41.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.160+0000 7f37e0c36700 1 -- 172.21.15.49:0/1404384526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0b7af0 msgr2=0x7f37dc0c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.160+0000 7f37e0c36700 1 --2- 172.21.15.49:0/1404384526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0b7af0 0x7f37dc0c5f30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00c550 tx=0x7f37cc00c910 comp rx=0 tx=0).stop 2023-07-21T22:11:41.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.160+0000 7f37e0c36700 1 -- 172.21.15.49:0/1404384526 shutdown_connections 2023-07-21T22:11:41.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.160+0000 7f37e0c36700 1 --2- 172.21.15.49:0/1404384526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37c80662f0 0x7f37c80687a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.160+0000 7f37e0c36700 1 --2- 172.21.15.49:0/1404384526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc0d1e40 0x7f37dc150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.160+0000 7f37e0c36700 1 --2- 172.21.15.49:0/1404384526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc0cee10 0x7f37dc15b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.160+0000 7f37e0c36700 1 --2- 172.21.15.49:0/1404384526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0b7af0 0x7f37dc0c5f30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.160+0000 7f37e0c36700 1 -- 172.21.15.49:0/1404384526 >> 172.21.15.49:0/1404384526 conn(0x7f37dc06e960 msgr2=0x7f37dc0b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:41.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.160+0000 7f37e0c36700 1 -- 172.21.15.49:0/1404384526 shutdown_connections 2023-07-21T22:11:41.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.160+0000 7f37e0c36700 1 -- 172.21.15.49:0/1404384526 wait complete. 2023-07-21T22:11:41.224 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:11:41.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.360+0000 7fb205341700 1 Processor -- start 2023-07-21T22:11:41.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.360+0000 7fb205341700 1 -- start start 2023-07-21T22:11:41.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.364+0000 7fb205341700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb20015c0b0 0x7fb2000cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.364+0000 7fb205341700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb200070180 0x7fb2000b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.364+0000 7fb205341700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2000cf630 con 0x7fb2000ce010 2023-07-21T22:11:41.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.364+0000 7fb205341700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2000cf440 con 0x7fb20015c0b0 2023-07-21T22:11:41.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.364+0000 7fb205341700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20008a5a0 con 0x7fb200070180 2023-07-21T22:11:41.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.364+0000 7fb1feffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb20015c0b0 0x7fb2000cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.364+0000 7fb1feffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb20015c0b0 0x7fb2000cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49678/0 (socket says 172.21.15.49:49678) 2023-07-21T22:11:41.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.364+0000 7fb1feffd700 1 -- 172.21.15.49:0/1352352404 learned_addr learned my addr 172.21.15.49:0/1352352404 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:41.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.364+0000 7fb1ff7fe700 1 --2- 172.21.15.49:0/1352352404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb200070180 0x7fb2000b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.364+0000 7fb1feffd700 1 -- 172.21.15.49:0/1352352404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb200070180 msgr2=0x7fb2000b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:41.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.364+0000 7fb1feffd700 1 --2- 172.21.15.49:0/1352352404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb200070180 0x7fb2000b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.364+0000 7fb1feffd700 1 -- 172.21.15.49:0/1352352404 >> v1:172.21.15.49:6789/0 conn(0x7fb2000ce010 legacy=0x7fb20006fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.364+0000 7fb1feffd700 1 -- 172.21.15.49:0/1352352404 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2000cf910 con 0x7fb20015c0b0 2023-07-21T22:11:41.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.368+0000 7fb1feffd700 1 --2- 172.21.15.49:0/1352352404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb20015c0b0 0x7fb2000cef00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009940 tx=0x7fb1f0009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861f29613730ee28 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:41.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.368+0000 7fb1fdffb700 1 -- 172.21.15.49:0/1352352404 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0005e50 con 0x7fb20015c0b0 2023-07-21T22:11:41.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.368+0000 7fb1fdffb700 1 -- 172.21.15.49:0/1352352404 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f0006030 con 0x7fb20015c0b0 2023-07-21T22:11:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.368+0000 7fb1fdffb700 1 -- 172.21.15.49:0/1352352404 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f00063c0 con 0x7fb20015c0b0 2023-07-21T22:11:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.368+0000 7fb205341700 1 -- 172.21.15.49:0/1352352404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb20015c0b0 msgr2=0x7fb2000cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.368+0000 7fb205341700 1 --2- 172.21.15.49:0/1352352404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb20015c0b0 0x7fb2000cef00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009940 tx=0x7fb1f0009c50 comp rx=0 tx=0).stop 2023-07-21T22:11:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.368+0000 7fb205341700 1 -- 172.21.15.49:0/1352352404 shutdown_connections 2023-07-21T22:11:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.368+0000 7fb205341700 1 --2- 172.21.15.49:0/1352352404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb200070180 0x7fb2000b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.368+0000 7fb205341700 1 --2- 172.21.15.49:0/1352352404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb20015c0b0 0x7fb2000cef00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.368+0000 7fb205341700 1 -- 172.21.15.49:0/1352352404 >> 172.21.15.49:0/1352352404 conn(0x7fb200089fe0 msgr2=0x7fb2000d0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:41.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.368+0000 7fb205341700 1 -- 172.21.15.49:0/1352352404 shutdown_connections 2023-07-21T22:11:41.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.368+0000 7fb205341700 1 -- 172.21.15.49:0/1352352404 wait complete. 2023-07-21T22:11:41.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.368+0000 7fb205341700 1 Processor -- start 2023-07-21T22:11:41.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.368+0000 7fb205341700 1 -- start start 2023-07-21T22:11:41.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb205341700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb200070180 0x7fb2000c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb205341700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2000ce010 0x7fb2000cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb205341700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb20015c0b0 0x7fb2000c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb205341700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000c4e40 con 0x7fb20015c0b0 2023-07-21T22:11:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb205341700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000c3f70 con 0x7fb2000ce010 2023-07-21T22:11:41.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb205341700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb200156ba0 con 0x7fb200070180 2023-07-21T22:11:41.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1ff7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb20015c0b0 0x7fb2000c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1ff7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb20015c0b0 0x7fb2000c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49688/0 (socket says 172.21.15.49:49688) 2023-07-21T22:11:41.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1ff7fe700 1 -- 172.21.15.49:0/788498515 learned_addr learned my addr 172.21.15.49:0/788498515 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:41.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1feffd700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb200070180 0x7fb2000c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1fe7fc700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2000ce010 0x7fb2000cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1ff7fe700 1 -- 172.21.15.49:0/788498515 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb200070180 msgr2=0x7fb2000c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1ff7fe700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb200070180 0x7fb2000c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1ff7fe700 1 -- 172.21.15.49:0/788498515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2000ce010 msgr2=0x7fb2000cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1ff7fe700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2000ce010 0x7fb2000cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1ff7fe700 1 -- 172.21.15.49:0/788498515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0009520 con 0x7fb20015c0b0 2023-07-21T22:11:41.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1feffd700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb200070180 0x7fb2000c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:41.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1ff7fe700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb20015c0b0 0x7fb2000c5f70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800efc0 tx=0x7fb1f8009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:41.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1e77fe700 1 -- 172.21.15.49:0/788498515 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8009b20 con 0x7fb20015c0b0 2023-07-21T22:11:41.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1e77fe700 1 -- 172.21.15.49:0/788498515 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f800f040 con 0x7fb20015c0b0 2023-07-21T22:11:41.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb205341700 1 -- 172.21.15.49:0/788498515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2000c41c0 con 0x7fb20015c0b0 2023-07-21T22:11:41.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb1e77fe700 1 -- 172.21.15.49:0/788498515 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f800cd40 con 0x7fb20015c0b0 2023-07-21T22:11:41.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.372+0000 7fb205341700 1 -- 172.21.15.49:0/788498515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2000c4780 con 0x7fb20015c0b0 2023-07-21T22:11:41.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.376+0000 7fb205341700 1 -- 172.21.15.49:0/788498515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20004dd50 con 0x7fb20015c0b0 2023-07-21T22:11:41.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.376+0000 7fb1e77fe700 1 -- 172.21.15.49:0/788498515 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb1f8014480 con 0x7fb20015c0b0 2023-07-21T22:11:41.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.380+0000 7fb1e77fe700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb1ec0662f0 0x7fb1ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.380+0000 7fb1e77fe700 1 -- 172.21.15.49:0/788498515 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb1f8084aa0 con 0x7fb20015c0b0 2023-07-21T22:11:41.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.380+0000 7fb1feffd700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb1ec0662f0 0x7fb1ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.380+0000 7fb1feffd700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb1ec0662f0 0x7fb1ec0687a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0013040 tx=0x7fb1f0008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:41.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.384+0000 7fb1e77fe700 1 -- 172.21.15.49:0/788498515 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1f8051be0 con 0x7fb20015c0b0 2023-07-21T22:11:41.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.556+0000 7fb205341700 1 -- 172.21.15.49:0/788498515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb20006c9a0 con 0x7fb20015c0b0 2023-07-21T22:11:41.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.560+0000 7fb1e77fe700 1 -- 172.21.15.49:0/788498515 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1f8055200 con 0x7fb20015c0b0 2023-07-21T22:11:41.603 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:41.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.564+0000 7fb205341700 1 -- 172.21.15.49:0/788498515 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb1ec0662f0 msgr2=0x7fb1ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.564+0000 7fb205341700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb1ec0662f0 0x7fb1ec0687a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0013040 tx=0x7fb1f0008070 comp rx=0 tx=0).stop 2023-07-21T22:11:41.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.564+0000 7fb205341700 1 -- 172.21.15.49:0/788498515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb20015c0b0 msgr2=0x7fb2000c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.564+0000 7fb205341700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb20015c0b0 0x7fb2000c5f70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800efc0 tx=0x7fb1f8009f60 comp rx=0 tx=0).stop 2023-07-21T22:11:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.564+0000 7fb205341700 1 -- 172.21.15.49:0/788498515 shutdown_connections 2023-07-21T22:11:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.564+0000 7fb205341700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb1ec0662f0 0x7fb1ec0687a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.564+0000 7fb205341700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb20015c0b0 0x7fb2000c5f70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.564+0000 7fb205341700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2000ce010 0x7fb2000cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.564+0000 7fb205341700 1 --2- 172.21.15.49:0/788498515 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb200070180 0x7fb2000c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.564+0000 7fb205341700 1 -- 172.21.15.49:0/788498515 >> 172.21.15.49:0/788498515 conn(0x7fb200089fe0 msgr2=0x7fb2000b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.564+0000 7fb205341700 1 -- 172.21.15.49:0/788498515 shutdown_connections 2023-07-21T22:11:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.564+0000 7fb205341700 1 -- 172.21.15.49:0/788498515 wait complete. 2023-07-21T22:11:41.632 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:11:41.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.772+0000 7fd541315700 1 Processor -- start 2023-07-21T22:11:41.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd541315700 1 -- start start 2023-07-21T22:11:41.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd541315700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd53c0ca550 0x7fd53c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd541315700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c06d6d0 0x7fd53c0698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd541315700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53c0c8b80 con 0x7fd53c159be0 2023-07-21T22:11:41.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd541315700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c0c9720 con 0x7fd53c0ca550 2023-07-21T22:11:41.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd541315700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c06db90 con 0x7fd53c06d6d0 2023-07-21T22:11:41.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd5337fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd53c0ca550 0x7fd53c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd5337fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd53c0ca550 0x7fd53c06d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49692/0 (socket says 172.21.15.49:49692) 2023-07-21T22:11:41.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd5337fe700 1 -- 172.21.15.49:0/437394030 learned_addr learned my addr 172.21.15.49:0/437394030 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:41.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd540b14700 1 --2- 172.21.15.49:0/437394030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c06d6d0 0x7fd53c0698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd5337fe700 1 -- 172.21.15.49:0/437394030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c06d6d0 msgr2=0x7fd53c0698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:41.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd5337fe700 1 --2- 172.21.15.49:0/437394030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c06d6d0 0x7fd53c0698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd5337fe700 1 -- 172.21.15.49:0/437394030 >> v1:172.21.15.49:6789/0 conn(0x7fd53c159be0 legacy=0x7fd53c0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd5337fe700 1 -- 172.21.15.49:0/437394030 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c06de70 con 0x7fd53c0ca550 2023-07-21T22:11:41.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd540b14700 1 --2- 172.21.15.49:0/437394030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c06d6d0 0x7fd53c0698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:41.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd5337fe700 1 --2- 172.21.15.49:0/437394030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd53c0ca550 0x7fd53c06d190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd524009910 tx=0x7fd524009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a5011e9947b9ee server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:41.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.776+0000 7fd53b7fe700 1 -- 172.21.15.49:0/437394030 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52400ba60 con 0x7fd53c0ca550 2023-07-21T22:11:41.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.780+0000 7fd53b7fe700 1 -- 172.21.15.49:0/437394030 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52400bbc0 con 0x7fd53c0ca550 2023-07-21T22:11:41.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.780+0000 7fd53b7fe700 1 -- 172.21.15.49:0/437394030 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524009e60 con 0x7fd53c0ca550 2023-07-21T22:11:41.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.780+0000 7fd541315700 1 -- 172.21.15.49:0/437394030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd53c0ca550 msgr2=0x7fd53c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.780+0000 7fd541315700 1 --2- 172.21.15.49:0/437394030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd53c0ca550 0x7fd53c06d190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd524009910 tx=0x7fd524009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.780+0000 7fd541315700 1 -- 172.21.15.49:0/437394030 shutdown_connections 2023-07-21T22:11:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.780+0000 7fd541315700 1 --2- 172.21.15.49:0/437394030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c06d6d0 0x7fd53c0698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.780+0000 7fd541315700 1 --2- 172.21.15.49:0/437394030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd53c0ca550 0x7fd53c06d190 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.780+0000 7fd541315700 1 -- 172.21.15.49:0/437394030 >> 172.21.15.49:0/437394030 conn(0x7fd53c0ce0d0 msgr2=0x7fd53c0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:41.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.780+0000 7fd541315700 1 -- 172.21.15.49:0/437394030 shutdown_connections 2023-07-21T22:11:41.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.780+0000 7fd541315700 1 -- 172.21.15.49:0/437394030 wait complete. 2023-07-21T22:11:41.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.780+0000 7fd541315700 1 Processor -- start 2023-07-21T22:11:41.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.780+0000 7fd541315700 1 -- start start 2023-07-21T22:11:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd541315700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd53c06d6d0 0x7fd53c15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd541315700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd53c0ca550 0x7fd53c146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd541315700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c159be0 0x7fd53c141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd541315700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0af640 con 0x7fd53c06d6d0 2023-07-21T22:11:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd541315700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c1477c0 con 0x7fd53c0ca550 2023-07-21T22:11:41.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd541315700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0c47a0 con 0x7fd53c159be0 2023-07-21T22:11:41.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd53bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd53c06d6d0 0x7fd53c15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd53bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd53c06d6d0 0x7fd53c15bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49694/0 (socket says 172.21.15.49:49694) 2023-07-21T22:11:41.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd53bfff700 1 -- 172.21.15.49:0/876776370 learned_addr learned my addr 172.21.15.49:0/876776370 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:41.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd5337fe700 1 --2- 172.21.15.49:0/876776370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd53c0ca550 0x7fd53c146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd540b14700 1 --2- 172.21.15.49:0/876776370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c159be0 0x7fd53c141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd53bfff700 1 -- 172.21.15.49:0/876776370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c159be0 msgr2=0x7fd53c141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd53bfff700 1 --2- 172.21.15.49:0/876776370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c159be0 0x7fd53c141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd53bfff700 1 -- 172.21.15.49:0/876776370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd53c0ca550 msgr2=0x7fd53c146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:41.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd53bfff700 1 --2- 172.21.15.49:0/876776370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd53c0ca550 0x7fd53c146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:41.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd53bfff700 1 -- 172.21.15.49:0/876776370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd524009570 con 0x7fd53c06d6d0 2023-07-21T22:11:41.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd53bfff700 1 --2- 172.21.15.49:0/876776370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd53c06d6d0 0x7fd53c15bfc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00c500 tx=0x7fd52c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd5397fa700 1 -- 172.21.15.49:0/876776370 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0052d0 con 0x7fd53c06d6d0 2023-07-21T22:11:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd5397fa700 1 -- 172.21.15.49:0/876776370 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c005430 con 0x7fd53c06d6d0 2023-07-21T22:11:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd5397fa700 1 -- 172.21.15.49:0/876776370 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0055a0 con 0x7fd53c06d6d0 2023-07-21T22:11:41.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd541315700 1 -- 172.21.15.49:0/876776370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c0aeca0 con 0x7fd53c06d6d0 2023-07-21T22:11:41.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.784+0000 7fd541315700 1 -- 172.21.15.49:0/876776370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c0af260 con 0x7fd53c06d6d0 2023-07-21T22:11:41.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.788+0000 7fd541315700 1 -- 172.21.15.49:0/876776370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c04dcb0 con 0x7fd53c06d6d0 2023-07-21T22:11:41.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.788+0000 7fd5397fa700 1 -- 172.21.15.49:0/876776370 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd52c0038e0 con 0x7fd53c06d6d0 2023-07-21T22:11:41.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.792+0000 7fd5397fa700 1 --2- 172.21.15.49:0/876776370 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd51c0662f0 0x7fd51c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:41.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.792+0000 7fd5397fa700 1 -- 172.21.15.49:0/876776370 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd52c083390 con 0x7fd53c06d6d0 2023-07-21T22:11:41.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.792+0000 7fd5337fe700 1 --2- 172.21.15.49:0/876776370 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd51c0662f0 0x7fd51c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:41.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.792+0000 7fd5337fe700 1 --2- 172.21.15.49:0/876776370 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd51c0662f0 0x7fd51c0687a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd524000c00 tx=0x7fd524008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:41.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.796+0000 7fd5397fa700 1 -- 172.21.15.49:0/876776370 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd52c050440 con 0x7fd53c06d6d0 2023-07-21T22:11:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.972+0000 7fd541315700 1 -- 172.21.15.49:0/876776370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd53c157730 con 0x7fd53c06d6d0 2023-07-21T22:11:42.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.972+0000 7fd5397fa700 1 -- 172.21.15.49:0/876776370 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd52c053a60 con 0x7fd53c06d6d0 2023-07-21T22:11:42.017 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:11:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.976+0000 7fd541315700 1 -- 172.21.15.49:0/876776370 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd51c0662f0 msgr2=0x7fd51c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.976+0000 7fd541315700 1 --2- 172.21.15.49:0/876776370 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd51c0662f0 0x7fd51c0687a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd524000c00 tx=0x7fd524008030 comp rx=0 tx=0).stop 2023-07-21T22:11:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.976+0000 7fd541315700 1 -- 172.21.15.49:0/876776370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd53c06d6d0 msgr2=0x7fd53c15bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.976+0000 7fd541315700 1 --2- 172.21.15.49:0/876776370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd53c06d6d0 0x7fd53c15bfc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00c500 tx=0x7fd52c00c810 comp rx=0 tx=0).stop 2023-07-21T22:11:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.976+0000 7fd541315700 1 -- 172.21.15.49:0/876776370 shutdown_connections 2023-07-21T22:11:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.976+0000 7fd541315700 1 --2- 172.21.15.49:0/876776370 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd51c0662f0 0x7fd51c0687a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.976+0000 7fd541315700 1 --2- 172.21.15.49:0/876776370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c159be0 0x7fd53c141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.976+0000 7fd541315700 1 --2- 172.21.15.49:0/876776370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd53c0ca550 0x7fd53c146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.976+0000 7fd541315700 1 --2- 172.21.15.49:0/876776370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd53c06d6d0 0x7fd53c15bfc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.976+0000 7fd541315700 1 -- 172.21.15.49:0/876776370 >> 172.21.15.49:0/876776370 conn(0x7fd53c0ce0d0 msgr2=0x7fd53c0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:42.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.976+0000 7fd541315700 1 -- 172.21.15.49:0/876776370 shutdown_connections 2023-07-21T22:11:42.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:41.976+0000 7fd541315700 1 -- 172.21.15.49:0/876776370 wait complete. 2023-07-21T22:11:42.041 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:11:42.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.180+0000 7f9f62126700 1 Processor -- start 2023-07-21T22:11:42.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.180+0000 7f9f62126700 1 -- start start 2023-07-21T22:11:42.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.184+0000 7f9f62126700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c160110 0x7f9f5c0cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:42.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.184+0000 7f9f62126700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9f5c0cb2f0 0x7f9f5c163d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:42.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.184+0000 7f9f62126700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c0cdf00 con 0x7f9f5c071220 2023-07-21T22:11:42.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.184+0000 7f9f62126700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5c0cd730 con 0x7f9f5c0cb2f0 2023-07-21T22:11:42.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.184+0000 7f9f62126700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0ce600 con 0x7f9f5c160110 2023-07-21T22:11:42.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.184+0000 7f9f5b7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c160110 0x7f9f5c0cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:42.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.184+0000 7f9f5b7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c160110 0x7f9f5c0cea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:47446/0 (socket says 172.21.15.49:47446) 2023-07-21T22:11:42.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.184+0000 7f9f5b7fe700 1 -- 172.21.15.49:0/3938526109 learned_addr learned my addr 172.21.15.49:0/3938526109 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:42.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.184+0000 7f9f5bfff700 1 --2- 172.21.15.49:0/3938526109 >> v2:172.21.15.150:3300/0 conn(0x7f9f5c0cb2f0 0x7f9f5c163d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:42.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f5b7fe700 1 -- 172.21.15.49:0/3938526109 >> v2:172.21.15.150:3300/0 conn(0x7f9f5c0cb2f0 msgr2=0x7f9f5c163d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:42.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f5b7fe700 1 --2- 172.21.15.49:0/3938526109 >> v2:172.21.15.150:3300/0 conn(0x7f9f5c0cb2f0 0x7f9f5c163d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f5b7fe700 1 -- 172.21.15.49:0/3938526109 >> v1:172.21.15.150:6789/0 conn(0x7f9f5c071220 legacy=0x7f9f5c0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:42.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f5b7fe700 1 -- 172.21.15.49:0/3938526109 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c0cefd0 con 0x7f9f5c160110 2023-07-21T22:11:42.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f5b7fe700 1 --2- 172.21.15.49:0/3938526109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c160110 0x7f9f5c0cea90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009910 tx=0x7f9f4c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=561842bbcd2add41 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:42.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f5a7fc700 1 -- 172.21.15.49:0/3938526109 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c00ba60 con 0x7f9f5c160110 2023-07-21T22:11:42.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f5a7fc700 1 -- 172.21.15.49:0/3938526109 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c00bbc0 con 0x7f9f5c160110 2023-07-21T22:11:42.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f5a7fc700 1 -- 172.21.15.49:0/3938526109 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c009e60 con 0x7f9f5c160110 2023-07-21T22:11:42.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f62126700 1 -- 172.21.15.49:0/3938526109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c160110 msgr2=0x7f9f5c0cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:42.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f62126700 1 --2- 172.21.15.49:0/3938526109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c160110 0x7f9f5c0cea90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009910 tx=0x7f9f4c009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:42.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f62126700 1 -- 172.21.15.49:0/3938526109 shutdown_connections 2023-07-21T22:11:42.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f62126700 1 --2- 172.21.15.49:0/3938526109 >> v2:172.21.15.150:3300/0 conn(0x7f9f5c0cb2f0 0x7f9f5c163d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f62126700 1 --2- 172.21.15.49:0/3938526109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c160110 0x7f9f5c0cea90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f62126700 1 -- 172.21.15.49:0/3938526109 >> 172.21.15.49:0/3938526109 conn(0x7f9f5c06e960 msgr2=0x7f9f5c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:42.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f62126700 1 -- 172.21.15.49:0/3938526109 shutdown_connections 2023-07-21T22:11:42.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.188+0000 7f9f62126700 1 -- 172.21.15.49:0/3938526109 wait complete. 2023-07-21T22:11:42.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.192+0000 7f9f62126700 1 Processor -- start 2023-07-21T22:11:42.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.192+0000 7f9f62126700 1 -- start start 2023-07-21T22:11:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.192+0000 7f9f62126700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5c071220 0x7f9f5c0c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.192+0000 7f9f62126700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f5c0cb2f0 0x7f9f5c163b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.192+0000 7f9f62126700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c160110 0x7f9f5c14fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.192+0000 7f9f62126700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0c67b0 con 0x7f9f5c0cb2f0 2023-07-21T22:11:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.192+0000 7f9f62126700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0c6a90 con 0x7f9f5c071220 2023-07-21T22:11:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.192+0000 7f9f62126700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0c6d70 con 0x7f9f5c160110 2023-07-21T22:11:42.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.192+0000 7f9f5affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f5c0cb2f0 0x7f9f5c163b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:42.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.192+0000 7f9f5affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f5c0cb2f0 0x7f9f5c163b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49702/0 (socket says 172.21.15.49:49702) 2023-07-21T22:11:42.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.192+0000 7f9f5affd700 1 -- 172.21.15.49:0/2642297654 learned_addr learned my addr 172.21.15.49:0/2642297654 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:42.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.192+0000 7f9f5b7fe700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5c071220 0x7f9f5c0c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:42.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.192+0000 7f9f5bfff700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c160110 0x7f9f5c14fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:42.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.196+0000 7f9f5affd700 1 -- 172.21.15.49:0/2642297654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c160110 msgr2=0x7f9f5c14fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:42.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.196+0000 7f9f5affd700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c160110 0x7f9f5c14fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.196+0000 7f9f5affd700 1 -- 172.21.15.49:0/2642297654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5c071220 msgr2=0x7f9f5c0c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:42.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.196+0000 7f9f5affd700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5c071220 0x7f9f5c0c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.196+0000 7f9f5affd700 1 -- 172.21.15.49:0/2642297654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c009570 con 0x7f9f5c0cb2f0 2023-07-21T22:11:42.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.196+0000 7f9f5b7fe700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5c071220 0x7f9f5c0c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:42.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.196+0000 7f9f5affd700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f5c0cb2f0 0x7f9f5c163b80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000c450 tx=0x7f9f5000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:42.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.196+0000 7f9f43fff700 1 -- 172.21.15.49:0/2642297654 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f500052d0 con 0x7f9f5c0cb2f0 2023-07-21T22:11:42.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.196+0000 7f9f43fff700 1 -- 172.21.15.49:0/2642297654 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f50005430 con 0x7f9f5c0cb2f0 2023-07-21T22:11:42.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.196+0000 7f9f43fff700 1 -- 172.21.15.49:0/2642297654 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50003930 con 0x7f9f5c0cb2f0 2023-07-21T22:11:42.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.196+0000 7f9f62126700 1 -- 172.21.15.49:0/2642297654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5c0c7050 con 0x7f9f5c0cb2f0 2023-07-21T22:11:42.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.196+0000 7f9f62126700 1 -- 172.21.15.49:0/2642297654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c0c7e50 con 0x7f9f5c0cb2f0 2023-07-21T22:11:42.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.196+0000 7f9f62126700 1 -- 172.21.15.49:0/2642297654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c161ac0 con 0x7f9f5c0cb2f0 2023-07-21T22:11:42.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.200+0000 7f9f43fff700 1 -- 172.21.15.49:0/2642297654 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9f50003a90 con 0x7f9f5c0cb2f0 2023-07-21T22:11:42.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.200+0000 7f9f43fff700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f480662f0 0x7f9f480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.200+0000 7f9f43fff700 1 -- 172.21.15.49:0/2642297654 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9f50083440 con 0x7f9f5c0cb2f0 2023-07-21T22:11:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.200+0000 7f9f5b7fe700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f480662f0 0x7f9f480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:42.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.200+0000 7f9f5b7fe700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f480662f0 0x7f9f480687a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c000c00 tx=0x7f9f4c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.208+0000 7f9f43fff700 1 -- 172.21.15.49:0/2642297654 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9f5c161ac0 con 0x7f9f5c0cb2f0 2023-07-21T22:11:42.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.388+0000 7f9f62126700 1 -- 172.21.15.49:0/2642297654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9f5c161ea0 con 0x7f9f5c0cb2f0 2023-07-21T22:11:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.388+0000 7f9f43fff700 1 -- 172.21.15.49:0/2642297654 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9f50017020 con 0x7f9f5c0cb2f0 2023-07-21T22:11:42.432 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:42.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.392+0000 7f9f62126700 1 -- 172.21.15.49:0/2642297654 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f480662f0 msgr2=0x7f9f480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:42.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.392+0000 7f9f62126700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f480662f0 0x7f9f480687a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c000c00 tx=0x7f9f4c008030 comp rx=0 tx=0).stop 2023-07-21T22:11:42.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.392+0000 7f9f62126700 1 -- 172.21.15.49:0/2642297654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f5c0cb2f0 msgr2=0x7f9f5c163b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:42.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.392+0000 7f9f62126700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f5c0cb2f0 0x7f9f5c163b80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000c450 tx=0x7f9f5000c760 comp rx=0 tx=0).stop 2023-07-21T22:11:42.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.392+0000 7f9f62126700 1 -- 172.21.15.49:0/2642297654 shutdown_connections 2023-07-21T22:11:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.392+0000 7f9f62126700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f480662f0 0x7f9f480687a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.392+0000 7f9f62126700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f5c0cb2f0 0x7f9f5c163b80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.392+0000 7f9f62126700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c160110 0x7f9f5c14fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.392+0000 7f9f62126700 1 --2- 172.21.15.49:0/2642297654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5c071220 0x7f9f5c0c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.392+0000 7f9f62126700 1 -- 172.21.15.49:0/2642297654 >> 172.21.15.49:0/2642297654 conn(0x7f9f5c06e960 msgr2=0x7f9f5c06cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:42.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.392+0000 7f9f62126700 1 -- 172.21.15.49:0/2642297654 shutdown_connections 2023-07-21T22:11:42.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.392+0000 7f9f62126700 1 -- 172.21.15.49:0/2642297654 wait complete. 2023-07-21T22:11:42.458 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:11:42.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.588+0000 7fd2d41dc700 1 Processor -- start 2023-07-21T22:11:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.592+0000 7fd2d41dc700 1 -- start start 2023-07-21T22:11:42.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.592+0000 7fd2d41dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc1604c0 0x7fd2cc0afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:42.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.592+0000 7fd2d41dc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2cc0c8860 0x7fd2cc070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:42.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.592+0000 7fd2d41dc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2cc0b0530 con 0x7fd2cc0afc20 2023-07-21T22:11:42.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.592+0000 7fd2d41dc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2cc163df0 con 0x7fd2cc0c8860 2023-07-21T22:11:42.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.592+0000 7fd2d41dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc1640d0 con 0x7fd2cc1604c0 2023-07-21T22:11:42.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.592+0000 7fd2d2779700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2cc0c8860 0x7fd2cc070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:42.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.592+0000 7fd2d2779700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2cc0c8860 0x7fd2cc070600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49710/0 (socket says 172.21.15.49:49710) 2023-07-21T22:11:42.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.592+0000 7fd2d2779700 1 -- 172.21.15.49:0/268349727 learned_addr learned my addr 172.21.15.49:0/268349727 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:42.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.592+0000 7fd2d1777700 1 --2- 172.21.15.49:0/268349727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc1604c0 0x7fd2cc0afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:42.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d2779700 1 -- 172.21.15.49:0/268349727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc1604c0 msgr2=0x7fd2cc0afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:42.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d2779700 1 --2- 172.21.15.49:0/268349727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc1604c0 0x7fd2cc0afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d2779700 1 -- 172.21.15.49:0/268349727 >> v1:172.21.15.150:6789/0 conn(0x7fd2cc0afc20 legacy=0x7fd2cc0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:42.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d2779700 1 -- 172.21.15.49:0/268349727 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc1643b0 con 0x7fd2cc0c8860 2023-07-21T22:11:42.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d0f76700 1 -- 172.21.15.49:0/268349727 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910673756 0 0) 0x7fd2cc0b0530 con 0x7fd2cc0afc20 2023-07-21T22:11:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d2779700 1 --2- 172.21.15.49:0/268349727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2cc0c8860 0x7fd2cc070600 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4009e50 tx=0x7fd2c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7278da0e6e86315b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d0f76700 1 -- 172.21.15.49:0/268349727 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c400e070 con 0x7fd2cc0c8860 2023-07-21T22:11:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d0f76700 1 -- 172.21.15.49:0/268349727 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c400b9c0 con 0x7fd2cc0c8860 2023-07-21T22:11:42.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d0f76700 1 -- 172.21.15.49:0/268349727 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c400bd70 con 0x7fd2cc0c8860 2023-07-21T22:11:42.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d41dc700 1 -- 172.21.15.49:0/268349727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2cc0c8860 msgr2=0x7fd2cc070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:42.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d41dc700 1 --2- 172.21.15.49:0/268349727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2cc0c8860 0x7fd2cc070600 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4009e50 tx=0x7fd2c400b330 comp rx=0 tx=0).stop 2023-07-21T22:11:42.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d41dc700 1 -- 172.21.15.49:0/268349727 shutdown_connections 2023-07-21T22:11:42.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d41dc700 1 --2- 172.21.15.49:0/268349727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc1604c0 0x7fd2cc0afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d41dc700 1 --2- 172.21.15.49:0/268349727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2cc0c8860 0x7fd2cc070600 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d41dc700 1 -- 172.21.15.49:0/268349727 >> 172.21.15.49:0/268349727 conn(0x7fd2cc06f5a0 msgr2=0x7fd2cc0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:42.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d41dc700 1 -- 172.21.15.49:0/268349727 shutdown_connections 2023-07-21T22:11:42.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.596+0000 7fd2d41dc700 1 -- 172.21.15.49:0/268349727 wait complete. 2023-07-21T22:11:42.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.600+0000 7fd2d41dc700 1 Processor -- start 2023-07-21T22:11:42.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.600+0000 7fd2d41dc700 1 -- start start 2023-07-21T22:11:42.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.600+0000 7fd2d41dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2cc0afc20 0x7fd2cc15e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:42.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d41dc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2cc0c8860 0x7fd2cc162300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:42.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d41dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc1604c0 0x7fd2cc0c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:42.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d41dc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc160a30 con 0x7fd2cc0afc20 2023-07-21T22:11:42.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d41dc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc160d10 con 0x7fd2cc0c8860 2023-07-21T22:11:42.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d41dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc160ff0 con 0x7fd2cc1604c0 2023-07-21T22:11:42.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d1f78700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2cc0afc20 0x7fd2cc15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:42.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d1f78700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2cc0afc20 0x7fd2cc15e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49724/0 (socket says 172.21.15.49:49724) 2023-07-21T22:11:42.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d1f78700 1 -- 172.21.15.49:0/813981512 learned_addr learned my addr 172.21.15.49:0/813981512 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:42.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d1777700 1 --2- 172.21.15.49:0/813981512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2cc0c8860 0x7fd2cc162300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:42.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d2779700 1 --2- 172.21.15.49:0/813981512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc1604c0 0x7fd2cc0c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:42.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d1f78700 1 -- 172.21.15.49:0/813981512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc1604c0 msgr2=0x7fd2cc0c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:42.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d1f78700 1 --2- 172.21.15.49:0/813981512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc1604c0 0x7fd2cc0c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d1f78700 1 -- 172.21.15.49:0/813981512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2cc0c8860 msgr2=0x7fd2cc162300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:42.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d1f78700 1 --2- 172.21.15.49:0/813981512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2cc0c8860 0x7fd2cc162300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d1f78700 1 -- 172.21.15.49:0/813981512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c4009b30 con 0x7fd2cc0afc20 2023-07-21T22:11:42.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d1f78700 1 --2- 172.21.15.49:0/813981512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2cc0afc20 0x7fd2cc15e790 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c520 tx=0x7fd2c800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:42.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2c27fc700 1 -- 172.21.15.49:0/813981512 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c80054e0 con 0x7fd2cc0afc20 2023-07-21T22:11:42.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2c27fc700 1 -- 172.21.15.49:0/813981512 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c80036a0 con 0x7fd2cc0afc20 2023-07-21T22:11:42.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d41dc700 1 -- 172.21.15.49:0/813981512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2cc1612d0 con 0x7fd2cc0afc20 2023-07-21T22:11:42.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2c27fc700 1 -- 172.21.15.49:0/813981512 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8003a50 con 0x7fd2cc0afc20 2023-07-21T22:11:42.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.604+0000 7fd2d41dc700 1 -- 172.21.15.49:0/813981512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2cc15ecd0 con 0x7fd2cc0afc20 2023-07-21T22:11:42.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.608+0000 7fd2d41dc700 1 -- 172.21.15.49:0/813981512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2cc1617f0 con 0x7fd2cc0afc20 2023-07-21T22:11:42.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.608+0000 7fd2c27fc700 1 -- 172.21.15.49:0/813981512 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd2c8003bb0 con 0x7fd2cc0afc20 2023-07-21T22:11:42.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.608+0000 7fd2c27fc700 1 --2- 172.21.15.49:0/813981512 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd2b00662f0 0x7fd2b00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:42.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.608+0000 7fd2c27fc700 1 -- 172.21.15.49:0/813981512 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd2c80834b0 con 0x7fd2cc0afc20 2023-07-21T22:11:42.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.608+0000 7fd2d1777700 1 --2- 172.21.15.49:0/813981512 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd2b00662f0 0x7fd2b00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:42.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.612+0000 7fd2d1777700 1 --2- 172.21.15.49:0/813981512 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd2b00662f0 0x7fd2b00687a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc162100 tx=0x7fd2bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.616+0000 7fd2c27fc700 1 -- 172.21.15.49:0/813981512 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2cc1617f0 con 0x7fd2cc0afc20 2023-07-21T22:11:42.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.804+0000 7fd2d41dc700 1 -- 172.21.15.49:0/813981512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd2cc1617f0 con 0x7fd2cc0afc20 2023-07-21T22:11:42.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.804+0000 7fd2c27fc700 1 -- 172.21.15.49:0/813981512 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd2cc1617f0 con 0x7fd2cc0afc20 2023-07-21T22:11:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.804+0000 7fd2d41dc700 1 -- 172.21.15.49:0/813981512 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd2b00662f0 msgr2=0x7fd2b00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.808+0000 7fd2d41dc700 1 --2- 172.21.15.49:0/813981512 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd2b00662f0 0x7fd2b00687a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc162100 tx=0x7fd2bc008040 comp rx=0 tx=0).stop 2023-07-21T22:11:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.808+0000 7fd2d41dc700 1 -- 172.21.15.49:0/813981512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2cc0afc20 msgr2=0x7fd2cc15e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.808+0000 7fd2d41dc700 1 --2- 172.21.15.49:0/813981512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2cc0afc20 0x7fd2cc15e790 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c520 tx=0x7fd2c800c830 comp rx=0 tx=0).stop 2023-07-21T22:11:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.808+0000 7fd2d41dc700 1 -- 172.21.15.49:0/813981512 shutdown_connections 2023-07-21T22:11:42.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.808+0000 7fd2d41dc700 1 --2- 172.21.15.49:0/813981512 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd2b00662f0 0x7fd2b00687a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.808+0000 7fd2d41dc700 1 --2- 172.21.15.49:0/813981512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc1604c0 0x7fd2cc0c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.808+0000 7fd2d41dc700 1 --2- 172.21.15.49:0/813981512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2cc0c8860 0x7fd2cc162300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.808+0000 7fd2d41dc700 1 --2- 172.21.15.49:0/813981512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2cc0afc20 0x7fd2cc15e790 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:42.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.808+0000 7fd2d41dc700 1 -- 172.21.15.49:0/813981512 >> 172.21.15.49:0/813981512 conn(0x7fd2cc06f5a0 msgr2=0x7fd2cc070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:42.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.808+0000 7fd2d41dc700 1 -- 172.21.15.49:0/813981512 shutdown_connections 2023-07-21T22:11:42.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:42.808+0000 7fd2d41dc700 1 -- 172.21.15.49:0/813981512 wait complete. 2023-07-21T22:11:42.853 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:11:42.875 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:11:42.876 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:11:42.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:43.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.076+0000 7f73de79e700 1 Processor -- start 2023-07-21T22:11:43.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.076+0000 7f73de79e700 1 -- start start 2023-07-21T22:11:43.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.076+0000 7f73de79e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73d806d380 0x7f73d806d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.076+0000 7f73de79e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73d80cafb0 0x7f73d80cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.076+0000 7f73de79e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d80cb940 con 0x7f73d8071c70 2023-07-21T22:11:43.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.076+0000 7f73de79e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d80c9e80 con 0x7f73d80cafb0 2023-07-21T22:11:43.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.076+0000 7f73de79e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80afeb0 con 0x7f73d806d380 2023-07-21T22:11:43.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.076+0000 7f73ddf9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73d80cafb0 0x7f73d80cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.076+0000 7f73dd79c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73d806d380 0x7f73d806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.076+0000 7f73dcf9b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f73d8071c70 0x7f73d80b0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:58658/0 (socket says 172.21.15.49:58658) 2023-07-21T22:11:43.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.076+0000 7f73ddf9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73d80cafb0 0x7f73d80cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49728/0 (socket says 172.21.15.49:49728) 2023-07-21T22:11:43.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.076+0000 7f73dcf9b700 1 -- 172.21.15.49:0/1197782570 learned_addr learned my addr 172.21.15.49:0/1197782570 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:43.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73dd79c700 1 -- 172.21.15.49:0/1197782570 >> v2:172.21.15.49:3300/0 conn(0x7f73d80cafb0 msgr2=0x7f73d80cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:43.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73dd79c700 1 --2- 172.21.15.49:0/1197782570 >> v2:172.21.15.49:3300/0 conn(0x7f73d80cafb0 0x7f73d80cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73dd79c700 1 -- 172.21.15.49:0/1197782570 >> v1:172.21.15.150:6789/0 conn(0x7f73d8071c70 legacy=0x7f73d80b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73dd79c700 1 -- 172.21.15.49:0/1197782570 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d80cab20 con 0x7f73d806d380 2023-07-21T22:11:43.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73ddf9d700 1 --2- 172.21.15.49:0/1197782570 >> v2:172.21.15.49:3300/0 conn(0x7f73d80cafb0 0x7f73d80cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:43.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73dd79c700 1 --2- 172.21.15.49:0/1197782570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73d806d380 0x7f73d806d750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009d90 tx=0x7f73d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e684ef88a904dc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73cffff700 1 -- 172.21.15.49:0/1197782570 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d400e070 con 0x7f73d806d380 2023-07-21T22:11:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73cffff700 1 -- 172.21.15.49:0/1197782570 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d400bb20 con 0x7f73d806d380 2023-07-21T22:11:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73cffff700 1 -- 172.21.15.49:0/1197782570 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d4012430 con 0x7f73d806d380 2023-07-21T22:11:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73de79e700 1 -- 172.21.15.49:0/1197782570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73d806d380 msgr2=0x7f73d806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73de79e700 1 --2- 172.21.15.49:0/1197782570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73d806d380 0x7f73d806d750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009d90 tx=0x7f73d400b330 comp rx=0 tx=0).stop 2023-07-21T22:11:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73de79e700 1 -- 172.21.15.49:0/1197782570 shutdown_connections 2023-07-21T22:11:43.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73de79e700 1 --2- 172.21.15.49:0/1197782570 >> v2:172.21.15.49:3300/0 conn(0x7f73d80cafb0 0x7f73d80cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73de79e700 1 --2- 172.21.15.49:0/1197782570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73d806d380 0x7f73d806d750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73de79e700 1 -- 172.21.15.49:0/1197782570 >> 172.21.15.49:0/1197782570 conn(0x7f73d8070450 msgr2=0x7f73d8070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:43.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73de79e700 1 -- 172.21.15.49:0/1197782570 shutdown_connections 2023-07-21T22:11:43.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.080+0000 7f73de79e700 1 -- 172.21.15.49:0/1197782570 wait complete. 2023-07-21T22:11:43.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.084+0000 7f73de79e700 1 Processor -- start 2023-07-21T22:11:43.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.084+0000 7f73de79e700 1 -- start start 2023-07-21T22:11:43.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73de79e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73d806d380 0x7f73d80c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73de79e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d8071c70 0x7f73d80a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73de79e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73d80cafb0 0x7f73d814e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73de79e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80a8c90 con 0x7f73d8071c70 2023-07-21T22:11:43.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73de79e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80a8430 con 0x7f73d80cafb0 2023-07-21T22:11:43.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73de79e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80a86d0 con 0x7f73d806d380 2023-07-21T22:11:43.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73dcf9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d8071c70 0x7f73d80a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73dcf9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d8071c70 0x7f73d80a7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49734/0 (socket says 172.21.15.49:49734) 2023-07-21T22:11:43.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73dcf9b700 1 -- 172.21.15.49:0/838302695 learned_addr learned my addr 172.21.15.49:0/838302695 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:43.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73dd79c700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73d806d380 0x7f73d80c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73ddf9d700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73d80cafb0 0x7f73d814e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73dcf9b700 1 -- 172.21.15.49:0/838302695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73d806d380 msgr2=0x7f73d80c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73dcf9b700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73d806d380 0x7f73d80c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73dcf9b700 1 -- 172.21.15.49:0/838302695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73d80cafb0 msgr2=0x7f73d814e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73dcf9b700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73d80cafb0 0x7f73d814e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73dcf9b700 1 -- 172.21.15.49:0/838302695 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d00094b0 con 0x7f73d8071c70 2023-07-21T22:11:43.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73ddf9d700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73d80cafb0 0x7f73d814e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:43.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73dd79c700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73d806d380 0x7f73d80c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:43.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73dcf9b700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d8071c70 0x7f73d80a7ef0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f73c800c700 tx=0x7f73c800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:43.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73cdffb700 1 -- 172.21.15.49:0/838302695 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8005d90 con 0x7f73d8071c70 2023-07-21T22:11:43.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73de79e700 1 -- 172.21.15.49:0/838302695 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d4009a70 con 0x7f73d8071c70 2023-07-21T22:11:43.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73cdffb700 1 -- 172.21.15.49:0/838302695 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c80070d0 con 0x7f73d8071c70 2023-07-21T22:11:43.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73cdffb700 1 -- 172.21.15.49:0/838302695 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8007440 con 0x7f73d8071c70 2023-07-21T22:11:43.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.088+0000 7f73de79e700 1 -- 172.21.15.49:0/838302695 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d80c3190 con 0x7f73d8071c70 2023-07-21T22:11:43.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.092+0000 7f73cdffb700 1 -- 172.21.15.49:0/838302695 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f73c80075a0 con 0x7f73d8071c70 2023-07-21T22:11:43.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.092+0000 7f73de79e700 1 -- 172.21.15.49:0/838302695 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d804dcb0 con 0x7f73d8071c70 2023-07-21T22:11:43.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.092+0000 7f73cdffb700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f73bc0662f0 0x7f73bc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.092+0000 7f73cdffb700 1 -- 172.21.15.49:0/838302695 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f73c80834d0 con 0x7f73d8071c70 2023-07-21T22:11:43.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.092+0000 7f73dd79c700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f73bc0662f0 0x7f73bc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.096+0000 7f73dd79c700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f73bc0662f0 0x7f73bc0687a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f73d4014040 tx=0x7f73d4011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:43.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.100+0000 7f73cdffb700 1 -- 172.21.15.49:0/838302695 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73c80506e0 con 0x7f73d8071c70 2023-07-21T22:11:43.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.272+0000 7f73de79e700 1 -- 172.21.15.49:0/838302695 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73d80c4b10 con 0x7f73d8071c70 2023-07-21T22:11:43.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.276+0000 7f73cdffb700 1 -- 172.21.15.49:0/838302695 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7f73c8053d00 con 0x7f73d8071c70 2023-07-21T22:11:43.323 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:43.323 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.284+0000 7f73de79e700 1 -- 172.21.15.49:0/838302695 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f73bc0662f0 msgr2=0x7f73bc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.284+0000 7f73de79e700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f73bc0662f0 0x7f73bc0687a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f73d4014040 tx=0x7f73d4011000 comp rx=0 tx=0).stop 2023-07-21T22:11:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.284+0000 7f73de79e700 1 -- 172.21.15.49:0/838302695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d8071c70 msgr2=0x7f73d80a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.284+0000 7f73de79e700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d8071c70 0x7f73d80a7ef0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f73c800c700 tx=0x7f73c800cac0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.284+0000 7f73de79e700 1 -- 172.21.15.49:0/838302695 shutdown_connections 2023-07-21T22:11:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.284+0000 7f73de79e700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f73bc0662f0 0x7f73bc0687a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.284+0000 7f73de79e700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d8071c70 0x7f73d80a7ef0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.284+0000 7f73de79e700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73d80cafb0 0x7f73d814e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.284+0000 7f73de79e700 1 --2- 172.21.15.49:0/838302695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73d806d380 0x7f73d80c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.284+0000 7f73de79e700 1 -- 172.21.15.49:0/838302695 >> 172.21.15.49:0/838302695 conn(0x7f73d8070450 msgr2=0x7f73d8070820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:43.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.284+0000 7f73de79e700 1 -- 172.21.15.49:0/838302695 shutdown_connections 2023-07-21T22:11:43.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.284+0000 7f73de79e700 1 -- 172.21.15.49:0/838302695 wait complete. 2023-07-21T22:11:43.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:11:43.352 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:11:43.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.492+0000 7f27f6541700 1 Processor -- start 2023-07-21T22:11:43.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.492+0000 7f27f6541700 1 -- start start 2023-07-21T22:11:43.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.492+0000 7f27f6541700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f27f0071220 0x7f27f00cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.492+0000 7f27f6541700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27f0071670 0x7f27f00cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.492+0000 7f27f6541700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f00cdf00 con 0x7f27f0160110 2023-07-21T22:11:43.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.492+0000 7f27f6541700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f00cd730 con 0x7f27f0071220 2023-07-21T22:11:43.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27f6541700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00ce600 con 0x7f27f0071670 2023-07-21T22:11:43.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27effff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f27f0160110 0x7f27f00cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44396/0 (socket says 172.21.15.49:44396) 2023-07-21T22:11:43.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27effff700 1 -- 172.21.15.49:0/428742552 learned_addr learned my addr 172.21.15.49:0/428742552 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:43.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27ef7fe700 1 --2- 172.21.15.49:0/428742552 >> v2:172.21.15.49:3300/0 conn(0x7f27f0071220 0x7f27f00cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27f4ade700 1 --2- 172.21.15.49:0/428742552 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27f0071670 0x7f27f00cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27eeffd700 1 -- 172.21.15.49:0/428742552 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88547419 0 0) 0x7f27f00cdf00 con 0x7f27f0160110 2023-07-21T22:11:43.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27eeffd700 1 -- 172.21.15.49:0/428742552 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d80035d0 con 0x7f27f0160110 2023-07-21T22:11:43.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27ef7fe700 1 -- 172.21.15.49:0/428742552 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27f0071670 msgr2=0x7f27f00cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:43.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27ef7fe700 1 --2- 172.21.15.49:0/428742552 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27f0071670 0x7f27f00cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27ef7fe700 1 -- 172.21.15.49:0/428742552 >> v1:172.21.15.49:6789/0 conn(0x7f27f0160110 legacy=0x7f27f00cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27eeffd700 1 -- 172.21.15.49:0/428742552 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 502079395 0 0) 0x7f27d80035d0 con 0x7f27f0160110 2023-07-21T22:11:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27ef7fe700 1 -- 172.21.15.49:0/428742552 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f006e190 con 0x7f27f0071220 2023-07-21T22:11:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27ef7fe700 1 --2- 172.21.15.49:0/428742552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f0071220 0x7f27f00cabe0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009840 tx=0x7f27e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cf03b1a4bef9d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27eeffd700 1 -- 172.21.15.49:0/428742552 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0001670 con 0x7f27f0071220 2023-07-21T22:11:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27eeffd700 1 -- 172.21.15.49:0/428742552 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e4004030 con 0x7f27f0071220 2023-07-21T22:11:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27eeffd700 1 -- 172.21.15.49:0/428742552 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e40043c0 con 0x7f27f0071220 2023-07-21T22:11:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27f6541700 1 -- 172.21.15.49:0/428742552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f0071220 msgr2=0x7f27f00cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27f6541700 1 --2- 172.21.15.49:0/428742552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f0071220 0x7f27f00cabe0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009840 tx=0x7f27e4009b50 comp rx=0 tx=0).stop 2023-07-21T22:11:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27f6541700 1 -- 172.21.15.49:0/428742552 shutdown_connections 2023-07-21T22:11:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27f6541700 1 --2- 172.21.15.49:0/428742552 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27f0071670 0x7f27f00cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27f6541700 1 --2- 172.21.15.49:0/428742552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f0071220 0x7f27f00cabe0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27f6541700 1 -- 172.21.15.49:0/428742552 >> 172.21.15.49:0/428742552 conn(0x7f27f006e960 msgr2=0x7f27f006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27f6541700 1 -- 172.21.15.49:0/428742552 shutdown_connections 2023-07-21T22:11:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.496+0000 7f27f6541700 1 -- 172.21.15.49:0/428742552 wait complete. 2023-07-21T22:11:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.500+0000 7f27f6541700 1 Processor -- start 2023-07-21T22:11:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.500+0000 7f27f6541700 1 -- start start 2023-07-21T22:11:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.500+0000 7f27f6541700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f0071220 0x7f27f015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.500+0000 7f27f6541700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27f0071670 0x7f27f00ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.500+0000 7f27f6541700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27f0160110 0x7f27f00cd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.500+0000 7f27f6541700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f01f9900 con 0x7f27f0071220 2023-07-21T22:11:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.500+0000 7f27f6541700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f01f8d10 con 0x7f27f0071670 2023-07-21T22:11:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.500+0000 7f27f6541700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f01f8f60 con 0x7f27f0160110 2023-07-21T22:11:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.500+0000 7f27effff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f0071220 0x7f27f015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.500+0000 7f27effff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f0071220 0x7f27f015cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49762/0 (socket says 172.21.15.49:49762) 2023-07-21T22:11:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.500+0000 7f27effff700 1 -- 172.21.15.49:0/3359107407 learned_addr learned my addr 172.21.15.49:0/3359107407 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27f4ade700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27f0160110 0x7f27f00cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27effff700 1 -- 172.21.15.49:0/3359107407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27f0160110 msgr2=0x7f27f00cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27ef7fe700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27f0071670 0x7f27f00ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27effff700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27f0160110 0x7f27f00cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27effff700 1 -- 172.21.15.49:0/3359107407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27f0071670 msgr2=0x7f27f00ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27effff700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27f0071670 0x7f27f00ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27effff700 1 -- 172.21.15.49:0/3359107407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e4009450 con 0x7f27f0071220 2023-07-21T22:11:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27f4ade700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27f0160110 0x7f27f00cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27ef7fe700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27f0071670 0x7f27f00ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27effff700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f0071220 0x7f27f015cd30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c520 tx=0x7f27e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27ecff9700 1 -- 172.21.15.49:0/3359107407 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0004ca0 con 0x7f27f0071220 2023-07-21T22:11:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27ecff9700 1 -- 172.21.15.49:0/3359107407 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e0004e20 con 0x7f27f0071220 2023-07-21T22:11:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27ecff9700 1 -- 172.21.15.49:0/3359107407 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0007310 con 0x7f27f0071220 2023-07-21T22:11:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27f6541700 1 -- 172.21.15.49:0/3359107407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f01f9240 con 0x7f27f0071220 2023-07-21T22:11:43.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27f6541700 1 -- 172.21.15.49:0/3359107407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f015d270 con 0x7f27f0071220 2023-07-21T22:11:43.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.504+0000 7f27f6541700 1 -- 172.21.15.49:0/3359107407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f004dd50 con 0x7f27f0071220 2023-07-21T22:11:43.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.508+0000 7f27ecff9700 1 -- 172.21.15.49:0/3359107407 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27e0007470 con 0x7f27f0071220 2023-07-21T22:11:43.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.508+0000 7f27ecff9700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f27dc0662f0 0x7f27dc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.508+0000 7f27ecff9700 1 -- 172.21.15.49:0/3359107407 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f27e0083dd0 con 0x7f27f0071220 2023-07-21T22:11:43.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.508+0000 7f27ef7fe700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f27dc0662f0 0x7f27dc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.508+0000 7f27ef7fe700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f27dc0662f0 0x7f27dc0687a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f27f00c7a10 tx=0x7f27e4013040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:43.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.516+0000 7f27ecff9700 1 -- 172.21.15.49:0/3359107407 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27e0050f10 con 0x7f27f0071220 2023-07-21T22:11:43.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.692+0000 7f27f6541700 1 -- 172.21.15.49:0/3359107407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27f0071000 con 0x7f27f0071220 2023-07-21T22:11:43.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.692+0000 7f27ecff9700 1 -- 172.21.15.49:0/3359107407 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27e0007720 con 0x7f27f0071220 2023-07-21T22:11:43.737 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:11:43.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.696+0000 7f27f6541700 1 -- 172.21.15.49:0/3359107407 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f27dc0662f0 msgr2=0x7f27dc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.696+0000 7f27f6541700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f27dc0662f0 0x7f27dc0687a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f27f00c7a10 tx=0x7f27e4013040 comp rx=0 tx=0).stop 2023-07-21T22:11:43.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.696+0000 7f27f6541700 1 -- 172.21.15.49:0/3359107407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f0071220 msgr2=0x7f27f015cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.696+0000 7f27f6541700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f0071220 0x7f27f015cd30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c520 tx=0x7f27e000c8e0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.696+0000 7f27f6541700 1 -- 172.21.15.49:0/3359107407 shutdown_connections 2023-07-21T22:11:43.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.696+0000 7f27f6541700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f27dc0662f0 0x7f27dc0687a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.696+0000 7f27f6541700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27f0160110 0x7f27f00cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.696+0000 7f27f6541700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27f0071670 0x7f27f00ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.696+0000 7f27f6541700 1 --2- 172.21.15.49:0/3359107407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f0071220 0x7f27f015cd30 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.696+0000 7f27f6541700 1 -- 172.21.15.49:0/3359107407 >> 172.21.15.49:0/3359107407 conn(0x7f27f006e960 msgr2=0x7f27f00cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:43.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.696+0000 7f27f6541700 1 -- 172.21.15.49:0/3359107407 shutdown_connections 2023-07-21T22:11:43.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.696+0000 7f27f6541700 1 -- 172.21.15.49:0/3359107407 wait complete. 2023-07-21T22:11:43.761 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:11:43.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.900+0000 7f25f5965700 1 Processor -- start 2023-07-21T22:11:43.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.900+0000 7f25f5965700 1 -- start start 2023-07-21T22:11:43.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.900+0000 7f25f5965700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f25f015e380 0x7f25f00cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.900+0000 7f25f5965700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00c9cd0 0x7f25f00cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.900+0000 7f25f5965700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f00ca190 con 0x7f25f00b3a50 2023-07-21T22:11:43.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.900+0000 7f25f5965700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f0159fd0 con 0x7f25f015e380 2023-07-21T22:11:43.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.900+0000 7f25f5965700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f015d6e0 con 0x7f25f00c9cd0 2023-07-21T22:11:43.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.900+0000 7f25eeffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f25f015e380 0x7f25f00cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25eeffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f25f015e380 0x7f25f00cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49774/0 (socket says 172.21.15.49:49774) 2023-07-21T22:11:43.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25eeffd700 1 -- 172.21.15.49:0/2722672333 learned_addr learned my addr 172.21.15.49:0/2722672333 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:43.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25ef7fe700 1 --2- 172.21.15.49:0/2722672333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00c9cd0 0x7f25f00cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25eeffd700 1 -- 172.21.15.49:0/2722672333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00c9cd0 msgr2=0x7f25f00cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:43.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25eeffd700 1 --2- 172.21.15.49:0/2722672333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00c9cd0 0x7f25f00cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25eeffd700 1 -- 172.21.15.49:0/2722672333 >> v1:172.21.15.150:6789/0 conn(0x7f25f00b3a50 legacy=0x7f25f00c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25eeffd700 1 -- 172.21.15.49:0/2722672333 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f00ca900 con 0x7f25f015e380 2023-07-21T22:11:43.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25eeffd700 1 --2- 172.21.15.49:0/2722672333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f015e380 0x7f25f00cabe0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009910 tx=0x7f25e0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363317a7cfe08975 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:43.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25edffb700 1 -- 172.21.15.49:0/2722672333 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e000ba60 con 0x7f25f015e380 2023-07-21T22:11:43.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25edffb700 1 -- 172.21.15.49:0/2722672333 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e000bbc0 con 0x7f25f015e380 2023-07-21T22:11:43.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25edffb700 1 -- 172.21.15.49:0/2722672333 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0009e60 con 0x7f25f015e380 2023-07-21T22:11:43.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25f5965700 1 -- 172.21.15.49:0/2722672333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f015e380 msgr2=0x7f25f00cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25f5965700 1 --2- 172.21.15.49:0/2722672333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f015e380 0x7f25f00cabe0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009910 tx=0x7f25e0009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:43.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25f5965700 1 -- 172.21.15.49:0/2722672333 shutdown_connections 2023-07-21T22:11:43.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25f5965700 1 --2- 172.21.15.49:0/2722672333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00c9cd0 0x7f25f00cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25f5965700 1 --2- 172.21.15.49:0/2722672333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f015e380 0x7f25f00cabe0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25f5965700 1 -- 172.21.15.49:0/2722672333 >> 172.21.15.49:0/2722672333 conn(0x7f25f006e960 msgr2=0x7f25f006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:43.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25f5965700 1 -- 172.21.15.49:0/2722672333 shutdown_connections 2023-07-21T22:11:43.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.904+0000 7f25f5965700 1 -- 172.21.15.49:0/2722672333 wait complete. 2023-07-21T22:11:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.908+0000 7f25f5965700 1 Processor -- start 2023-07-21T22:11:43.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.908+0000 7f25f5965700 1 -- start start 2023-07-21T22:11:43.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25f5965700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f00b3a50 0x7f25f0151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25f5965700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00c9cd0 0x7f25f01589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25f5965700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25f015e380 0x7f25f0158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25f5965700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f00cdaa0 con 0x7f25f00b3a50 2023-07-21T22:11:43.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25f5965700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f00cc890 con 0x7f25f015e380 2023-07-21T22:11:43.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25f5965700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f015ce20 con 0x7f25f00c9cd0 2023-07-21T22:11:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25eeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f00b3a50 0x7f25f0151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25eeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f00b3a50 0x7f25f0151830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49784/0 (socket says 172.21.15.49:49784) 2023-07-21T22:11:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25eeffd700 1 -- 172.21.15.49:0/1925771325 learned_addr learned my addr 172.21.15.49:0/1925771325 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25ef7fe700 1 --2- 172.21.15.49:0/1925771325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25f015e380 0x7f25f0158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25ee7fc700 1 --2- 172.21.15.49:0/1925771325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00c9cd0 0x7f25f01589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25eeffd700 1 -- 172.21.15.49:0/1925771325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00c9cd0 msgr2=0x7f25f01589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25eeffd700 1 --2- 172.21.15.49:0/1925771325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00c9cd0 0x7f25f01589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25eeffd700 1 -- 172.21.15.49:0/1925771325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25f015e380 msgr2=0x7f25f0158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25eeffd700 1 --2- 172.21.15.49:0/1925771325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25f015e380 0x7f25f0158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25eeffd700 1 -- 172.21.15.49:0/1925771325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e0009570 con 0x7f25f00b3a50 2023-07-21T22:11:43.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25eeffd700 1 --2- 172.21.15.49:0/1925771325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f00b3a50 0x7f25f0151830 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f25f00cf2d0 tx=0x7f25e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:43.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25d7fff700 1 -- 172.21.15.49:0/1925771325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0004510 con 0x7f25f00b3a50 2023-07-21T22:11:43.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25f5965700 1 -- 172.21.15.49:0/1925771325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f00cbf60 con 0x7f25f00b3a50 2023-07-21T22:11:43.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25d7fff700 1 -- 172.21.15.49:0/1925771325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e001f070 con 0x7f25f00b3a50 2023-07-21T22:11:43.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25d7fff700 1 -- 172.21.15.49:0/1925771325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0003900 con 0x7f25f00b3a50 2023-07-21T22:11:43.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.912+0000 7f25f5965700 1 -- 172.21.15.49:0/1925771325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f00cc520 con 0x7f25f00b3a50 2023-07-21T22:11:43.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.916+0000 7f25f5965700 1 -- 172.21.15.49:0/1925771325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f00b3840 con 0x7f25f00b3a50 2023-07-21T22:11:43.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.916+0000 7f25d7fff700 1 -- 172.21.15.49:0/1925771325 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f25e0003a60 con 0x7f25f00b3a50 2023-07-21T22:11:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.920+0000 7f25d7fff700 1 --2- 172.21.15.49:0/1925771325 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f25dc0662f0 0x7f25dc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.920+0000 7f25d7fff700 1 -- 172.21.15.49:0/1925771325 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f25e0021070 con 0x7f25f00b3a50 2023-07-21T22:11:43.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.920+0000 7f25ee7fc700 1 --2- 172.21.15.49:0/1925771325 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f25dc0662f0 0x7f25dc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:43.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.920+0000 7f25ee7fc700 1 --2- 172.21.15.49:0/1925771325 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f25dc0662f0 0x7f25dc0687a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f25f00afb80 tx=0x7f25e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:43.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:43.924+0000 7f25d7fff700 1 -- 172.21.15.49:0/1925771325 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f25e0052920 con 0x7f25f00b3a50 2023-07-21T22:11:44.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.100+0000 7f25f5965700 1 -- 172.21.15.49:0/1925771325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f25f0071850 con 0x7f25f00b3a50 2023-07-21T22:11:44.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.100+0000 7f25d7fff700 1 -- 172.21.15.49:0/1925771325 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f25e0074020 con 0x7f25f00b3a50 2023-07-21T22:11:44.144 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:11:44.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.104+0000 7f25f5965700 1 -- 172.21.15.49:0/1925771325 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f25dc0662f0 msgr2=0x7f25dc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.104+0000 7f25f5965700 1 --2- 172.21.15.49:0/1925771325 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f25dc0662f0 0x7f25dc0687a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f25f00afb80 tx=0x7f25e4009040 comp rx=0 tx=0).stop 2023-07-21T22:11:44.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.104+0000 7f25f5965700 1 -- 172.21.15.49:0/1925771325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f00b3a50 msgr2=0x7f25f0151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.104+0000 7f25f5965700 1 --2- 172.21.15.49:0/1925771325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f00b3a50 0x7f25f0151830 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f25f00cf2d0 tx=0x7f25e0004770 comp rx=0 tx=0).stop 2023-07-21T22:11:44.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.104+0000 7f25f5965700 1 -- 172.21.15.49:0/1925771325 shutdown_connections 2023-07-21T22:11:44.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.104+0000 7f25f5965700 1 --2- 172.21.15.49:0/1925771325 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f25dc0662f0 0x7f25dc0687a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.104+0000 7f25f5965700 1 --2- 172.21.15.49:0/1925771325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25f015e380 0x7f25f0158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.104+0000 7f25f5965700 1 --2- 172.21.15.49:0/1925771325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00c9cd0 0x7f25f01589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.104+0000 7f25f5965700 1 --2- 172.21.15.49:0/1925771325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f00b3a50 0x7f25f0151830 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.104+0000 7f25f5965700 1 -- 172.21.15.49:0/1925771325 >> 172.21.15.49:0/1925771325 conn(0x7f25f006e960 msgr2=0x7f25f006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:44.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.104+0000 7f25f5965700 1 -- 172.21.15.49:0/1925771325 shutdown_connections 2023-07-21T22:11:44.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.104+0000 7f25f5965700 1 -- 172.21.15.49:0/1925771325 wait complete. 2023-07-21T22:11:44.172 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:11:44.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.316+0000 7f29ba836700 1 Processor -- start 2023-07-21T22:11:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.316+0000 7f29ba836700 1 -- start start 2023-07-21T22:11:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.316+0000 7f29ba836700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f29b40c9b80 0x7f29b40ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.316+0000 7f29ba836700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b40b09f0 con 0x7f29b40698a0 2023-07-21T22:11:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.316+0000 7f29ba836700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b415fa90 con 0x7f29b40aca90 2023-07-21T22:11:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.316+0000 7f29ba836700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b4160710 con 0x7f29b40c9b80 2023-07-21T22:11:44.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.316+0000 7f29b9834700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f29b40c9b80 0x7f29b40ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:44.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.316+0000 7f29b9033700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f29b40698a0 0x7f29b40afbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44410/0 (socket says 172.21.15.49:44410) 2023-07-21T22:11:44.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.316+0000 7f29b9033700 1 -- 172.21.15.49:0/2104469635 learned_addr learned my addr 172.21.15.49:0/2104469635 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:44.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.320+0000 7f29b9834700 1 -- 172.21.15.49:0/2104469635 >> v1:172.21.15.150:6789/0 conn(0x7f29b40aca90 legacy=0x7f29b40b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.320+0000 7f29b9834700 1 -- 172.21.15.49:0/2104469635 >> v1:172.21.15.49:6789/0 conn(0x7f29b40698a0 legacy=0x7f29b40afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.320+0000 7f29b9834700 1 -- 172.21.15.49:0/2104469635 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b415fd70 con 0x7f29b40c9b80 2023-07-21T22:11:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.320+0000 7f29b9834700 1 --2- 172.21.15.49:0/2104469635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b40c9b80 0x7f29b40ad3e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009850 tx=0x7f29b0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625705b275136891 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.320+0000 7f29b8832700 1 -- 172.21.15.49:0/2104469635 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b0011830 con 0x7f29b40c9b80 2023-07-21T22:11:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.320+0000 7f29b8832700 1 -- 172.21.15.49:0/2104469635 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b0011990 con 0x7f29b40c9b80 2023-07-21T22:11:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.320+0000 7f29b8832700 1 -- 172.21.15.49:0/2104469635 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b0011d20 con 0x7f29b40c9b80 2023-07-21T22:11:44.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.320+0000 7f29ba836700 1 -- 172.21.15.49:0/2104469635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b40c9b80 msgr2=0x7f29b40ad3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.320+0000 7f29ba836700 1 --2- 172.21.15.49:0/2104469635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b40c9b80 0x7f29b40ad3e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009850 tx=0x7f29b0009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:44.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.320+0000 7f29ba836700 1 -- 172.21.15.49:0/2104469635 shutdown_connections 2023-07-21T22:11:44.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.320+0000 7f29ba836700 1 --2- 172.21.15.49:0/2104469635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b40c9b80 0x7f29b40ad3e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.320+0000 7f29ba836700 1 -- 172.21.15.49:0/2104469635 >> 172.21.15.49:0/2104469635 conn(0x7f29b40ce0d0 msgr2=0x7f29b40ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:44.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.320+0000 7f29ba836700 1 -- 172.21.15.49:0/2104469635 shutdown_connections 2023-07-21T22:11:44.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.320+0000 7f29ba836700 1 -- 172.21.15.49:0/2104469635 wait complete. 2023-07-21T22:11:44.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.324+0000 7f29ba836700 1 Processor -- start 2023-07-21T22:11:44.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.324+0000 7f29ba836700 1 -- start start 2023-07-21T22:11:44.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.324+0000 7f29ba836700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b40698a0 0x7f29b40af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:44.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.324+0000 7f29ba836700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b40aca90 0x7f29b41524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:44.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.324+0000 7f29ba836700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b40c9b80 0x7f29b4152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:44.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.324+0000 7f29ba836700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40b3bd0 con 0x7f29b40aca90 2023-07-21T22:11:44.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.324+0000 7f29ba836700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40b2d20 con 0x7f29b40c9b80 2023-07-21T22:11:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.324+0000 7f29ba836700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40b32a0 con 0x7f29b40698a0 2023-07-21T22:11:44.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.324+0000 7f29b9033700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b40aca90 0x7f29b41524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:44.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29b9033700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b40aca90 0x7f29b41524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49814/0 (socket says 172.21.15.49:49814) 2023-07-21T22:11:44.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29b9033700 1 -- 172.21.15.49:0/4139007248 learned_addr learned my addr 172.21.15.49:0/4139007248 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:44.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29b9834700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b40698a0 0x7f29b40af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:44.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29ba035700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b40c9b80 0x7f29b4152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:44.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29b9033700 1 -- 172.21.15.49:0/4139007248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b40698a0 msgr2=0x7f29b40af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29b9033700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b40698a0 0x7f29b40af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29b9033700 1 -- 172.21.15.49:0/4139007248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b40c9b80 msgr2=0x7f29b4152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29b9033700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b40c9b80 0x7f29b4152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29b9033700 1 -- 172.21.15.49:0/4139007248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00094b0 con 0x7f29b40aca90 2023-07-21T22:11:44.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29ba035700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b40c9b80 0x7f29b4152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:44.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29b9033700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b40aca90 0x7f29b41524d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f29a4001eb0 tx=0x7f29a400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:44.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4139007248 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a4005d90 con 0x7f29b40aca90 2023-07-21T22:11:44.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4139007248 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a40070d0 con 0x7f29b40aca90 2023-07-21T22:11:44.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29ba836700 1 -- 172.21.15.49:0/4139007248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b40b3580 con 0x7f29b40aca90 2023-07-21T22:11:44.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4139007248 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a4007440 con 0x7f29b40aca90 2023-07-21T22:11:44.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29ba836700 1 -- 172.21.15.49:0/4139007248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b40af900 con 0x7f29b40aca90 2023-07-21T22:11:44.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.328+0000 7f29ba836700 1 -- 172.21.15.49:0/4139007248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b40b3d80 con 0x7f29b40aca90 2023-07-21T22:11:44.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.332+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4139007248 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f29a40075a0 con 0x7f29b40aca90 2023-07-21T22:11:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.332+0000 7f29aa7fc700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29980662f0 0x7f29980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.332+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4139007248 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f29a40833e0 con 0x7f29b40aca90 2023-07-21T22:11:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.332+0000 7f29b9834700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29980662f0 0x7f29980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:44.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.332+0000 7f29b9834700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29980662f0 0x7f29980687a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009fd0 tx=0x7f29b0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:44.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.340+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4139007248 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29b40b3d80 con 0x7f29b40aca90 2023-07-21T22:11:44.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.516+0000 7f29ba836700 1 -- 172.21.15.49:0/4139007248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29b40afac0 con 0x7f29b40aca90 2023-07-21T22:11:44.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.516+0000 7f29aa7fc700 1 -- 172.21.15.49:0/4139007248 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29a40504b0 con 0x7f29b40aca90 2023-07-21T22:11:44.560 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:44.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.516+0000 7f29ba836700 1 -- 172.21.15.49:0/4139007248 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29980662f0 msgr2=0x7f29980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.516+0000 7f29ba836700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29980662f0 0x7f29980687a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009fd0 tx=0x7f29b0008030 comp rx=0 tx=0).stop 2023-07-21T22:11:44.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.516+0000 7f29ba836700 1 -- 172.21.15.49:0/4139007248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b40aca90 msgr2=0x7f29b41524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.516+0000 7f29ba836700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b40aca90 0x7f29b41524d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f29a4001eb0 tx=0x7f29a400c7b0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.516+0000 7f29ba836700 1 -- 172.21.15.49:0/4139007248 shutdown_connections 2023-07-21T22:11:44.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.516+0000 7f29ba836700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29980662f0 0x7f29980687a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.516+0000 7f29ba836700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b40aca90 0x7f29b41524d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.516+0000 7f29ba836700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b40c9b80 0x7f29b4152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.516+0000 7f29ba836700 1 --2- 172.21.15.49:0/4139007248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b40698a0 0x7f29b40af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.520+0000 7f29ba836700 1 -- 172.21.15.49:0/4139007248 >> 172.21.15.49:0/4139007248 conn(0x7f29b40ce0d0 msgr2=0x7f29b4069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:44.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.520+0000 7f29ba836700 1 -- 172.21.15.49:0/4139007248 shutdown_connections 2023-07-21T22:11:44.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.520+0000 7f29ba836700 1 -- 172.21.15.49:0/4139007248 wait complete. 2023-07-21T22:11:44.581 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:11:44.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.720+0000 7f065e1bf700 1 Processor -- start 2023-07-21T22:11:44.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.720+0000 7f065e1bf700 1 -- start start 2023-07-21T22:11:44.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.720+0000 7f065e1bf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f06580b4040 0x7f06580cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:44.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.720+0000 7f065e1bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580b4410 0x7f06580b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:44.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.720+0000 7f065e1bf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06580b8170 con 0x7f065815f960 2023-07-21T22:11:44.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.720+0000 7f065e1bf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06580cfa20 con 0x7f06580b4040 2023-07-21T22:11:44.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.720+0000 7f065e1bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06580d03c0 con 0x7f06580b4410 2023-07-21T22:11:44.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.720+0000 7f064ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580b4410 0x7f06580b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:44.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.720+0000 7f06577fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f06580b4040 0x7f06580cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:44.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.720+0000 7f0657fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f065815f960 0x7f065815fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:49304/0 (socket says 172.21.15.49:49304) 2023-07-21T22:11:44.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.720+0000 7f0657fff700 1 -- 172.21.15.49:0/581672476 learned_addr learned my addr 172.21.15.49:0/581672476 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:44.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f06577fe700 1 -- 172.21.15.49:0/581672476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580b4410 msgr2=0x7f06580b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:44.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f06577fe700 1 --2- 172.21.15.49:0/581672476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580b4410 0x7f06580b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f06577fe700 1 -- 172.21.15.49:0/581672476 >> v1:172.21.15.150:6789/0 conn(0x7f065815f960 legacy=0x7f065815fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f06577fe700 1 -- 172.21.15.49:0/581672476 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06580d2350 con 0x7f06580b4040 2023-07-21T22:11:44.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f064ffff700 1 --2- 172.21.15.49:0/581672476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580b4410 0x7f06580b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:44.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f0656ffd700 1 -- 172.21.15.49:0/581672476 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478833906 0 0) 0x7f06580b8170 con 0x7f065815f960 2023-07-21T22:11:44.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f06577fe700 1 --2- 172.21.15.49:0/581672476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580b4040 0x7f06580cf320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0648009850 tx=0x7f0648009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d384920dfb2bed1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:44.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f0656ffd700 1 -- 172.21.15.49:0/581672476 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648011830 con 0x7f06580b4040 2023-07-21T22:11:44.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f0656ffd700 1 -- 172.21.15.49:0/581672476 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0648011990 con 0x7f06580b4040 2023-07-21T22:11:44.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f0656ffd700 1 -- 172.21.15.49:0/581672476 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648011d40 con 0x7f06580b4040 2023-07-21T22:11:44.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f065e1bf700 1 -- 172.21.15.49:0/581672476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580b4040 msgr2=0x7f06580cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f065e1bf700 1 --2- 172.21.15.49:0/581672476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580b4040 0x7f06580cf320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0648009850 tx=0x7f0648009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:44.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f065e1bf700 1 -- 172.21.15.49:0/581672476 shutdown_connections 2023-07-21T22:11:44.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f065e1bf700 1 --2- 172.21.15.49:0/581672476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580b4410 0x7f06580b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f065e1bf700 1 --2- 172.21.15.49:0/581672476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580b4040 0x7f06580cf320 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f065e1bf700 1 -- 172.21.15.49:0/581672476 >> 172.21.15.49:0/581672476 conn(0x7f06580658e0 msgr2=0x7f065806fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:44.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f065e1bf700 1 -- 172.21.15.49:0/581672476 shutdown_connections 2023-07-21T22:11:44.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.724+0000 7f065e1bf700 1 -- 172.21.15.49:0/581672476 wait complete. 2023-07-21T22:11:44.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.728+0000 7f065e1bf700 1 Processor -- start 2023-07-21T22:11:44.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.728+0000 7f065e1bf700 1 -- start start 2023-07-21T22:11:44.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.728+0000 7f065e1bf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580b4040 0x7f0658148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:44.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.728+0000 7f065e1bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06580b4410 0x7f065814b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:44.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.728+0000 7f065e1bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f065815f960 0x7f06580ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:44.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.728+0000 7f065e1bf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06581499d0 con 0x7f06580b4410 2023-07-21T22:11:44.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.728+0000 7f065e1bf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0658149660 con 0x7f06580b4040 2023-07-21T22:11:44.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.728+0000 7f065e1bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0658149290 con 0x7f065815f960 2023-07-21T22:11:44.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.728+0000 7f064ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06580b4410 0x7f065814b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:44.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.728+0000 7f064ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06580b4410 0x7f065814b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60718/0 (socket says 172.21.15.49:60718) 2023-07-21T22:11:44.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.728+0000 7f064ffff700 1 -- 172.21.15.49:0/2852511536 learned_addr learned my addr 172.21.15.49:0/2852511536 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:44.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.728+0000 7f06577fe700 1 --2- 172.21.15.49:0/2852511536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580b4040 0x7f0658148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:44.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.728+0000 7f0657fff700 1 --2- 172.21.15.49:0/2852511536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f065815f960 0x7f06580ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.732+0000 7f064ffff700 1 -- 172.21.15.49:0/2852511536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f065815f960 msgr2=0x7f06580ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.732+0000 7f064ffff700 1 --2- 172.21.15.49:0/2852511536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f065815f960 0x7f06580ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.732+0000 7f064ffff700 1 -- 172.21.15.49:0/2852511536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580b4040 msgr2=0x7f0658148d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.732+0000 7f064ffff700 1 --2- 172.21.15.49:0/2852511536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580b4040 0x7f0658148d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.732+0000 7f064ffff700 1 -- 172.21.15.49:0/2852511536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06400094b0 con 0x7f06580b4410 2023-07-21T22:11:44.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.732+0000 7f064ffff700 1 --2- 172.21.15.49:0/2852511536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06580b4410 0x7f065814b5f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f064000ec10 tx=0x7f064000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:44.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.732+0000 7f0654ff9700 1 -- 172.21.15.49:0/2852511536 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064000c890 con 0x7f06580b4410 2023-07-21T22:11:44.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.732+0000 7f0654ff9700 1 -- 172.21.15.49:0/2852511536 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064000c9f0 con 0x7f06580b4410 2023-07-21T22:11:44.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.732+0000 7f0654ff9700 1 -- 172.21.15.49:0/2852511536 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064000cd60 con 0x7f06580b4410 2023-07-21T22:11:44.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.732+0000 7f065e1bf700 1 -- 172.21.15.49:0/2852511536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06480094b0 con 0x7f06580b4410 2023-07-21T22:11:44.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.732+0000 7f065e1bf700 1 -- 172.21.15.49:0/2852511536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065814c1f0 con 0x7f06580b4410 2023-07-21T22:11:44.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.732+0000 7f065e1bf700 1 -- 172.21.15.49:0/2852511536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0658149b10 con 0x7f06580b4410 2023-07-21T22:11:44.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.736+0000 7f0654ff9700 1 -- 172.21.15.49:0/2852511536 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0640013470 con 0x7f06580b4410 2023-07-21T22:11:44.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.736+0000 7f0654ff9700 1 --2- 172.21.15.49:0/2852511536 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06380662f0 0x7f06380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:44.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.736+0000 7f0654ff9700 1 -- 172.21.15.49:0/2852511536 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f06400845a0 con 0x7f06580b4410 2023-07-21T22:11:44.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.736+0000 7f06577fe700 1 --2- 172.21.15.49:0/2852511536 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06380662f0 0x7f06380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:44.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.740+0000 7f06577fe700 1 --2- 172.21.15.49:0/2852511536 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06380662f0 0x7f06380687a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f06480090b0 tx=0x7f064801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:44.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.744+0000 7f0654ff9700 1 -- 172.21.15.49:0/2852511536 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0640051670 con 0x7f06580b4410 2023-07-21T22:11:44.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.912+0000 7f065e1bf700 1 -- 172.21.15.49:0/2852511536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f065804dd50 con 0x7f06580b4410 2023-07-21T22:11:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.916+0000 7f0654ff9700 1 -- 172.21.15.49:0/2852511536 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0640054c90 con 0x7f06580b4410 2023-07-21T22:11:44.959 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:11:44.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.916+0000 7f065e1bf700 1 -- 172.21.15.49:0/2852511536 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06380662f0 msgr2=0x7f06380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.916+0000 7f065e1bf700 1 --2- 172.21.15.49:0/2852511536 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06380662f0 0x7f06380687a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f06480090b0 tx=0x7f064801c040 comp rx=0 tx=0).stop 2023-07-21T22:11:44.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.916+0000 7f065e1bf700 1 -- 172.21.15.49:0/2852511536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06580b4410 msgr2=0x7f065814b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:44.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.916+0000 7f065e1bf700 1 --2- 172.21.15.49:0/2852511536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06580b4410 0x7f065814b5f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f064000ec10 tx=0x7f064000ef20 comp rx=0 tx=0).stop 2023-07-21T22:11:44.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.916+0000 7f065e1bf700 1 -- 172.21.15.49:0/2852511536 shutdown_connections 2023-07-21T22:11:44.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.916+0000 7f065e1bf700 1 --2- 172.21.15.49:0/2852511536 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06380662f0 0x7f06380687a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.916+0000 7f065e1bf700 1 --2- 172.21.15.49:0/2852511536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06580b4410 0x7f065814b5f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.916+0000 7f065e1bf700 1 --2- 172.21.15.49:0/2852511536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f065815f960 0x7f06580ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.916+0000 7f065e1bf700 1 --2- 172.21.15.49:0/2852511536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580b4040 0x7f0658148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.916+0000 7f065e1bf700 1 -- 172.21.15.49:0/2852511536 >> 172.21.15.49:0/2852511536 conn(0x7f06580658e0 msgr2=0x7f06580cfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.916+0000 7f065e1bf700 1 -- 172.21.15.49:0/2852511536 shutdown_connections 2023-07-21T22:11:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:44.916+0000 7f065e1bf700 1 -- 172.21.15.49:0/2852511536 wait complete. 2023-07-21T22:11:44.983 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:11:45.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.124+0000 7f9b218dd700 1 Processor -- start 2023-07-21T22:11:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.124+0000 7f9b218dd700 1 -- start start 2023-07-21T22:11:45.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.124+0000 7f9b218dd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b1c0b4040 0x7f9b1c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:45.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b218dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0b4410 0x7f9b1c0b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:45.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b218dd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9b1c15f960 0x7f9b1c15fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:45.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b218dd700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c0cfa20 con 0x7f9b1c15f960 2023-07-21T22:11:45.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b218dd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c0d03c0 con 0x7f9b1c0b4040 2023-07-21T22:11:45.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b218dd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0b8170 con 0x7f9b1c0b4410 2023-07-21T22:11:45.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b1b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9b1c15f960 0x7f9b1c15fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:45.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b1b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9b1c15f960 0x7f9b1c15fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60724/0 (socket says 172.21.15.49:60724) 2023-07-21T22:11:45.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b1b7fe700 1 -- 172.21.15.49:0/502382390 learned_addr learned my addr 172.21.15.49:0/502382390 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:45.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b13fff700 1 --2- 172.21.15.49:0/502382390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0b4410 0x7f9b1c0b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:45.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b1affd700 1 --2- 172.21.15.49:0/502382390 >> v2:172.21.15.150:3300/0 conn(0x7f9b1c0b4040 0x7f9b1c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:45.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b13fff700 1 -- 172.21.15.49:0/502382390 >> v2:172.21.15.150:3300/0 conn(0x7f9b1c0b4040 msgr2=0x7f9b1c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:45.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b13fff700 1 --2- 172.21.15.49:0/502382390 >> v2:172.21.15.150:3300/0 conn(0x7f9b1c0b4040 0x7f9b1c0cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b13fff700 1 -- 172.21.15.49:0/502382390 >> v2:172.21.15.49:3300/0 conn(0x7f9b1c15f960 msgr2=0x7f9b1c15fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:45.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b13fff700 1 --2- 172.21.15.49:0/502382390 >> v2:172.21.15.49:3300/0 conn(0x7f9b1c15f960 0x7f9b1c15fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b13fff700 1 -- 172.21.15.49:0/502382390 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c0d2350 con 0x7f9b1c0b4410 2023-07-21T22:11:45.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b1b7fe700 1 --2- 172.21.15.49:0/502382390 >> v2:172.21.15.49:3300/0 conn(0x7f9b1c15f960 0x7f9b1c15fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:45.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b13fff700 1 --2- 172.21.15.49:0/502382390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0b4410 0x7f9b1c0b4860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c06f0c0 tx=0x7f9b04009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6f18e793dbec897 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:45.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b1a7fc700 1 -- 172.21.15.49:0/502382390 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04011830 con 0x7f9b1c0b4410 2023-07-21T22:11:45.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b1a7fc700 1 -- 172.21.15.49:0/502382390 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b04011990 con 0x7f9b1c0b4410 2023-07-21T22:11:45.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.128+0000 7f9b1a7fc700 1 -- 172.21.15.49:0/502382390 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04011d20 con 0x7f9b1c0b4410 2023-07-21T22:11:45.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.132+0000 7f9b218dd700 1 -- 172.21.15.49:0/502382390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0b4410 msgr2=0x7f9b1c0b4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:45.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.132+0000 7f9b218dd700 1 --2- 172.21.15.49:0/502382390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0b4410 0x7f9b1c0b4860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c06f0c0 tx=0x7f9b04009b30 comp rx=0 tx=0).stop 2023-07-21T22:11:45.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.132+0000 7f9b218dd700 1 -- 172.21.15.49:0/502382390 shutdown_connections 2023-07-21T22:11:45.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.132+0000 7f9b218dd700 1 --2- 172.21.15.49:0/502382390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0b4410 0x7f9b1c0b4860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.132+0000 7f9b218dd700 1 --2- 172.21.15.49:0/502382390 >> v2:172.21.15.49:3300/0 conn(0x7f9b1c15f960 0x7f9b1c15fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.132+0000 7f9b218dd700 1 --2- 172.21.15.49:0/502382390 >> v2:172.21.15.150:3300/0 conn(0x7f9b1c0b4040 0x7f9b1c0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.132+0000 7f9b218dd700 1 -- 172.21.15.49:0/502382390 >> 172.21.15.49:0/502382390 conn(0x7f9b1c0658e0 msgr2=0x7f9b1c06fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.132+0000 7f9b218dd700 1 -- 172.21.15.49:0/502382390 shutdown_connections 2023-07-21T22:11:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.132+0000 7f9b218dd700 1 -- 172.21.15.49:0/502382390 wait complete. 2023-07-21T22:11:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.132+0000 7f9b218dd700 1 Processor -- start 2023-07-21T22:11:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.132+0000 7f9b218dd700 1 -- start start 2023-07-21T22:11:45.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b218dd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b1c0b4040 0x7f9b1c0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:45.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b218dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0b4410 0x7f9b1c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:45.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b218dd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b1c15f960 0x7f9b1c158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:45.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b218dd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0cacb0 con 0x7f9b1c15f960 2023-07-21T22:11:45.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b218dd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0c6bc0 con 0x7f9b1c0b4040 2023-07-21T22:11:45.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b218dd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0c6290 con 0x7f9b1c0b4410 2023-07-21T22:11:45.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b1b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b1c15f960 0x7f9b1c158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b1b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b1c15f960 0x7f9b1c158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60726/0 (socket says 172.21.15.49:60726) 2023-07-21T22:11:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b1b7fe700 1 -- 172.21.15.49:0/255226083 learned_addr learned my addr 172.21.15.49:0/255226083 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b13fff700 1 --2- 172.21.15.49:0/255226083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0b4410 0x7f9b1c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b1affd700 1 --2- 172.21.15.49:0/255226083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b1c0b4040 0x7f9b1c0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b1b7fe700 1 -- 172.21.15.49:0/255226083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0b4410 msgr2=0x7f9b1c0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b1b7fe700 1 --2- 172.21.15.49:0/255226083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0b4410 0x7f9b1c0ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b1b7fe700 1 -- 172.21.15.49:0/255226083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b1c0b4040 msgr2=0x7f9b1c0c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b1b7fe700 1 --2- 172.21.15.49:0/255226083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b1c0b4040 0x7f9b1c0c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b1b7fe700 1 -- 172.21.15.49:0/255226083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b14009b30 con 0x7f9b1c15f960 2023-07-21T22:11:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b1b7fe700 1 --2- 172.21.15.49:0/255226083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b1c15f960 0x7f9b1c158ee0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400efc0 tx=0x7f9b14009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b18ff9700 1 -- 172.21.15.49:0/255226083 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14018070 con 0x7f9b1c15f960 2023-07-21T22:11:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b18ff9700 1 -- 172.21.15.49:0/255226083 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1400f040 con 0x7f9b1c15f960 2023-07-21T22:11:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b218dd700 1 -- 172.21.15.49:0/255226083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b040094b0 con 0x7f9b1c15f960 2023-07-21T22:11:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b18ff9700 1 -- 172.21.15.49:0/255226083 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14003c60 con 0x7f9b1c15f960 2023-07-21T22:11:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.136+0000 7f9b218dd700 1 -- 172.21.15.49:0/255226083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c0c6850 con 0x7f9b1c15f960 2023-07-21T22:11:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.140+0000 7f9b218dd700 1 -- 172.21.15.49:0/255226083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c0c6d50 con 0x7f9b1c15f960 2023-07-21T22:11:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.140+0000 7f9b18ff9700 1 -- 172.21.15.49:0/255226083 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b1400c9e0 con 0x7f9b1c15f960 2023-07-21T22:11:45.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.140+0000 7f9b18ff9700 1 --2- 172.21.15.49:0/255226083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9afc0662f0 0x7f9afc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:45.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.144+0000 7f9b18ff9700 1 -- 172.21.15.49:0/255226083 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9b14084310 con 0x7f9b1c15f960 2023-07-21T22:11:45.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.144+0000 7f9b1affd700 1 --2- 172.21.15.49:0/255226083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9afc0662f0 0x7f9afc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:45.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.144+0000 7f9b1affd700 1 --2- 172.21.15.49:0/255226083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9afc0662f0 0x7f9afc0687a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c009a60 tx=0x7f9b0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:45.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.148+0000 7f9b18ff9700 1 -- 172.21.15.49:0/255226083 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b14051450 con 0x7f9b1c15f960 2023-07-21T22:11:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.328+0000 7f9b218dd700 1 -- 172.21.15.49:0/255226083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9b1c04dd50 con 0x7f9b1c15f960 2023-07-21T22:11:45.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.328+0000 7f9b18ff9700 1 -- 172.21.15.49:0/255226083 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9b14054a70 con 0x7f9b1c15f960 2023-07-21T22:11:45.372 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.332+0000 7f9b218dd700 1 -- 172.21.15.49:0/255226083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9afc0662f0 msgr2=0x7f9afc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.332+0000 7f9b218dd700 1 --2- 172.21.15.49:0/255226083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9afc0662f0 0x7f9afc0687a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c009a60 tx=0x7f9b0c008040 comp rx=0 tx=0).stop 2023-07-21T22:11:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.332+0000 7f9b218dd700 1 -- 172.21.15.49:0/255226083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b1c15f960 msgr2=0x7f9b1c158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.332+0000 7f9b218dd700 1 --2- 172.21.15.49:0/255226083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b1c15f960 0x7f9b1c158ee0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400efc0 tx=0x7f9b14009f90 comp rx=0 tx=0).stop 2023-07-21T22:11:45.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.332+0000 7f9b218dd700 1 -- 172.21.15.49:0/255226083 shutdown_connections 2023-07-21T22:11:45.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.332+0000 7f9b218dd700 1 --2- 172.21.15.49:0/255226083 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9afc0662f0 0x7f9afc0687a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.332+0000 7f9b218dd700 1 --2- 172.21.15.49:0/255226083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b1c15f960 0x7f9b1c158ee0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.332+0000 7f9b218dd700 1 --2- 172.21.15.49:0/255226083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0b4410 0x7f9b1c0ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.332+0000 7f9b218dd700 1 --2- 172.21.15.49:0/255226083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b1c0b4040 0x7f9b1c0c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.332+0000 7f9b218dd700 1 -- 172.21.15.49:0/255226083 >> 172.21.15.49:0/255226083 conn(0x7f9b1c0658e0 msgr2=0x7f9b1c0ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:45.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.332+0000 7f9b218dd700 1 -- 172.21.15.49:0/255226083 shutdown_connections 2023-07-21T22:11:45.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.332+0000 7f9b218dd700 1 -- 172.21.15.49:0/255226083 wait complete. 2023-07-21T22:11:45.397 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:11:45.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.528+0000 7f6148754700 1 Processor -- start 2023-07-21T22:11:45.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.528+0000 7f6148754700 1 -- start start 2023-07-21T22:11:45.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6148754700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f614006ded0 0x7f614006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:45.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6148754700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f61400b4b30 0x7f614006e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:45.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6148754700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61400b4fb0 0x7f614006eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:45.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6148754700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614015e700 con 0x7f614006ded0 2023-07-21T22:11:45.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6148754700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614015db80 con 0x7f61400b4b30 2023-07-21T22:11:45.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6148754700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614015de60 con 0x7f61400b4fb0 2023-07-21T22:11:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f61464f0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f614006ded0 0x7f614006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6145cef700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f61400b4b30 0x7f614006e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6146cf1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61400b4fb0 0x7f614006eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6145cef700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f61400b4b30 0x7f614006e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:60426/0 (socket says 172.21.15.49:60426) 2023-07-21T22:11:45.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6145cef700 1 -- 172.21.15.49:0/3225994338 learned_addr learned my addr 172.21.15.49:0/3225994338 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:45.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6145cef700 1 -- 172.21.15.49:0/3225994338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61400b4fb0 msgr2=0x7f614006eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:45.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6145cef700 1 --2- 172.21.15.49:0/3225994338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61400b4fb0 0x7f614006eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6145cef700 1 -- 172.21.15.49:0/3225994338 >> v2:172.21.15.49:3300/0 conn(0x7f614006ded0 msgr2=0x7f614006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:45.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6145cef700 1 --2- 172.21.15.49:0/3225994338 >> v2:172.21.15.49:3300/0 conn(0x7f614006ded0 0x7f614006cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.532+0000 7f6145cef700 1 -- 172.21.15.49:0/3225994338 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614015e140 con 0x7f61400b4b30 2023-07-21T22:11:45.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.536+0000 7f6145cef700 1 --2- 172.21.15.49:0/3225994338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61400b4b30 0x7f614006e960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f614006bb60 tx=0x7f6130009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=631195b222b10951 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:45.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.536+0000 7f61454ee700 1 -- 172.21.15.49:0/3225994338 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6130011830 con 0x7f61400b4b30 2023-07-21T22:11:45.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.536+0000 7f61454ee700 1 -- 172.21.15.49:0/3225994338 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6130011990 con 0x7f61400b4b30 2023-07-21T22:11:45.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.536+0000 7f61454ee700 1 -- 172.21.15.49:0/3225994338 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6130011d20 con 0x7f61400b4b30 2023-07-21T22:11:45.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.536+0000 7f6148754700 1 -- 172.21.15.49:0/3225994338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61400b4b30 msgr2=0x7f614006e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:45.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.536+0000 7f6148754700 1 --2- 172.21.15.49:0/3225994338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61400b4b30 0x7f614006e960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f614006bb60 tx=0x7f6130009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.536+0000 7f6148754700 1 -- 172.21.15.49:0/3225994338 shutdown_connections 2023-07-21T22:11:45.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.536+0000 7f6148754700 1 --2- 172.21.15.49:0/3225994338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61400b4fb0 0x7f614006eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.536+0000 7f6148754700 1 --2- 172.21.15.49:0/3225994338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61400b4b30 0x7f614006e960 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.536+0000 7f6148754700 1 --2- 172.21.15.49:0/3225994338 >> v2:172.21.15.49:3300/0 conn(0x7f614006ded0 0x7f614006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.536+0000 7f6148754700 1 -- 172.21.15.49:0/3225994338 >> 172.21.15.49:0/3225994338 conn(0x7f61400cffc0 msgr2=0x7f61400cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:45.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.536+0000 7f6148754700 1 -- 172.21.15.49:0/3225994338 shutdown_connections 2023-07-21T22:11:45.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.536+0000 7f6148754700 1 -- 172.21.15.49:0/3225994338 wait complete. 2023-07-21T22:11:45.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.540+0000 7f6148754700 1 Processor -- start 2023-07-21T22:11:45.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.540+0000 7f6148754700 1 -- start start 2023-07-21T22:11:45.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f6148754700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f614006ded0 0x7f61400c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:45.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f6148754700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61400b4b30 0x7f6140145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:45.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f6148754700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61400b4fb0 0x7f61401594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f6148754700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61400c7470 con 0x7f614006ded0 2023-07-21T22:11:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f6148754700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61400c76e0 con 0x7f61400b4fb0 2023-07-21T22:11:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f6148754700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61400c79c0 con 0x7f61400b4b30 2023-07-21T22:11:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f61464f0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f614006ded0 0x7f61400c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f61464f0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f614006ded0 0x7f61400c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60744/0 (socket says 172.21.15.49:60744) 2023-07-21T22:11:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f61464f0700 1 -- 172.21.15.49:0/1781902667 learned_addr learned my addr 172.21.15.49:0/1781902667 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:45.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f6146cf1700 1 --2- 172.21.15.49:0/1781902667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61400b4fb0 0x7f61401594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f6145cef700 1 --2- 172.21.15.49:0/1781902667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61400b4b30 0x7f6140145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f61464f0700 1 -- 172.21.15.49:0/1781902667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61400b4b30 msgr2=0x7f6140145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f61464f0700 1 --2- 172.21.15.49:0/1781902667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61400b4b30 0x7f6140145080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f61464f0700 1 -- 172.21.15.49:0/1781902667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61400b4fb0 msgr2=0x7f61401594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f61464f0700 1 --2- 172.21.15.49:0/1781902667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61400b4fb0 0x7f61401594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f61464f0700 1 -- 172.21.15.49:0/1781902667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6130009570 con 0x7f614006ded0 2023-07-21T22:11:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f61464f0700 1 --2- 172.21.15.49:0/1781902667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f614006ded0 0x7f61400c81c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f613c00e9d0 tx=0x7f613c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f6136ffd700 1 -- 172.21.15.49:0/1781902667 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c009720 con 0x7f614006ded0 2023-07-21T22:11:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f6148754700 1 -- 172.21.15.49:0/1781902667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61400c7ca0 con 0x7f614006ded0 2023-07-21T22:11:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f6136ffd700 1 -- 172.21.15.49:0/1781902667 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c00ee70 con 0x7f614006ded0 2023-07-21T22:11:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f6136ffd700 1 -- 172.21.15.49:0/1781902667 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c00ca50 con 0x7f614006ded0 2023-07-21T22:11:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.544+0000 7f6148754700 1 -- 172.21.15.49:0/1781902667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61401455c0 con 0x7f614006ded0 2023-07-21T22:11:45.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.548+0000 7f6148754700 1 -- 172.21.15.49:0/1781902667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6140145870 con 0x7f614006ded0 2023-07-21T22:11:45.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.548+0000 7f6136ffd700 1 -- 172.21.15.49:0/1781902667 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f613c00cbb0 con 0x7f614006ded0 2023-07-21T22:11:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.552+0000 7f6136ffd700 1 --2- 172.21.15.49:0/1781902667 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6124066320 0x7f61240687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.552+0000 7f6136ffd700 1 -- 172.21.15.49:0/1781902667 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f613c084130 con 0x7f614006ded0 2023-07-21T22:11:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.552+0000 7f6145cef700 1 --2- 172.21.15.49:0/1781902667 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6124066320 0x7f61240687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:45.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.552+0000 7f6145cef700 1 --2- 172.21.15.49:0/1781902667 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6124066320 0x7f61240687d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6130000c00 tx=0x7f6130008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:45.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.560+0000 7f6136ffd700 1 -- 172.21.15.49:0/1781902667 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6140145870 con 0x7f614006ded0 2023-07-21T22:11:45.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.748+0000 7f6148754700 1 -- 172.21.15.49:0/1781902667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6140145870 con 0x7f614006ded0 2023-07-21T22:11:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.748+0000 7f6136ffd700 1 -- 172.21.15.49:0/1781902667 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6140145870 con 0x7f614006ded0 2023-07-21T22:11:45.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.752+0000 7f6148754700 1 -- 172.21.15.49:0/1781902667 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6124066320 msgr2=0x7f61240687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:45.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.752+0000 7f6148754700 1 --2- 172.21.15.49:0/1781902667 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6124066320 0x7f61240687d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6130000c00 tx=0x7f6130008030 comp rx=0 tx=0).stop 2023-07-21T22:11:45.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.752+0000 7f6148754700 1 -- 172.21.15.49:0/1781902667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f614006ded0 msgr2=0x7f61400c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:45.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.752+0000 7f6148754700 1 --2- 172.21.15.49:0/1781902667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f614006ded0 0x7f61400c81c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f613c00e9d0 tx=0x7f613c00ece0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.752+0000 7f6148754700 1 -- 172.21.15.49:0/1781902667 shutdown_connections 2023-07-21T22:11:45.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.752+0000 7f6148754700 1 --2- 172.21.15.49:0/1781902667 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6124066320 0x7f61240687d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.752+0000 7f6148754700 1 --2- 172.21.15.49:0/1781902667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61400b4fb0 0x7f61401594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.752+0000 7f6148754700 1 --2- 172.21.15.49:0/1781902667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61400b4b30 0x7f6140145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.752+0000 7f6148754700 1 --2- 172.21.15.49:0/1781902667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f614006ded0 0x7f61400c81c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.752+0000 7f6148754700 1 -- 172.21.15.49:0/1781902667 >> 172.21.15.49:0/1781902667 conn(0x7f61400cffc0 msgr2=0x7f614006a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.752+0000 7f6148754700 1 -- 172.21.15.49:0/1781902667 shutdown_connections 2023-07-21T22:11:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:45.752+0000 7f6148754700 1 -- 172.21.15.49:0/1781902667 wait complete. 2023-07-21T22:11:45.798 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:11:45.818 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2023-07-21T22:11:45.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:45.819 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-21T22:11:45.853 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:11:45.854 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:11:45.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:45.855 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:11:45.920 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:11:45.921 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:11:45.940 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:11:45.940 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:11:46.000 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:46.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.136+0000 7f761359e700 1 Processor -- start 2023-07-21T22:11:46.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.136+0000 7f761359e700 1 -- start start 2023-07-21T22:11:46.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.140+0000 7f761359e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7614160370 0x7f761406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:46.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.140+0000 7f761359e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761406e010 con 0x7f76140c1470 2023-07-21T22:11:46.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.140+0000 7f761359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7614160740 con 0x7f76140ca490 2023-07-21T22:11:46.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.140+0000 7f761359e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76140ccc50 con 0x7f7614160370 2023-07-21T22:11:46.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.140+0000 7f761259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7614160370 0x7f761406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:46.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.140+0000 7f761259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7614160370 0x7f761406d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60748/0 (socket says 172.21.15.49:60748) 2023-07-21T22:11:46.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.140+0000 7f761259c700 1 -- 172.21.15.49:0/2027686341 learned_addr learned my addr 172.21.15.49:0/2027686341 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:46.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.140+0000 7f761259c700 1 -- 172.21.15.49:0/2027686341 >> v1:172.21.15.150:6789/0 conn(0x7f76140ca490 legacy=0x7f7614163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:46.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.140+0000 7f761259c700 1 -- 172.21.15.49:0/2027686341 >> v1:172.21.15.49:6789/0 conn(0x7f76140c1470 legacy=0x7f76140c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:46.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.140+0000 7f761259c700 1 -- 172.21.15.49:0/2027686341 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76140afc90 con 0x7f7614160370 2023-07-21T22:11:46.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.140+0000 7f761159a700 1 -- 172.21.15.49:0/2027686341 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004502976 0 0) 0x7f761406e010 con 0x7f76140c1470 2023-07-21T22:11:46.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.144+0000 7f761259c700 1 --2- 172.21.15.49:0/2027686341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7614160370 0x7f761406d7e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7604009910 tx=0x7f7604009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417acea5c53fb61a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:46.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.144+0000 7f761159a700 1 -- 172.21.15.49:0/2027686341 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604004230 con 0x7f7614160370 2023-07-21T22:11:46.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.144+0000 7f761159a700 1 -- 172.21.15.49:0/2027686341 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7604004390 con 0x7f7614160370 2023-07-21T22:11:46.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.144+0000 7f761159a700 1 -- 172.21.15.49:0/2027686341 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604009e60 con 0x7f7614160370 2023-07-21T22:11:46.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.144+0000 7f761359e700 1 -- 172.21.15.49:0/2027686341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7614160370 msgr2=0x7f761406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:46.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.144+0000 7f761359e700 1 --2- 172.21.15.49:0/2027686341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7614160370 0x7f761406d7e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7604009910 tx=0x7f7604009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:46.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.144+0000 7f761359e700 1 -- 172.21.15.49:0/2027686341 shutdown_connections 2023-07-21T22:11:46.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.144+0000 7f761359e700 1 --2- 172.21.15.49:0/2027686341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7614160370 0x7f761406d7e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.144+0000 7f761359e700 1 -- 172.21.15.49:0/2027686341 >> 172.21.15.49:0/2027686341 conn(0x7f7614070450 msgr2=0x7f7614070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:46.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.144+0000 7f761359e700 1 -- 172.21.15.49:0/2027686341 shutdown_connections 2023-07-21T22:11:46.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.144+0000 7f761359e700 1 -- 172.21.15.49:0/2027686341 wait complete. 2023-07-21T22:11:46.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.148+0000 7f761359e700 1 Processor -- start 2023-07-21T22:11:46.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.148+0000 7f761359e700 1 -- start start 2023-07-21T22:11:46.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.148+0000 7f761359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76140c1470 0x7f761415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:46.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.148+0000 7f761359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76140ca490 0x7f76140c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:46.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.148+0000 7f761359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7614160370 0x7f76140c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:46.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.148+0000 7f761359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76140b1c90 con 0x7f7614160370 2023-07-21T22:11:46.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.148+0000 7f761359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76140c6910 con 0x7f76140ca490 2023-07-21T22:11:46.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.148+0000 7f761359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76140c5cb0 con 0x7f76140c1470 2023-07-21T22:11:46.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.148+0000 7f7612d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7614160370 0x7f76140c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:46.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.148+0000 7f7612d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7614160370 0x7f76140c5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60760/0 (socket says 172.21.15.49:60760) 2023-07-21T22:11:46.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.148+0000 7f7612d9d700 1 -- 172.21.15.49:0/909026625 learned_addr learned my addr 172.21.15.49:0/909026625 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:46.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.148+0000 7f761259c700 1 --2- 172.21.15.49:0/909026625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76140c1470 0x7f761415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:46.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.148+0000 7f7611d9b700 1 --2- 172.21.15.49:0/909026625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76140ca490 0x7f76140c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:46.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.152+0000 7f7612d9d700 1 -- 172.21.15.49:0/909026625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76140c1470 msgr2=0x7f761415a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:46.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.152+0000 7f7612d9d700 1 --2- 172.21.15.49:0/909026625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76140c1470 0x7f761415a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.152+0000 7f7612d9d700 1 -- 172.21.15.49:0/909026625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76140ca490 msgr2=0x7f76140c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:46.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.152+0000 7f7612d9d700 1 --2- 172.21.15.49:0/909026625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76140ca490 0x7f76140c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.152+0000 7f7612d9d700 1 -- 172.21.15.49:0/909026625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7604009570 con 0x7f7614160370 2023-07-21T22:11:46.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.152+0000 7f7612d9d700 1 --2- 172.21.15.49:0/909026625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7614160370 0x7f76140c5680 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f760c00cc10 tx=0x7f760c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:46.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.152+0000 7f7602ffd700 1 -- 172.21.15.49:0/909026625 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c00ab10 con 0x7f7614160370 2023-07-21T22:11:46.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.152+0000 7f7602ffd700 1 -- 172.21.15.49:0/909026625 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c00ac70 con 0x7f7614160370 2023-07-21T22:11:46.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.152+0000 7f7602ffd700 1 -- 172.21.15.49:0/909026625 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c012420 con 0x7f7614160370 2023-07-21T22:11:46.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.152+0000 7f761359e700 1 -- 172.21.15.49:0/909026625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76140c5f90 con 0x7f7614160370 2023-07-21T22:11:46.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.152+0000 7f761359e700 1 -- 172.21.15.49:0/909026625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76140b1f30 con 0x7f7614160370 2023-07-21T22:11:46.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.152+0000 7f761359e700 1 -- 172.21.15.49:0/909026625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76140c64b0 con 0x7f7614160370 2023-07-21T22:11:46.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.156+0000 7f7602ffd700 1 -- 172.21.15.49:0/909026625 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f760c012580 con 0x7f7614160370 2023-07-21T22:11:46.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.156+0000 7f7602ffd700 1 --2- 172.21.15.49:0/909026625 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75f40662f0 0x7f75f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:46.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.156+0000 7f7602ffd700 1 -- 172.21.15.49:0/909026625 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f760c084eb0 con 0x7f7614160370 2023-07-21T22:11:46.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.160+0000 7f761259c700 1 --2- 172.21.15.49:0/909026625 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75f40662f0 0x7f75f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:46.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.160+0000 7f761259c700 1 --2- 172.21.15.49:0/909026625 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75f40662f0 0x7f75f40687a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7604009910 tx=0x7f7604008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:46.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.160+0000 7f7602ffd700 1 -- 172.21.15.49:0/909026625 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f760c052070 con 0x7f7614160370 2023-07-21T22:11:46.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.336+0000 7f761359e700 1 -- 172.21.15.49:0/909026625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76140b2150 con 0x7f7614160370 2023-07-21T22:11:46.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.336+0000 7f7602ffd700 1 -- 172.21.15.49:0/909026625 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7f760c055690 con 0x7f7614160370 2023-07-21T22:11:46.382 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:46.383 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:46.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.340+0000 7f761359e700 1 -- 172.21.15.49:0/909026625 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75f40662f0 msgr2=0x7f75f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:46.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.340+0000 7f761359e700 1 --2- 172.21.15.49:0/909026625 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75f40662f0 0x7f75f40687a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7604009910 tx=0x7f7604008030 comp rx=0 tx=0).stop 2023-07-21T22:11:46.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.340+0000 7f761359e700 1 -- 172.21.15.49:0/909026625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7614160370 msgr2=0x7f76140c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:46.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.340+0000 7f761359e700 1 --2- 172.21.15.49:0/909026625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7614160370 0x7f76140c5680 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f760c00cc10 tx=0x7f760c00cf20 comp rx=0 tx=0).stop 2023-07-21T22:11:46.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.340+0000 7f761359e700 1 -- 172.21.15.49:0/909026625 shutdown_connections 2023-07-21T22:11:46.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.340+0000 7f761359e700 1 --2- 172.21.15.49:0/909026625 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75f40662f0 0x7f75f40687a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.340+0000 7f761359e700 1 --2- 172.21.15.49:0/909026625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7614160370 0x7f76140c5680 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.340+0000 7f761359e700 1 --2- 172.21.15.49:0/909026625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76140ca490 0x7f76140c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.340+0000 7f761359e700 1 --2- 172.21.15.49:0/909026625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76140c1470 0x7f761415a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.340+0000 7f761359e700 1 -- 172.21.15.49:0/909026625 >> 172.21.15.49:0/909026625 conn(0x7f7614070450 msgr2=0x7f76140cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:46.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.340+0000 7f761359e700 1 -- 172.21.15.49:0/909026625 shutdown_connections 2023-07-21T22:11:46.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.340+0000 7f761359e700 1 -- 172.21.15.49:0/909026625 wait complete. 2023-07-21T22:11:46.408 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:11:46.409 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:11:46.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.548+0000 7f87c4cdf700 1 Processor -- start 2023-07-21T22:11:46.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.548+0000 7f87c4cdf700 1 -- start start 2023-07-21T22:11:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.552+0000 7f87c4cdf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87c00cb2f0 0x7f87c00ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.552+0000 7f87c4cdf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f87c00b3a50 0x7f87c00ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.552+0000 7f87c4cdf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c00ca190 con 0x7f87c015e380 2023-07-21T22:11:46.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.552+0000 7f87c4cdf700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c0159fd0 con 0x7f87c00cb2f0 2023-07-21T22:11:46.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.552+0000 7f87c4cdf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c015d6e0 con 0x7f87c00b3a50 2023-07-21T22:11:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.552+0000 7f87b7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87c00cb2f0 0x7f87c00ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.552+0000 7f87b7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87c00cb2f0 0x7f87c00ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60764/0 (socket says 172.21.15.49:60764) 2023-07-21T22:11:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.552+0000 7f87b7fff700 1 -- 172.21.15.49:0/498840208 learned_addr learned my addr 172.21.15.49:0/498840208 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.552+0000 7f87bed9d700 1 --2- 172.21.15.49:0/498840208 >> v2:172.21.15.150:3300/0 conn(0x7f87c00b3a50 0x7f87c00ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.552+0000 7f87b7fff700 1 -- 172.21.15.49:0/498840208 >> v2:172.21.15.150:3300/0 conn(0x7f87c00b3a50 msgr2=0x7f87c00ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.552+0000 7f87b7fff700 1 --2- 172.21.15.49:0/498840208 >> v2:172.21.15.150:3300/0 conn(0x7f87c00b3a50 0x7f87c00ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.552+0000 7f87b7fff700 1 -- 172.21.15.49:0/498840208 >> v1:172.21.15.150:6789/0 conn(0x7f87c015e380 legacy=0x7f87c00cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.552+0000 7f87b7fff700 1 -- 172.21.15.49:0/498840208 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c00ca900 con 0x7f87c00cb2f0 2023-07-21T22:11:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.552+0000 7f87b7fff700 1 --2- 172.21.15.49:0/498840208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c00cb2f0 0x7f87c00ce160 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f87c00ce020 tx=0x7f87a8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94c5e868475e7d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:46.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.556+0000 7f87bdd9b700 1 -- 172.21.15.49:0/498840208 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8005e50 con 0x7f87c00cb2f0 2023-07-21T22:11:46.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.556+0000 7f87bdd9b700 1 -- 172.21.15.49:0/498840208 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a8006030 con 0x7f87c00cb2f0 2023-07-21T22:11:46.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.556+0000 7f87bdd9b700 1 -- 172.21.15.49:0/498840208 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a80063c0 con 0x7f87c00cb2f0 2023-07-21T22:11:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.556+0000 7f87c4cdf700 1 -- 172.21.15.49:0/498840208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c00cb2f0 msgr2=0x7f87c00ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.556+0000 7f87c4cdf700 1 --2- 172.21.15.49:0/498840208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c00cb2f0 0x7f87c00ce160 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f87c00ce020 tx=0x7f87a8009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.556+0000 7f87c4cdf700 1 -- 172.21.15.49:0/498840208 shutdown_connections 2023-07-21T22:11:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.556+0000 7f87c4cdf700 1 --2- 172.21.15.49:0/498840208 >> v2:172.21.15.150:3300/0 conn(0x7f87c00b3a50 0x7f87c00ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.556+0000 7f87c4cdf700 1 --2- 172.21.15.49:0/498840208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c00cb2f0 0x7f87c00ce160 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.556+0000 7f87c4cdf700 1 -- 172.21.15.49:0/498840208 >> 172.21.15.49:0/498840208 conn(0x7f87c006e960 msgr2=0x7f87c006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.556+0000 7f87c4cdf700 1 -- 172.21.15.49:0/498840208 shutdown_connections 2023-07-21T22:11:46.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.556+0000 7f87c4cdf700 1 -- 172.21.15.49:0/498840208 wait complete. 2023-07-21T22:11:46.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.560+0000 7f87c4cdf700 1 Processor -- start 2023-07-21T22:11:46.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.560+0000 7f87c4cdf700 1 -- start start 2023-07-21T22:11:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.560+0000 7f87c4cdf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c00b3a50 0x7f87c00c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.560+0000 7f87c4cdf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87c00cb2f0 0x7f87c00a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.560+0000 7f87c4cdf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87c015e380 0x7f87c00a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.560+0000 7f87c4cdf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c01f58e0 con 0x7f87c00b3a50 2023-07-21T22:11:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.560+0000 7f87c4cdf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c014b890 con 0x7f87c00cb2f0 2023-07-21T22:11:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.560+0000 7f87c4cdf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c014bd20 con 0x7f87c015e380 2023-07-21T22:11:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.560+0000 7f87be59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c00b3a50 0x7f87c00c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.560+0000 7f87be59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c00b3a50 0x7f87c00c3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60772/0 (socket says 172.21.15.49:60772) 2023-07-21T22:11:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.560+0000 7f87be59c700 1 -- 172.21.15.49:0/2816748617 learned_addr learned my addr 172.21.15.49:0/2816748617 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87bed9d700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87c015e380 0x7f87c00a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87b7fff700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87c00cb2f0 0x7f87c00a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87be59c700 1 -- 172.21.15.49:0/2816748617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87c015e380 msgr2=0x7f87c00a8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87be59c700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87c015e380 0x7f87c00a8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87be59c700 1 -- 172.21.15.49:0/2816748617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87c00cb2f0 msgr2=0x7f87c00a8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87be59c700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87c00cb2f0 0x7f87c00a8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87be59c700 1 -- 172.21.15.49:0/2816748617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8009520 con 0x7f87c00b3a50 2023-07-21T22:11:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87bed9d700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87c015e380 0x7f87c00a8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87be59c700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c00b3a50 0x7f87c00c3a30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f87b000c530 tx=0x7f87b000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87b6ffd700 1 -- 172.21.15.49:0/2816748617 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b00052d0 con 0x7f87c00b3a50 2023-07-21T22:11:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87b6ffd700 1 -- 172.21.15.49:0/2816748617 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b0005430 con 0x7f87c00b3a50 2023-07-21T22:11:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87c4cdf700 1 -- 172.21.15.49:0/2816748617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c00a74c0 con 0x7f87c00b3a50 2023-07-21T22:11:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87b6ffd700 1 -- 172.21.15.49:0/2816748617 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b00055a0 con 0x7f87c00b3a50 2023-07-21T22:11:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87c4cdf700 1 -- 172.21.15.49:0/2816748617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c014b240 con 0x7f87c00b3a50 2023-07-21T22:11:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.564+0000 7f87c4cdf700 1 -- 172.21.15.49:0/2816748617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c004dd50 con 0x7f87c00b3a50 2023-07-21T22:11:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.568+0000 7f87b6ffd700 1 -- 172.21.15.49:0/2816748617 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87b00038e0 con 0x7f87c00b3a50 2023-07-21T22:11:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.568+0000 7f87b6ffd700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f87a00662f0 0x7f87a00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:46.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.568+0000 7f87b6ffd700 1 -- 172.21.15.49:0/2816748617 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f87b0083520 con 0x7f87c00b3a50 2023-07-21T22:11:46.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.568+0000 7f87b7fff700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f87a00662f0 0x7f87a00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:46.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.572+0000 7f87b7fff700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f87a00662f0 0x7f87a00687a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009c30 tx=0x7f87a8008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.576+0000 7f87b6ffd700 1 -- 172.21.15.49:0/2816748617 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f87b00505d0 con 0x7f87c00b3a50 2023-07-21T22:11:46.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.748+0000 7f87c4cdf700 1 -- 172.21.15.49:0/2816748617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87c015db20 con 0x7f87c00b3a50 2023-07-21T22:11:46.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.748+0000 7f87b6ffd700 1 -- 172.21.15.49:0/2816748617 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87b0053bf0 con 0x7f87c00b3a50 2023-07-21T22:11:46.794 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:11:46.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.752+0000 7f87c4cdf700 1 -- 172.21.15.49:0/2816748617 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f87a00662f0 msgr2=0x7f87a00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:46.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.752+0000 7f87c4cdf700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f87a00662f0 0x7f87a00687a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009c30 tx=0x7f87a8008070 comp rx=0 tx=0).stop 2023-07-21T22:11:46.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.752+0000 7f87c4cdf700 1 -- 172.21.15.49:0/2816748617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c00b3a50 msgr2=0x7f87c00c3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:46.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.752+0000 7f87c4cdf700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c00b3a50 0x7f87c00c3a30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f87b000c530 tx=0x7f87b000c840 comp rx=0 tx=0).stop 2023-07-21T22:11:46.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.752+0000 7f87c4cdf700 1 -- 172.21.15.49:0/2816748617 shutdown_connections 2023-07-21T22:11:46.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.752+0000 7f87c4cdf700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f87a00662f0 0x7f87a00687a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.752+0000 7f87c4cdf700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87c015e380 0x7f87c00a8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.752+0000 7f87c4cdf700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87c00cb2f0 0x7f87c00a8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.752+0000 7f87c4cdf700 1 --2- 172.21.15.49:0/2816748617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c00b3a50 0x7f87c00c3a30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:46.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.752+0000 7f87c4cdf700 1 -- 172.21.15.49:0/2816748617 >> 172.21.15.49:0/2816748617 conn(0x7f87c006e960 msgr2=0x7f87c00c1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:46.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.752+0000 7f87c4cdf700 1 -- 172.21.15.49:0/2816748617 shutdown_connections 2023-07-21T22:11:46.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.752+0000 7f87c4cdf700 1 -- 172.21.15.49:0/2816748617 wait complete. 2023-07-21T22:11:46.819 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:11:47.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.956+0000 7fb482737700 1 Processor -- start 2023-07-21T22:11:47.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.956+0000 7fb482737700 1 -- start start 2023-07-21T22:11:47.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.960+0000 7fb482737700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb47c160010 0x7fb47c0ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.960+0000 7fb482737700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47c163ee0 con 0x7fb47c0ca680 2023-07-21T22:11:47.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.960+0000 7fb482737700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47c0cd6d0 con 0x7fb47c1603e0 2023-07-21T22:11:47.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.960+0000 7fb482737700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47c0cdf70 con 0x7fb47c160010 2023-07-21T22:11:47.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.960+0000 7fb481f36700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb47c0ca680 0x7fb47c0cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60256/0 (socket says 172.21.15.49:60256) 2023-07-21T22:11:47.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.960+0000 7fb481f36700 1 -- 172.21.15.49:0/81330395 learned_addr learned my addr 172.21.15.49:0/81330395 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:47.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.960+0000 7fb481735700 1 --2- 172.21.15.49:0/81330395 >> v2:172.21.15.150:3300/0 conn(0x7fb47c160010 0x7fb47c0ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:47.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.960+0000 7fb473fff700 1 -- 172.21.15.49:0/81330395 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152709190 0 0) 0x7fb47c163ee0 con 0x7fb47c0ca680 2023-07-21T22:11:47.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.960+0000 7fb473fff700 1 -- 172.21.15.49:0/81330395 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4680035d0 con 0x7fb47c0ca680 2023-07-21T22:11:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.960+0000 7fb481735700 1 -- 172.21.15.49:0/81330395 >> v1:172.21.15.150:6789/0 conn(0x7fb47c1603e0 legacy=0x7fb47c164370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.960+0000 7fb473fff700 1 -- 172.21.15.49:0/81330395 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3529499175 0 0) 0x7fb4680035d0 con 0x7fb47c0ca680 2023-07-21T22:11:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.960+0000 7fb481735700 1 -- 172.21.15.49:0/81330395 >> v1:172.21.15.49:6789/0 conn(0x7fb47c0ca680 legacy=0x7fb47c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.960+0000 7fb481735700 1 -- 172.21.15.49:0/81330395 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c0cd9b0 con 0x7fb47c160010 2023-07-21T22:11:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.960+0000 7fb481735700 1 --2- 172.21.15.49:0/81330395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c160010 0x7fb47c0ca140 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb478009850 tx=0x7fb478009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba256116ef7fa1c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:47.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.964+0000 7fb473fff700 1 -- 172.21.15.49:0/81330395 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4740019f0 con 0x7fb47c160010 2023-07-21T22:11:47.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.964+0000 7fb473fff700 1 -- 172.21.15.49:0/81330395 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb478004030 con 0x7fb47c160010 2023-07-21T22:11:47.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.964+0000 7fb473fff700 1 -- 172.21.15.49:0/81330395 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780043c0 con 0x7fb47c160010 2023-07-21T22:11:47.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.964+0000 7fb482737700 1 -- 172.21.15.49:0/81330395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c160010 msgr2=0x7fb47c0ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.964+0000 7fb482737700 1 --2- 172.21.15.49:0/81330395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c160010 0x7fb47c0ca140 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb478009850 tx=0x7fb478009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:47.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.964+0000 7fb482737700 1 -- 172.21.15.49:0/81330395 shutdown_connections 2023-07-21T22:11:47.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.964+0000 7fb482737700 1 --2- 172.21.15.49:0/81330395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c160010 0x7fb47c0ca140 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.964+0000 7fb482737700 1 -- 172.21.15.49:0/81330395 >> 172.21.15.49:0/81330395 conn(0x7fb47c0ce0d0 msgr2=0x7fb47c0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:47.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.964+0000 7fb482737700 1 -- 172.21.15.49:0/81330395 shutdown_connections 2023-07-21T22:11:47.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.964+0000 7fb482737700 1 -- 172.21.15.49:0/81330395 wait complete. 2023-07-21T22:11:47.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.968+0000 7fb482737700 1 Processor -- start 2023-07-21T22:11:47.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.968+0000 7fb482737700 1 -- start start 2023-07-21T22:11:47.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb482737700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c0ca680 0x7fb47c1506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb482737700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb47c160010 0x7fb47c0b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb482737700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb47c1603e0 0x7fb47c14fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb482737700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c0b2eb0 con 0x7fb47c1603e0 2023-07-21T22:11:47.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb482737700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c14ffa0 con 0x7fb47c0ca680 2023-07-21T22:11:47.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb482737700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c0b30a0 con 0x7fb47c160010 2023-07-21T22:11:47.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb481f36700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb47c1603e0 0x7fb47c14fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:47.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb481f36700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb47c1603e0 0x7fb47c14fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60774/0 (socket says 172.21.15.49:60774) 2023-07-21T22:11:47.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb481f36700 1 -- 172.21.15.49:0/3355698758 learned_addr learned my addr 172.21.15.49:0/3355698758 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:47.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb480f34700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb47c160010 0x7fb47c0b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:47.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb481735700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c0ca680 0x7fb47c1506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:47.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb480f34700 1 -- 172.21.15.49:0/3355698758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c0ca680 msgr2=0x7fb47c1506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb480f34700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c0ca680 0x7fb47c1506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb480f34700 1 -- 172.21.15.49:0/3355698758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb47c1603e0 msgr2=0x7fb47c14fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb480f34700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb47c1603e0 0x7fb47c14fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb480f34700 1 -- 172.21.15.49:0/3355698758 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4780094b0 con 0x7fb47c160010 2023-07-21T22:11:47.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb481f36700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb47c1603e0 0x7fb47c14fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:47.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb480f34700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb47c160010 0x7fb47c0b2970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00c480 tx=0x7fb46c00c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:47.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb471ffb700 1 -- 172.21.15.49:0/3355698758 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0052d0 con 0x7fb47c160010 2023-07-21T22:11:47.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb471ffb700 1 -- 172.21.15.49:0/3355698758 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c005430 con 0x7fb47c160010 2023-07-21T22:11:47.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb482737700 1 -- 172.21.15.49:0/3355698758 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47c0b3380 con 0x7fb47c160010 2023-07-21T22:11:47.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb471ffb700 1 -- 172.21.15.49:0/3355698758 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0055a0 con 0x7fb47c160010 2023-07-21T22:11:47.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.972+0000 7fb482737700 1 -- 172.21.15.49:0/3355698758 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47c0c5590 con 0x7fb47c160010 2023-07-21T22:11:47.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.976+0000 7fb482737700 1 -- 172.21.15.49:0/3355698758 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47c0c5110 con 0x7fb47c160010 2023-07-21T22:11:47.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.976+0000 7fb471ffb700 1 -- 172.21.15.49:0/3355698758 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb46c0038e0 con 0x7fb47c160010 2023-07-21T22:11:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.976+0000 7fb471ffb700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb4600662f0 0x7fb4600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.976+0000 7fb471ffb700 1 -- 172.21.15.49:0/3355698758 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb46c083370 con 0x7fb47c160010 2023-07-21T22:11:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.980+0000 7fb481735700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb4600662f0 0x7fb4600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.980+0000 7fb481735700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb4600662f0 0x7fb4600687a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb4780090b0 tx=0x7fb478008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:46.984+0000 7fb471ffb700 1 -- 172.21.15.49:0/3355698758 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb47c0c5110 con 0x7fb47c160010 2023-07-21T22:11:47.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.160+0000 7fb482737700 1 -- 172.21.15.49:0/3355698758 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb47c0c5110 con 0x7fb47c160010 2023-07-21T22:11:47.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.160+0000 7fb471ffb700 1 -- 172.21.15.49:0/3355698758 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb47c0c5110 con 0x7fb47c160010 2023-07-21T22:11:47.206 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:11:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.164+0000 7fb482737700 1 -- 172.21.15.49:0/3355698758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb4600662f0 msgr2=0x7fb4600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.164+0000 7fb482737700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb4600662f0 0x7fb4600687a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb4780090b0 tx=0x7fb478008030 comp rx=0 tx=0).stop 2023-07-21T22:11:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.164+0000 7fb482737700 1 -- 172.21.15.49:0/3355698758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb47c160010 msgr2=0x7fb47c0b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.164+0000 7fb482737700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb47c160010 0x7fb47c0b2970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00c480 tx=0x7fb46c00c790 comp rx=0 tx=0).stop 2023-07-21T22:11:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.164+0000 7fb482737700 1 -- 172.21.15.49:0/3355698758 shutdown_connections 2023-07-21T22:11:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.164+0000 7fb482737700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb4600662f0 0x7fb4600687a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.164+0000 7fb482737700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb47c1603e0 0x7fb47c14fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.164+0000 7fb482737700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb47c160010 0x7fb47c0b2970 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.164+0000 7fb482737700 1 --2- 172.21.15.49:0/3355698758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c0ca680 0x7fb47c1506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.164+0000 7fb482737700 1 -- 172.21.15.49:0/3355698758 >> 172.21.15.49:0/3355698758 conn(0x7fb47c0ce0d0 msgr2=0x7fb47c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.164+0000 7fb482737700 1 -- 172.21.15.49:0/3355698758 shutdown_connections 2023-07-21T22:11:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.164+0000 7fb482737700 1 -- 172.21.15.49:0/3355698758 wait complete. 2023-07-21T22:11:47.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:11:47.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.368+0000 7fb31b59e700 1 Processor -- start 2023-07-21T22:11:47.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.368+0000 7fb31b59e700 1 -- start start 2023-07-21T22:11:47.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.372+0000 7fb31b59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb31c0ca550 0x7fb31c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.372+0000 7fb31b59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c0c8b80 con 0x7fb31c159be0 2023-07-21T22:11:47.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.372+0000 7fb31b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c06db90 con 0x7fb31c06d6d0 2023-07-21T22:11:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.372+0000 7fb31b59e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31c0c9720 con 0x7fb31c0ca550 2023-07-21T22:11:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.372+0000 7fb319d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb31c0ca550 0x7fb31c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.372+0000 7fb319d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb31c0ca550 0x7fb31c06d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60782/0 (socket says 172.21.15.49:60782) 2023-07-21T22:11:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.372+0000 7fb319d9b700 1 -- 172.21.15.49:0/432648888 learned_addr learned my addr 172.21.15.49:0/432648888 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:47.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.372+0000 7fb319d9b700 1 -- 172.21.15.49:0/432648888 >> v1:172.21.15.150:6789/0 conn(0x7fb31c06d6d0 legacy=0x7fb31c0698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:47.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.372+0000 7fb319d9b700 1 -- 172.21.15.49:0/432648888 >> v1:172.21.15.49:6789/0 conn(0x7fb31c159be0 legacy=0x7fb31c0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.372+0000 7fb319d9b700 1 -- 172.21.15.49:0/432648888 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c06de70 con 0x7fb31c0ca550 2023-07-21T22:11:47.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.372+0000 7fb319d9b700 1 --2- 172.21.15.49:0/432648888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb31c0ca550 0x7fb31c06d190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb310009910 tx=0x7fb310009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a814c31135edf11 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:47.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.372+0000 7fb31959a700 1 -- 172.21.15.49:0/432648888 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310004230 con 0x7fb31c0ca550 2023-07-21T22:11:47.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.372+0000 7fb31959a700 1 -- 172.21.15.49:0/432648888 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb310004390 con 0x7fb31c0ca550 2023-07-21T22:11:47.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.372+0000 7fb31959a700 1 -- 172.21.15.49:0/432648888 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310009e60 con 0x7fb31c0ca550 2023-07-21T22:11:47.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.376+0000 7fb31b59e700 1 -- 172.21.15.49:0/432648888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb31c0ca550 msgr2=0x7fb31c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.376+0000 7fb31b59e700 1 --2- 172.21.15.49:0/432648888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb31c0ca550 0x7fb31c06d190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb310009910 tx=0x7fb310009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:47.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.376+0000 7fb31b59e700 1 -- 172.21.15.49:0/432648888 shutdown_connections 2023-07-21T22:11:47.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.376+0000 7fb31b59e700 1 --2- 172.21.15.49:0/432648888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb31c0ca550 0x7fb31c06d190 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.376+0000 7fb31b59e700 1 -- 172.21.15.49:0/432648888 >> 172.21.15.49:0/432648888 conn(0x7fb31c0ce0d0 msgr2=0x7fb31c0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:47.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.376+0000 7fb31b59e700 1 -- 172.21.15.49:0/432648888 shutdown_connections 2023-07-21T22:11:47.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.376+0000 7fb31b59e700 1 -- 172.21.15.49:0/432648888 wait complete. 2023-07-21T22:11:47.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.376+0000 7fb31b59e700 1 Processor -- start 2023-07-21T22:11:47.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.376+0000 7fb31b59e700 1 -- start start 2023-07-21T22:11:47.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb31b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb31c06d6d0 0x7fb31c0b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb31b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb31c0ca550 0x7fb31c0cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb31b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb31c159be0 0x7fb31c0ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb31b59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0cd190 con 0x7fb31c0ca550 2023-07-21T22:11:47.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb31b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0b0b10 con 0x7fb31c159be0 2023-07-21T22:11:47.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb31b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0cc510 con 0x7fb31c06d6d0 2023-07-21T22:11:47.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb319d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb31c0ca550 0x7fb31c0cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:47.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb319d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb31c0ca550 0x7fb31c0cd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60790/0 (socket says 172.21.15.49:60790) 2023-07-21T22:11:47.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb319d9b700 1 -- 172.21.15.49:0/3418136108 learned_addr learned my addr 172.21.15.49:0/3418136108 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:47.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb31ad9d700 1 --2- 172.21.15.49:0/3418136108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb31c159be0 0x7fb31c0ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:47.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb31a59c700 1 --2- 172.21.15.49:0/3418136108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb31c06d6d0 0x7fb31c0b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:47.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb319d9b700 1 -- 172.21.15.49:0/3418136108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb31c06d6d0 msgr2=0x7fb31c0b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb319d9b700 1 --2- 172.21.15.49:0/3418136108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb31c06d6d0 0x7fb31c0b05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb319d9b700 1 -- 172.21.15.49:0/3418136108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb31c159be0 msgr2=0x7fb31c0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb319d9b700 1 --2- 172.21.15.49:0/3418136108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb31c159be0 0x7fb31c0ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb319d9b700 1 -- 172.21.15.49:0/3418136108 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb310009570 con 0x7fb31c0ca550 2023-07-21T22:11:47.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb319d9b700 1 --2- 172.21.15.49:0/3418136108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb31c0ca550 0x7fb31c0cd5b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb310004000 tx=0x7fb310004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:47.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb30affd700 1 -- 172.21.15.49:0/3418136108 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31000bca0 con 0x7fb31c0ca550 2023-07-21T22:11:47.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb30affd700 1 -- 172.21.15.49:0/3418136108 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31001f070 con 0x7fb31c0ca550 2023-07-21T22:11:47.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb30affd700 1 -- 172.21.15.49:0/3418136108 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100036c0 con 0x7fb31c0ca550 2023-07-21T22:11:47.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb31b59e700 1 -- 172.21.15.49:0/3418136108 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31c0cc7f0 con 0x7fb31c0ca550 2023-07-21T22:11:47.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.380+0000 7fb31b59e700 1 -- 172.21.15.49:0/3418136108 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31c0ccdb0 con 0x7fb31c0ca550 2023-07-21T22:11:47.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.384+0000 7fb31b59e700 1 -- 172.21.15.49:0/3418136108 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31c04dcb0 con 0x7fb31c0ca550 2023-07-21T22:11:47.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.384+0000 7fb30affd700 1 -- 172.21.15.49:0/3418136108 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb310021030 con 0x7fb31c0ca550 2023-07-21T22:11:47.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.388+0000 7fb30affd700 1 --2- 172.21.15.49:0/3418136108 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb2fc0662f0 0x7fb2fc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.388+0000 7fb30affd700 1 -- 172.21.15.49:0/3418136108 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb310084ea0 con 0x7fb31c0ca550 2023-07-21T22:11:47.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.388+0000 7fb31a59c700 1 --2- 172.21.15.49:0/3418136108 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb2fc0662f0 0x7fb2fc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:47.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.388+0000 7fb31a59c700 1 --2- 172.21.15.49:0/3418136108 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb2fc0662f0 0x7fb2fc0687a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0018a0 tx=0x7fb30c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:47.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.392+0000 7fb30affd700 1 -- 172.21.15.49:0/3418136108 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb310051f50 con 0x7fb31c0ca550 2023-07-21T22:11:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.568+0000 7fb31b59e700 1 -- 172.21.15.49:0/3418136108 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb31c0c9190 con 0x7fb31c0ca550 2023-07-21T22:11:47.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.568+0000 7fb30affd700 1 -- 172.21.15.49:0/3418136108 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb310055570 con 0x7fb31c0ca550 2023-07-21T22:11:47.612 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:47.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.572+0000 7fb31b59e700 1 -- 172.21.15.49:0/3418136108 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb2fc0662f0 msgr2=0x7fb2fc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.572+0000 7fb31b59e700 1 --2- 172.21.15.49:0/3418136108 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb2fc0662f0 0x7fb2fc0687a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0018a0 tx=0x7fb30c009040 comp rx=0 tx=0).stop 2023-07-21T22:11:47.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.572+0000 7fb31b59e700 1 -- 172.21.15.49:0/3418136108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb31c0ca550 msgr2=0x7fb31c0cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.572+0000 7fb31b59e700 1 --2- 172.21.15.49:0/3418136108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb31c0ca550 0x7fb31c0cd5b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb310004000 tx=0x7fb310004770 comp rx=0 tx=0).stop 2023-07-21T22:11:47.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.572+0000 7fb31b59e700 1 -- 172.21.15.49:0/3418136108 shutdown_connections 2023-07-21T22:11:47.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.572+0000 7fb31b59e700 1 --2- 172.21.15.49:0/3418136108 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb2fc0662f0 0x7fb2fc0687a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.572+0000 7fb31b59e700 1 --2- 172.21.15.49:0/3418136108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb31c0ca550 0x7fb31c0cd5b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.572+0000 7fb31b59e700 1 --2- 172.21.15.49:0/3418136108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb31c159be0 0x7fb31c0ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.572+0000 7fb31b59e700 1 --2- 172.21.15.49:0/3418136108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb31c06d6d0 0x7fb31c0b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.572+0000 7fb31b59e700 1 -- 172.21.15.49:0/3418136108 >> 172.21.15.49:0/3418136108 conn(0x7fb31c0ce0d0 msgr2=0x7fb31c158ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:47.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.572+0000 7fb31b59e700 1 -- 172.21.15.49:0/3418136108 shutdown_connections 2023-07-21T22:11:47.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.572+0000 7fb31b59e700 1 -- 172.21.15.49:0/3418136108 wait complete. 2023-07-21T22:11:47.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:11:47.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.776+0000 7fa925599700 1 Processor -- start 2023-07-21T22:11:47.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.776+0000 7fa925599700 1 -- start start 2023-07-21T22:11:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa925599700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa9201589a0 0x7fa92006c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa925599700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa920069fb0 0x7fa9200c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa925599700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa920158d70 con 0x7fa92006c6d0 2023-07-21T22:11:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa925599700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92015c800 con 0x7fa9201589a0 2023-07-21T22:11:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa925599700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9200cc990 con 0x7fa920069fb0 2023-07-21T22:11:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa91effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa9201589a0 0x7fa92006c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa91effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa9201589a0 0x7fa92006c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60796/0 (socket says 172.21.15.49:60796) 2023-07-21T22:11:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa91effd700 1 -- 172.21.15.49:0/1014962831 learned_addr learned my addr 172.21.15.49:0/1014962831 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa91f7fe700 1 --2- 172.21.15.49:0/1014962831 >> v2:172.21.15.150:3300/0 conn(0x7fa920069fb0 0x7fa9200c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa91effd700 1 -- 172.21.15.49:0/1014962831 >> v2:172.21.15.150:3300/0 conn(0x7fa920069fb0 msgr2=0x7fa9200c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa91effd700 1 --2- 172.21.15.49:0/1014962831 >> v2:172.21.15.150:3300/0 conn(0x7fa920069fb0 0x7fa9200c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa91effd700 1 -- 172.21.15.49:0/1014962831 >> v1:172.21.15.150:6789/0 conn(0x7fa92006c6d0 legacy=0x7fa9200698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa91effd700 1 -- 172.21.15.49:0/1014962831 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9200c95d0 con 0x7fa9201589a0 2023-07-21T22:11:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa91f7fe700 1 --2- 172.21.15.49:0/1014962831 >> v2:172.21.15.150:3300/0 conn(0x7fa920069fb0 0x7fa9200c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:47.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa91effd700 1 --2- 172.21.15.49:0/1014962831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9201589a0 0x7fa92006c190 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa92015d550 tx=0x7fa910009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2f697232ac7f60 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:47.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.780+0000 7fa91dffb700 1 -- 172.21.15.49:0/1014962831 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91000f8a0 con 0x7fa9201589a0 2023-07-21T22:11:47.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.784+0000 7fa91dffb700 1 -- 172.21.15.49:0/1014962831 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91000fa00 con 0x7fa9201589a0 2023-07-21T22:11:47.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.784+0000 7fa91dffb700 1 -- 172.21.15.49:0/1014962831 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91000fd90 con 0x7fa9201589a0 2023-07-21T22:11:47.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.784+0000 7fa925599700 1 -- 172.21.15.49:0/1014962831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9201589a0 msgr2=0x7fa92006c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.784+0000 7fa925599700 1 --2- 172.21.15.49:0/1014962831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9201589a0 0x7fa92006c190 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa92015d550 tx=0x7fa910009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.784+0000 7fa925599700 1 -- 172.21.15.49:0/1014962831 shutdown_connections 2023-07-21T22:11:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.784+0000 7fa925599700 1 --2- 172.21.15.49:0/1014962831 >> v2:172.21.15.150:3300/0 conn(0x7fa920069fb0 0x7fa9200c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.784+0000 7fa925599700 1 --2- 172.21.15.49:0/1014962831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9201589a0 0x7fa92006c190 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.784+0000 7fa925599700 1 -- 172.21.15.49:0/1014962831 >> 172.21.15.49:0/1014962831 conn(0x7fa9200ce0d0 msgr2=0x7fa9200ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:47.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.784+0000 7fa925599700 1 -- 172.21.15.49:0/1014962831 shutdown_connections 2023-07-21T22:11:47.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.784+0000 7fa925599700 1 -- 172.21.15.49:0/1014962831 wait complete. 2023-07-21T22:11:47.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.784+0000 7fa925599700 1 Processor -- start 2023-07-21T22:11:47.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa925599700 1 -- start start 2023-07-21T22:11:47.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa925599700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920069fb0 0x7fa9200ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa925599700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa92006c6d0 0x7fa9200b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa925599700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9201589a0 0x7fa9200b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa925599700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200adfd0 con 0x7fa920069fb0 2023-07-21T22:11:47.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa925599700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200b0a80 con 0x7fa92006c6d0 2023-07-21T22:11:47.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa925599700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200b0220 con 0x7fa9201589a0 2023-07-21T22:11:47.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa91effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920069fb0 0x7fa9200ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:47.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa91effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920069fb0 0x7fa9200ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60812/0 (socket says 172.21.15.49:60812) 2023-07-21T22:11:47.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa91effd700 1 -- 172.21.15.49:0/2910406313 learned_addr learned my addr 172.21.15.49:0/2910406313 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:47.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa91effd700 1 -- 172.21.15.49:0/2910406313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9201589a0 msgr2=0x7fa9200b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa91effd700 1 --2- 172.21.15.49:0/2910406313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9201589a0 0x7fa9200b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa91effd700 1 -- 172.21.15.49:0/2910406313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa92006c6d0 msgr2=0x7fa9200b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:47.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa91effd700 1 --2- 172.21.15.49:0/2910406313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa92006c6d0 0x7fa9200b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:47.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa91effd700 1 -- 172.21.15.49:0/2910406313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa918009a70 con 0x7fa920069fb0 2023-07-21T22:11:47.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa91effd700 1 --2- 172.21.15.49:0/2910406313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920069fb0 0x7fa9200ada90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa920071dd0 tx=0x7fa910004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:47.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa9077fe700 1 -- 172.21.15.49:0/2910406313 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9100038c0 con 0x7fa920069fb0 2023-07-21T22:11:47.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa925599700 1 -- 172.21.15.49:0/2910406313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa910009570 con 0x7fa920069fb0 2023-07-21T22:11:47.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa9077fe700 1 -- 172.21.15.49:0/2910406313 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa910003a20 con 0x7fa920069fb0 2023-07-21T22:11:47.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa9077fe700 1 -- 172.21.15.49:0/2910406313 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910003dd0 con 0x7fa920069fb0 2023-07-21T22:11:47.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.788+0000 7fa925599700 1 -- 172.21.15.49:0/2910406313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9200b07a0 con 0x7fa920069fb0 2023-07-21T22:11:47.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.792+0000 7fa925599700 1 -- 172.21.15.49:0/2910406313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92004dcb0 con 0x7fa920069fb0 2023-07-21T22:11:47.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.792+0000 7fa9077fe700 1 -- 172.21.15.49:0/2910406313 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa910022440 con 0x7fa920069fb0 2023-07-21T22:11:47.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.792+0000 7fa9077fe700 1 --2- 172.21.15.49:0/2910406313 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa90c0662f0 0x7fa90c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:47.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.792+0000 7fa9077fe700 1 -- 172.21.15.49:0/2910406313 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa9100858f0 con 0x7fa920069fb0 2023-07-21T22:11:47.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.792+0000 7fa91e7fc700 1 --2- 172.21.15.49:0/2910406313 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa90c0662f0 0x7fa90c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:47.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.796+0000 7fa91e7fc700 1 --2- 172.21.15.49:0/2910406313 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa90c0662f0 0x7fa90c0687a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa914000f60 tx=0x7fa914007a60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:47.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.800+0000 7fa9077fe700 1 -- 172.21.15.49:0/2910406313 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa910052b10 con 0x7fa920069fb0 2023-07-21T22:11:48.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.976+0000 7fa925599700 1 -- 172.21.15.49:0/2910406313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9200cc080 con 0x7fa920069fb0 2023-07-21T22:11:48.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.976+0000 7fa9077fe700 1 -- 172.21.15.49:0/2910406313 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa910056130 con 0x7fa920069fb0 2023-07-21T22:11:48.023 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:11:48.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.980+0000 7fa925599700 1 -- 172.21.15.49:0/2910406313 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa90c0662f0 msgr2=0x7fa90c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:48.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.980+0000 7fa925599700 1 --2- 172.21.15.49:0/2910406313 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa90c0662f0 0x7fa90c0687a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa914000f60 tx=0x7fa914007a60 comp rx=0 tx=0).stop 2023-07-21T22:11:48.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.980+0000 7fa925599700 1 -- 172.21.15.49:0/2910406313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920069fb0 msgr2=0x7fa9200ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:48.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.980+0000 7fa925599700 1 --2- 172.21.15.49:0/2910406313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920069fb0 0x7fa9200ada90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa920071dd0 tx=0x7fa910004770 comp rx=0 tx=0).stop 2023-07-21T22:11:48.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.980+0000 7fa925599700 1 -- 172.21.15.49:0/2910406313 shutdown_connections 2023-07-21T22:11:48.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.980+0000 7fa925599700 1 --2- 172.21.15.49:0/2910406313 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa90c0662f0 0x7fa90c0687a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.980+0000 7fa925599700 1 --2- 172.21.15.49:0/2910406313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9201589a0 0x7fa9200b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.980+0000 7fa925599700 1 --2- 172.21.15.49:0/2910406313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa92006c6d0 0x7fa9200b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.984+0000 7fa925599700 1 --2- 172.21.15.49:0/2910406313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920069fb0 0x7fa9200ada90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.984+0000 7fa925599700 1 -- 172.21.15.49:0/2910406313 >> 172.21.15.49:0/2910406313 conn(0x7fa9200ce0d0 msgr2=0x7fa920152740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:48.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.984+0000 7fa925599700 1 -- 172.21.15.49:0/2910406313 shutdown_connections 2023-07-21T22:11:48.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:47.984+0000 7fa925599700 1 -- 172.21.15.49:0/2910406313 wait complete. 2023-07-21T22:11:48.047 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:11:48.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.184+0000 7f2a1ef00700 1 Processor -- start 2023-07-21T22:11:48.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.184+0000 7f2a1ef00700 1 -- start start 2023-07-21T22:11:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1ef00700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a180d1e40 0x7f2a180b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1ef00700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2a180cee10 0x7f2a180cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1ef00700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a180b3e80 con 0x7f2a180b7af0 2023-07-21T22:11:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1ef00700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a180cf7d0 con 0x7f2a180cee10 2023-07-21T22:11:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1ef00700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1815fd40 con 0x7f2a180d1e40 2023-07-21T22:11:48.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1d6fd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a180d1e40 0x7f2a180b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:48.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1e6ff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2a180cee10 0x7f2a180cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:48.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1d6fd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a180d1e40 0x7f2a180b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:41644/0 (socket says 172.21.15.49:41644) 2023-07-21T22:11:48.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1d6fd700 1 -- 172.21.15.49:0/4264780728 learned_addr learned my addr 172.21.15.49:0/4264780728 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:48.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1d6fd700 1 -- 172.21.15.49:0/4264780728 >> v2:172.21.15.150:3300/0 conn(0x7f2a180cee10 msgr2=0x7f2a180cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:48.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1d6fd700 1 --2- 172.21.15.49:0/4264780728 >> v2:172.21.15.150:3300/0 conn(0x7f2a180cee10 0x7f2a180cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1d6fd700 1 -- 172.21.15.49:0/4264780728 >> v1:172.21.15.150:6789/0 conn(0x7f2a180b7af0 legacy=0x7f2a1815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:48.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1d6fd700 1 -- 172.21.15.49:0/4264780728 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a180cea00 con 0x7f2a180d1e40 2023-07-21T22:11:48.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1d6fd700 1 --2- 172.21.15.49:0/4264780728 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a180d1e40 0x7f2a180b1630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009910 tx=0x7f2a08009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31d5331800c6c35a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:48.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.188+0000 7f2a1cefc700 1 -- 172.21.15.49:0/4264780728 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08011830 con 0x7f2a180d1e40 2023-07-21T22:11:48.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.192+0000 7f2a1cefc700 1 -- 172.21.15.49:0/4264780728 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a08011990 con 0x7f2a180d1e40 2023-07-21T22:11:48.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.192+0000 7f2a1cefc700 1 -- 172.21.15.49:0/4264780728 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08011d40 con 0x7f2a180d1e40 2023-07-21T22:11:48.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.192+0000 7f2a1ef00700 1 -- 172.21.15.49:0/4264780728 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a180d1e40 msgr2=0x7f2a180b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:48.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.192+0000 7f2a1ef00700 1 --2- 172.21.15.49:0/4264780728 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a180d1e40 0x7f2a180b1630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009910 tx=0x7f2a08009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:48.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.192+0000 7f2a1ef00700 1 -- 172.21.15.49:0/4264780728 shutdown_connections 2023-07-21T22:11:48.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.192+0000 7f2a1ef00700 1 --2- 172.21.15.49:0/4264780728 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a180d1e40 0x7f2a180b1630 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.192+0000 7f2a1ef00700 1 --2- 172.21.15.49:0/4264780728 >> v2:172.21.15.150:3300/0 conn(0x7f2a180cee10 0x7f2a180cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.192+0000 7f2a1ef00700 1 -- 172.21.15.49:0/4264780728 >> 172.21.15.49:0/4264780728 conn(0x7f2a1806e960 msgr2=0x7f2a1806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:48.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.192+0000 7f2a1ef00700 1 -- 172.21.15.49:0/4264780728 shutdown_connections 2023-07-21T22:11:48.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.192+0000 7f2a1ef00700 1 -- 172.21.15.49:0/4264780728 wait complete. 2023-07-21T22:11:48.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.192+0000 7f2a1ef00700 1 Processor -- start 2023-07-21T22:11:48.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1ef00700 1 -- start start 2023-07-21T22:11:48.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1ef00700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a180b7af0 0x7f2a18151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:48.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1ef00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a180cee10 0x7f2a180c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:48.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1ef00700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a180d1e40 0x7f2a180b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:48.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1ef00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1815c8e0 con 0x7f2a180cee10 2023-07-21T22:11:48.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1ef00700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1815cbc0 con 0x7f2a180b7af0 2023-07-21T22:11:48.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1ef00700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1815cea0 con 0x7f2a180d1e40 2023-07-21T22:11:48.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1d6fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a180cee10 0x7f2a180c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:48.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1d6fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a180cee10 0x7f2a180c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60822/0 (socket says 172.21.15.49:60822) 2023-07-21T22:11:48.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1d6fd700 1 -- 172.21.15.49:0/105628455 learned_addr learned my addr 172.21.15.49:0/105628455 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:48.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1defe700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a180b7af0 0x7f2a18151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:48.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1e6ff700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a180d1e40 0x7f2a180b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:48.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1d6fd700 1 -- 172.21.15.49:0/105628455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a180d1e40 msgr2=0x7f2a180b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:48.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1d6fd700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a180d1e40 0x7f2a180b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1d6fd700 1 -- 172.21.15.49:0/105628455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a180b7af0 msgr2=0x7f2a18151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:48.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1d6fd700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a180b7af0 0x7f2a18151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1d6fd700 1 -- 172.21.15.49:0/105628455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08009570 con 0x7f2a180cee10 2023-07-21T22:11:48.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1e6ff700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a180d1e40 0x7f2a180b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:48.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1d6fd700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a180cee10 0x7f2a180c8610 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2a08000c00 tx=0x7f2a08004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:48.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a0e7fc700 1 -- 172.21.15.49:0/105628455 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08004590 con 0x7f2a180cee10 2023-07-21T22:11:48.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a0e7fc700 1 -- 172.21.15.49:0/105628455 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a080036c0 con 0x7f2a180cee10 2023-07-21T22:11:48.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a0e7fc700 1 -- 172.21.15.49:0/105628455 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08003a70 con 0x7f2a180cee10 2023-07-21T22:11:48.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.196+0000 7f2a1ef00700 1 -- 172.21.15.49:0/105628455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1815d180 con 0x7f2a180cee10 2023-07-21T22:11:48.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.200+0000 7f2a1ef00700 1 -- 172.21.15.49:0/105628455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a180c8b50 con 0x7f2a180cee10 2023-07-21T22:11:48.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.200+0000 7f2a1ef00700 1 -- 172.21.15.49:0/105628455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a1815d6a0 con 0x7f2a180cee10 2023-07-21T22:11:48.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.200+0000 7f2a0e7fc700 1 -- 172.21.15.49:0/105628455 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2a08003bd0 con 0x7f2a180cee10 2023-07-21T22:11:48.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.204+0000 7f2a0e7fc700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29fc0662f0 0x7f29fc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:48.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.204+0000 7f2a0e7fc700 1 -- 172.21.15.49:0/105628455 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2a08021030 con 0x7f2a180cee10 2023-07-21T22:11:48.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.204+0000 7f2a1defe700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29fc0662f0 0x7f29fc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:48.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.204+0000 7f2a1defe700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29fc0662f0 0x7f29fc0687a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a180b4d80 tx=0x7f2a14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:48.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.208+0000 7f2a0e7fc700 1 -- 172.21.15.49:0/105628455 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2a1815d6a0 con 0x7f2a180cee10 2023-07-21T22:11:48.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.384+0000 7f2a1ef00700 1 -- 172.21.15.49:0/105628455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2a1815d6a0 con 0x7f2a180cee10 2023-07-21T22:11:48.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.384+0000 7f2a0e7fc700 1 -- 172.21.15.49:0/105628455 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2a1815d6a0 con 0x7f2a180cee10 2023-07-21T22:11:48.429 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:48.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.388+0000 7f2a1ef00700 1 -- 172.21.15.49:0/105628455 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29fc0662f0 msgr2=0x7f29fc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:48.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.388+0000 7f2a1ef00700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29fc0662f0 0x7f29fc0687a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a180b4d80 tx=0x7f2a14009040 comp rx=0 tx=0).stop 2023-07-21T22:11:48.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.388+0000 7f2a1ef00700 1 -- 172.21.15.49:0/105628455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a180cee10 msgr2=0x7f2a180c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:48.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.388+0000 7f2a1ef00700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a180cee10 0x7f2a180c8610 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2a08000c00 tx=0x7f2a08004770 comp rx=0 tx=0).stop 2023-07-21T22:11:48.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.388+0000 7f2a1ef00700 1 -- 172.21.15.49:0/105628455 shutdown_connections 2023-07-21T22:11:48.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.388+0000 7f2a1ef00700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29fc0662f0 0x7f29fc0687a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.388+0000 7f2a1ef00700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a180cee10 0x7f2a180c8610 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.388+0000 7f2a1ef00700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a180d1e40 0x7f2a180b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.388+0000 7f2a1ef00700 1 --2- 172.21.15.49:0/105628455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a180b7af0 0x7f2a18151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.388+0000 7f2a1ef00700 1 -- 172.21.15.49:0/105628455 >> 172.21.15.49:0/105628455 conn(0x7f2a1806e960 msgr2=0x7f2a1815b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:48.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.388+0000 7f2a1ef00700 1 -- 172.21.15.49:0/105628455 shutdown_connections 2023-07-21T22:11:48.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.388+0000 7f2a1ef00700 1 -- 172.21.15.49:0/105628455 wait complete. 2023-07-21T22:11:48.451 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:11:48.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.584+0000 7fe149dd5700 1 Processor -- start 2023-07-21T22:11:48.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.584+0000 7fe149dd5700 1 -- start start 2023-07-21T22:11:48.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.584+0000 7fe149dd5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1440afc20 0x7fe1440cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:48.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.584+0000 7fe149dd5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1440c8860 0x7fe144070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:48.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.584+0000 7fe149dd5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1440cdeb0 con 0x7fe1441604c0 2023-07-21T22:11:48.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.584+0000 7fe149dd5700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe144163df0 con 0x7fe1440afc20 2023-07-21T22:11:48.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.584+0000 7fe149dd5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1441640d0 con 0x7fe1440c8860 2023-07-21T22:11:48.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe1437fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1440afc20 0x7fe1440cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:48.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe142ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe1441604c0 0x7fe1440afff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60278/0 (socket says 172.21.15.49:60278) 2023-07-21T22:11:48.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe142ffd700 1 -- 172.21.15.49:0/205295709 learned_addr learned my addr 172.21.15.49:0/205295709 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:48.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe143fff700 1 --2- 172.21.15.49:0/205295709 >> v2:172.21.15.150:3300/0 conn(0x7fe1440c8860 0x7fe144070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:48.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe1427fc700 1 -- 172.21.15.49:0/205295709 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340482922 0 0) 0x7fe1440cdeb0 con 0x7fe1441604c0 2023-07-21T22:11:48.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe1427fc700 1 -- 172.21.15.49:0/205295709 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe12c0035d0 con 0x7fe1441604c0 2023-07-21T22:11:48.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe1437fe700 1 -- 172.21.15.49:0/205295709 >> v2:172.21.15.150:3300/0 conn(0x7fe1440c8860 msgr2=0x7fe144070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:48.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe1437fe700 1 --2- 172.21.15.49:0/205295709 >> v2:172.21.15.150:3300/0 conn(0x7fe1440c8860 0x7fe144070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe1437fe700 1 -- 172.21.15.49:0/205295709 >> v1:172.21.15.49:6789/0 conn(0x7fe1441604c0 legacy=0x7fe1440afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:48.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe1437fe700 1 -- 172.21.15.49:0/205295709 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1441643b0 con 0x7fe1440afc20 2023-07-21T22:11:48.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe1437fe700 1 --2- 172.21.15.49:0/205295709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1440afc20 0x7fe1440cd970 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe1440b0d20 tx=0x7fe134009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8df9e1ade8f5639 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:48.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe1427fc700 1 -- 172.21.15.49:0/205295709 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134011830 con 0x7fe1440afc20 2023-07-21T22:11:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe1427fc700 1 -- 172.21.15.49:0/205295709 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134011990 con 0x7fe1440afc20 2023-07-21T22:11:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe1427fc700 1 -- 172.21.15.49:0/205295709 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134011d20 con 0x7fe1440afc20 2023-07-21T22:11:48.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe149dd5700 1 -- 172.21.15.49:0/205295709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1440afc20 msgr2=0x7fe1440cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:48.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe149dd5700 1 --2- 172.21.15.49:0/205295709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1440afc20 0x7fe1440cd970 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe1440b0d20 tx=0x7fe134009b30 comp rx=0 tx=0).stop 2023-07-21T22:11:48.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe149dd5700 1 -- 172.21.15.49:0/205295709 shutdown_connections 2023-07-21T22:11:48.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe149dd5700 1 --2- 172.21.15.49:0/205295709 >> v2:172.21.15.150:3300/0 conn(0x7fe1440c8860 0x7fe144070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe149dd5700 1 --2- 172.21.15.49:0/205295709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1440afc20 0x7fe1440cd970 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe149dd5700 1 -- 172.21.15.49:0/205295709 >> 172.21.15.49:0/205295709 conn(0x7fe14406f5a0 msgr2=0x7fe1440cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:48.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe149dd5700 1 -- 172.21.15.49:0/205295709 shutdown_connections 2023-07-21T22:11:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.588+0000 7fe149dd5700 1 -- 172.21.15.49:0/205295709 wait complete. 2023-07-21T22:11:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.592+0000 7fe149dd5700 1 Processor -- start 2023-07-21T22:11:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.592+0000 7fe149dd5700 1 -- start start 2023-07-21T22:11:48.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe149dd5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1440afc20 0x7fe144163620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:48.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe149dd5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1440c8860 0x7fe1441f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:48.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe149dd5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1441604c0 0x7fe14415ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:48.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe149dd5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe144163b60 con 0x7fe1440c8860 2023-07-21T22:11:48.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe149dd5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1441f62a0 con 0x7fe1441604c0 2023-07-21T22:11:48.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe149dd5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1441f6580 con 0x7fe1440afc20 2023-07-21T22:11:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe142ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1440c8860 0x7fe1441f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe142ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1440c8860 0x7fe1441f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60840/0 (socket says 172.21.15.49:60840) 2023-07-21T22:11:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe142ffd700 1 -- 172.21.15.49:0/1215854071 learned_addr learned my addr 172.21.15.49:0/1215854071 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe143fff700 1 --2- 172.21.15.49:0/1215854071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1441604c0 0x7fe14415ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe1437fe700 1 --2- 172.21.15.49:0/1215854071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1440afc20 0x7fe144163620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe142ffd700 1 -- 172.21.15.49:0/1215854071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1440afc20 msgr2=0x7fe144163620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe142ffd700 1 --2- 172.21.15.49:0/1215854071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1440afc20 0x7fe144163620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe142ffd700 1 -- 172.21.15.49:0/1215854071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1441604c0 msgr2=0x7fe14415ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe142ffd700 1 --2- 172.21.15.49:0/1215854071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1441604c0 0x7fe14415ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe142ffd700 1 -- 172.21.15.49:0/1215854071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1340094b0 con 0x7fe1440c8860 2023-07-21T22:11:48.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe142ffd700 1 --2- 172.21.15.49:0/1215854071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1440c8860 0x7fe1441f57d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe13800c4d0 tx=0x7fe13800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:48.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe12bfff700 1 -- 172.21.15.49:0/1215854071 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138005d90 con 0x7fe1440c8860 2023-07-21T22:11:48.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe12bfff700 1 -- 172.21.15.49:0/1215854071 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1380070d0 con 0x7fe1440c8860 2023-07-21T22:11:48.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe12bfff700 1 -- 172.21.15.49:0/1215854071 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138007480 con 0x7fe1440c8860 2023-07-21T22:11:48.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe149dd5700 1 -- 172.21.15.49:0/1215854071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe144162e20 con 0x7fe1440c8860 2023-07-21T22:11:48.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.596+0000 7fe149dd5700 1 -- 172.21.15.49:0/1215854071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe144162ad0 con 0x7fe1440c8860 2023-07-21T22:11:48.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.600+0000 7fe149dd5700 1 -- 172.21.15.49:0/1215854071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14404dcb0 con 0x7fe1440c8860 2023-07-21T22:11:48.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.600+0000 7fe12bfff700 1 -- 172.21.15.49:0/1215854071 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1380075e0 con 0x7fe1440c8860 2023-07-21T22:11:48.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.604+0000 7fe12bfff700 1 --2- 172.21.15.49:0/1215854071 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe130066320 0x7fe1300687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:48.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.604+0000 7fe12bfff700 1 -- 172.21.15.49:0/1215854071 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe1380835d0 con 0x7fe1440c8860 2023-07-21T22:11:48.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.604+0000 7fe1437fe700 1 --2- 172.21.15.49:0/1215854071 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe130066320 0x7fe1300687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:48.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.604+0000 7fe1437fe700 1 --2- 172.21.15.49:0/1215854071 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe130066320 0x7fe1300687d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe134000c00 tx=0x7fe134008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:48.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.604+0000 7fe12bfff700 1 -- 172.21.15.49:0/1215854071 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe138050790 con 0x7fe1440c8860 2023-07-21T22:11:48.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.788+0000 7fe149dd5700 1 -- 172.21.15.49:0/1215854071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe1440c4fe0 con 0x7fe1440c8860 2023-07-21T22:11:48.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.788+0000 7fe12bfff700 1 -- 172.21.15.49:0/1215854071 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe138053db0 con 0x7fe1440c8860 2023-07-21T22:11:48.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.792+0000 7fe149dd5700 1 -- 172.21.15.49:0/1215854071 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe130066320 msgr2=0x7fe1300687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:48.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.792+0000 7fe149dd5700 1 --2- 172.21.15.49:0/1215854071 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe130066320 0x7fe1300687d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe134000c00 tx=0x7fe134008030 comp rx=0 tx=0).stop 2023-07-21T22:11:48.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.792+0000 7fe149dd5700 1 -- 172.21.15.49:0/1215854071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1440c8860 msgr2=0x7fe1441f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:48.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.792+0000 7fe149dd5700 1 --2- 172.21.15.49:0/1215854071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1440c8860 0x7fe1441f57d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe13800c4d0 tx=0x7fe13800c7e0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.792+0000 7fe149dd5700 1 -- 172.21.15.49:0/1215854071 shutdown_connections 2023-07-21T22:11:48.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.792+0000 7fe149dd5700 1 --2- 172.21.15.49:0/1215854071 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe130066320 0x7fe1300687d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.792+0000 7fe149dd5700 1 --2- 172.21.15.49:0/1215854071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1440c8860 0x7fe1441f57d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.792+0000 7fe149dd5700 1 --2- 172.21.15.49:0/1215854071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1441604c0 0x7fe14415ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.792+0000 7fe149dd5700 1 --2- 172.21.15.49:0/1215854071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1440afc20 0x7fe144163620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:48.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.792+0000 7fe149dd5700 1 -- 172.21.15.49:0/1215854071 >> 172.21.15.49:0/1215854071 conn(0x7fe14406f5a0 msgr2=0x7fe1440afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:48.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.792+0000 7fe149dd5700 1 -- 172.21.15.49:0/1215854071 shutdown_connections 2023-07-21T22:11:48.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:48.792+0000 7fe149dd5700 1 -- 172.21.15.49:0/1215854071 wait complete. 2023-07-21T22:11:48.839 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:11:48.859 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:11:48.860 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:11:48.880 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:49.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.012+0000 7fcd4d4d6700 1 Processor -- start 2023-07-21T22:11:49.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.012+0000 7fcd4d4d6700 1 -- start start 2023-07-21T22:11:49.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.016+0000 7fcd4d4d6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd481604c0 0x7fcd480afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.016+0000 7fcd4d4d6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd480b0530 con 0x7fcd480c8860 2023-07-21T22:11:49.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.016+0000 7fcd4d4d6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd48163df0 con 0x7fcd480afc20 2023-07-21T22:11:49.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.016+0000 7fcd4d4d6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd481640d0 con 0x7fcd481604c0 2023-07-21T22:11:49.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.016+0000 7fcd477fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcd480c8860 0x7fcd48070600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60284/0 (socket says 172.21.15.49:60284) 2023-07-21T22:11:49.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.016+0000 7fcd477fe700 1 -- 172.21.15.49:0/866896987 learned_addr learned my addr 172.21.15.49:0/866896987 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:49.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.016+0000 7fcd467fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd481604c0 0x7fcd480afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd45ffb700 1 -- 172.21.15.49:0/866896987 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301252112 0 0) 0x7fcd480b0530 con 0x7fcd480c8860 2023-07-21T22:11:49.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd45ffb700 1 -- 172.21.15.49:0/866896987 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd300035d0 con 0x7fcd480c8860 2023-07-21T22:11:49.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd45ffb700 1 -- 172.21.15.49:0/866896987 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063088574 0 0) 0x7fcd48163df0 con 0x7fcd480afc20 2023-07-21T22:11:49.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd467fc700 1 -- 172.21.15.49:0/866896987 >> v1:172.21.15.150:6789/0 conn(0x7fcd480afc20 legacy=0x7fcd480cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd467fc700 1 -- 172.21.15.49:0/866896987 >> v1:172.21.15.49:6789/0 conn(0x7fcd480c8860 legacy=0x7fcd48070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd467fc700 1 -- 172.21.15.49:0/866896987 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd481643b0 con 0x7fcd481604c0 2023-07-21T22:11:49.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd467fc700 1 --2- 172.21.15.49:0/866896987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd481604c0 0x7fcd480afff0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009850 tx=0x7fcd3c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81c69ecc26daf8d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:49.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd45ffb700 1 -- 172.21.15.49:0/866896987 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c011830 con 0x7fcd481604c0 2023-07-21T22:11:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd45ffb700 1 -- 172.21.15.49:0/866896987 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c011990 con 0x7fcd481604c0 2023-07-21T22:11:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd45ffb700 1 -- 172.21.15.49:0/866896987 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c011d00 con 0x7fcd481604c0 2023-07-21T22:11:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/866896987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd481604c0 msgr2=0x7fcd480afff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd4d4d6700 1 --2- 172.21.15.49:0/866896987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd481604c0 0x7fcd480afff0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009850 tx=0x7fcd3c009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/866896987 shutdown_connections 2023-07-21T22:11:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd4d4d6700 1 --2- 172.21.15.49:0/866896987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd481604c0 0x7fcd480afff0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/866896987 >> 172.21.15.49:0/866896987 conn(0x7fcd4806f5a0 msgr2=0x7fcd480cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:49.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/866896987 shutdown_connections 2023-07-21T22:11:49.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.020+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/866896987 wait complete. 2023-07-21T22:11:49.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.024+0000 7fcd4d4d6700 1 Processor -- start 2023-07-21T22:11:49.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.024+0000 7fcd4d4d6700 1 -- start start 2023-07-21T22:11:49.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.024+0000 7fcd4d4d6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd480afc20 0x7fcd4806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.024+0000 7fcd4d4d6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd480c8860 0x7fcd48163510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.024+0000 7fcd4d4d6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd481604c0 0x7fcd480b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.024+0000 7fcd4d4d6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480c3c00 con 0x7fcd481604c0 2023-07-21T22:11:49.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.024+0000 7fcd4d4d6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480c3ec0 con 0x7fcd480c8860 2023-07-21T22:11:49.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.024+0000 7fcd4d4d6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480c41a0 con 0x7fcd480afc20 2023-07-21T22:11:49.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.024+0000 7fcd477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd481604c0 0x7fcd480b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.024+0000 7fcd477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd481604c0 0x7fcd480b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60872/0 (socket says 172.21.15.49:60872) 2023-07-21T22:11:49.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.024+0000 7fcd477fe700 1 -- 172.21.15.49:0/4206811148 learned_addr learned my addr 172.21.15.49:0/4206811148 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:49.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.024+0000 7fcd467fc700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd480c8860 0x7fcd48163510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.028+0000 7fcd46ffd700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd480afc20 0x7fcd4806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.028+0000 7fcd477fe700 1 -- 172.21.15.49:0/4206811148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd480afc20 msgr2=0x7fcd4806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.028+0000 7fcd477fe700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd480afc20 0x7fcd4806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.028+0000 7fcd477fe700 1 -- 172.21.15.49:0/4206811148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd480c8860 msgr2=0x7fcd48163510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.028+0000 7fcd477fe700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd480c8860 0x7fcd48163510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.028+0000 7fcd477fe700 1 -- 172.21.15.49:0/4206811148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c0094b0 con 0x7fcd481604c0 2023-07-21T22:11:49.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.028+0000 7fcd46ffd700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd480afc20 0x7fcd4806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:49.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.028+0000 7fcd477fe700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd481604c0 0x7fcd480b1cd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000cb40 tx=0x7fcd4000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:49.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.028+0000 7fcd2f7fe700 1 -- 172.21.15.49:0/4206811148 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000a9e0 con 0x7fcd481604c0 2023-07-21T22:11:49.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.028+0000 7fcd2f7fe700 1 -- 172.21.15.49:0/4206811148 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4000ab40 con 0x7fcd481604c0 2023-07-21T22:11:49.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.028+0000 7fcd2f7fe700 1 -- 172.21.15.49:0/4206811148 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000ce60 con 0x7fcd481604c0 2023-07-21T22:11:49.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.028+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/4206811148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd480c4480 con 0x7fcd481604c0 2023-07-21T22:11:49.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.028+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/4206811148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd480b1120 con 0x7fcd481604c0 2023-07-21T22:11:49.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.028+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/4206811148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd480c49a0 con 0x7fcd481604c0 2023-07-21T22:11:49.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.032+0000 7fcd2f7fe700 1 -- 172.21.15.49:0/4206811148 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcd4001b3b0 con 0x7fcd481604c0 2023-07-21T22:11:49.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.032+0000 7fcd2f7fe700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd340662f0 0x7fcd340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.032+0000 7fcd2f7fe700 1 -- 172.21.15.49:0/4206811148 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcd40083b70 con 0x7fcd481604c0 2023-07-21T22:11:49.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.032+0000 7fcd46ffd700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd340662f0 0x7fcd340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.032+0000 7fcd46ffd700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd340662f0 0x7fcd340687a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcd481f8e80 tx=0x7fcd38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:49.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.040+0000 7fcd2f7fe700 1 -- 172.21.15.49:0/4206811148 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd40050cc0 con 0x7fcd481604c0 2023-07-21T22:11:49.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.212+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/4206811148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd48070060 con 0x7fcd481604c0 2023-07-21T22:11:49.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.216+0000 7fcd2f7fe700 1 -- 172.21.15.49:0/4206811148 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7fcd400542e0 con 0x7fcd481604c0 2023-07-21T22:11:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:49.260 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:49.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.216+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/4206811148 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd340662f0 msgr2=0x7fcd340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.216+0000 7fcd4d4d6700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd340662f0 0x7fcd340687a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcd481f8e80 tx=0x7fcd38009040 comp rx=0 tx=0).stop 2023-07-21T22:11:49.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.216+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/4206811148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd481604c0 msgr2=0x7fcd480b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.216+0000 7fcd4d4d6700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd481604c0 0x7fcd480b1cd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000cb40 tx=0x7fcd4000cc20 comp rx=0 tx=0).stop 2023-07-21T22:11:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.220+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/4206811148 shutdown_connections 2023-07-21T22:11:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.220+0000 7fcd4d4d6700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd340662f0 0x7fcd340687a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.220+0000 7fcd4d4d6700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd481604c0 0x7fcd480b1cd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.220+0000 7fcd4d4d6700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd480c8860 0x7fcd48163510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.220+0000 7fcd4d4d6700 1 --2- 172.21.15.49:0/4206811148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd480afc20 0x7fcd4806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.220+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/4206811148 >> 172.21.15.49:0/4206811148 conn(0x7fcd4806f5a0 msgr2=0x7fcd480c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.220+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/4206811148 shutdown_connections 2023-07-21T22:11:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.220+0000 7fcd4d4d6700 1 -- 172.21.15.49:0/4206811148 wait complete. 2023-07-21T22:11:49.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:11:49.286 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:11:49.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.428+0000 7f9a836bc700 1 Processor -- start 2023-07-21T22:11:49.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.428+0000 7f9a836bc700 1 -- start start 2023-07-21T22:11:49.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a836bc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a7c158aa0 0x7f9a7c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a836bc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9a7c0cb540 0x7f9a7c0cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a836bc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a7c0cd220 0x7f9a7c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a836bc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7c0cc740 con 0x7f9a7c158aa0 2023-07-21T22:11:49.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a836bc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7c158e70 con 0x7f9a7c0cb540 2023-07-21T22:11:49.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a836bc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c15c5a0 con 0x7f9a7c0cd220 2023-07-21T22:11:49.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a81458700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a7c158aa0 0x7f9a7c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a81458700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a7c158aa0 0x7f9a7c0cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60888/0 (socket says 172.21.15.49:60888) 2023-07-21T22:11:49.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a81458700 1 -- 172.21.15.49:0/3982791637 learned_addr learned my addr 172.21.15.49:0/3982791637 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:49.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a81c59700 1 --2- 172.21.15.49:0/3982791637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a7c0cd220 0x7f9a7c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a80c57700 1 --2- 172.21.15.49:0/3982791637 >> v2:172.21.15.150:3300/0 conn(0x7f9a7c0cb540 0x7f9a7c0cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a81458700 1 -- 172.21.15.49:0/3982791637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a7c0cd220 msgr2=0x7f9a7c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:49.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a81458700 1 --2- 172.21.15.49:0/3982791637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a7c0cd220 0x7f9a7c06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a81458700 1 -- 172.21.15.49:0/3982791637 >> v2:172.21.15.150:3300/0 conn(0x7f9a7c0cb540 msgr2=0x7f9a7c0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:49.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a81458700 1 --2- 172.21.15.49:0/3982791637 >> v2:172.21.15.150:3300/0 conn(0x7f9a7c0cb540 0x7f9a7c0cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a81458700 1 -- 172.21.15.49:0/3982791637 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c15c880 con 0x7f9a7c158aa0 2023-07-21T22:11:49.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.432+0000 7f9a80c57700 1 --2- 172.21.15.49:0/3982791637 >> v2:172.21.15.150:3300/0 conn(0x7f9a7c0cb540 0x7f9a7c0cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:49.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.436+0000 7f9a81458700 1 --2- 172.21.15.49:0/3982791637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a7c158aa0 0x7f9a7c0cd770 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c070970 tx=0x7f9a78009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a313ea5c572a6c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:49.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.436+0000 7f9a73fff700 1 -- 172.21.15.49:0/3982791637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78011830 con 0x7f9a7c158aa0 2023-07-21T22:11:49.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.436+0000 7f9a73fff700 1 -- 172.21.15.49:0/3982791637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a78011990 con 0x7f9a7c158aa0 2023-07-21T22:11:49.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.436+0000 7f9a73fff700 1 -- 172.21.15.49:0/3982791637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78011d40 con 0x7f9a7c158aa0 2023-07-21T22:11:49.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.436+0000 7f9a836bc700 1 -- 172.21.15.49:0/3982791637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a7c158aa0 msgr2=0x7f9a7c0cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.436+0000 7f9a836bc700 1 --2- 172.21.15.49:0/3982791637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a7c158aa0 0x7f9a7c0cd770 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c070970 tx=0x7f9a78009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:49.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.436+0000 7f9a836bc700 1 -- 172.21.15.49:0/3982791637 shutdown_connections 2023-07-21T22:11:49.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.436+0000 7f9a836bc700 1 --2- 172.21.15.49:0/3982791637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a7c0cd220 0x7f9a7c06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.436+0000 7f9a836bc700 1 --2- 172.21.15.49:0/3982791637 >> v2:172.21.15.150:3300/0 conn(0x7f9a7c0cb540 0x7f9a7c0cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.436+0000 7f9a836bc700 1 --2- 172.21.15.49:0/3982791637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a7c158aa0 0x7f9a7c0cd770 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.436+0000 7f9a836bc700 1 -- 172.21.15.49:0/3982791637 >> 172.21.15.49:0/3982791637 conn(0x7f9a7c0b0e30 msgr2=0x7f9a7c0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:49.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.436+0000 7f9a836bc700 1 -- 172.21.15.49:0/3982791637 shutdown_connections 2023-07-21T22:11:49.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.436+0000 7f9a836bc700 1 -- 172.21.15.49:0/3982791637 wait complete. 2023-07-21T22:11:49.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a836bc700 1 Processor -- start 2023-07-21T22:11:49.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a836bc700 1 -- start start 2023-07-21T22:11:49.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a836bc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a7c0cb540 0x7f9a7c0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a836bc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7c0cd220 0x7f9a7c0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a836bc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a7c158aa0 0x7f9a7c0b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a836bc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c15b840 con 0x7f9a7c0cb540 2023-07-21T22:11:49.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a836bc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c159d00 con 0x7f9a7c0cd220 2023-07-21T22:11:49.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a836bc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c06b090 con 0x7f9a7c158aa0 2023-07-21T22:11:49.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a81458700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a7c0cb540 0x7f9a7c0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a81458700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a7c0cb540 0x7f9a7c0c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60904/0 (socket says 172.21.15.49:60904) 2023-07-21T22:11:49.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a81458700 1 -- 172.21.15.49:0/190369125 learned_addr learned my addr 172.21.15.49:0/190369125 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:49.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a80c57700 1 --2- 172.21.15.49:0/190369125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7c0cd220 0x7f9a7c0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a81c59700 1 --2- 172.21.15.49:0/190369125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a7c158aa0 0x7f9a7c0b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a81458700 1 -- 172.21.15.49:0/190369125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a7c158aa0 msgr2=0x7f9a7c0b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a81458700 1 --2- 172.21.15.49:0/190369125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a7c158aa0 0x7f9a7c0b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a81458700 1 -- 172.21.15.49:0/190369125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7c0cd220 msgr2=0x7f9a7c0b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a81458700 1 --2- 172.21.15.49:0/190369125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7c0cd220 0x7f9a7c0b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.440+0000 7f9a81458700 1 -- 172.21.15.49:0/190369125 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c0094b0 con 0x7f9a7c0cb540 2023-07-21T22:11:49.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.444+0000 7f9a81458700 1 --2- 172.21.15.49:0/190369125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a7c0cb540 0x7f9a7c0c8e90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9a78000c00 tx=0x7f9a78004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:49.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.444+0000 7f9a71ffb700 1 -- 172.21.15.49:0/190369125 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78004450 con 0x7f9a7c0cb540 2023-07-21T22:11:49.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.444+0000 7f9a71ffb700 1 -- 172.21.15.49:0/190369125 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7801e070 con 0x7f9a7c0cb540 2023-07-21T22:11:49.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.444+0000 7f9a836bc700 1 -- 172.21.15.49:0/190369125 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a78009570 con 0x7f9a7c0cb540 2023-07-21T22:11:49.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.444+0000 7f9a71ffb700 1 -- 172.21.15.49:0/190369125 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78003900 con 0x7f9a7c0cb540 2023-07-21T22:11:49.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.444+0000 7f9a836bc700 1 -- 172.21.15.49:0/190369125 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7c15b4d0 con 0x7f9a7c0cb540 2023-07-21T22:11:49.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.444+0000 7f9a836bc700 1 -- 172.21.15.49:0/190369125 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7c15b660 con 0x7f9a7c0cb540 2023-07-21T22:11:49.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.448+0000 7f9a71ffb700 1 -- 172.21.15.49:0/190369125 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a78003a60 con 0x7f9a7c0cb540 2023-07-21T22:11:49.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.448+0000 7f9a71ffb700 1 --2- 172.21.15.49:0/190369125 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9a600662f0 0x7f9a600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.448+0000 7f9a71ffb700 1 -- 172.21.15.49:0/190369125 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9a78084de0 con 0x7f9a7c0cb540 2023-07-21T22:11:49.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.448+0000 7f9a80c57700 1 --2- 172.21.15.49:0/190369125 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9a600662f0 0x7f9a600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.448+0000 7f9a80c57700 1 --2- 172.21.15.49:0/190369125 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9a600662f0 0x7f9a600687a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c14f070 tx=0x7f9a6c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:49.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.456+0000 7f9a71ffb700 1 -- 172.21.15.49:0/190369125 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a78052000 con 0x7f9a7c0cb540 2023-07-21T22:11:49.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.628+0000 7f9a836bc700 1 -- 172.21.15.49:0/190369125 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a7c04dd50 con 0x7f9a7c0cb540 2023-07-21T22:11:49.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.632+0000 7f9a71ffb700 1 -- 172.21.15.49:0/190369125 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a78055620 con 0x7f9a7c0cb540 2023-07-21T22:11:49.675 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:11:49.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.636+0000 7f9a836bc700 1 -- 172.21.15.49:0/190369125 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9a600662f0 msgr2=0x7f9a600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.636+0000 7f9a836bc700 1 --2- 172.21.15.49:0/190369125 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9a600662f0 0x7f9a600687a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c14f070 tx=0x7f9a6c009240 comp rx=0 tx=0).stop 2023-07-21T22:11:49.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.636+0000 7f9a836bc700 1 -- 172.21.15.49:0/190369125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a7c0cb540 msgr2=0x7f9a7c0c8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.636+0000 7f9a836bc700 1 --2- 172.21.15.49:0/190369125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a7c0cb540 0x7f9a7c0c8e90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9a78000c00 tx=0x7f9a78004770 comp rx=0 tx=0).stop 2023-07-21T22:11:49.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.636+0000 7f9a836bc700 1 -- 172.21.15.49:0/190369125 shutdown_connections 2023-07-21T22:11:49.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.636+0000 7f9a836bc700 1 --2- 172.21.15.49:0/190369125 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9a600662f0 0x7f9a600687a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.636+0000 7f9a836bc700 1 --2- 172.21.15.49:0/190369125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a7c158aa0 0x7f9a7c0b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.636+0000 7f9a836bc700 1 --2- 172.21.15.49:0/190369125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7c0cd220 0x7f9a7c0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.636+0000 7f9a836bc700 1 --2- 172.21.15.49:0/190369125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a7c0cb540 0x7f9a7c0c8e90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.636+0000 7f9a836bc700 1 -- 172.21.15.49:0/190369125 >> 172.21.15.49:0/190369125 conn(0x7f9a7c0b0e30 msgr2=0x7f9a7c0c4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:49.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.636+0000 7f9a836bc700 1 -- 172.21.15.49:0/190369125 shutdown_connections 2023-07-21T22:11:49.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.636+0000 7f9a836bc700 1 -- 172.21.15.49:0/190369125 wait complete. 2023-07-21T22:11:49.701 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:11:49.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.844+0000 7fe0d3dae700 1 Processor -- start 2023-07-21T22:11:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.844+0000 7fe0d3dae700 1 -- start start 2023-07-21T22:11:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d3dae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0cc0b4040 0x7fe0cc0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d3dae700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe0cc0b4410 0x7fe0cc0b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d3dae700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0cc0b8170 con 0x7fe0cc15f960 2023-07-21T22:11:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d3dae700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0cc0cfa20 con 0x7fe0cc0b4410 2023-07-21T22:11:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d3dae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0d03c0 con 0x7fe0cc0b4040 2023-07-21T22:11:49.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d1349700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe0cc0b4410 0x7fe0cc0b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d234b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe0cc15f960 0x7fe0cc15fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:49370/0 (socket says 172.21.15.49:49370) 2023-07-21T22:11:49.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d1b4a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0cc0b4040 0x7fe0cc0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d234b700 1 -- 172.21.15.49:0/495769359 learned_addr learned my addr 172.21.15.49:0/495769359 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:49.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d1349700 1 --2- 172.21.15.49:0/495769359 >> v2:172.21.15.150:3300/0 conn(0x7fe0cc0b4410 0x7fe0cc0b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:60554/0 (socket says 172.21.15.49:60554) 2023-07-21T22:11:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d1349700 1 -- 172.21.15.49:0/495769359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0cc0b4040 msgr2=0x7fe0cc0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d1349700 1 --2- 172.21.15.49:0/495769359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0cc0b4040 0x7fe0cc0cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d1349700 1 -- 172.21.15.49:0/495769359 >> v1:172.21.15.150:6789/0 conn(0x7fe0cc15f960 legacy=0x7fe0cc15fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d1349700 1 -- 172.21.15.49:0/495769359 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc0d2350 con 0x7fe0cc0b4410 2023-07-21T22:11:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.848+0000 7fe0d1349700 1 --2- 172.21.15.49:0/495769359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0cc0b4410 0x7fe0cc0b4860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009850 tx=0x7fe0bc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cffaec238566b1f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.852+0000 7fe0d0b48700 1 -- 172.21.15.49:0/495769359 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc011830 con 0x7fe0cc0b4410 2023-07-21T22:11:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.852+0000 7fe0d0b48700 1 -- 172.21.15.49:0/495769359 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc011990 con 0x7fe0cc0b4410 2023-07-21T22:11:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.852+0000 7fe0d0b48700 1 -- 172.21.15.49:0/495769359 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc011d40 con 0x7fe0cc0b4410 2023-07-21T22:11:49.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.852+0000 7fe0d3dae700 1 -- 172.21.15.49:0/495769359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0cc0b4410 msgr2=0x7fe0cc0b4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.852+0000 7fe0d3dae700 1 --2- 172.21.15.49:0/495769359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0cc0b4410 0x7fe0cc0b4860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009850 tx=0x7fe0bc009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.852+0000 7fe0d3dae700 1 -- 172.21.15.49:0/495769359 shutdown_connections 2023-07-21T22:11:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.852+0000 7fe0d3dae700 1 --2- 172.21.15.49:0/495769359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0cc0b4410 0x7fe0cc0b4860 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.852+0000 7fe0d3dae700 1 --2- 172.21.15.49:0/495769359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0cc0b4040 0x7fe0cc0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.852+0000 7fe0d3dae700 1 -- 172.21.15.49:0/495769359 >> 172.21.15.49:0/495769359 conn(0x7fe0cc0658e0 msgr2=0x7fe0cc06fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.852+0000 7fe0d3dae700 1 -- 172.21.15.49:0/495769359 shutdown_connections 2023-07-21T22:11:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.852+0000 7fe0d3dae700 1 -- 172.21.15.49:0/495769359 wait complete. 2023-07-21T22:11:49.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d3dae700 1 Processor -- start 2023-07-21T22:11:49.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d3dae700 1 -- start start 2023-07-21T22:11:49.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d3dae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0cc0b4040 0x7fe0cc0c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d3dae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0cc0b4410 0x7fe0cc159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d3dae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0cc15f960 0x7fe0cc15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d3dae700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0c67f0 con 0x7fe0cc15f960 2023-07-21T22:11:49.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d3dae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc15f2d0 con 0x7fe0cc0b4410 2023-07-21T22:11:49.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d3dae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc15c600 con 0x7fe0cc0b4040 2023-07-21T22:11:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d234b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0cc15f960 0x7fe0cc15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d234b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0cc15f960 0x7fe0cc15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60908/0 (socket says 172.21.15.49:60908) 2023-07-21T22:11:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d234b700 1 -- 172.21.15.49:0/1997077231 learned_addr learned my addr 172.21.15.49:0/1997077231 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d1349700 1 --2- 172.21.15.49:0/1997077231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0cc0b4410 0x7fe0cc159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d1b4a700 1 --2- 172.21.15.49:0/1997077231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0cc0b4040 0x7fe0cc0c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d234b700 1 -- 172.21.15.49:0/1997077231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0cc0b4040 msgr2=0x7fe0cc0c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d234b700 1 --2- 172.21.15.49:0/1997077231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0cc0b4040 0x7fe0cc0c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d234b700 1 -- 172.21.15.49:0/1997077231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0cc0b4410 msgr2=0x7fe0cc159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:49.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d234b700 1 --2- 172.21.15.49:0/1997077231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0cc0b4410 0x7fe0cc159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:49.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d234b700 1 -- 172.21.15.49:0/1997077231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc0094b0 con 0x7fe0cc15f960 2023-07-21T22:11:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.856+0000 7fe0d234b700 1 --2- 172.21.15.49:0/1997077231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0cc15f960 0x7fe0cc15a360 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400cbc0 tx=0x7fe0c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.860+0000 7fe0c27fc700 1 -- 172.21.15.49:0/1997077231 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4007480 con 0x7fe0cc15f960 2023-07-21T22:11:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.860+0000 7fe0c27fc700 1 -- 172.21.15.49:0/1997077231 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c40075e0 con 0x7fe0cc15f960 2023-07-21T22:11:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.860+0000 7fe0d3dae700 1 -- 172.21.15.49:0/1997077231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0cc15c8e0 con 0x7fe0cc15f960 2023-07-21T22:11:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.860+0000 7fe0c27fc700 1 -- 172.21.15.49:0/1997077231 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4007950 con 0x7fe0cc15f960 2023-07-21T22:11:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.860+0000 7fe0d3dae700 1 -- 172.21.15.49:0/1997077231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc15cea0 con 0x7fe0cc15f960 2023-07-21T22:11:49.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.860+0000 7fe0d3dae700 1 -- 172.21.15.49:0/1997077231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc15d090 con 0x7fe0cc15f960 2023-07-21T22:11:49.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.864+0000 7fe0c27fc700 1 -- 172.21.15.49:0/1997077231 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0c4012400 con 0x7fe0cc15f960 2023-07-21T22:11:49.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.864+0000 7fe0c27fc700 1 --2- 172.21.15.49:0/1997077231 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe0b00662f0 0x7fe0b00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:49.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.864+0000 7fe0c27fc700 1 -- 172.21.15.49:0/1997077231 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe0c4083920 con 0x7fe0cc15f960 2023-07-21T22:11:49.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.864+0000 7fe0d1b4a700 1 --2- 172.21.15.49:0/1997077231 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe0b00662f0 0x7fe0b00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:49.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.864+0000 7fe0d1b4a700 1 --2- 172.21.15.49:0/1997077231 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe0b00662f0 0x7fe0b00687a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009b50 tx=0x7fe0c8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:49.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:49.868+0000 7fe0c27fc700 1 -- 172.21.15.49:0/1997077231 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0c4050a80 con 0x7fe0cc15f960 2023-07-21T22:11:50.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.044+0000 7fe0d3dae700 1 -- 172.21.15.49:0/1997077231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe0cc04dd50 con 0x7fe0cc15f960 2023-07-21T22:11:50.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.044+0000 7fe0c27fc700 1 -- 172.21.15.49:0/1997077231 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe0c4017020 con 0x7fe0cc15f960 2023-07-21T22:11:50.090 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:11:50.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.048+0000 7fe0d3dae700 1 -- 172.21.15.49:0/1997077231 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe0b00662f0 msgr2=0x7fe0b00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.048+0000 7fe0d3dae700 1 --2- 172.21.15.49:0/1997077231 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe0b00662f0 0x7fe0b00687a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009b50 tx=0x7fe0c8009240 comp rx=0 tx=0).stop 2023-07-21T22:11:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.048+0000 7fe0d3dae700 1 -- 172.21.15.49:0/1997077231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0cc15f960 msgr2=0x7fe0cc15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.048+0000 7fe0d3dae700 1 --2- 172.21.15.49:0/1997077231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0cc15f960 0x7fe0cc15a360 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400cbc0 tx=0x7fe0c400cbf0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.048+0000 7fe0d3dae700 1 -- 172.21.15.49:0/1997077231 shutdown_connections 2023-07-21T22:11:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.048+0000 7fe0d3dae700 1 --2- 172.21.15.49:0/1997077231 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe0b00662f0 0x7fe0b00687a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.048+0000 7fe0d3dae700 1 --2- 172.21.15.49:0/1997077231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0cc15f960 0x7fe0cc15a360 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.048+0000 7fe0d3dae700 1 --2- 172.21.15.49:0/1997077231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0cc0b4410 0x7fe0cc159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.048+0000 7fe0d3dae700 1 --2- 172.21.15.49:0/1997077231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0cc0b4040 0x7fe0cc0c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.048+0000 7fe0d3dae700 1 -- 172.21.15.49:0/1997077231 >> 172.21.15.49:0/1997077231 conn(0x7fe0cc0658e0 msgr2=0x7fe0cc0cfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:50.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.048+0000 7fe0d3dae700 1 -- 172.21.15.49:0/1997077231 shutdown_connections 2023-07-21T22:11:50.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.048+0000 7fe0d3dae700 1 -- 172.21.15.49:0/1997077231 wait complete. 2023-07-21T22:11:50.113 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:11:50.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.248+0000 7f75ab59e700 1 Processor -- start 2023-07-21T22:11:50.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.248+0000 7f75ab59e700 1 -- start start 2023-07-21T22:11:50.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.252+0000 7f75ab59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75ac0d1e40 0x7f75ac0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:50.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.252+0000 7f75ab59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f75ac0cee10 0x7f75ac0cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:50.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.252+0000 7f75ab59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac0b3e80 con 0x7f75ac0b7af0 2023-07-21T22:11:50.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.252+0000 7f75ab59e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac0cf790 con 0x7f75ac0d1e40 2023-07-21T22:11:50.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.252+0000 7f75ab59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac15fd40 con 0x7f75ac0cee10 2023-07-21T22:11:50.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.252+0000 7f75a9d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75ac0d1e40 0x7f75ac0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:50.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.252+0000 7f75aa59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f75ac0b7af0 0x7f75ac15f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60298/0 (socket says 172.21.15.49:60298) 2023-07-21T22:11:50.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.252+0000 7f75aa59c700 1 -- 172.21.15.49:0/4257659470 learned_addr learned my addr 172.21.15.49:0/4257659470 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:50.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75aad9d700 1 --2- 172.21.15.49:0/4257659470 >> v2:172.21.15.150:3300/0 conn(0x7f75ac0cee10 0x7f75ac0cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:50.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75a959a700 1 -- 172.21.15.49:0/4257659470 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653772005 0 0) 0x7f75ac0b3e80 con 0x7f75ac0b7af0 2023-07-21T22:11:50.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75a959a700 1 -- 172.21.15.49:0/4257659470 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75940035d0 con 0x7f75ac0b7af0 2023-07-21T22:11:50.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75a9d9b700 1 -- 172.21.15.49:0/4257659470 >> v2:172.21.15.150:3300/0 conn(0x7f75ac0cee10 msgr2=0x7f75ac0cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:50.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75a9d9b700 1 --2- 172.21.15.49:0/4257659470 >> v2:172.21.15.150:3300/0 conn(0x7f75ac0cee10 0x7f75ac0cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75a9d9b700 1 -- 172.21.15.49:0/4257659470 >> v1:172.21.15.49:6789/0 conn(0x7f75ac0b7af0 legacy=0x7f75ac15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:50.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75a9d9b700 1 -- 172.21.15.49:0/4257659470 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac0cea00 con 0x7f75ac0d1e40 2023-07-21T22:11:50.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75a9d9b700 1 --2- 172.21.15.49:0/4257659470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac0d1e40 0x7f75ac0b1630 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0cfed0 tx=0x7f75a0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc695aaaffe8612 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:50.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75a959a700 1 -- 172.21.15.49:0/4257659470 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0011830 con 0x7f75ac0d1e40 2023-07-21T22:11:50.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75a959a700 1 -- 172.21.15.49:0/4257659470 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a0011990 con 0x7f75ac0d1e40 2023-07-21T22:11:50.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75a959a700 1 -- 172.21.15.49:0/4257659470 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0011d20 con 0x7f75ac0d1e40 2023-07-21T22:11:50.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75ab59e700 1 -- 172.21.15.49:0/4257659470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac0d1e40 msgr2=0x7f75ac0b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:50.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75ab59e700 1 --2- 172.21.15.49:0/4257659470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac0d1e40 0x7f75ac0b1630 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0cfed0 tx=0x7f75a0009b30 comp rx=0 tx=0).stop 2023-07-21T22:11:50.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75ab59e700 1 -- 172.21.15.49:0/4257659470 shutdown_connections 2023-07-21T22:11:50.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75ab59e700 1 --2- 172.21.15.49:0/4257659470 >> v2:172.21.15.150:3300/0 conn(0x7f75ac0cee10 0x7f75ac0cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75ab59e700 1 --2- 172.21.15.49:0/4257659470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac0d1e40 0x7f75ac0b1630 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75ab59e700 1 -- 172.21.15.49:0/4257659470 >> 172.21.15.49:0/4257659470 conn(0x7f75ac06e960 msgr2=0x7f75ac06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:50.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.256+0000 7f75ab59e700 1 -- 172.21.15.49:0/4257659470 shutdown_connections 2023-07-21T22:11:50.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.260+0000 7f75ab59e700 1 -- 172.21.15.49:0/4257659470 wait complete. 2023-07-21T22:11:50.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.260+0000 7f75ab59e700 1 Processor -- start 2023-07-21T22:11:50.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.260+0000 7f75ab59e700 1 -- start start 2023-07-21T22:11:50.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75ab59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac0b7af0 0x7f75ac0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:50.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75ab59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75ac0cee10 0x7f75ac1e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:50.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75ab59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75ac0d1e40 0x7f75ac156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:50.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75ab59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0c5aa0 con 0x7f75ac0b7af0 2023-07-21T22:11:50.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75ab59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac1e7530 con 0x7f75ac0d1e40 2023-07-21T22:11:50.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75ab59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0c6060 con 0x7f75ac0cee10 2023-07-21T22:11:50.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75aa59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac0b7af0 0x7f75ac0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:50.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75aa59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac0b7af0 0x7f75ac0c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60932/0 (socket says 172.21.15.49:60932) 2023-07-21T22:11:50.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75aa59c700 1 -- 172.21.15.49:0/1151908631 learned_addr learned my addr 172.21.15.49:0/1151908631 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:50.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75a9d9b700 1 --2- 172.21.15.49:0/1151908631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75ac0cee10 0x7f75ac1e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:50.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75aad9d700 1 --2- 172.21.15.49:0/1151908631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75ac0d1e40 0x7f75ac156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:50.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75aa59c700 1 -- 172.21.15.49:0/1151908631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75ac0cee10 msgr2=0x7f75ac1e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:50.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75aa59c700 1 --2- 172.21.15.49:0/1151908631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75ac0cee10 0x7f75ac1e6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75aa59c700 1 -- 172.21.15.49:0/1151908631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75ac0d1e40 msgr2=0x7f75ac156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:50.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75aa59c700 1 --2- 172.21.15.49:0/1151908631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75ac0d1e40 0x7f75ac156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75aa59c700 1 -- 172.21.15.49:0/1151908631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a00094b0 con 0x7f75ac0b7af0 2023-07-21T22:11:50.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75aa59c700 1 --2- 172.21.15.49:0/1151908631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac0b7af0 0x7f75ac0c89c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f759c00c700 tx=0x7f759c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:50.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f759affd700 1 -- 172.21.15.49:0/1151908631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c005d90 con 0x7f75ac0b7af0 2023-07-21T22:11:50.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f759affd700 1 -- 172.21.15.49:0/1151908631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c0070d0 con 0x7f75ac0b7af0 2023-07-21T22:11:50.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f759affd700 1 -- 172.21.15.49:0/1151908631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c007480 con 0x7f75ac0b7af0 2023-07-21T22:11:50.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75ab59e700 1 -- 172.21.15.49:0/1151908631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac0c6340 con 0x7f75ac0b7af0 2023-07-21T22:11:50.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.264+0000 7f75ab59e700 1 -- 172.21.15.49:0/1151908631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac0c6900 con 0x7f75ac0b7af0 2023-07-21T22:11:50.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.268+0000 7f75ab59e700 1 -- 172.21.15.49:0/1151908631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac04dcb0 con 0x7f75ac0b7af0 2023-07-21T22:11:50.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.268+0000 7f759affd700 1 -- 172.21.15.49:0/1151908631 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f759c0075e0 con 0x7f75ac0b7af0 2023-07-21T22:11:50.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.272+0000 7f759affd700 1 --2- 172.21.15.49:0/1151908631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f758c0662f0 0x7f758c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:50.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.272+0000 7f759affd700 1 -- 172.21.15.49:0/1151908631 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f759c083710 con 0x7f75ac0b7af0 2023-07-21T22:11:50.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.272+0000 7f75a9d9b700 1 --2- 172.21.15.49:0/1151908631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f758c0662f0 0x7f758c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:50.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.272+0000 7f75a9d9b700 1 --2- 172.21.15.49:0/1151908631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f758c0662f0 0x7f758c0687a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f75a0000c00 tx=0x7f75a0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.276+0000 7f759affd700 1 -- 172.21.15.49:0/1151908631 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f759c0507d0 con 0x7f75ac0b7af0 2023-07-21T22:11:50.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.464+0000 7f75ab59e700 1 -- 172.21.15.49:0/1151908631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75ac0cfa70 con 0x7f75ac0b7af0 2023-07-21T22:11:50.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.464+0000 7f759affd700 1 -- 172.21.15.49:0/1151908631 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f759c053df0 con 0x7f75ac0b7af0 2023-07-21T22:11:50.510 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:50.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.468+0000 7f75ab59e700 1 -- 172.21.15.49:0/1151908631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f758c0662f0 msgr2=0x7f758c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:50.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.468+0000 7f75ab59e700 1 --2- 172.21.15.49:0/1151908631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f758c0662f0 0x7f758c0687a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f75a0000c00 tx=0x7f75a0008030 comp rx=0 tx=0).stop 2023-07-21T22:11:50.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.468+0000 7f75ab59e700 1 -- 172.21.15.49:0/1151908631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac0b7af0 msgr2=0x7f75ac0c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:50.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.468+0000 7f75ab59e700 1 --2- 172.21.15.49:0/1151908631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac0b7af0 0x7f75ac0c89c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f759c00c700 tx=0x7f759c00cac0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.468+0000 7f75ab59e700 1 -- 172.21.15.49:0/1151908631 shutdown_connections 2023-07-21T22:11:50.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.468+0000 7f75ab59e700 1 --2- 172.21.15.49:0/1151908631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f758c0662f0 0x7f758c0687a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.468+0000 7f75ab59e700 1 --2- 172.21.15.49:0/1151908631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75ac0d1e40 0x7f75ac156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.472+0000 7f75ab59e700 1 --2- 172.21.15.49:0/1151908631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75ac0cee10 0x7f75ac1e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.472+0000 7f75ab59e700 1 --2- 172.21.15.49:0/1151908631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac0b7af0 0x7f75ac0c89c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.472+0000 7f75ab59e700 1 -- 172.21.15.49:0/1151908631 >> 172.21.15.49:0/1151908631 conn(0x7f75ac06e960 msgr2=0x7f75ac15a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.472+0000 7f75ab59e700 1 -- 172.21.15.49:0/1151908631 shutdown_connections 2023-07-21T22:11:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.472+0000 7f75ab59e700 1 -- 172.21.15.49:0/1151908631 wait complete. 2023-07-21T22:11:50.535 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:11:50.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.676+0000 7fb874901700 1 Processor -- start 2023-07-21T22:11:50.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.676+0000 7fb874901700 1 -- start start 2023-07-21T22:11:50.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.680+0000 7fb874901700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8700cb2f0 0x7fb8700ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:50.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.680+0000 7fb874901700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8700b3a50 0x7fb8700ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:50.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.680+0000 7fb874901700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8700ca190 con 0x7fb87015e380 2023-07-21T22:11:50.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.680+0000 7fb874901700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb870159fd0 con 0x7fb8700cb2f0 2023-07-21T22:11:50.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.680+0000 7fb874901700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87015d6e0 con 0x7fb8700b3a50 2023-07-21T22:11:50.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.680+0000 7fb86dd9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8700cb2f0 0x7fb8700ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:50.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.680+0000 7fb86dd9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8700cb2f0 0x7fb8700ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60934/0 (socket says 172.21.15.49:60934) 2023-07-21T22:11:50.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.680+0000 7fb86dd9b700 1 -- 172.21.15.49:0/2150394664 learned_addr learned my addr 172.21.15.49:0/2150394664 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:50.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.680+0000 7fb86ed9d700 1 --2- 172.21.15.49:0/2150394664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8700b3a50 0x7fb8700ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:50.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.680+0000 7fb86dd9b700 1 -- 172.21.15.49:0/2150394664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8700b3a50 msgr2=0x7fb8700ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:50.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.680+0000 7fb86dd9b700 1 --2- 172.21.15.49:0/2150394664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8700b3a50 0x7fb8700ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.680+0000 7fb86dd9b700 1 -- 172.21.15.49:0/2150394664 >> v1:172.21.15.150:6789/0 conn(0x7fb87015e380 legacy=0x7fb8700cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:50.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.680+0000 7fb86dd9b700 1 -- 172.21.15.49:0/2150394664 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8700ca900 con 0x7fb8700cb2f0 2023-07-21T22:11:50.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.680+0000 7fb86dd9b700 1 --2- 172.21.15.49:0/2150394664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700cb2f0 0x7fb8700ce160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb864009900 tx=0x7fb864009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99471fb333ca6d28 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:50.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.684+0000 7fb86d59a700 1 -- 172.21.15.49:0/2150394664 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864011830 con 0x7fb8700cb2f0 2023-07-21T22:11:50.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.684+0000 7fb86d59a700 1 -- 172.21.15.49:0/2150394664 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb864011990 con 0x7fb8700cb2f0 2023-07-21T22:11:50.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.684+0000 7fb86d59a700 1 -- 172.21.15.49:0/2150394664 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864011d40 con 0x7fb8700cb2f0 2023-07-21T22:11:50.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.684+0000 7fb874901700 1 -- 172.21.15.49:0/2150394664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700cb2f0 msgr2=0x7fb8700ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:50.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.684+0000 7fb874901700 1 --2- 172.21.15.49:0/2150394664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700cb2f0 0x7fb8700ce160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb864009900 tx=0x7fb864009c10 comp rx=0 tx=0).stop 2023-07-21T22:11:50.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.684+0000 7fb874901700 1 -- 172.21.15.49:0/2150394664 shutdown_connections 2023-07-21T22:11:50.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.684+0000 7fb874901700 1 --2- 172.21.15.49:0/2150394664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8700b3a50 0x7fb8700ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.684+0000 7fb874901700 1 --2- 172.21.15.49:0/2150394664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700cb2f0 0x7fb8700ce160 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.684+0000 7fb874901700 1 -- 172.21.15.49:0/2150394664 >> 172.21.15.49:0/2150394664 conn(0x7fb87006e960 msgr2=0x7fb87006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:50.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.684+0000 7fb874901700 1 -- 172.21.15.49:0/2150394664 shutdown_connections 2023-07-21T22:11:50.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.684+0000 7fb874901700 1 -- 172.21.15.49:0/2150394664 wait complete. 2023-07-21T22:11:50.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.684+0000 7fb874901700 1 Processor -- start 2023-07-21T22:11:50.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb874901700 1 -- start start 2023-07-21T22:11:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb874901700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700b3a50 0x7fb870158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb874901700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8700cb2f0 0x7fb87015bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb874901700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb87015e380 0x7fb870148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb874901700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87015cc40 con 0x7fb8700b3a50 2023-07-21T22:11:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb874901700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87015c140 con 0x7fb87015e380 2023-07-21T22:11:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb874901700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87015c3a0 con 0x7fb8700cb2f0 2023-07-21T22:11:50.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb86e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700b3a50 0x7fb870158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb86e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700b3a50 0x7fb870158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60940/0 (socket says 172.21.15.49:60940) 2023-07-21T22:11:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb86e59c700 1 -- 172.21.15.49:0/3016287432 learned_addr learned my addr 172.21.15.49:0/3016287432 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb86ed9d700 1 --2- 172.21.15.49:0/3016287432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb87015e380 0x7fb870148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb86dd9b700 1 --2- 172.21.15.49:0/3016287432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8700cb2f0 0x7fb87015bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb86e59c700 1 -- 172.21.15.49:0/3016287432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8700cb2f0 msgr2=0x7fb87015bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb86e59c700 1 --2- 172.21.15.49:0/3016287432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8700cb2f0 0x7fb87015bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb86e59c700 1 -- 172.21.15.49:0/3016287432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb87015e380 msgr2=0x7fb870148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb86e59c700 1 --2- 172.21.15.49:0/3016287432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb87015e380 0x7fb870148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb86e59c700 1 -- 172.21.15.49:0/3016287432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864009510 con 0x7fb8700b3a50 2023-07-21T22:11:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb86e59c700 1 --2- 172.21.15.49:0/3016287432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700b3a50 0x7fb870158180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb86000c500 tx=0x7fb86000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb85effd700 1 -- 172.21.15.49:0/3016287432 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8600052d0 con 0x7fb8700b3a50 2023-07-21T22:11:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb85effd700 1 -- 172.21.15.49:0/3016287432 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb860005430 con 0x7fb8700b3a50 2023-07-21T22:11:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb874901700 1 -- 172.21.15.49:0/3016287432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87015c680 con 0x7fb8700b3a50 2023-07-21T22:11:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb85effd700 1 -- 172.21.15.49:0/3016287432 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8600055a0 con 0x7fb8700b3a50 2023-07-21T22:11:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.688+0000 7fb874901700 1 -- 172.21.15.49:0/3016287432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8701463a0 con 0x7fb8700b3a50 2023-07-21T22:11:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.692+0000 7fb874901700 1 -- 172.21.15.49:0/3016287432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb870146200 con 0x7fb8700b3a50 2023-07-21T22:11:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.692+0000 7fb85effd700 1 -- 172.21.15.49:0/3016287432 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb8600038e0 con 0x7fb8700b3a50 2023-07-21T22:11:50.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.696+0000 7fb85effd700 1 --2- 172.21.15.49:0/3016287432 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8500662f0 0x7fb8500687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:50.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.696+0000 7fb85effd700 1 -- 172.21.15.49:0/3016287432 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb860083490 con 0x7fb8700b3a50 2023-07-21T22:11:50.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.696+0000 7fb86dd9b700 1 --2- 172.21.15.49:0/3016287432 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8500662f0 0x7fb8500687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:50.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.696+0000 7fb86dd9b700 1 --2- 172.21.15.49:0/3016287432 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8500662f0 0x7fb8500687a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb864009c50 tx=0x7fb864008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:50.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.700+0000 7fb85effd700 1 -- 172.21.15.49:0/3016287432 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb870146200 con 0x7fb8700b3a50 2023-07-21T22:11:50.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.876+0000 7fb874901700 1 -- 172.21.15.49:0/3016287432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb870146200 con 0x7fb8700b3a50 2023-07-21T22:11:50.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.876+0000 7fb85effd700 1 -- 172.21.15.49:0/3016287432 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb870146200 con 0x7fb8700b3a50 2023-07-21T22:11:50.920 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:11:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.880+0000 7fb874901700 1 -- 172.21.15.49:0/3016287432 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8500662f0 msgr2=0x7fb8500687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.880+0000 7fb874901700 1 --2- 172.21.15.49:0/3016287432 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8500662f0 0x7fb8500687a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb864009c50 tx=0x7fb864008030 comp rx=0 tx=0).stop 2023-07-21T22:11:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.880+0000 7fb874901700 1 -- 172.21.15.49:0/3016287432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700b3a50 msgr2=0x7fb870158180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.880+0000 7fb874901700 1 --2- 172.21.15.49:0/3016287432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700b3a50 0x7fb870158180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb86000c500 tx=0x7fb86000c810 comp rx=0 tx=0).stop 2023-07-21T22:11:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.880+0000 7fb874901700 1 -- 172.21.15.49:0/3016287432 shutdown_connections 2023-07-21T22:11:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.880+0000 7fb874901700 1 --2- 172.21.15.49:0/3016287432 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8500662f0 0x7fb8500687a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.880+0000 7fb874901700 1 --2- 172.21.15.49:0/3016287432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb87015e380 0x7fb870148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.880+0000 7fb874901700 1 --2- 172.21.15.49:0/3016287432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8700cb2f0 0x7fb87015bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.880+0000 7fb874901700 1 --2- 172.21.15.49:0/3016287432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700b3a50 0x7fb870158180 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:50.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.880+0000 7fb874901700 1 -- 172.21.15.49:0/3016287432 >> 172.21.15.49:0/3016287432 conn(0x7fb87006e960 msgr2=0x7fb8700c9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:50.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.880+0000 7fb874901700 1 -- 172.21.15.49:0/3016287432 shutdown_connections 2023-07-21T22:11:50.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:50.880+0000 7fb874901700 1 -- 172.21.15.49:0/3016287432 wait complete. 2023-07-21T22:11:50.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:11:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.084+0000 7faf1e427700 1 Processor -- start 2023-07-21T22:11:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.084+0000 7faf1e427700 1 -- start start 2023-07-21T22:11:51.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf1e427700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf180c90d0 0x7faf18069d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf1e427700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf18158d70 con 0x7faf181589a0 2023-07-21T22:11:51.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf1e427700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf180cc990 con 0x7faf180698a0 2023-07-21T22:11:51.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf1e427700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1815c800 con 0x7faf180c90d0 2023-07-21T22:11:51.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf1d425700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faf181589a0 0x7faf1806c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60302/0 (socket says 172.21.15.49:60302) 2023-07-21T22:11:51.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf1d425700 1 -- 172.21.15.49:0/3532107843 learned_addr learned my addr 172.21.15.49:0/3532107843 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:51.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf1dc26700 1 --2- 172.21.15.49:0/3532107843 >> v2:172.21.15.49:3300/0 conn(0x7faf180c90d0 0x7faf18069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:51.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf0ffff700 1 -- 172.21.15.49:0/3532107843 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495390296 0 0) 0x7faf14001110 con 0x7faf181589a0 2023-07-21T22:11:51.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf0ffff700 1 -- 172.21.15.49:0/3532107843 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf040035d0 con 0x7faf181589a0 2023-07-21T22:11:51.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf0ffff700 1 -- 172.21.15.49:0/3532107843 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779042383 0 0) 0x7faf180cc990 con 0x7faf180698a0 2023-07-21T22:11:51.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf0ffff700 1 -- 172.21.15.49:0/3532107843 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf14001110 con 0x7faf180698a0 2023-07-21T22:11:51.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf1dc26700 1 -- 172.21.15.49:0/3532107843 >> v1:172.21.15.150:6789/0 conn(0x7faf180698a0 legacy=0x7faf180c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf1dc26700 1 -- 172.21.15.49:0/3532107843 >> v1:172.21.15.49:6789/0 conn(0x7faf181589a0 legacy=0x7faf1806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf0ffff700 1 -- 172.21.15.49:0/3532107843 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 751439011 0 0) 0x7faf040035d0 con 0x7faf181589a0 2023-07-21T22:11:51.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf1dc26700 1 -- 172.21.15.49:0/3532107843 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf180c95d0 con 0x7faf180c90d0 2023-07-21T22:11:51.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.088+0000 7faf1dc26700 1 --2- 172.21.15.49:0/3532107843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180c90d0 0x7faf18069d10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faf10009d90 tx=0x7faf1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a53e41b29fa6f85 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:51.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.092+0000 7faf0ffff700 1 -- 172.21.15.49:0/3532107843 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000e070 con 0x7faf180c90d0 2023-07-21T22:11:51.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.092+0000 7faf0ffff700 1 -- 172.21.15.49:0/3532107843 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf10003a40 con 0x7faf180c90d0 2023-07-21T22:11:51.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.092+0000 7faf0ffff700 1 -- 172.21.15.49:0/3532107843 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf14001800 con 0x7faf180c90d0 2023-07-21T22:11:51.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.092+0000 7faf1e427700 1 -- 172.21.15.49:0/3532107843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180c90d0 msgr2=0x7faf18069d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.092+0000 7faf1e427700 1 --2- 172.21.15.49:0/3532107843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180c90d0 0x7faf18069d10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faf10009d90 tx=0x7faf1000b330 comp rx=0 tx=0).stop 2023-07-21T22:11:51.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.092+0000 7faf1e427700 1 -- 172.21.15.49:0/3532107843 shutdown_connections 2023-07-21T22:11:51.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.092+0000 7faf1e427700 1 --2- 172.21.15.49:0/3532107843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180c90d0 0x7faf18069d10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.092+0000 7faf1e427700 1 -- 172.21.15.49:0/3532107843 >> 172.21.15.49:0/3532107843 conn(0x7faf180ce0d0 msgr2=0x7faf180ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:51.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.092+0000 7faf1e427700 1 -- 172.21.15.49:0/3532107843 shutdown_connections 2023-07-21T22:11:51.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.092+0000 7faf1e427700 1 -- 172.21.15.49:0/3532107843 wait complete. 2023-07-21T22:11:51.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1e427700 1 Processor -- start 2023-07-21T22:11:51.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1e427700 1 -- start start 2023-07-21T22:11:51.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1e427700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180698a0 0x7faf18152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1e427700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf180c90d0 0x7faf180b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1e427700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf181589a0 0x7faf180b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1e427700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf180b3500 con 0x7faf180698a0 2023-07-21T22:11:51.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1e427700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf180c7eb0 con 0x7faf180c90d0 2023-07-21T22:11:51.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1e427700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf180b2f40 con 0x7faf181589a0 2023-07-21T22:11:51.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1d425700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180698a0 0x7faf18152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:51.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1d425700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180698a0 0x7faf18152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60956/0 (socket says 172.21.15.49:60956) 2023-07-21T22:11:51.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1d425700 1 -- 172.21.15.49:0/3538910642 learned_addr learned my addr 172.21.15.49:0/3538910642 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:51.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1cc24700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf180c90d0 0x7faf180b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:51.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1dc26700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf181589a0 0x7faf180b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:51.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1d425700 1 -- 172.21.15.49:0/3538910642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf181589a0 msgr2=0x7faf180b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1d425700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf181589a0 0x7faf180b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1d425700 1 -- 172.21.15.49:0/3538910642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf180c90d0 msgr2=0x7faf180b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1d425700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf180c90d0 0x7faf180b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1d425700 1 -- 172.21.15.49:0/3538910642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf10009a70 con 0x7faf180698a0 2023-07-21T22:11:51.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1cc24700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf180c90d0 0x7faf180b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:51.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf1d425700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180698a0 0x7faf18152f40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7faf1400cad0 tx=0x7faf1400ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:51.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.096+0000 7faf0dffb700 1 -- 172.21.15.49:0/3538910642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf14004a90 con 0x7faf180698a0 2023-07-21T22:11:51.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.100+0000 7faf0dffb700 1 -- 172.21.15.49:0/3538910642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf14004bf0 con 0x7faf180698a0 2023-07-21T22:11:51.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.100+0000 7faf0dffb700 1 -- 172.21.15.49:0/3538910642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf140070d0 con 0x7faf180698a0 2023-07-21T22:11:51.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.100+0000 7faf1e427700 1 -- 172.21.15.49:0/3538910642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf180b3220 con 0x7faf180698a0 2023-07-21T22:11:51.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.100+0000 7faf1e427700 1 -- 172.21.15.49:0/3538910642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf180ae3e0 con 0x7faf180698a0 2023-07-21T22:11:51.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.100+0000 7faf1e427700 1 -- 172.21.15.49:0/3538910642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf180adf60 con 0x7faf180698a0 2023-07-21T22:11:51.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.104+0000 7faf0dffb700 1 -- 172.21.15.49:0/3538910642 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf14007230 con 0x7faf180698a0 2023-07-21T22:11:51.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.104+0000 7faf0dffb700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faefc0662f0 0x7faefc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.104+0000 7faf0dffb700 1 -- 172.21.15.49:0/3538910642 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faf14083310 con 0x7faf180698a0 2023-07-21T22:11:51.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.104+0000 7faf1cc24700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faefc0662f0 0x7faefc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:51.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.104+0000 7faf1cc24700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faefc0662f0 0x7faefc0687a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faf181f8c80 tx=0x7faf08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:51.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.108+0000 7faf0dffb700 1 -- 172.21.15.49:0/3538910642 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf180adf60 con 0x7faf180698a0 2023-07-21T22:11:51.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.292+0000 7faf1e427700 1 -- 172.21.15.49:0/3538910642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faf18158d70 con 0x7faf180698a0 2023-07-21T22:11:51.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.292+0000 7faf0dffb700 1 -- 172.21.15.49:0/3538910642 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7faf18158d70 con 0x7faf180698a0 2023-07-21T22:11:51.335 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:51.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.292+0000 7faf1e427700 1 -- 172.21.15.49:0/3538910642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faefc0662f0 msgr2=0x7faefc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.292+0000 7faf1e427700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faefc0662f0 0x7faefc0687a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faf181f8c80 tx=0x7faf08009040 comp rx=0 tx=0).stop 2023-07-21T22:11:51.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.292+0000 7faf1e427700 1 -- 172.21.15.49:0/3538910642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180698a0 msgr2=0x7faf18152f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.292+0000 7faf1e427700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180698a0 0x7faf18152f40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7faf1400cad0 tx=0x7faf1400ce90 comp rx=0 tx=0).stop 2023-07-21T22:11:51.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.292+0000 7faf1e427700 1 -- 172.21.15.49:0/3538910642 shutdown_connections 2023-07-21T22:11:51.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.292+0000 7faf1e427700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faefc0662f0 0x7faefc0687a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.292+0000 7faf1e427700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf181589a0 0x7faf180b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.292+0000 7faf1e427700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf180c90d0 0x7faf180b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.292+0000 7faf1e427700 1 --2- 172.21.15.49:0/3538910642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180698a0 0x7faf18152f40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.292+0000 7faf1e427700 1 -- 172.21.15.49:0/3538910642 >> 172.21.15.49:0/3538910642 conn(0x7faf180ce0d0 msgr2=0x7faf180ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:51.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.292+0000 7faf1e427700 1 -- 172.21.15.49:0/3538910642 shutdown_connections 2023-07-21T22:11:51.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.292+0000 7faf1e427700 1 -- 172.21.15.49:0/3538910642 wait complete. 2023-07-21T22:11:51.358 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:11:51.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.500+0000 7f562759e700 1 Processor -- start 2023-07-21T22:11:51.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.500+0000 7f562759e700 1 -- start start 2023-07-21T22:11:51.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.504+0000 7f562759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5628158c00 0x7f562815d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.504+0000 7f562759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56280c90d0 0x7f56280c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.504+0000 7f562759e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56280c9a70 con 0x7f562806da70 2023-07-21T22:11:51.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.504+0000 7f562759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f562806d650 con 0x7f5628158c00 2023-07-21T22:11:51.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.504+0000 7f562759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5628158fd0 con 0x7f56280c90d0 2023-07-21T22:11:51.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.504+0000 7f562659c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5628158c00 0x7f562815d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:51.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.504+0000 7f561dd9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f562806da70 0x7f562806c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60308/0 (socket says 172.21.15.49:60308) 2023-07-21T22:11:51.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.504+0000 7f561dd9b700 1 -- 172.21.15.49:0/811455019 learned_addr learned my addr 172.21.15.49:0/811455019 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:51.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.504+0000 7f5626d9d700 1 --2- 172.21.15.49:0/811455019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56280c90d0 0x7f56280c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:51.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f562659c700 1 -- 172.21.15.49:0/811455019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56280c90d0 msgr2=0x7f56280c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:51.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f562659c700 1 --2- 172.21.15.49:0/811455019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56280c90d0 0x7f56280c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f5625d9b700 1 -- 172.21.15.49:0/811455019 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891719210 0 0) 0x7f56280c9a70 con 0x7f562806da70 2023-07-21T22:11:51.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f562659c700 1 -- 172.21.15.49:0/811455019 >> v1:172.21.15.49:6789/0 conn(0x7f562806da70 legacy=0x7f562806c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f562659c700 1 -- 172.21.15.49:0/811455019 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562806c9d0 con 0x7f5628158c00 2023-07-21T22:11:51.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f562659c700 1 --2- 172.21.15.49:0/811455019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5628158c00 0x7f562815d180 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5618009850 tx=0x7f5618009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7aff73c4c6170c5b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:51.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f5625d9b700 1 -- 172.21.15.49:0/811455019 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561800f8a0 con 0x7f5628158c00 2023-07-21T22:11:51.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f5625d9b700 1 -- 172.21.15.49:0/811455019 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561800fa00 con 0x7f5628158c00 2023-07-21T22:11:51.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f5625d9b700 1 -- 172.21.15.49:0/811455019 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561800fdb0 con 0x7f5628158c00 2023-07-21T22:11:51.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f562759e700 1 -- 172.21.15.49:0/811455019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5628158c00 msgr2=0x7f562815d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f562759e700 1 --2- 172.21.15.49:0/811455019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5628158c00 0x7f562815d180 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5618009850 tx=0x7f5618009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:51.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f562759e700 1 -- 172.21.15.49:0/811455019 shutdown_connections 2023-07-21T22:11:51.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f562759e700 1 --2- 172.21.15.49:0/811455019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56280c90d0 0x7f56280c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f562759e700 1 --2- 172.21.15.49:0/811455019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5628158c00 0x7f562815d180 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f562759e700 1 -- 172.21.15.49:0/811455019 >> 172.21.15.49:0/811455019 conn(0x7f5628070450 msgr2=0x7f5628070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:51.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f562759e700 1 -- 172.21.15.49:0/811455019 shutdown_connections 2023-07-21T22:11:51.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.508+0000 7f562759e700 1 -- 172.21.15.49:0/811455019 wait complete. 2023-07-21T22:11:51.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.512+0000 7f562759e700 1 Processor -- start 2023-07-21T22:11:51.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.512+0000 7f562759e700 1 -- start start 2023-07-21T22:11:51.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f562759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f562806da70 0x7f562814c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f562759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56280c90d0 0x7f562815b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f562759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5628158c00 0x7f56280af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f562759e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562814cb30 con 0x7f5628158c00 2023-07-21T22:11:51.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f562759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562815b960 con 0x7f562806da70 2023-07-21T22:11:51.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f562759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5628159bc0 con 0x7f56280c90d0 2023-07-21T22:11:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f5626d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5628158c00 0x7f56280af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f5626d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5628158c00 0x7f56280af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60960/0 (socket says 172.21.15.49:60960) 2023-07-21T22:11:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f5626d9d700 1 -- 172.21.15.49:0/1598140101 learned_addr learned my addr 172.21.15.49:0/1598140101 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f562659c700 1 --2- 172.21.15.49:0/1598140101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f562806da70 0x7f562814c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:51.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f561dd9b700 1 --2- 172.21.15.49:0/1598140101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56280c90d0 0x7f562815b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:51.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f5626d9d700 1 -- 172.21.15.49:0/1598140101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56280c90d0 msgr2=0x7f562815b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f5626d9d700 1 --2- 172.21.15.49:0/1598140101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56280c90d0 0x7f562815b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f5626d9d700 1 -- 172.21.15.49:0/1598140101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f562806da70 msgr2=0x7f562814c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f5626d9d700 1 --2- 172.21.15.49:0/1598140101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f562806da70 0x7f562814c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f5626d9d700 1 -- 172.21.15.49:0/1598140101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56180094b0 con 0x7f5628158c00 2023-07-21T22:11:51.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f5626d9d700 1 --2- 172.21.15.49:0/1598140101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5628158c00 0x7f56280af1a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f562000efc0 tx=0x7f562000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:51.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f561f7fe700 1 -- 172.21.15.49:0/1598140101 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562000cb80 con 0x7f5628158c00 2023-07-21T22:11:51.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f561f7fe700 1 -- 172.21.15.49:0/1598140101 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562000f040 con 0x7f5628158c00 2023-07-21T22:11:51.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f562759e700 1 -- 172.21.15.49:0/1598140101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5628159ea0 con 0x7f5628158c00 2023-07-21T22:11:51.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.516+0000 7f561f7fe700 1 -- 172.21.15.49:0/1598140101 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5620014480 con 0x7f5628158c00 2023-07-21T22:11:51.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.520+0000 7f562759e700 1 -- 172.21.15.49:0/1598140101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f562815a460 con 0x7f5628158c00 2023-07-21T22:11:51.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.520+0000 7f562759e700 1 -- 172.21.15.49:0/1598140101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f562804dcb0 con 0x7f5628158c00 2023-07-21T22:11:51.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.520+0000 7f561f7fe700 1 -- 172.21.15.49:0/1598140101 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f56200145e0 con 0x7f5628158c00 2023-07-21T22:11:51.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.524+0000 7f561f7fe700 1 --2- 172.21.15.49:0/1598140101 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f56080662f0 0x7f56080687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.524+0000 7f561f7fe700 1 -- 172.21.15.49:0/1598140101 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5620084c90 con 0x7f5628158c00 2023-07-21T22:11:51.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.524+0000 7f562659c700 1 --2- 172.21.15.49:0/1598140101 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f56080662f0 0x7f56080687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:51.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.524+0000 7f562659c700 1 --2- 172.21.15.49:0/1598140101 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f56080662f0 0x7f56080687a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f56180090b0 tx=0x7f561801b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:51.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.528+0000 7f561f7fe700 1 -- 172.21.15.49:0/1598140101 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5620051cb0 con 0x7f5628158c00 2023-07-21T22:11:51.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.716+0000 7f562759e700 1 -- 172.21.15.49:0/1598140101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f562815bb90 con 0x7f5628158c00 2023-07-21T22:11:51.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.716+0000 7f561f7fe700 1 -- 172.21.15.49:0/1598140101 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5620018020 con 0x7f5628158c00 2023-07-21T22:11:51.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.720+0000 7f562759e700 1 -- 172.21.15.49:0/1598140101 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f56080662f0 msgr2=0x7f56080687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.720+0000 7f562759e700 1 --2- 172.21.15.49:0/1598140101 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f56080662f0 0x7f56080687a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f56180090b0 tx=0x7f561801b040 comp rx=0 tx=0).stop 2023-07-21T22:11:51.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.720+0000 7f562759e700 1 -- 172.21.15.49:0/1598140101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5628158c00 msgr2=0x7f56280af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.720+0000 7f562759e700 1 --2- 172.21.15.49:0/1598140101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5628158c00 0x7f56280af1a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f562000efc0 tx=0x7f562000c0c0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.720+0000 7f562759e700 1 -- 172.21.15.49:0/1598140101 shutdown_connections 2023-07-21T22:11:51.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.720+0000 7f562759e700 1 --2- 172.21.15.49:0/1598140101 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f56080662f0 0x7f56080687a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.720+0000 7f562759e700 1 --2- 172.21.15.49:0/1598140101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5628158c00 0x7f56280af1a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.720+0000 7f562759e700 1 --2- 172.21.15.49:0/1598140101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56280c90d0 0x7f562815b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.720+0000 7f562759e700 1 --2- 172.21.15.49:0/1598140101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f562806da70 0x7f562814c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.720+0000 7f562759e700 1 -- 172.21.15.49:0/1598140101 >> 172.21.15.49:0/1598140101 conn(0x7f5628070450 msgr2=0x7f56281562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:51.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.720+0000 7f562759e700 1 -- 172.21.15.49:0/1598140101 shutdown_connections 2023-07-21T22:11:51.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:51.720+0000 7f562759e700 1 -- 172.21.15.49:0/1598140101 wait complete. 2023-07-21T22:11:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:11:51.784 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2023-07-21T22:11:51.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:51.785 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-07-21T22:11:51.834 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:11:51.835 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:11:51.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:51.835 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-21T22:11:51.877 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:11:51.877 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:11:51.892 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:11:51.893 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:11:51.955 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:52.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.128+0000 7f77db103700 1 Processor -- start 2023-07-21T22:11:52.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.128+0000 7f77db103700 1 -- start start 2023-07-21T22:11:52.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.132+0000 7f77db103700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f77d40cafb0 0x7f77d40cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:52.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.132+0000 7f77db103700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d40cab20 con 0x7f77d406d380 2023-07-21T22:11:52.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.132+0000 7f77db103700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d40ca1f0 con 0x7f77d4071c70 2023-07-21T22:11:52.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.132+0000 7f77db103700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d40c9e80 con 0x7f77d40cafb0 2023-07-21T22:11:52.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.132+0000 7f77da101700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f77d406d380 0x7f77d406d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60324/0 (socket says 172.21.15.49:60324) 2023-07-21T22:11:52.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.132+0000 7f77da101700 1 -- 172.21.15.49:0/724516071 learned_addr learned my addr 172.21.15.49:0/724516071 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:52.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.132+0000 7f77da902700 1 --2- 172.21.15.49:0/724516071 >> v2:172.21.15.150:3300/0 conn(0x7f77d40cafb0 0x7f77d40cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:52.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.132+0000 7f77d90ff700 1 -- 172.21.15.49:0/724516071 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571750361 0 0) 0x7f77d40cab20 con 0x7f77d406d380 2023-07-21T22:11:52.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.132+0000 7f77d90ff700 1 -- 172.21.15.49:0/724516071 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77c00035d0 con 0x7f77d406d380 2023-07-21T22:11:52.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.132+0000 7f77d90ff700 1 -- 172.21.15.49:0/724516071 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019179449 0 0) 0x7f77d40ca1f0 con 0x7f77d4071c70 2023-07-21T22:11:52.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.132+0000 7f77da902700 1 -- 172.21.15.49:0/724516071 >> v1:172.21.15.150:6789/0 conn(0x7f77d4071c70 legacy=0x7f77d40b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:52.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.132+0000 7f77da902700 1 -- 172.21.15.49:0/724516071 >> v1:172.21.15.49:6789/0 conn(0x7f77d406d380 legacy=0x7f77d406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:52.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.132+0000 7f77da902700 1 -- 172.21.15.49:0/724516071 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d40ca4d0 con 0x7f77d40cafb0 2023-07-21T22:11:52.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.136+0000 7f77da902700 1 --2- 172.21.15.49:0/724516071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77d40cafb0 0x7f77d40cb430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009d90 tx=0x7f77cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7606ac31080c9a79 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:52.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.136+0000 7f77d90ff700 1 -- 172.21.15.49:0/724516071 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc00e070 con 0x7f77d40cafb0 2023-07-21T22:11:52.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.136+0000 7f77d90ff700 1 -- 172.21.15.49:0/724516071 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc00bb20 con 0x7f77d40cafb0 2023-07-21T22:11:52.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.136+0000 7f77d90ff700 1 -- 172.21.15.49:0/724516071 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc00bed0 con 0x7f77d40cafb0 2023-07-21T22:11:52.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.136+0000 7f77db103700 1 -- 172.21.15.49:0/724516071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77d40cafb0 msgr2=0x7f77d40cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:52.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.136+0000 7f77db103700 1 --2- 172.21.15.49:0/724516071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77d40cafb0 0x7f77d40cb430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009d90 tx=0x7f77cc00b330 comp rx=0 tx=0).stop 2023-07-21T22:11:52.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.136+0000 7f77db103700 1 -- 172.21.15.49:0/724516071 shutdown_connections 2023-07-21T22:11:52.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.136+0000 7f77db103700 1 --2- 172.21.15.49:0/724516071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77d40cafb0 0x7f77d40cb430 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.136+0000 7f77db103700 1 -- 172.21.15.49:0/724516071 >> 172.21.15.49:0/724516071 conn(0x7f77d4070450 msgr2=0x7f77d4070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:52.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.136+0000 7f77db103700 1 -- 172.21.15.49:0/724516071 shutdown_connections 2023-07-21T22:11:52.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.136+0000 7f77db103700 1 -- 172.21.15.49:0/724516071 wait complete. 2023-07-21T22:11:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.140+0000 7f77db103700 1 Processor -- start 2023-07-21T22:11:52.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.140+0000 7f77db103700 1 -- start start 2023-07-21T22:11:52.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.140+0000 7f77db103700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d406d380 0x7f77d40cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:52.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.140+0000 7f77db103700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77d4071c70 0x7f77d40c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:52.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.140+0000 7f77db103700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77d40cafb0 0x7f77d40c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:52.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.140+0000 7f77db103700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d41479c0 con 0x7f77d4071c70 2023-07-21T22:11:52.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.140+0000 7f77db103700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d40c49a0 con 0x7f77d40cafb0 2023-07-21T22:11:52.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.140+0000 7f77db103700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d415b7d0 con 0x7f77d406d380 2023-07-21T22:11:52.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.140+0000 7f77d9900700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77d4071c70 0x7f77d40c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:52.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.140+0000 7f77d9900700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77d4071c70 0x7f77d40c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60972/0 (socket says 172.21.15.49:60972) 2023-07-21T22:11:52.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.140+0000 7f77d9900700 1 -- 172.21.15.49:0/3618424176 learned_addr learned my addr 172.21.15.49:0/3618424176 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:52.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.140+0000 7f77da101700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d406d380 0x7f77d40cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:52.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.140+0000 7f77da902700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77d40cafb0 0x7f77d40c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:52.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.144+0000 7f77d9900700 1 -- 172.21.15.49:0/3618424176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d406d380 msgr2=0x7f77d40cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:52.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.144+0000 7f77d9900700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d406d380 0x7f77d40cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.144+0000 7f77d9900700 1 -- 172.21.15.49:0/3618424176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77d40cafb0 msgr2=0x7f77d40c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:52.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.144+0000 7f77d9900700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77d40cafb0 0x7f77d40c27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.144+0000 7f77d9900700 1 -- 172.21.15.49:0/3618424176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc009a70 con 0x7f77d4071c70 2023-07-21T22:11:52.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.144+0000 7f77da101700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d406d380 0x7f77d40cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:52.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.144+0000 7f77d9900700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77d4071c70 0x7f77d40c4460 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f77c40011e0 tx=0x7f77c400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:52.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.144+0000 7f77caffd700 1 -- 172.21.15.49:0/3618424176 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c40054e0 con 0x7f77d4071c70 2023-07-21T22:11:52.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.144+0000 7f77caffd700 1 -- 172.21.15.49:0/3618424176 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c40036a0 con 0x7f77d4071c70 2023-07-21T22:11:52.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.144+0000 7f77caffd700 1 -- 172.21.15.49:0/3618424176 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4003a50 con 0x7f77d4071c70 2023-07-21T22:11:52.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.144+0000 7f77db103700 1 -- 172.21.15.49:0/3618424176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d40c1cb0 con 0x7f77d4071c70 2023-07-21T22:11:52.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.144+0000 7f77db103700 1 -- 172.21.15.49:0/3618424176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d40c2270 con 0x7f77d4071c70 2023-07-21T22:11:52.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.144+0000 7f77db103700 1 -- 172.21.15.49:0/3618424176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d415b980 con 0x7f77d4071c70 2023-07-21T22:11:52.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.148+0000 7f77caffd700 1 -- 172.21.15.49:0/3618424176 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f77c4003bb0 con 0x7f77d4071c70 2023-07-21T22:11:52.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.148+0000 7f77caffd700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f77b80662f0 0x7f77b80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:52.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.148+0000 7f77caffd700 1 -- 172.21.15.49:0/3618424176 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f77c40834b0 con 0x7f77d4071c70 2023-07-21T22:11:52.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.148+0000 7f77da101700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f77b80662f0 0x7f77b80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:52.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.148+0000 7f77da101700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f77b80662f0 0x7f77b80687a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77d0005930 tx=0x7f77d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:52.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.156+0000 7f77caffd700 1 -- 172.21.15.49:0/3618424176 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f77d415b980 con 0x7f77d4071c70 2023-07-21T22:11:52.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.332+0000 7f77db103700 1 -- 172.21.15.49:0/3618424176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77d415b940 con 0x7f77d4071c70 2023-07-21T22:11:52.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.336+0000 7f77caffd700 1 -- 172.21.15.49:0/3618424176 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7f77c4050690 con 0x7f77d4071c70 2023-07-21T22:11:52.379 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:52.380 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:52.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.340+0000 7f77db103700 1 -- 172.21.15.49:0/3618424176 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f77b80662f0 msgr2=0x7f77b80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:52.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.340+0000 7f77db103700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f77b80662f0 0x7f77b80687a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77d0005930 tx=0x7f77d0009040 comp rx=0 tx=0).stop 2023-07-21T22:11:52.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.340+0000 7f77db103700 1 -- 172.21.15.49:0/3618424176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77d4071c70 msgr2=0x7f77d40c4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:52.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.340+0000 7f77db103700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77d4071c70 0x7f77d40c4460 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f77c40011e0 tx=0x7f77c400ca30 comp rx=0 tx=0).stop 2023-07-21T22:11:52.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.340+0000 7f77db103700 1 -- 172.21.15.49:0/3618424176 shutdown_connections 2023-07-21T22:11:52.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.340+0000 7f77db103700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f77b80662f0 0x7f77b80687a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.340+0000 7f77db103700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77d4071c70 0x7f77d40c4460 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.340+0000 7f77db103700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77d40cafb0 0x7f77d40c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.340+0000 7f77db103700 1 --2- 172.21.15.49:0/3618424176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d406d380 0x7f77d40cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.340+0000 7f77db103700 1 -- 172.21.15.49:0/3618424176 >> 172.21.15.49:0/3618424176 conn(0x7f77d4070450 msgr2=0x7f77d40b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.340+0000 7f77db103700 1 -- 172.21.15.49:0/3618424176 shutdown_connections 2023-07-21T22:11:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.340+0000 7f77db103700 1 -- 172.21.15.49:0/3618424176 wait complete. 2023-07-21T22:11:52.405 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:11:52.406 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:11:52.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.540+0000 7fedfe926700 1 Processor -- start 2023-07-21T22:11:52.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.540+0000 7fedfe926700 1 -- start start 2023-07-21T22:11:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.540+0000 7fedfe926700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fedf80b7af0 0x7fedf80b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.540+0000 7fedfe926700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fedf80cee10 0x7fedf80cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.540+0000 7fedfe926700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf80b3e80 con 0x7fedf80d1e40 2023-07-21T22:11:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.540+0000 7fedfe926700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf80cf790 con 0x7fedf80cee10 2023-07-21T22:11:52.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.540+0000 7fedfe926700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf815fd40 con 0x7fedf80b7af0 2023-07-21T22:11:52.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe125700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fedf80cee10 0x7fedf80cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:52.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe125700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fedf80cee10 0x7fedf80cf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60982/0 (socket says 172.21.15.49:60982) 2023-07-21T22:11:52.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe125700 1 -- 172.21.15.49:0/1908486121 learned_addr learned my addr 172.21.15.49:0/1908486121 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:52.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfd924700 1 --2- 172.21.15.49:0/1908486121 >> v2:172.21.15.150:3300/0 conn(0x7fedf80b7af0 0x7fedf80b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:52.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe125700 1 -- 172.21.15.49:0/1908486121 >> v2:172.21.15.150:3300/0 conn(0x7fedf80b7af0 msgr2=0x7fedf80b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:52.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe125700 1 --2- 172.21.15.49:0/1908486121 >> v2:172.21.15.150:3300/0 conn(0x7fedf80b7af0 0x7fedf80b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe125700 1 -- 172.21.15.49:0/1908486121 >> v1:172.21.15.150:6789/0 conn(0x7fedf80d1e40 legacy=0x7fedf815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:52.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe125700 1 -- 172.21.15.49:0/1908486121 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf80cea00 con 0x7fedf80cee10 2023-07-21T22:11:52.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe125700 1 --2- 172.21.15.49:0/1908486121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedf80cee10 0x7fedf80cf250 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fedf80cede0 tx=0x7fedf000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3b4277e628642a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:52.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfc922700 1 -- 172.21.15.49:0/1908486121 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf000e070 con 0x7fedf80cee10 2023-07-21T22:11:52.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfc922700 1 -- 172.21.15.49:0/1908486121 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf0003a90 con 0x7fedf80cee10 2023-07-21T22:11:52.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfc922700 1 -- 172.21.15.49:0/1908486121 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf0003e40 con 0x7fedf80cee10 2023-07-21T22:11:52.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe926700 1 -- 172.21.15.49:0/1908486121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedf80cee10 msgr2=0x7fedf80cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:52.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe926700 1 --2- 172.21.15.49:0/1908486121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedf80cee10 0x7fedf80cf250 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fedf80cede0 tx=0x7fedf000b330 comp rx=0 tx=0).stop 2023-07-21T22:11:52.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe926700 1 -- 172.21.15.49:0/1908486121 shutdown_connections 2023-07-21T22:11:52.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe926700 1 --2- 172.21.15.49:0/1908486121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedf80cee10 0x7fedf80cf250 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe926700 1 --2- 172.21.15.49:0/1908486121 >> v2:172.21.15.150:3300/0 conn(0x7fedf80b7af0 0x7fedf80b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe926700 1 -- 172.21.15.49:0/1908486121 >> 172.21.15.49:0/1908486121 conn(0x7fedf806e960 msgr2=0x7fedf806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:52.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe926700 1 -- 172.21.15.49:0/1908486121 shutdown_connections 2023-07-21T22:11:52.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.544+0000 7fedfe926700 1 -- 172.21.15.49:0/1908486121 wait complete. 2023-07-21T22:11:52.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.548+0000 7fedfe926700 1 Processor -- start 2023-07-21T22:11:52.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.548+0000 7fedfe926700 1 -- start start 2023-07-21T22:11:52.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfe926700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedf80b7af0 0x7fedf80c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:52.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfe926700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedf80cee10 0x7fedf80cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:52.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfe926700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf80d1e40 0x7fedf80cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:52.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfe926700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf81f1b50 con 0x7fedf80cee10 2023-07-21T22:11:52.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfe926700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf81f5610 con 0x7fedf80d1e40 2023-07-21T22:11:52.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfe926700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf81f1220 con 0x7fedf80b7af0 2023-07-21T22:11:52.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfd123700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedf80cee10 0x7fedf80cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:52.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfd123700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedf80cee10 0x7fedf80cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60994/0 (socket says 172.21.15.49:60994) 2023-07-21T22:11:52.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfd123700 1 -- 172.21.15.49:0/2257640166 learned_addr learned my addr 172.21.15.49:0/2257640166 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:52.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfd924700 1 --2- 172.21.15.49:0/2257640166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedf80b7af0 0x7fedf80c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:52.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfe125700 1 --2- 172.21.15.49:0/2257640166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf80d1e40 0x7fedf80cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:52.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfd123700 1 -- 172.21.15.49:0/2257640166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedf80b7af0 msgr2=0x7fedf80c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:52.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfd123700 1 --2- 172.21.15.49:0/2257640166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedf80b7af0 0x7fedf80c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfd123700 1 -- 172.21.15.49:0/2257640166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf80d1e40 msgr2=0x7fedf80cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:52.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfd123700 1 --2- 172.21.15.49:0/2257640166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf80d1e40 0x7fedf80cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfd123700 1 -- 172.21.15.49:0/2257640166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf0009b30 con 0x7fedf80cee10 2023-07-21T22:11:52.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedfd123700 1 --2- 172.21.15.49:0/2257640166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedf80cee10 0x7fedf80cb090 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fede800b4a0 tx=0x7fede800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:52.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.552+0000 7fedee7fc700 1 -- 172.21.15.49:0/2257640166 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8011830 con 0x7fedf80cee10 2023-07-21T22:11:52.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.556+0000 7fedee7fc700 1 -- 172.21.15.49:0/2257640166 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede8011990 con 0x7fedf80cee10 2023-07-21T22:11:52.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.556+0000 7fedee7fc700 1 -- 172.21.15.49:0/2257640166 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8011d40 con 0x7fedf80cee10 2023-07-21T22:11:52.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.556+0000 7fedfe926700 1 -- 172.21.15.49:0/2257640166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf81f1500 con 0x7fedf80cee10 2023-07-21T22:11:52.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.556+0000 7fedfe926700 1 -- 172.21.15.49:0/2257640166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf81f1fe0 con 0x7fedf80cee10 2023-07-21T22:11:52.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.556+0000 7fedfe926700 1 -- 172.21.15.49:0/2257640166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf804dcb0 con 0x7fedf80cee10 2023-07-21T22:11:52.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.556+0000 7fedee7fc700 1 -- 172.21.15.49:0/2257640166 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fede801a400 con 0x7fedf80cee10 2023-07-21T22:11:52.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.560+0000 7fedee7fc700 1 --2- 172.21.15.49:0/2257640166 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feddc0662f0 0x7feddc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:52.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.560+0000 7fedee7fc700 1 -- 172.21.15.49:0/2257640166 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fede8083d60 con 0x7fedf80cee10 2023-07-21T22:11:52.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.560+0000 7fedfd924700 1 --2- 172.21.15.49:0/2257640166 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feddc0662f0 0x7feddc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:52.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.560+0000 7fedfd924700 1 --2- 172.21.15.49:0/2257640166 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feddc0662f0 0x7feddc0687a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fedf815f6c0 tx=0x7fedf4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.564+0000 7fedee7fc700 1 -- 172.21.15.49:0/2257640166 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fede8050ea0 con 0x7fedf80cee10 2023-07-21T22:11:52.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.740+0000 7fedfe926700 1 -- 172.21.15.49:0/2257640166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedf806f0b0 con 0x7fedf80cee10 2023-07-21T22:11:52.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.740+0000 7fedee7fc700 1 -- 172.21.15.49:0/2257640166 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fede80544c0 con 0x7fedf80cee10 2023-07-21T22:11:52.786 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:11:52.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.744+0000 7fedfe926700 1 -- 172.21.15.49:0/2257640166 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feddc0662f0 msgr2=0x7feddc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:52.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.744+0000 7fedfe926700 1 --2- 172.21.15.49:0/2257640166 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feddc0662f0 0x7feddc0687a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fedf815f6c0 tx=0x7fedf4008040 comp rx=0 tx=0).stop 2023-07-21T22:11:52.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.744+0000 7fedfe926700 1 -- 172.21.15.49:0/2257640166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedf80cee10 msgr2=0x7fedf80cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:52.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.744+0000 7fedfe926700 1 --2- 172.21.15.49:0/2257640166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedf80cee10 0x7fedf80cb090 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fede800b4a0 tx=0x7fede800b860 comp rx=0 tx=0).stop 2023-07-21T22:11:52.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.744+0000 7fedfe926700 1 -- 172.21.15.49:0/2257640166 shutdown_connections 2023-07-21T22:11:52.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.744+0000 7fedfe926700 1 --2- 172.21.15.49:0/2257640166 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feddc0662f0 0x7feddc0687a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.744+0000 7fedfe926700 1 --2- 172.21.15.49:0/2257640166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedf80cee10 0x7fedf80cb090 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.744+0000 7fedfe926700 1 --2- 172.21.15.49:0/2257640166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedf80d1e40 0x7fedf80cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.744+0000 7fedfe926700 1 --2- 172.21.15.49:0/2257640166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedf80b7af0 0x7fedf80c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.744+0000 7fedfe926700 1 -- 172.21.15.49:0/2257640166 >> 172.21.15.49:0/2257640166 conn(0x7fedf806e960 msgr2=0x7fedf80b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:52.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.744+0000 7fedfe926700 1 -- 172.21.15.49:0/2257640166 shutdown_connections 2023-07-21T22:11:52.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.744+0000 7fedfe926700 1 -- 172.21.15.49:0/2257640166 wait complete. 2023-07-21T22:11:52.812 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:11:52.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.944+0000 7f17bbf62700 1 Processor -- start 2023-07-21T22:11:52.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.948+0000 7f17bbf62700 1 -- start start 2023-07-21T22:11:52.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.948+0000 7f17bbf62700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17b40b4b20 0x7f17b40cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:52.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.948+0000 7f17bbf62700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b40d0810 0x7f17b40d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:52.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.948+0000 7f17bbf62700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b40b8170 con 0x7f17b40b4040 2023-07-21T22:11:52.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.948+0000 7f17bbf62700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b40cfa20 con 0x7f17b40b4b20 2023-07-21T22:11:52.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.948+0000 7f17bbf62700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40d03c0 con 0x7f17b40d0810 2023-07-21T22:11:52.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.948+0000 7f17b94fd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17b40b4b20 0x7f17b40cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:52.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.948+0000 7f17b94fd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17b40b4b20 0x7f17b40cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32774/0 (socket says 172.21.15.49:32774) 2023-07-21T22:11:52.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.948+0000 7f17b94fd700 1 -- 172.21.15.49:0/193170111 learned_addr learned my addr 172.21.15.49:0/193170111 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:52.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.948+0000 7f17ba4ff700 1 --2- 172.21.15.49:0/193170111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b40d0810 0x7f17b40d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:52.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17b94fd700 1 -- 172.21.15.49:0/193170111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b40d0810 msgr2=0x7f17b40d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:52.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17b94fd700 1 --2- 172.21.15.49:0/193170111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b40d0810 0x7f17b40d0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17b94fd700 1 -- 172.21.15.49:0/193170111 >> v1:172.21.15.150:6789/0 conn(0x7f17b40b4040 legacy=0x7f17b40b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:52.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17b94fd700 1 -- 172.21.15.49:0/193170111 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b40d2350 con 0x7f17b40b4b20 2023-07-21T22:11:52.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17b94fd700 1 --2- 172.21.15.49:0/193170111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b40b4b20 0x7f17b40cf320 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009910 tx=0x7f17a4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414ec82e3136b0e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:52.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17b8cfc700 1 -- 172.21.15.49:0/193170111 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a400ba60 con 0x7f17b40b4b20 2023-07-21T22:11:52.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17b8cfc700 1 -- 172.21.15.49:0/193170111 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a400bbc0 con 0x7f17b40b4b20 2023-07-21T22:11:52.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17b8cfc700 1 -- 172.21.15.49:0/193170111 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a4009e60 con 0x7f17b40b4b20 2023-07-21T22:11:52.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17bbf62700 1 -- 172.21.15.49:0/193170111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b40b4b20 msgr2=0x7f17b40cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:52.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17bbf62700 1 --2- 172.21.15.49:0/193170111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b40b4b20 0x7f17b40cf320 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009910 tx=0x7f17a4009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:52.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17bbf62700 1 -- 172.21.15.49:0/193170111 shutdown_connections 2023-07-21T22:11:52.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17bbf62700 1 --2- 172.21.15.49:0/193170111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b40d0810 0x7f17b40d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17bbf62700 1 --2- 172.21.15.49:0/193170111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b40b4b20 0x7f17b40cf320 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:52.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17bbf62700 1 -- 172.21.15.49:0/193170111 >> 172.21.15.49:0/193170111 conn(0x7f17b40658e0 msgr2=0x7f17b406fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:52.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17bbf62700 1 -- 172.21.15.49:0/193170111 shutdown_connections 2023-07-21T22:11:52.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.952+0000 7f17bbf62700 1 -- 172.21.15.49:0/193170111 wait complete. 2023-07-21T22:11:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17bbf62700 1 Processor -- start 2023-07-21T22:11:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17bbf62700 1 -- start start 2023-07-21T22:11:53.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17bbf62700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b40b4040 0x7f17b4153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17bbf62700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b40b4b20 0x7f17b40c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17bbf62700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17b40d0810 0x7f17b40c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17bbf62700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40c84c0 con 0x7f17b40b4040 2023-07-21T22:11:53.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17bbf62700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40c7840 con 0x7f17b40d0810 2023-07-21T22:11:53.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17bbf62700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40c7b20 con 0x7f17b40b4b20 2023-07-21T22:11:53.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17b9cfe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b40b4040 0x7f17b4153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17b9cfe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b40b4040 0x7f17b4153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32776/0 (socket says 172.21.15.49:32776) 2023-07-21T22:11:53.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17b9cfe700 1 -- 172.21.15.49:0/3064402046 learned_addr learned my addr 172.21.15.49:0/3064402046 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:53.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17b94fd700 1 --2- 172.21.15.49:0/3064402046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b40b4b20 0x7f17b40c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17ba4ff700 1 --2- 172.21.15.49:0/3064402046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17b40d0810 0x7f17b40c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17b9cfe700 1 -- 172.21.15.49:0/3064402046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b40b4b20 msgr2=0x7f17b40c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:53.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17b9cfe700 1 --2- 172.21.15.49:0/3064402046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b40b4b20 0x7f17b40c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17b9cfe700 1 -- 172.21.15.49:0/3064402046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17b40d0810 msgr2=0x7f17b40c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:53.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17b9cfe700 1 --2- 172.21.15.49:0/3064402046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17b40d0810 0x7f17b40c6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17b9cfe700 1 -- 172.21.15.49:0/3064402046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a4009570 con 0x7f17b40b4040 2023-07-21T22:11:53.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.956+0000 7f17b9cfe700 1 --2- 172.21.15.49:0/3064402046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b40b4040 0x7f17b4153b90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f17b000c500 tx=0x7f17b000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:53.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.960+0000 7f17aa7fc700 1 -- 172.21.15.49:0/3064402046 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b00052d0 con 0x7f17b40b4040 2023-07-21T22:11:53.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.960+0000 7f17aa7fc700 1 -- 172.21.15.49:0/3064402046 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b0005430 con 0x7f17b40b4040 2023-07-21T22:11:53.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.960+0000 7f17bbf62700 1 -- 172.21.15.49:0/3064402046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b40c7e00 con 0x7f17b40b4040 2023-07-21T22:11:53.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.960+0000 7f17aa7fc700 1 -- 172.21.15.49:0/3064402046 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b00055a0 con 0x7f17b40b4040 2023-07-21T22:11:53.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.960+0000 7f17bbf62700 1 -- 172.21.15.49:0/3064402046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b40c8e20 con 0x7f17b40b4040 2023-07-21T22:11:53.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.960+0000 7f17bbf62700 1 -- 172.21.15.49:0/3064402046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b404dd50 con 0x7f17b40b4040 2023-07-21T22:11:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.960+0000 7f17aa7fc700 1 -- 172.21.15.49:0/3064402046 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f17b00038e0 con 0x7f17b40b4040 2023-07-21T22:11:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.964+0000 7f17aa7fc700 1 --2- 172.21.15.49:0/3064402046 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17980662f0 0x7f17980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.964+0000 7f17aa7fc700 1 -- 172.21.15.49:0/3064402046 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f17b00832c0 con 0x7f17b40b4040 2023-07-21T22:11:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.964+0000 7f17b94fd700 1 --2- 172.21.15.49:0/3064402046 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17980662f0 0x7f17980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.964+0000 7f17b94fd700 1 --2- 172.21.15.49:0/3064402046 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17980662f0 0x7f17980687a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f17a4000c00 tx=0x7f17a4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:53.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:52.968+0000 7f17aa7fc700 1 -- 172.21.15.49:0/3064402046 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f17b00504a0 con 0x7f17b40b4040 2023-07-21T22:11:53.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.144+0000 7f17bbf62700 1 -- 172.21.15.49:0/3064402046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f17b40cc7c0 con 0x7f17b40b4040 2023-07-21T22:11:53.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.148+0000 7f17aa7fc700 1 -- 172.21.15.49:0/3064402046 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f17b0053ac0 con 0x7f17b40b4040 2023-07-21T22:11:53.191 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:11:53.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.148+0000 7f17bbf62700 1 -- 172.21.15.49:0/3064402046 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17980662f0 msgr2=0x7f17980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:53.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.148+0000 7f17bbf62700 1 --2- 172.21.15.49:0/3064402046 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17980662f0 0x7f17980687a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f17a4000c00 tx=0x7f17a4008030 comp rx=0 tx=0).stop 2023-07-21T22:11:53.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.148+0000 7f17bbf62700 1 -- 172.21.15.49:0/3064402046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b40b4040 msgr2=0x7f17b4153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:53.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.148+0000 7f17bbf62700 1 --2- 172.21.15.49:0/3064402046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b40b4040 0x7f17b4153b90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f17b000c500 tx=0x7f17b000c810 comp rx=0 tx=0).stop 2023-07-21T22:11:53.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.148+0000 7f17bbf62700 1 -- 172.21.15.49:0/3064402046 shutdown_connections 2023-07-21T22:11:53.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.148+0000 7f17bbf62700 1 --2- 172.21.15.49:0/3064402046 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17980662f0 0x7f17980687a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.148+0000 7f17bbf62700 1 --2- 172.21.15.49:0/3064402046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17b40d0810 0x7f17b40c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.148+0000 7f17bbf62700 1 --2- 172.21.15.49:0/3064402046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b40b4b20 0x7f17b40c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.148+0000 7f17bbf62700 1 --2- 172.21.15.49:0/3064402046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b40b4040 0x7f17b4153b90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.148+0000 7f17bbf62700 1 -- 172.21.15.49:0/3064402046 >> 172.21.15.49:0/3064402046 conn(0x7f17b40658e0 msgr2=0x7f17b40b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:53.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.148+0000 7f17bbf62700 1 -- 172.21.15.49:0/3064402046 shutdown_connections 2023-07-21T22:11:53.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.148+0000 7f17bbf62700 1 -- 172.21.15.49:0/3064402046 wait complete. 2023-07-21T22:11:53.214 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:11:53.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.356+0000 7f77cd7d9700 1 Processor -- start 2023-07-21T22:11:53.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.356+0000 7f77cd7d9700 1 -- start start 2023-07-21T22:11:53.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77cd7d9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f77c80b7af0 0x7f77c80b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77cd7d9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c80d1e40 0x7f77c815f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77cd7d9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c80b3e80 con 0x7f77c80cee10 2023-07-21T22:11:53.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77cd7d9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c80cea00 con 0x7f77c80b7af0 2023-07-21T22:11:53.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77cd7d9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80ccbf0 con 0x7f77c80d1e40 2023-07-21T22:11:53.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77c7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f77c80b7af0 0x7f77c80b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77c7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f77c80b7af0 0x7f77c80b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32790/0 (socket says 172.21.15.49:32790) 2023-07-21T22:11:53.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77c77fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c80d1e40 0x7f77c815f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77c7fff700 1 -- 172.21.15.49:0/3361124592 learned_addr learned my addr 172.21.15.49:0/3361124592 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:53.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77c7fff700 1 -- 172.21.15.49:0/3361124592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c80d1e40 msgr2=0x7f77c815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:53.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77c7fff700 1 --2- 172.21.15.49:0/3361124592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c80d1e40 0x7f77c815f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77c7fff700 1 -- 172.21.15.49:0/3361124592 >> v1:172.21.15.150:6789/0 conn(0x7f77c80cee10 legacy=0x7f77c80b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:53.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77c7fff700 1 -- 172.21.15.49:0/3361124592 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c80cced0 con 0x7f77c80b7af0 2023-07-21T22:11:53.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77c7fff700 1 --2- 172.21.15.49:0/3361124592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c80b7af0 0x7f77c80b1630 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f77b8009e50 tx=0x7f77b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e9847080469291 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:53.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77c6ffd700 1 -- 172.21.15.49:0/3361124592 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b800e070 con 0x7f77c80b7af0 2023-07-21T22:11:53.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77c6ffd700 1 -- 172.21.15.49:0/3361124592 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b800b910 con 0x7f77c80b7af0 2023-07-21T22:11:53.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.360+0000 7f77c6ffd700 1 -- 172.21.15.49:0/3361124592 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b800bcc0 con 0x7f77c80b7af0 2023-07-21T22:11:53.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.364+0000 7f77cd7d9700 1 -- 172.21.15.49:0/3361124592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c80b7af0 msgr2=0x7f77c80b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:53.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.364+0000 7f77cd7d9700 1 --2- 172.21.15.49:0/3361124592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c80b7af0 0x7f77c80b1630 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f77b8009e50 tx=0x7f77b800b330 comp rx=0 tx=0).stop 2023-07-21T22:11:53.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.364+0000 7f77cd7d9700 1 -- 172.21.15.49:0/3361124592 shutdown_connections 2023-07-21T22:11:53.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.364+0000 7f77cd7d9700 1 --2- 172.21.15.49:0/3361124592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c80d1e40 0x7f77c815f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.364+0000 7f77cd7d9700 1 --2- 172.21.15.49:0/3361124592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c80b7af0 0x7f77c80b1630 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.364+0000 7f77cd7d9700 1 -- 172.21.15.49:0/3361124592 >> 172.21.15.49:0/3361124592 conn(0x7f77c806e960 msgr2=0x7f77c806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:53.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.364+0000 7f77cd7d9700 1 -- 172.21.15.49:0/3361124592 shutdown_connections 2023-07-21T22:11:53.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.364+0000 7f77cd7d9700 1 -- 172.21.15.49:0/3361124592 wait complete. 2023-07-21T22:11:53.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.368+0000 7f77cd7d9700 1 Processor -- start 2023-07-21T22:11:53.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.368+0000 7f77cd7d9700 1 -- start start 2023-07-21T22:11:53.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.368+0000 7f77cd7d9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c80b7af0 0x7f77c80b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.368+0000 7f77cd7d9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77c80cee10 0x7f77c8157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.368+0000 7f77cd7d9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c80d1e40 0x7f77c815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.368+0000 7f77cd7d9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80ca520 con 0x7f77c80d1e40 2023-07-21T22:11:53.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.368+0000 7f77cd7d9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80ca800 con 0x7f77c80cee10 2023-07-21T22:11:53.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.368+0000 7f77cd7d9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80caae0 con 0x7f77c80b7af0 2023-07-21T22:11:53.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.368+0000 7f77ccfd8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c80d1e40 0x7f77c815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.368+0000 7f77c77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77c80cee10 0x7f77c8157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.368+0000 7f77ccfd8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c80d1e40 0x7f77c815b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32804/0 (socket says 172.21.15.49:32804) 2023-07-21T22:11:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.368+0000 7f77ccfd8700 1 -- 172.21.15.49:0/4266131631 learned_addr learned my addr 172.21.15.49:0/4266131631 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.368+0000 7f77c7fff700 1 --2- 172.21.15.49:0/4266131631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c80b7af0 0x7f77c80b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.372+0000 7f77ccfd8700 1 -- 172.21.15.49:0/4266131631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c80b7af0 msgr2=0x7f77c80b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.372+0000 7f77ccfd8700 1 --2- 172.21.15.49:0/4266131631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c80b7af0 0x7f77c80b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.372+0000 7f77ccfd8700 1 -- 172.21.15.49:0/4266131631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77c80cee10 msgr2=0x7f77c8157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.372+0000 7f77ccfd8700 1 --2- 172.21.15.49:0/4266131631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77c80cee10 0x7f77c8157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.372+0000 7f77ccfd8700 1 -- 172.21.15.49:0/4266131631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b8009b30 con 0x7f77c80d1e40 2023-07-21T22:11:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.372+0000 7f77ccfd8700 1 --2- 172.21.15.49:0/4266131631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c80d1e40 0x7f77c815b5b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f77c000c4b0 tx=0x7f77c000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.372+0000 7f77c4ff9700 1 -- 172.21.15.49:0/4266131631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c00052d0 con 0x7f77c80d1e40 2023-07-21T22:11:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.372+0000 7f77c4ff9700 1 -- 172.21.15.49:0/4266131631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c0005450 con 0x7f77c80d1e40 2023-07-21T22:11:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.372+0000 7f77c4ff9700 1 -- 172.21.15.49:0/4266131631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0003930 con 0x7f77c80d1e40 2023-07-21T22:11:53.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.372+0000 7f77cd7d9700 1 -- 172.21.15.49:0/4266131631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c80cadc0 con 0x7f77c80d1e40 2023-07-21T22:11:53.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.372+0000 7f77cd7d9700 1 -- 172.21.15.49:0/4266131631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c80cb380 con 0x7f77c80d1e40 2023-07-21T22:11:53.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.372+0000 7f77cd7d9700 1 -- 172.21.15.49:0/4266131631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c804dcb0 con 0x7f77c80d1e40 2023-07-21T22:11:53.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.376+0000 7f77c4ff9700 1 -- 172.21.15.49:0/4266131631 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f77c0003a90 con 0x7f77c80d1e40 2023-07-21T22:11:53.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.376+0000 7f77c4ff9700 1 --2- 172.21.15.49:0/4266131631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f77b40662f0 0x7f77b40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.376+0000 7f77c4ff9700 1 -- 172.21.15.49:0/4266131631 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f77c0083510 con 0x7f77c80d1e40 2023-07-21T22:11:53.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.376+0000 7f77c7fff700 1 --2- 172.21.15.49:0/4266131631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f77b40662f0 0x7f77b40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.380+0000 7f77c7fff700 1 --2- 172.21.15.49:0/4266131631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f77b40662f0 0x7f77b40687a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f77b800b370 tx=0x7f77b8009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:53.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.384+0000 7f77c4ff9700 1 -- 172.21.15.49:0/4266131631 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f77c0050530 con 0x7f77c80d1e40 2023-07-21T22:11:53.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.568+0000 7f77cd7d9700 1 -- 172.21.15.49:0/4266131631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77c8160220 con 0x7f77c80d1e40 2023-07-21T22:11:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.568+0000 7f77c4ff9700 1 -- 172.21.15.49:0/4266131631 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f77c0053b50 con 0x7f77c80d1e40 2023-07-21T22:11:53.613 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.572+0000 7f77cd7d9700 1 -- 172.21.15.49:0/4266131631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f77b40662f0 msgr2=0x7f77b40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.572+0000 7f77cd7d9700 1 --2- 172.21.15.49:0/4266131631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f77b40662f0 0x7f77b40687a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f77b800b370 tx=0x7f77b8009000 comp rx=0 tx=0).stop 2023-07-21T22:11:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.572+0000 7f77cd7d9700 1 -- 172.21.15.49:0/4266131631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c80d1e40 msgr2=0x7f77c815b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.572+0000 7f77cd7d9700 1 --2- 172.21.15.49:0/4266131631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c80d1e40 0x7f77c815b5b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f77c000c4b0 tx=0x7f77c000c7c0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.572+0000 7f77cd7d9700 1 -- 172.21.15.49:0/4266131631 shutdown_connections 2023-07-21T22:11:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.572+0000 7f77cd7d9700 1 --2- 172.21.15.49:0/4266131631 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f77b40662f0 0x7f77b40687a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.572+0000 7f77cd7d9700 1 --2- 172.21.15.49:0/4266131631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c80d1e40 0x7f77c815b5b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.572+0000 7f77cd7d9700 1 --2- 172.21.15.49:0/4266131631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77c80cee10 0x7f77c8157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.572+0000 7f77cd7d9700 1 --2- 172.21.15.49:0/4266131631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c80b7af0 0x7f77c80b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.572+0000 7f77cd7d9700 1 -- 172.21.15.49:0/4266131631 >> 172.21.15.49:0/4266131631 conn(0x7f77c806e960 msgr2=0x7f77c80cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.576+0000 7f77cd7d9700 1 -- 172.21.15.49:0/4266131631 shutdown_connections 2023-07-21T22:11:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.576+0000 7f77cd7d9700 1 -- 172.21.15.49:0/4266131631 wait complete. 2023-07-21T22:11:53.643 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:11:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.776+0000 7feb3bfff700 1 Processor -- start 2023-07-21T22:11:53.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.776+0000 7feb3bfff700 1 -- start start 2023-07-21T22:11:53.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb3c0b7af0 0x7feb3c0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3bfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feb3c0d1e40 0x7feb3c15f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb3c0cee10 0x7feb3c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3bfff700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c0cf7d0 con 0x7feb3c0cee10 2023-07-21T22:11:53.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3bfff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c0b3e80 con 0x7feb3c0d1e40 2023-07-21T22:11:53.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3bfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0cea00 con 0x7feb3c0b7af0 2023-07-21T22:11:53.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb3c0cee10 0x7feb3c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb3c0cee10 0x7feb3c0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32812/0 (socket says 172.21.15.49:32812) 2023-07-21T22:11:53.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3b7fe700 1 -- 172.21.15.49:0/3334482237 learned_addr learned my addr 172.21.15.49:0/3334482237 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:53.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3a7fc700 1 --2- 172.21.15.49:0/3334482237 >> v2:172.21.15.150:3300/0 conn(0x7feb3c0d1e40 0x7feb3c15f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3affd700 1 --2- 172.21.15.49:0/3334482237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb3c0b7af0 0x7feb3c0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3b7fe700 1 -- 172.21.15.49:0/3334482237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb3c0b7af0 msgr2=0x7feb3c0b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:53.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3b7fe700 1 --2- 172.21.15.49:0/3334482237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb3c0b7af0 0x7feb3c0b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3b7fe700 1 -- 172.21.15.49:0/3334482237 >> v2:172.21.15.150:3300/0 conn(0x7feb3c0d1e40 msgr2=0x7feb3c15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:53.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3b7fe700 1 --2- 172.21.15.49:0/3334482237 >> v2:172.21.15.150:3300/0 conn(0x7feb3c0d1e40 0x7feb3c15f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3b7fe700 1 -- 172.21.15.49:0/3334482237 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c0ccbf0 con 0x7feb3c0cee10 2023-07-21T22:11:53.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3a7fc700 1 --2- 172.21.15.49:0/3334482237 >> v2:172.21.15.150:3300/0 conn(0x7feb3c0d1e40 0x7feb3c15f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:53.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.780+0000 7feb3b7fe700 1 --2- 172.21.15.49:0/3334482237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb3c0cee10 0x7feb3c0cf290 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0b4fc0 tx=0x7feb3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c2a4c59c97023c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:53.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.784+0000 7feb39ffb700 1 -- 172.21.15.49:0/3334482237 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3400e070 con 0x7feb3c0cee10 2023-07-21T22:11:53.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.784+0000 7feb39ffb700 1 -- 172.21.15.49:0/3334482237 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3400b9c0 con 0x7feb3c0cee10 2023-07-21T22:11:53.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.784+0000 7feb39ffb700 1 -- 172.21.15.49:0/3334482237 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3400bd70 con 0x7feb3c0cee10 2023-07-21T22:11:53.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.784+0000 7feb3bfff700 1 -- 172.21.15.49:0/3334482237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb3c0cee10 msgr2=0x7feb3c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:53.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.784+0000 7feb3bfff700 1 --2- 172.21.15.49:0/3334482237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb3c0cee10 0x7feb3c0cf290 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0b4fc0 tx=0x7feb3400b330 comp rx=0 tx=0).stop 2023-07-21T22:11:53.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.784+0000 7feb3bfff700 1 -- 172.21.15.49:0/3334482237 shutdown_connections 2023-07-21T22:11:53.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.784+0000 7feb3bfff700 1 --2- 172.21.15.49:0/3334482237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb3c0cee10 0x7feb3c0cf290 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.784+0000 7feb3bfff700 1 --2- 172.21.15.49:0/3334482237 >> v2:172.21.15.150:3300/0 conn(0x7feb3c0d1e40 0x7feb3c15f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.784+0000 7feb3bfff700 1 --2- 172.21.15.49:0/3334482237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb3c0b7af0 0x7feb3c0b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.784+0000 7feb3bfff700 1 -- 172.21.15.49:0/3334482237 >> 172.21.15.49:0/3334482237 conn(0x7feb3c06e960 msgr2=0x7feb3c06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:53.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.784+0000 7feb3bfff700 1 -- 172.21.15.49:0/3334482237 shutdown_connections 2023-07-21T22:11:53.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.784+0000 7feb3bfff700 1 -- 172.21.15.49:0/3334482237 wait complete. 2023-07-21T22:11:53.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3bfff700 1 Processor -- start 2023-07-21T22:11:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3bfff700 1 -- start start 2023-07-21T22:11:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb3c0b7af0 0x7feb3c0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb3c0cee10 0x7feb3c15b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb3c0d1e40 0x7feb3c0cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3bfff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0c7f30 con 0x7feb3c0cee10 2023-07-21T22:11:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3bfff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0c9a10 con 0x7feb3c0b7af0 2023-07-21T22:11:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3bfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0c9c40 con 0x7feb3c0d1e40 2023-07-21T22:11:53.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb3c0cee10 0x7feb3c15b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb3c0cee10 0x7feb3c15b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32822/0 (socket says 172.21.15.49:32822) 2023-07-21T22:11:53.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3a7fc700 1 -- 172.21.15.49:0/4240713879 learned_addr learned my addr 172.21.15.49:0/4240713879 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:53.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3affd700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb3c0b7af0 0x7feb3c0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3b7fe700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb3c0d1e40 0x7feb3c0cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3a7fc700 1 -- 172.21.15.49:0/4240713879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb3c0d1e40 msgr2=0x7feb3c0cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:53.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3a7fc700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb3c0d1e40 0x7feb3c0cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3a7fc700 1 -- 172.21.15.49:0/4240713879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb3c0b7af0 msgr2=0x7feb3c0c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:53.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3a7fc700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb3c0b7af0 0x7feb3c0c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:53.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3a7fc700 1 -- 172.21.15.49:0/4240713879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb34009b30 con 0x7feb3c0cee10 2023-07-21T22:11:53.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3affd700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb3c0b7af0 0x7feb3c0c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:53.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.788+0000 7feb3b7fe700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb3c0d1e40 0x7feb3c0cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.792+0000 7feb3a7fc700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb3c0cee10 0x7feb3c15b930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7feb3000e810 tx=0x7feb3000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.792+0000 7feb23fff700 1 -- 172.21.15.49:0/4240713879 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30013610 con 0x7feb3c0cee10 2023-07-21T22:11:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.792+0000 7feb23fff700 1 -- 172.21.15.49:0/4240713879 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb30013770 con 0x7feb3c0cee10 2023-07-21T22:11:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.792+0000 7feb23fff700 1 -- 172.21.15.49:0/4240713879 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30013b00 con 0x7feb3c0cee10 2023-07-21T22:11:53.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.792+0000 7feb3bfff700 1 -- 172.21.15.49:0/4240713879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3c0c9f20 con 0x7feb3c0cee10 2023-07-21T22:11:53.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.792+0000 7feb3bfff700 1 -- 172.21.15.49:0/4240713879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3c0ca4e0 con 0x7feb3c0cee10 2023-07-21T22:11:53.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.792+0000 7feb3bfff700 1 -- 172.21.15.49:0/4240713879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c15faf0 con 0x7feb3c0cee10 2023-07-21T22:11:53.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.796+0000 7feb23fff700 1 -- 172.21.15.49:0/4240713879 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feb30013c60 con 0x7feb3c0cee10 2023-07-21T22:11:53.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.796+0000 7feb23fff700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb280662f0 0x7feb280687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:53.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.796+0000 7feb23fff700 1 -- 172.21.15.49:0/4240713879 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feb30083bc0 con 0x7feb3c0cee10 2023-07-21T22:11:53.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.796+0000 7feb3affd700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb280662f0 0x7feb280687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:53.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.796+0000 7feb3affd700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb280662f0 0x7feb280687a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009a10 tx=0x7feb2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:53.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.800+0000 7feb23fff700 1 -- 172.21.15.49:0/4240713879 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb30050d20 con 0x7feb3c0cee10 2023-07-21T22:11:54.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.976+0000 7feb3bfff700 1 -- 172.21.15.49:0/4240713879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb3c04dcb0 con 0x7feb3c0cee10 2023-07-21T22:11:54.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.980+0000 7feb23fff700 1 -- 172.21.15.49:0/4240713879 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb30054340 con 0x7feb3c0cee10 2023-07-21T22:11:54.023 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:11:54.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.984+0000 7feb3bfff700 1 -- 172.21.15.49:0/4240713879 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb280662f0 msgr2=0x7feb280687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:54.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.984+0000 7feb3bfff700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb280662f0 0x7feb280687a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009a10 tx=0x7feb2c008040 comp rx=0 tx=0).stop 2023-07-21T22:11:54.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.984+0000 7feb3bfff700 1 -- 172.21.15.49:0/4240713879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb3c0cee10 msgr2=0x7feb3c15b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.984+0000 7feb3bfff700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb3c0cee10 0x7feb3c15b930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7feb3000e810 tx=0x7feb3000ebd0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.984+0000 7feb3bfff700 1 -- 172.21.15.49:0/4240713879 shutdown_connections 2023-07-21T22:11:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.984+0000 7feb3bfff700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb280662f0 0x7feb280687a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.984+0000 7feb3bfff700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb3c0cee10 0x7feb3c15b930 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.984+0000 7feb3bfff700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb3c0d1e40 0x7feb3c0cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.984+0000 7feb3bfff700 1 --2- 172.21.15.49:0/4240713879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb3c0b7af0 0x7feb3c0c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.984+0000 7feb3bfff700 1 -- 172.21.15.49:0/4240713879 >> 172.21.15.49:0/4240713879 conn(0x7feb3c06e960 msgr2=0x7feb3c15fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.984+0000 7feb3bfff700 1 -- 172.21.15.49:0/4240713879 shutdown_connections 2023-07-21T22:11:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:53.984+0000 7feb3bfff700 1 -- 172.21.15.49:0/4240713879 wait complete. 2023-07-21T22:11:54.051 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:11:54.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.188+0000 7f58e6ae4700 1 Processor -- start 2023-07-21T22:11:54.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.188+0000 7f58e6ae4700 1 -- start start 2023-07-21T22:11:54.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58e0159be0 0x7f58e00c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:54.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f58e00ca550 0x7f58e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:54.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e006d6d0 0x7f58e00698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:54.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e00c8b80 con 0x7f58e0159be0 2023-07-21T22:11:54.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e006db90 con 0x7f58e00ca550 2023-07-21T22:11:54.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e006de70 con 0x7f58e006d6d0 2023-07-21T22:11:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e5ae2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58e0159be0 0x7f58e00c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e5ae2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58e0159be0 0x7f58e00c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32834/0 (socket says 172.21.15.49:32834) 2023-07-21T22:11:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e5ae2700 1 -- 172.21.15.49:0/1658432398 learned_addr learned my addr 172.21.15.49:0/1658432398 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e62e3700 1 --2- 172.21.15.49:0/1658432398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e006d6d0 0x7f58e00698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e52e1700 1 --2- 172.21.15.49:0/1658432398 >> v2:172.21.15.150:3300/0 conn(0x7f58e00ca550 0x7f58e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:54.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e5ae2700 1 -- 172.21.15.49:0/1658432398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e006d6d0 msgr2=0x7f58e00698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:54.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e5ae2700 1 --2- 172.21.15.49:0/1658432398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e006d6d0 0x7f58e00698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e5ae2700 1 -- 172.21.15.49:0/1658432398 >> v2:172.21.15.150:3300/0 conn(0x7f58e00ca550 msgr2=0x7f58e006d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:54.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e5ae2700 1 --2- 172.21.15.49:0/1658432398 >> v2:172.21.15.150:3300/0 conn(0x7f58e00ca550 0x7f58e006d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e5ae2700 1 -- 172.21.15.49:0/1658432398 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e00c8810 con 0x7f58e0159be0 2023-07-21T22:11:54.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e62e3700 1 --2- 172.21.15.49:0/1658432398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e006d6d0 0x7f58e00698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:54.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e52e1700 1 --2- 172.21.15.49:0/1658432398 >> v2:172.21.15.150:3300/0 conn(0x7f58e00ca550 0x7f58e006d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:54.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e5ae2700 1 --2- 172.21.15.49:0/1658432398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e0159be0 0x7f58e00c9010 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f58e015d4d0 tx=0x7f58dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576de79d034baaa9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:54.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e4ae0700 1 -- 172.21.15.49:0/1658432398 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00e070 con 0x7f58e0159be0 2023-07-21T22:11:54.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e4ae0700 1 -- 172.21.15.49:0/1658432398 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc00b9c0 con 0x7f58e0159be0 2023-07-21T22:11:54.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e4ae0700 1 -- 172.21.15.49:0/1658432398 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00bd70 con 0x7f58e0159be0 2023-07-21T22:11:54.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1658432398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e0159be0 msgr2=0x7f58e00c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:54.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 --2- 172.21.15.49:0/1658432398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e0159be0 0x7f58e00c9010 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f58e015d4d0 tx=0x7f58dc00b330 comp rx=0 tx=0).stop 2023-07-21T22:11:54.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1658432398 shutdown_connections 2023-07-21T22:11:54.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 --2- 172.21.15.49:0/1658432398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e006d6d0 0x7f58e00698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 --2- 172.21.15.49:0/1658432398 >> v2:172.21.15.150:3300/0 conn(0x7f58e00ca550 0x7f58e006d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 --2- 172.21.15.49:0/1658432398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e0159be0 0x7f58e00c9010 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1658432398 >> 172.21.15.49:0/1658432398 conn(0x7f58e00ce0d0 msgr2=0x7f58e00ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:54.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1658432398 shutdown_connections 2023-07-21T22:11:54.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.192+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1658432398 wait complete. 2023-07-21T22:11:54.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.196+0000 7f58e6ae4700 1 Processor -- start 2023-07-21T22:11:54.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.196+0000 7f58e6ae4700 1 -- start start 2023-07-21T22:11:54.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.196+0000 7f58e6ae4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e006d6d0 0x7f58e00ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:54.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.196+0000 7f58e6ae4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e00ca550 0x7f58e00b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:54.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.196+0000 7f58e6ae4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e0159be0 0x7f58e014d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:54.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.196+0000 7f58e6ae4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00b17c0 con 0x7f58e00ca550 2023-07-21T22:11:54.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.196+0000 7f58e6ae4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00cdc50 con 0x7f58e006d6d0 2023-07-21T22:11:54.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.196+0000 7f58e6ae4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e014dd90 con 0x7f58e0159be0 2023-07-21T22:11:54.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58e52e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e00ca550 0x7f58e00b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:54.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58e5ae2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e006d6d0 0x7f58e00ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:54.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58e52e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e00ca550 0x7f58e00b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32842/0 (socket says 172.21.15.49:32842) 2023-07-21T22:11:54.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58e52e1700 1 -- 172.21.15.49:0/1923801000 learned_addr learned my addr 172.21.15.49:0/1923801000 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:54.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58e62e3700 1 --2- 172.21.15.49:0/1923801000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e0159be0 0x7f58e014d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:54.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58e52e1700 1 -- 172.21.15.49:0/1923801000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e0159be0 msgr2=0x7f58e014d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:54.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58e52e1700 1 --2- 172.21.15.49:0/1923801000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e0159be0 0x7f58e014d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58e52e1700 1 -- 172.21.15.49:0/1923801000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e006d6d0 msgr2=0x7f58e00ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:54.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58e52e1700 1 --2- 172.21.15.49:0/1923801000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e006d6d0 0x7f58e00ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58e52e1700 1 -- 172.21.15.49:0/1923801000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc009b30 con 0x7f58e00ca550 2023-07-21T22:11:54.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58e52e1700 1 --2- 172.21.15.49:0/1923801000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e00ca550 0x7f58e00b1280 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f58d000e880 tx=0x7f58d000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:54.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58d67fc700 1 -- 172.21.15.49:0/1923801000 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0013610 con 0x7f58e00ca550 2023-07-21T22:11:54.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58d67fc700 1 -- 172.21.15.49:0/1923801000 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d0013770 con 0x7f58e00ca550 2023-07-21T22:11:54.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1923801000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e00cd690 con 0x7f58e00ca550 2023-07-21T22:11:54.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58d67fc700 1 -- 172.21.15.49:0/1923801000 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0013b00 con 0x7f58e00ca550 2023-07-21T22:11:54.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.200+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1923801000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e00ab9e0 con 0x7f58e00ca550 2023-07-21T22:11:54.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.204+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1923801000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e004dcb0 con 0x7f58e00ca550 2023-07-21T22:11:54.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.204+0000 7f58d67fc700 1 -- 172.21.15.49:0/1923801000 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f58d0013c60 con 0x7f58e00ca550 2023-07-21T22:11:54.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.204+0000 7f58d67fc700 1 --2- 172.21.15.49:0/1923801000 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f58c40662f0 0x7f58c40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:54.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.208+0000 7f58d67fc700 1 -- 172.21.15.49:0/1923801000 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f58d0083bd0 con 0x7f58e00ca550 2023-07-21T22:11:54.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.208+0000 7f58e5ae2700 1 --2- 172.21.15.49:0/1923801000 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f58c40662f0 0x7f58c40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:54.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.208+0000 7f58e5ae2700 1 --2- 172.21.15.49:0/1923801000 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f58c40662f0 0x7f58c40687a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00b370 tx=0x7f58dc009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:54.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.208+0000 7f58d67fc700 1 -- 172.21.15.49:0/1923801000 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58d0054710 con 0x7f58e00ca550 2023-07-21T22:11:54.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.380+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1923801000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f58e0156c60 con 0x7f58e00ca550 2023-07-21T22:11:54.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.384+0000 7f58d67fc700 1 -- 172.21.15.49:0/1923801000 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f58d0017020 con 0x7f58e00ca550 2023-07-21T22:11:54.427 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:54.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.384+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1923801000 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f58c40662f0 msgr2=0x7f58c40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:54.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.384+0000 7f58e6ae4700 1 --2- 172.21.15.49:0/1923801000 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f58c40662f0 0x7f58c40687a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00b370 tx=0x7f58dc009000 comp rx=0 tx=0).stop 2023-07-21T22:11:54.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.384+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1923801000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e00ca550 msgr2=0x7f58e00b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:54.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.384+0000 7f58e6ae4700 1 --2- 172.21.15.49:0/1923801000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e00ca550 0x7f58e00b1280 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f58d000e880 tx=0x7f58d000eb90 comp rx=0 tx=0).stop 2023-07-21T22:11:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.384+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1923801000 shutdown_connections 2023-07-21T22:11:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.384+0000 7f58e6ae4700 1 --2- 172.21.15.49:0/1923801000 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f58c40662f0 0x7f58c40687a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.384+0000 7f58e6ae4700 1 --2- 172.21.15.49:0/1923801000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e00ca550 0x7f58e00b1280 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.384+0000 7f58e6ae4700 1 --2- 172.21.15.49:0/1923801000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e0159be0 0x7f58e014d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.384+0000 7f58e6ae4700 1 --2- 172.21.15.49:0/1923801000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e006d6d0 0x7f58e00ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.384+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1923801000 >> 172.21.15.49:0/1923801000 conn(0x7f58e00ce0d0 msgr2=0x7f58e006bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:54.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.384+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1923801000 shutdown_connections 2023-07-21T22:11:54.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.384+0000 7f58e6ae4700 1 -- 172.21.15.49:0/1923801000 wait complete. 2023-07-21T22:11:54.450 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:11:54.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.584+0000 7f7158f13700 1 Processor -- start 2023-07-21T22:11:54.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.584+0000 7f7158f13700 1 -- start start 2023-07-21T22:11:54.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7158f13700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f715406d5d0 0x7f715406d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:54.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7158f13700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7154159f60 0x7f71540afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:54.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7158f13700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f71540b0160 0x7f7154070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:54.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7158f13700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715406dee0 con 0x7f7154159f60 2023-07-21T22:11:54.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7158f13700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71540b0600 con 0x7f71540b0160 2023-07-21T22:11:54.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7158f13700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715415a470 con 0x7f715406d5d0 2023-07-21T22:11:54.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7151d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7154159f60 0x7f71540afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:54.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7151d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7154159f60 0x7f71540afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38834/0 (socket says 172.21.15.49:38834) 2023-07-21T22:11:54.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7151d9b700 1 -- 172.21.15.49:0/790463931 learned_addr learned my addr 172.21.15.49:0/790463931 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:54.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7152d9d700 1 --2- 172.21.15.49:0/790463931 >> v2:172.21.15.150:3300/0 conn(0x7f71540b0160 0x7f7154070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:54.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f715259c700 1 --2- 172.21.15.49:0/790463931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f715406d5d0 0x7f715406d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:54.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7151d9b700 1 -- 172.21.15.49:0/790463931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f715406d5d0 msgr2=0x7f715406d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:54.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7151d9b700 1 --2- 172.21.15.49:0/790463931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f715406d5d0 0x7f715406d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7151d9b700 1 -- 172.21.15.49:0/790463931 >> v2:172.21.15.150:3300/0 conn(0x7f71540b0160 msgr2=0x7f7154070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:54.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7151d9b700 1 --2- 172.21.15.49:0/790463931 >> v2:172.21.15.150:3300/0 conn(0x7f71540b0160 0x7f7154070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7151d9b700 1 -- 172.21.15.49:0/790463931 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715415a750 con 0x7f7154159f60 2023-07-21T22:11:54.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f7151d9b700 1 --2- 172.21.15.49:0/790463931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7154159f60 0x7f71540afc20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f71540730b0 tx=0x7f7148009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55555b03d840b949 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:54.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f715159a700 1 -- 172.21.15.49:0/790463931 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7148011830 con 0x7f7154159f60 2023-07-21T22:11:54.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f715159a700 1 -- 172.21.15.49:0/790463931 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7148011990 con 0x7f7154159f60 2023-07-21T22:11:54.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.588+0000 7f715159a700 1 -- 172.21.15.49:0/790463931 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7148011d20 con 0x7f7154159f60 2023-07-21T22:11:54.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.592+0000 7f7158f13700 1 -- 172.21.15.49:0/790463931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7154159f60 msgr2=0x7f71540afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:54.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.592+0000 7f7158f13700 1 --2- 172.21.15.49:0/790463931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7154159f60 0x7f71540afc20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f71540730b0 tx=0x7f7148009bf0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.592+0000 7f7158f13700 1 -- 172.21.15.49:0/790463931 shutdown_connections 2023-07-21T22:11:54.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.592+0000 7f7158f13700 1 --2- 172.21.15.49:0/790463931 >> v2:172.21.15.150:3300/0 conn(0x7f71540b0160 0x7f7154070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.592+0000 7f7158f13700 1 --2- 172.21.15.49:0/790463931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7154159f60 0x7f71540afc20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.592+0000 7f7158f13700 1 --2- 172.21.15.49:0/790463931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f715406d5d0 0x7f715406d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.592+0000 7f7158f13700 1 -- 172.21.15.49:0/790463931 >> 172.21.15.49:0/790463931 conn(0x7f715406f5a0 msgr2=0x7f71540cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:54.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.592+0000 7f7158f13700 1 -- 172.21.15.49:0/790463931 shutdown_connections 2023-07-21T22:11:54.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.592+0000 7f7158f13700 1 -- 172.21.15.49:0/790463931 wait complete. 2023-07-21T22:11:54.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.596+0000 7f7158f13700 1 Processor -- start 2023-07-21T22:11:54.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.596+0000 7f7158f13700 1 -- start start 2023-07-21T22:11:54.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.596+0000 7f7158f13700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f715406d5d0 0x7f715414fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:54.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.596+0000 7f7158f13700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71540b0160 0x7f71540c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:54.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.596+0000 7f7158f13700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7154159f60 0x7f7154152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:54.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.596+0000 7f7158f13700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7154153fd0 con 0x7f7154159f60 2023-07-21T22:11:54.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.596+0000 7f7158f13700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71540b14e0 con 0x7f715406d5d0 2023-07-21T22:11:54.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.596+0000 7f7158f13700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71540c46c0 con 0x7f71540b0160 2023-07-21T22:11:54.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.596+0000 7f7152d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7154159f60 0x7f7154152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:54.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.596+0000 7f7152d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7154159f60 0x7f7154152220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38848/0 (socket says 172.21.15.49:38848) 2023-07-21T22:11:54.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.596+0000 7f7152d9d700 1 -- 172.21.15.49:0/4294949145 learned_addr learned my addr 172.21.15.49:0/4294949145 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:54.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.596+0000 7f715259c700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f715406d5d0 0x7f715414fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:54.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.596+0000 7f7151d9b700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71540b0160 0x7f71540c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:54.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.600+0000 7f7152d9d700 1 -- 172.21.15.49:0/4294949145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71540b0160 msgr2=0x7f71540c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:54.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.600+0000 7f7152d9d700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71540b0160 0x7f71540c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.600+0000 7f7152d9d700 1 -- 172.21.15.49:0/4294949145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f715406d5d0 msgr2=0x7f715414fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:54.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.600+0000 7f7152d9d700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f715406d5d0 0x7f715414fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.600+0000 7f7152d9d700 1 -- 172.21.15.49:0/4294949145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7148009570 con 0x7f7154159f60 2023-07-21T22:11:54.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.600+0000 7f7151d9b700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71540b0160 0x7f71540c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:54.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.600+0000 7f7152d9d700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7154159f60 0x7f7154152220 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f714c00efc0 tx=0x7f714c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:54.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.600+0000 7f7142ffd700 1 -- 172.21.15.49:0/4294949145 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c00cd40 con 0x7f7154159f60 2023-07-21T22:11:54.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.600+0000 7f7142ffd700 1 -- 172.21.15.49:0/4294949145 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c00f040 con 0x7f7154159f60 2023-07-21T22:11:54.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.600+0000 7f7158f13700 1 -- 172.21.15.49:0/4294949145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71540c49a0 con 0x7f7154159f60 2023-07-21T22:11:54.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.600+0000 7f7142ffd700 1 -- 172.21.15.49:0/4294949145 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c0146c0 con 0x7f7154159f60 2023-07-21T22:11:54.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.600+0000 7f7158f13700 1 -- 172.21.15.49:0/4294949145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71541500e0 con 0x7f7154159f60 2023-07-21T22:11:54.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.600+0000 7f7158f13700 1 -- 172.21.15.49:0/4294949145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7154073130 con 0x7f7154159f60 2023-07-21T22:11:54.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.604+0000 7f7142ffd700 1 -- 172.21.15.49:0/4294949145 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f714c014820 con 0x7f7154159f60 2023-07-21T22:11:54.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.608+0000 7f7142ffd700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71340662f0 0x7f71340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:54.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.608+0000 7f7142ffd700 1 -- 172.21.15.49:0/4294949145 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f714c084c50 con 0x7f7154159f60 2023-07-21T22:11:54.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.608+0000 7f715259c700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71340662f0 0x7f71340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:54.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.608+0000 7f715259c700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71340662f0 0x7f71340687a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7144007a60 tx=0x7f7144008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:54.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.612+0000 7f7142ffd700 1 -- 172.21.15.49:0/4294949145 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f714c051d00 con 0x7f7154159f60 2023-07-21T22:11:54.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.800+0000 7f7158f13700 1 -- 172.21.15.49:0/4294949145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f71540c4be0 con 0x7f7154159f60 2023-07-21T22:11:54.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.800+0000 7f7142ffd700 1 -- 172.21.15.49:0/4294949145 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7f71540c4be0 con 0x7f7154159f60 2023-07-21T22:11:54.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.800+0000 7f7158f13700 1 -- 172.21.15.49:0/4294949145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71340662f0 msgr2=0x7f71340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:54.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.800+0000 7f7158f13700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71340662f0 0x7f71340687a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7144007a60 tx=0x7f7144008040 comp rx=0 tx=0).stop 2023-07-21T22:11:54.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.800+0000 7f7158f13700 1 -- 172.21.15.49:0/4294949145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7154159f60 msgr2=0x7f7154152220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:54.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.800+0000 7f7158f13700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7154159f60 0x7f7154152220 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f714c00efc0 tx=0x7f714c00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.800+0000 7f7158f13700 1 -- 172.21.15.49:0/4294949145 shutdown_connections 2023-07-21T22:11:54.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.800+0000 7f7158f13700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71340662f0 0x7f71340687a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.800+0000 7f7158f13700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7154159f60 0x7f7154152220 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.800+0000 7f7158f13700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71540b0160 0x7f71540c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.800+0000 7f7158f13700 1 --2- 172.21.15.49:0/4294949145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f715406d5d0 0x7f715414fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:54.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.800+0000 7f7158f13700 1 -- 172.21.15.49:0/4294949145 >> 172.21.15.49:0/4294949145 conn(0x7f715406f5a0 msgr2=0x7f71540ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:54.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.804+0000 7f7158f13700 1 -- 172.21.15.49:0/4294949145 shutdown_connections 2023-07-21T22:11:54.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:54.804+0000 7f7158f13700 1 -- 172.21.15.49:0/4294949145 wait complete. 2023-07-21T22:11:54.849 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:11:54.870 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:11:54.870 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:11:54.887 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:55.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.064+0000 7f1b397bf700 1 Processor -- start 2023-07-21T22:11:55.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.064+0000 7f1b397bf700 1 -- start start 2023-07-21T22:11:55.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.068+0000 7f1b397bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340b7a40 0x7f1b3415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.068+0000 7f1b397bf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b340cfff0 0x7f1b340d23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.068+0000 7f1b397bf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3415d150 con 0x7f1b340d0440 2023-07-21T22:11:55.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.068+0000 7f1b397bf700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b340ce7f0 con 0x7f1b340cfff0 2023-07-21T22:11:55.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.068+0000 7f1b397bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b340ccdc0 con 0x7f1b340b7a40 2023-07-21T22:11:55.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.068+0000 7f1b327fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b340cfff0 0x7f1b340d23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.068+0000 7f1b32ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340b7a40 0x7f1b3415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.068+0000 7f1b327fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b340cfff0 0x7f1b340d23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38852/0 (socket says 172.21.15.49:38852) 2023-07-21T22:11:55.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.068+0000 7f1b327fc700 1 -- 172.21.15.49:0/1680356101 learned_addr learned my addr 172.21.15.49:0/1680356101 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:55.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b327fc700 1 -- 172.21.15.49:0/1680356101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340b7a40 msgr2=0x7f1b3415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:55.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b327fc700 1 --2- 172.21.15.49:0/1680356101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340b7a40 0x7f1b3415cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b327fc700 1 -- 172.21.15.49:0/1680356101 >> v1:172.21.15.150:6789/0 conn(0x7f1b340d0440 legacy=0x7f1b340cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b327fc700 1 -- 172.21.15.49:0/1680356101 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b340cea60 con 0x7f1b340cfff0 2023-07-21T22:11:55.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b31ffb700 1 -- 172.21.15.49:0/1680356101 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576405777 0 0) 0x7f1b3415d150 con 0x7f1b340d0440 2023-07-21T22:11:55.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b327fc700 1 --2- 172.21.15.49:0/1680356101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b340cfff0 0x7f1b340d23b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009910 tx=0x7f1b28009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a115e4eec53d81 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:55.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b31ffb700 1 -- 172.21.15.49:0/1680356101 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28011830 con 0x7f1b340cfff0 2023-07-21T22:11:55.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b31ffb700 1 -- 172.21.15.49:0/1680356101 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28011990 con 0x7f1b340cfff0 2023-07-21T22:11:55.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b31ffb700 1 -- 172.21.15.49:0/1680356101 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28011d40 con 0x7f1b340cfff0 2023-07-21T22:11:55.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b397bf700 1 -- 172.21.15.49:0/1680356101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b340cfff0 msgr2=0x7f1b340d23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b397bf700 1 --2- 172.21.15.49:0/1680356101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b340cfff0 0x7f1b340d23b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009910 tx=0x7f1b28009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:55.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b397bf700 1 -- 172.21.15.49:0/1680356101 shutdown_connections 2023-07-21T22:11:55.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b397bf700 1 --2- 172.21.15.49:0/1680356101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b340cfff0 0x7f1b340d23b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b397bf700 1 --2- 172.21.15.49:0/1680356101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340b7a40 0x7f1b3415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b397bf700 1 -- 172.21.15.49:0/1680356101 >> 172.21.15.49:0/1680356101 conn(0x7f1b3406fe40 msgr2=0x7f1b34070210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:55.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b397bf700 1 -- 172.21.15.49:0/1680356101 shutdown_connections 2023-07-21T22:11:55.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.072+0000 7f1b397bf700 1 -- 172.21.15.49:0/1680356101 wait complete. 2023-07-21T22:11:55.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.076+0000 7f1b397bf700 1 Processor -- start 2023-07-21T22:11:55.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.076+0000 7f1b397bf700 1 -- start start 2023-07-21T22:11:55.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b397bf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b340b7a40 0x7f1b3414cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b397bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340cfff0 0x7f1b340ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b397bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b340d0440 0x7f1b340c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b397bf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b340c5f50 con 0x7f1b340d0440 2023-07-21T22:11:55.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b397bf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3414d600 con 0x7f1b340b7a40 2023-07-21T22:11:55.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b397bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3414dea0 con 0x7f1b340cfff0 2023-07-21T22:11:55.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b337fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b340d0440 0x7f1b340c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b337fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b340d0440 0x7f1b340c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38856/0 (socket says 172.21.15.49:38856) 2023-07-21T22:11:55.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b337fe700 1 -- 172.21.15.49:0/3837201635 learned_addr learned my addr 172.21.15.49:0/3837201635 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:55.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b32ffd700 1 --2- 172.21.15.49:0/3837201635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b340b7a40 0x7f1b3414cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b327fc700 1 --2- 172.21.15.49:0/3837201635 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340cfff0 0x7f1b340ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b337fe700 1 -- 172.21.15.49:0/3837201635 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340cfff0 msgr2=0x7f1b340ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b337fe700 1 --2- 172.21.15.49:0/3837201635 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340cfff0 0x7f1b340ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b337fe700 1 -- 172.21.15.49:0/3837201635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b340b7a40 msgr2=0x7f1b3414cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b337fe700 1 --2- 172.21.15.49:0/3837201635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b340b7a40 0x7f1b3414cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b337fe700 1 -- 172.21.15.49:0/3837201635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b28009570 con 0x7f1b340d0440 2023-07-21T22:11:55.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b337fe700 1 --2- 172.21.15.49:0/3837201635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b340d0440 0x7f1b340c81b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00cc10 tx=0x7f1b2c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:55.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b1b7fe700 1 -- 172.21.15.49:0/3837201635 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c003e50 con 0x7f1b340d0440 2023-07-21T22:11:55.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b1b7fe700 1 -- 172.21.15.49:0/3837201635 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c00a700 con 0x7f1b340d0440 2023-07-21T22:11:55.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b1b7fe700 1 -- 172.21.15.49:0/3837201635 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c00aab0 con 0x7f1b340d0440 2023-07-21T22:11:55.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b397bf700 1 -- 172.21.15.49:0/3837201635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3414d0c0 con 0x7f1b340d0440 2023-07-21T22:11:55.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.080+0000 7f1b397bf700 1 -- 172.21.15.49:0/3837201635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3414d850 con 0x7f1b340d0440 2023-07-21T22:11:55.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.084+0000 7f1b397bf700 1 -- 172.21.15.49:0/3837201635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3414e010 con 0x7f1b340d0440 2023-07-21T22:11:55.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.084+0000 7f1b1b7fe700 1 -- 172.21.15.49:0/3837201635 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1b2c00ac10 con 0x7f1b340d0440 2023-07-21T22:11:55.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.088+0000 7f1b1b7fe700 1 --2- 172.21.15.49:0/3837201635 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b200662f0 0x7f1b200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.088+0000 7f1b1b7fe700 1 -- 172.21.15.49:0/3837201635 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1b2c083a50 con 0x7f1b340d0440 2023-07-21T22:11:55.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.088+0000 7f1b32ffd700 1 --2- 172.21.15.49:0/3837201635 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b200662f0 0x7f1b200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.088+0000 7f1b32ffd700 1 --2- 172.21.15.49:0/3837201635 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b200662f0 0x7f1b200687a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1b34158100 tx=0x7f1b24009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:55.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.092+0000 7f1b1b7fe700 1 -- 172.21.15.49:0/3837201635 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b2c050c30 con 0x7f1b340d0440 2023-07-21T22:11:55.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.272+0000 7f1b397bf700 1 -- 172.21.15.49:0/3837201635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b3404dcb0 con 0x7f1b340d0440 2023-07-21T22:11:55.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.276+0000 7f1b1b7fe700 1 -- 172.21.15.49:0/3837201635 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7f1b2c054250 con 0x7f1b340d0440 2023-07-21T22:11:55.321 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:55.321 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:55.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.280+0000 7f1b397bf700 1 -- 172.21.15.49:0/3837201635 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b200662f0 msgr2=0x7f1b200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.280+0000 7f1b397bf700 1 --2- 172.21.15.49:0/3837201635 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b200662f0 0x7f1b200687a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1b34158100 tx=0x7f1b24009240 comp rx=0 tx=0).stop 2023-07-21T22:11:55.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.280+0000 7f1b397bf700 1 -- 172.21.15.49:0/3837201635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b340d0440 msgr2=0x7f1b340c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.280+0000 7f1b397bf700 1 --2- 172.21.15.49:0/3837201635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b340d0440 0x7f1b340c81b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00cc10 tx=0x7f1b2c00cf20 comp rx=0 tx=0).stop 2023-07-21T22:11:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.280+0000 7f1b397bf700 1 -- 172.21.15.49:0/3837201635 shutdown_connections 2023-07-21T22:11:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.280+0000 7f1b397bf700 1 --2- 172.21.15.49:0/3837201635 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b200662f0 0x7f1b200687a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.280+0000 7f1b397bf700 1 --2- 172.21.15.49:0/3837201635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b340d0440 0x7f1b340c81b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.280+0000 7f1b397bf700 1 --2- 172.21.15.49:0/3837201635 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340cfff0 0x7f1b340ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.280+0000 7f1b397bf700 1 --2- 172.21.15.49:0/3837201635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b340b7a40 0x7f1b3414cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.280+0000 7f1b397bf700 1 -- 172.21.15.49:0/3837201635 >> 172.21.15.49:0/3837201635 conn(0x7f1b3406fe40 msgr2=0x7f1b340cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.280+0000 7f1b397bf700 1 -- 172.21.15.49:0/3837201635 shutdown_connections 2023-07-21T22:11:55.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.280+0000 7f1b397bf700 1 -- 172.21.15.49:0/3837201635 wait complete. 2023-07-21T22:11:55.346 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:11:55.347 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:11:55.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.488+0000 7fa5ab23e700 1 Processor -- start 2023-07-21T22:11:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.488+0000 7fa5ab23e700 1 -- start start 2023-07-21T22:11:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5ab23e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a40cb2f0 0x7fa5a4163d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5ab23e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a40cdf00 con 0x7fa5a4071220 2023-07-21T22:11:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5ab23e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a40ce600 con 0x7fa5a4160110 2023-07-21T22:11:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5ab23e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40cd730 con 0x7fa5a40cb2f0 2023-07-21T22:11:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa5a4071220 0x7fa5a40cabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40798/0 (socket says 172.21.15.49:40798) 2023-07-21T22:11:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a3fff700 1 -- 172.21.15.49:0/20370884 learned_addr learned my addr 172.21.15.49:0/20370884 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622413177 0 0) 0x7fa5a40cdf00 con 0x7fa5a4071220 2023-07-21T22:11:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a97db700 1 --2- 172.21.15.49:0/20370884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a40cb2f0 0x7fa5a4163d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa58c0035d0 con 0x7fa5a4071220 2023-07-21T22:11:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355217150 0 0) 0x7fa5a40ce600 con 0x7fa5a4160110 2023-07-21T22:11:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a40cdf00 con 0x7fa5a4160110 2023-07-21T22:11:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1753282476 0 0) 0x7fa58c0035d0 con 0x7fa5a4071220 2023-07-21T22:11:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a40cb2f0 msgr2=0x7fa5a4163d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:55.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 --2- 172.21.15.49:0/20370884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a40cb2f0 0x7fa5a4163d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 >> v1:172.21.15.150:6789/0 conn(0x7fa5a4160110 legacy=0x7fa5a40cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a406e190 con 0x7fa5a4071220 2023-07-21T22:11:55.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7fa5940017f0 con 0x7fa5a4071220 2023-07-21T22:11:55.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 >> v1:172.21.15.49:6789/0 conn(0x7fa5a4071220 legacy=0x7fa5a40cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 --2- 172.21.15.49:0/20370884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a40cb2f0 0x7fa58c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 --2- 172.21.15.49:0/20370884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa58c004140 0x7fa58c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 --2- 172.21.15.49:0/20370884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c004db0 0x7fa58c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40cd730 con 0x7fa58c004140 2023-07-21T22:11:55.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c00bbc0 con 0x7fa58c004db0 2023-07-21T22:11:55.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c00bd50 con 0x7fa5a40cb2f0 2023-07-21T22:11:55.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a3fff700 1 --2- 172.21.15.49:0/20370884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa58c004140 0x7fa58c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a97db700 1 --2- 172.21.15.49:0/20370884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c004db0 0x7fa58c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a8fda700 1 --2- 172.21.15.49:0/20370884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a40cb2f0 0x7fa58c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a97db700 1 -- 172.21.15.49:0/20370884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a40cb2f0 msgr2=0x7fa58c003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:55.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a97db700 1 --2- 172.21.15.49:0/20370884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a40cb2f0 0x7fa58c003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a97db700 1 -- 172.21.15.49:0/20370884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa58c004140 msgr2=0x7fa58c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:55.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a97db700 1 --2- 172.21.15.49:0/20370884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa58c004140 0x7fa58c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.492+0000 7fa5a97db700 1 -- 172.21.15.49:0/20370884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c0035d0 con 0x7fa58c004db0 2023-07-21T22:11:55.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.496+0000 7fa5a97db700 1 --2- 172.21.15.49:0/20370884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c004db0 0x7fa58c005220 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009f90 tx=0x7fa58c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f8c8afe29c1e216 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:55.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.496+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c00ec30 con 0x7fa58c004db0 2023-07-21T22:11:55.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.496+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c00f040 con 0x7fa58c004db0 2023-07-21T22:11:55.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.496+0000 7fa5a37fe700 1 -- 172.21.15.49:0/20370884 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c014480 con 0x7fa58c004db0 2023-07-21T22:11:55.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.496+0000 7fa5ab23e700 1 -- 172.21.15.49:0/20370884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c004db0 msgr2=0x7fa58c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.496+0000 7fa5ab23e700 1 --2- 172.21.15.49:0/20370884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c004db0 0x7fa58c005220 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009f90 tx=0x7fa58c0058a0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.496+0000 7fa5a97db700 1 -- 172.21.15.49:0/20370884 reap_dead start 2023-07-21T22:11:55.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.496+0000 7fa5ab23e700 1 -- 172.21.15.49:0/20370884 shutdown_connections 2023-07-21T22:11:55.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.496+0000 7fa5ab23e700 1 -- 172.21.15.49:0/20370884 >> 172.21.15.49:0/20370884 conn(0x7fa5a406e960 msgr2=0x7fa5a406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:55.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.496+0000 7fa5ab23e700 1 -- 172.21.15.49:0/20370884 shutdown_connections 2023-07-21T22:11:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.496+0000 7fa5ab23e700 1 -- 172.21.15.49:0/20370884 wait complete. 2023-07-21T22:11:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5ab23e700 1 Processor -- start 2023-07-21T22:11:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5ab23e700 1 -- start start 2023-07-21T22:11:55.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5ab23e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa58c004db0 0x7fa5a40c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5ab23e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a414f980 0x7fa5a40c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5ab23e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5a414fdf0 0x7fa5a40c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5ab23e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40c77e0 con 0x7fa58c004db0 2023-07-21T22:11:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5ab23e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4160580 con 0x7fa5a414fdf0 2023-07-21T22:11:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5ab23e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4160860 con 0x7fa5a414f980 2023-07-21T22:11:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5a8fda700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa58c004db0 0x7fa5a40c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5a8fda700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa58c004db0 0x7fa5a40c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38868/0 (socket says 172.21.15.49:38868) 2023-07-21T22:11:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5a8fda700 1 -- 172.21.15.49:0/1695960478 learned_addr learned my addr 172.21.15.49:0/1695960478 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5a3fff700 1 --2- 172.21.15.49:0/1695960478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a414f980 0x7fa5a40c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5a97db700 1 --2- 172.21.15.49:0/1695960478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5a414fdf0 0x7fa5a40c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5a8fda700 1 -- 172.21.15.49:0/1695960478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a414f980 msgr2=0x7fa5a40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5a8fda700 1 --2- 172.21.15.49:0/1695960478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a414f980 0x7fa5a40c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5a8fda700 1 -- 172.21.15.49:0/1695960478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5a414fdf0 msgr2=0x7fa5a40c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5a8fda700 1 --2- 172.21.15.49:0/1695960478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5a414fdf0 0x7fa5a40c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5a8fda700 1 -- 172.21.15.49:0/1695960478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a4160b40 con 0x7fa58c004db0 2023-07-21T22:11:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.500+0000 7fa5a8fda700 1 --2- 172.21.15.49:0/1695960478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa58c004db0 0x7fa5a40c7200 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa59800f800 tx=0x7fa59800fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.504+0000 7fa5a17fa700 1 -- 172.21.15.49:0/1695960478 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598001540 con 0x7fa58c004db0 2023-07-21T22:11:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.504+0000 7fa5a17fa700 1 -- 172.21.15.49:0/1695960478 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5980052e0 con 0x7fa58c004db0 2023-07-21T22:11:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.504+0000 7fa5a17fa700 1 -- 172.21.15.49:0/1695960478 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5980036a0 con 0x7fa58c004db0 2023-07-21T22:11:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.504+0000 7fa5ab23e700 1 -- 172.21.15.49:0/1695960478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a4160e20 con 0x7fa58c004db0 2023-07-21T22:11:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.504+0000 7fa5ab23e700 1 -- 172.21.15.49:0/1695960478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a40c5d20 con 0x7fa58c004db0 2023-07-21T22:11:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.504+0000 7fa5ab23e700 1 -- 172.21.15.49:0/1695960478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a40c9610 con 0x7fa58c004db0 2023-07-21T22:11:55.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.508+0000 7fa5a17fa700 1 -- 172.21.15.49:0/1695960478 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa598003800 con 0x7fa58c004db0 2023-07-21T22:11:55.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.508+0000 7fa5a17fa700 1 --2- 172.21.15.49:0/1695960478 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa5900662f0 0x7fa5900687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.508+0000 7fa5a17fa700 1 -- 172.21.15.49:0/1695960478 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa598083fe0 con 0x7fa58c004db0 2023-07-21T22:11:55.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.508+0000 7fa5a3fff700 1 --2- 172.21.15.49:0/1695960478 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa5900662f0 0x7fa5900687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.508+0000 7fa5a3fff700 1 --2- 172.21.15.49:0/1695960478 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa5900662f0 0x7fa5900687a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa594001380 tx=0x7fa594009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:55.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.516+0000 7fa5a17fa700 1 -- 172.21.15.49:0/1695960478 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa598051140 con 0x7fa58c004db0 2023-07-21T22:11:55.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.684+0000 7fa5ab23e700 1 -- 172.21.15.49:0/1695960478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5a40cabe0 con 0x7fa58c004db0 2023-07-21T22:11:55.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.688+0000 7fa5a17fa700 1 -- 172.21.15.49:0/1695960478 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa598054760 con 0x7fa58c004db0 2023-07-21T22:11:55.731 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:11:55.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.688+0000 7fa5ab23e700 1 -- 172.21.15.49:0/1695960478 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa5900662f0 msgr2=0x7fa5900687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.688+0000 7fa5ab23e700 1 --2- 172.21.15.49:0/1695960478 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa5900662f0 0x7fa5900687a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa594001380 tx=0x7fa594009040 comp rx=0 tx=0).stop 2023-07-21T22:11:55.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.688+0000 7fa5ab23e700 1 -- 172.21.15.49:0/1695960478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa58c004db0 msgr2=0x7fa5a40c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.688+0000 7fa5ab23e700 1 --2- 172.21.15.49:0/1695960478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa58c004db0 0x7fa5a40c7200 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa59800f800 tx=0x7fa59800fbc0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.692+0000 7fa5ab23e700 1 -- 172.21.15.49:0/1695960478 shutdown_connections 2023-07-21T22:11:55.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.692+0000 7fa5ab23e700 1 --2- 172.21.15.49:0/1695960478 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa5900662f0 0x7fa5900687a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.692+0000 7fa5ab23e700 1 --2- 172.21.15.49:0/1695960478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5a414fdf0 0x7fa5a40c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.692+0000 7fa5ab23e700 1 --2- 172.21.15.49:0/1695960478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a414f980 0x7fa5a40c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.692+0000 7fa5ab23e700 1 --2- 172.21.15.49:0/1695960478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa58c004db0 0x7fa5a40c7200 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.692+0000 7fa5ab23e700 1 -- 172.21.15.49:0/1695960478 >> 172.21.15.49:0/1695960478 conn(0x7fa5a406e960 msgr2=0x7fa5a40c9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:55.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.692+0000 7fa5ab23e700 1 -- 172.21.15.49:0/1695960478 shutdown_connections 2023-07-21T22:11:55.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.692+0000 7fa5ab23e700 1 -- 172.21.15.49:0/1695960478 wait complete. 2023-07-21T22:11:55.756 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:11:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.896+0000 7f05fc825700 1 Processor -- start 2023-07-21T22:11:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.896+0000 7f05fc825700 1 -- start start 2023-07-21T22:11:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.896+0000 7f05fc825700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05f815e380 0x7f05f80cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05fc825700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f05f80c9cd0 0x7f05f80cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05fc825700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f80ca190 con 0x7f05f80b3a50 2023-07-21T22:11:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05fc825700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f8159fd0 con 0x7f05f80c9cd0 2023-07-21T22:11:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05fc825700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f815d6e0 con 0x7f05f815e380 2023-07-21T22:11:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05f5d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f05f80b3a50 0x7f05f80c8820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40804/0 (socket says 172.21.15.49:40804) 2023-07-21T22:11:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05f5d9b700 1 -- 172.21.15.49:0/3663829914 learned_addr learned my addr 172.21.15.49:0/3663829914 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05f659c700 1 --2- 172.21.15.49:0/3663829914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05f815e380 0x7f05f80cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05f6d9d700 1 --2- 172.21.15.49:0/3663829914 >> v2:172.21.15.150:3300/0 conn(0x7f05f80c9cd0 0x7f05f80cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05f559a700 1 -- 172.21.15.49:0/3663829914 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884038906 0 0) 0x7f05f80ca190 con 0x7f05f80b3a50 2023-07-21T22:11:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05f6d9d700 1 -- 172.21.15.49:0/3663829914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05f815e380 msgr2=0x7f05f80cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05f6d9d700 1 --2- 172.21.15.49:0/3663829914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05f815e380 0x7f05f80cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05f6d9d700 1 -- 172.21.15.49:0/3663829914 >> v1:172.21.15.49:6789/0 conn(0x7f05f80b3a50 legacy=0x7f05f80c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05f6d9d700 1 -- 172.21.15.49:0/3663829914 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f80ca900 con 0x7f05f80c9cd0 2023-07-21T22:11:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05f6d9d700 1 --2- 172.21.15.49:0/3663829914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05f80c9cd0 0x7f05f80cb120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009d90 tx=0x7f05f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=986ee1024d33ba20 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05f559a700 1 -- 172.21.15.49:0/3663829914 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f000e070 con 0x7f05f80c9cd0 2023-07-21T22:11:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05f559a700 1 -- 172.21.15.49:0/3663829914 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f000bb20 con 0x7f05f80c9cd0 2023-07-21T22:11:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.900+0000 7f05f559a700 1 -- 172.21.15.49:0/3663829914 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0012430 con 0x7f05f80c9cd0 2023-07-21T22:11:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.904+0000 7f05fc825700 1 -- 172.21.15.49:0/3663829914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05f80c9cd0 msgr2=0x7f05f80cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.904+0000 7f05fc825700 1 --2- 172.21.15.49:0/3663829914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05f80c9cd0 0x7f05f80cb120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009d90 tx=0x7f05f000b330 comp rx=0 tx=0).stop 2023-07-21T22:11:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.904+0000 7f05fc825700 1 -- 172.21.15.49:0/3663829914 shutdown_connections 2023-07-21T22:11:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.904+0000 7f05fc825700 1 --2- 172.21.15.49:0/3663829914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05f80c9cd0 0x7f05f80cb120 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.904+0000 7f05fc825700 1 --2- 172.21.15.49:0/3663829914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05f815e380 0x7f05f80cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.904+0000 7f05fc825700 1 -- 172.21.15.49:0/3663829914 >> 172.21.15.49:0/3663829914 conn(0x7f05f806e960 msgr2=0x7f05f806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.904+0000 7f05fc825700 1 -- 172.21.15.49:0/3663829914 shutdown_connections 2023-07-21T22:11:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.904+0000 7f05fc825700 1 -- 172.21.15.49:0/3663829914 wait complete. 2023-07-21T22:11:55.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05fc825700 1 Processor -- start 2023-07-21T22:11:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05fc825700 1 -- start start 2023-07-21T22:11:55.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05fc825700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05f80b3a50 0x7f05f815b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05fc825700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05f80c9cd0 0x7f05f80c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05fc825700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05f815e380 0x7f05f815c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05fc825700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f815cea0 con 0x7f05f815e380 2023-07-21T22:11:55.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05fc825700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f815cc90 con 0x7f05f80b3a50 2023-07-21T22:11:55.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05fc825700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f815a340 con 0x7f05f80c9cd0 2023-07-21T22:11:55.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05f6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05f815e380 0x7f05f815c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05f6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05f815e380 0x7f05f815c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38880/0 (socket says 172.21.15.49:38880) 2023-07-21T22:11:55.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05f659c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05f80b3a50 0x7f05f815b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05f6d9d700 1 -- 172.21.15.49:0/696025946 learned_addr learned my addr 172.21.15.49:0/696025946 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:55.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05f5d9b700 1 --2- 172.21.15.49:0/696025946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05f80c9cd0 0x7f05f80c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05f6d9d700 1 -- 172.21.15.49:0/696025946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05f80c9cd0 msgr2=0x7f05f80c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05f6d9d700 1 --2- 172.21.15.49:0/696025946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05f80c9cd0 0x7f05f80c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05f6d9d700 1 -- 172.21.15.49:0/696025946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05f80b3a50 msgr2=0x7f05f815b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:55.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05f6d9d700 1 --2- 172.21.15.49:0/696025946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05f80b3a50 0x7f05f815b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:55.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.908+0000 7f05f6d9d700 1 -- 172.21.15.49:0/696025946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0009a70 con 0x7f05f815e380 2023-07-21T22:11:55.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.912+0000 7f05f6d9d700 1 --2- 172.21.15.49:0/696025946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05f815e380 0x7f05f815c750 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f05f0013000 tx=0x7f05f0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:55.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.912+0000 7f05e6ffd700 1 -- 172.21.15.49:0/696025946 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0012430 con 0x7f05f815e380 2023-07-21T22:11:55.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.912+0000 7f05e6ffd700 1 -- 172.21.15.49:0/696025946 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f0020070 con 0x7f05f815e380 2023-07-21T22:11:55.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.912+0000 7f05e6ffd700 1 -- 172.21.15.49:0/696025946 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0004280 con 0x7f05f815e380 2023-07-21T22:11:55.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.912+0000 7f05fc825700 1 -- 172.21.15.49:0/696025946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f815a620 con 0x7f05f815e380 2023-07-21T22:11:55.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.912+0000 7f05fc825700 1 -- 172.21.15.49:0/696025946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f815abe0 con 0x7f05f815e380 2023-07-21T22:11:55.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.912+0000 7f05fc825700 1 -- 172.21.15.49:0/696025946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f8066230 con 0x7f05f815e380 2023-07-21T22:11:55.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.916+0000 7f05e6ffd700 1 -- 172.21.15.49:0/696025946 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05f00043e0 con 0x7f05f815e380 2023-07-21T22:11:55.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.916+0000 7f05e6ffd700 1 --2- 172.21.15.49:0/696025946 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f05d80662f0 0x7f05d80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:55.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.916+0000 7f05e6ffd700 1 -- 172.21.15.49:0/696025946 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f05f0022070 con 0x7f05f815e380 2023-07-21T22:11:55.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.916+0000 7f05f659c700 1 --2- 172.21.15.49:0/696025946 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f05d80662f0 0x7f05d80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.920+0000 7f05f659c700 1 --2- 172.21.15.49:0/696025946 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f05d80662f0 0x7f05d80687a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009b50 tx=0x7f05e8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:55.924+0000 7f05e6ffd700 1 -- 172.21.15.49:0/696025946 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05f0052e50 con 0x7f05f815e380 2023-07-21T22:11:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.100+0000 7f05fc825700 1 -- 172.21.15.49:0/696025946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f05f815add0 con 0x7f05f815e380 2023-07-21T22:11:56.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.100+0000 7f05e6ffd700 1 -- 172.21.15.49:0/696025946 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f05f002c020 con 0x7f05f815e380 2023-07-21T22:11:56.145 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:11:56.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.104+0000 7f05fc825700 1 -- 172.21.15.49:0/696025946 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f05d80662f0 msgr2=0x7f05d80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:56.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.104+0000 7f05fc825700 1 --2- 172.21.15.49:0/696025946 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f05d80662f0 0x7f05d80687a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009b50 tx=0x7f05e8009240 comp rx=0 tx=0).stop 2023-07-21T22:11:56.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.104+0000 7f05fc825700 1 -- 172.21.15.49:0/696025946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05f815e380 msgr2=0x7f05f815c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:56.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.104+0000 7f05fc825700 1 --2- 172.21.15.49:0/696025946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05f815e380 0x7f05f815c750 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f05f0013000 tx=0x7f05f0004af0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.104+0000 7f05fc825700 1 -- 172.21.15.49:0/696025946 shutdown_connections 2023-07-21T22:11:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.104+0000 7f05fc825700 1 --2- 172.21.15.49:0/696025946 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f05d80662f0 0x7f05d80687a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.104+0000 7f05fc825700 1 --2- 172.21.15.49:0/696025946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05f815e380 0x7f05f815c750 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.104+0000 7f05fc825700 1 --2- 172.21.15.49:0/696025946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05f80c9cd0 0x7f05f80c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.104+0000 7f05fc825700 1 --2- 172.21.15.49:0/696025946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05f80b3a50 0x7f05f815b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.104+0000 7f05fc825700 1 -- 172.21.15.49:0/696025946 >> 172.21.15.49:0/696025946 conn(0x7f05f806e960 msgr2=0x7f05f80b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:56.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.108+0000 7f05fc825700 1 -- 172.21.15.49:0/696025946 shutdown_connections 2023-07-21T22:11:56.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.108+0000 7f05fc825700 1 -- 172.21.15.49:0/696025946 wait complete. 2023-07-21T22:11:56.173 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:11:56.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.308+0000 7fe73c3f7700 1 Processor -- start 2023-07-21T22:11:56.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.308+0000 7fe73c3f7700 1 -- start start 2023-07-21T22:11:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe73c3f7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe734159b70 0x7fe73415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe73c3f7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7340cc750 0x7fe7340c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe73c3f7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe73406c310 0x7fe73406c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe73c3f7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73406ccd0 con 0x7fe7340cc750 2023-07-21T22:11:56.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe73c3f7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73415c960 con 0x7fe734159b70 2023-07-21T22:11:56.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe73c3f7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73415cc40 con 0x7fe73406c310 2023-07-21T22:11:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe739992700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7340cc750 0x7fe7340c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe73a193700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe734159b70 0x7fe73415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe73a994700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe73406c310 0x7fe73406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe739992700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7340cc750 0x7fe7340c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38888/0 (socket says 172.21.15.49:38888) 2023-07-21T22:11:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe739992700 1 -- 172.21.15.49:0/3349623297 learned_addr learned my addr 172.21.15.49:0/3349623297 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe73a193700 1 -- 172.21.15.49:0/3349623297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe73406c310 msgr2=0x7fe73406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe73a193700 1 --2- 172.21.15.49:0/3349623297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe73406c310 0x7fe73406c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe73a193700 1 -- 172.21.15.49:0/3349623297 >> v2:172.21.15.49:3300/0 conn(0x7fe7340cc750 msgr2=0x7fe7340c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe73a193700 1 --2- 172.21.15.49:0/3349623297 >> v2:172.21.15.49:3300/0 conn(0x7fe7340cc750 0x7fe7340c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe73a193700 1 -- 172.21.15.49:0/3349623297 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73415cf20 con 0x7fe734159b70 2023-07-21T22:11:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.312+0000 7fe739992700 1 --2- 172.21.15.49:0/3349623297 >> v2:172.21.15.49:3300/0 conn(0x7fe7340cc750 0x7fe7340c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:56.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.316+0000 7fe73a193700 1 --2- 172.21.15.49:0/3349623297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe734159b70 0x7fe73415c2e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe73406de40 tx=0x7fe73000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=230ee51041860de2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:56.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.316+0000 7fe739191700 1 -- 172.21.15.49:0/3349623297 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73000e070 con 0x7fe734159b70 2023-07-21T22:11:56.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.316+0000 7fe739191700 1 -- 172.21.15.49:0/3349623297 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73000bb20 con 0x7fe734159b70 2023-07-21T22:11:56.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.316+0000 7fe739191700 1 -- 172.21.15.49:0/3349623297 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730012430 con 0x7fe734159b70 2023-07-21T22:11:56.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.316+0000 7fe73c3f7700 1 -- 172.21.15.49:0/3349623297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe734159b70 msgr2=0x7fe73415c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:56.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.316+0000 7fe73c3f7700 1 --2- 172.21.15.49:0/3349623297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe734159b70 0x7fe73415c2e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe73406de40 tx=0x7fe73000b330 comp rx=0 tx=0).stop 2023-07-21T22:11:56.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.316+0000 7fe73c3f7700 1 -- 172.21.15.49:0/3349623297 shutdown_connections 2023-07-21T22:11:56.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.316+0000 7fe73c3f7700 1 --2- 172.21.15.49:0/3349623297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe73406c310 0x7fe73406c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.316+0000 7fe73c3f7700 1 --2- 172.21.15.49:0/3349623297 >> v2:172.21.15.49:3300/0 conn(0x7fe7340cc750 0x7fe7340c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.316+0000 7fe73c3f7700 1 --2- 172.21.15.49:0/3349623297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe734159b70 0x7fe73415c2e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.316+0000 7fe73c3f7700 1 -- 172.21.15.49:0/3349623297 >> 172.21.15.49:0/3349623297 conn(0x7fe7340b03b0 msgr2=0x7fe7340b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:56.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.316+0000 7fe73c3f7700 1 -- 172.21.15.49:0/3349623297 shutdown_connections 2023-07-21T22:11:56.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.316+0000 7fe73c3f7700 1 -- 172.21.15.49:0/3349623297 wait complete. 2023-07-21T22:11:56.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.320+0000 7fe73c3f7700 1 Processor -- start 2023-07-21T22:11:56.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.320+0000 7fe73c3f7700 1 -- start start 2023-07-21T22:11:56.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.320+0000 7fe73c3f7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe73406c310 0x7fe7340b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:56.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.320+0000 7fe73c3f7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7340cc750 0x7fe73414b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:56.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.320+0000 7fe73c3f7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7340cd660 0x7fe7340b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.320+0000 7fe73c3f7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7340b3c00 con 0x7fe7340cc750 2023-07-21T22:11:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.320+0000 7fe73c3f7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73414b6f0 con 0x7fe73406c310 2023-07-21T22:11:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.320+0000 7fe73c3f7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7340b2f80 con 0x7fe7340cd660 2023-07-21T22:11:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe739992700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7340cc750 0x7fe73414b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe739992700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7340cc750 0x7fe73414b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38896/0 (socket says 172.21.15.49:38896) 2023-07-21T22:11:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe739992700 1 -- 172.21.15.49:0/2780687483 learned_addr learned my addr 172.21.15.49:0/2780687483 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe73a193700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe73406c310 0x7fe7340b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:56.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe73a994700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7340cd660 0x7fe7340b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:56.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe739992700 1 -- 172.21.15.49:0/2780687483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7340cd660 msgr2=0x7fe7340b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:56.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe739992700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7340cd660 0x7fe7340b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe739992700 1 -- 172.21.15.49:0/2780687483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe73406c310 msgr2=0x7fe7340b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:56.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe739992700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe73406c310 0x7fe7340b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe739992700 1 -- 172.21.15.49:0/2780687483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe724009570 con 0x7fe7340cc750 2023-07-21T22:11:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe73a193700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe73406c310 0x7fe7340b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe73a994700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7340cd660 0x7fe7340b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe739992700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7340cc750 0x7fe73414b1b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe72400e9d0 tx=0x7fe72400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe72affd700 1 -- 172.21.15.49:0/2780687483 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72400c850 con 0x7fe7340cc750 2023-07-21T22:11:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe72affd700 1 -- 172.21.15.49:0/2780687483 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72400c9b0 con 0x7fe7340cc750 2023-07-21T22:11:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe72affd700 1 -- 172.21.15.49:0/2780687483 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72400cd20 con 0x7fe7340cc750 2023-07-21T22:11:56.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe73c3f7700 1 -- 172.21.15.49:0/2780687483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe730009a70 con 0x7fe7340cc750 2023-07-21T22:11:56.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe73c3f7700 1 -- 172.21.15.49:0/2780687483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7340b3540 con 0x7fe7340cc750 2023-07-21T22:11:56.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.324+0000 7fe73c3f7700 1 -- 172.21.15.49:0/2780687483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73404dd50 con 0x7fe7340cc750 2023-07-21T22:11:56.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.328+0000 7fe72affd700 1 -- 172.21.15.49:0/2780687483 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe724013470 con 0x7fe7340cc750 2023-07-21T22:11:56.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.328+0000 7fe72affd700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe7180662f0 0x7fe7180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:56.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.328+0000 7fe72affd700 1 -- 172.21.15.49:0/2780687483 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe724083d40 con 0x7fe7340cc750 2023-07-21T22:11:56.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.328+0000 7fe73a193700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe7180662f0 0x7fe7180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:56.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.328+0000 7fe73a193700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe7180662f0 0x7fe7180687a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe730014040 tx=0x7fe730011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:56.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.336+0000 7fe72affd700 1 -- 172.21.15.49:0/2780687483 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe724050e80 con 0x7fe7340cc750 2023-07-21T22:11:56.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.508+0000 7fe73c3f7700 1 -- 172.21.15.49:0/2780687483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe7340b0090 con 0x7fe7340cc750 2023-07-21T22:11:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.512+0000 7fe72affd700 1 -- 172.21.15.49:0/2780687483 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe7240544a0 con 0x7fe7340cc750 2023-07-21T22:11:56.555 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.512+0000 7fe73c3f7700 1 -- 172.21.15.49:0/2780687483 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe7180662f0 msgr2=0x7fe7180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.512+0000 7fe73c3f7700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe7180662f0 0x7fe7180687a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe730014040 tx=0x7fe730011000 comp rx=0 tx=0).stop 2023-07-21T22:11:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.512+0000 7fe73c3f7700 1 -- 172.21.15.49:0/2780687483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7340cc750 msgr2=0x7fe73414b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.512+0000 7fe73c3f7700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7340cc750 0x7fe73414b1b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe72400e9d0 tx=0x7fe72400ed90 comp rx=0 tx=0).stop 2023-07-21T22:11:56.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.512+0000 7fe73c3f7700 1 -- 172.21.15.49:0/2780687483 shutdown_connections 2023-07-21T22:11:56.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.512+0000 7fe73c3f7700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe7180662f0 0x7fe7180687a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.512+0000 7fe73c3f7700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7340cc750 0x7fe73414b1b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.512+0000 7fe73c3f7700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7340cd660 0x7fe7340b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.512+0000 7fe73c3f7700 1 --2- 172.21.15.49:0/2780687483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe73406c310 0x7fe7340b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.512+0000 7fe73c3f7700 1 -- 172.21.15.49:0/2780687483 >> 172.21.15.49:0/2780687483 conn(0x7fe7340b03b0 msgr2=0x7fe7340cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.512+0000 7fe73c3f7700 1 -- 172.21.15.49:0/2780687483 shutdown_connections 2023-07-21T22:11:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.512+0000 7fe73c3f7700 1 -- 172.21.15.49:0/2780687483 wait complete. 2023-07-21T22:11:56.582 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:11:56.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.720+0000 7ff6000d6700 1 Processor -- start 2023-07-21T22:11:56.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.720+0000 7ff6000d6700 1 -- start start 2023-07-21T22:11:56.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff6000d6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5f80cb2f0 0x7ff5f8163d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:56.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff6000d6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f80cdf00 con 0x7ff5f8071220 2023-07-21T22:11:56.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff6000d6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f80ce600 con 0x7ff5f8160110 2023-07-21T22:11:56.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff6000d6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f80cd730 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff5fe673700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5f80cb2f0 0x7ff5f8163d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:56.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff5fd671700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff5f8071220 0x7ff5f80cabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40810/0 (socket says 172.21.15.49:40810) 2023-07-21T22:11:56.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff5fd671700 1 -- 172.21.15.49:0/3495877039 learned_addr learned my addr 172.21.15.49:0/3495877039 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:56.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff5fe673700 1 -- 172.21.15.49:0/3495877039 >> v1:172.21.15.150:6789/0 conn(0x7ff5f8160110 legacy=0x7ff5f80cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:56.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff5fe673700 1 -- 172.21.15.49:0/3495877039 >> v1:172.21.15.49:6789/0 conn(0x7ff5f8071220 legacy=0x7ff5f80cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:56.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff5fe673700 1 -- 172.21.15.49:0/3495877039 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f806e190 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff5fe673700 1 --2- 172.21.15.49:0/3495877039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5f80cb2f0 0x7ff5f8163d40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009d90 tx=0x7ff5f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26dc12b1d92ee6f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:56.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff5fce70700 1 -- 172.21.15.49:0/3495877039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f000e070 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff5fce70700 1 -- 172.21.15.49:0/3495877039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f000bbd0 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff5fce70700 1 -- 172.21.15.49:0/3495877039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0012430 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff6000d6700 1 -- 172.21.15.49:0/3495877039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5f80cb2f0 msgr2=0x7ff5f8163d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:56.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff6000d6700 1 --2- 172.21.15.49:0/3495877039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5f80cb2f0 0x7ff5f8163d40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009d90 tx=0x7ff5f000b330 comp rx=0 tx=0).stop 2023-07-21T22:11:56.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff6000d6700 1 -- 172.21.15.49:0/3495877039 shutdown_connections 2023-07-21T22:11:56.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff6000d6700 1 --2- 172.21.15.49:0/3495877039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5f80cb2f0 0x7ff5f8163d40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff6000d6700 1 -- 172.21.15.49:0/3495877039 >> 172.21.15.49:0/3495877039 conn(0x7ff5f806e960 msgr2=0x7ff5f806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:56.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.724+0000 7ff6000d6700 1 -- 172.21.15.49:0/3495877039 shutdown_connections 2023-07-21T22:11:56.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.728+0000 7ff6000d6700 1 -- 172.21.15.49:0/3495877039 wait complete. 2023-07-21T22:11:56.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.728+0000 7ff6000d6700 1 Processor -- start 2023-07-21T22:11:56.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.728+0000 7ff6000d6700 1 -- start start 2023-07-21T22:11:56.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.728+0000 7ff6000d6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f8071220 0x7ff5f80c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:56.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.728+0000 7ff6000d6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5f80cb2f0 0x7ff5f8158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:56.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.728+0000 7ff6000d6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5f8160110 0x7ff5f815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:56.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.728+0000 7ff6000d6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f815b020 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.728+0000 7ff6000d6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80c6c90 con 0x7ff5f8071220 2023-07-21T22:11:56.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.728+0000 7ff6000d6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f815b230 con 0x7ff5f8160110 2023-07-21T22:11:56.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.728+0000 7ff5fd671700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5f80cb2f0 0x7ff5f8158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:56.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff5fd671700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5f80cb2f0 0x7ff5f8158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38924/0 (socket says 172.21.15.49:38924) 2023-07-21T22:11:56.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff5fd671700 1 -- 172.21.15.49:0/254641061 learned_addr learned my addr 172.21.15.49:0/254641061 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:56.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff5fde72700 1 --2- 172.21.15.49:0/254641061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f8071220 0x7ff5f80c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:56.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff5fe673700 1 --2- 172.21.15.49:0/254641061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5f8160110 0x7ff5f815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:56.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff5fd671700 1 -- 172.21.15.49:0/254641061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5f8160110 msgr2=0x7ff5f815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:56.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff5fd671700 1 --2- 172.21.15.49:0/254641061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5f8160110 0x7ff5f815aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff5fd671700 1 -- 172.21.15.49:0/254641061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f8071220 msgr2=0x7ff5f80c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:56.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff5fd671700 1 --2- 172.21.15.49:0/254641061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f8071220 0x7ff5f80c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff5fd671700 1 -- 172.21.15.49:0/254641061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f0009a70 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff5fd671700 1 --2- 172.21.15.49:0/254641061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5f80cb2f0 0x7ff5f8158aa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c4d0 tx=0x7ff5e800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:56.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff5ee7fc700 1 -- 172.21.15.49:0/254641061 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e800cea0 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff5ee7fc700 1 -- 172.21.15.49:0/254641061 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e8005d90 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff6000d6700 1 -- 172.21.15.49:0/254641061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f815b510 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff5ee7fc700 1 -- 172.21.15.49:0/254641061 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80072d0 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff6000d6700 1 -- 172.21.15.49:0/254641061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f815bad0 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.732+0000 7ff6000d6700 1 -- 172.21.15.49:0/254641061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f804dd50 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.736+0000 7ff5ee7fc700 1 -- 172.21.15.49:0/254641061 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff5e8007430 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.736+0000 7ff5ee7fc700 1 --2- 172.21.15.49:0/254641061 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff5dc0662f0 0x7ff5dc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:56.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.736+0000 7ff5ee7fc700 1 -- 172.21.15.49:0/254641061 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff5e8083220 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.740+0000 7ff5fde72700 1 --2- 172.21.15.49:0/254641061 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff5dc0662f0 0x7ff5dc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:56.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.740+0000 7ff5fde72700 1 --2- 172.21.15.49:0/254641061 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff5dc0662f0 0x7ff5dc0687a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4000f60 tx=0x7ff5f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:56.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.744+0000 7ff5ee7fc700 1 -- 172.21.15.49:0/254641061 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5e8050400 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.916+0000 7ff6000d6700 1 -- 172.21.15.49:0/254641061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5f806d3e0 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.916+0000 7ff5ee7fc700 1 -- 172.21.15.49:0/254641061 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5e8017020 con 0x7ff5f80cb2f0 2023-07-21T22:11:56.960 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:11:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.916+0000 7ff6000d6700 1 -- 172.21.15.49:0/254641061 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff5dc0662f0 msgr2=0x7ff5dc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.916+0000 7ff6000d6700 1 --2- 172.21.15.49:0/254641061 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff5dc0662f0 0x7ff5dc0687a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4000f60 tx=0x7ff5f4009040 comp rx=0 tx=0).stop 2023-07-21T22:11:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.916+0000 7ff6000d6700 1 -- 172.21.15.49:0/254641061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5f80cb2f0 msgr2=0x7ff5f8158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.916+0000 7ff6000d6700 1 --2- 172.21.15.49:0/254641061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5f80cb2f0 0x7ff5f8158aa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c4d0 tx=0x7ff5e800c7e0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.916+0000 7ff6000d6700 1 -- 172.21.15.49:0/254641061 shutdown_connections 2023-07-21T22:11:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.916+0000 7ff6000d6700 1 --2- 172.21.15.49:0/254641061 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff5dc0662f0 0x7ff5dc0687a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.916+0000 7ff6000d6700 1 --2- 172.21.15.49:0/254641061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5f80cb2f0 0x7ff5f8158aa0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.916+0000 7ff6000d6700 1 --2- 172.21.15.49:0/254641061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5f8160110 0x7ff5f815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.916+0000 7ff6000d6700 1 --2- 172.21.15.49:0/254641061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5f8071220 0x7ff5f80c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:56.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.916+0000 7ff6000d6700 1 -- 172.21.15.49:0/254641061 >> 172.21.15.49:0/254641061 conn(0x7ff5f806e960 msgr2=0x7ff5f80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:56.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.920+0000 7ff6000d6700 1 -- 172.21.15.49:0/254641061 shutdown_connections 2023-07-21T22:11:56.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:56.920+0000 7ff6000d6700 1 -- 172.21.15.49:0/254641061 wait complete. 2023-07-21T22:11:56.982 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:11:57.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.128+0000 7f0a46660700 1 Processor -- start 2023-07-21T22:11:57.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.128+0000 7f0a46660700 1 -- start start 2023-07-21T22:11:57.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a46660700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0a4015e380 0x7f0a400cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a46660700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0a400c9cd0 0x7f0a400cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a46660700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a400ca190 con 0x7f0a400b3a50 2023-07-21T22:11:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a46660700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a40159fd0 con 0x7f0a4015e380 2023-07-21T22:11:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a46660700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4015d6e0 con 0x7f0a400c9cd0 2023-07-21T22:11:57.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a3ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0a4015e380 0x7f0a400cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:57.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a44bfd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0a400c9cd0 0x7f0a400cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:57.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a44bfd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0a400c9cd0 0x7f0a400cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:58314/0 (socket says 172.21.15.49:58314) 2023-07-21T22:11:57.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a44bfd700 1 -- 172.21.15.49:0/4288391181 learned_addr learned my addr 172.21.15.49:0/4288391181 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:57.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a3ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0a4015e380 0x7f0a400cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38932/0 (socket says 172.21.15.49:38932) 2023-07-21T22:11:57.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a44bfd700 1 -- 172.21.15.49:0/4288391181 >> v2:172.21.15.49:3300/0 conn(0x7f0a4015e380 msgr2=0x7f0a400cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:57.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a44bfd700 1 --2- 172.21.15.49:0/4288391181 >> v2:172.21.15.49:3300/0 conn(0x7f0a4015e380 0x7f0a400cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a44bfd700 1 -- 172.21.15.49:0/4288391181 >> v1:172.21.15.150:6789/0 conn(0x7f0a400b3a50 legacy=0x7f0a400c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:57.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a44bfd700 1 -- 172.21.15.49:0/4288391181 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a400ca900 con 0x7f0a400c9cd0 2023-07-21T22:11:57.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a44bfd700 1 --2- 172.21.15.49:0/4288391181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a400c9cd0 0x7f0a400cb120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0a400c19c0 tx=0x7f0a3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b993956b2a21ff1f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:57.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a3f7fe700 1 -- 172.21.15.49:0/4288391181 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3800e070 con 0x7f0a400c9cd0 2023-07-21T22:11:57.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a3f7fe700 1 -- 172.21.15.49:0/4288391181 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3800b910 con 0x7f0a400c9cd0 2023-07-21T22:11:57.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.132+0000 7f0a3f7fe700 1 -- 172.21.15.49:0/4288391181 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3800bcc0 con 0x7f0a400c9cd0 2023-07-21T22:11:57.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.136+0000 7f0a46660700 1 -- 172.21.15.49:0/4288391181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a400c9cd0 msgr2=0x7f0a400cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:57.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.136+0000 7f0a46660700 1 --2- 172.21.15.49:0/4288391181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a400c9cd0 0x7f0a400cb120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0a400c19c0 tx=0x7f0a3800b330 comp rx=0 tx=0).stop 2023-07-21T22:11:57.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.136+0000 7f0a46660700 1 -- 172.21.15.49:0/4288391181 shutdown_connections 2023-07-21T22:11:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.136+0000 7f0a46660700 1 --2- 172.21.15.49:0/4288391181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a400c9cd0 0x7f0a400cb120 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.136+0000 7f0a46660700 1 --2- 172.21.15.49:0/4288391181 >> v2:172.21.15.49:3300/0 conn(0x7f0a4015e380 0x7f0a400cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.136+0000 7f0a46660700 1 -- 172.21.15.49:0/4288391181 >> 172.21.15.49:0/4288391181 conn(0x7f0a4006e960 msgr2=0x7f0a4006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.136+0000 7f0a46660700 1 -- 172.21.15.49:0/4288391181 shutdown_connections 2023-07-21T22:11:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.136+0000 7f0a46660700 1 -- 172.21.15.49:0/4288391181 wait complete. 2023-07-21T22:11:57.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a46660700 1 Processor -- start 2023-07-21T22:11:57.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a46660700 1 -- start start 2023-07-21T22:11:57.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a46660700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a400b3a50 0x7f0a40145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a46660700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a400c9cd0 0x7f0a400a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a46660700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a4015e380 0x7f0a400a7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a46660700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a40147120 con 0x7f0a400c9cd0 2023-07-21T22:11:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a46660700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a400c9850 con 0x7f0a4015e380 2023-07-21T22:11:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a46660700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a400c6a70 con 0x7f0a400b3a50 2023-07-21T22:11:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a400c9cd0 0x7f0a400a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:57.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a400c9cd0 0x7f0a400a74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38942/0 (socket says 172.21.15.49:38942) 2023-07-21T22:11:57.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a377fe700 1 -- 172.21.15.49:0/2538200794 learned_addr learned my addr 172.21.15.49:0/2538200794 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:57.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a44bfd700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a4015e380 0x7f0a400a7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:57.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a3ffff700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a400b3a50 0x7f0a40145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:57.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a377fe700 1 -- 172.21.15.49:0/2538200794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a400b3a50 msgr2=0x7f0a40145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:57.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a377fe700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a400b3a50 0x7f0a40145f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a377fe700 1 -- 172.21.15.49:0/2538200794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a4015e380 msgr2=0x7f0a400a7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:57.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a377fe700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a4015e380 0x7f0a400a7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a377fe700 1 -- 172.21.15.49:0/2538200794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a38009b30 con 0x7f0a400c9cd0 2023-07-21T22:11:57.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a3ffff700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a400b3a50 0x7f0a40145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:11:57.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a377fe700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a400c9cd0 0x7f0a400a74c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800c450 tx=0x7f0a2800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:57.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a3d7fa700 1 -- 172.21.15.49:0/2538200794 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a280052d0 con 0x7f0a400c9cd0 2023-07-21T22:11:57.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a3d7fa700 1 -- 172.21.15.49:0/2538200794 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a28005430 con 0x7f0a400c9cd0 2023-07-21T22:11:57.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a46660700 1 -- 172.21.15.49:0/2538200794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a40146a60 con 0x7f0a400c9cd0 2023-07-21T22:11:57.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a3d7fa700 1 -- 172.21.15.49:0/2538200794 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28003930 con 0x7f0a400c9cd0 2023-07-21T22:11:57.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.140+0000 7f0a46660700 1 -- 172.21.15.49:0/2538200794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a401464b0 con 0x7f0a400c9cd0 2023-07-21T22:11:57.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.144+0000 7f0a46660700 1 -- 172.21.15.49:0/2538200794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4004dd50 con 0x7f0a400c9cd0 2023-07-21T22:11:57.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.144+0000 7f0a3d7fa700 1 -- 172.21.15.49:0/2538200794 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a28003a90 con 0x7f0a400c9cd0 2023-07-21T22:11:57.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.148+0000 7f0a3d7fa700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0a200662f0 0x7f0a200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:57.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.148+0000 7f0a3d7fa700 1 -- 172.21.15.49:0/2538200794 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0a280834c0 con 0x7f0a400c9cd0 2023-07-21T22:11:57.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.148+0000 7f0a3ffff700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0a200662f0 0x7f0a200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:57.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.148+0000 7f0a3ffff700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0a200662f0 0x7f0a200687a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009b70 tx=0x7f0a30008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:57.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.152+0000 7f0a3d7fa700 1 -- 172.21.15.49:0/2538200794 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a28050610 con 0x7f0a400c9cd0 2023-07-21T22:11:57.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.324+0000 7f0a46660700 1 -- 172.21.15.49:0/2538200794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0a40146640 con 0x7f0a400c9cd0 2023-07-21T22:11:57.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.324+0000 7f0a3d7fa700 1 -- 172.21.15.49:0/2538200794 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0a40146640 con 0x7f0a400c9cd0 2023-07-21T22:11:57.370 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:57.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.328+0000 7f0a46660700 1 -- 172.21.15.49:0/2538200794 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0a200662f0 msgr2=0x7f0a200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:57.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.328+0000 7f0a46660700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0a200662f0 0x7f0a200687a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009b70 tx=0x7f0a30008040 comp rx=0 tx=0).stop 2023-07-21T22:11:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.328+0000 7f0a46660700 1 -- 172.21.15.49:0/2538200794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a400c9cd0 msgr2=0x7f0a400a74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.328+0000 7f0a46660700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a400c9cd0 0x7f0a400a74c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800c450 tx=0x7f0a2800c810 comp rx=0 tx=0).stop 2023-07-21T22:11:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.332+0000 7f0a46660700 1 -- 172.21.15.49:0/2538200794 shutdown_connections 2023-07-21T22:11:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.332+0000 7f0a46660700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0a200662f0 0x7f0a200687a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.332+0000 7f0a46660700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a400c9cd0 0x7f0a400a74c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.332+0000 7f0a46660700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a4015e380 0x7f0a400a7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.332+0000 7f0a46660700 1 --2- 172.21.15.49:0/2538200794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a400b3a50 0x7f0a40145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.332+0000 7f0a46660700 1 -- 172.21.15.49:0/2538200794 >> 172.21.15.49:0/2538200794 conn(0x7f0a4006e960 msgr2=0x7f0a400b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:57.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.332+0000 7f0a46660700 1 -- 172.21.15.49:0/2538200794 shutdown_connections 2023-07-21T22:11:57.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.332+0000 7f0a46660700 1 -- 172.21.15.49:0/2538200794 wait complete. 2023-07-21T22:11:57.398 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:11:57.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.540+0000 7fa1dec36700 1 Processor -- start 2023-07-21T22:11:57.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.540+0000 7fa1dec36700 1 -- start start 2023-07-21T22:11:57.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.540+0000 7fa1dec36700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1d80b7af0 0x7fa1d80b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:57.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.540+0000 7fa1dec36700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa1d80cee10 0x7fa1d80cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:57.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.540+0000 7fa1dec36700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d80b3e80 con 0x7fa1d80d1e40 2023-07-21T22:11:57.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.540+0000 7fa1dec36700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d80cf790 con 0x7fa1d80b7af0 2023-07-21T22:11:57.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.540+0000 7fa1dec36700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d815fd40 con 0x7fa1d80cee10 2023-07-21T22:11:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1ddc34700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1d80b7af0 0x7fa1d80b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1dd433700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa1d80d1e40 0x7fa1d815f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40822/0 (socket says 172.21.15.49:40822) 2023-07-21T22:11:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1ddc34700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1d80b7af0 0x7fa1d80b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38944/0 (socket says 172.21.15.49:38944) 2023-07-21T22:11:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1dd433700 1 -- 172.21.15.49:0/1063969479 learned_addr learned my addr 172.21.15.49:0/1063969479 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1de435700 1 --2- 172.21.15.49:0/1063969479 >> v2:172.21.15.150:3300/0 conn(0x7fa1d80cee10 0x7fa1d80cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1ddc34700 1 -- 172.21.15.49:0/1063969479 >> v2:172.21.15.150:3300/0 conn(0x7fa1d80cee10 msgr2=0x7fa1d80cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:57.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1ddc34700 1 --2- 172.21.15.49:0/1063969479 >> v2:172.21.15.150:3300/0 conn(0x7fa1d80cee10 0x7fa1d80cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1ddc34700 1 -- 172.21.15.49:0/1063969479 >> v1:172.21.15.49:6789/0 conn(0x7fa1d80d1e40 legacy=0x7fa1d815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:57.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1ddc34700 1 -- 172.21.15.49:0/1063969479 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d80cea00 con 0x7fa1d80b7af0 2023-07-21T22:11:57.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1dcc32700 1 -- 172.21.15.49:0/1063969479 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932066026 0 0) 0x7fa1d80b3e80 con 0x7fa1d80d1e40 2023-07-21T22:11:57.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1de435700 1 --2- 172.21.15.49:0/1063969479 >> v2:172.21.15.150:3300/0 conn(0x7fa1d80cee10 0x7fa1d80cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:57.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1ddc34700 1 --2- 172.21.15.49:0/1063969479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d80b7af0 0x7fa1d80b1630 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80cfed0 tx=0x7fa1d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84afe3dd5c744887 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:57.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1dcc32700 1 -- 172.21.15.49:0/1063969479 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d400e070 con 0x7fa1d80b7af0 2023-07-21T22:11:57.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1dcc32700 1 -- 172.21.15.49:0/1063969479 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d400bbd0 con 0x7fa1d80b7af0 2023-07-21T22:11:57.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1dcc32700 1 -- 172.21.15.49:0/1063969479 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4012430 con 0x7fa1d80b7af0 2023-07-21T22:11:57.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1dec36700 1 -- 172.21.15.49:0/1063969479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d80b7af0 msgr2=0x7fa1d80b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:57.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1dec36700 1 --2- 172.21.15.49:0/1063969479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d80b7af0 0x7fa1d80b1630 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80cfed0 tx=0x7fa1d400b330 comp rx=0 tx=0).stop 2023-07-21T22:11:57.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1dec36700 1 -- 172.21.15.49:0/1063969479 shutdown_connections 2023-07-21T22:11:57.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1dec36700 1 --2- 172.21.15.49:0/1063969479 >> v2:172.21.15.150:3300/0 conn(0x7fa1d80cee10 0x7fa1d80cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1dec36700 1 --2- 172.21.15.49:0/1063969479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d80b7af0 0x7fa1d80b1630 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1dec36700 1 -- 172.21.15.49:0/1063969479 >> 172.21.15.49:0/1063969479 conn(0x7fa1d806e960 msgr2=0x7fa1d806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:57.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1dec36700 1 -- 172.21.15.49:0/1063969479 shutdown_connections 2023-07-21T22:11:57.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.544+0000 7fa1dec36700 1 -- 172.21.15.49:0/1063969479 wait complete. 2023-07-21T22:11:57.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.548+0000 7fa1dec36700 1 Processor -- start 2023-07-21T22:11:57.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.548+0000 7fa1dec36700 1 -- start start 2023-07-21T22:11:57.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1dec36700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1d80b7af0 0x7fa1d815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:57.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1dec36700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d80cee10 0x7fa1d8157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:57.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1dec36700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d80d1e40 0x7fa1d8157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:57.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1dec36700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80cc7a0 con 0x7fa1d80d1e40 2023-07-21T22:11:57.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1dec36700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d8157690 con 0x7fa1d80b7af0 2023-07-21T22:11:57.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1dec36700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80cbf40 con 0x7fa1d80cee10 2023-07-21T22:11:57.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1de435700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d80d1e40 0x7fa1d8157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:57.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1ddc34700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1d80b7af0 0x7fa1d815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:57.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1de435700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d80d1e40 0x7fa1d8157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38960/0 (socket says 172.21.15.49:38960) 2023-07-21T22:11:57.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1de435700 1 -- 172.21.15.49:0/3165962129 learned_addr learned my addr 172.21.15.49:0/3165962129 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:57.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1dd433700 1 --2- 172.21.15.49:0/3165962129 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d80cee10 0x7fa1d8157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:57.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1de435700 1 -- 172.21.15.49:0/3165962129 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d80cee10 msgr2=0x7fa1d8157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:57.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1de435700 1 --2- 172.21.15.49:0/3165962129 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d80cee10 0x7fa1d8157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1de435700 1 -- 172.21.15.49:0/3165962129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1d80b7af0 msgr2=0x7fa1d815abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:57.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1de435700 1 --2- 172.21.15.49:0/3165962129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1d80b7af0 0x7fa1d815abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1de435700 1 -- 172.21.15.49:0/3165962129 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d4009a70 con 0x7fa1d80d1e40 2023-07-21T22:11:57.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1de435700 1 --2- 172.21.15.49:0/3165962129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d80d1e40 0x7fa1d8157150 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000e810 tx=0x7fa1d000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:57.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1ce7fc700 1 -- 172.21.15.49:0/3165962129 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d000c070 con 0x7fa1d80d1e40 2023-07-21T22:11:57.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1ce7fc700 1 -- 172.21.15.49:0/3165962129 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d0013630 con 0x7fa1d80d1e40 2023-07-21T22:11:57.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1ce7fc700 1 -- 172.21.15.49:0/3165962129 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00139e0 con 0x7fa1d80d1e40 2023-07-21T22:11:57.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.552+0000 7fa1dec36700 1 -- 172.21.15.49:0/3165962129 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d80b3920 con 0x7fa1d80d1e40 2023-07-21T22:11:57.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.556+0000 7fa1dec36700 1 -- 172.21.15.49:0/3165962129 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d80cc1e0 con 0x7fa1d80d1e40 2023-07-21T22:11:57.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.556+0000 7fa1dec36700 1 -- 172.21.15.49:0/3165962129 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d80ccb70 con 0x7fa1d80d1e40 2023-07-21T22:11:57.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.556+0000 7fa1ce7fc700 1 -- 172.21.15.49:0/3165962129 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa1d0013b40 con 0x7fa1d80d1e40 2023-07-21T22:11:57.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.560+0000 7fa1ce7fc700 1 --2- 172.21.15.49:0/3165962129 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa1bc0662f0 0x7fa1bc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:57.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.560+0000 7fa1ce7fc700 1 -- 172.21.15.49:0/3165962129 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa1d0083790 con 0x7fa1d80d1e40 2023-07-21T22:11:57.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.560+0000 7fa1ddc34700 1 --2- 172.21.15.49:0/3165962129 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa1bc0662f0 0x7fa1bc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:57.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.560+0000 7fa1ddc34700 1 --2- 172.21.15.49:0/3165962129 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa1bc0662f0 0x7fa1bc0687a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4014040 tx=0x7fa1d4011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:57.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.568+0000 7fa1ce7fc700 1 -- 172.21.15.49:0/3165962129 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1d0054370 con 0x7fa1d80d1e40 2023-07-21T22:11:57.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.752+0000 7fa1dec36700 1 -- 172.21.15.49:0/3165962129 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa1d804dcb0 con 0x7fa1d80d1e40 2023-07-21T22:11:57.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.752+0000 7fa1ce7fc700 1 -- 172.21.15.49:0/3165962129 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa1d0053f00 con 0x7fa1d80d1e40 2023-07-21T22:11:57.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.752+0000 7fa1dec36700 1 -- 172.21.15.49:0/3165962129 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa1bc0662f0 msgr2=0x7fa1bc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:57.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.752+0000 7fa1dec36700 1 --2- 172.21.15.49:0/3165962129 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa1bc0662f0 0x7fa1bc0687a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4014040 tx=0x7fa1d4011000 comp rx=0 tx=0).stop 2023-07-21T22:11:57.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.752+0000 7fa1dec36700 1 -- 172.21.15.49:0/3165962129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d80d1e40 msgr2=0x7fa1d8157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:57.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.752+0000 7fa1dec36700 1 --2- 172.21.15.49:0/3165962129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d80d1e40 0x7fa1d8157150 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000e810 tx=0x7fa1d000eb20 comp rx=0 tx=0).stop 2023-07-21T22:11:57.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.756+0000 7fa1dec36700 1 -- 172.21.15.49:0/3165962129 shutdown_connections 2023-07-21T22:11:57.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.756+0000 7fa1dec36700 1 --2- 172.21.15.49:0/3165962129 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa1bc0662f0 0x7fa1bc0687a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.756+0000 7fa1dec36700 1 --2- 172.21.15.49:0/3165962129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d80d1e40 0x7fa1d8157150 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.756+0000 7fa1dec36700 1 --2- 172.21.15.49:0/3165962129 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d80cee10 0x7fa1d8157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.756+0000 7fa1dec36700 1 --2- 172.21.15.49:0/3165962129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1d80b7af0 0x7fa1d815abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:57.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.756+0000 7fa1dec36700 1 -- 172.21.15.49:0/3165962129 >> 172.21.15.49:0/3165962129 conn(0x7fa1d806e960 msgr2=0x7fa1d80d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:57.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.756+0000 7fa1dec36700 1 -- 172.21.15.49:0/3165962129 shutdown_connections 2023-07-21T22:11:57.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:57.756+0000 7fa1dec36700 1 -- 172.21.15.49:0/3165962129 wait complete. 2023-07-21T22:11:57.801 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:11:57.819 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2023-07-21T22:11:57.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:57.820 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-07-21T22:11:57.856 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:11:57.857 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:11:57.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:11:57.858 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-21T22:11:57.917 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:11:57.918 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:11:57.937 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:11:57.938 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:11:58.000 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:11:58.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.132+0000 7f42673ed700 1 Processor -- start 2023-07-21T22:11:58.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.132+0000 7f42673ed700 1 -- start start 2023-07-21T22:11:58.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f42673ed700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4260159f60 0x7f42600afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:58.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f42673ed700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f42600b0160 0x7f426015d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:58.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f42673ed700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42600b0600 con 0x7f426006d5d0 2023-07-21T22:11:58.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f42673ed700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426015a470 con 0x7f4260159f60 2023-07-21T22:11:58.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f42673ed700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426015a750 con 0x7f42600b0160 2023-07-21T22:11:58.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f4264988700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4260159f60 0x7f42600afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:58.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f4265189700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f426006d5d0 0x7f426006d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40830/0 (socket says 172.21.15.49:40830) 2023-07-21T22:11:58.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f4265189700 1 -- 172.21.15.49:0/3447976822 learned_addr learned my addr 172.21.15.49:0/3447976822 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:58.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f426598a700 1 --2- 172.21.15.49:0/3447976822 >> v2:172.21.15.150:3300/0 conn(0x7f42600b0160 0x7f426015d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:58.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f4264988700 1 -- 172.21.15.49:0/3447976822 >> v2:172.21.15.150:3300/0 conn(0x7f42600b0160 msgr2=0x7f426015d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:58.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f4264988700 1 --2- 172.21.15.49:0/3447976822 >> v2:172.21.15.150:3300/0 conn(0x7f42600b0160 0x7f426015d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f4257fff700 1 -- 172.21.15.49:0/3447976822 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085895744 0 0) 0x7f42600b0600 con 0x7f426006d5d0 2023-07-21T22:11:58.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f4264988700 1 -- 172.21.15.49:0/3447976822 >> v1:172.21.15.49:6789/0 conn(0x7f426006d5d0 legacy=0x7f426006d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:58.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f4264988700 1 -- 172.21.15.49:0/3447976822 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426015aa30 con 0x7f4260159f60 2023-07-21T22:11:58.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f4264988700 1 --2- 172.21.15.49:0/3447976822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4260159f60 0x7f42600afc20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f426006e670 tx=0x7f4250009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f16a5c7939de8c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:58.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.136+0000 7f4257fff700 1 -- 172.21.15.49:0/3447976822 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4250011830 con 0x7f4260159f60 2023-07-21T22:11:58.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.140+0000 7f4257fff700 1 -- 172.21.15.49:0/3447976822 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4250011990 con 0x7f4260159f60 2023-07-21T22:11:58.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.140+0000 7f4257fff700 1 -- 172.21.15.49:0/3447976822 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4250011d20 con 0x7f4260159f60 2023-07-21T22:11:58.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.140+0000 7f42673ed700 1 -- 172.21.15.49:0/3447976822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4260159f60 msgr2=0x7f42600afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:58.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.140+0000 7f42673ed700 1 --2- 172.21.15.49:0/3447976822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4260159f60 0x7f42600afc20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f426006e670 tx=0x7f4250009b30 comp rx=0 tx=0).stop 2023-07-21T22:11:58.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.140+0000 7f42673ed700 1 -- 172.21.15.49:0/3447976822 shutdown_connections 2023-07-21T22:11:58.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.140+0000 7f42673ed700 1 --2- 172.21.15.49:0/3447976822 >> v2:172.21.15.150:3300/0 conn(0x7f42600b0160 0x7f426015d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.140+0000 7f42673ed700 1 --2- 172.21.15.49:0/3447976822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4260159f60 0x7f42600afc20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.140+0000 7f42673ed700 1 -- 172.21.15.49:0/3447976822 >> 172.21.15.49:0/3447976822 conn(0x7f426006f5a0 msgr2=0x7f42600cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:58.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.140+0000 7f42673ed700 1 -- 172.21.15.49:0/3447976822 shutdown_connections 2023-07-21T22:11:58.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.140+0000 7f42673ed700 1 -- 172.21.15.49:0/3447976822 wait complete. 2023-07-21T22:11:58.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.140+0000 7f42673ed700 1 Processor -- start 2023-07-21T22:11:58.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.140+0000 7f42673ed700 1 -- start start 2023-07-21T22:11:58.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f42673ed700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426006d5d0 0x7f42600c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:58.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f42673ed700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42600b0160 0x7f42600b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:58.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f42673ed700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260159f60 0x7f42600c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:58.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f42673ed700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600b3b30 con 0x7f42600b0160 2023-07-21T22:11:58.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f42673ed700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600c3180 con 0x7f426006d5d0 2023-07-21T22:11:58.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f42673ed700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42600c3460 con 0x7f4260159f60 2023-07-21T22:11:58.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f4264988700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42600b0160 0x7f42600b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:58.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f4264988700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42600b0160 0x7f42600b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38970/0 (socket says 172.21.15.49:38970) 2023-07-21T22:11:58.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f4264988700 1 -- 172.21.15.49:0/2521654538 learned_addr learned my addr 172.21.15.49:0/2521654538 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:58.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f4265189700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426006d5d0 0x7f42600c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:58.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f426598a700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260159f60 0x7f42600c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:58.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f4264988700 1 -- 172.21.15.49:0/2521654538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260159f60 msgr2=0x7f42600c2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:58.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f4264988700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260159f60 0x7f42600c2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f4264988700 1 -- 172.21.15.49:0/2521654538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426006d5d0 msgr2=0x7f42600c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:58.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f4264988700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426006d5d0 0x7f42600c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f4264988700 1 -- 172.21.15.49:0/2521654538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42500094b0 con 0x7f42600b0160 2023-07-21T22:11:58.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f426598a700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260159f60 0x7f42600c2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:58.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f4264988700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42600b0160 0x7f42600b1e10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4250009fd0 tx=0x7f4250004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:58.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f4255ffb700 1 -- 172.21.15.49:0/2521654538 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4250004480 con 0x7f42600b0160 2023-07-21T22:11:58.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f4255ffb700 1 -- 172.21.15.49:0/2521654538 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425001f070 con 0x7f42600b0160 2023-07-21T22:11:58.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f42673ed700 1 -- 172.21.15.49:0/2521654538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42600c3740 con 0x7f42600b0160 2023-07-21T22:11:58.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f4255ffb700 1 -- 172.21.15.49:0/2521654538 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42500038c0 con 0x7f42600b0160 2023-07-21T22:11:58.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.144+0000 7f42673ed700 1 -- 172.21.15.49:0/2521654538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42600c3d00 con 0x7f42600b0160 2023-07-21T22:11:58.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.148+0000 7f42673ed700 1 -- 172.21.15.49:0/2521654538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4260073130 con 0x7f42600b0160 2023-07-21T22:11:58.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.148+0000 7f4255ffb700 1 -- 172.21.15.49:0/2521654538 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4250021030 con 0x7f42600b0160 2023-07-21T22:11:58.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.152+0000 7f4255ffb700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4244066320 0x7f42440687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:58.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.152+0000 7f4255ffb700 1 -- 172.21.15.49:0/2521654538 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4250085430 con 0x7f42600b0160 2023-07-21T22:11:58.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.152+0000 7f4265189700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4244066320 0x7f42440687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:58.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.152+0000 7f4265189700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4244066320 0x7f42440687d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f425c000f60 tx=0x7f425c007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:58.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.156+0000 7f4255ffb700 1 -- 172.21.15.49:0/2521654538 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4250052730 con 0x7f42600b0160 2023-07-21T22:11:58.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.332+0000 7f42673ed700 1 -- 172.21.15.49:0/2521654538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42600c3ef0 con 0x7f42600b0160 2023-07-21T22:11:58.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.332+0000 7f4255ffb700 1 -- 172.21.15.49:0/2521654538 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7f4250055d50 con 0x7f42600b0160 2023-07-21T22:11:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:11:58.380 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:11:58.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.336+0000 7f42673ed700 1 -- 172.21.15.49:0/2521654538 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4244066320 msgr2=0x7f42440687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:58.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.336+0000 7f42673ed700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4244066320 0x7f42440687d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f425c000f60 tx=0x7f425c007e90 comp rx=0 tx=0).stop 2023-07-21T22:11:58.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.336+0000 7f42673ed700 1 -- 172.21.15.49:0/2521654538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42600b0160 msgr2=0x7f42600b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:58.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.336+0000 7f42673ed700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42600b0160 0x7f42600b1e10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4250009fd0 tx=0x7f4250004770 comp rx=0 tx=0).stop 2023-07-21T22:11:58.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.336+0000 7f42673ed700 1 -- 172.21.15.49:0/2521654538 shutdown_connections 2023-07-21T22:11:58.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.336+0000 7f42673ed700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4244066320 0x7f42440687d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.336+0000 7f42673ed700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42600b0160 0x7f42600b1e10 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.336+0000 7f42673ed700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260159f60 0x7f42600c2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.336+0000 7f42673ed700 1 --2- 172.21.15.49:0/2521654538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f426006d5d0 0x7f42600c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.336+0000 7f42673ed700 1 -- 172.21.15.49:0/2521654538 >> 172.21.15.49:0/2521654538 conn(0x7f426006f5a0 msgr2=0x7f426015b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:58.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.336+0000 7f42673ed700 1 -- 172.21.15.49:0/2521654538 shutdown_connections 2023-07-21T22:11:58.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.336+0000 7f42673ed700 1 -- 172.21.15.49:0/2521654538 wait complete. 2023-07-21T22:11:58.405 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:11:58.406 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:11:58.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.552+0000 7f555b777700 1 Processor -- start 2023-07-21T22:11:58.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.552+0000 7f555b777700 1 -- start start 2023-07-21T22:11:58.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.552+0000 7f555b777700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540cb2f0 0x7f55540ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:58.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.552+0000 7f555b777700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55540ca190 con 0x7f555415e380 2023-07-21T22:11:58.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.552+0000 7f555b777700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5554159fd0 con 0x7f55540b3a50 2023-07-21T22:11:58.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.552+0000 7f555b777700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555415d6e0 con 0x7f55540cb2f0 2023-07-21T22:11:58.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.556+0000 7f5559513700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f555415e380 0x7f55540cabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40832/0 (socket says 172.21.15.49:40832) 2023-07-21T22:11:58.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.556+0000 7f5559513700 1 -- 172.21.15.49:0/3150600009 learned_addr learned my addr 172.21.15.49:0/3150600009 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:58.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.556+0000 7f5558d12700 1 --2- 172.21.15.49:0/3150600009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540cb2f0 0x7f55540ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:58.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.556+0000 7f554bfff700 1 -- 172.21.15.49:0/3150600009 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132382399 0 0) 0x7f55540ca190 con 0x7f555415e380 2023-07-21T22:11:58.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.556+0000 7f554bfff700 1 -- 172.21.15.49:0/3150600009 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55400035d0 con 0x7f555415e380 2023-07-21T22:11:58.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.556+0000 7f5558d12700 1 -- 172.21.15.49:0/3150600009 >> v1:172.21.15.150:6789/0 conn(0x7f55540b3a50 legacy=0x7f55540ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:58.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.556+0000 7f554bfff700 1 -- 172.21.15.49:0/3150600009 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059887231 0 0) 0x7f5554159fd0 con 0x7f55540b3a50 2023-07-21T22:11:58.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.556+0000 7f5558d12700 1 -- 172.21.15.49:0/3150600009 >> v1:172.21.15.49:6789/0 conn(0x7f555415e380 legacy=0x7f55540cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:58.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.556+0000 7f5558d12700 1 -- 172.21.15.49:0/3150600009 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55540ca900 con 0x7f55540cb2f0 2023-07-21T22:11:58.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.556+0000 7f5558d12700 1 --2- 172.21.15.49:0/3150600009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540cb2f0 0x7f55540ce160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5544009870 tx=0x7f5544009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7d84b7a53284aae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:58.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.556+0000 7f554bfff700 1 -- 172.21.15.49:0/3150600009 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544005e50 con 0x7f55540cb2f0 2023-07-21T22:11:58.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.556+0000 7f554bfff700 1 -- 172.21.15.49:0/3150600009 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5544006030 con 0x7f55540cb2f0 2023-07-21T22:11:58.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.556+0000 7f554bfff700 1 -- 172.21.15.49:0/3150600009 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55440063c0 con 0x7f55540cb2f0 2023-07-21T22:11:58.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.560+0000 7f555b777700 1 -- 172.21.15.49:0/3150600009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540cb2f0 msgr2=0x7f55540ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:58.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.560+0000 7f555b777700 1 --2- 172.21.15.49:0/3150600009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540cb2f0 0x7f55540ce160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5544009870 tx=0x7f5544009b80 comp rx=0 tx=0).stop 2023-07-21T22:11:58.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.560+0000 7f555b777700 1 -- 172.21.15.49:0/3150600009 shutdown_connections 2023-07-21T22:11:58.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.560+0000 7f555b777700 1 --2- 172.21.15.49:0/3150600009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540cb2f0 0x7f55540ce160 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.560+0000 7f555b777700 1 -- 172.21.15.49:0/3150600009 >> 172.21.15.49:0/3150600009 conn(0x7f555406e960 msgr2=0x7f555406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:58.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.560+0000 7f555b777700 1 -- 172.21.15.49:0/3150600009 shutdown_connections 2023-07-21T22:11:58.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.560+0000 7f555b777700 1 -- 172.21.15.49:0/3150600009 wait complete. 2023-07-21T22:11:58.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f555b777700 1 Processor -- start 2023-07-21T22:11:58.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f555b777700 1 -- start start 2023-07-21T22:11:58.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f555b777700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55540b3a50 0x7f555415b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:58.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f555b777700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540cb2f0 0x7f5554155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:58.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f555b777700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f555415e380 0x7f55540c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:58.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f555b777700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55540c9650 con 0x7f55540b3a50 2023-07-21T22:11:58.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f555b777700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555415ac70 con 0x7f555415e380 2023-07-21T22:11:58.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f555b777700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55540c7680 con 0x7f55540cb2f0 2023-07-21T22:11:58.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f5559513700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55540b3a50 0x7f555415b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:58.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f5559513700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55540b3a50 0x7f555415b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38984/0 (socket says 172.21.15.49:38984) 2023-07-21T22:11:58.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f5559513700 1 -- 172.21.15.49:0/1209231501 learned_addr learned my addr 172.21.15.49:0/1209231501 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:58.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f5558d12700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540cb2f0 0x7f5554155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:58.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f5559d14700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f555415e380 0x7f55540c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:58.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f5559513700 1 -- 172.21.15.49:0/1209231501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540cb2f0 msgr2=0x7f5554155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:58.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f5559513700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540cb2f0 0x7f5554155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f5559513700 1 -- 172.21.15.49:0/1209231501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f555415e380 msgr2=0x7f55540c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:58.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f5559513700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f555415e380 0x7f55540c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f5559513700 1 -- 172.21.15.49:0/1209231501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5544009450 con 0x7f55540b3a50 2023-07-21T22:11:58.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f5558d12700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540cb2f0 0x7f5554155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:11:58.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f5559513700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55540b3a50 0x7f555415b4a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f555000c520 tx=0x7f555000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:58.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f5549ffb700 1 -- 172.21.15.49:0/1209231501 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550005d90 con 0x7f55540b3a50 2023-07-21T22:11:58.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.564+0000 7f5549ffb700 1 -- 172.21.15.49:0/1209231501 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55500070d0 con 0x7f55540b3a50 2023-07-21T22:11:58.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.568+0000 7f5549ffb700 1 -- 172.21.15.49:0/1209231501 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550007440 con 0x7f55540b3a50 2023-07-21T22:11:58.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.568+0000 7f555b777700 1 -- 172.21.15.49:0/1209231501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55540cc3c0 con 0x7f55540b3a50 2023-07-21T22:11:58.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.568+0000 7f555b777700 1 -- 172.21.15.49:0/1209231501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555415b1c0 con 0x7f55540b3a50 2023-07-21T22:11:58.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.568+0000 7f555b777700 1 -- 172.21.15.49:0/1209231501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555404dd50 con 0x7f55540b3a50 2023-07-21T22:11:58.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.568+0000 7f5549ffb700 1 -- 172.21.15.49:0/1209231501 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55500075a0 con 0x7f55540b3a50 2023-07-21T22:11:58.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.572+0000 7f5549ffb700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f55380662f0 0x7f55380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:58.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.572+0000 7f5549ffb700 1 -- 172.21.15.49:0/1209231501 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f55500834f0 con 0x7f55540b3a50 2023-07-21T22:11:58.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.572+0000 7f5558d12700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f55380662f0 0x7f55380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:58.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.572+0000 7f5558d12700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f55380662f0 0x7f55380687a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f55540cb6e0 tx=0x7f5544008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:58.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.576+0000 7f5549ffb700 1 -- 172.21.15.49:0/1209231501 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5550050650 con 0x7f55540b3a50 2023-07-21T22:11:58.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.752+0000 7f555b777700 1 -- 172.21.15.49:0/1209231501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5554071290 con 0x7f55540b3a50 2023-07-21T22:11:58.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.752+0000 7f5549ffb700 1 -- 172.21.15.49:0/1209231501 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5550053c70 con 0x7f55540b3a50 2023-07-21T22:11:58.798 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:11:58.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.756+0000 7f555b777700 1 -- 172.21.15.49:0/1209231501 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f55380662f0 msgr2=0x7f55380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:58.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.756+0000 7f555b777700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f55380662f0 0x7f55380687a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f55540cb6e0 tx=0x7f5544008070 comp rx=0 tx=0).stop 2023-07-21T22:11:58.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.756+0000 7f555b777700 1 -- 172.21.15.49:0/1209231501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55540b3a50 msgr2=0x7f555415b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:58.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.756+0000 7f555b777700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55540b3a50 0x7f555415b4a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f555000c520 tx=0x7f555000c8e0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.756+0000 7f555b777700 1 -- 172.21.15.49:0/1209231501 shutdown_connections 2023-07-21T22:11:58.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.756+0000 7f555b777700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f55380662f0 0x7f55380687a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.756+0000 7f555b777700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f555415e380 0x7f55540c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.756+0000 7f555b777700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540cb2f0 0x7f5554155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.756+0000 7f555b777700 1 --2- 172.21.15.49:0/1209231501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55540b3a50 0x7f555415b4a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:58.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.756+0000 7f555b777700 1 -- 172.21.15.49:0/1209231501 >> 172.21.15.49:0/1209231501 conn(0x7f555406e960 msgr2=0x7f55540cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:58.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.756+0000 7f555b777700 1 -- 172.21.15.49:0/1209231501 shutdown_connections 2023-07-21T22:11:58.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.756+0000 7f555b777700 1 -- 172.21.15.49:0/1209231501 wait complete. 2023-07-21T22:11:58.825 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:11:59.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.964+0000 7f5eff05a700 1 Processor -- start 2023-07-21T22:11:59.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.964+0000 7f5eff05a700 1 -- start start 2023-07-21T22:11:59.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.964+0000 7f5eff05a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ef80ca550 0x7f5ef806d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.964+0000 7f5eff05a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5ef806d6d0 0x7f5ef80698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.964+0000 7f5eff05a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef80c8b80 con 0x7f5ef8159be0 2023-07-21T22:11:59.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.964+0000 7f5eff05a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef80c9720 con 0x7f5ef806d6d0 2023-07-21T22:11:59.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.964+0000 7f5eff05a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef806db90 con 0x7f5ef80ca550 2023-07-21T22:11:59.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.968+0000 7f5efe058700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5ef8159be0 0x7f5ef80c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40846/0 (socket says 172.21.15.49:40846) 2023-07-21T22:11:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.968+0000 7f5efe058700 1 -- 172.21.15.49:0/4155068971 learned_addr learned my addr 172.21.15.49:0/4155068971 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.968+0000 7f5efd857700 1 --2- 172.21.15.49:0/4155068971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ef80ca550 0x7f5ef806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.968+0000 7f5efe859700 1 --2- 172.21.15.49:0/4155068971 >> v2:172.21.15.150:3300/0 conn(0x7f5ef806d6d0 0x7f5ef80698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.968+0000 7f5efd857700 1 -- 172.21.15.49:0/4155068971 >> v2:172.21.15.150:3300/0 conn(0x7f5ef806d6d0 msgr2=0x7f5ef80698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:59.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.968+0000 7f5efd857700 1 --2- 172.21.15.49:0/4155068971 >> v2:172.21.15.150:3300/0 conn(0x7f5ef806d6d0 0x7f5ef80698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.968+0000 7f5efd857700 1 -- 172.21.15.49:0/4155068971 >> v1:172.21.15.49:6789/0 conn(0x7f5ef8159be0 legacy=0x7f5ef80c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.968+0000 7f5efd857700 1 -- 172.21.15.49:0/4155068971 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef806de70 con 0x7f5ef80ca550 2023-07-21T22:11:59.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.968+0000 7f5efd056700 1 -- 172.21.15.49:0/4155068971 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285719483 0 0) 0x7f5ef80c8b80 con 0x7f5ef8159be0 2023-07-21T22:11:59.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.968+0000 7f5efd857700 1 --2- 172.21.15.49:0/4155068971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ef80ca550 0x7f5ef806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009850 tx=0x7f5ee8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dedd51abacc814d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:59.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.968+0000 7f5efd056700 1 -- 172.21.15.49:0/4155068971 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8011830 con 0x7f5ef80ca550 2023-07-21T22:11:59.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.968+0000 7f5efd056700 1 -- 172.21.15.49:0/4155068971 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee8011990 con 0x7f5ef80ca550 2023-07-21T22:11:59.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.968+0000 7f5efd056700 1 -- 172.21.15.49:0/4155068971 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8011d40 con 0x7f5ef80ca550 2023-07-21T22:11:59.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.972+0000 7f5eff05a700 1 -- 172.21.15.49:0/4155068971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ef80ca550 msgr2=0x7f5ef806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.972+0000 7f5eff05a700 1 --2- 172.21.15.49:0/4155068971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ef80ca550 0x7f5ef806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009850 tx=0x7f5ee8009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:59.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.972+0000 7f5eff05a700 1 -- 172.21.15.49:0/4155068971 shutdown_connections 2023-07-21T22:11:59.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.972+0000 7f5eff05a700 1 --2- 172.21.15.49:0/4155068971 >> v2:172.21.15.150:3300/0 conn(0x7f5ef806d6d0 0x7f5ef80698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.972+0000 7f5eff05a700 1 --2- 172.21.15.49:0/4155068971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ef80ca550 0x7f5ef806d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.972+0000 7f5eff05a700 1 -- 172.21.15.49:0/4155068971 >> 172.21.15.49:0/4155068971 conn(0x7f5ef80ce0d0 msgr2=0x7f5ef80ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:59.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.972+0000 7f5eff05a700 1 -- 172.21.15.49:0/4155068971 shutdown_connections 2023-07-21T22:11:59.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.972+0000 7f5eff05a700 1 -- 172.21.15.49:0/4155068971 wait complete. 2023-07-21T22:11:59.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.972+0000 7f5eff05a700 1 Processor -- start 2023-07-21T22:11:59.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.972+0000 7f5eff05a700 1 -- start start 2023-07-21T22:11:59.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5eff05a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ef806d6d0 0x7f5ef80afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5eff05a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ef80ca550 0x7f5ef81f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5eff05a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ef8159be0 0x7f5ef814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5eff05a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef81f4830 con 0x7f5ef80ca550 2023-07-21T22:11:59.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5eff05a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef81f44e0 con 0x7f5ef8159be0 2023-07-21T22:11:59.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5eff05a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef81f1420 con 0x7f5ef806d6d0 2023-07-21T22:11:59.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5efd857700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ef80ca550 0x7f5ef81f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5efd857700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ef80ca550 0x7f5ef81f0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38986/0 (socket says 172.21.15.49:38986) 2023-07-21T22:11:59.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5efd857700 1 -- 172.21.15.49:0/1090441321 learned_addr learned my addr 172.21.15.49:0/1090441321 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:59.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5efe058700 1 --2- 172.21.15.49:0/1090441321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ef806d6d0 0x7f5ef80afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5efe859700 1 --2- 172.21.15.49:0/1090441321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ef8159be0 0x7f5ef814ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5efd857700 1 -- 172.21.15.49:0/1090441321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ef806d6d0 msgr2=0x7f5ef80afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5efd857700 1 --2- 172.21.15.49:0/1090441321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ef806d6d0 0x7f5ef80afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5efd857700 1 -- 172.21.15.49:0/1090441321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ef8159be0 msgr2=0x7f5ef814ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5efd857700 1 --2- 172.21.15.49:0/1090441321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ef8159be0 0x7f5ef814ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5efd857700 1 -- 172.21.15.49:0/1090441321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee80094b0 con 0x7f5ef80ca550 2023-07-21T22:11:59.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5efd857700 1 --2- 172.21.15.49:0/1090441321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ef80ca550 0x7f5ef81f0ee0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80090b0 tx=0x7f5ee8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:59.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5eeeffd700 1 -- 172.21.15.49:0/1090441321 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee801aac0 con 0x7f5ef80ca550 2023-07-21T22:11:59.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5eeeffd700 1 -- 172.21.15.49:0/1090441321 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee801f070 con 0x7f5ef80ca550 2023-07-21T22:11:59.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5eff05a700 1 -- 172.21.15.49:0/1090441321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef814f9c0 con 0x7f5ef80ca550 2023-07-21T22:11:59.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5eeeffd700 1 -- 172.21.15.49:0/1090441321 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee801ae60 con 0x7f5ef80ca550 2023-07-21T22:11:59.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.976+0000 7f5eff05a700 1 -- 172.21.15.49:0/1090441321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef81f1680 con 0x7f5ef80ca550 2023-07-21T22:11:59.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.980+0000 7f5eff05a700 1 -- 172.21.15.49:0/1090441321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef804dcb0 con 0x7f5ef80ca550 2023-07-21T22:11:59.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.980+0000 7f5eeeffd700 1 -- 172.21.15.49:0/1090441321 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ee801b430 con 0x7f5ef80ca550 2023-07-21T22:11:59.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.984+0000 7f5eeeffd700 1 --2- 172.21.15.49:0/1090441321 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5edc0662f0 0x7f5edc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.984+0000 7f5eeeffd700 1 -- 172.21.15.49:0/1090441321 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5ee8085210 con 0x7f5ef80ca550 2023-07-21T22:11:59.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.984+0000 7f5efe058700 1 --2- 172.21.15.49:0/1090441321 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5edc0662f0 0x7f5edc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.984+0000 7f5efe058700 1 --2- 172.21.15.49:0/1090441321 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5edc0662f0 0x7f5edc0687a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4000f60 tx=0x7f5ef4007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:59.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:58.988+0000 7f5eeeffd700 1 -- 172.21.15.49:0/1090441321 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ee8052350 con 0x7f5ef80ca550 2023-07-21T22:11:59.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.160+0000 7f5eff05a700 1 -- 172.21.15.49:0/1090441321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5ef80c9ce0 con 0x7f5ef80ca550 2023-07-21T22:11:59.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.164+0000 7f5eeeffd700 1 -- 172.21.15.49:0/1090441321 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5ee80210a0 con 0x7f5ef80ca550 2023-07-21T22:11:59.207 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:11:59.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.164+0000 7f5eff05a700 1 -- 172.21.15.49:0/1090441321 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5edc0662f0 msgr2=0x7f5edc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.164+0000 7f5eff05a700 1 --2- 172.21.15.49:0/1090441321 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5edc0662f0 0x7f5edc0687a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4000f60 tx=0x7f5ef4007c00 comp rx=0 tx=0).stop 2023-07-21T22:11:59.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.164+0000 7f5eff05a700 1 -- 172.21.15.49:0/1090441321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ef80ca550 msgr2=0x7f5ef81f0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.164+0000 7f5eff05a700 1 --2- 172.21.15.49:0/1090441321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ef80ca550 0x7f5ef81f0ee0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80090b0 tx=0x7f5ee8004770 comp rx=0 tx=0).stop 2023-07-21T22:11:59.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.164+0000 7f5eff05a700 1 -- 172.21.15.49:0/1090441321 shutdown_connections 2023-07-21T22:11:59.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.164+0000 7f5eff05a700 1 --2- 172.21.15.49:0/1090441321 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5edc0662f0 0x7f5edc0687a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.164+0000 7f5eff05a700 1 --2- 172.21.15.49:0/1090441321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ef80ca550 0x7f5ef81f0ee0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.164+0000 7f5eff05a700 1 --2- 172.21.15.49:0/1090441321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ef8159be0 0x7f5ef814ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.164+0000 7f5eff05a700 1 --2- 172.21.15.49:0/1090441321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ef806d6d0 0x7f5ef80afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.164+0000 7f5eff05a700 1 -- 172.21.15.49:0/1090441321 >> 172.21.15.49:0/1090441321 conn(0x7f5ef80ce0d0 msgr2=0x7f5ef80cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:59.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.164+0000 7f5eff05a700 1 -- 172.21.15.49:0/1090441321 shutdown_connections 2023-07-21T22:11:59.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.164+0000 7f5eff05a700 1 -- 172.21.15.49:0/1090441321 wait complete. 2023-07-21T22:11:59.231 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:11:59.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.372+0000 7fc98f54c700 1 Processor -- start 2023-07-21T22:11:59.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.372+0000 7fc98f54c700 1 -- start start 2023-07-21T22:11:59.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.376+0000 7fc98f54c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc980038560 0x7fc98003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.376+0000 7fc98f54c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc980007360 con 0x7fc9800e29f0 2023-07-21T22:11:59.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.376+0000 7fc98f54c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc980053f70 con 0x7fc98003b160 2023-07-21T22:11:59.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.376+0000 7fc98f54c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9800e2dc0 con 0x7fc980038560 2023-07-21T22:11:59.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.376+0000 7fc98dd49700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc980038560 0x7fc98003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.376+0000 7fc98dd49700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc980038560 0x7fc98003ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38994/0 (socket says 172.21.15.49:38994) 2023-07-21T22:11:59.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.376+0000 7fc98dd49700 1 -- 172.21.15.49:0/3171739001 learned_addr learned my addr 172.21.15.49:0/3171739001 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:59.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.376+0000 7fc98e54a700 1 --1- 172.21.15.49:0/3171739001 >> v1:172.21.15.49:6789/0 conn(0x7fc9800e29f0 0x7fc980055490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40860/0 (socket says 172.21.15.49:40860) 2023-07-21T22:11:59.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.380+0000 7fc98dd49700 1 -- 172.21.15.49:0/3171739001 >> v1:172.21.15.150:6789/0 conn(0x7fc98003b160 legacy=0x7fc980057210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.380+0000 7fc98dd49700 1 -- 172.21.15.49:0/3171739001 >> v1:172.21.15.49:6789/0 conn(0x7fc9800e29f0 legacy=0x7fc980055490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.380+0000 7fc98dd49700 1 -- 172.21.15.49:0/3171739001 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98003b5a0 con 0x7fc980038560 2023-07-21T22:11:59.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.380+0000 7fc98dd49700 1 --2- 172.21.15.49:0/3171739001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc980038560 0x7fc98003ac20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc978009910 tx=0x7fc978009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119b503590f0e3ad server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:59.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.380+0000 7fc98d548700 1 -- 172.21.15.49:0/3171739001 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97800ba60 con 0x7fc980038560 2023-07-21T22:11:59.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.380+0000 7fc98d548700 1 -- 172.21.15.49:0/3171739001 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97800bbc0 con 0x7fc980038560 2023-07-21T22:11:59.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.380+0000 7fc98d548700 1 -- 172.21.15.49:0/3171739001 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978009e60 con 0x7fc980038560 2023-07-21T22:11:59.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.380+0000 7fc98f54c700 1 -- 172.21.15.49:0/3171739001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc980038560 msgr2=0x7fc98003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.380+0000 7fc98f54c700 1 --2- 172.21.15.49:0/3171739001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc980038560 0x7fc98003ac20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc978009910 tx=0x7fc978009c20 comp rx=0 tx=0).stop 2023-07-21T22:11:59.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.380+0000 7fc98f54c700 1 -- 172.21.15.49:0/3171739001 shutdown_connections 2023-07-21T22:11:59.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.380+0000 7fc98f54c700 1 --2- 172.21.15.49:0/3171739001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc980038560 0x7fc98003ac20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.380+0000 7fc98f54c700 1 -- 172.21.15.49:0/3171739001 >> 172.21.15.49:0/3171739001 conn(0x7fc980055c20 msgr2=0x7fc980056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:59.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.380+0000 7fc98f54c700 1 -- 172.21.15.49:0/3171739001 shutdown_connections 2023-07-21T22:11:59.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.380+0000 7fc98f54c700 1 -- 172.21.15.49:0/3171739001 wait complete. 2023-07-21T22:11:59.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98f54c700 1 Processor -- start 2023-07-21T22:11:59.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98f54c700 1 -- start start 2023-07-21T22:11:59.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98f54c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc980038560 0x7fc980039ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98f54c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98003b160 0x7fc98004b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98f54c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800e29f0 0x7fc98004bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98f54c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98004c450 con 0x7fc980038560 2023-07-21T22:11:59.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98f54c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98017c7c0 con 0x7fc98003b160 2023-07-21T22:11:59.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98f54c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9800ce0d0 con 0x7fc9800e29f0 2023-07-21T22:11:59.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98e54a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc980038560 0x7fc980039ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98e54a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc980038560 0x7fc980039ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39004/0 (socket says 172.21.15.49:39004) 2023-07-21T22:11:59.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98dd49700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98003b160 0x7fc98004b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98e54a700 1 -- 172.21.15.49:0/1078770907 learned_addr learned my addr 172.21.15.49:0/1078770907 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:59.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98ed4b700 1 --2- 172.21.15.49:0/1078770907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800e29f0 0x7fc98004bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98e54a700 1 -- 172.21.15.49:0/1078770907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800e29f0 msgr2=0x7fc98004bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98e54a700 1 --2- 172.21.15.49:0/1078770907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800e29f0 0x7fc98004bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98e54a700 1 -- 172.21.15.49:0/1078770907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98003b160 msgr2=0x7fc98004b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98e54a700 1 --2- 172.21.15.49:0/1078770907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98003b160 0x7fc98004b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98e54a700 1 -- 172.21.15.49:0/1078770907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc978009570 con 0x7fc980038560 2023-07-21T22:11:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.384+0000 7fc98e54a700 1 --2- 172.21.15.49:0/1078770907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc980038560 0x7fc980039ec0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc98400c500 tx=0x7fc98400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.388+0000 7fc97effd700 1 -- 172.21.15.49:0/1078770907 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc984005cd0 con 0x7fc980038560 2023-07-21T22:11:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.388+0000 7fc97effd700 1 -- 172.21.15.49:0/1078770907 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc984005e30 con 0x7fc980038560 2023-07-21T22:11:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.388+0000 7fc98f54c700 1 -- 172.21.15.49:0/1078770907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9800ce3b0 con 0x7fc980038560 2023-07-21T22:11:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.388+0000 7fc97effd700 1 -- 172.21.15.49:0/1078770907 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9840072f0 con 0x7fc980038560 2023-07-21T22:11:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.388+0000 7fc98f54c700 1 -- 172.21.15.49:0/1078770907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9800ce970 con 0x7fc980038560 2023-07-21T22:11:59.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.388+0000 7fc98f54c700 1 -- 172.21.15.49:0/1078770907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98003ccf0 con 0x7fc980038560 2023-07-21T22:11:59.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.388+0000 7fc97effd700 1 -- 172.21.15.49:0/1078770907 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc984007450 con 0x7fc980038560 2023-07-21T22:11:59.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.392+0000 7fc97effd700 1 --2- 172.21.15.49:0/1078770907 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc96c0662f0 0x7fc96c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.392+0000 7fc97effd700 1 -- 172.21.15.49:0/1078770907 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc9840833f0 con 0x7fc980038560 2023-07-21T22:11:59.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.392+0000 7fc98dd49700 1 --2- 172.21.15.49:0/1078770907 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc96c0662f0 0x7fc96c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.392+0000 7fc98dd49700 1 --2- 172.21.15.49:0/1078770907 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc96c0662f0 0x7fc96c0687a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc980038930 tx=0x7fc978008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:59.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.396+0000 7fc97effd700 1 -- 172.21.15.49:0/1078770907 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc984050530 con 0x7fc980038560 2023-07-21T22:11:59.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.572+0000 7fc98f54c700 1 -- 172.21.15.49:0/1078770907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9800077b0 con 0x7fc980038560 2023-07-21T22:11:59.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.576+0000 7fc97effd700 1 -- 172.21.15.49:0/1078770907 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc984053b50 con 0x7fc980038560 2023-07-21T22:11:59.619 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:11:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.576+0000 7fc98f54c700 1 -- 172.21.15.49:0/1078770907 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc96c0662f0 msgr2=0x7fc96c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.576+0000 7fc98f54c700 1 --2- 172.21.15.49:0/1078770907 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc96c0662f0 0x7fc96c0687a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc980038930 tx=0x7fc978008030 comp rx=0 tx=0).stop 2023-07-21T22:11:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.576+0000 7fc98f54c700 1 -- 172.21.15.49:0/1078770907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc980038560 msgr2=0x7fc980039ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.576+0000 7fc98f54c700 1 --2- 172.21.15.49:0/1078770907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc980038560 0x7fc980039ec0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc98400c500 tx=0x7fc98400c810 comp rx=0 tx=0).stop 2023-07-21T22:11:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.576+0000 7fc98f54c700 1 -- 172.21.15.49:0/1078770907 shutdown_connections 2023-07-21T22:11:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.576+0000 7fc98f54c700 1 --2- 172.21.15.49:0/1078770907 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc96c0662f0 0x7fc96c0687a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.576+0000 7fc98f54c700 1 --2- 172.21.15.49:0/1078770907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800e29f0 0x7fc98004bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.576+0000 7fc98f54c700 1 --2- 172.21.15.49:0/1078770907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98003b160 0x7fc98004b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.576+0000 7fc98f54c700 1 --2- 172.21.15.49:0/1078770907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc980038560 0x7fc980039ec0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.576+0000 7fc98f54c700 1 -- 172.21.15.49:0/1078770907 >> 172.21.15.49:0/1078770907 conn(0x7fc980055c20 msgr2=0x7fc98003c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.576+0000 7fc98f54c700 1 -- 172.21.15.49:0/1078770907 shutdown_connections 2023-07-21T22:11:59.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.576+0000 7fc98f54c700 1 -- 172.21.15.49:0/1078770907 wait complete. 2023-07-21T22:11:59.642 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:11:59.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.780+0000 7fb04d6c6700 1 Processor -- start 2023-07-21T22:11:59.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.780+0000 7fb04d6c6700 1 -- start start 2023-07-21T22:11:59.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb04d6c6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0481603e0 0x7fb048164370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb04d6c6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb0481648b0 0x7fb0480cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb04d6c6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb048163ee0 con 0x7fb048160010 2023-07-21T22:11:59.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb04d6c6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0480cdf70 con 0x7fb0481648b0 2023-07-21T22:11:59.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb04d6c6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480cd6d0 con 0x7fb0481603e0 2023-07-21T22:11:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb0467fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0481603e0 0x7fb048164370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb046ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb048160010 0x7fb0480ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:47402/0 (socket says 172.21.15.49:47402) 2023-07-21T22:11:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb046ffd700 1 -- 172.21.15.49:0/1316901384 learned_addr learned my addr 172.21.15.49:0/1316901384 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:11:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb0477fe700 1 --2- 172.21.15.49:0/1316901384 >> v2:172.21.15.150:3300/0 conn(0x7fb0481648b0 0x7fb0480cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb0467fc700 1 -- 172.21.15.49:0/1316901384 >> v2:172.21.15.150:3300/0 conn(0x7fb0481648b0 msgr2=0x7fb0480cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:11:59.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb0467fc700 1 --2- 172.21.15.49:0/1316901384 >> v2:172.21.15.150:3300/0 conn(0x7fb0481648b0 0x7fb0480cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb0467fc700 1 -- 172.21.15.49:0/1316901384 >> v1:172.21.15.150:6789/0 conn(0x7fb048160010 legacy=0x7fb0480ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb0467fc700 1 -- 172.21.15.49:0/1316901384 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0480cd9b0 con 0x7fb0481603e0 2023-07-21T22:11:59.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb045ffb700 1 -- 172.21.15.49:0/1316901384 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777286414 0 0) 0x7fb048163ee0 con 0x7fb048160010 2023-07-21T22:11:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb0467fc700 1 --2- 172.21.15.49:0/1316901384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0481603e0 0x7fb048164370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009850 tx=0x7fb03c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=369aa68debef8a5b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb045ffb700 1 -- 172.21.15.49:0/1316901384 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c011830 con 0x7fb0481603e0 2023-07-21T22:11:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb045ffb700 1 -- 172.21.15.49:0/1316901384 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c011990 con 0x7fb0481603e0 2023-07-21T22:11:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.784+0000 7fb045ffb700 1 -- 172.21.15.49:0/1316901384 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c011d40 con 0x7fb0481603e0 2023-07-21T22:11:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.788+0000 7fb04d6c6700 1 -- 172.21.15.49:0/1316901384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0481603e0 msgr2=0x7fb048164370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.788+0000 7fb04d6c6700 1 --2- 172.21.15.49:0/1316901384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0481603e0 0x7fb048164370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009850 tx=0x7fb03c009b60 comp rx=0 tx=0).stop 2023-07-21T22:11:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.788+0000 7fb04d6c6700 1 -- 172.21.15.49:0/1316901384 shutdown_connections 2023-07-21T22:11:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.788+0000 7fb04d6c6700 1 --2- 172.21.15.49:0/1316901384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0481603e0 0x7fb048164370 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.788+0000 7fb04d6c6700 1 --2- 172.21.15.49:0/1316901384 >> v2:172.21.15.150:3300/0 conn(0x7fb0481648b0 0x7fb0480cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.788+0000 7fb04d6c6700 1 -- 172.21.15.49:0/1316901384 >> 172.21.15.49:0/1316901384 conn(0x7fb0480ce0d0 msgr2=0x7fb0480ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.788+0000 7fb04d6c6700 1 -- 172.21.15.49:0/1316901384 shutdown_connections 2023-07-21T22:11:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.788+0000 7fb04d6c6700 1 -- 172.21.15.49:0/1316901384 wait complete. 2023-07-21T22:11:59.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb04d6c6700 1 Processor -- start 2023-07-21T22:11:59.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb04d6c6700 1 -- start start 2023-07-21T22:11:59.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb04d6c6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb048160010 0x7fb0480b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb04d6c6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0481603e0 0x7fb0480b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb04d6c6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0481648b0 0x7fb0480b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb04d6c6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04806c050 con 0x7fb0481648b0 2023-07-21T22:11:59.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb04d6c6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480b1ab0 con 0x7fb0481603e0 2023-07-21T22:11:59.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb04d6c6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0481f8d10 con 0x7fb048160010 2023-07-21T22:11:59.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb0477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0481648b0 0x7fb0480b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb0477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0481648b0 0x7fb0480b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39020/0 (socket says 172.21.15.49:39020) 2023-07-21T22:11:59.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb0477fe700 1 -- 172.21.15.49:0/2624923698 learned_addr learned my addr 172.21.15.49:0/2624923698 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:11:59.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb046ffd700 1 --2- 172.21.15.49:0/2624923698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb048160010 0x7fb0480b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb0467fc700 1 --2- 172.21.15.49:0/2624923698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0481603e0 0x7fb0480b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb0477fe700 1 -- 172.21.15.49:0/2624923698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb048160010 msgr2=0x7fb0480b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb0477fe700 1 --2- 172.21.15.49:0/2624923698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb048160010 0x7fb0480b06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb0477fe700 1 -- 172.21.15.49:0/2624923698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0481603e0 msgr2=0x7fb0480b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:59.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb0477fe700 1 --2- 172.21.15.49:0/2624923698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0481603e0 0x7fb0480b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:59.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb0477fe700 1 -- 172.21.15.49:0/2624923698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c0094b0 con 0x7fb0481648b0 2023-07-21T22:11:59.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.792+0000 7fb0477fe700 1 --2- 172.21.15.49:0/2624923698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0481648b0 0x7fb0480b1480 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb04000efc0 tx=0x7fb04000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:59.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.796+0000 7fb02f7fe700 1 -- 172.21.15.49:0/2624923698 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040009ea0 con 0x7fb0481648b0 2023-07-21T22:11:59.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.796+0000 7fb02f7fe700 1 -- 172.21.15.49:0/2624923698 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04000f040 con 0x7fb0481648b0 2023-07-21T22:11:59.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.796+0000 7fb02f7fe700 1 -- 172.21.15.49:0/2624923698 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04000ced0 con 0x7fb0481648b0 2023-07-21T22:11:59.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.796+0000 7fb04d6c6700 1 -- 172.21.15.49:0/2624923698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0481f8ff0 con 0x7fb0481648b0 2023-07-21T22:11:59.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.796+0000 7fb04d6c6700 1 -- 172.21.15.49:0/2624923698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0481f95b0 con 0x7fb0481648b0 2023-07-21T22:11:59.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.796+0000 7fb04d6c6700 1 -- 172.21.15.49:0/2624923698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0480b3e50 con 0x7fb0481648b0 2023-07-21T22:11:59.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.800+0000 7fb02f7fe700 1 -- 172.21.15.49:0/2624923698 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb040014480 con 0x7fb0481648b0 2023-07-21T22:11:59.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.800+0000 7fb02f7fe700 1 --2- 172.21.15.49:0/2624923698 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb0340662f0 0x7fb0340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:59.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.800+0000 7fb02f7fe700 1 -- 172.21.15.49:0/2624923698 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb040084890 con 0x7fb0481648b0 2023-07-21T22:11:59.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.800+0000 7fb046ffd700 1 --2- 172.21.15.49:0/2624923698 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb0340662f0 0x7fb0340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:59.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.800+0000 7fb046ffd700 1 --2- 172.21.15.49:0/2624923698 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb0340662f0 0x7fb0340687a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb038000f60 tx=0x7fb038007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:59.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.804+0000 7fb02f7fe700 1 -- 172.21.15.49:0/2624923698 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0400519f0 con 0x7fb0481648b0 2023-07-21T22:12:00.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.976+0000 7fb04d6c6700 1 -- 172.21.15.49:0/2624923698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0481f97a0 con 0x7fb0481648b0 2023-07-21T22:12:00.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.976+0000 7fb02f7fe700 1 -- 172.21.15.49:0/2624923698 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb0400180a0 con 0x7fb0481648b0 2023-07-21T22:12:00.023 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:12:00.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.984+0000 7fb04d6c6700 1 -- 172.21.15.49:0/2624923698 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb0340662f0 msgr2=0x7fb0340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.984+0000 7fb04d6c6700 1 --2- 172.21.15.49:0/2624923698 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb0340662f0 0x7fb0340687a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb038000f60 tx=0x7fb038007e90 comp rx=0 tx=0).stop 2023-07-21T22:12:00.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.984+0000 7fb04d6c6700 1 -- 172.21.15.49:0/2624923698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0481648b0 msgr2=0x7fb0480b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.984+0000 7fb04d6c6700 1 --2- 172.21.15.49:0/2624923698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0481648b0 0x7fb0480b1480 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb04000efc0 tx=0x7fb04000c3a0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.984+0000 7fb04d6c6700 1 -- 172.21.15.49:0/2624923698 shutdown_connections 2023-07-21T22:12:00.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.984+0000 7fb04d6c6700 1 --2- 172.21.15.49:0/2624923698 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb0340662f0 0x7fb0340687a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.984+0000 7fb04d6c6700 1 --2- 172.21.15.49:0/2624923698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0481648b0 0x7fb0480b1480 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.984+0000 7fb04d6c6700 1 --2- 172.21.15.49:0/2624923698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0481603e0 0x7fb0480b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.984+0000 7fb04d6c6700 1 --2- 172.21.15.49:0/2624923698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb048160010 0x7fb0480b06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.984+0000 7fb04d6c6700 1 -- 172.21.15.49:0/2624923698 >> 172.21.15.49:0/2624923698 conn(0x7fb0480ce0d0 msgr2=0x7fb048070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:00.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.984+0000 7fb04d6c6700 1 -- 172.21.15.49:0/2624923698 shutdown_connections 2023-07-21T22:12:00.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:11:59.984+0000 7fb04d6c6700 1 -- 172.21.15.49:0/2624923698 wait complete. 2023-07-21T22:12:00.040 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:12:00.047 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:12:00.048 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:12:00.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.220+0000 7f3cb1493700 1 Processor -- start 2023-07-21T22:12:00.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.220+0000 7f3cb1493700 1 -- start start 2023-07-21T22:12:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.224+0000 7f3cb1493700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3cac0b7af0 0x7f3cac0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:00.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.224+0000 7f3cb1493700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cac0b3e80 con 0x7f3cac0d1e40 2023-07-21T22:12:00.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.224+0000 7f3cb1493700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cac15fd40 con 0x7f3cac0cee10 2023-07-21T22:12:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.224+0000 7f3cb1493700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac0cea00 con 0x7f3cac0b7af0 2023-07-21T22:12:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.224+0000 7f3cab7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3cac0d1e40 0x7f3cac15f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40862/0 (socket says 172.21.15.49:40862) 2023-07-21T22:12:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.224+0000 7f3cab7fe700 1 -- 172.21.15.49:0/3747312216 learned_addr learned my addr 172.21.15.49:0/3747312216 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.224+0000 7f3cabfff700 1 --2- 172.21.15.49:0/3747312216 >> v2:172.21.15.49:3300/0 conn(0x7f3cac0b7af0 0x7f3cac0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:00.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.224+0000 7f3caaffd700 1 -- 172.21.15.49:0/3747312216 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465799567 0 0) 0x7f3cac0b3e80 con 0x7f3cac0d1e40 2023-07-21T22:12:00.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.224+0000 7f3caaffd700 1 -- 172.21.15.49:0/3747312216 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c940035d0 con 0x7f3cac0d1e40 2023-07-21T22:12:00.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.224+0000 7f3cabfff700 1 -- 172.21.15.49:0/3747312216 >> v1:172.21.15.150:6789/0 conn(0x7f3cac0cee10 legacy=0x7f3cac0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.224+0000 7f3cabfff700 1 -- 172.21.15.49:0/3747312216 >> v1:172.21.15.49:6789/0 conn(0x7f3cac0d1e40 legacy=0x7f3cac15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.224+0000 7f3cabfff700 1 -- 172.21.15.49:0/3747312216 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac0ccbf0 con 0x7f3cac0b7af0 2023-07-21T22:12:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.228+0000 7f3cabfff700 1 --2- 172.21.15.49:0/3747312216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cac0b7af0 0x7f3cac0b1630 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009850 tx=0x7f3c9c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f980463b430891c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.228+0000 7f3caaffd700 1 -- 172.21.15.49:0/3747312216 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c011830 con 0x7f3cac0b7af0 2023-07-21T22:12:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.228+0000 7f3caaffd700 1 -- 172.21.15.49:0/3747312216 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c011990 con 0x7f3cac0b7af0 2023-07-21T22:12:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.228+0000 7f3caaffd700 1 -- 172.21.15.49:0/3747312216 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c011d40 con 0x7f3cac0b7af0 2023-07-21T22:12:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.228+0000 7f3cb1493700 1 -- 172.21.15.49:0/3747312216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cac0b7af0 msgr2=0x7f3cac0b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.228+0000 7f3cb1493700 1 --2- 172.21.15.49:0/3747312216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cac0b7af0 0x7f3cac0b1630 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009850 tx=0x7f3c9c009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.228+0000 7f3cb1493700 1 -- 172.21.15.49:0/3747312216 shutdown_connections 2023-07-21T22:12:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.228+0000 7f3cb1493700 1 --2- 172.21.15.49:0/3747312216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cac0b7af0 0x7f3cac0b1630 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.228+0000 7f3cb1493700 1 -- 172.21.15.49:0/3747312216 >> 172.21.15.49:0/3747312216 conn(0x7f3cac06e960 msgr2=0x7f3cac06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.228+0000 7f3cb1493700 1 -- 172.21.15.49:0/3747312216 shutdown_connections 2023-07-21T22:12:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.228+0000 7f3cb1493700 1 -- 172.21.15.49:0/3747312216 wait complete. 2023-07-21T22:12:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb1493700 1 Processor -- start 2023-07-21T22:12:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb1493700 1 -- start start 2023-07-21T22:12:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb1493700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cac0b7af0 0x7f3cac150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:00.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb1493700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cac0cee10 0x7f3cac0b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:00.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb1493700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cac0d1e40 0x7f3cac0b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:00.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb1493700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac150fc0 con 0x7f3cac0d1e40 2023-07-21T22:12:00.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb1493700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac1e58a0 con 0x7f3cac0b7af0 2023-07-21T22:12:00.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb1493700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac1e5b80 con 0x7f3cac0cee10 2023-07-21T22:12:00.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb0c92700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cac0d1e40 0x7f3cac0b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:00.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb0c92700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cac0d1e40 0x7f3cac0b68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39036/0 (socket says 172.21.15.49:39036) 2023-07-21T22:12:00.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb0c92700 1 -- 172.21.15.49:0/52410212 learned_addr learned my addr 172.21.15.49:0/52410212 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:00.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cabfff700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cac0b7af0 0x7f3cac150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:00.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cab7fe700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cac0cee10 0x7f3cac0b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:00.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb0c92700 1 -- 172.21.15.49:0/52410212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cac0cee10 msgr2=0x7f3cac0b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb0c92700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cac0cee10 0x7f3cac0b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb0c92700 1 -- 172.21.15.49:0/52410212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cac0b7af0 msgr2=0x7f3cac150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb0c92700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cac0b7af0 0x7f3cac150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cb0c92700 1 -- 172.21.15.49:0/52410212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c0094b0 con 0x7f3cac0d1e40 2023-07-21T22:12:00.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.232+0000 7f3cab7fe700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cac0cee10 0x7f3cac0b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:00.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.236+0000 7f3cb0c92700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cac0d1e40 0x7f3cac0b68f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400cb90 tx=0x7f3ca400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:00.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.236+0000 7f3ca8ff9700 1 -- 172.21.15.49:0/52410212 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4003c70 con 0x7f3cac0d1e40 2023-07-21T22:12:00.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.236+0000 7f3ca8ff9700 1 -- 172.21.15.49:0/52410212 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca4003df0 con 0x7f3cac0d1e40 2023-07-21T22:12:00.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.236+0000 7f3cb1493700 1 -- 172.21.15.49:0/52410212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac1e5e60 con 0x7f3cac0d1e40 2023-07-21T22:12:00.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.236+0000 7f3ca8ff9700 1 -- 172.21.15.49:0/52410212 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400abb0 con 0x7f3cac0d1e40 2023-07-21T22:12:00.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.236+0000 7f3cb1493700 1 -- 172.21.15.49:0/52410212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac1e6420 con 0x7f3cac0d1e40 2023-07-21T22:12:00.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.236+0000 7f3cb1493700 1 -- 172.21.15.49:0/52410212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac1e6640 con 0x7f3cac0d1e40 2023-07-21T22:12:00.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.240+0000 7f3ca8ff9700 1 -- 172.21.15.49:0/52410212 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3ca400ad10 con 0x7f3cac0d1e40 2023-07-21T22:12:00.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.240+0000 7f3ca8ff9700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3c980662f0 0x7f3c980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:00.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.240+0000 7f3ca8ff9700 1 -- 172.21.15.49:0/52410212 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3ca4084130 con 0x7f3cac0d1e40 2023-07-21T22:12:00.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.240+0000 7f3cabfff700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3c980662f0 0x7f3c980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:00.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.240+0000 7f3cabfff700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3c980662f0 0x7f3c980687a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0090b0 tx=0x7f3c9c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:00.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.244+0000 7f3ca8ff9700 1 -- 172.21.15.49:0/52410212 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3ca4051270 con 0x7f3cac0d1e40 2023-07-21T22:12:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.424+0000 7f3cb1493700 1 -- 172.21.15.49:0/52410212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3cac151100 con 0x7f3cac0d1e40 2023-07-21T22:12:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.424+0000 7f3ca8ff9700 1 -- 172.21.15.49:0/52410212 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3ca4054890 con 0x7f3cac0d1e40 2023-07-21T22:12:00.471 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:12:00.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.428+0000 7f3cb1493700 1 -- 172.21.15.49:0/52410212 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3c980662f0 msgr2=0x7f3c980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.428+0000 7f3cb1493700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3c980662f0 0x7f3c980687a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0090b0 tx=0x7f3c9c008030 comp rx=0 tx=0).stop 2023-07-21T22:12:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.428+0000 7f3cb1493700 1 -- 172.21.15.49:0/52410212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cac0d1e40 msgr2=0x7f3cac0b68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.428+0000 7f3cb1493700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cac0d1e40 0x7f3cac0b68f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400cb90 tx=0x7f3ca400cf50 comp rx=0 tx=0).stop 2023-07-21T22:12:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.428+0000 7f3cb1493700 1 -- 172.21.15.49:0/52410212 shutdown_connections 2023-07-21T22:12:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.428+0000 7f3cb1493700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3c980662f0 0x7f3c980687a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.428+0000 7f3cb1493700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cac0d1e40 0x7f3cac0b68f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.428+0000 7f3cb1493700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cac0cee10 0x7f3cac0b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.428+0000 7f3cb1493700 1 --2- 172.21.15.49:0/52410212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cac0b7af0 0x7f3cac150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.428+0000 7f3cb1493700 1 -- 172.21.15.49:0/52410212 >> 172.21.15.49:0/52410212 conn(0x7f3cac06e960 msgr2=0x7f3cac15b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.428+0000 7f3cb1493700 1 -- 172.21.15.49:0/52410212 shutdown_connections 2023-07-21T22:12:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.428+0000 7f3cb1493700 1 -- 172.21.15.49:0/52410212 wait complete. 2023-07-21T22:12:00.497 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:12:00.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.636+0000 7f176cdbf700 1 Processor -- start 2023-07-21T22:12:00.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.636+0000 7f176cdbf700 1 -- start start 2023-07-21T22:12:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.640+0000 7f176cdbf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17680ab8d0 0x7f17680afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:00.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.640+0000 7f176cdbf700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17680cdd70 con 0x7f17680cb800 2023-07-21T22:12:00.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.640+0000 7f176cdbf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17680cda40 con 0x7f176815c0a0 2023-07-21T22:12:00.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.640+0000 7f176cdbf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17680abdd0 con 0x7f17680ab8d0 2023-07-21T22:12:00.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.640+0000 7f1766d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f17680cb800 0x7f1768070600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40870/0 (socket says 172.21.15.49:40870) 2023-07-21T22:12:00.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.640+0000 7f1766d9d700 1 -- 172.21.15.49:0/3979221743 learned_addr learned my addr 172.21.15.49:0/3979221743 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:00.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.640+0000 7f1765d9b700 1 --2- 172.21.15.49:0/3979221743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17680ab8d0 0x7f17680afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:00.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.640+0000 7f1765d9b700 1 -- 172.21.15.49:0/3979221743 >> v1:172.21.15.150:6789/0 conn(0x7f176815c0a0 legacy=0x7f17680ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.640+0000 7f1765d9b700 1 -- 172.21.15.49:0/3979221743 >> v1:172.21.15.49:6789/0 conn(0x7f17680cb800 legacy=0x7f1768070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.640+0000 7f1765d9b700 1 -- 172.21.15.49:0/3979221743 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17680cccc0 con 0x7f17680ab8d0 2023-07-21T22:12:00.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.640+0000 7f176559a700 1 -- 172.21.15.49:0/3979221743 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196765223 0 0) 0x7f17680cdd70 con 0x7f17680cb800 2023-07-21T22:12:00.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.640+0000 7f1765d9b700 1 --2- 172.21.15.49:0/3979221743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17680ab8d0 0x7f17680afc20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f175c009880 tx=0x7f175c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a9405310d7348bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.644+0000 7f176559a700 1 -- 172.21.15.49:0/3979221743 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c011830 con 0x7f17680ab8d0 2023-07-21T22:12:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.644+0000 7f176559a700 1 -- 172.21.15.49:0/3979221743 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c011990 con 0x7f17680ab8d0 2023-07-21T22:12:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.644+0000 7f176559a700 1 -- 172.21.15.49:0/3979221743 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c011d20 con 0x7f17680ab8d0 2023-07-21T22:12:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.644+0000 7f176cdbf700 1 -- 172.21.15.49:0/3979221743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17680ab8d0 msgr2=0x7f17680afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.644+0000 7f176cdbf700 1 --2- 172.21.15.49:0/3979221743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17680ab8d0 0x7f17680afc20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f175c009880 tx=0x7f175c009b90 comp rx=0 tx=0).stop 2023-07-21T22:12:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.644+0000 7f176cdbf700 1 -- 172.21.15.49:0/3979221743 shutdown_connections 2023-07-21T22:12:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.644+0000 7f176cdbf700 1 --2- 172.21.15.49:0/3979221743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17680ab8d0 0x7f17680afc20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.644+0000 7f176cdbf700 1 -- 172.21.15.49:0/3979221743 >> 172.21.15.49:0/3979221743 conn(0x7f176806f5a0 msgr2=0x7f17680cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.644+0000 7f176cdbf700 1 -- 172.21.15.49:0/3979221743 shutdown_connections 2023-07-21T22:12:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.644+0000 7f176cdbf700 1 -- 172.21.15.49:0/3979221743 wait complete. 2023-07-21T22:12:00.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.648+0000 7f176cdbf700 1 Processor -- start 2023-07-21T22:12:00.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.648+0000 7f176cdbf700 1 -- start start 2023-07-21T22:12:00.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.648+0000 7f176cdbf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17680ab8d0 0x7f17680c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:00.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.648+0000 7f176cdbf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17680cb800 0x7f17681f1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:00.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.648+0000 7f176cdbf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f176815c0a0 0x7f17680af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:00.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.648+0000 7f176cdbf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17680c65c0 con 0x7f17680cb800 2023-07-21T22:12:00.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.648+0000 7f176cdbf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17680c29e0 con 0x7f17680ab8d0 2023-07-21T22:12:00.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.648+0000 7f176cdbf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17680c2cc0 con 0x7f176815c0a0 2023-07-21T22:12:00.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f176659c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17680ab8d0 0x7f17680c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:00.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f1765d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17680cb800 0x7f17681f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:00.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f176659c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17680ab8d0 0x7f17680c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:58440/0 (socket says 172.21.15.49:58440) 2023-07-21T22:12:00.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f176659c700 1 -- 172.21.15.49:0/343928370 learned_addr learned my addr 172.21.15.49:0/343928370 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:00.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f1766d9d700 1 --2- 172.21.15.49:0/343928370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f176815c0a0 0x7f17680af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:00.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f1765d9b700 1 -- 172.21.15.49:0/343928370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f176815c0a0 msgr2=0x7f17680af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f1765d9b700 1 --2- 172.21.15.49:0/343928370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f176815c0a0 0x7f17680af4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f1765d9b700 1 -- 172.21.15.49:0/343928370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17680ab8d0 msgr2=0x7f17680c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f1765d9b700 1 --2- 172.21.15.49:0/343928370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17680ab8d0 0x7f17680c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f1765d9b700 1 -- 172.21.15.49:0/343928370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c0094b0 con 0x7f17680cb800 2023-07-21T22:12:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f176659c700 1 --2- 172.21.15.49:0/343928370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17680ab8d0 0x7f17680c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f1765d9b700 1 --2- 172.21.15.49:0/343928370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17680cb800 0x7f17681f1260 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f175c016000 tx=0x7f175c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:00.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f1756ffd700 1 -- 172.21.15.49:0/343928370 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c004550 con 0x7f17680cb800 2023-07-21T22:12:00.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f1756ffd700 1 -- 172.21.15.49:0/343928370 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c01e070 con 0x7f17680cb800 2023-07-21T22:12:00.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f176cdbf700 1 -- 172.21.15.49:0/343928370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17680c2fa0 con 0x7f17680cb800 2023-07-21T22:12:00.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f1756ffd700 1 -- 172.21.15.49:0/343928370 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0038e0 con 0x7f17680cb800 2023-07-21T22:12:00.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.652+0000 7f176cdbf700 1 -- 172.21.15.49:0/343928370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17680c61c0 con 0x7f17680cb800 2023-07-21T22:12:00.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.656+0000 7f176cdbf700 1 -- 172.21.15.49:0/343928370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17680c6a50 con 0x7f17680cb800 2023-07-21T22:12:00.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.656+0000 7f1756ffd700 1 -- 172.21.15.49:0/343928370 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f175c003a40 con 0x7f17680cb800 2023-07-21T22:12:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.660+0000 7f1756ffd700 1 --2- 172.21.15.49:0/343928370 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17480662f0 0x7f17480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.660+0000 7f1756ffd700 1 -- 172.21.15.49:0/343928370 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f175c085420 con 0x7f17680cb800 2023-07-21T22:12:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.660+0000 7f176659c700 1 --2- 172.21.15.49:0/343928370 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17480662f0 0x7f17480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:00.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.660+0000 7f176659c700 1 --2- 172.21.15.49:0/343928370 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17480662f0 0x7f17480687a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1758001d30 tx=0x7f1758009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.664+0000 7f1756ffd700 1 -- 172.21.15.49:0/343928370 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f17680c6a50 con 0x7f17680cb800 2023-07-21T22:12:00.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.848+0000 7f176cdbf700 1 -- 172.21.15.49:0/343928370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f17680c6a50 con 0x7f17680cb800 2023-07-21T22:12:00.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.848+0000 7f1756ffd700 1 -- 172.21.15.49:0/343928370 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7f17680c6a50 con 0x7f17680cb800 2023-07-21T22:12:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.852+0000 7f176cdbf700 1 -- 172.21.15.49:0/343928370 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17480662f0 msgr2=0x7f17480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.852+0000 7f176cdbf700 1 --2- 172.21.15.49:0/343928370 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17480662f0 0x7f17480687a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1758001d30 tx=0x7f1758009040 comp rx=0 tx=0).stop 2023-07-21T22:12:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.852+0000 7f176cdbf700 1 -- 172.21.15.49:0/343928370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17680cb800 msgr2=0x7f17681f1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.852+0000 7f176cdbf700 1 --2- 172.21.15.49:0/343928370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17680cb800 0x7f17681f1260 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f175c016000 tx=0x7f175c004770 comp rx=0 tx=0).stop 2023-07-21T22:12:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.852+0000 7f176cdbf700 1 -- 172.21.15.49:0/343928370 shutdown_connections 2023-07-21T22:12:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.852+0000 7f176cdbf700 1 --2- 172.21.15.49:0/343928370 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f17480662f0 0x7f17480687a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.852+0000 7f176cdbf700 1 --2- 172.21.15.49:0/343928370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17680cb800 0x7f17681f1260 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.852+0000 7f176cdbf700 1 --2- 172.21.15.49:0/343928370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f176815c0a0 0x7f17680af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.852+0000 7f176cdbf700 1 --2- 172.21.15.49:0/343928370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17680ab8d0 0x7f17680c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.852+0000 7f176cdbf700 1 -- 172.21.15.49:0/343928370 >> 172.21.15.49:0/343928370 conn(0x7f176806f5a0 msgr2=0x7f176806d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.852+0000 7f176cdbf700 1 -- 172.21.15.49:0/343928370 shutdown_connections 2023-07-21T22:12:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:00.852+0000 7f176cdbf700 1 -- 172.21.15.49:0/343928370 wait complete. 2023-07-21T22:12:00.900 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:12:00.919 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:12:00.919 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:12:00.937 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:12:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.072+0000 7fd67d400700 1 Processor -- start 2023-07-21T22:12:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.072+0000 7fd67d400700 1 -- start start 2023-07-21T22:12:01.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.072+0000 7fd67d400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd67806d630 0x7fd67806e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.072+0000 7fd67d400700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd678070d30 0x7fd67806da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.072+0000 7fd67d400700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67815d610 con 0x7fd6780cbbd0 2023-07-21T22:12:01.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.072+0000 7fd67d400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67815deb0 con 0x7fd67806d630 2023-07-21T22:12:01.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.072+0000 7fd67d400700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67806df40 con 0x7fd678070d30 2023-07-21T22:12:01.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd676ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd67806d630 0x7fd67806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd676ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd67806d630 0x7fd67806e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39064/0 (socket says 172.21.15.49:39064) 2023-07-21T22:12:01.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd676ffd700 1 -- 172.21.15.49:0/2838856353 learned_addr learned my addr 172.21.15.49:0/2838856353 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:01.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd66ffff700 1 --2- 172.21.15.49:0/2838856353 >> v2:172.21.15.150:3300/0 conn(0x7fd678070d30 0x7fd67806da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd676ffd700 1 -- 172.21.15.49:0/2838856353 >> v2:172.21.15.150:3300/0 conn(0x7fd678070d30 msgr2=0x7fd67806da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:01.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd676ffd700 1 --2- 172.21.15.49:0/2838856353 >> v2:172.21.15.150:3300/0 conn(0x7fd678070d30 0x7fd67806da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd676ffd700 1 -- 172.21.15.49:0/2838856353 >> v1:172.21.15.150:6789/0 conn(0x7fd6780cbbd0 legacy=0x7fd6780b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd676ffd700 1 -- 172.21.15.49:0/2838856353 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6780cc0b0 con 0x7fd67806d630 2023-07-21T22:12:01.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd676ffd700 1 --2- 172.21.15.49:0/2838856353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd67806d630 0x7fd67806e960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd6780cd1e0 tx=0x7fd668009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f57329e4e1d77c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:01.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd6767fc700 1 -- 172.21.15.49:0/2838856353 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668011830 con 0x7fd67806d630 2023-07-21T22:12:01.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd6767fc700 1 -- 172.21.15.49:0/2838856353 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd668011990 con 0x7fd67806d630 2023-07-21T22:12:01.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd6767fc700 1 -- 172.21.15.49:0/2838856353 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668011d20 con 0x7fd67806d630 2023-07-21T22:12:01.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd67d400700 1 -- 172.21.15.49:0/2838856353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd67806d630 msgr2=0x7fd67806e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd67d400700 1 --2- 172.21.15.49:0/2838856353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd67806d630 0x7fd67806e960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd6780cd1e0 tx=0x7fd668009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd67d400700 1 -- 172.21.15.49:0/2838856353 shutdown_connections 2023-07-21T22:12:01.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd67d400700 1 --2- 172.21.15.49:0/2838856353 >> v2:172.21.15.150:3300/0 conn(0x7fd678070d30 0x7fd67806da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd67d400700 1 --2- 172.21.15.49:0/2838856353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd67806d630 0x7fd67806e960 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd67d400700 1 -- 172.21.15.49:0/2838856353 >> 172.21.15.49:0/2838856353 conn(0x7fd6780cc430 msgr2=0x7fd6780cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:01.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd67d400700 1 -- 172.21.15.49:0/2838856353 shutdown_connections 2023-07-21T22:12:01.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.076+0000 7fd67d400700 1 -- 172.21.15.49:0/2838856353 wait complete. 2023-07-21T22:12:01.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.080+0000 7fd67d400700 1 Processor -- start 2023-07-21T22:12:01.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.080+0000 7fd67d400700 1 -- start start 2023-07-21T22:12:01.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.080+0000 7fd67d400700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd67806d630 0x7fd6780c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.080+0000 7fd67d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd678070d30 0x7fd678159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.080+0000 7fd67d400700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6780cbbd0 0x7fd6780c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.080+0000 7fd67d400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6780b1a90 con 0x7fd678070d30 2023-07-21T22:12:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.080+0000 7fd67d400700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6780b0630 con 0x7fd67806d630 2023-07-21T22:12:01.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.080+0000 7fd67d400700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6780b0020 con 0x7fd6780cbbd0 2023-07-21T22:12:01.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd678070d30 0x7fd678159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd678070d30 0x7fd678159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39072/0 (socket says 172.21.15.49:39072) 2023-07-21T22:12:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd66ffff700 1 -- 172.21.15.49:0/4165908148 learned_addr learned my addr 172.21.15.49:0/4165908148 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd676ffd700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd67806d630 0x7fd6780c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd677fff700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6780cbbd0 0x7fd6780c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd66ffff700 1 -- 172.21.15.49:0/4165908148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6780cbbd0 msgr2=0x7fd6780c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd66ffff700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6780cbbd0 0x7fd6780c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd66ffff700 1 -- 172.21.15.49:0/4165908148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd67806d630 msgr2=0x7fd6780c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd66ffff700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd67806d630 0x7fd6780c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd66ffff700 1 -- 172.21.15.49:0/4165908148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd668009570 con 0x7fd678070d30 2023-07-21T22:12:01.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd676ffd700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd67806d630 0x7fd6780c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:01.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd66ffff700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd678070d30 0x7fd678159070 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd66000e9b0 tx=0x7fd66000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:01.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd66f7fe700 1 -- 172.21.15.49:0/4165908148 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660009710 con 0x7fd678070d30 2023-07-21T22:12:01.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd66f7fe700 1 -- 172.21.15.49:0/4165908148 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66000ee50 con 0x7fd678070d30 2023-07-21T22:12:01.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd66f7fe700 1 -- 172.21.15.49:0/4165908148 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66000ca50 con 0x7fd678070d30 2023-07-21T22:12:01.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd67d400700 1 -- 172.21.15.49:0/4165908148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6780b1ce0 con 0x7fd678070d30 2023-07-21T22:12:01.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.084+0000 7fd67d400700 1 -- 172.21.15.49:0/4165908148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6780b02c0 con 0x7fd678070d30 2023-07-21T22:12:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.088+0000 7fd67d400700 1 -- 172.21.15.49:0/4165908148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6780b07a0 con 0x7fd678070d30 2023-07-21T22:12:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.088+0000 7fd66f7fe700 1 -- 172.21.15.49:0/4165908148 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd66000cbb0 con 0x7fd678070d30 2023-07-21T22:12:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.088+0000 7fd66f7fe700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd658066320 0x7fd6580687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.088+0000 7fd66f7fe700 1 -- 172.21.15.49:0/4165908148 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd660084370 con 0x7fd678070d30 2023-07-21T22:12:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.088+0000 7fd676ffd700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd658066320 0x7fd6580687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.092+0000 7fd676ffd700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd658066320 0x7fd6580687d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd668009c30 tx=0x7fd668008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:01.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.096+0000 7fd66f7fe700 1 -- 172.21.15.49:0/4165908148 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd660054f50 con 0x7fd678070d30 2023-07-21T22:12:01.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.280+0000 7fd67d400700 1 -- 172.21.15.49:0/4165908148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd67804dcb0 con 0x7fd678070d30 2023-07-21T22:12:01.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.284+0000 7fd66f7fe700 1 -- 172.21.15.49:0/4165908148 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7fd66000ce60 con 0x7fd678070d30 2023-07-21T22:12:01.328 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:01.328 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:12:01.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.288+0000 7fd67d400700 1 -- 172.21.15.49:0/4165908148 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd658066320 msgr2=0x7fd6580687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.288+0000 7fd67d400700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd658066320 0x7fd6580687d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd668009c30 tx=0x7fd668008030 comp rx=0 tx=0).stop 2023-07-21T22:12:01.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.288+0000 7fd67d400700 1 -- 172.21.15.49:0/4165908148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd678070d30 msgr2=0x7fd678159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.288+0000 7fd67d400700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd678070d30 0x7fd678159070 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd66000e9b0 tx=0x7fd66000ecc0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.288+0000 7fd67d400700 1 -- 172.21.15.49:0/4165908148 shutdown_connections 2023-07-21T22:12:01.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.288+0000 7fd67d400700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd658066320 0x7fd6580687d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.288+0000 7fd67d400700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd678070d30 0x7fd678159070 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.288+0000 7fd67d400700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6780cbbd0 0x7fd6780c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.288+0000 7fd67d400700 1 --2- 172.21.15.49:0/4165908148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd67806d630 0x7fd6780c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.288+0000 7fd67d400700 1 -- 172.21.15.49:0/4165908148 >> 172.21.15.49:0/4165908148 conn(0x7fd6780cc430 msgr2=0x7fd6780cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:01.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.288+0000 7fd67d400700 1 -- 172.21.15.49:0/4165908148 shutdown_connections 2023-07-21T22:12:01.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.288+0000 7fd67d400700 1 -- 172.21.15.49:0/4165908148 wait complete. 2023-07-21T22:12:01.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:12:01.352 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:12:01.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.496+0000 7f78f42bc700 1 Processor -- start 2023-07-21T22:12:01.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.496+0000 7f78f42bc700 1 -- start start 2023-07-21T22:12:01.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f42bc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ec0cabe0 0x7f78ec0cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f42bc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f78ec15f9d0 0x7f78ec15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f42bc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec0c88c0 con 0x7f78ec0ce120 2023-07-21T22:12:01.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f42bc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ec15c220 con 0x7f78ec15f9d0 2023-07-21T22:12:01.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f42bc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0ca620 con 0x7f78ec0cabe0 2023-07-21T22:12:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f1857700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f78ec15f9d0 0x7f78ec15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f1857700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f78ec15f9d0 0x7f78ec15fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39080/0 (socket says 172.21.15.49:39080) 2023-07-21T22:12:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f2859700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f78ec0ce120 0x7f78ec0ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40872/0 (socket says 172.21.15.49:40872) 2023-07-21T22:12:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f1857700 1 -- 172.21.15.49:0/1794908708 learned_addr learned my addr 172.21.15.49:0/1794908708 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:01.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f2058700 1 --2- 172.21.15.49:0/1794908708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ec0cabe0 0x7f78ec0cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f1857700 1 -- 172.21.15.49:0/1794908708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ec0cabe0 msgr2=0x7f78ec0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:01.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f1857700 1 --2- 172.21.15.49:0/1794908708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ec0cabe0 0x7f78ec0cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f1857700 1 -- 172.21.15.49:0/1794908708 >> v1:172.21.15.49:6789/0 conn(0x7f78ec0ce120 legacy=0x7f78ec0ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f1857700 1 -- 172.21.15.49:0/1794908708 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec0cb4f0 con 0x7f78ec15f9d0 2023-07-21T22:12:01.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f1056700 1 -- 172.21.15.49:0/1794908708 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600985540 0 0) 0x7f78ec0c88c0 con 0x7f78ec0ce120 2023-07-21T22:12:01.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f2058700 1 --2- 172.21.15.49:0/1794908708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ec0cabe0 0x7f78ec0cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:01.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f1857700 1 --2- 172.21.15.49:0/1794908708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78ec15f9d0 0x7f78ec15fe20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009940 tx=0x7f78dc009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440c73628aa60e5f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:01.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f1056700 1 -- 172.21.15.49:0/1794908708 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc005e50 con 0x7f78ec15f9d0 2023-07-21T22:12:01.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f1056700 1 -- 172.21.15.49:0/1794908708 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc009e90 con 0x7f78ec15f9d0 2023-07-21T22:12:01.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f1056700 1 -- 172.21.15.49:0/1794908708 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc00b830 con 0x7f78ec15f9d0 2023-07-21T22:12:01.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f42bc700 1 -- 172.21.15.49:0/1794908708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78ec15f9d0 msgr2=0x7f78ec15fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.500+0000 7f78f42bc700 1 --2- 172.21.15.49:0/1794908708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78ec15f9d0 0x7f78ec15fe20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009940 tx=0x7f78dc009c50 comp rx=0 tx=0).stop 2023-07-21T22:12:01.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.504+0000 7f78f42bc700 1 -- 172.21.15.49:0/1794908708 shutdown_connections 2023-07-21T22:12:01.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.504+0000 7f78f42bc700 1 --2- 172.21.15.49:0/1794908708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78ec15f9d0 0x7f78ec15fe20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.504+0000 7f78f42bc700 1 --2- 172.21.15.49:0/1794908708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ec0cabe0 0x7f78ec0cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.504+0000 7f78f42bc700 1 -- 172.21.15.49:0/1794908708 >> 172.21.15.49:0/1794908708 conn(0x7f78ec06e960 msgr2=0x7f78ec06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:01.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.504+0000 7f78f42bc700 1 -- 172.21.15.49:0/1794908708 shutdown_connections 2023-07-21T22:12:01.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.504+0000 7f78f42bc700 1 -- 172.21.15.49:0/1794908708 wait complete. 2023-07-21T22:12:01.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f42bc700 1 Processor -- start 2023-07-21T22:12:01.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f42bc700 1 -- start start 2023-07-21T22:12:01.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f42bc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78ec0cabe0 0x7f78ec0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f42bc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ec0ce120 0x7f78ec148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f42bc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78ec15f9d0 0x7f78ec0b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f42bc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0b0c00 con 0x7f78ec15f9d0 2023-07-21T22:12:01.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f42bc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0c7700 con 0x7f78ec0cabe0 2023-07-21T22:12:01.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f42bc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0c79e0 con 0x7f78ec0ce120 2023-07-21T22:12:01.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f2859700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78ec15f9d0 0x7f78ec0b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f2859700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78ec15f9d0 0x7f78ec0b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39090/0 (socket says 172.21.15.49:39090) 2023-07-21T22:12:01.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f2859700 1 -- 172.21.15.49:0/3815428526 learned_addr learned my addr 172.21.15.49:0/3815428526 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:01.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f2058700 1 --2- 172.21.15.49:0/3815428526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78ec0cabe0 0x7f78ec0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f1857700 1 --2- 172.21.15.49:0/3815428526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ec0ce120 0x7f78ec148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f2859700 1 -- 172.21.15.49:0/3815428526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ec0ce120 msgr2=0x7f78ec148580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f2859700 1 --2- 172.21.15.49:0/3815428526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ec0ce120 0x7f78ec148580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f2859700 1 -- 172.21.15.49:0/3815428526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78ec0cabe0 msgr2=0x7f78ec0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f2859700 1 --2- 172.21.15.49:0/3815428526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78ec0cabe0 0x7f78ec0c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.508+0000 7f78f2859700 1 -- 172.21.15.49:0/3815428526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc009520 con 0x7f78ec15f9d0 2023-07-21T22:12:01.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.512+0000 7f78f2859700 1 --2- 172.21.15.49:0/3815428526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78ec15f9d0 0x7f78ec0b06c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f78e400cb60 tx=0x7f78e400ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:01.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.512+0000 7f78e2ffd700 1 -- 172.21.15.49:0/3815428526 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e400aaa0 con 0x7f78ec15f9d0 2023-07-21T22:12:01.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.512+0000 7f78e2ffd700 1 -- 172.21.15.49:0/3815428526 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e400ac00 con 0x7f78ec15f9d0 2023-07-21T22:12:01.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.512+0000 7f78f42bc700 1 -- 172.21.15.49:0/3815428526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec0c7cc0 con 0x7f78ec15f9d0 2023-07-21T22:12:01.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.512+0000 7f78e2ffd700 1 -- 172.21.15.49:0/3815428526 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e40070d0 con 0x7f78ec15f9d0 2023-07-21T22:12:01.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.512+0000 7f78f42bc700 1 -- 172.21.15.49:0/3815428526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec0c8280 con 0x7f78ec15f9d0 2023-07-21T22:12:01.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.512+0000 7f78f42bc700 1 -- 172.21.15.49:0/3815428526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ec04dd50 con 0x7f78ec15f9d0 2023-07-21T22:12:01.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.516+0000 7f78e2ffd700 1 -- 172.21.15.49:0/3815428526 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78e4007230 con 0x7f78ec15f9d0 2023-07-21T22:12:01.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.516+0000 7f78e2ffd700 1 --2- 172.21.15.49:0/3815428526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f78d00662f0 0x7f78d00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.516+0000 7f78e2ffd700 1 -- 172.21.15.49:0/3815428526 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f78e4083c40 con 0x7f78ec15f9d0 2023-07-21T22:12:01.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.516+0000 7f78f2058700 1 --2- 172.21.15.49:0/3815428526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f78d00662f0 0x7f78d00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.520+0000 7f78f2058700 1 --2- 172.21.15.49:0/3815428526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f78d00662f0 0x7f78d00687a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f78e80044b0 tx=0x7f78e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:01.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.524+0000 7f78e2ffd700 1 -- 172.21.15.49:0/3815428526 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78e4050c60 con 0x7f78ec15f9d0 2023-07-21T22:12:01.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.696+0000 7f78f42bc700 1 -- 172.21.15.49:0/3815428526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78ec0adcd0 con 0x7f78ec15f9d0 2023-07-21T22:12:01.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.700+0000 7f78e2ffd700 1 -- 172.21.15.49:0/3815428526 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78e4054280 con 0x7f78ec15f9d0 2023-07-21T22:12:01.743 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:12:01.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.700+0000 7f78f42bc700 1 -- 172.21.15.49:0/3815428526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f78d00662f0 msgr2=0x7f78d00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.700+0000 7f78f42bc700 1 --2- 172.21.15.49:0/3815428526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f78d00662f0 0x7f78d00687a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f78e80044b0 tx=0x7f78e8008040 comp rx=0 tx=0).stop 2023-07-21T22:12:01.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.700+0000 7f78f42bc700 1 -- 172.21.15.49:0/3815428526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78ec15f9d0 msgr2=0x7f78ec0b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.700+0000 7f78f42bc700 1 --2- 172.21.15.49:0/3815428526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78ec15f9d0 0x7f78ec0b06c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f78e400cb60 tx=0x7f78e400ce70 comp rx=0 tx=0).stop 2023-07-21T22:12:01.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.700+0000 7f78f42bc700 1 -- 172.21.15.49:0/3815428526 shutdown_connections 2023-07-21T22:12:01.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.700+0000 7f78f42bc700 1 --2- 172.21.15.49:0/3815428526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f78d00662f0 0x7f78d00687a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.700+0000 7f78f42bc700 1 --2- 172.21.15.49:0/3815428526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78ec15f9d0 0x7f78ec0b06c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.700+0000 7f78f42bc700 1 --2- 172.21.15.49:0/3815428526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ec0ce120 0x7f78ec148580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.700+0000 7f78f42bc700 1 --2- 172.21.15.49:0/3815428526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78ec0cabe0 0x7f78ec0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.700+0000 7f78f42bc700 1 -- 172.21.15.49:0/3815428526 >> 172.21.15.49:0/3815428526 conn(0x7f78ec06e960 msgr2=0x7f78ec0ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.700+0000 7f78f42bc700 1 -- 172.21.15.49:0/3815428526 shutdown_connections 2023-07-21T22:12:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.704+0000 7f78f42bc700 1 -- 172.21.15.49:0/3815428526 wait complete. 2023-07-21T22:12:01.768 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:12:01.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.908+0000 7f4258882700 1 Processor -- start 2023-07-21T22:12:01.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.908+0000 7f4258882700 1 -- start start 2023-07-21T22:12:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.912+0000 7f4258882700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f42541564c0 0x7f42540cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.912+0000 7f4258882700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425415d3e0 con 0x7f425415cfa0 2023-07-21T22:12:01.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.912+0000 7f4258882700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42540c8bd0 con 0x7f42540c9990 2023-07-21T22:12:01.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.912+0000 7f4258882700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42540c9570 con 0x7f42541564c0 2023-07-21T22:12:01.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.912+0000 7f425259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f42541564c0 0x7f42540cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.912+0000 7f4252d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f425415cfa0 0x7f425406d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40888/0 (socket says 172.21.15.49:40888) 2023-07-21T22:12:01.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.912+0000 7f425259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f42541564c0 0x7f42540cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39098/0 (socket says 172.21.15.49:39098) 2023-07-21T22:12:01.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.912+0000 7f4252d9d700 1 -- 172.21.15.49:0/3705501422 learned_addr learned my addr 172.21.15.49:0/3705501422 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:01.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.912+0000 7f425259c700 1 -- 172.21.15.49:0/3705501422 >> v1:172.21.15.150:6789/0 conn(0x7f42540c9990 legacy=0x7f425415c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.912+0000 7f425259c700 1 -- 172.21.15.49:0/3705501422 >> v1:172.21.15.49:6789/0 conn(0x7f425415cfa0 legacy=0x7f425406d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.912+0000 7f425259c700 1 -- 172.21.15.49:0/3705501422 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42540c8eb0 con 0x7f42541564c0 2023-07-21T22:12:01.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.916+0000 7f425259c700 1 --2- 172.21.15.49:0/3705501422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42541564c0 0x7f42540cdf40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4244009850 tx=0x7f4244009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7862b2bb4e2c829 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:01.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.916+0000 7f425159a700 1 -- 172.21.15.49:0/3705501422 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244011830 con 0x7f42541564c0 2023-07-21T22:12:01.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.916+0000 7f425159a700 1 -- 172.21.15.49:0/3705501422 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4244011990 con 0x7f42541564c0 2023-07-21T22:12:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.916+0000 7f425159a700 1 -- 172.21.15.49:0/3705501422 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244011d20 con 0x7f42541564c0 2023-07-21T22:12:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.916+0000 7f4258882700 1 -- 172.21.15.49:0/3705501422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42541564c0 msgr2=0x7f42540cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.916+0000 7f4258882700 1 --2- 172.21.15.49:0/3705501422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42541564c0 0x7f42540cdf40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4244009850 tx=0x7f4244009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.916+0000 7f4258882700 1 -- 172.21.15.49:0/3705501422 shutdown_connections 2023-07-21T22:12:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.916+0000 7f4258882700 1 --2- 172.21.15.49:0/3705501422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42541564c0 0x7f42540cdf40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.916+0000 7f4258882700 1 -- 172.21.15.49:0/3705501422 >> 172.21.15.49:0/3705501422 conn(0x7f425406e960 msgr2=0x7f425406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:01.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.916+0000 7f4258882700 1 -- 172.21.15.49:0/3705501422 shutdown_connections 2023-07-21T22:12:01.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.916+0000 7f4258882700 1 -- 172.21.15.49:0/3705501422 wait complete. 2023-07-21T22:12:01.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f4258882700 1 Processor -- start 2023-07-21T22:12:01.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f4258882700 1 -- start start 2023-07-21T22:12:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f4258882700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42540c9990 0x7f4254156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f4258882700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42541564c0 0x7f42540b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f4258882700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f425415cfa0 0x7f42540b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f4258882700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42541f19f0 con 0x7f42540c9990 2023-07-21T22:12:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f4258882700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4254157580 con 0x7f42541564c0 2023-07-21T22:12:01.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f4258882700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4254157860 con 0x7f425415cfa0 2023-07-21T22:12:01.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f425259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42540c9990 0x7f4254156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f425259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42540c9990 0x7f4254156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39112/0 (socket says 172.21.15.49:39112) 2023-07-21T22:12:01.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f425259c700 1 -- 172.21.15.49:0/1760123145 learned_addr learned my addr 172.21.15.49:0/1760123145 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:01.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f4252d9d700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f425415cfa0 0x7f42540b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f4251d9b700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42541564c0 0x7f42540b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f425259c700 1 -- 172.21.15.49:0/1760123145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f425415cfa0 msgr2=0x7f42540b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f425259c700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f425415cfa0 0x7f42540b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f425259c700 1 -- 172.21.15.49:0/1760123145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42541564c0 msgr2=0x7f42540b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:01.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f425259c700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42541564c0 0x7f42540b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:01.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f425259c700 1 -- 172.21.15.49:0/1760123145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440094b0 con 0x7f42540c9990 2023-07-21T22:12:01.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f4252d9d700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f425415cfa0 0x7f42540b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:01.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f425259c700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42540c9990 0x7f4254156bc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4254159020 tx=0x7f4244004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:01.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f4242ffd700 1 -- 172.21.15.49:0/1760123145 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42440038c0 con 0x7f42540c9990 2023-07-21T22:12:01.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f4242ffd700 1 -- 172.21.15.49:0/1760123145 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4244003a20 con 0x7f42540c9990 2023-07-21T22:12:01.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.920+0000 7f4258882700 1 -- 172.21.15.49:0/1760123145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4254157b40 con 0x7f42540c9990 2023-07-21T22:12:01.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.924+0000 7f4242ffd700 1 -- 172.21.15.49:0/1760123145 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244003dd0 con 0x7f42540c9990 2023-07-21T22:12:01.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.924+0000 7f4258882700 1 -- 172.21.15.49:0/1760123145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4254158100 con 0x7f42540c9990 2023-07-21T22:12:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.924+0000 7f4258882700 1 -- 172.21.15.49:0/1760123145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425404dd50 con 0x7f42540c9990 2023-07-21T22:12:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.924+0000 7f4242ffd700 1 -- 172.21.15.49:0/1760123145 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f424401a430 con 0x7f42540c9990 2023-07-21T22:12:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.928+0000 7f4242ffd700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f42340662f0 0x7f42340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.928+0000 7f4242ffd700 1 -- 172.21.15.49:0/1760123145 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4244021030 con 0x7f42540c9990 2023-07-21T22:12:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.928+0000 7f4251d9b700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f42340662f0 0x7f42340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:01.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.928+0000 7f4251d9b700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f42340662f0 0x7f42340687a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f42540cef60 tx=0x7f4248009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:01.932+0000 7f4242ffd700 1 -- 172.21.15.49:0/1760123145 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4244052a70 con 0x7f42540c9990 2023-07-21T22:12:02.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.100+0000 7f4258882700 1 -- 172.21.15.49:0/1760123145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f42540b4070 con 0x7f42540c9990 2023-07-21T22:12:02.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.104+0000 7f4242ffd700 1 -- 172.21.15.49:0/1760123145 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4244056090 con 0x7f42540c9990 2023-07-21T22:12:02.147 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:12:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.104+0000 7f4258882700 1 -- 172.21.15.49:0/1760123145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f42340662f0 msgr2=0x7f42340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.104+0000 7f4258882700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f42340662f0 0x7f42340687a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f42540cef60 tx=0x7f4248009040 comp rx=0 tx=0).stop 2023-07-21T22:12:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.104+0000 7f4258882700 1 -- 172.21.15.49:0/1760123145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42540c9990 msgr2=0x7f4254156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.104+0000 7f4258882700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42540c9990 0x7f4254156bc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4254159020 tx=0x7f4244004770 comp rx=0 tx=0).stop 2023-07-21T22:12:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.104+0000 7f4258882700 1 -- 172.21.15.49:0/1760123145 shutdown_connections 2023-07-21T22:12:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.104+0000 7f4258882700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f42340662f0 0x7f42340687a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.104+0000 7f4258882700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f425415cfa0 0x7f42540b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.104+0000 7f4258882700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42541564c0 0x7f42540b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.104+0000 7f4258882700 1 --2- 172.21.15.49:0/1760123145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42540c9990 0x7f4254156bc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.104+0000 7f4258882700 1 -- 172.21.15.49:0/1760123145 >> 172.21.15.49:0/1760123145 conn(0x7f425406e960 msgr2=0x7f4254070690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:02.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.104+0000 7f4258882700 1 -- 172.21.15.49:0/1760123145 shutdown_connections 2023-07-21T22:12:02.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.104+0000 7f4258882700 1 -- 172.21.15.49:0/1760123145 wait complete. 2023-07-21T22:12:02.172 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:12:02.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.304+0000 7f07b3e25700 1 Processor -- start 2023-07-21T22:12:02.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.304+0000 7f07b3e25700 1 -- start start 2023-07-21T22:12:02.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b3e25700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f07ac071220 0x7f07ac0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:02.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b3e25700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07ac071670 0x7f07ac0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:02.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b3e25700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ac0cdf00 con 0x7f07ac160110 2023-07-21T22:12:02.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b3e25700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ac0cd730 con 0x7f07ac071670 2023-07-21T22:12:02.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b3e25700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ac0ce600 con 0x7f07ac071220 2023-07-21T22:12:02.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b23c2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07ac071670 0x7f07ac0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:02.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b23c2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07ac071670 0x7f07ac0cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39126/0 (socket says 172.21.15.49:39126) 2023-07-21T22:12:02.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b23c2700 1 -- 172.21.15.49:0/4159637949 learned_addr learned my addr 172.21.15.49:0/4159637949 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:02.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b13c0700 1 --2- 172.21.15.49:0/4159637949 >> v2:172.21.15.150:3300/0 conn(0x7f07ac071220 0x7f07ac0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:02.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b23c2700 1 -- 172.21.15.49:0/4159637949 >> v2:172.21.15.150:3300/0 conn(0x7f07ac071220 msgr2=0x7f07ac0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:02.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b23c2700 1 --2- 172.21.15.49:0/4159637949 >> v2:172.21.15.150:3300/0 conn(0x7f07ac071220 0x7f07ac0cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b23c2700 1 -- 172.21.15.49:0/4159637949 >> v1:172.21.15.150:6789/0 conn(0x7f07ac160110 legacy=0x7f07ac0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:02.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b23c2700 1 -- 172.21.15.49:0/4159637949 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac06e190 con 0x7f07ac071670 2023-07-21T22:12:02.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b23c2700 1 --2- 172.21.15.49:0/4159637949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac071670 0x7f07ac0cb120 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0afcf0 tx=0x7f07a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f7f7c39f78672f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:02.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b0bbf700 1 -- 172.21.15.49:0/4159637949 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400e070 con 0x7f07ac071670 2023-07-21T22:12:02.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b0bbf700 1 -- 172.21.15.49:0/4159637949 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a400b910 con 0x7f07ac071670 2023-07-21T22:12:02.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.308+0000 7f07b0bbf700 1 -- 172.21.15.49:0/4159637949 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400bcc0 con 0x7f07ac071670 2023-07-21T22:12:02.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.312+0000 7f07b3e25700 1 -- 172.21.15.49:0/4159637949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac071670 msgr2=0x7f07ac0cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:02.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.312+0000 7f07b3e25700 1 --2- 172.21.15.49:0/4159637949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac071670 0x7f07ac0cb120 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0afcf0 tx=0x7f07a400b330 comp rx=0 tx=0).stop 2023-07-21T22:12:02.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.312+0000 7f07b3e25700 1 -- 172.21.15.49:0/4159637949 shutdown_connections 2023-07-21T22:12:02.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.312+0000 7f07b3e25700 1 --2- 172.21.15.49:0/4159637949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac071670 0x7f07ac0cb120 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.312+0000 7f07b3e25700 1 --2- 172.21.15.49:0/4159637949 >> v2:172.21.15.150:3300/0 conn(0x7f07ac071220 0x7f07ac0cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.312+0000 7f07b3e25700 1 -- 172.21.15.49:0/4159637949 >> 172.21.15.49:0/4159637949 conn(0x7f07ac06e960 msgr2=0x7f07ac06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:02.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.312+0000 7f07b3e25700 1 -- 172.21.15.49:0/4159637949 shutdown_connections 2023-07-21T22:12:02.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.312+0000 7f07b3e25700 1 -- 172.21.15.49:0/4159637949 wait complete. 2023-07-21T22:12:02.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.316+0000 7f07b3e25700 1 Processor -- start 2023-07-21T22:12:02.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.316+0000 7f07b3e25700 1 -- start start 2023-07-21T22:12:02.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.316+0000 7f07b3e25700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07ac071220 0x7f07ac0adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:02.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.316+0000 7f07b3e25700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07ac071670 0x7f07ac0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:02.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.316+0000 7f07b3e25700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac160110 0x7f07ac157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.316+0000 7f07b3e25700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0c5d20 con 0x7f07ac160110 2023-07-21T22:12:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.316+0000 7f07b3e25700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0c6000 con 0x7f07ac071670 2023-07-21T22:12:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.316+0000 7f07b3e25700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0c62e0 con 0x7f07ac071220 2023-07-21T22:12:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.316+0000 7f07b23c2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac160110 0x7f07ac157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.316+0000 7f07b23c2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac160110 0x7f07ac157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39136/0 (socket says 172.21.15.49:39136) 2023-07-21T22:12:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.316+0000 7f07b23c2700 1 -- 172.21.15.49:0/3439341801 learned_addr learned my addr 172.21.15.49:0/3439341801 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.316+0000 7f07b1bc1700 1 --2- 172.21.15.49:0/3439341801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07ac071220 0x7f07ac0adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.316+0000 7f07b13c0700 1 --2- 172.21.15.49:0/3439341801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07ac071670 0x7f07ac0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:02.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.320+0000 7f07b23c2700 1 -- 172.21.15.49:0/3439341801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07ac071220 msgr2=0x7f07ac0adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:02.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.320+0000 7f07b23c2700 1 --2- 172.21.15.49:0/3439341801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07ac071220 0x7f07ac0adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.320+0000 7f07b23c2700 1 -- 172.21.15.49:0/3439341801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07ac071670 msgr2=0x7f07ac0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:02.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.320+0000 7f07b23c2700 1 --2- 172.21.15.49:0/3439341801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07ac071670 0x7f07ac0c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.320+0000 7f07b23c2700 1 -- 172.21.15.49:0/3439341801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a4009b30 con 0x7f07ac160110 2023-07-21T22:12:02.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.320+0000 7f07b23c2700 1 --2- 172.21.15.49:0/3439341801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac160110 0x7f07ac157400 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f07a400b370 tx=0x7f07a4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:02.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.320+0000 7f07a27fc700 1 -- 172.21.15.49:0/3439341801 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4004880 con 0x7f07ac160110 2023-07-21T22:12:02.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.320+0000 7f07a27fc700 1 -- 172.21.15.49:0/3439341801 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a40099b0 con 0x7f07ac160110 2023-07-21T22:12:02.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.320+0000 7f07a27fc700 1 -- 172.21.15.49:0/3439341801 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a401c680 con 0x7f07ac160110 2023-07-21T22:12:02.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.320+0000 7f07b3e25700 1 -- 172.21.15.49:0/3439341801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ac0c65c0 con 0x7f07ac160110 2023-07-21T22:12:02.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.320+0000 7f07b3e25700 1 -- 172.21.15.49:0/3439341801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ac159230 con 0x7f07ac160110 2023-07-21T22:12:02.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.320+0000 7f07b3e25700 1 -- 172.21.15.49:0/3439341801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ac159510 con 0x7f07ac160110 2023-07-21T22:12:02.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.324+0000 7f07a27fc700 1 -- 172.21.15.49:0/3439341801 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f07a401c7e0 con 0x7f07ac160110 2023-07-21T22:12:02.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.324+0000 7f07a27fc700 1 --2- 172.21.15.49:0/3439341801 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0790066320 0x7f07900687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:02.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.324+0000 7f07a27fc700 1 -- 172.21.15.49:0/3439341801 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f07a40858a0 con 0x7f07ac160110 2023-07-21T22:12:02.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.324+0000 7f07b1bc1700 1 --2- 172.21.15.49:0/3439341801 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0790066320 0x7f07900687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:02.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.324+0000 7f07b1bc1700 1 --2- 172.21.15.49:0/3439341801 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0790066320 0x7f07900687d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f07a8000f60 tx=0x7f07a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:02.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.332+0000 7f07a27fc700 1 -- 172.21.15.49:0/3439341801 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07a40529e0 con 0x7f07ac160110 2023-07-21T22:12:02.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.508+0000 7f07b3e25700 1 -- 172.21.15.49:0/3439341801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f07ac04dd50 con 0x7f07ac160110 2023-07-21T22:12:02.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.512+0000 7f07a27fc700 1 -- 172.21.15.49:0/3439341801 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f07a4056000 con 0x7f07ac160110 2023-07-21T22:12:02.555 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:12:02.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.512+0000 7f07b3e25700 1 -- 172.21.15.49:0/3439341801 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0790066320 msgr2=0x7f07900687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:02.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.512+0000 7f07b3e25700 1 --2- 172.21.15.49:0/3439341801 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0790066320 0x7f07900687d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f07a8000f60 tx=0x7f07a8009040 comp rx=0 tx=0).stop 2023-07-21T22:12:02.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.512+0000 7f07b3e25700 1 -- 172.21.15.49:0/3439341801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac160110 msgr2=0x7f07ac157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:02.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.512+0000 7f07b3e25700 1 --2- 172.21.15.49:0/3439341801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac160110 0x7f07ac157400 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f07a400b370 tx=0x7f07a4004af0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.512+0000 7f07b3e25700 1 -- 172.21.15.49:0/3439341801 shutdown_connections 2023-07-21T22:12:02.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.512+0000 7f07b3e25700 1 --2- 172.21.15.49:0/3439341801 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0790066320 0x7f07900687d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.512+0000 7f07b3e25700 1 --2- 172.21.15.49:0/3439341801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac160110 0x7f07ac157400 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.512+0000 7f07b3e25700 1 --2- 172.21.15.49:0/3439341801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07ac071670 0x7f07ac0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.512+0000 7f07b3e25700 1 --2- 172.21.15.49:0/3439341801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07ac071220 0x7f07ac0adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.512+0000 7f07b3e25700 1 -- 172.21.15.49:0/3439341801 >> 172.21.15.49:0/3439341801 conn(0x7f07ac06e960 msgr2=0x7f07ac0cc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:02.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.512+0000 7f07b3e25700 1 -- 172.21.15.49:0/3439341801 shutdown_connections 2023-07-21T22:12:02.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.512+0000 7f07b3e25700 1 -- 172.21.15.49:0/3439341801 wait complete. 2023-07-21T22:12:02.580 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:12:02.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.716+0000 7f9d2218b700 1 Processor -- start 2023-07-21T22:12:02.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.716+0000 7f9d2218b700 1 -- start start 2023-07-21T22:12:02.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d2218b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c159be0 0x7f9d1c0c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:02.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d2218b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d1c0ca550 0x7f9d1c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:02.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d2218b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1c0c8b80 con 0x7f9d1c06d6d0 2023-07-21T22:12:02.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d2218b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1c06db90 con 0x7f9d1c0ca550 2023-07-21T22:12:02.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d2218b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c06de70 con 0x7f9d1c159be0 2023-07-21T22:12:02.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d20988700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d1c0ca550 0x7f9d1c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:02.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d2198a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9d1c06d6d0 0x7f9d1c0698a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40902/0 (socket says 172.21.15.49:40902) 2023-07-21T22:12:02.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d2198a700 1 -- 172.21.15.49:0/2661162671 learned_addr learned my addr 172.21.15.49:0/2661162671 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:02.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d21189700 1 --2- 172.21.15.49:0/2661162671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c159be0 0x7f9d1c0c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:02.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d13fff700 1 -- 172.21.15.49:0/2661162671 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143852070 0 0) 0x7f9d1c0c8b80 con 0x7f9d1c06d6d0 2023-07-21T22:12:02.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d20988700 1 -- 172.21.15.49:0/2661162671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c159be0 msgr2=0x7f9d1c0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:02.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d20988700 1 --2- 172.21.15.49:0/2661162671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c159be0 0x7f9d1c0c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d20988700 1 -- 172.21.15.49:0/2661162671 >> v1:172.21.15.49:6789/0 conn(0x7f9d1c06d6d0 legacy=0x7f9d1c0698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:02.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d20988700 1 -- 172.21.15.49:0/2661162671 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c0c8810 con 0x7f9d1c0ca550 2023-07-21T22:12:02.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d20988700 1 --2- 172.21.15.49:0/2661162671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0ca550 0x7f9d1c06d190 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009850 tx=0x7f9d0c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdf2d968adaf930 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:02.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d13fff700 1 -- 172.21.15.49:0/2661162671 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c011830 con 0x7f9d1c0ca550 2023-07-21T22:12:02.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d13fff700 1 -- 172.21.15.49:0/2661162671 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c011990 con 0x7f9d1c0ca550 2023-07-21T22:12:02.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.720+0000 7f9d13fff700 1 -- 172.21.15.49:0/2661162671 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c011d40 con 0x7f9d1c0ca550 2023-07-21T22:12:02.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.724+0000 7f9d2218b700 1 -- 172.21.15.49:0/2661162671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0ca550 msgr2=0x7f9d1c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:02.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.724+0000 7f9d2218b700 1 --2- 172.21.15.49:0/2661162671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0ca550 0x7f9d1c06d190 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009850 tx=0x7f9d0c009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:02.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.724+0000 7f9d2218b700 1 -- 172.21.15.49:0/2661162671 shutdown_connections 2023-07-21T22:12:02.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.724+0000 7f9d2218b700 1 --2- 172.21.15.49:0/2661162671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0ca550 0x7f9d1c06d190 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.724+0000 7f9d2218b700 1 --2- 172.21.15.49:0/2661162671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c159be0 0x7f9d1c0c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.724+0000 7f9d2218b700 1 -- 172.21.15.49:0/2661162671 >> 172.21.15.49:0/2661162671 conn(0x7f9d1c0ce0d0 msgr2=0x7f9d1c0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:02.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.724+0000 7f9d2218b700 1 -- 172.21.15.49:0/2661162671 shutdown_connections 2023-07-21T22:12:02.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.724+0000 7f9d2218b700 1 -- 172.21.15.49:0/2661162671 wait complete. 2023-07-21T22:12:02.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.724+0000 7f9d2218b700 1 Processor -- start 2023-07-21T22:12:02.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.724+0000 7f9d2218b700 1 -- start start 2023-07-21T22:12:02.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d2218b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c06d6d0 0x7f9d1c0cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:02.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d2218b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0ca550 0x7f9d1c15c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:02.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d2218b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c159be0 0x7f9d1c1470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:02.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d2218b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0cc030 con 0x7f9d1c0ca550 2023-07-21T22:12:02.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d2218b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0cc310 con 0x7f9d1c159be0 2023-07-21T22:12:02.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d2218b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0cc5f0 con 0x7f9d1c06d6d0 2023-07-21T22:12:02.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d20988700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0ca550 0x7f9d1c15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:02.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d20988700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0ca550 0x7f9d1c15c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39150/0 (socket says 172.21.15.49:39150) 2023-07-21T22:12:02.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d20988700 1 -- 172.21.15.49:0/836461272 learned_addr learned my addr 172.21.15.49:0/836461272 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:02.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d21189700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c06d6d0 0x7f9d1c0cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:02.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d2198a700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c159be0 0x7f9d1c1470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:02.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d20988700 1 -- 172.21.15.49:0/836461272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c06d6d0 msgr2=0x7f9d1c0cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:02.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d20988700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c06d6d0 0x7f9d1c0cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d20988700 1 -- 172.21.15.49:0/836461272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c159be0 msgr2=0x7f9d1c1470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d20988700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c159be0 0x7f9d1c1470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d20988700 1 -- 172.21.15.49:0/836461272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c0094b0 con 0x7f9d1c0ca550 2023-07-21T22:12:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d2198a700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c159be0 0x7f9d1c1470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d20988700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0ca550 0x7f9d1c15c690 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c014040 tx=0x7f9d0c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d11ffb700 1 -- 172.21.15.49:0/836461272 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c019ab0 con 0x7f9d1c0ca550 2023-07-21T22:12:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d11ffb700 1 -- 172.21.15.49:0/836461272 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c01e070 con 0x7f9d1c0ca550 2023-07-21T22:12:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d11ffb700 1 -- 172.21.15.49:0/836461272 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c019e70 con 0x7f9d1c0ca550 2023-07-21T22:12:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d2218b700 1 -- 172.21.15.49:0/836461272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1c0cc8d0 con 0x7f9d1c0ca550 2023-07-21T22:12:02.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.728+0000 7f9d2218b700 1 -- 172.21.15.49:0/836461272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1c0cd610 con 0x7f9d1c0ca550 2023-07-21T22:12:02.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.732+0000 7f9d2218b700 1 -- 172.21.15.49:0/836461272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1c04dcb0 con 0x7f9d1c0ca550 2023-07-21T22:12:02.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.732+0000 7f9d11ffb700 1 -- 172.21.15.49:0/836461272 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d0c02d450 con 0x7f9d1c0ca550 2023-07-21T22:12:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.732+0000 7f9d11ffb700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9d000662f0 0x7f9d000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.732+0000 7f9d11ffb700 1 -- 172.21.15.49:0/836461272 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9d0c085190 con 0x7f9d1c0ca550 2023-07-21T22:12:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.732+0000 7f9d21189700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9d000662f0 0x7f9d000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.736+0000 7f9d21189700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9d000662f0 0x7f9d000687a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009b80 tx=0x7f9d18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:02.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.740+0000 7f9d11ffb700 1 -- 172.21.15.49:0/836461272 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9d0c0522d0 con 0x7f9d1c0ca550 2023-07-21T22:12:02.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.916+0000 7f9d2218b700 1 -- 172.21.15.49:0/836461272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d1c0c83f0 con 0x7f9d1c0ca550 2023-07-21T22:12:02.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.920+0000 7f9d11ffb700 1 -- 172.21.15.49:0/836461272 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d0c0200a0 con 0x7f9d1c0ca550 2023-07-21T22:12:02.963 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:12:02.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.920+0000 7f9d2218b700 1 -- 172.21.15.49:0/836461272 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9d000662f0 msgr2=0x7f9d000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:02.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.920+0000 7f9d2218b700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9d000662f0 0x7f9d000687a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009b80 tx=0x7f9d18008040 comp rx=0 tx=0).stop 2023-07-21T22:12:02.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.920+0000 7f9d2218b700 1 -- 172.21.15.49:0/836461272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0ca550 msgr2=0x7f9d1c15c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:02.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.920+0000 7f9d2218b700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0ca550 0x7f9d1c15c690 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c014040 tx=0x7f9d0c004770 comp rx=0 tx=0).stop 2023-07-21T22:12:02.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.920+0000 7f9d2218b700 1 -- 172.21.15.49:0/836461272 shutdown_connections 2023-07-21T22:12:02.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.920+0000 7f9d2218b700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9d000662f0 0x7f9d000687a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.920+0000 7f9d2218b700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1c0ca550 0x7f9d1c15c690 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.920+0000 7f9d2218b700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c159be0 0x7f9d1c1470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.920+0000 7f9d2218b700 1 --2- 172.21.15.49:0/836461272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c06d6d0 0x7f9d1c0cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:02.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.920+0000 7f9d2218b700 1 -- 172.21.15.49:0/836461272 >> 172.21.15.49:0/836461272 conn(0x7f9d1c0ce0d0 msgr2=0x7f9d1c158840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:02.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.920+0000 7f9d2218b700 1 -- 172.21.15.49:0/836461272 shutdown_connections 2023-07-21T22:12:02.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:02.920+0000 7f9d2218b700 1 -- 172.21.15.49:0/836461272 wait complete. 2023-07-21T22:12:02.992 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:12:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.128+0000 7faca4cb1700 1 Processor -- start 2023-07-21T22:12:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.128+0000 7faca4cb1700 1 -- start start 2023-07-21T22:12:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.132+0000 7faca4cb1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faca00b7af0 0x7faca00b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.132+0000 7faca4cb1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca00d1e40 0x7faca015f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.132+0000 7faca4cb1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca00b3e80 con 0x7faca00cee10 2023-07-21T22:12:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.132+0000 7faca4cb1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca00cea00 con 0x7faca00b7af0 2023-07-21T22:12:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.132+0000 7faca4cb1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca00ccbf0 con 0x7faca00d1e40 2023-07-21T22:12:03.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.132+0000 7fac9ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faca00cee10 0x7faca00b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40916/0 (socket says 172.21.15.49:40916) 2023-07-21T22:12:03.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.132+0000 7fac9ffff700 1 -- 172.21.15.49:0/284363785 learned_addr learned my addr 172.21.15.49:0/284363785 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:03.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.132+0000 7fac9f7fe700 1 --2- 172.21.15.49:0/284363785 >> v2:172.21.15.150:3300/0 conn(0x7faca00b7af0 0x7faca00b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:03.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.132+0000 7fac9effd700 1 --2- 172.21.15.49:0/284363785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca00d1e40 0x7faca015f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:03.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7fac9e7fc700 1 -- 172.21.15.49:0/284363785 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146121591 0 0) 0x7faca00b3e80 con 0x7faca00cee10 2023-07-21T22:12:03.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7fac9e7fc700 1 -- 172.21.15.49:0/284363785 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac880035d0 con 0x7faca00cee10 2023-07-21T22:12:03.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7fac9f7fe700 1 -- 172.21.15.49:0/284363785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca00d1e40 msgr2=0x7faca015f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:03.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7fac9f7fe700 1 --2- 172.21.15.49:0/284363785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca00d1e40 0x7faca015f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7fac9f7fe700 1 -- 172.21.15.49:0/284363785 >> v1:172.21.15.49:6789/0 conn(0x7faca00cee10 legacy=0x7faca00b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:03.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7fac9f7fe700 1 -- 172.21.15.49:0/284363785 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca00cced0 con 0x7faca00b7af0 2023-07-21T22:12:03.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7fac9f7fe700 1 --2- 172.21.15.49:0/284363785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca00b7af0 0x7faca00b1630 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fac90009850 tx=0x7fac90009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4711bcf89f1055a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7fac9e7fc700 1 -- 172.21.15.49:0/284363785 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90011830 con 0x7faca00b7af0 2023-07-21T22:12:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7fac9e7fc700 1 -- 172.21.15.49:0/284363785 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac90011990 con 0x7faca00b7af0 2023-07-21T22:12:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7fac9e7fc700 1 -- 172.21.15.49:0/284363785 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90011d40 con 0x7faca00b7af0 2023-07-21T22:12:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7faca4cb1700 1 -- 172.21.15.49:0/284363785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca00b7af0 msgr2=0x7faca00b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7faca4cb1700 1 --2- 172.21.15.49:0/284363785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca00b7af0 0x7faca00b1630 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fac90009850 tx=0x7fac90009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7faca4cb1700 1 -- 172.21.15.49:0/284363785 shutdown_connections 2023-07-21T22:12:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7faca4cb1700 1 --2- 172.21.15.49:0/284363785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca00d1e40 0x7faca015f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7faca4cb1700 1 --2- 172.21.15.49:0/284363785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca00b7af0 0x7faca00b1630 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7faca4cb1700 1 -- 172.21.15.49:0/284363785 >> 172.21.15.49:0/284363785 conn(0x7faca006e960 msgr2=0x7faca006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:03.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7faca4cb1700 1 -- 172.21.15.49:0/284363785 shutdown_connections 2023-07-21T22:12:03.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.136+0000 7faca4cb1700 1 -- 172.21.15.49:0/284363785 wait complete. 2023-07-21T22:12:03.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.140+0000 7faca4cb1700 1 Processor -- start 2023-07-21T22:12:03.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.140+0000 7faca4cb1700 1 -- start start 2023-07-21T22:12:03.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.140+0000 7faca4cb1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca00b7af0 0x7faca00cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:03.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.140+0000 7faca4cb1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faca00cee10 0x7faca01561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:03.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.140+0000 7faca4cb1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca00d1e40 0x7faca00c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:03.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.140+0000 7faca4cb1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca015a160 con 0x7faca00cee10 2023-07-21T22:12:03.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.140+0000 7faca4cb1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca00c9b30 con 0x7faca00d1e40 2023-07-21T22:12:03.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.140+0000 7faca4cb1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca00c9570 con 0x7faca00b7af0 2023-07-21T22:12:03.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac9effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faca00cee10 0x7faca01561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:03.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac9effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faca00cee10 0x7faca01561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39158/0 (socket says 172.21.15.49:39158) 2023-07-21T22:12:03.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac9effd700 1 -- 172.21.15.49:0/3452074699 learned_addr learned my addr 172.21.15.49:0/3452074699 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:03.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac9f7fe700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca00b7af0 0x7faca00cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:03.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac9ffff700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca00d1e40 0x7faca00c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:03.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac9effd700 1 -- 172.21.15.49:0/3452074699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca00b7af0 msgr2=0x7faca00cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:03.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac9effd700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca00b7af0 0x7faca00cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac9effd700 1 -- 172.21.15.49:0/3452074699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca00d1e40 msgr2=0x7faca00c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:03.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac9effd700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca00d1e40 0x7faca00c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac9effd700 1 -- 172.21.15.49:0/3452074699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac900094b0 con 0x7faca00cee10 2023-07-21T22:12:03.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac9ffff700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca00d1e40 0x7faca00c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:03.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac9effd700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faca00cee10 0x7faca01561b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fac9400e840 tx=0x7fac9400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:03.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac87fff700 1 -- 172.21.15.49:0/3452074699 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac940095a0 con 0x7faca00cee10 2023-07-21T22:12:03.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7faca4cb1700 1 -- 172.21.15.49:0/3452074699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca00c9850 con 0x7faca00cee10 2023-07-21T22:12:03.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac87fff700 1 -- 172.21.15.49:0/3452074699 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac94013680 con 0x7faca00cee10 2023-07-21T22:12:03.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7fac87fff700 1 -- 172.21.15.49:0/3452074699 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac940139f0 con 0x7faca00cee10 2023-07-21T22:12:03.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.144+0000 7faca4cb1700 1 -- 172.21.15.49:0/3452074699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca00ca3a0 con 0x7faca00cee10 2023-07-21T22:12:03.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.148+0000 7faca4cb1700 1 -- 172.21.15.49:0/3452074699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca004dcb0 con 0x7faca00cee10 2023-07-21T22:12:03.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.148+0000 7fac87fff700 1 -- 172.21.15.49:0/3452074699 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fac94013b50 con 0x7faca00cee10 2023-07-21T22:12:03.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.148+0000 7fac87fff700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac8c0662f0 0x7fac8c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:03.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.148+0000 7fac87fff700 1 -- 172.21.15.49:0/3452074699 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fac94084330 con 0x7faca00cee10 2023-07-21T22:12:03.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.152+0000 7fac9f7fe700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac8c0662f0 0x7fac8c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:03.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.152+0000 7fac9f7fe700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac8c0662f0 0x7fac8c0687a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fac900090b0 tx=0x7fac90008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:03.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.156+0000 7fac87fff700 1 -- 172.21.15.49:0/3452074699 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac940513f0 con 0x7faca00cee10 2023-07-21T22:12:03.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.336+0000 7faca4cb1700 1 -- 172.21.15.49:0/3452074699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faca006f250 con 0x7faca00cee10 2023-07-21T22:12:03.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.336+0000 7fac87fff700 1 -- 172.21.15.49:0/3452074699 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7fac94054a10 con 0x7faca00cee10 2023-07-21T22:12:03.381 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:12:03.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.340+0000 7faca4cb1700 1 -- 172.21.15.49:0/3452074699 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac8c0662f0 msgr2=0x7fac8c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:03.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.340+0000 7faca4cb1700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac8c0662f0 0x7fac8c0687a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fac900090b0 tx=0x7fac90008030 comp rx=0 tx=0).stop 2023-07-21T22:12:03.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.340+0000 7faca4cb1700 1 -- 172.21.15.49:0/3452074699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faca00cee10 msgr2=0x7faca01561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.340+0000 7faca4cb1700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faca00cee10 0x7faca01561b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fac9400e840 tx=0x7fac9400eb50 comp rx=0 tx=0).stop 2023-07-21T22:12:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.340+0000 7faca4cb1700 1 -- 172.21.15.49:0/3452074699 shutdown_connections 2023-07-21T22:12:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.340+0000 7faca4cb1700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fac8c0662f0 0x7fac8c0687a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.340+0000 7faca4cb1700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faca00cee10 0x7faca01561b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.340+0000 7faca4cb1700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca00d1e40 0x7faca00c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.340+0000 7faca4cb1700 1 --2- 172.21.15.49:0/3452074699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca00b7af0 0x7faca00cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.340+0000 7faca4cb1700 1 -- 172.21.15.49:0/3452074699 >> 172.21.15.49:0/3452074699 conn(0x7faca006e960 msgr2=0x7faca00b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.340+0000 7faca4cb1700 1 -- 172.21.15.49:0/3452074699 shutdown_connections 2023-07-21T22:12:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.340+0000 7faca4cb1700 1 -- 172.21.15.49:0/3452074699 wait complete. 2023-07-21T22:12:03.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:12:03.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.548+0000 7fbcb2203700 1 Processor -- start 2023-07-21T22:12:03.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.548+0000 7fbcb2203700 1 -- start start 2023-07-21T22:12:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbcb2203700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbcac15bf30 0x7fbcac0ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbcb2203700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbcac0b0200 0x7fbcac0ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbcb2203700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcac0cb270 con 0x7fbcac0cbc40 2023-07-21T22:12:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbcb2203700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac15c300 con 0x7fbcac0b0200 2023-07-21T22:12:03.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbcb2203700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac0acac0 con 0x7fbcac15bf30 2023-07-21T22:12:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbcb1a02700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbcac0b0200 0x7fbcac0ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbcb0a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbcac0cbc40 0x7fbcac0afaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40918/0 (socket says 172.21.15.49:40918) 2023-07-21T22:12:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbcb0a00700 1 -- 172.21.15.49:0/3739974725 learned_addr learned my addr 172.21.15.49:0/3739974725 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbcb1201700 1 --2- 172.21.15.49:0/3739974725 >> v2:172.21.15.150:3300/0 conn(0x7fbcac15bf30 0x7fbcac0ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbcb1a02700 1 -- 172.21.15.49:0/3739974725 >> v2:172.21.15.150:3300/0 conn(0x7fbcac15bf30 msgr2=0x7fbcac0ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbcb1a02700 1 --2- 172.21.15.49:0/3739974725 >> v2:172.21.15.150:3300/0 conn(0x7fbcac15bf30 0x7fbcac0ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbcb1a02700 1 -- 172.21.15.49:0/3739974725 >> v1:172.21.15.49:6789/0 conn(0x7fbcac0cbc40 legacy=0x7fbcac0afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:03.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbcb1a02700 1 -- 172.21.15.49:0/3739974725 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac06f740 con 0x7fbcac0b0200 2023-07-21T22:12:03.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbcb1a02700 1 --2- 172.21.15.49:0/3739974725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcac0b0200 0x7fbcac0ab8d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0cbbc0 tx=0x7fbca400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e322ca2d758774c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:03.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbca3fff700 1 -- 172.21.15.49:0/3739974725 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca400e070 con 0x7fbcac0b0200 2023-07-21T22:12:03.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbca3fff700 1 -- 172.21.15.49:0/3739974725 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca400bbd0 con 0x7fbcac0b0200 2023-07-21T22:12:03.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.552+0000 7fbca3fff700 1 -- 172.21.15.49:0/3739974725 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4012430 con 0x7fbcac0b0200 2023-07-21T22:12:03.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.556+0000 7fbcb2203700 1 -- 172.21.15.49:0/3739974725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcac0b0200 msgr2=0x7fbcac0ab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:03.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.556+0000 7fbcb2203700 1 --2- 172.21.15.49:0/3739974725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcac0b0200 0x7fbcac0ab8d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0cbbc0 tx=0x7fbca400b330 comp rx=0 tx=0).stop 2023-07-21T22:12:03.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.556+0000 7fbcb2203700 1 -- 172.21.15.49:0/3739974725 shutdown_connections 2023-07-21T22:12:03.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.556+0000 7fbcb2203700 1 --2- 172.21.15.49:0/3739974725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcac0b0200 0x7fbcac0ab8d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.556+0000 7fbcb2203700 1 --2- 172.21.15.49:0/3739974725 >> v2:172.21.15.150:3300/0 conn(0x7fbcac15bf30 0x7fbcac0ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.556+0000 7fbcb2203700 1 -- 172.21.15.49:0/3739974725 >> 172.21.15.49:0/3739974725 conn(0x7fbcac070450 msgr2=0x7fbcac070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:03.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.556+0000 7fbcb2203700 1 -- 172.21.15.49:0/3739974725 shutdown_connections 2023-07-21T22:12:03.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.556+0000 7fbcb2203700 1 -- 172.21.15.49:0/3739974725 wait complete. 2023-07-21T22:12:03.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.556+0000 7fbcb2203700 1 Processor -- start 2023-07-21T22:12:03.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.556+0000 7fbcb2203700 1 -- start start 2023-07-21T22:12:03.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb2203700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcac0b0200 0x7fbcac0c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:03.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb2203700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcac0cbc40 0x7fbcac15a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:03.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb2203700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcac15bf30 0x7fbcac15e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:03.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb2203700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac1f95e0 con 0x7fbcac15bf30 2023-07-21T22:12:03.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb2203700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac15a0a0 con 0x7fbcac0b0200 2023-07-21T22:12:03.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb2203700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac1f8c40 con 0x7fbcac0cbc40 2023-07-21T22:12:03.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb1a02700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcac15bf30 0x7fbcac15e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:03.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb1a02700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcac15bf30 0x7fbcac15e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39180/0 (socket says 172.21.15.49:39180) 2023-07-21T22:12:03.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb1a02700 1 -- 172.21.15.49:0/134184459 learned_addr learned my addr 172.21.15.49:0/134184459 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:03.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb1201700 1 --2- 172.21.15.49:0/134184459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcac0b0200 0x7fbcac0c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:03.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb0a00700 1 --2- 172.21.15.49:0/134184459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcac0cbc40 0x7fbcac15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:03.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb1a02700 1 -- 172.21.15.49:0/134184459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcac0cbc40 msgr2=0x7fbcac15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb1a02700 1 --2- 172.21.15.49:0/134184459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcac0cbc40 0x7fbcac15a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb1a02700 1 -- 172.21.15.49:0/134184459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcac0b0200 msgr2=0x7fbcac0c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb1a02700 1 --2- 172.21.15.49:0/134184459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcac0b0200 0x7fbcac0c3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb1a02700 1 -- 172.21.15.49:0/134184459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca4009a70 con 0x7fbcac15bf30 2023-07-21T22:12:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb1a02700 1 --2- 172.21.15.49:0/134184459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcac15bf30 0x7fbcac15e060 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbca4014040 tx=0x7fbca4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbca1ffb700 1 -- 172.21.15.49:0/134184459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4012430 con 0x7fbcac15bf30 2023-07-21T22:12:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbca1ffb700 1 -- 172.21.15.49:0/134184459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca4020070 con 0x7fbcac15bf30 2023-07-21T22:12:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbca1ffb700 1 -- 172.21.15.49:0/134184459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca40098f0 con 0x7fbcac15bf30 2023-07-21T22:12:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb2203700 1 -- 172.21.15.49:0/134184459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac1f8f20 con 0x7fbcac15bf30 2023-07-21T22:12:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.560+0000 7fbcb2203700 1 -- 172.21.15.49:0/134184459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac15ddf0 con 0x7fbcac15bf30 2023-07-21T22:12:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.564+0000 7fbcb2203700 1 -- 172.21.15.49:0/134184459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcac1f9720 con 0x7fbcac15bf30 2023-07-21T22:12:03.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.564+0000 7fbca1ffb700 1 -- 172.21.15.49:0/134184459 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbca4004040 con 0x7fbcac15bf30 2023-07-21T22:12:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.568+0000 7fbca1ffb700 1 --2- 172.21.15.49:0/134184459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbc900662f0 0x7fbc900687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.568+0000 7fbca1ffb700 1 -- 172.21.15.49:0/134184459 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbca4022070 con 0x7fbcac15bf30 2023-07-21T22:12:03.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.568+0000 7fbcb1201700 1 --2- 172.21.15.49:0/134184459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbc900662f0 0x7fbc900687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:03.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.568+0000 7fbcb1201700 1 --2- 172.21.15.49:0/134184459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbc900662f0 0x7fbc900687a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbca8006b40 tx=0x7fbca8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:03.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.572+0000 7fbca1ffb700 1 -- 172.21.15.49:0/134184459 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbcac1f9720 con 0x7fbcac15bf30 2023-07-21T22:12:03.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.760+0000 7fbcb2203700 1 -- 172.21.15.49:0/134184459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbcac1f8d80 con 0x7fbcac15bf30 2023-07-21T22:12:03.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.760+0000 7fbca1ffb700 1 -- 172.21.15.49:0/134184459 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbcac1f8d80 con 0x7fbcac15bf30 2023-07-21T22:12:03.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.764+0000 7fbcb2203700 1 -- 172.21.15.49:0/134184459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbc900662f0 msgr2=0x7fbc900687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:03.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.764+0000 7fbcb2203700 1 --2- 172.21.15.49:0/134184459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbc900662f0 0x7fbc900687a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbca8006b40 tx=0x7fbca8008040 comp rx=0 tx=0).stop 2023-07-21T22:12:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.764+0000 7fbcb2203700 1 -- 172.21.15.49:0/134184459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcac15bf30 msgr2=0x7fbcac15e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.764+0000 7fbcb2203700 1 --2- 172.21.15.49:0/134184459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcac15bf30 0x7fbcac15e060 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbca4014040 tx=0x7fbca4004af0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.764+0000 7fbcb2203700 1 -- 172.21.15.49:0/134184459 shutdown_connections 2023-07-21T22:12:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.764+0000 7fbcb2203700 1 --2- 172.21.15.49:0/134184459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbc900662f0 0x7fbc900687a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.764+0000 7fbcb2203700 1 --2- 172.21.15.49:0/134184459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcac15bf30 0x7fbcac15e060 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.764+0000 7fbcb2203700 1 --2- 172.21.15.49:0/134184459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcac0cbc40 0x7fbcac15a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.764+0000 7fbcb2203700 1 --2- 172.21.15.49:0/134184459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcac0b0200 0x7fbcac0c3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.764+0000 7fbcb2203700 1 -- 172.21.15.49:0/134184459 >> 172.21.15.49:0/134184459 conn(0x7fbcac070450 msgr2=0x7fbcac0ada70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:03.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.764+0000 7fbcb2203700 1 -- 172.21.15.49:0/134184459 shutdown_connections 2023-07-21T22:12:03.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:03.764+0000 7fbcb2203700 1 -- 172.21.15.49:0/134184459 wait complete. 2023-07-21T22:12:03.812 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:12:03.831 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2023-07-21T22:12:03.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:03.832 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-07-21T22:12:03.866 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:12:03.867 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:12:03.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:03.868 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-21T22:12:03.934 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-21T22:12:03.934 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:12:04.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.068+0000 7f7131995700 1 Processor -- start 2023-07-21T22:12:04.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.068+0000 7f7131995700 1 -- start start 2023-07-21T22:12:04.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f7131995700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f712c15bf30 0x7f712c0ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f7131995700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f712c0cbc40 0x7f712c0afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f7131995700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c0cb270 con 0x7f712c0b0030 2023-07-21T22:12:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f7131995700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712c0ac8e0 con 0x7f712c15bf30 2023-07-21T22:12:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f7131995700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c15c300 con 0x7f712c0cbc40 2023-07-21T22:12:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f7131194700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f712c0b0030 0x7f712c15f9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40930/0 (socket says 172.21.15.49:40930) 2023-07-21T22:12:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f7131194700 1 -- 172.21.15.49:0/869551916 learned_addr learned my addr 172.21.15.49:0/869551916 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:04.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f7130993700 1 --2- 172.21.15.49:0/869551916 >> v2:172.21.15.150:3300/0 conn(0x7f712c15bf30 0x7f712c0ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f712bfff700 1 --2- 172.21.15.49:0/869551916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f712c0cbc40 0x7f712c0afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f712b7fe700 1 -- 172.21.15.49:0/869551916 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146523909 0 0) 0x7f712c0cb270 con 0x7f712c0b0030 2023-07-21T22:12:04.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f712b7fe700 1 -- 172.21.15.49:0/869551916 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f711c0035d0 con 0x7f712c0b0030 2023-07-21T22:12:04.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f7130993700 1 -- 172.21.15.49:0/869551916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f712c0cbc40 msgr2=0x7f712c0afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:04.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f7130993700 1 --2- 172.21.15.49:0/869551916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f712c0cbc40 0x7f712c0afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f7130993700 1 -- 172.21.15.49:0/869551916 >> v1:172.21.15.49:6789/0 conn(0x7f712c0b0030 legacy=0x7f712c15f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f712b7fe700 1 -- 172.21.15.49:0/869551916 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2024683197 0 0) 0x7f711c0035d0 con 0x7f712c0b0030 2023-07-21T22:12:04.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f7130993700 1 -- 172.21.15.49:0/869551916 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c0acac0 con 0x7f712c15bf30 2023-07-21T22:12:04.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f7130993700 1 --2- 172.21.15.49:0/869551916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712c15bf30 0x7f712c0ad350 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7120009850 tx=0x7f7120009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=366f3b41277a6092 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:04.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f712b7fe700 1 -- 172.21.15.49:0/869551916 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71240019f0 con 0x7f712c15bf30 2023-07-21T22:12:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f712b7fe700 1 -- 172.21.15.49:0/869551916 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7120004030 con 0x7f712c15bf30 2023-07-21T22:12:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.072+0000 7f712b7fe700 1 -- 172.21.15.49:0/869551916 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71200043e0 con 0x7f712c15bf30 2023-07-21T22:12:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.076+0000 7f7131995700 1 -- 172.21.15.49:0/869551916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712c15bf30 msgr2=0x7f712c0ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.076+0000 7f7131995700 1 --2- 172.21.15.49:0/869551916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712c15bf30 0x7f712c0ad350 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7120009850 tx=0x7f7120009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.076+0000 7f7131995700 1 -- 172.21.15.49:0/869551916 shutdown_connections 2023-07-21T22:12:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.076+0000 7f7131995700 1 --2- 172.21.15.49:0/869551916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f712c0cbc40 0x7f712c0afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.076+0000 7f7131995700 1 --2- 172.21.15.49:0/869551916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712c15bf30 0x7f712c0ad350 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.076+0000 7f7131995700 1 -- 172.21.15.49:0/869551916 >> 172.21.15.49:0/869551916 conn(0x7f712c070450 msgr2=0x7f712c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.076+0000 7f7131995700 1 -- 172.21.15.49:0/869551916 shutdown_connections 2023-07-21T22:12:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.076+0000 7f7131995700 1 -- 172.21.15.49:0/869551916 wait complete. 2023-07-21T22:12:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.076+0000 7f7131995700 1 Processor -- start 2023-07-21T22:12:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.076+0000 7f7131995700 1 -- start start 2023-07-21T22:12:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f7131995700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f712c0b0030 0x7f712c0c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f7131995700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f712c0cbc40 0x7f712c1f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f7131995700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712c15bf30 0x7f712c0c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f7131995700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c14bd80 con 0x7f712c0cbc40 2023-07-21T22:12:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f7131995700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c1f4710 con 0x7f712c15bf30 2023-07-21T22:12:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f7131995700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c14b170 con 0x7f712c0b0030 2023-07-21T22:12:04.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f712bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f712c0cbc40 0x7f712c1f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f712bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f712c0cbc40 0x7f712c1f41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39192/0 (socket says 172.21.15.49:39192) 2023-07-21T22:12:04.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f712bfff700 1 -- 172.21.15.49:0/2883705313 learned_addr learned my addr 172.21.15.49:0/2883705313 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:04.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f7130993700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f712c0b0030 0x7f712c0c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f7131194700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712c15bf30 0x7f712c0c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f712bfff700 1 -- 172.21.15.49:0/2883705313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f712c0b0030 msgr2=0x7f712c0c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f712bfff700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f712c0b0030 0x7f712c0c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f712bfff700 1 -- 172.21.15.49:0/2883705313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712c15bf30 msgr2=0x7f712c0c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f712bfff700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712c15bf30 0x7f712c0c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f712bfff700 1 -- 172.21.15.49:0/2883705313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71200094b0 con 0x7f712c0cbc40 2023-07-21T22:12:04.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f7131194700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712c15bf30 0x7f712c0c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:04.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f712bfff700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f712c0cbc40 0x7f712c1f41d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f711800ea00 tx=0x7f711800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:04.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f71297fa700 1 -- 172.21.15.49:0/2883705313 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7118009720 con 0x7f712c0cbc40 2023-07-21T22:12:04.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f71297fa700 1 -- 172.21.15.49:0/2883705313 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711800c850 con 0x7f712c0cbc40 2023-07-21T22:12:04.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f7131995700 1 -- 172.21.15.49:0/2883705313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c14b450 con 0x7f712c0cbc40 2023-07-21T22:12:04.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f71297fa700 1 -- 172.21.15.49:0/2883705313 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711800cbc0 con 0x7f712c0cbc40 2023-07-21T22:12:04.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.080+0000 7f7131995700 1 -- 172.21.15.49:0/2883705313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c14ba10 con 0x7f712c0cbc40 2023-07-21T22:12:04.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.084+0000 7f7131995700 1 -- 172.21.15.49:0/2883705313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c14bf30 con 0x7f712c0cbc40 2023-07-21T22:12:04.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.084+0000 7f71297fa700 1 -- 172.21.15.49:0/2883705313 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f711800cd20 con 0x7f712c0cbc40 2023-07-21T22:12:04.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.088+0000 7f71297fa700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7110066320 0x7f71100687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.088+0000 7f71297fa700 1 -- 172.21.15.49:0/2883705313 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f71180840b0 con 0x7f712c0cbc40 2023-07-21T22:12:04.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.088+0000 7f7130993700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7110066320 0x7f71100687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.088+0000 7f7130993700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7110066320 0x7f71100687d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f71200090b0 tx=0x7f7120008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:04.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.092+0000 7f71297fa700 1 -- 172.21.15.49:0/2883705313 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f712c14bf30 con 0x7f712c0cbc40 2023-07-21T22:12:04.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.308+0000 7f7131995700 1 -- 172.21.15.49:0/2883705313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f712c14bf30 con 0x7f712c0cbc40 2023-07-21T22:12:04.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.308+0000 7f71297fa700 1 -- 172.21.15.49:0/2883705313 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f712c14bf30 con 0x7f712c0cbc40 2023-07-21T22:12:04.352 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/1894793298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1894793298},{"type":"v1","addr":"172.21.15.150:6833","nonce":1894793298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1984862419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1984862419},{"type":"v1","addr":"172.21.15.49:6836","nonce":1984862419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1331451608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1331451608},{"type":"v1","addr":"172.21.15.49:6837","nonce":1331451608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:10:34.629989+0000","modified":"2023-07-21T22:11:01.997441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2478678672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2478678672},{"type":"v1","addr":"172.21.15.150:6835","nonce":2478678672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:12:04.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.312+0000 7f7131995700 1 -- 172.21.15.49:0/2883705313 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7110066320 msgr2=0x7f71100687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.312+0000 7f7131995700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7110066320 0x7f71100687d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f71200090b0 tx=0x7f7120008030 comp rx=0 tx=0).stop 2023-07-21T22:12:04.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.312+0000 7f7131995700 1 -- 172.21.15.49:0/2883705313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f712c0cbc40 msgr2=0x7f712c1f41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.312+0000 7f7131995700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f712c0cbc40 0x7f712c1f41d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f711800ea00 tx=0x7f711800edc0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.312+0000 7f7131995700 1 -- 172.21.15.49:0/2883705313 shutdown_connections 2023-07-21T22:12:04.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.312+0000 7f7131995700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7110066320 0x7f71100687d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.312+0000 7f7131995700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f712c0cbc40 0x7f712c1f41d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.312+0000 7f7131995700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712c15bf30 0x7f712c0c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.312+0000 7f7131995700 1 --2- 172.21.15.49:0/2883705313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f712c0b0030 0x7f712c0c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.312+0000 7f7131995700 1 -- 172.21.15.49:0/2883705313 >> 172.21.15.49:0/2883705313 conn(0x7f712c070450 msgr2=0x7f712c0ad9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.312+0000 7f7131995700 1 -- 172.21.15.49:0/2883705313 shutdown_connections 2023-07-21T22:12:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.312+0000 7f7131995700 1 -- 172.21.15.49:0/2883705313 wait complete. 2023-07-21T22:12:04.358 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2023-07-21T22:12:04.377 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:12:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.512+0000 7f9254998700 1 Processor -- start 2023-07-21T22:12:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.512+0000 7f9254998700 1 -- start start 2023-07-21T22:12:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f9254998700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f92500c1470 0x7f92500c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f9254998700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92500ca2c0 0x7f9250163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f9254998700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925006e010 con 0x7f9250160370 2023-07-21T22:12:04.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f9254998700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9250160740 con 0x7f92500c1470 2023-07-21T22:12:04.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f9254998700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92500ccc50 con 0x7f92500ca2c0 2023-07-21T22:12:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f924e59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f92500c1470 0x7f92500c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f924e59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f92500c1470 0x7f92500c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39206/0 (socket says 172.21.15.49:39206) 2023-07-21T22:12:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f924e59c700 1 -- 172.21.15.49:0/2337749362 learned_addr learned my addr 172.21.15.49:0/2337749362 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f924f59e700 1 --2- 172.21.15.49:0/2337749362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92500ca2c0 0x7f9250163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f924e59c700 1 -- 172.21.15.49:0/2337749362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92500ca2c0 msgr2=0x7f9250163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:04.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f924e59c700 1 --2- 172.21.15.49:0/2337749362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92500ca2c0 0x7f9250163ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f924e59c700 1 -- 172.21.15.49:0/2337749362 >> v1:172.21.15.150:6789/0 conn(0x7f9250160370 legacy=0x7f925006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f924e59c700 1 -- 172.21.15.49:0/2337749362 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92500afc90 con 0x7f92500c1470 2023-07-21T22:12:04.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f924e59c700 1 --2- 172.21.15.49:0/2337749362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92500c1470 0x7f92500c9d80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9244009910 tx=0x7f9244009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88ccdc846038de4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:04.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f924dd9b700 1 -- 172.21.15.49:0/2337749362 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924400ba60 con 0x7f92500c1470 2023-07-21T22:12:04.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f924dd9b700 1 -- 172.21.15.49:0/2337749362 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924400bbc0 con 0x7f92500c1470 2023-07-21T22:12:04.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f924dd9b700 1 -- 172.21.15.49:0/2337749362 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244009e60 con 0x7f92500c1470 2023-07-21T22:12:04.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f9254998700 1 -- 172.21.15.49:0/2337749362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92500c1470 msgr2=0x7f92500c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f9254998700 1 --2- 172.21.15.49:0/2337749362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92500c1470 0x7f92500c9d80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9244009910 tx=0x7f9244009c20 comp rx=0 tx=0).stop 2023-07-21T22:12:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f9254998700 1 -- 172.21.15.49:0/2337749362 shutdown_connections 2023-07-21T22:12:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f9254998700 1 --2- 172.21.15.49:0/2337749362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92500ca2c0 0x7f9250163ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f9254998700 1 --2- 172.21.15.49:0/2337749362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92500c1470 0x7f92500c9d80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.516+0000 7f9254998700 1 -- 172.21.15.49:0/2337749362 >> 172.21.15.49:0/2337749362 conn(0x7f9250070450 msgr2=0x7f9250070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.520+0000 7f9254998700 1 -- 172.21.15.49:0/2337749362 shutdown_connections 2023-07-21T22:12:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.520+0000 7f9254998700 1 -- 172.21.15.49:0/2337749362 wait complete. 2023-07-21T22:12:04.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f9254998700 1 Processor -- start 2023-07-21T22:12:04.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f9254998700 1 -- start start 2023-07-21T22:12:04.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f9254998700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92500ca2c0 0x7f9250159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f9254998700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9250160370 0x7f925015d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f9254998700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f925015a4e0 0x7f92500b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f9254998700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92500b25e0 con 0x7f925015a4e0 2023-07-21T22:12:04.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f9254998700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925015ad80 con 0x7f9250160370 2023-07-21T22:12:04.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f9254998700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92500b3100 con 0x7f92500ca2c0 2023-07-21T22:12:04.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f924f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f925015a4e0 0x7f92500b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f924f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f925015a4e0 0x7f92500b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39218/0 (socket says 172.21.15.49:39218) 2023-07-21T22:12:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f924f59e700 1 -- 172.21.15.49:0/1793751339 learned_addr learned my addr 172.21.15.49:0/1793751339 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f924e59c700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9250160370 0x7f925015d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f924ed9d700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92500ca2c0 0x7f9250159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f924f59e700 1 -- 172.21.15.49:0/1793751339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92500ca2c0 msgr2=0x7f9250159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f924f59e700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92500ca2c0 0x7f9250159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f924f59e700 1 -- 172.21.15.49:0/1793751339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9250160370 msgr2=0x7f925015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f924f59e700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9250160370 0x7f925015d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f924f59e700 1 -- 172.21.15.49:0/1793751339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9244009570 con 0x7f925015a4e0 2023-07-21T22:12:04.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.524+0000 7f924ed9d700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92500ca2c0 0x7f9250159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:04.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.528+0000 7f924f59e700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f925015a4e0 0x7f92500b3590 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9248007e40 tx=0x7f924800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:04.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.528+0000 7f92377fe700 1 -- 172.21.15.49:0/1793751339 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924800eea0 con 0x7f925015a4e0 2023-07-21T22:12:04.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.528+0000 7f92377fe700 1 -- 172.21.15.49:0/1793751339 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9248014420 con 0x7f925015a4e0 2023-07-21T22:12:04.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.528+0000 7f92377fe700 1 -- 172.21.15.49:0/1793751339 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480147b0 con 0x7f925015a4e0 2023-07-21T22:12:04.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.528+0000 7f9254998700 1 -- 172.21.15.49:0/1793751339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925015d8e0 con 0x7f925015a4e0 2023-07-21T22:12:04.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.528+0000 7f9254998700 1 -- 172.21.15.49:0/1793751339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92500b2d90 con 0x7f925015a4e0 2023-07-21T22:12:04.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.528+0000 7f9254998700 1 -- 172.21.15.49:0/1793751339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92500b3270 con 0x7f925015a4e0 2023-07-21T22:12:04.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.532+0000 7f92377fe700 1 -- 172.21.15.49:0/1793751339 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9248014910 con 0x7f925015a4e0 2023-07-21T22:12:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.532+0000 7f92377fe700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f923c066320 0x7f923c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.532+0000 7f92377fe700 1 -- 172.21.15.49:0/1793751339 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f92480847f0 con 0x7f925015a4e0 2023-07-21T22:12:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.532+0000 7f924ed9d700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f923c066320 0x7f923c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.536+0000 7f924ed9d700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f923c066320 0x7f923c0687d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9240000f60 tx=0x7f9240009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:04.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.540+0000 7f92377fe700 1 -- 172.21.15.49:0/1793751339 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9248051930 con 0x7f925015a4e0 2023-07-21T22:12:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.716+0000 7f9254998700 1 -- 172.21.15.49:0/1793751339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f925004dcb0 con 0x7f925015a4e0 2023-07-21T22:12:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.716+0000 7f92377fe700 1 -- 172.21.15.49:0/1793751339 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7f9248054f50 con 0x7f925015a4e0 2023-07-21T22:12:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:04.763 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:12:04.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.724+0000 7f9254998700 1 -- 172.21.15.49:0/1793751339 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f923c066320 msgr2=0x7f923c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.724+0000 7f9254998700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f923c066320 0x7f923c0687d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9240000f60 tx=0x7f9240009040 comp rx=0 tx=0).stop 2023-07-21T22:12:04.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.724+0000 7f9254998700 1 -- 172.21.15.49:0/1793751339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f925015a4e0 msgr2=0x7f92500b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.724+0000 7f9254998700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f925015a4e0 0x7f92500b3590 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9248007e40 tx=0x7f924800e3c0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.724+0000 7f9254998700 1 -- 172.21.15.49:0/1793751339 shutdown_connections 2023-07-21T22:12:04.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.724+0000 7f9254998700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f923c066320 0x7f923c0687d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.724+0000 7f9254998700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f925015a4e0 0x7f92500b3590 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.724+0000 7f9254998700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9250160370 0x7f925015d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.724+0000 7f9254998700 1 --2- 172.21.15.49:0/1793751339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92500ca2c0 0x7f9250159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.724+0000 7f9254998700 1 -- 172.21.15.49:0/1793751339 >> 172.21.15.49:0/1793751339 conn(0x7f9250070450 msgr2=0x7f92500aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:04.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.724+0000 7f9254998700 1 -- 172.21.15.49:0/1793751339 shutdown_connections 2023-07-21T22:12:04.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.724+0000 7f9254998700 1 -- 172.21.15.49:0/1793751339 wait complete. 2023-07-21T22:12:04.791 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:10:32.913913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:10:33.637467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T22:10:37.289765+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T22:12:04.791 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:12:04.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.928+0000 7f7476abc700 1 Processor -- start 2023-07-21T22:12:04.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.928+0000 7f7476abc700 1 -- start start 2023-07-21T22:12:04.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f7476abc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74700cabe0 0x7f74700cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f7476abc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f747015f9d0 0x7f747015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f7476abc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74700c88c0 con 0x7f74700ce120 2023-07-21T22:12:04.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f7476abc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747015c220 con 0x7f74700cabe0 2023-07-21T22:12:04.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f7476abc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74700ca620 con 0x7f747015f9d0 2023-07-21T22:12:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f7474858700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74700cabe0 0x7f74700cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f7474858700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74700cabe0 0x7f74700cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43486/0 (socket says 172.21.15.49:43486) 2023-07-21T22:12:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f7474858700 1 -- 172.21.15.49:0/569242380 learned_addr learned my addr 172.21.15.49:0/569242380 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f746ffff700 1 --2- 172.21.15.49:0/569242380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f747015f9d0 0x7f747015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f746f7fe700 1 -- 172.21.15.49:0/569242380 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130918244 0 0) 0x7f74700c88c0 con 0x7f74700ce120 2023-07-21T22:12:04.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f7474858700 1 -- 172.21.15.49:0/569242380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f747015f9d0 msgr2=0x7f747015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:04.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f7474858700 1 --2- 172.21.15.49:0/569242380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f747015f9d0 0x7f747015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f7474858700 1 -- 172.21.15.49:0/569242380 >> v1:172.21.15.150:6789/0 conn(0x7f74700ce120 legacy=0x7f74700ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f7474858700 1 -- 172.21.15.49:0/569242380 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74700cb4f0 con 0x7f74700cabe0 2023-07-21T22:12:04.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f7474858700 1 --2- 172.21.15.49:0/569242380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74700cabe0 0x7f74700cafb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7464009940 tx=0x7f7464009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3afc76d8404b32 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:04.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f746f7fe700 1 -- 172.21.15.49:0/569242380 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464011830 con 0x7f74700cabe0 2023-07-21T22:12:04.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f746f7fe700 1 -- 172.21.15.49:0/569242380 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7464011990 con 0x7f74700cabe0 2023-07-21T22:12:04.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.932+0000 7f746f7fe700 1 -- 172.21.15.49:0/569242380 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464011d20 con 0x7f74700cabe0 2023-07-21T22:12:04.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.936+0000 7f7476abc700 1 -- 172.21.15.49:0/569242380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74700cabe0 msgr2=0x7f74700cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.936+0000 7f7476abc700 1 --2- 172.21.15.49:0/569242380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74700cabe0 0x7f74700cafb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7464009940 tx=0x7f7464009c50 comp rx=0 tx=0).stop 2023-07-21T22:12:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.936+0000 7f7476abc700 1 -- 172.21.15.49:0/569242380 shutdown_connections 2023-07-21T22:12:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.936+0000 7f7476abc700 1 --2- 172.21.15.49:0/569242380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f747015f9d0 0x7f747015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.936+0000 7f7476abc700 1 --2- 172.21.15.49:0/569242380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74700cabe0 0x7f74700cafb0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.936+0000 7f7476abc700 1 -- 172.21.15.49:0/569242380 >> 172.21.15.49:0/569242380 conn(0x7f747006e960 msgr2=0x7f747006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.936+0000 7f7476abc700 1 -- 172.21.15.49:0/569242380 shutdown_connections 2023-07-21T22:12:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.936+0000 7f7476abc700 1 -- 172.21.15.49:0/569242380 wait complete. 2023-07-21T22:12:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7476abc700 1 Processor -- start 2023-07-21T22:12:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7476abc700 1 -- start start 2023-07-21T22:12:04.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7476abc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74700cabe0 0x7f7470159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7476abc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74700ce120 0x7f74700ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7476abc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747015f9d0 0x7f74700ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7476abc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74700c7550 con 0x7f74700cabe0 2023-07-21T22:12:04.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7476abc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74700acc30 con 0x7f747015f9d0 2023-07-21T22:12:04.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7476abc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74700c6bb0 con 0x7f74700ce120 2023-07-21T22:12:04.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7474858700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74700cabe0 0x7f7470159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7474858700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74700cabe0 0x7f7470159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43492/0 (socket says 172.21.15.49:43492) 2023-07-21T22:12:04.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7474858700 1 -- 172.21.15.49:0/3035115107 learned_addr learned my addr 172.21.15.49:0/3035115107 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:04.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f746ffff700 1 --2- 172.21.15.49:0/3035115107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74700ce120 0x7f74700ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7475059700 1 --2- 172.21.15.49:0/3035115107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747015f9d0 0x7f74700ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7474858700 1 -- 172.21.15.49:0/3035115107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74700ce120 msgr2=0x7f74700ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7474858700 1 --2- 172.21.15.49:0/3035115107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74700ce120 0x7f74700ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7474858700 1 -- 172.21.15.49:0/3035115107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747015f9d0 msgr2=0x7f74700ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:04.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7474858700 1 --2- 172.21.15.49:0/3035115107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747015f9d0 0x7f74700ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:04.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7474858700 1 -- 172.21.15.49:0/3035115107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7464009570 con 0x7f74700cabe0 2023-07-21T22:12:04.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.940+0000 7f7474858700 1 --2- 172.21.15.49:0/3035115107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74700cabe0 0x7f7470159690 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7464014040 tx=0x7f7464004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:04.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.944+0000 7f746d7fa700 1 -- 172.21.15.49:0/3035115107 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746400b8b0 con 0x7f74700cabe0 2023-07-21T22:12:04.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.944+0000 7f746d7fa700 1 -- 172.21.15.49:0/3035115107 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746401e070 con 0x7f74700cabe0 2023-07-21T22:12:04.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.944+0000 7f746d7fa700 1 -- 172.21.15.49:0/3035115107 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746400bc10 con 0x7f74700cabe0 2023-07-21T22:12:04.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.944+0000 7f7476abc700 1 -- 172.21.15.49:0/3035115107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74700c6e90 con 0x7f74700cabe0 2023-07-21T22:12:04.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.944+0000 7f7476abc700 1 -- 172.21.15.49:0/3035115107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7470159bd0 con 0x7f74700cabe0 2023-07-21T22:12:04.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.944+0000 7f7476abc700 1 -- 172.21.15.49:0/3035115107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74700cc610 con 0x7f74700cabe0 2023-07-21T22:12:04.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.948+0000 7f746d7fa700 1 -- 172.21.15.49:0/3035115107 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f746400bd70 con 0x7f74700cabe0 2023-07-21T22:12:04.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.948+0000 7f746d7fa700 1 --2- 172.21.15.49:0/3035115107 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f74540662f0 0x7f74540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:04.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.948+0000 7f746d7fa700 1 -- 172.21.15.49:0/3035115107 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7464085040 con 0x7f74700cabe0 2023-07-21T22:12:04.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.948+0000 7f746ffff700 1 --2- 172.21.15.49:0/3035115107 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f74540662f0 0x7f74540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:04.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.948+0000 7f746ffff700 1 --2- 172.21.15.49:0/3035115107 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f74540662f0 0x7f74540687a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f747015e680 tx=0x7f745c0091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:05.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:04.956+0000 7f746d7fa700 1 -- 172.21.15.49:0/3035115107 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74640b5700 con 0x7f74700cabe0 2023-07-21T22:12:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.128+0000 7f7476abc700 1 -- 172.21.15.49:0/3035115107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74700ad9d0 con 0x7f74700cabe0 2023-07-21T22:12:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.128+0000 7f746d7fa700 1 -- 172.21.15.49:0/3035115107 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7464052100 con 0x7f74700cabe0 2023-07-21T22:12:05.174 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:12:05.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.132+0000 7f7476abc700 1 -- 172.21.15.49:0/3035115107 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f74540662f0 msgr2=0x7f74540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:05.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.132+0000 7f7476abc700 1 --2- 172.21.15.49:0/3035115107 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f74540662f0 0x7f74540687a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f747015e680 tx=0x7f745c0091c0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.132+0000 7f7476abc700 1 -- 172.21.15.49:0/3035115107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74700cabe0 msgr2=0x7f7470159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:05.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.132+0000 7f7476abc700 1 --2- 172.21.15.49:0/3035115107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74700cabe0 0x7f7470159690 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7464014040 tx=0x7f7464004770 comp rx=0 tx=0).stop 2023-07-21T22:12:05.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.132+0000 7f7476abc700 1 -- 172.21.15.49:0/3035115107 shutdown_connections 2023-07-21T22:12:05.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.132+0000 7f7476abc700 1 --2- 172.21.15.49:0/3035115107 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f74540662f0 0x7f74540687a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.132+0000 7f7476abc700 1 --2- 172.21.15.49:0/3035115107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747015f9d0 0x7f74700ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.132+0000 7f7476abc700 1 --2- 172.21.15.49:0/3035115107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74700ce120 0x7f74700ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.132+0000 7f7476abc700 1 --2- 172.21.15.49:0/3035115107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74700cabe0 0x7f7470159690 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.132+0000 7f7476abc700 1 -- 172.21.15.49:0/3035115107 >> 172.21.15.49:0/3035115107 conn(0x7f747006e960 msgr2=0x7f74700ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:05.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.132+0000 7f7476abc700 1 -- 172.21.15.49:0/3035115107 shutdown_connections 2023-07-21T22:12:05.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.132+0000 7f7476abc700 1 -- 172.21.15.49:0/3035115107 wait complete. 2023-07-21T22:12:05.198 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:12:05.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.332+0000 7fb149f25700 1 Processor -- start 2023-07-21T22:12:05.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb149f25700 1 -- start start 2023-07-21T22:12:05.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb149f25700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb1440cb2f0 0x7fb1440ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:05.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb149f25700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1440b3a50 0x7fb1440ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:05.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb149f25700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1440ca190 con 0x7fb14415e380 2023-07-21T22:12:05.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb149f25700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb144159fd0 con 0x7fb1440cb2f0 2023-07-21T22:12:05.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb149f25700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14415d6e0 con 0x7fb1440b3a50 2023-07-21T22:12:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb142ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb1440cb2f0 0x7fb1440ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb142ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb1440cb2f0 0x7fb1440ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:56834/0 (socket says 172.21.15.49:56834) 2023-07-21T22:12:05.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb142ffd700 1 -- 172.21.15.49:0/1020309073 learned_addr learned my addr 172.21.15.49:0/1020309073 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:05.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb143fff700 1 --2- 172.21.15.49:0/1020309073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1440b3a50 0x7fb1440ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:05.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb1427fc700 1 -- 172.21.15.49:0/1020309073 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73287758 0 0) 0x7fb1440ca190 con 0x7fb14415e380 2023-07-21T22:12:05.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb1427fc700 1 -- 172.21.15.49:0/1020309073 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb12c0035d0 con 0x7fb14415e380 2023-07-21T22:12:05.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb142ffd700 1 -- 172.21.15.49:0/1020309073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1440b3a50 msgr2=0x7fb1440ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:05.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb142ffd700 1 --2- 172.21.15.49:0/1020309073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1440b3a50 0x7fb1440ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.336+0000 7fb142ffd700 1 -- 172.21.15.49:0/1020309073 >> v1:172.21.15.150:6789/0 conn(0x7fb14415e380 legacy=0x7fb1440cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.340+0000 7fb142ffd700 1 -- 172.21.15.49:0/1020309073 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1440ca900 con 0x7fb1440cb2f0 2023-07-21T22:12:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.340+0000 7fb142ffd700 1 --2- 172.21.15.49:0/1020309073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1440cb2f0 0x7fb1440ce160 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb138009910 tx=0x7fb138009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65ec40bc5b6c9b22 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.340+0000 7fb1427fc700 1 -- 172.21.15.49:0/1020309073 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138005e50 con 0x7fb1440cb2f0 2023-07-21T22:12:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.340+0000 7fb1427fc700 1 -- 172.21.15.49:0/1020309073 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb138006030 con 0x7fb1440cb2f0 2023-07-21T22:12:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.340+0000 7fb1427fc700 1 -- 172.21.15.49:0/1020309073 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1380063e0 con 0x7fb1440cb2f0 2023-07-21T22:12:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.340+0000 7fb149f25700 1 -- 172.21.15.49:0/1020309073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1440cb2f0 msgr2=0x7fb1440ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:05.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.340+0000 7fb149f25700 1 --2- 172.21.15.49:0/1020309073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1440cb2f0 0x7fb1440ce160 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb138009910 tx=0x7fb138009c20 comp rx=0 tx=0).stop 2023-07-21T22:12:05.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.340+0000 7fb149f25700 1 -- 172.21.15.49:0/1020309073 shutdown_connections 2023-07-21T22:12:05.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.340+0000 7fb149f25700 1 --2- 172.21.15.49:0/1020309073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1440b3a50 0x7fb1440ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.340+0000 7fb149f25700 1 --2- 172.21.15.49:0/1020309073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1440cb2f0 0x7fb1440ce160 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.340+0000 7fb149f25700 1 -- 172.21.15.49:0/1020309073 >> 172.21.15.49:0/1020309073 conn(0x7fb14406e960 msgr2=0x7fb14406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:05.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.340+0000 7fb149f25700 1 -- 172.21.15.49:0/1020309073 shutdown_connections 2023-07-21T22:12:05.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.340+0000 7fb149f25700 1 -- 172.21.15.49:0/1020309073 wait complete. 2023-07-21T22:12:05.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.344+0000 7fb149f25700 1 Processor -- start 2023-07-21T22:12:05.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.344+0000 7fb149f25700 1 -- start start 2023-07-21T22:12:05.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb149f25700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1440b3a50 0x7fb14414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:05.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb149f25700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1440cb2f0 0x7fb144156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:05.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb149f25700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb14415e380 0x7fb14415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb149f25700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1441f7ed0 con 0x7fb1440b3a50 2023-07-21T22:12:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb149f25700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1441f72c0 con 0x7fb14415e380 2023-07-21T22:12:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb149f25700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1441f75a0 con 0x7fb1440cb2f0 2023-07-21T22:12:05.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb1437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1440b3a50 0x7fb14414a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:05.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb1437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1440b3a50 0x7fb14414a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43508/0 (socket says 172.21.15.49:43508) 2023-07-21T22:12:05.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb1437fe700 1 -- 172.21.15.49:0/2334476559 learned_addr learned my addr 172.21.15.49:0/2334476559 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:05.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb143fff700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb14415e380 0x7fb14415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:05.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb142ffd700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1440cb2f0 0x7fb144156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:05.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb1437fe700 1 -- 172.21.15.49:0/2334476559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1440cb2f0 msgr2=0x7fb144156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:05.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb1437fe700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1440cb2f0 0x7fb144156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb1437fe700 1 -- 172.21.15.49:0/2334476559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb14415e380 msgr2=0x7fb14415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:05.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb1437fe700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb14415e380 0x7fb14415a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb1437fe700 1 -- 172.21.15.49:0/2334476559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138009520 con 0x7fb1440b3a50 2023-07-21T22:12:05.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb142ffd700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1440cb2f0 0x7fb144156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:05.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb1437fe700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1440b3a50 0x7fb14414a730 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb134001f00 tx=0x7fb13400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:05.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb12bfff700 1 -- 172.21.15.49:0/2334476559 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134003c20 con 0x7fb1440b3a50 2023-07-21T22:12:05.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb12bfff700 1 -- 172.21.15.49:0/2334476559 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134003d80 con 0x7fb1440b3a50 2023-07-21T22:12:05.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb12bfff700 1 -- 172.21.15.49:0/2334476559 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13400ac60 con 0x7fb1440b3a50 2023-07-21T22:12:05.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb149f25700 1 -- 172.21.15.49:0/2334476559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1441f7880 con 0x7fb1440b3a50 2023-07-21T22:12:05.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.348+0000 7fb149f25700 1 -- 172.21.15.49:0/2334476559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1441570b0 con 0x7fb1440b3a50 2023-07-21T22:12:05.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.352+0000 7fb149f25700 1 -- 172.21.15.49:0/2334476559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb144071860 con 0x7fb1440b3a50 2023-07-21T22:12:05.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.352+0000 7fb12bfff700 1 -- 172.21.15.49:0/2334476559 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb1340050d0 con 0x7fb1440b3a50 2023-07-21T22:12:05.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.356+0000 7fb12bfff700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb130066320 0x7fb1300687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:05.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.356+0000 7fb12bfff700 1 -- 172.21.15.49:0/2334476559 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb134084140 con 0x7fb1440b3a50 2023-07-21T22:12:05.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.356+0000 7fb142ffd700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb130066320 0x7fb1300687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:05.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.356+0000 7fb142ffd700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb130066320 0x7fb1300687d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb138006000 tx=0x7fb138008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:05.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.360+0000 7fb12bfff700 1 -- 172.21.15.49:0/2334476559 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb144071860 con 0x7fb1440b3a50 2023-07-21T22:12:05.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.532+0000 7fb149f25700 1 -- 172.21.15.49:0/2334476559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb144071860 con 0x7fb1440b3a50 2023-07-21T22:12:05.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.536+0000 7fb12bfff700 1 -- 172.21.15.49:0/2334476559 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb144071860 con 0x7fb1440b3a50 2023-07-21T22:12:05.580 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:12:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.536+0000 7fb149f25700 1 -- 172.21.15.49:0/2334476559 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb130066320 msgr2=0x7fb1300687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.536+0000 7fb149f25700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb130066320 0x7fb1300687d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb138006000 tx=0x7fb138008070 comp rx=0 tx=0).stop 2023-07-21T22:12:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.536+0000 7fb149f25700 1 -- 172.21.15.49:0/2334476559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1440b3a50 msgr2=0x7fb14414a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.536+0000 7fb149f25700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1440b3a50 0x7fb14414a730 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb134001f00 tx=0x7fb13400a060 comp rx=0 tx=0).stop 2023-07-21T22:12:05.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.536+0000 7fb149f25700 1 -- 172.21.15.49:0/2334476559 shutdown_connections 2023-07-21T22:12:05.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.536+0000 7fb149f25700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb130066320 0x7fb1300687d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.536+0000 7fb149f25700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb14415e380 0x7fb14415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.536+0000 7fb149f25700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1440cb2f0 0x7fb144156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.536+0000 7fb149f25700 1 --2- 172.21.15.49:0/2334476559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1440b3a50 0x7fb14414a730 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.536+0000 7fb149f25700 1 -- 172.21.15.49:0/2334476559 >> 172.21.15.49:0/2334476559 conn(0x7fb14406e960 msgr2=0x7fb1440c1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:05.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.540+0000 7fb149f25700 1 -- 172.21.15.49:0/2334476559 shutdown_connections 2023-07-21T22:12:05.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.540+0000 7fb149f25700 1 -- 172.21.15.49:0/2334476559 wait complete. 2023-07-21T22:12:05.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:12:05.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.740+0000 7f121cd24700 1 Processor -- start 2023-07-21T22:12:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.740+0000 7f121cd24700 1 -- start start 2023-07-21T22:12:05.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f121cd24700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f12180d1e40 0x7f12180b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:05.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f121cd24700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f12180cee10 0x7f12180cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:05.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f121cd24700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12180b3e80 con 0x7f12180b7af0 2023-07-21T22:12:05.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f12177fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f12180b7af0 0x7f121815f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53066/0 (socket says 172.21.15.49:53066) 2023-07-21T22:12:05.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f12177fe700 1 -- 172.21.15.49:0/4149761571 learned_addr learned my addr 172.21.15.49:0/4149761571 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:05.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f121cd24700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12180cf790 con 0x7f12180cee10 2023-07-21T22:12:05.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f1217fff700 1 --2- 172.21.15.49:0/4149761571 >> v2:172.21.15.49:3300/0 conn(0x7f12180cee10 0x7f12180cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:05.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f121cd24700 1 -- 172.21.15.49:0/4149761571 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121815fd40 con 0x7f12180d1e40 2023-07-21T22:12:05.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f1216ffd700 1 --2- 172.21.15.49:0/4149761571 >> v2:172.21.15.150:3300/0 conn(0x7f12180d1e40 0x7f12180b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:05.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f12167fc700 1 -- 172.21.15.49:0/4149761571 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047719163 0 0) 0x7f12180b3e80 con 0x7f12180b7af0 2023-07-21T22:12:05.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f12167fc700 1 -- 172.21.15.49:0/4149761571 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12000035d0 con 0x7f12180b7af0 2023-07-21T22:12:05.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f1217fff700 1 -- 172.21.15.49:0/4149761571 >> v2:172.21.15.150:3300/0 conn(0x7f12180d1e40 msgr2=0x7f12180b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:05.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f1217fff700 1 --2- 172.21.15.49:0/4149761571 >> v2:172.21.15.150:3300/0 conn(0x7f12180d1e40 0x7f12180b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f1217fff700 1 -- 172.21.15.49:0/4149761571 >> v1:172.21.15.49:6789/0 conn(0x7f12180b7af0 legacy=0x7f121815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:05.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f12167fc700 1 -- 172.21.15.49:0/4149761571 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 105798461 0 0) 0x7f12000035d0 con 0x7f12180b7af0 2023-07-21T22:12:05.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f1217fff700 1 -- 172.21.15.49:0/4149761571 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12180cea00 con 0x7f12180cee10 2023-07-21T22:12:05.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f1216ffd700 1 --2- 172.21.15.49:0/4149761571 >> v2:172.21.15.150:3300/0 conn(0x7f12180d1e40 0x7f12180b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:05.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f1217fff700 1 --2- 172.21.15.49:0/4149761571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12180cee10 0x7f12180cf250 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f12180d1200 tx=0x7f121000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1195f6f2d36de0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:05.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f12167fc700 1 -- 172.21.15.49:0/4149761571 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121000e070 con 0x7f12180cee10 2023-07-21T22:12:05.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f12167fc700 1 -- 172.21.15.49:0/4149761571 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1210003a90 con 0x7f12180cee10 2023-07-21T22:12:05.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f12167fc700 1 -- 172.21.15.49:0/4149761571 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1208001670 con 0x7f12180cee10 2023-07-21T22:12:05.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f121cd24700 1 -- 172.21.15.49:0/4149761571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12180cee10 msgr2=0x7f12180cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:05.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f121cd24700 1 --2- 172.21.15.49:0/4149761571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12180cee10 0x7f12180cf250 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f12180d1200 tx=0x7f121000b330 comp rx=0 tx=0).stop 2023-07-21T22:12:05.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f121cd24700 1 -- 172.21.15.49:0/4149761571 shutdown_connections 2023-07-21T22:12:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f121cd24700 1 --2- 172.21.15.49:0/4149761571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12180cee10 0x7f12180cf250 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f121cd24700 1 --2- 172.21.15.49:0/4149761571 >> v2:172.21.15.150:3300/0 conn(0x7f12180d1e40 0x7f12180b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f121cd24700 1 -- 172.21.15.49:0/4149761571 >> 172.21.15.49:0/4149761571 conn(0x7f121806e960 msgr2=0x7f121806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f121cd24700 1 -- 172.21.15.49:0/4149761571 shutdown_connections 2023-07-21T22:12:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.744+0000 7f121cd24700 1 -- 172.21.15.49:0/4149761571 wait complete. 2023-07-21T22:12:05.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.748+0000 7f121cd24700 1 Processor -- start 2023-07-21T22:12:05.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.748+0000 7f121cd24700 1 -- start start 2023-07-21T22:12:05.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f121cd24700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12180b7af0 0x7f1218153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:05.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f121cd24700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12180cee10 0x7f12180cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:05.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f121cd24700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12180d1e40 0x7f12181590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:05.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f121cd24700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12180cae40 con 0x7f12180d1e40 2023-07-21T22:12:05.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f121cd24700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12180cb120 con 0x7f12180cee10 2023-07-21T22:12:05.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f121cd24700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12180cb400 con 0x7f12180b7af0 2023-07-21T22:12:05.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f1217fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12180d1e40 0x7f12181590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:05.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f1217fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12180d1e40 0x7f12181590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43526/0 (socket says 172.21.15.49:43526) 2023-07-21T22:12:05.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f1217fff700 1 -- 172.21.15.49:0/4006347570 learned_addr learned my addr 172.21.15.49:0/4006347570 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:05.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f1216ffd700 1 --2- 172.21.15.49:0/4006347570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12180cee10 0x7f12180cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f12177fe700 1 --2- 172.21.15.49:0/4006347570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12180b7af0 0x7f1218153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f1217fff700 1 -- 172.21.15.49:0/4006347570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12180b7af0 msgr2=0x7f1218153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f1217fff700 1 --2- 172.21.15.49:0/4006347570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12180b7af0 0x7f1218153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f1217fff700 1 -- 172.21.15.49:0/4006347570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12180cee10 msgr2=0x7f12180cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f1217fff700 1 --2- 172.21.15.49:0/4006347570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12180cee10 0x7f12180cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f1217fff700 1 -- 172.21.15.49:0/4006347570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1210009a70 con 0x7f12180d1e40 2023-07-21T22:12:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f1217fff700 1 --2- 172.21.15.49:0/4006347570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12180d1e40 0x7f12181590d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f12180b4ff0 tx=0x7f1210004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f11fffff700 1 -- 172.21.15.49:0/4006347570 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100046f0 con 0x7f12180d1e40 2023-07-21T22:12:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f11fffff700 1 -- 172.21.15.49:0/4006347570 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1210004850 con 0x7f12180d1e40 2023-07-21T22:12:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f121cd24700 1 -- 172.21.15.49:0/4006347570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12180cb6e0 con 0x7f12180d1e40 2023-07-21T22:12:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f11fffff700 1 -- 172.21.15.49:0/4006347570 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121001c680 con 0x7f12180d1e40 2023-07-21T22:12:05.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.752+0000 7f121cd24700 1 -- 172.21.15.49:0/4006347570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1218153d60 con 0x7f12180d1e40 2023-07-21T22:12:05.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.756+0000 7f121cd24700 1 -- 172.21.15.49:0/4006347570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12180cbc00 con 0x7f12180d1e40 2023-07-21T22:12:05.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.756+0000 7f11fffff700 1 -- 172.21.15.49:0/4006347570 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f121001c7e0 con 0x7f12180d1e40 2023-07-21T22:12:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.756+0000 7f11fffff700 1 --2- 172.21.15.49:0/4006347570 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f12040662f0 0x7f12040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.756+0000 7f11fffff700 1 -- 172.21.15.49:0/4006347570 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1210006e40 con 0x7f12180d1e40 2023-07-21T22:12:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.760+0000 7f12177fe700 1 --2- 172.21.15.49:0/4006347570 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f12040662f0 0x7f12040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.760+0000 7f12177fe700 1 --2- 172.21.15.49:0/4006347570 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f12040662f0 0x7f12040687a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1208001eb0 tx=0x7f1208001c60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.764+0000 7f11fffff700 1 -- 172.21.15.49:0/4006347570 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12180cbc00 con 0x7f12180d1e40 2023-07-21T22:12:05.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.940+0000 7f121cd24700 1 -- 172.21.15.49:0/4006347570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12180cbc00 con 0x7f12180d1e40 2023-07-21T22:12:05.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.940+0000 7f11fffff700 1 -- 172.21.15.49:0/4006347570 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12180cbc00 con 0x7f12180d1e40 2023-07-21T22:12:05.985 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:12:05.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.944+0000 7f121cd24700 1 -- 172.21.15.49:0/4006347570 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f12040662f0 msgr2=0x7f12040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:05.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.944+0000 7f121cd24700 1 --2- 172.21.15.49:0/4006347570 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f12040662f0 0x7f12040687a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1208001eb0 tx=0x7f1208001c60 comp rx=0 tx=0).stop 2023-07-21T22:12:05.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.944+0000 7f121cd24700 1 -- 172.21.15.49:0/4006347570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12180d1e40 msgr2=0x7f12181590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:05.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.944+0000 7f121cd24700 1 --2- 172.21.15.49:0/4006347570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12180d1e40 0x7f12181590d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f12180b4ff0 tx=0x7f1210004b40 comp rx=0 tx=0).stop 2023-07-21T22:12:05.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.944+0000 7f121cd24700 1 -- 172.21.15.49:0/4006347570 shutdown_connections 2023-07-21T22:12:05.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.944+0000 7f121cd24700 1 --2- 172.21.15.49:0/4006347570 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f12040662f0 0x7f12040687a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.944+0000 7f121cd24700 1 --2- 172.21.15.49:0/4006347570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12180d1e40 0x7f12181590d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.944+0000 7f121cd24700 1 --2- 172.21.15.49:0/4006347570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12180cee10 0x7f12180cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.944+0000 7f121cd24700 1 --2- 172.21.15.49:0/4006347570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12180b7af0 0x7f1218153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:05.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.944+0000 7f121cd24700 1 -- 172.21.15.49:0/4006347570 >> 172.21.15.49:0/4006347570 conn(0x7f121806e960 msgr2=0x7f12180722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:05.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.944+0000 7f121cd24700 1 -- 172.21.15.49:0/4006347570 shutdown_connections 2023-07-21T22:12:05.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:05.944+0000 7f121cd24700 1 -- 172.21.15.49:0/4006347570 wait complete. 2023-07-21T22:12:06.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:12:06.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.152+0000 7fa78032d700 1 Processor -- start 2023-07-21T22:12:06.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.152+0000 7fa78032d700 1 -- start start 2023-07-21T22:12:06.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.152+0000 7fa78032d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7780ce650 0x7fa77815c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:06.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.152+0000 7fa78032d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7780c9990 0x7fa77815cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:06.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.152+0000 7fa78032d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7780c8bd0 con 0x7fa7781564c0 2023-07-21T22:12:06.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.152+0000 7fa78032d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7780c9570 con 0x7fa7780c9990 2023-07-21T22:12:06.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.152+0000 7fa78032d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780c8eb0 con 0x7fa7780ce650 2023-07-21T22:12:06.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.152+0000 7fa77e8ca700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7780c9990 0x7fa77815cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:06.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa77e0c9700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa7781564c0 0x7fa7780cdf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53078/0 (socket says 172.21.15.49:53078) 2023-07-21T22:12:06.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa77e0c9700 1 -- 172.21.15.49:0/1876635185 learned_addr learned my addr 172.21.15.49:0/1876635185 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:06.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa77d8c8700 1 --2- 172.21.15.49:0/1876635185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7780ce650 0x7fa77815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa77e8ca700 1 -- 172.21.15.49:0/1876635185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7780ce650 msgr2=0x7fa77815c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa77e8ca700 1 --2- 172.21.15.49:0/1876635185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7780ce650 0x7fa77815c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa77e8ca700 1 -- 172.21.15.49:0/1876635185 >> v1:172.21.15.49:6789/0 conn(0x7fa7781564c0 legacy=0x7fa7780cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa77e8ca700 1 -- 172.21.15.49:0/1876635185 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780c9190 con 0x7fa7780c9990 2023-07-21T22:12:06.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa77d0c7700 1 -- 172.21.15.49:0/1876635185 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543387562 0 0) 0x7fa7780c8bd0 con 0x7fa7781564c0 2023-07-21T22:12:06.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa77e8ca700 1 --2- 172.21.15.49:0/1876635185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7780c9990 0x7fa77815cdd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa770009d90 tx=0x7fa77000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79cce65f0f538ba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa77d0c7700 1 -- 172.21.15.49:0/1876635185 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77000e070 con 0x7fa7780c9990 2023-07-21T22:12:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa77d0c7700 1 -- 172.21.15.49:0/1876635185 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77000bb20 con 0x7fa7780c9990 2023-07-21T22:12:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa77d0c7700 1 -- 172.21.15.49:0/1876635185 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770012430 con 0x7fa7780c9990 2023-07-21T22:12:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa78032d700 1 -- 172.21.15.49:0/1876635185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7780c9990 msgr2=0x7fa77815cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa78032d700 1 --2- 172.21.15.49:0/1876635185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7780c9990 0x7fa77815cdd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa770009d90 tx=0x7fa77000b330 comp rx=0 tx=0).stop 2023-07-21T22:12:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa78032d700 1 -- 172.21.15.49:0/1876635185 shutdown_connections 2023-07-21T22:12:06.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa78032d700 1 --2- 172.21.15.49:0/1876635185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7780c9990 0x7fa77815cdd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa78032d700 1 --2- 172.21.15.49:0/1876635185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7780ce650 0x7fa77815c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa78032d700 1 -- 172.21.15.49:0/1876635185 >> 172.21.15.49:0/1876635185 conn(0x7fa77806e960 msgr2=0x7fa77806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:06.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa78032d700 1 -- 172.21.15.49:0/1876635185 shutdown_connections 2023-07-21T22:12:06.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.156+0000 7fa78032d700 1 -- 172.21.15.49:0/1876635185 wait complete. 2023-07-21T22:12:06.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.160+0000 7fa78032d700 1 Processor -- start 2023-07-21T22:12:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.160+0000 7fa78032d700 1 -- start start 2023-07-21T22:12:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.160+0000 7fa78032d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7780c9990 0x7fa778150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.160+0000 7fa78032d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7780ce650 0x7fa7780c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.160+0000 7fa78032d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7781564c0 0x7fa778152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:06.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.160+0000 7fa78032d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780b1040 con 0x7fa7780c9990 2023-07-21T22:12:06.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.160+0000 7fa78032d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780b2d00 con 0x7fa7780ce650 2023-07-21T22:12:06.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.160+0000 7fa78032d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780b2f50 con 0x7fa7781564c0 2023-07-21T22:12:06.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.160+0000 7fa77e0c9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7780c9990 0x7fa778150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:06.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa77e0c9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7780c9990 0x7fa778150d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43546/0 (socket says 172.21.15.49:43546) 2023-07-21T22:12:06.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa77e0c9700 1 -- 172.21.15.49:0/676937380 learned_addr learned my addr 172.21.15.49:0/676937380 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:06.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa77e8ca700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7781564c0 0x7fa778152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:06.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa77d8c8700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7780ce650 0x7fa7780c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa77e0c9700 1 -- 172.21.15.49:0/676937380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7781564c0 msgr2=0x7fa778152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa77e0c9700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7781564c0 0x7fa778152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa77e0c9700 1 -- 172.21.15.49:0/676937380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7780ce650 msgr2=0x7fa7780c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa77e0c9700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7780ce650 0x7fa7780c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa77e0c9700 1 -- 172.21.15.49:0/676937380 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa770009a70 con 0x7fa7780c9990 2023-07-21T22:12:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa77e8ca700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7781564c0 0x7fa778152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa77e0c9700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7780c9990 0x7fa778150d00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa77400c4e0 tx=0x7fa77400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa76effd700 1 -- 172.21.15.49:0/676937380 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774004ca0 con 0x7fa7780c9990 2023-07-21T22:12:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa78032d700 1 -- 172.21.15.49:0/676937380 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7780b3230 con 0x7fa7780c9990 2023-07-21T22:12:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa76effd700 1 -- 172.21.15.49:0/676937380 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa774004e20 con 0x7fa7780c9990 2023-07-21T22:12:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa76effd700 1 -- 172.21.15.49:0/676937380 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774007310 con 0x7fa7780c9990 2023-07-21T22:12:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.164+0000 7fa78032d700 1 -- 172.21.15.49:0/676937380 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa778151240 con 0x7fa7780c9990 2023-07-21T22:12:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.168+0000 7fa78032d700 1 -- 172.21.15.49:0/676937380 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77806cb40 con 0x7fa7780c9990 2023-07-21T22:12:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.168+0000 7fa76effd700 1 -- 172.21.15.49:0/676937380 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa774007470 con 0x7fa7780c9990 2023-07-21T22:12:06.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.168+0000 7fa76effd700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa75c0662f0 0x7fa75c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:06.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.168+0000 7fa76effd700 1 -- 172.21.15.49:0/676937380 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa774083de0 con 0x7fa7780c9990 2023-07-21T22:12:06.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.168+0000 7fa77d8c8700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa75c0662f0 0x7fa75c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:06.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.168+0000 7fa77d8c8700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa75c0662f0 0x7fa75c0687a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa778070790 tx=0x7fa768008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:06.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.176+0000 7fa76effd700 1 -- 172.21.15.49:0/676937380 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa774050e20 con 0x7fa7780c9990 2023-07-21T22:12:06.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.348+0000 7fa78032d700 1 -- 172.21.15.49:0/676937380 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa77804dd50 con 0x7fa7780c9990 2023-07-21T22:12:06.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.348+0000 7fa76effd700 1 -- 172.21.15.49:0/676937380 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa774007720 con 0x7fa7780c9990 2023-07-21T22:12:06.394 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:12:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.352+0000 7fa78032d700 1 -- 172.21.15.49:0/676937380 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa75c0662f0 msgr2=0x7fa75c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.352+0000 7fa78032d700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa75c0662f0 0x7fa75c0687a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa778070790 tx=0x7fa768008040 comp rx=0 tx=0).stop 2023-07-21T22:12:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.352+0000 7fa78032d700 1 -- 172.21.15.49:0/676937380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7780c9990 msgr2=0x7fa778150d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.352+0000 7fa78032d700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7780c9990 0x7fa778150d00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa77400c4e0 tx=0x7fa77400c8a0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.352+0000 7fa78032d700 1 -- 172.21.15.49:0/676937380 shutdown_connections 2023-07-21T22:12:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.352+0000 7fa78032d700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa75c0662f0 0x7fa75c0687a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.352+0000 7fa78032d700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7781564c0 0x7fa778152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.352+0000 7fa78032d700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7780ce650 0x7fa7780c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.352+0000 7fa78032d700 1 --2- 172.21.15.49:0/676937380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7780c9990 0x7fa778150d00 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.352+0000 7fa78032d700 1 -- 172.21.15.49:0/676937380 >> 172.21.15.49:0/676937380 conn(0x7fa77806e960 msgr2=0x7fa77806c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:06.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.356+0000 7fa78032d700 1 -- 172.21.15.49:0/676937380 shutdown_connections 2023-07-21T22:12:06.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.356+0000 7fa78032d700 1 -- 172.21.15.49:0/676937380 wait complete. 2023-07-21T22:12:06.420 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T22:12:06.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.560+0000 7f27a3e89700 1 Processor -- start 2023-07-21T22:12:06.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.560+0000 7f27a3e89700 1 -- start start 2023-07-21T22:12:06.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.560+0000 7f27a3e89700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f279c160110 0x7f279c0cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:06.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a3e89700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f279c0cb2f0 0x7f279c163d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:06.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a3e89700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279c0cdf00 con 0x7f279c071220 2023-07-21T22:12:06.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a3e89700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279c0cd730 con 0x7f279c0cb2f0 2023-07-21T22:12:06.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a3e89700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279c0ce600 con 0x7f279c160110 2023-07-21T22:12:06.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a2426700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f279c0cb2f0 0x7f279c163d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:06.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a2426700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f279c0cb2f0 0x7f279c163d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43548/0 (socket says 172.21.15.49:43548) 2023-07-21T22:12:06.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a2426700 1 -- 172.21.15.49:0/1428771946 learned_addr learned my addr 172.21.15.49:0/1428771946 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:06.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a1c25700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f279c160110 0x7f279c0cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:06.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a2426700 1 -- 172.21.15.49:0/1428771946 >> v2:172.21.15.150:3300/0 conn(0x7f279c160110 msgr2=0x7f279c0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a2426700 1 --2- 172.21.15.49:0/1428771946 >> v2:172.21.15.150:3300/0 conn(0x7f279c160110 0x7f279c0cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a2426700 1 -- 172.21.15.49:0/1428771946 >> v1:172.21.15.150:6789/0 conn(0x7f279c071220 legacy=0x7f279c0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:06.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a2426700 1 -- 172.21.15.49:0/1428771946 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c0cefd0 con 0x7f279c0cb2f0 2023-07-21T22:12:06.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a0c23700 1 -- 172.21.15.49:0/1428771946 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861481383 0 0) 0x7f279c0cdf00 con 0x7f279c071220 2023-07-21T22:12:06.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a2426700 1 --2- 172.21.15.49:0/1428771946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f279c0cb2f0 0x7f279c163d40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f279c0cabb0 tx=0x7f279400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285896577e8ae87a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:06.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a0c23700 1 -- 172.21.15.49:0/1428771946 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279400e070 con 0x7f279c0cb2f0 2023-07-21T22:12:06.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a0c23700 1 -- 172.21.15.49:0/1428771946 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279400b910 con 0x7f279c0cb2f0 2023-07-21T22:12:06.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a0c23700 1 -- 172.21.15.49:0/1428771946 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279400bcc0 con 0x7f279c0cb2f0 2023-07-21T22:12:06.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a3e89700 1 -- 172.21.15.49:0/1428771946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f279c0cb2f0 msgr2=0x7f279c163d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:06.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.564+0000 7f27a3e89700 1 --2- 172.21.15.49:0/1428771946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f279c0cb2f0 0x7f279c163d40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f279c0cabb0 tx=0x7f279400b330 comp rx=0 tx=0).stop 2023-07-21T22:12:06.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.568+0000 7f27a3e89700 1 -- 172.21.15.49:0/1428771946 shutdown_connections 2023-07-21T22:12:06.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.568+0000 7f27a3e89700 1 --2- 172.21.15.49:0/1428771946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f279c0cb2f0 0x7f279c163d40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.568+0000 7f27a3e89700 1 --2- 172.21.15.49:0/1428771946 >> v2:172.21.15.150:3300/0 conn(0x7f279c160110 0x7f279c0cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.568+0000 7f27a3e89700 1 -- 172.21.15.49:0/1428771946 >> 172.21.15.49:0/1428771946 conn(0x7f279c06e960 msgr2=0x7f279c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:06.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.568+0000 7f27a3e89700 1 -- 172.21.15.49:0/1428771946 shutdown_connections 2023-07-21T22:12:06.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.568+0000 7f27a3e89700 1 -- 172.21.15.49:0/1428771946 wait complete. 2023-07-21T22:12:06.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a3e89700 1 Processor -- start 2023-07-21T22:12:06.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a3e89700 1 -- start start 2023-07-21T22:12:06.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a3e89700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f279c071220 0x7f279c15bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:06.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a3e89700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f279c0cb2f0 0x7f279c1f8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:06.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a3e89700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c160110 0x7f279c1f9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:06.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a3e89700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c15c520 con 0x7f279c0cb2f0 2023-07-21T22:12:06.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a3e89700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c15c800 con 0x7f279c160110 2023-07-21T22:12:06.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a3e89700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0c5340 con 0x7f279c071220 2023-07-21T22:12:06.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a1424700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f279c0cb2f0 0x7f279c1f8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:06.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a1424700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f279c0cb2f0 0x7f279c1f8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43554/0 (socket says 172.21.15.49:43554) 2023-07-21T22:12:06.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a1424700 1 -- 172.21.15.49:0/2719733900 learned_addr learned my addr 172.21.15.49:0/2719733900 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:06.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a2426700 1 --2- 172.21.15.49:0/2719733900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c160110 0x7f279c1f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:06.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a1c25700 1 --2- 172.21.15.49:0/2719733900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f279c071220 0x7f279c15bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:06.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a1424700 1 -- 172.21.15.49:0/2719733900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f279c071220 msgr2=0x7f279c15bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:06.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a1424700 1 --2- 172.21.15.49:0/2719733900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f279c071220 0x7f279c15bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a1424700 1 -- 172.21.15.49:0/2719733900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c160110 msgr2=0x7f279c1f9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:06.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a1424700 1 --2- 172.21.15.49:0/2719733900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c160110 0x7f279c1f9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a1424700 1 -- 172.21.15.49:0/2719733900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2794009b30 con 0x7f279c0cb2f0 2023-07-21T22:12:06.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.572+0000 7f27a1424700 1 --2- 172.21.15.49:0/2719733900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f279c0cb2f0 0x7f279c1f8dc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f278c00c550 tx=0x7f278c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:06.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.576+0000 7f27927fc700 1 -- 172.21.15.49:0/2719733900 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c0054e0 con 0x7f279c0cb2f0 2023-07-21T22:12:06.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.576+0000 7f27927fc700 1 -- 172.21.15.49:0/2719733900 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c0036f0 con 0x7f279c0cb2f0 2023-07-21T22:12:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.576+0000 7f27a3e89700 1 -- 172.21.15.49:0/2719733900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c0c5620 con 0x7f279c0cb2f0 2023-07-21T22:12:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.576+0000 7f27927fc700 1 -- 172.21.15.49:0/2719733900 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c003aa0 con 0x7f279c0cb2f0 2023-07-21T22:12:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.576+0000 7f27a3e89700 1 -- 172.21.15.49:0/2719733900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279c14ccc0 con 0x7f279c0cb2f0 2023-07-21T22:12:06.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.576+0000 7f27a3e89700 1 -- 172.21.15.49:0/2719733900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279c04dd50 con 0x7f279c0cb2f0 2023-07-21T22:12:06.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.580+0000 7f27927fc700 1 -- 172.21.15.49:0/2719733900 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f278c003c00 con 0x7f279c0cb2f0 2023-07-21T22:12:06.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.580+0000 7f27927fc700 1 --2- 172.21.15.49:0/2719733900 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2780066370 0x7f2780068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.580+0000 7f27927fc700 1 -- 172.21.15.49:0/2719733900 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f278c083450 con 0x7f279c0cb2f0 2023-07-21T22:12:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.580+0000 7f27a1c25700 1 --2- 172.21.15.49:0/2719733900 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2780066370 0x7f2780068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:06.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.580+0000 7f27a1c25700 1 --2- 172.21.15.49:0/2719733900 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2780066370 0x7f2780068820 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2798009bf0 tx=0x7f2798009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:06.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.584+0000 7f27927fc700 1 -- 172.21.15.49:0/2719733900 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f278c050580 con 0x7f279c0cb2f0 2023-07-21T22:12:06.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.756+0000 7f27a3e89700 1 -- 172.21.15.49:0/2719733900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f279c071000 con 0x7f279c0cb2f0 2023-07-21T22:12:06.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.760+0000 7f27927fc700 1 -- 172.21.15.49:0/2719733900 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f278c053ba0 con 0x7f279c0cb2f0 2023-07-21T22:12:06.803 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:12:06.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.764+0000 7f27a3e89700 1 -- 172.21.15.49:0/2719733900 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2780066370 msgr2=0x7f2780068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:06.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.764+0000 7f27a3e89700 1 --2- 172.21.15.49:0/2719733900 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2780066370 0x7f2780068820 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2798009bf0 tx=0x7f2798009240 comp rx=0 tx=0).stop 2023-07-21T22:12:06.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.764+0000 7f27a3e89700 1 -- 172.21.15.49:0/2719733900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f279c0cb2f0 msgr2=0x7f279c1f8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:06.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.764+0000 7f27a3e89700 1 --2- 172.21.15.49:0/2719733900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f279c0cb2f0 0x7f279c1f8dc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f278c00c550 tx=0x7f278c00c860 comp rx=0 tx=0).stop 2023-07-21T22:12:06.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.764+0000 7f27a3e89700 1 -- 172.21.15.49:0/2719733900 shutdown_connections 2023-07-21T22:12:06.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.764+0000 7f27a3e89700 1 --2- 172.21.15.49:0/2719733900 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2780066370 0x7f2780068820 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.764+0000 7f27a3e89700 1 --2- 172.21.15.49:0/2719733900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f279c0cb2f0 0x7f279c1f8dc0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.764+0000 7f27a3e89700 1 --2- 172.21.15.49:0/2719733900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c160110 0x7f279c1f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.764+0000 7f27a3e89700 1 --2- 172.21.15.49:0/2719733900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f279c071220 0x7f279c15bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:06.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.764+0000 7f27a3e89700 1 -- 172.21.15.49:0/2719733900 >> 172.21.15.49:0/2719733900 conn(0x7f279c06e960 msgr2=0x7f279c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:06.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.764+0000 7f27a3e89700 1 -- 172.21.15.49:0/2719733900 shutdown_connections 2023-07-21T22:12:06.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.764+0000 7f27a3e89700 1 -- 172.21.15.49:0/2719733900 wait complete. 2023-07-21T22:12:06.831 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:12:07.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.964+0000 7f18dd1fe700 1 Processor -- start 2023-07-21T22:12:07.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.964+0000 7f18dd1fe700 1 -- start start 2023-07-21T22:12:07.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18dd1fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18d8071c70 0x7f18d80b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18dd1fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d80b1400 0x7f18d80cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18dd1fe700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d80cab20 con 0x7f18d806d380 2023-07-21T22:12:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18dd1fe700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d80c9e80 con 0x7f18d8071c70 2023-07-21T22:12:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18dd1fe700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80afeb0 con 0x7f18d80b1400 2023-07-21T22:12:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18cf7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18d8071c70 0x7f18d80b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18cf7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18d8071c70 0x7f18d80b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43558/0 (socket says 172.21.15.49:43558) 2023-07-21T22:12:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18cf7fe700 1 -- 172.21.15.49:0/4006230561 learned_addr learned my addr 172.21.15.49:0/4006230561 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:07.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18dc9fd700 1 --2- 172.21.15.49:0/4006230561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d80b1400 0x7f18d80cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18cf7fe700 1 -- 172.21.15.49:0/4006230561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d80b1400 msgr2=0x7f18d80cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:07.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18cf7fe700 1 --2- 172.21.15.49:0/4006230561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d80b1400 0x7f18d80cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18cf7fe700 1 -- 172.21.15.49:0/4006230561 >> v1:172.21.15.49:6789/0 conn(0x7f18d806d380 legacy=0x7f18d806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:07.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18cf7fe700 1 -- 172.21.15.49:0/4006230561 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d80ca1f0 con 0x7f18d8071c70 2023-07-21T22:12:07.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18dc9fd700 1 --2- 172.21.15.49:0/4006230561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d80b1400 0x7f18d80cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:07.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18cf7fe700 1 --2- 172.21.15.49:0/4006230561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18d8071c70 0x7f18d80b0ec0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009910 tx=0x7f18c0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731e54cdcc2babe0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:07.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18d77fe700 1 -- 172.21.15.49:0/4006230561 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c000ba60 con 0x7f18d8071c70 2023-07-21T22:12:07.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18d77fe700 1 -- 172.21.15.49:0/4006230561 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c000bbc0 con 0x7f18d8071c70 2023-07-21T22:12:07.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.968+0000 7f18d77fe700 1 -- 172.21.15.49:0/4006230561 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0009e60 con 0x7f18d8071c70 2023-07-21T22:12:07.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.972+0000 7f18dd1fe700 1 -- 172.21.15.49:0/4006230561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18d8071c70 msgr2=0x7f18d80b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:07.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.972+0000 7f18dd1fe700 1 --2- 172.21.15.49:0/4006230561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18d8071c70 0x7f18d80b0ec0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009910 tx=0x7f18c0009c20 comp rx=0 tx=0).stop 2023-07-21T22:12:07.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.972+0000 7f18dd1fe700 1 -- 172.21.15.49:0/4006230561 shutdown_connections 2023-07-21T22:12:07.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.972+0000 7f18dd1fe700 1 --2- 172.21.15.49:0/4006230561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d80b1400 0x7f18d80cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.972+0000 7f18dd1fe700 1 --2- 172.21.15.49:0/4006230561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18d8071c70 0x7f18d80b0ec0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.972+0000 7f18dd1fe700 1 -- 172.21.15.49:0/4006230561 >> 172.21.15.49:0/4006230561 conn(0x7f18d8070450 msgr2=0x7f18d8070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:07.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.972+0000 7f18dd1fe700 1 -- 172.21.15.49:0/4006230561 shutdown_connections 2023-07-21T22:12:07.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.972+0000 7f18dd1fe700 1 -- 172.21.15.49:0/4006230561 wait complete. 2023-07-21T22:12:07.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.972+0000 7f18dd1fe700 1 Processor -- start 2023-07-21T22:12:07.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.972+0000 7f18dd1fe700 1 -- start start 2023-07-21T22:12:07.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dd1fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d806d380 0x7f18d81557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dd1fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d8071c70 0x7f18d80cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dd1fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18d80b1400 0x7f18d80cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dd1fe700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d81f2ff0 con 0x7f18d80b1400 2023-07-21T22:12:07.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dd1fe700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d81f23e0 con 0x7f18d806d380 2023-07-21T22:12:07.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dd1fe700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d81f26c0 con 0x7f18d8071c70 2023-07-21T22:12:07.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dc9fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18d80b1400 0x7f18d80cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dc9fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18d80b1400 0x7f18d80cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43568/0 (socket says 172.21.15.49:43568) 2023-07-21T22:12:07.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dc9fd700 1 -- 172.21.15.49:0/1594095511 learned_addr learned my addr 172.21.15.49:0/1594095511 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:07.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18cf7fe700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d8071c70 0x7f18d80cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18d7fff700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d806d380 0x7f18d81557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dc9fd700 1 -- 172.21.15.49:0/1594095511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d8071c70 msgr2=0x7f18d80cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:07.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dc9fd700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d8071c70 0x7f18d80cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dc9fd700 1 -- 172.21.15.49:0/1594095511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d806d380 msgr2=0x7f18d81557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:07.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dc9fd700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d806d380 0x7f18d81557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dc9fd700 1 -- 172.21.15.49:0/1594095511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c0009570 con 0x7f18d80b1400 2023-07-21T22:12:07.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18d7fff700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d806d380 0x7f18d81557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:07.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dc9fd700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18d80b1400 0x7f18d80cd5d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c7f0 tx=0x7f18d000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:07.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18d57fa700 1 -- 172.21.15.49:0/1594095511 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0011800 con 0x7f18d80b1400 2023-07-21T22:12:07.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18d57fa700 1 -- 172.21.15.49:0/1594095511 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0011980 con 0x7f18d80b1400 2023-07-21T22:12:07.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dd1fe700 1 -- 172.21.15.49:0/1594095511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d81f29a0 con 0x7f18d80b1400 2023-07-21T22:12:07.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18d57fa700 1 -- 172.21.15.49:0/1594095511 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0011d30 con 0x7f18d80b1400 2023-07-21T22:12:07.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.976+0000 7f18dd1fe700 1 -- 172.21.15.49:0/1594095511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d81eedc0 con 0x7f18d80b1400 2023-07-21T22:12:07.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.980+0000 7f18dd1fe700 1 -- 172.21.15.49:0/1594095511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d80cef70 con 0x7f18d80b1400 2023-07-21T22:12:07.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.980+0000 7f18d57fa700 1 -- 172.21.15.49:0/1594095511 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18d0022350 con 0x7f18d80b1400 2023-07-21T22:12:07.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.984+0000 7f18d57fa700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f18b80662f0 0x7f18b80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.984+0000 7f18d57fa700 1 -- 172.21.15.49:0/1594095511 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f18d00840c0 con 0x7f18d80b1400 2023-07-21T22:12:07.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.984+0000 7f18d7fff700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f18b80662f0 0x7f18b80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.984+0000 7f18d7fff700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f18b80662f0 0x7f18b80687a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f18c80012e0 tx=0x7f18c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:07.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:06.988+0000 7f18d57fa700 1 -- 172.21.15.49:0/1594095511 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18d0054c10 con 0x7f18d80b1400 2023-07-21T22:12:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.196+0000 7f18dd1fe700 1 -- 172.21.15.49:0/1594095511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18d804dcb0 con 0x7f18d80b1400 2023-07-21T22:12:07.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.196+0000 7f18d57fa700 1 -- 172.21.15.49:0/1594095511 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f18d00547a0 con 0x7f18d80b1400 2023-07-21T22:12:07.242 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:07.242 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/1894793298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1894793298},{"type":"v1","addr":"172.21.15.150:6833","nonce":1894793298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1984862419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1984862419},{"type":"v1","addr":"172.21.15.49:6836","nonce":1984862419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1331451608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1331451608},{"type":"v1","addr":"172.21.15.49:6837","nonce":1331451608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:10:34.629989+0000","modified":"2023-07-21T22:11:01.997441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2478678672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2478678672},{"type":"v1","addr":"172.21.15.150:6835","nonce":2478678672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:12:07.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.200+0000 7f18dd1fe700 1 -- 172.21.15.49:0/1594095511 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f18b80662f0 msgr2=0x7f18b80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:07.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.200+0000 7f18dd1fe700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f18b80662f0 0x7f18b80687a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f18c80012e0 tx=0x7f18c8009040 comp rx=0 tx=0).stop 2023-07-21T22:12:07.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.200+0000 7f18dd1fe700 1 -- 172.21.15.49:0/1594095511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18d80b1400 msgr2=0x7f18d80cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:07.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.200+0000 7f18dd1fe700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18d80b1400 0x7f18d80cd5d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c7f0 tx=0x7f18d000cbb0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.200+0000 7f18dd1fe700 1 -- 172.21.15.49:0/1594095511 shutdown_connections 2023-07-21T22:12:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.200+0000 7f18dd1fe700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f18b80662f0 0x7f18b80687a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.200+0000 7f18dd1fe700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18d80b1400 0x7f18d80cd5d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.200+0000 7f18dd1fe700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d8071c70 0x7f18d80cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.200+0000 7f18dd1fe700 1 --2- 172.21.15.49:0/1594095511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d806d380 0x7f18d81557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.200+0000 7f18dd1fe700 1 -- 172.21.15.49:0/1594095511 >> 172.21.15.49:0/1594095511 conn(0x7f18d8070450 msgr2=0x7f18d80b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:07.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.200+0000 7f18dd1fe700 1 -- 172.21.15.49:0/1594095511 shutdown_connections 2023-07-21T22:12:07.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.200+0000 7f18dd1fe700 1 -- 172.21.15.49:0/1594095511 wait complete. 2023-07-21T22:12:07.247 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2023-07-21T22:12:07.270 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:12:07.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.412+0000 7ff7393e3700 1 Processor -- start 2023-07-21T22:12:07.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.412+0000 7ff7393e3700 1 -- start start 2023-07-21T22:12:07.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.412+0000 7ff7393e3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff734071c70 0x7ff7340b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.412+0000 7ff7393e3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff7340b1400 0x7ff7340cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.412+0000 7ff7393e3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7340cab20 con 0x7ff73406d380 2023-07-21T22:12:07.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.412+0000 7ff7393e3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7340c9e80 con 0x7ff7340b1400 2023-07-21T22:12:07.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.412+0000 7ff7393e3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7340afeb0 con 0x7ff734071c70 2023-07-21T22:12:07.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff733fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff73406d380 0x7ff73406d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:33962/0 (socket says 172.21.15.49:33962) 2023-07-21T22:12:07.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff733fff700 1 -- 172.21.15.49:0/203544154 learned_addr learned my addr 172.21.15.49:0/203544154 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:07.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff738be2700 1 --2- 172.21.15.49:0/203544154 >> v2:172.21.15.49:3300/0 conn(0x7ff7340b1400 0x7ff7340cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff72bfff700 1 --2- 172.21.15.49:0/203544154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff734071c70 0x7ff7340b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff7337fe700 1 -- 172.21.15.49:0/203544154 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549957713 0 0) 0x7ff7340cab20 con 0x7ff73406d380 2023-07-21T22:12:07.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff7337fe700 1 -- 172.21.15.49:0/203544154 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7200035d0 con 0x7ff73406d380 2023-07-21T22:12:07.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff72bfff700 1 -- 172.21.15.49:0/203544154 >> v2:172.21.15.49:3300/0 conn(0x7ff7340b1400 msgr2=0x7ff7340cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:07.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff72bfff700 1 --2- 172.21.15.49:0/203544154 >> v2:172.21.15.49:3300/0 conn(0x7ff7340b1400 0x7ff7340cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff72bfff700 1 -- 172.21.15.49:0/203544154 >> v1:172.21.15.150:6789/0 conn(0x7ff73406d380 legacy=0x7ff73406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:07.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff72bfff700 1 -- 172.21.15.49:0/203544154 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7340ca1f0 con 0x7ff734071c70 2023-07-21T22:12:07.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff738be2700 1 --2- 172.21.15.49:0/203544154 >> v2:172.21.15.49:3300/0 conn(0x7ff7340b1400 0x7ff7340cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:07.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff72bfff700 1 --2- 172.21.15.49:0/203544154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff734071c70 0x7ff7340b0ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009850 tx=0x7ff71c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7cfd4419bb43ce1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:07.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff7337fe700 1 -- 172.21.15.49:0/203544154 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c011830 con 0x7ff734071c70 2023-07-21T22:12:07.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff7337fe700 1 -- 172.21.15.49:0/203544154 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c011990 con 0x7ff734071c70 2023-07-21T22:12:07.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.416+0000 7ff7337fe700 1 -- 172.21.15.49:0/203544154 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c011d40 con 0x7ff734071c70 2023-07-21T22:12:07.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.420+0000 7ff7393e3700 1 -- 172.21.15.49:0/203544154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff734071c70 msgr2=0x7ff7340b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:07.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.420+0000 7ff7393e3700 1 --2- 172.21.15.49:0/203544154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff734071c70 0x7ff7340b0ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009850 tx=0x7ff71c009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:07.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.420+0000 7ff7393e3700 1 -- 172.21.15.49:0/203544154 shutdown_connections 2023-07-21T22:12:07.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.420+0000 7ff7393e3700 1 --2- 172.21.15.49:0/203544154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff734071c70 0x7ff7340b0ec0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.420+0000 7ff7393e3700 1 --2- 172.21.15.49:0/203544154 >> v2:172.21.15.49:3300/0 conn(0x7ff7340b1400 0x7ff7340cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.420+0000 7ff7393e3700 1 -- 172.21.15.49:0/203544154 >> 172.21.15.49:0/203544154 conn(0x7ff734070450 msgr2=0x7ff734070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:07.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.420+0000 7ff7393e3700 1 -- 172.21.15.49:0/203544154 shutdown_connections 2023-07-21T22:12:07.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.420+0000 7ff7393e3700 1 -- 172.21.15.49:0/203544154 wait complete. 2023-07-21T22:12:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.420+0000 7ff7393e3700 1 Processor -- start 2023-07-21T22:12:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff7393e3700 1 -- start start 2023-07-21T22:12:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff7393e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff73406d380 0x7ff73414ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff7393e3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff734071c70 0x7ff7340c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff7393e3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7340b1400 0x7ff7340c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff7393e3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73414b340 con 0x7ff73406d380 2023-07-21T22:12:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff7393e3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7340a7760 con 0x7ff7340b1400 2023-07-21T22:12:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff7393e3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7341487b0 con 0x7ff734071c70 2023-07-21T22:12:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff733fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff73406d380 0x7ff73414ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff733fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff73406d380 0x7ff73414ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43586/0 (socket says 172.21.15.49:43586) 2023-07-21T22:12:07.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff733fff700 1 -- 172.21.15.49:0/2665491655 learned_addr learned my addr 172.21.15.49:0/2665491655 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:07.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff72bfff700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff734071c70 0x7ff7340c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff738be2700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7340b1400 0x7ff7340c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff733fff700 1 -- 172.21.15.49:0/2665491655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff734071c70 msgr2=0x7ff7340c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:07.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff733fff700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff734071c70 0x7ff7340c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff733fff700 1 -- 172.21.15.49:0/2665491655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7340b1400 msgr2=0x7ff7340c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:07.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff733fff700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7340b1400 0x7ff7340c27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff733fff700 1 -- 172.21.15.49:0/2665491655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c009a70 con 0x7ff73406d380 2023-07-21T22:12:07.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff738be2700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7340b1400 0x7ff7340c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:07.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff733fff700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff73406d380 0x7ff73414ae00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff72400c4d0 tx=0x7ff72400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:07.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff7317fa700 1 -- 172.21.15.49:0/2665491655 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff724005d90 con 0x7ff73406d380 2023-07-21T22:12:07.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff7393e3700 1 -- 172.21.15.49:0/2665491655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71c0094b0 con 0x7ff73406d380 2023-07-21T22:12:07.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff7317fa700 1 -- 172.21.15.49:0/2665491655 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7240070d0 con 0x7ff73406d380 2023-07-21T22:12:07.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.424+0000 7ff7317fa700 1 -- 172.21.15.49:0/2665491655 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff724007480 con 0x7ff73406d380 2023-07-21T22:12:07.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.428+0000 7ff7393e3700 1 -- 172.21.15.49:0/2665491655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff734148d70 con 0x7ff73406d380 2023-07-21T22:12:07.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.428+0000 7ff7393e3700 1 -- 172.21.15.49:0/2665491655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73404dcb0 con 0x7ff73406d380 2023-07-21T22:12:07.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.428+0000 7ff7317fa700 1 -- 172.21.15.49:0/2665491655 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7240075e0 con 0x7ff73406d380 2023-07-21T22:12:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.432+0000 7ff7317fa700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff7140662f0 0x7ff7140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.432+0000 7ff7317fa700 1 -- 172.21.15.49:0/2665491655 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff724083660 con 0x7ff73406d380 2023-07-21T22:12:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.432+0000 7ff72bfff700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff7140662f0 0x7ff7140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.432+0000 7ff72bfff700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff7140662f0 0x7ff7140687a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0090b0 tx=0x7ff71c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:07.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.440+0000 7ff7317fa700 1 -- 172.21.15.49:0/2665491655 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff724050730 con 0x7ff73406d380 2023-07-21T22:12:07.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.620+0000 7ff7393e3700 1 -- 172.21.15.49:0/2665491655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7340b3ff0 con 0x7ff73406d380 2023-07-21T22:12:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.624+0000 7ff7317fa700 1 -- 172.21.15.49:0/2665491655 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7ff724053d50 con 0x7ff73406d380 2023-07-21T22:12:07.670 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:07.671 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:12:07.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.628+0000 7ff7393e3700 1 -- 172.21.15.49:0/2665491655 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff7140662f0 msgr2=0x7ff7140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:07.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.628+0000 7ff7393e3700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff7140662f0 0x7ff7140687a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0090b0 tx=0x7ff71c008030 comp rx=0 tx=0).stop 2023-07-21T22:12:07.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.628+0000 7ff7393e3700 1 -- 172.21.15.49:0/2665491655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff73406d380 msgr2=0x7ff73414ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:07.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.628+0000 7ff7393e3700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff73406d380 0x7ff73414ae00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff72400c4d0 tx=0x7ff72400c890 comp rx=0 tx=0).stop 2023-07-21T22:12:07.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.628+0000 7ff7393e3700 1 -- 172.21.15.49:0/2665491655 shutdown_connections 2023-07-21T22:12:07.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.628+0000 7ff7393e3700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff7140662f0 0x7ff7140687a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.628+0000 7ff7393e3700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7340b1400 0x7ff7340c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.628+0000 7ff7393e3700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff734071c70 0x7ff7340c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.628+0000 7ff7393e3700 1 --2- 172.21.15.49:0/2665491655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff73406d380 0x7ff73414ae00 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.628+0000 7ff7393e3700 1 -- 172.21.15.49:0/2665491655 >> 172.21.15.49:0/2665491655 conn(0x7ff734070450 msgr2=0x7ff734158100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:07.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.628+0000 7ff7393e3700 1 -- 172.21.15.49:0/2665491655 shutdown_connections 2023-07-21T22:12:07.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.628+0000 7ff7393e3700 1 -- 172.21.15.49:0/2665491655 wait complete. 2023-07-21T22:12:07.698 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:12:07.699 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:12:07.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.836+0000 7f6235265700 1 Processor -- start 2023-07-21T22:12:07.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.836+0000 7f6235265700 1 -- start start 2023-07-21T22:12:07.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.836+0000 7f6235265700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f623006d540 0x7f62300cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.836+0000 7f6235265700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6230159c30 0x7f62300c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.836+0000 7f6235265700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623006c780 con 0x7f6230070600 2023-07-21T22:12:07.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.836+0000 7f6235265700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623006ca60 con 0x7f6230159c30 2023-07-21T22:12:07.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.836+0000 7f6235265700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623006cd40 con 0x7f623006d540 2023-07-21T22:12:07.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.836+0000 7f622f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6230159c30 0x7f62300c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.836+0000 7f622f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6230159c30 0x7f62300c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43594/0 (socket says 172.21.15.49:43594) 2023-07-21T22:12:07.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.836+0000 7f622f7fe700 1 -- 172.21.15.49:0/671131946 learned_addr learned my addr 172.21.15.49:0/671131946 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:07.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.836+0000 7f6227fff700 1 --2- 172.21.15.49:0/671131946 >> v2:172.21.15.150:3300/0 conn(0x7f623006d540 0x7f62300cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.836+0000 7f622f7fe700 1 -- 172.21.15.49:0/671131946 >> v2:172.21.15.150:3300/0 conn(0x7f623006d540 msgr2=0x7f62300cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:07.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.836+0000 7f622f7fe700 1 --2- 172.21.15.49:0/671131946 >> v2:172.21.15.150:3300/0 conn(0x7f623006d540 0x7f62300cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.840+0000 7f622f7fe700 1 -- 172.21.15.49:0/671131946 >> v1:172.21.15.150:6789/0 conn(0x7f6230070600 legacy=0x7f62300709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:07.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.840+0000 7f622f7fe700 1 -- 172.21.15.49:0/671131946 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623006d020 con 0x7f6230159c30 2023-07-21T22:12:07.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.840+0000 7f622f7fe700 1 --2- 172.21.15.49:0/671131946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6230159c30 0x7f62300c87f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f62300afc20 tx=0x7f622800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e90d6a613b5b10c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:07.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.840+0000 7f622e7fc700 1 -- 172.21.15.49:0/671131946 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622800e070 con 0x7f6230159c30 2023-07-21T22:12:07.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.840+0000 7f622e7fc700 1 -- 172.21.15.49:0/671131946 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6228003a40 con 0x7f6230159c30 2023-07-21T22:12:07.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.840+0000 7f622e7fc700 1 -- 172.21.15.49:0/671131946 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228003df0 con 0x7f6230159c30 2023-07-21T22:12:07.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.840+0000 7f6235265700 1 -- 172.21.15.49:0/671131946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6230159c30 msgr2=0x7f62300c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:07.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.840+0000 7f6235265700 1 --2- 172.21.15.49:0/671131946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6230159c30 0x7f62300c87f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f62300afc20 tx=0x7f622800b330 comp rx=0 tx=0).stop 2023-07-21T22:12:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.840+0000 7f6235265700 1 -- 172.21.15.49:0/671131946 shutdown_connections 2023-07-21T22:12:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.840+0000 7f6235265700 1 --2- 172.21.15.49:0/671131946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6230159c30 0x7f62300c87f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.840+0000 7f6235265700 1 --2- 172.21.15.49:0/671131946 >> v2:172.21.15.150:3300/0 conn(0x7f623006d540 0x7f62300cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.840+0000 7f6235265700 1 -- 172.21.15.49:0/671131946 >> 172.21.15.49:0/671131946 conn(0x7f623006f5a0 msgr2=0x7f62300cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.840+0000 7f6235265700 1 -- 172.21.15.49:0/671131946 shutdown_connections 2023-07-21T22:12:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.840+0000 7f6235265700 1 -- 172.21.15.49:0/671131946 wait complete. 2023-07-21T22:12:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.844+0000 7f6235265700 1 Processor -- start 2023-07-21T22:12:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.844+0000 7f6235265700 1 -- start start 2023-07-21T22:12:07.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.844+0000 7f6235265700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f623006d540 0x7f62301f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.844+0000 7f6235265700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6230070600 0x7f62300c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.844+0000 7f6235265700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6230159c30 0x7f6230151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.844+0000 7f6235265700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62300c7930 con 0x7f6230070600 2023-07-21T22:12:07.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.844+0000 7f6235265700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62301f1eb0 con 0x7f623006d540 2023-07-21T22:12:07.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.844+0000 7f6235265700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62301f2190 con 0x7f6230159c30 2023-07-21T22:12:07.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.844+0000 7f6227fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6230070600 0x7f62300c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.844+0000 7f6227fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6230070600 0x7f62300c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43604/0 (socket says 172.21.15.49:43604) 2023-07-21T22:12:07.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.844+0000 7f6227fff700 1 -- 172.21.15.49:0/1057124050 learned_addr learned my addr 172.21.15.49:0/1057124050 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:07.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.844+0000 7f622effd700 1 --2- 172.21.15.49:0/1057124050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f623006d540 0x7f62301f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.844+0000 7f622f7fe700 1 --2- 172.21.15.49:0/1057124050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6230159c30 0x7f6230151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.848+0000 7f6227fff700 1 -- 172.21.15.49:0/1057124050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6230159c30 msgr2=0x7f6230151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:07.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.848+0000 7f6227fff700 1 --2- 172.21.15.49:0/1057124050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6230159c30 0x7f6230151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.848+0000 7f6227fff700 1 -- 172.21.15.49:0/1057124050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f623006d540 msgr2=0x7f62301f2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:07.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.848+0000 7f6227fff700 1 --2- 172.21.15.49:0/1057124050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f623006d540 0x7f62301f2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:07.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.848+0000 7f6227fff700 1 -- 172.21.15.49:0/1057124050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6228009b30 con 0x7f6230070600 2023-07-21T22:12:07.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.848+0000 7f6227fff700 1 --2- 172.21.15.49:0/1057124050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6230070600 0x7f62300c72a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f621800d800 tx=0x7f621800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:07.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.848+0000 7f62277fe700 1 -- 172.21.15.49:0/1057124050 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62180125f0 con 0x7f6230070600 2023-07-21T22:12:07.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.848+0000 7f62277fe700 1 -- 172.21.15.49:0/1057124050 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6218012750 con 0x7f6230070600 2023-07-21T22:12:07.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.848+0000 7f62277fe700 1 -- 172.21.15.49:0/1057124050 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218012ac0 con 0x7f6230070600 2023-07-21T22:12:07.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.848+0000 7f6235265700 1 -- 172.21.15.49:0/1057124050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62301f2470 con 0x7f6230070600 2023-07-21T22:12:07.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.848+0000 7f6235265700 1 -- 172.21.15.49:0/1057124050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62300c8130 con 0x7f6230070600 2023-07-21T22:12:07.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.848+0000 7f6235265700 1 -- 172.21.15.49:0/1057124050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623004dcb0 con 0x7f6230070600 2023-07-21T22:12:07.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.852+0000 7f62277fe700 1 -- 172.21.15.49:0/1057124050 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6218012c20 con 0x7f6230070600 2023-07-21T22:12:07.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.852+0000 7f62277fe700 1 --2- 172.21.15.49:0/1057124050 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f62100662f0 0x7f62100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:07.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.852+0000 7f62277fe700 1 -- 172.21.15.49:0/1057124050 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6218084000 con 0x7f6230070600 2023-07-21T22:12:07.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.852+0000 7f622effd700 1 --2- 172.21.15.49:0/1057124050 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f62100662f0 0x7f62100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:07.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.852+0000 7f622effd700 1 --2- 172.21.15.49:0/1057124050 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f62100662f0 0x7f62100687a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6220007fd0 tx=0x7f6220009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:07.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:07.860+0000 7f62277fe700 1 -- 172.21.15.49:0/1057124050 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6218051160 con 0x7f6230070600 2023-07-21T22:12:08.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.068+0000 7f6235265700 1 -- 172.21.15.49:0/1057124050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62300ad7e0 con 0x7f6230070600 2023-07-21T22:12:08.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.068+0000 7f62277fe700 1 -- 172.21.15.49:0/1057124050 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f6218054780 con 0x7f6230070600 2023-07-21T22:12:08.114 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:08.114 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/1894793298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1894793298},{"type":"v1","addr":"172.21.15.150:6833","nonce":1894793298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1984862419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1984862419},{"type":"v1","addr":"172.21.15.49:6836","nonce":1984862419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1331451608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1331451608},{"type":"v1","addr":"172.21.15.49:6837","nonce":1331451608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:10:34.629989+0000","modified":"2023-07-21T22:11:01.997441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2478678672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2478678672},{"type":"v1","addr":"172.21.15.150:6835","nonce":2478678672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:12:08.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.072+0000 7f6235265700 1 -- 172.21.15.49:0/1057124050 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f62100662f0 msgr2=0x7f62100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.072+0000 7f6235265700 1 --2- 172.21.15.49:0/1057124050 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f62100662f0 0x7f62100687a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6220007fd0 tx=0x7f6220009040 comp rx=0 tx=0).stop 2023-07-21T22:12:08.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.072+0000 7f6235265700 1 -- 172.21.15.49:0/1057124050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6230070600 msgr2=0x7f62300c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.072+0000 7f6235265700 1 --2- 172.21.15.49:0/1057124050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6230070600 0x7f62300c72a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f621800d800 tx=0x7f621800db10 comp rx=0 tx=0).stop 2023-07-21T22:12:08.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.072+0000 7f6235265700 1 -- 172.21.15.49:0/1057124050 shutdown_connections 2023-07-21T22:12:08.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.072+0000 7f6235265700 1 --2- 172.21.15.49:0/1057124050 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f62100662f0 0x7f62100687a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.072+0000 7f6235265700 1 --2- 172.21.15.49:0/1057124050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6230070600 0x7f62300c72a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.072+0000 7f6235265700 1 --2- 172.21.15.49:0/1057124050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6230159c30 0x7f6230151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.072+0000 7f6235265700 1 --2- 172.21.15.49:0/1057124050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f623006d540 0x7f62301f2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.072+0000 7f6235265700 1 -- 172.21.15.49:0/1057124050 >> 172.21.15.49:0/1057124050 conn(0x7f623006f5a0 msgr2=0x7f62300aca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:08.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.072+0000 7f6235265700 1 -- 172.21.15.49:0/1057124050 shutdown_connections 2023-07-21T22:12:08.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.072+0000 7f6235265700 1 -- 172.21.15.49:0/1057124050 wait complete. 2023-07-21T22:12:08.121 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2023-07-21T22:12:08.141 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:12:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.268+0000 7f31c8c5a700 1 Processor -- start 2023-07-21T22:12:08.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.268+0000 7f31c8c5a700 1 -- start start 2023-07-21T22:12:08.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.272+0000 7f31c8c5a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31c40d1e40 0x7f31c40b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:08.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.272+0000 7f31c8c5a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c40b3e80 con 0x7f31c40b7af0 2023-07-21T22:12:08.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.272+0000 7f31c8c5a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c415fd40 con 0x7f31c40cee10 2023-07-21T22:12:08.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.272+0000 7f31c8c5a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c40cea00 con 0x7f31c40d1e40 2023-07-21T22:12:08.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.272+0000 7f31c37fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f31c40b7af0 0x7f31c415f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53090/0 (socket says 172.21.15.49:53090) 2023-07-21T22:12:08.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.272+0000 7f31c37fe700 1 -- 172.21.15.49:0/2474496382 learned_addr learned my addr 172.21.15.49:0/2474496382 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:08.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.272+0000 7f31c2ffd700 1 --2- 172.21.15.49:0/2474496382 >> v2:172.21.15.150:3300/0 conn(0x7f31c40d1e40 0x7f31c40b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:08.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.272+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243345311 0 0) 0x7f31c40b3e80 con 0x7f31c40b7af0 2023-07-21T22:12:08.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31ac0035d0 con 0x7f31c40b7af0 2023-07-21T22:12:08.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688766994 0 0) 0x7f31c415fd40 con 0x7f31c40cee10 2023-07-21T22:12:08.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c40b3e80 con 0x7f31c40cee10 2023-07-21T22:12:08.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3565615287 0 0) 0x7f31ac0035d0 con 0x7f31c40b7af0 2023-07-21T22:12:08.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 >> v2:172.21.15.150:3300/0 conn(0x7f31c40d1e40 msgr2=0x7f31c40b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:08.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 --2- 172.21.15.49:0/2474496382 >> v2:172.21.15.150:3300/0 conn(0x7f31c40d1e40 0x7f31c40b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 >> v1:172.21.15.150:6789/0 conn(0x7f31c40cee10 legacy=0x7f31c40b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c40ccbf0 con 0x7f31c40b7af0 2023-07-21T22:12:08.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f31b4001670 con 0x7f31c40b7af0 2023-07-21T22:12:08.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c2ffd700 1 --2- 172.21.15.49:0/2474496382 >> v2:172.21.15.150:3300/0 conn(0x7f31c40d1e40 0x7f31c40b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:08.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 >> v1:172.21.15.49:6789/0 conn(0x7f31c40b7af0 legacy=0x7f31c415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 --2- 172.21.15.49:0/2474496382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31ac003c00 0x7f31ac003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:08.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 --2- 172.21.15.49:0/2474496382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ac004870 0x7f31ac004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:08.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 --2- 172.21.15.49:0/2474496382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ac005220 0x7f31ac00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:08.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c40cea00 con 0x7f31ac003c00 2023-07-21T22:12:08.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac00c100 con 0x7f31ac004870 2023-07-21T22:12:08.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac00c290 con 0x7f31ac005220 2023-07-21T22:12:08.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c37fe700 1 --2- 172.21.15.49:0/2474496382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31ac003c00 0x7f31ac003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:08.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c2ffd700 1 --2- 172.21.15.49:0/2474496382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ac004870 0x7f31ac004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:08.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c3fff700 1 --2- 172.21.15.49:0/2474496382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ac005220 0x7f31ac00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:08.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c37fe700 1 -- 172.21.15.49:0/2474496382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ac005220 msgr2=0x7f31ac00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:08.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c37fe700 1 --2- 172.21.15.49:0/2474496382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ac005220 0x7f31ac00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c37fe700 1 -- 172.21.15.49:0/2474496382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ac004870 msgr2=0x7f31ac004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:08.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c37fe700 1 --2- 172.21.15.49:0/2474496382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ac004870 0x7f31ac004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c37fe700 1 -- 172.21.15.49:0/2474496382 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac0035d0 con 0x7f31ac003c00 2023-07-21T22:12:08.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c3fff700 1 -- 172.21.15.49:0/2474496382 reap_dead start 2023-07-21T22:12:08.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c37fe700 1 --2- 172.21.15.49:0/2474496382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31ac003c00 0x7f31ac003ff0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f31b4001eb0 tx=0x7f31ac0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a170881541693b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:08.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400cc90 con 0x7f31ac003c00 2023-07-21T22:12:08.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b400cdf0 con 0x7f31ac003c00 2023-07-21T22:12:08.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.276+0000 7f31c27fc700 1 -- 172.21.15.49:0/2474496382 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4005bc0 con 0x7f31ac003c00 2023-07-21T22:12:08.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.280+0000 7f31c8c5a700 1 -- 172.21.15.49:0/2474496382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31ac003c00 msgr2=0x7f31ac003ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.280+0000 7f31c8c5a700 1 --2- 172.21.15.49:0/2474496382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31ac003c00 0x7f31ac003ff0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f31b4001eb0 tx=0x7f31ac0058a0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.280+0000 7f31c8c5a700 1 -- 172.21.15.49:0/2474496382 shutdown_connections 2023-07-21T22:12:08.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.280+0000 7f31c8c5a700 1 --2- 172.21.15.49:0/2474496382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31ac003c00 0x7f31ac003ff0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.280+0000 7f31c8c5a700 1 -- 172.21.15.49:0/2474496382 >> 172.21.15.49:0/2474496382 conn(0x7f31c406e960 msgr2=0x7f31c406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:08.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.280+0000 7f31c8c5a700 1 -- 172.21.15.49:0/2474496382 shutdown_connections 2023-07-21T22:12:08.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.280+0000 7f31c8c5a700 1 -- 172.21.15.49:0/2474496382 wait complete. 2023-07-21T22:12:08.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.280+0000 7f31c8c5a700 1 Processor -- start 2023-07-21T22:12:08.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.280+0000 7f31c8c5a700 1 -- start start 2023-07-21T22:12:08.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c8c5a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31ac003c00 0x7f31c41579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:08.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c8c5a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31c40b6280 0x7f31c40b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:08.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c8c5a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31c40c7f90 0x7f31c40c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:08.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c8c5a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c40b6c30 con 0x7f31ac003c00 2023-07-21T22:12:08.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c8c5a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4157f30 con 0x7f31c40b6280 2023-07-21T22:12:08.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c8c5a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c415b500 con 0x7f31c40c7f90 2023-07-21T22:12:08.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31ac003c00 0x7f31c41579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:08.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31ac003c00 0x7f31c41579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43626/0 (socket says 172.21.15.49:43626) 2023-07-21T22:12:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c37fe700 1 -- 172.21.15.49:0/983380193 learned_addr learned my addr 172.21.15.49:0/983380193 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c2ffd700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31c40b6280 0x7f31c40b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c3fff700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31c40c7f90 0x7f31c40c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c37fe700 1 -- 172.21.15.49:0/983380193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31c40c7f90 msgr2=0x7f31c40c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c37fe700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31c40c7f90 0x7f31c40c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c37fe700 1 -- 172.21.15.49:0/983380193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31c40b6280 msgr2=0x7f31c40b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c37fe700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31c40b6280 0x7f31c40b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c37fe700 1 -- 172.21.15.49:0/983380193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c41f1240 con 0x7f31ac003c00 2023-07-21T22:12:08.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c3fff700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31c40c7f90 0x7f31c40c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:08.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c2ffd700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31c40b6280 0x7f31c40b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:08.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c37fe700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31ac003c00 0x7f31c41579f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0047c0 tx=0x7f31b4001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31abfff700 1 -- 172.21.15.49:0/983380193 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b40070d0 con 0x7f31ac003c00 2023-07-21T22:12:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31abfff700 1 -- 172.21.15.49:0/983380193 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b4007230 con 0x7f31ac003c00 2023-07-21T22:12:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c8c5a700 1 -- 172.21.15.49:0/983380193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c41f1fc0 con 0x7f31ac003c00 2023-07-21T22:12:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31abfff700 1 -- 172.21.15.49:0/983380193 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b40075e0 con 0x7f31ac003c00 2023-07-21T22:12:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.284+0000 7f31c8c5a700 1 -- 172.21.15.49:0/983380193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c41f17c0 con 0x7f31ac003c00 2023-07-21T22:12:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.288+0000 7f31c8c5a700 1 -- 172.21.15.49:0/983380193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c404dcb0 con 0x7f31ac003c00 2023-07-21T22:12:08.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.288+0000 7f31abfff700 1 -- 172.21.15.49:0/983380193 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f31b401d420 con 0x7f31ac003c00 2023-07-21T22:12:08.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.288+0000 7f31abfff700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f31b0066320 0x7f31b00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:08.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.288+0000 7f31abfff700 1 -- 172.21.15.49:0/983380193 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f31b4085190 con 0x7f31ac003c00 2023-07-21T22:12:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.292+0000 7f31c2ffd700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f31b0066320 0x7f31b00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.292+0000 7f31c2ffd700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f31b0066320 0x7f31b00687d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f31c415cd10 tx=0x7f31b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.296+0000 7f31abfff700 1 -- 172.21.15.49:0/983380193 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f31b40523f0 con 0x7f31ac003c00 2023-07-21T22:12:08.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.504+0000 7f31c8c5a700 1 -- 172.21.15.49:0/983380193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31c40ccea0 con 0x7f31ac003c00 2023-07-21T22:12:08.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.508+0000 7f31abfff700 1 -- 172.21.15.49:0/983380193 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f31b4021090 con 0x7f31ac003c00 2023-07-21T22:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/1894793298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1894793298},{"type":"v1","addr":"172.21.15.150:6833","nonce":1894793298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1984862419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1984862419},{"type":"v1","addr":"172.21.15.49:6836","nonce":1984862419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1331451608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1331451608},{"type":"v1","addr":"172.21.15.49:6837","nonce":1331451608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:10:34.629989+0000","modified":"2023-07-21T22:11:01.997441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2478678672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2478678672},{"type":"v1","addr":"172.21.15.150:6835","nonce":2478678672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:12:08.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.508+0000 7f31c8c5a700 1 -- 172.21.15.49:0/983380193 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f31b0066320 msgr2=0x7f31b00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.508+0000 7f31c8c5a700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f31b0066320 0x7f31b00687d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f31c415cd10 tx=0x7f31b8008040 comp rx=0 tx=0).stop 2023-07-21T22:12:08.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.508+0000 7f31c8c5a700 1 -- 172.21.15.49:0/983380193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31ac003c00 msgr2=0x7f31c41579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.508+0000 7f31c8c5a700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31ac003c00 0x7f31c41579f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0047c0 tx=0x7f31b4001930 comp rx=0 tx=0).stop 2023-07-21T22:12:08.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.508+0000 7f31c8c5a700 1 -- 172.21.15.49:0/983380193 shutdown_connections 2023-07-21T22:12:08.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.508+0000 7f31c8c5a700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f31b0066320 0x7f31b00687d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.508+0000 7f31c8c5a700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31c40c7f90 0x7f31c40c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.508+0000 7f31c8c5a700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31c40b6280 0x7f31c40b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.508+0000 7f31c8c5a700 1 --2- 172.21.15.49:0/983380193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31ac003c00 0x7f31c41579f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.508+0000 7f31c8c5a700 1 -- 172.21.15.49:0/983380193 >> 172.21.15.49:0/983380193 conn(0x7f31c406e960 msgr2=0x7f31c40b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:08.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.508+0000 7f31c8c5a700 1 -- 172.21.15.49:0/983380193 shutdown_connections 2023-07-21T22:12:08.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.508+0000 7f31c8c5a700 1 -- 172.21.15.49:0/983380193 wait complete. 2023-07-21T22:12:08.557 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2023-07-21T22:12:08.576 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:12:08.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.716+0000 7ff2b05d5700 1 Processor -- start 2023-07-21T22:12:08.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.716+0000 7ff2b05d5700 1 -- start start 2023-07-21T22:12:08.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.716+0000 7ff2b05d5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2a80cdd50 0x7ff2a80ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:08.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.716+0000 7ff2b05d5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff2a80ce790 0x7ff2a80d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:08.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2b05d5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a80b8680 con 0x7ff2a80ce240 2023-07-21T22:12:08.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2b05d5700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a80d3500 con 0x7ff2a80cdd50 2023-07-21T22:12:08.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2b05d5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a80d2fa0 con 0x7ff2a80ce790 2023-07-21T22:12:08.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2aeb72700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff2a80ce240 0x7ff2a80cf330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53100/0 (socket says 172.21.15.49:53100) 2023-07-21T22:12:08.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2aeb72700 1 -- 172.21.15.49:0/3786429517 learned_addr learned my addr 172.21.15.49:0/3786429517 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:08.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2ae371700 1 --2- 172.21.15.49:0/3786429517 >> v2:172.21.15.49:3300/0 conn(0x7ff2a80cdd50 0x7ff2a80ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:08.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2adb70700 1 --2- 172.21.15.49:0/3786429517 >> v2:172.21.15.150:3300/0 conn(0x7ff2a80ce790 0x7ff2a80d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:08.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2ad36f700 1 -- 172.21.15.49:0/3786429517 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901542940 0 0) 0x7ff2a80b8680 con 0x7ff2a80ce240 2023-07-21T22:12:08.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2ad36f700 1 -- 172.21.15.49:0/3786429517 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2940035d0 con 0x7ff2a80ce240 2023-07-21T22:12:08.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2ae371700 1 -- 172.21.15.49:0/3786429517 >> v2:172.21.15.150:3300/0 conn(0x7ff2a80ce790 msgr2=0x7ff2a80d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:08.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2ae371700 1 --2- 172.21.15.49:0/3786429517 >> v2:172.21.15.150:3300/0 conn(0x7ff2a80ce790 0x7ff2a80d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2ae371700 1 -- 172.21.15.49:0/3786429517 >> v1:172.21.15.49:6789/0 conn(0x7ff2a80ce240 legacy=0x7ff2a80cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2ae371700 1 -- 172.21.15.49:0/3786429517 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a80b6290 con 0x7ff2a80cdd50 2023-07-21T22:12:08.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2ae371700 1 --2- 172.21.15.49:0/3786429517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2a80cdd50 0x7ff2a80ccce0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff2a806e6b0 tx=0x7ff2a4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4a453f4ee83396 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:08.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2ad36f700 1 -- 172.21.15.49:0/3786429517 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4011830 con 0x7ff2a80cdd50 2023-07-21T22:12:08.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2ad36f700 1 -- 172.21.15.49:0/3786429517 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a4011990 con 0x7ff2a80cdd50 2023-07-21T22:12:08.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2ad36f700 1 -- 172.21.15.49:0/3786429517 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4011d20 con 0x7ff2a80cdd50 2023-07-21T22:12:08.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2b05d5700 1 -- 172.21.15.49:0/3786429517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2a80cdd50 msgr2=0x7ff2a80ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2b05d5700 1 --2- 172.21.15.49:0/3786429517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2a80cdd50 0x7ff2a80ccce0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff2a806e6b0 tx=0x7ff2a4009b20 comp rx=0 tx=0).stop 2023-07-21T22:12:08.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2b05d5700 1 -- 172.21.15.49:0/3786429517 shutdown_connections 2023-07-21T22:12:08.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2b05d5700 1 --2- 172.21.15.49:0/3786429517 >> v2:172.21.15.150:3300/0 conn(0x7ff2a80ce790 0x7ff2a80d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2b05d5700 1 --2- 172.21.15.49:0/3786429517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2a80cdd50 0x7ff2a80ccce0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2b05d5700 1 -- 172.21.15.49:0/3786429517 >> 172.21.15.49:0/3786429517 conn(0x7ff2a80b55e0 msgr2=0x7ff2a80b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:08.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.720+0000 7ff2b05d5700 1 -- 172.21.15.49:0/3786429517 shutdown_connections 2023-07-21T22:12:08.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.724+0000 7ff2b05d5700 1 -- 172.21.15.49:0/3786429517 wait complete. 2023-07-21T22:12:08.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.724+0000 7ff2b05d5700 1 Processor -- start 2023-07-21T22:12:08.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.724+0000 7ff2b05d5700 1 -- start start 2023-07-21T22:12:08.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.724+0000 7ff2b05d5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2a80cdd50 0x7ff2a80b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:08.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.724+0000 7ff2b05d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2a80ce240 0x7ff2a815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:08.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.724+0000 7ff2b05d5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2a80ce790 0x7ff2a8159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:08.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.724+0000 7ff2b05d5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a815f360 con 0x7ff2a80cdd50 2023-07-21T22:12:08.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.724+0000 7ff2b05d5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a815e750 con 0x7ff2a80ce790 2023-07-21T22:12:08.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.724+0000 7ff2b05d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a815ea30 con 0x7ff2a80ce240 2023-07-21T22:12:08.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.724+0000 7ff2ae371700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2a80cdd50 0x7ff2a80b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:08.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.724+0000 7ff2ae371700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2a80cdd50 0x7ff2a80b0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43650/0 (socket says 172.21.15.49:43650) 2023-07-21T22:12:08.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.724+0000 7ff2ae371700 1 -- 172.21.15.49:0/4020801898 learned_addr learned my addr 172.21.15.49:0/4020801898 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:08.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.728+0000 7ff2aeb72700 1 --2- 172.21.15.49:0/4020801898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2a80ce790 0x7ff2a8159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:08.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.728+0000 7ff2adb70700 1 --2- 172.21.15.49:0/4020801898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2a80ce240 0x7ff2a815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:08.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.728+0000 7ff2ae371700 1 -- 172.21.15.49:0/4020801898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2a80ce240 msgr2=0x7ff2a815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.728+0000 7ff2ae371700 1 --2- 172.21.15.49:0/4020801898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2a80ce240 0x7ff2a815dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.728+0000 7ff2ae371700 1 -- 172.21.15.49:0/4020801898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2a80ce790 msgr2=0x7ff2a8159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.728+0000 7ff2ae371700 1 --2- 172.21.15.49:0/4020801898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2a80ce790 0x7ff2a8159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.728+0000 7ff2ae371700 1 -- 172.21.15.49:0/4020801898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a4009450 con 0x7ff2a80cdd50 2023-07-21T22:12:08.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.728+0000 7ff2ae371700 1 --2- 172.21.15.49:0/4020801898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2a80cdd50 0x7ff2a80b0fe0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009b60 tx=0x7ff2a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:08.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.728+0000 7ff29effd700 1 -- 172.21.15.49:0/4020801898 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4004380 con 0x7ff2a80cdd50 2023-07-21T22:12:08.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.728+0000 7ff29effd700 1 -- 172.21.15.49:0/4020801898 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a401f070 con 0x7ff2a80cdd50 2023-07-21T22:12:08.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.728+0000 7ff29effd700 1 -- 172.21.15.49:0/4020801898 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40036c0 con 0x7ff2a80cdd50 2023-07-21T22:12:08.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.728+0000 7ff2b05d5700 1 -- 172.21.15.49:0/4020801898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a815ed10 con 0x7ff2a80cdd50 2023-07-21T22:12:08.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.728+0000 7ff2b05d5700 1 -- 172.21.15.49:0/4020801898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a80b2540 con 0x7ff2a80cdd50 2023-07-21T22:12:08.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.728+0000 7ff2b05d5700 1 -- 172.21.15.49:0/4020801898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a804dcb0 con 0x7ff2a80cdd50 2023-07-21T22:12:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.732+0000 7ff29effd700 1 -- 172.21.15.49:0/4020801898 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff2a4021030 con 0x7ff2a80cdd50 2023-07-21T22:12:08.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.732+0000 7ff29effd700 1 --2- 172.21.15.49:0/4020801898 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff28c0662f0 0x7ff28c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:08.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.732+0000 7ff29effd700 1 -- 172.21.15.49:0/4020801898 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff2a4085390 con 0x7ff2a80cdd50 2023-07-21T22:12:08.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.732+0000 7ff2adb70700 1 --2- 172.21.15.49:0/4020801898 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff28c0662f0 0x7ff28c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:08.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.732+0000 7ff2adb70700 1 --2- 172.21.15.49:0/4020801898 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff28c0662f0 0x7ff28c0687a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff2a81f4940 tx=0x7ff298009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.740+0000 7ff29effd700 1 -- 172.21.15.49:0/4020801898 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff2a4052450 con 0x7ff2a80cdd50 2023-07-21T22:12:08.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.912+0000 7ff2b05d5700 1 -- 172.21.15.49:0/4020801898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2a80b8090 con 0x7ff2a80cdd50 2023-07-21T22:12:08.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.916+0000 7ff29effd700 1 -- 172.21.15.49:0/4020801898 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+20179 (secure 0 0 0) 0x7ff2a4055a70 con 0x7ff2a80cdd50 2023-07-21T22:12:08.962 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:08.962 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:11:16.101384+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:10:32.913913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:10:33.637467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T22:10:37.289765+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:12:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.920+0000 7ff2b05d5700 1 -- 172.21.15.49:0/4020801898 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff28c0662f0 msgr2=0x7ff28c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.920+0000 7ff2b05d5700 1 --2- 172.21.15.49:0/4020801898 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff28c0662f0 0x7ff28c0687a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff2a81f4940 tx=0x7ff298009240 comp rx=0 tx=0).stop 2023-07-21T22:12:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.920+0000 7ff2b05d5700 1 -- 172.21.15.49:0/4020801898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2a80cdd50 msgr2=0x7ff2a80b0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.920+0000 7ff2b05d5700 1 --2- 172.21.15.49:0/4020801898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2a80cdd50 0x7ff2a80b0fe0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009b60 tx=0x7ff2a4004770 comp rx=0 tx=0).stop 2023-07-21T22:12:08.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.920+0000 7ff2b05d5700 1 -- 172.21.15.49:0/4020801898 shutdown_connections 2023-07-21T22:12:08.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.920+0000 7ff2b05d5700 1 --2- 172.21.15.49:0/4020801898 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff28c0662f0 0x7ff28c0687a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.920+0000 7ff2b05d5700 1 --2- 172.21.15.49:0/4020801898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2a80ce790 0x7ff2a8159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.920+0000 7ff2b05d5700 1 --2- 172.21.15.49:0/4020801898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2a80ce240 0x7ff2a815dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.920+0000 7ff2b05d5700 1 --2- 172.21.15.49:0/4020801898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2a80cdd50 0x7ff2a80b0fe0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:08.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.920+0000 7ff2b05d5700 1 -- 172.21.15.49:0/4020801898 >> 172.21.15.49:0/4020801898 conn(0x7ff2a80b55e0 msgr2=0x7ff2a815bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:08.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.920+0000 7ff2b05d5700 1 -- 172.21.15.49:0/4020801898 shutdown_connections 2023-07-21T22:12:08.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:08.920+0000 7ff2b05d5700 1 -- 172.21.15.49:0/4020801898 wait complete. 2023-07-21T22:12:08.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T22:12:09.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.124+0000 7f109eacd700 1 Processor -- start 2023-07-21T22:12:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.124+0000 7f109eacd700 1 -- start start 2023-07-21T22:12:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f109eacd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f10981561a0 0x7f10980cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f109eacd700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109815bf50 con 0x7f10980afc20 2023-07-21T22:12:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f109eacd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109815c230 con 0x7f1098155dd0 2023-07-21T22:12:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f109eacd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109815c510 con 0x7f10981561a0 2023-07-21T22:12:09.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f109d06a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f10980afc20 0x7f10980b0040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53108/0 (socket says 172.21.15.49:53108) 2023-07-21T22:12:09.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f109d06a700 1 -- 172.21.15.49:0/672134819 learned_addr learned my addr 172.21.15.49:0/672134819 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:09.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f1097fff700 1 --2- 172.21.15.49:0/672134819 >> v2:172.21.15.150:3300/0 conn(0x7f10981561a0 0x7f10980cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:09.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f10977fe700 1 -- 172.21.15.49:0/672134819 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261967528 0 0) 0x7f109815bf50 con 0x7f10980afc20 2023-07-21T22:12:09.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f10977fe700 1 -- 172.21.15.49:0/672134819 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10880034f0 con 0x7f10980afc20 2023-07-21T22:12:09.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f10977fe700 1 -- 172.21.15.49:0/672134819 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294214073 0 0) 0x7f109815c230 con 0x7f1098155dd0 2023-07-21T22:12:09.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f10977fe700 1 -- 172.21.15.49:0/672134819 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f109815bf50 con 0x7f1098155dd0 2023-07-21T22:12:09.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f1097fff700 1 -- 172.21.15.49:0/672134819 >> v1:172.21.15.150:6789/0 conn(0x7f1098155dd0 legacy=0x7f10980cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:09.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f1097fff700 1 -- 172.21.15.49:0/672134819 >> v1:172.21.15.49:6789/0 conn(0x7f10980afc20 legacy=0x7f10980b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:09.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f10977fe700 1 -- 172.21.15.49:0/672134819 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1554631521 0 0) 0x7f10880034f0 con 0x7f10980afc20 2023-07-21T22:12:09.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.128+0000 7f1097fff700 1 -- 172.21.15.49:0/672134819 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109815c7f0 con 0x7f10981561a0 2023-07-21T22:12:09.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.132+0000 7f1097fff700 1 --2- 172.21.15.49:0/672134819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10981561a0 0x7f10980cc570 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1084009850 tx=0x7f1084009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d618398948756a58 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:09.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.132+0000 7f10977fe700 1 -- 172.21.15.49:0/672134819 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10900019f0 con 0x7f10981561a0 2023-07-21T22:12:09.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.132+0000 7f10977fe700 1 -- 172.21.15.49:0/672134819 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1084004030 con 0x7f10981561a0 2023-07-21T22:12:09.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.132+0000 7f10977fe700 1 -- 172.21.15.49:0/672134819 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10840043c0 con 0x7f10981561a0 2023-07-21T22:12:09.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.132+0000 7f109eacd700 1 -- 172.21.15.49:0/672134819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10981561a0 msgr2=0x7f10980cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:09.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.132+0000 7f109eacd700 1 --2- 172.21.15.49:0/672134819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10981561a0 0x7f10980cc570 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1084009850 tx=0x7f1084009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:09.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.132+0000 7f109eacd700 1 -- 172.21.15.49:0/672134819 shutdown_connections 2023-07-21T22:12:09.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.132+0000 7f109eacd700 1 --2- 172.21.15.49:0/672134819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10981561a0 0x7f10980cc570 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:09.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.132+0000 7f109eacd700 1 -- 172.21.15.49:0/672134819 >> 172.21.15.49:0/672134819 conn(0x7f109806f5a0 msgr2=0x7f10980cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:09.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.132+0000 7f109eacd700 1 -- 172.21.15.49:0/672134819 shutdown_connections 2023-07-21T22:12:09.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.132+0000 7f109eacd700 1 -- 172.21.15.49:0/672134819 wait complete. 2023-07-21T22:12:09.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109eacd700 1 Processor -- start 2023-07-21T22:12:09.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109eacd700 1 -- start start 2023-07-21T22:12:09.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109eacd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10980afc20 0x7f1098149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:09.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109eacd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1098155dd0 0x7f10981f1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:09.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109eacd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10981f53b0 0x7f10981f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:09.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109eacd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10981f5d90 con 0x7f10980afc20 2023-07-21T22:12:09.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109eacd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10980ac920 con 0x7f10981f53b0 2023-07-21T22:12:09.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109eacd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10980ad180 con 0x7f1098155dd0 2023-07-21T22:12:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109c869700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10980afc20 0x7f1098149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:09.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109c869700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10980afc20 0x7f1098149030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43654/0 (socket says 172.21.15.49:43654) 2023-07-21T22:12:09.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109c869700 1 -- 172.21.15.49:0/2056826988 learned_addr learned my addr 172.21.15.49:0/2056826988 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:09.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109d06a700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10981f53b0 0x7f10981f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:09.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f1097fff700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1098155dd0 0x7f10981f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:09.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109c869700 1 -- 172.21.15.49:0/2056826988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1098155dd0 msgr2=0x7f10981f1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:09.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109c869700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1098155dd0 0x7f10981f1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:09.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109c869700 1 -- 172.21.15.49:0/2056826988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10981f53b0 msgr2=0x7f10981f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:09.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109c869700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10981f53b0 0x7f10981f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:09.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109c869700 1 -- 172.21.15.49:0/2056826988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10840094b0 con 0x7f10980afc20 2023-07-21T22:12:09.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.136+0000 7f109d06a700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10981f53b0 0x7f10981f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:09.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.140+0000 7f109c869700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10980afc20 0x7f1098149030 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f108c00c520 tx=0x7f108c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:09.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.140+0000 7f10957fa700 1 -- 172.21.15.49:0/2056826988 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c0052d0 con 0x7f10980afc20 2023-07-21T22:12:09.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.140+0000 7f10957fa700 1 -- 172.21.15.49:0/2056826988 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c005450 con 0x7f10980afc20 2023-07-21T22:12:09.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.140+0000 7f109eacd700 1 -- 172.21.15.49:0/2056826988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10980c4e50 con 0x7f10980afc20 2023-07-21T22:12:09.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.140+0000 7f10957fa700 1 -- 172.21.15.49:0/2056826988 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c0038e0 con 0x7f10980afc20 2023-07-21T22:12:09.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.140+0000 7f109eacd700 1 -- 172.21.15.49:0/2056826988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10980ace10 con 0x7f10980afc20 2023-07-21T22:12:09.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.140+0000 7f109eacd700 1 -- 172.21.15.49:0/2056826988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1098073130 con 0x7f10980afc20 2023-07-21T22:12:09.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.144+0000 7f10957fa700 1 -- 172.21.15.49:0/2056826988 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f108c003a40 con 0x7f10980afc20 2023-07-21T22:12:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.144+0000 7f10957fa700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f107c0662f0 0x7f107c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.144+0000 7f10957fa700 1 -- 172.21.15.49:0/2056826988 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f108c0835a0 con 0x7f10980afc20 2023-07-21T22:12:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.144+0000 7f1097fff700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f107c0662f0 0x7f107c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.144+0000 7f1097fff700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f107c0662f0 0x7f107c0687a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f10840090b0 tx=0x7f1084008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:09.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.152+0000 7f10957fa700 1 -- 172.21.15.49:0/2056826988 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f108c0506e0 con 0x7f10980afc20 2023-07-21T22:12:09.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.360+0000 7f109eacd700 1 -- 172.21.15.49:0/2056826988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f10980ca1c0 con 0x7f10980afc20 2023-07-21T22:12:09.405 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-07-21T22:12:09.360+0000 7fcc7a5f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T22:12:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.368+0000 7f10957fa700 1 -- 172.21.15.49:0/2056826988 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f108c053d00 con 0x7f10980afc20 2023-07-21T22:12:09.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.372+0000 7f109eacd700 1 -- 172.21.15.49:0/2056826988 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f107c0662f0 msgr2=0x7f107c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:09.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.372+0000 7f109eacd700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f107c0662f0 0x7f107c0687a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f10840090b0 tx=0x7f1084008030 comp rx=0 tx=0).stop 2023-07-21T22:12:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.372+0000 7f109eacd700 1 -- 172.21.15.49:0/2056826988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10980afc20 msgr2=0x7f1098149030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.372+0000 7f109eacd700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10980afc20 0x7f1098149030 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f108c00c520 tx=0x7f108c00c8e0 comp rx=0 tx=0).stop 2023-07-21T22:12:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.372+0000 7f109eacd700 1 -- 172.21.15.49:0/2056826988 shutdown_connections 2023-07-21T22:12:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.372+0000 7f109eacd700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f107c0662f0 0x7f107c0687a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.372+0000 7f109eacd700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10981f53b0 0x7f10981f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.372+0000 7f109eacd700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1098155dd0 0x7f10981f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.372+0000 7f109eacd700 1 --2- 172.21.15.49:0/2056826988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10980afc20 0x7f1098149030 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.372+0000 7f109eacd700 1 -- 172.21.15.49:0/2056826988 >> 172.21.15.49:0/2056826988 conn(0x7f109806f5a0 msgr2=0x7f10980aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.372+0000 7f109eacd700 1 -- 172.21.15.49:0/2056826988 shutdown_connections 2023-07-21T22:12:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.372+0000 7f109eacd700 1 -- 172.21.15.49:0/2056826988 wait complete. 2023-07-21T22:12:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T22:12:09.431 INFO:tasks.ceph.mds.d.smithi150.stderr: -5103> 2023-07-21T22:10:40.294+0000 7fc879983700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:12:09.440 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T22:12:09.492 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-07-21T22:12:09.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.580+0000 7fae8359e700 1 Processor -- start 2023-07-21T22:12:09.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.580+0000 7fae8359e700 1 -- start start 2023-07-21T22:12:09.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.584+0000 7fae8359e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fae840d1e40 0x7fae840b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:09.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.584+0000 7fae8359e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae840b3e80 con 0x7fae840cee10 2023-07-21T22:12:09.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.584+0000 7fae8359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8415fd40 con 0x7fae840b7af0 2023-07-21T22:12:09.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.584+0000 7fae8359e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae840cea00 con 0x7fae840d1e40 2023-07-21T22:12:09.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.584+0000 7fae82d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fae840cee10 0x7fae840b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53116/0 (socket says 172.21.15.49:53116) 2023-07-21T22:12:09.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.584+0000 7fae82d9d700 1 -- 172.21.15.49:0/2864484857 learned_addr learned my addr 172.21.15.49:0/2864484857 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:09.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.584+0000 7fae7bfff700 1 --2- 172.21.15.49:0/2864484857 >> v2:172.21.15.150:3300/0 conn(0x7fae840d1e40 0x7fae840b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:09.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.584+0000 7fae81d9b700 1 -- 172.21.15.49:0/2864484857 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862012768 0 0) 0x7fae840b3e80 con 0x7fae840cee10 2023-07-21T22:12:09.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.584+0000 7fae81d9b700 1 -- 172.21.15.49:0/2864484857 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae700035d0 con 0x7fae840cee10 2023-07-21T22:12:09.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.584+0000 7fae81d9b700 1 -- 172.21.15.49:0/2864484857 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339384508 0 0) 0x7fae8415fd40 con 0x7fae840b7af0 2023-07-21T22:12:09.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.584+0000 7fae81d9b700 1 -- 172.21.15.49:0/2864484857 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae840b3e80 con 0x7fae840b7af0 2023-07-21T22:12:09.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.584+0000 7fae7bfff700 1 -- 172.21.15.49:0/2864484857 >> v1:172.21.15.150:6789/0 conn(0x7fae840b7af0 legacy=0x7fae8415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:09.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.584+0000 7fae7bfff700 1 -- 172.21.15.49:0/2864484857 >> v1:172.21.15.49:6789/0 conn(0x7fae840cee10 legacy=0x7fae840b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:09.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.584+0000 7fae7bfff700 1 -- 172.21.15.49:0/2864484857 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae840ccbf0 con 0x7fae840d1e40 2023-07-21T22:12:09.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.588+0000 7fae7bfff700 1 --2- 172.21.15.49:0/2864484857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae840d1e40 0x7fae840b1630 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009850 tx=0x7fae6c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d34b171380870f5c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:09.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.588+0000 7fae81d9b700 1 -- 172.21.15.49:0/2864484857 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c011830 con 0x7fae840d1e40 2023-07-21T22:12:09.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.588+0000 7fae81d9b700 1 -- 172.21.15.49:0/2864484857 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c011990 con 0x7fae840d1e40 2023-07-21T22:12:09.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.588+0000 7fae81d9b700 1 -- 172.21.15.49:0/2864484857 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c011d40 con 0x7fae840d1e40 2023-07-21T22:12:09.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.588+0000 7fae8359e700 1 -- 172.21.15.49:0/2864484857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae840d1e40 msgr2=0x7fae840b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:09.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.588+0000 7fae8359e700 1 --2- 172.21.15.49:0/2864484857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae840d1e40 0x7fae840b1630 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009850 tx=0x7fae6c009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:09.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.588+0000 7fae8359e700 1 -- 172.21.15.49:0/2864484857 shutdown_connections 2023-07-21T22:12:09.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.588+0000 7fae8359e700 1 --2- 172.21.15.49:0/2864484857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae840d1e40 0x7fae840b1630 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:09.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.588+0000 7fae8359e700 1 -- 172.21.15.49:0/2864484857 >> 172.21.15.49:0/2864484857 conn(0x7fae8406e960 msgr2=0x7fae8406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:09.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.588+0000 7fae8359e700 1 -- 172.21.15.49:0/2864484857 shutdown_connections 2023-07-21T22:12:09.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.588+0000 7fae8359e700 1 -- 172.21.15.49:0/2864484857 wait complete. 2023-07-21T22:12:09.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae8359e700 1 Processor -- start 2023-07-21T22:12:09.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae8359e700 1 -- start start 2023-07-21T22:12:09.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae8359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae840b7af0 0x7fae8415e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:09.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae8359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae840cee10 0x7fae840b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:09.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae8359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae840d1e40 0x7fae840b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:09.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae8359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae841f42c0 con 0x7fae840d1e40 2023-07-21T22:12:09.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae8359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae841f4560 con 0x7fae840cee10 2023-07-21T22:12:09.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae8359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae841f4840 con 0x7fae840b7af0 2023-07-21T22:12:09.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae82d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae840d1e40 0x7fae840b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae82d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae840d1e40 0x7fae840b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43666/0 (socket says 172.21.15.49:43666) 2023-07-21T22:12:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae82d9d700 1 -- 172.21.15.49:0/3737105721 learned_addr learned my addr 172.21.15.49:0/3737105721 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae8259c700 1 --2- 172.21.15.49:0/3737105721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae840b7af0 0x7fae8415e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae7bfff700 1 --2- 172.21.15.49:0/3737105721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae840cee10 0x7fae840b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae82d9d700 1 -- 172.21.15.49:0/3737105721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae840b7af0 msgr2=0x7fae8415e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae82d9d700 1 --2- 172.21.15.49:0/3737105721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae840b7af0 0x7fae8415e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae82d9d700 1 -- 172.21.15.49:0/3737105721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae840cee10 msgr2=0x7fae840b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:09.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae82d9d700 1 --2- 172.21.15.49:0/3737105721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae840cee10 0x7fae840b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:09.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae82d9d700 1 -- 172.21.15.49:0/3737105721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c0094b0 con 0x7fae840d1e40 2023-07-21T22:12:09.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.592+0000 7fae82d9d700 1 --2- 172.21.15.49:0/3737105721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae840d1e40 0x7fae840b2d70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00cb70 tx=0x7fae7c00ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:09.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.596+0000 7fae7affd700 1 -- 172.21.15.49:0/3737105721 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c00a9e0 con 0x7fae840d1e40 2023-07-21T22:12:09.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.596+0000 7fae7affd700 1 -- 172.21.15.49:0/3737105721 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c00ab40 con 0x7fae840d1e40 2023-07-21T22:12:09.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.596+0000 7fae7affd700 1 -- 172.21.15.49:0/3737105721 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c012400 con 0x7fae840d1e40 2023-07-21T22:12:09.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.596+0000 7fae8359e700 1 -- 172.21.15.49:0/3737105721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae841f4b20 con 0x7fae840d1e40 2023-07-21T22:12:09.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.596+0000 7fae8359e700 1 -- 172.21.15.49:0/3737105721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8415ee10 con 0x7fae840d1e40 2023-07-21T22:12:09.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.596+0000 7fae8359e700 1 -- 172.21.15.49:0/3737105721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae841f5040 con 0x7fae840d1e40 2023-07-21T22:12:09.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.596+0000 7fae7affd700 1 -- 172.21.15.49:0/3737105721 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fae7c005d50 con 0x7fae840d1e40 2023-07-21T22:12:09.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.600+0000 7fae7affd700 1 --2- 172.21.15.49:0/3737105721 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fae64066320 0x7fae640687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:09.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.600+0000 7fae7affd700 1 -- 172.21.15.49:0/3737105721 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fae7c083880 con 0x7fae840d1e40 2023-07-21T22:12:09.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.600+0000 7fae8259c700 1 --2- 172.21.15.49:0/3737105721 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fae64066320 0x7fae640687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:09.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.600+0000 7fae8259c700 1 --2- 172.21.15.49:0/3737105721 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fae64066320 0x7fae640687d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fae740011e0 tx=0x7fae74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:09.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.608+0000 7fae7affd700 1 -- 172.21.15.49:0/3737105721 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fae841f5040 con 0x7fae840d1e40 2023-07-21T22:12:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:09.824+0000 7fae8359e700 1 -- 172.21.15.49:0/3737105721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fae841f5040 con 0x7fae840d1e40 2023-07-21T22:12:10.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.375+0000 7fae7affd700 1 -- 172.21.15.49:0/3737105721 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fae841f5040 con 0x7fae840d1e40 2023-07-21T22:12:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.379+0000 7fae8359e700 1 -- 172.21.15.49:0/3737105721 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fae64066320 msgr2=0x7fae640687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.379+0000 7fae8359e700 1 --2- 172.21.15.49:0/3737105721 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fae64066320 0x7fae640687d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fae740011e0 tx=0x7fae74009040 comp rx=0 tx=0).stop 2023-07-21T22:12:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.379+0000 7fae8359e700 1 -- 172.21.15.49:0/3737105721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae840d1e40 msgr2=0x7fae840b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.379+0000 7fae8359e700 1 --2- 172.21.15.49:0/3737105721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae840d1e40 0x7fae840b2d70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00cb70 tx=0x7fae7c00ce80 comp rx=0 tx=0).stop 2023-07-21T22:12:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.379+0000 7fae8359e700 1 -- 172.21.15.49:0/3737105721 shutdown_connections 2023-07-21T22:12:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.379+0000 7fae8359e700 1 --2- 172.21.15.49:0/3737105721 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fae64066320 0x7fae640687d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.379+0000 7fae8359e700 1 --2- 172.21.15.49:0/3737105721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae840d1e40 0x7fae840b2d70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:10.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.379+0000 7fae8359e700 1 --2- 172.21.15.49:0/3737105721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae840cee10 0x7fae840b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:10.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.379+0000 7fae8359e700 1 --2- 172.21.15.49:0/3737105721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae840b7af0 0x7fae8415e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:10.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.379+0000 7fae8359e700 1 -- 172.21.15.49:0/3737105721 >> 172.21.15.49:0/3737105721 conn(0x7fae8406e960 msgr2=0x7fae8415ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:10.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.379+0000 7fae8359e700 1 -- 172.21.15.49:0/3737105721 shutdown_connections 2023-07-21T22:12:10.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.379+0000 7fae8359e700 1 -- 172.21.15.49:0/3737105721 wait complete. 2023-07-21T22:12:10.449 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T22:12:10.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.595+0000 7f055fb4d700 1 Processor -- start 2023-07-21T22:12:10.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.595+0000 7f055fb4d700 1 -- start start 2023-07-21T22:12:10.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055fb4d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f055815bb80 0x7f0558160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:10.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055fb4d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05580cf6d0 0x7f05580d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:10.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055fb4d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05580ccc30 con 0x7f055815bf50 2023-07-21T22:12:10.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055fb4d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055806f480 con 0x7f055815bb80 2023-07-21T22:12:10.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055fb4d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0558160860 con 0x7f05580cf6d0 2023-07-21T22:12:10.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055d8e9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f055815bb80 0x7f0558160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:10.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055e0ea700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05580cf6d0 0x7f05580d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:10.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055d8e9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f055815bb80 0x7f0558160320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:56974/0 (socket says 172.21.15.49:56974) 2023-07-21T22:12:10.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055e0ea700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05580cf6d0 0x7f05580d03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:47690/0 (socket says 172.21.15.49:47690) 2023-07-21T22:12:10.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055d0e8700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f055815bf50 0x7f05580cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:34012/0 (socket says 172.21.15.49:34012) 2023-07-21T22:12:10.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055e0ea700 1 -- 172.21.15.49:0/532929622 learned_addr learned my addr 172.21.15.49:0/532929622 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:10.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055c8e7700 1 -- 172.21.15.49:0/532929622 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723921699 0 0) 0x7f05580ccc30 con 0x7f055815bf50 2023-07-21T22:12:10.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055e0ea700 1 -- 172.21.15.49:0/532929622 >> v2:172.21.15.150:3300/0 conn(0x7f055815bb80 msgr2=0x7f0558160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:10.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055e0ea700 1 --2- 172.21.15.49:0/532929622 >> v2:172.21.15.150:3300/0 conn(0x7f055815bb80 0x7f0558160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:10.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055e0ea700 1 -- 172.21.15.49:0/532929622 >> v1:172.21.15.150:6789/0 conn(0x7f055815bf50 legacy=0x7f05580cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:10.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.599+0000 7f055e0ea700 1 -- 172.21.15.49:0/532929622 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05580ce9a0 con 0x7f05580cf6d0 2023-07-21T22:12:10.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.603+0000 7f055e0ea700 1 --2- 172.21.15.49:0/532929622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05580cf6d0 0x7f05580d03f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0550009e50 tx=0x7f055000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed1c95a92adc8334 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:10.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.603+0000 7f055c8e7700 1 -- 172.21.15.49:0/532929622 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000e070 con 0x7f05580cf6d0 2023-07-21T22:12:10.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.603+0000 7f055c8e7700 1 -- 172.21.15.49:0/532929622 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055000b910 con 0x7f05580cf6d0 2023-07-21T22:12:10.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.603+0000 7f055c8e7700 1 -- 172.21.15.49:0/532929622 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000bcc0 con 0x7f05580cf6d0 2023-07-21T22:12:10.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.603+0000 7f055fb4d700 1 -- 172.21.15.49:0/532929622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05580cf6d0 msgr2=0x7f05580d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:10.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.603+0000 7f055fb4d700 1 --2- 172.21.15.49:0/532929622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05580cf6d0 0x7f05580d03f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0550009e50 tx=0x7f055000b330 comp rx=0 tx=0).stop 2023-07-21T22:12:10.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.603+0000 7f055fb4d700 1 -- 172.21.15.49:0/532929622 shutdown_connections 2023-07-21T22:12:10.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.603+0000 7f055fb4d700 1 --2- 172.21.15.49:0/532929622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05580cf6d0 0x7f05580d03f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:10.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.603+0000 7f055fb4d700 1 --2- 172.21.15.49:0/532929622 >> v2:172.21.15.150:3300/0 conn(0x7f055815bb80 0x7f0558160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:10.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.603+0000 7f055fb4d700 1 -- 172.21.15.49:0/532929622 >> 172.21.15.49:0/532929622 conn(0x7f055806fdc0 msgr2=0x7f0558070190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:10.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.603+0000 7f055fb4d700 1 -- 172.21.15.49:0/532929622 shutdown_connections 2023-07-21T22:12:10.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.603+0000 7f055fb4d700 1 -- 172.21.15.49:0/532929622 wait complete. 2023-07-21T22:12:10.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.607+0000 7f055fb4d700 1 Processor -- start 2023-07-21T22:12:10.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.607+0000 7f055fb4d700 1 -- start start 2023-07-21T22:12:10.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055fb4d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05580cf6d0 0x7f05580c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:10.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055fb4d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f055815bb80 0x7f05581f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:10.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055fb4d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f055815bf50 0x7f0558157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:10.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055fb4d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05581f1d70 con 0x7f05580cf6d0 2023-07-21T22:12:10.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055fb4d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05581581a0 con 0x7f055815bf50 2023-07-21T22:12:10.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055fb4d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05581f5270 con 0x7f055815bb80 2023-07-21T22:12:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055d8e9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05580cf6d0 0x7f05580c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055d8e9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05580cf6d0 0x7f05580c96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43682/0 (socket says 172.21.15.49:43682) 2023-07-21T22:12:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055d8e9700 1 -- 172.21.15.49:0/2110937665 learned_addr learned my addr 172.21.15.49:0/2110937665 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055d0e8700 1 --2- 172.21.15.49:0/2110937665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f055815bb80 0x7f05581f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055e0ea700 1 --2- 172.21.15.49:0/2110937665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f055815bf50 0x7f0558157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055d8e9700 1 -- 172.21.15.49:0/2110937665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f055815bb80 msgr2=0x7f05581f1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055d8e9700 1 --2- 172.21.15.49:0/2110937665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f055815bb80 0x7f05581f1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055d8e9700 1 -- 172.21.15.49:0/2110937665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f055815bf50 msgr2=0x7f0558157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055d8e9700 1 --2- 172.21.15.49:0/2110937665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f055815bf50 0x7f0558157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055d8e9700 1 -- 172.21.15.49:0/2110937665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0550009b30 con 0x7f05580cf6d0 2023-07-21T22:12:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055d8e9700 1 --2- 172.21.15.49:0/2110937665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05580cf6d0 0x7f05580c96b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f055400ea30 tx=0x7f055400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f054e7fc700 1 -- 172.21.15.49:0/2110937665 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554009720 con 0x7f05580cf6d0 2023-07-21T22:12:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f054e7fc700 1 -- 172.21.15.49:0/2110937665 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055400eed0 con 0x7f05580cf6d0 2023-07-21T22:12:10.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f054e7fc700 1 -- 172.21.15.49:0/2110937665 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400c9f0 con 0x7f05580cf6d0 2023-07-21T22:12:10.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.611+0000 7f055fb4d700 1 -- 172.21.15.49:0/2110937665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05581f46f0 con 0x7f05580cf6d0 2023-07-21T22:12:10.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.615+0000 7f055fb4d700 1 -- 172.21.15.49:0/2110937665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05581f4cb0 con 0x7f05580cf6d0 2023-07-21T22:12:10.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.615+0000 7f055fb4d700 1 -- 172.21.15.49:0/2110937665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05580cfdd0 con 0x7f05580cf6d0 2023-07-21T22:12:10.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.615+0000 7f054e7fc700 1 -- 172.21.15.49:0/2110937665 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f055400cb70 con 0x7f05580cf6d0 2023-07-21T22:12:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.619+0000 7f054e7fc700 1 --2- 172.21.15.49:0/2110937665 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f053c0662f0 0x7f053c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.619+0000 7f054e7fc700 1 -- 172.21.15.49:0/2110937665 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f05540840f0 con 0x7f05580cf6d0 2023-07-21T22:12:10.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.619+0000 7f055d0e8700 1 --2- 172.21.15.49:0/2110937665 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f053c0662f0 0x7f053c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:10.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.619+0000 7f055d0e8700 1 --2- 172.21.15.49:0/2110937665 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f053c0662f0 0x7f053c0687a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f05580cb380 tx=0x7f0548007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:10.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.627+0000 7f054e7fc700 1 -- 172.21.15.49:0/2110937665 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0554054be0 con 0x7f05580cf6d0 2023-07-21T22:12:10.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:10.799+0000 7f055fb4d700 1 -- 172.21.15.49:0/2110937665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f055804dd20 con 0x7f05580cf6d0 2023-07-21T22:12:11.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.491+0000 7f054e7fc700 1 -- 172.21.15.49:0/2110937665 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0554054770 con 0x7f05580cf6d0 2023-07-21T22:12:11.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.495+0000 7f055fb4d700 1 -- 172.21.15.49:0/2110937665 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f053c0662f0 msgr2=0x7f053c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:11.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.495+0000 7f055fb4d700 1 --2- 172.21.15.49:0/2110937665 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f053c0662f0 0x7f053c0687a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f05580cb380 tx=0x7f0548007e90 comp rx=0 tx=0).stop 2023-07-21T22:12:11.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.495+0000 7f055fb4d700 1 -- 172.21.15.49:0/2110937665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05580cf6d0 msgr2=0x7f05580c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:11.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.495+0000 7f055fb4d700 1 --2- 172.21.15.49:0/2110937665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05580cf6d0 0x7f05580c96b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f055400ea30 tx=0x7f055400ed40 comp rx=0 tx=0).stop 2023-07-21T22:12:11.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.499+0000 7f055fb4d700 1 -- 172.21.15.49:0/2110937665 shutdown_connections 2023-07-21T22:12:11.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.499+0000 7f055fb4d700 1 --2- 172.21.15.49:0/2110937665 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f053c0662f0 0x7f053c0687a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.499+0000 7f055fb4d700 1 --2- 172.21.15.49:0/2110937665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f055815bf50 0x7f0558157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.499+0000 7f055fb4d700 1 --2- 172.21.15.49:0/2110937665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f055815bb80 0x7f05581f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.499+0000 7f055fb4d700 1 --2- 172.21.15.49:0/2110937665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05580cf6d0 0x7f05580c96b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.499+0000 7f055fb4d700 1 -- 172.21.15.49:0/2110937665 >> 172.21.15.49:0/2110937665 conn(0x7f055806fdc0 msgr2=0x7f05580cee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:11.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.499+0000 7f055fb4d700 1 -- 172.21.15.49:0/2110937665 shutdown_connections 2023-07-21T22:12:11.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.499+0000 7f055fb4d700 1 -- 172.21.15.49:0/2110937665 wait complete. 2023-07-21T22:12:11.546 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-07-21T22:12:11.568 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T22:12:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.711+0000 7f7aab9cd700 1 Processor -- start 2023-07-21T22:12:11.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.711+0000 7f7aab9cd700 1 -- start start 2023-07-21T22:12:11.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.711+0000 7f7aab9cd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa415bb80 0x7f7aa4160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:11.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.711+0000 7f7aab9cd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7aa415bf50 0x7f7aa40cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:11.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.711+0000 7f7aab9cd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7aa40b5430 0x7f7aa40cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:11.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.711+0000 7f7aab9cd700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa406f480 con 0x7f7aa415bf50 2023-07-21T22:12:11.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.711+0000 7f7aab9cd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa4160860 con 0x7f7aa40b5430 2023-07-21T22:12:11.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.711+0000 7f7aab9cd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40ce790 con 0x7f7aa415bb80 2023-07-21T22:12:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aa8f68700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7aa415bf50 0x7f7aa40cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aa9769700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa415bb80 0x7f7aa4160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aa8f68700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7aa415bf50 0x7f7aa40cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43694/0 (socket says 172.21.15.49:43694) 2023-07-21T22:12:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aa9769700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa415bb80 0x7f7aa4160320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:47712/0 (socket says 172.21.15.49:47712) 2023-07-21T22:12:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aa8f68700 1 -- 172.21.15.49:0/464707704 learned_addr learned my addr 172.21.15.49:0/464707704 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aa9f6a700 1 --2- 172.21.15.49:0/464707704 >> v2:172.21.15.150:3300/0 conn(0x7f7aa40b5430 0x7f7aa40cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aa8f68700 1 -- 172.21.15.49:0/464707704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa415bb80 msgr2=0x7f7aa4160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aa8f68700 1 --2- 172.21.15.49:0/464707704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa415bb80 0x7f7aa4160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aa8f68700 1 -- 172.21.15.49:0/464707704 >> v2:172.21.15.150:3300/0 conn(0x7f7aa40b5430 msgr2=0x7f7aa40cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aa8f68700 1 --2- 172.21.15.49:0/464707704 >> v2:172.21.15.150:3300/0 conn(0x7f7aa40b5430 0x7f7aa40cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aa8f68700 1 -- 172.21.15.49:0/464707704 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa40ccc30 con 0x7f7aa415bf50 2023-07-21T22:12:11.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aa8f68700 1 --2- 172.21.15.49:0/464707704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aa415bf50 0x7f7aa40cefc0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40c9640 tx=0x7f7a94009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e62c8e6355e2214 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:11.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7a9bfff700 1 -- 172.21.15.49:0/464707704 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94011830 con 0x7f7aa415bf50 2023-07-21T22:12:11.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7a9bfff700 1 -- 172.21.15.49:0/464707704 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a94011990 con 0x7f7aa415bf50 2023-07-21T22:12:11.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7a9bfff700 1 -- 172.21.15.49:0/464707704 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94011d20 con 0x7f7aa415bf50 2023-07-21T22:12:11.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aab9cd700 1 -- 172.21.15.49:0/464707704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aa415bf50 msgr2=0x7f7aa40cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:11.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aab9cd700 1 --2- 172.21.15.49:0/464707704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aa415bf50 0x7f7aa40cefc0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40c9640 tx=0x7f7a94009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aab9cd700 1 -- 172.21.15.49:0/464707704 shutdown_connections 2023-07-21T22:12:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aab9cd700 1 --2- 172.21.15.49:0/464707704 >> v2:172.21.15.150:3300/0 conn(0x7f7aa40b5430 0x7f7aa40cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aab9cd700 1 --2- 172.21.15.49:0/464707704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aa415bf50 0x7f7aa40cefc0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aab9cd700 1 --2- 172.21.15.49:0/464707704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa415bb80 0x7f7aa4160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.715+0000 7f7aab9cd700 1 -- 172.21.15.49:0/464707704 >> 172.21.15.49:0/464707704 conn(0x7f7aa406fdc0 msgr2=0x7f7aa4070190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.719+0000 7f7aab9cd700 1 -- 172.21.15.49:0/464707704 shutdown_connections 2023-07-21T22:12:11.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.719+0000 7f7aab9cd700 1 -- 172.21.15.49:0/464707704 wait complete. 2023-07-21T22:12:11.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.719+0000 7f7aab9cd700 1 Processor -- start 2023-07-21T22:12:11.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.719+0000 7f7aab9cd700 1 -- start start 2023-07-21T22:12:11.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aab9cd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aa40b5430 0x7f7aa40c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:11.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aab9cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aa415bb80 0x7f7aa40c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:11.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aab9cd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa415bf50 0x7f7aa41446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:11.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aab9cd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40c8450 con 0x7f7aa415bb80 2023-07-21T22:12:11.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aab9cd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40ca4c0 con 0x7f7aa40b5430 2023-07-21T22:12:11.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aab9cd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40c8640 con 0x7f7aa415bf50 2023-07-21T22:12:11.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aa8f68700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aa415bb80 0x7f7aa40c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:11.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aa8f68700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aa415bb80 0x7f7aa40c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43704/0 (socket says 172.21.15.49:43704) 2023-07-21T22:12:11.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aa8f68700 1 -- 172.21.15.49:0/1924625292 learned_addr learned my addr 172.21.15.49:0/1924625292 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:11.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aa9769700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aa40b5430 0x7f7aa40c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:11.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aa9f6a700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa415bf50 0x7f7aa41446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:11.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aa8f68700 1 -- 172.21.15.49:0/1924625292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa415bf50 msgr2=0x7f7aa41446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:11.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aa8f68700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa415bf50 0x7f7aa41446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aa8f68700 1 -- 172.21.15.49:0/1924625292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aa40b5430 msgr2=0x7f7aa40c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:11.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aa8f68700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aa40b5430 0x7f7aa40c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aa8f68700 1 -- 172.21.15.49:0/1924625292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a94009570 con 0x7f7aa415bb80 2023-07-21T22:12:11.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aa9769700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aa40b5430 0x7f7aa40c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:11.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aa8f68700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aa415bb80 0x7f7aa40c9f80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40b51d0 tx=0x7f7a94004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:11.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7a99ffb700 1 -- 172.21.15.49:0/1924625292 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94004460 con 0x7f7aa415bb80 2023-07-21T22:12:11.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7a99ffb700 1 -- 172.21.15.49:0/1924625292 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9401e070 con 0x7f7aa415bb80 2023-07-21T22:12:11.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aab9cd700 1 -- 172.21.15.49:0/1924625292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa40c8920 con 0x7f7aa415bb80 2023-07-21T22:12:11.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7a99ffb700 1 -- 172.21.15.49:0/1924625292 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94003900 con 0x7f7aa415bb80 2023-07-21T22:12:11.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.723+0000 7f7aab9cd700 1 -- 172.21.15.49:0/1924625292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa40c8ee0 con 0x7f7aa415bb80 2023-07-21T22:12:11.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.727+0000 7f7aab9cd700 1 -- 172.21.15.49:0/1924625292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa4072480 con 0x7f7aa415bb80 2023-07-21T22:12:11.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.727+0000 7f7a99ffb700 1 -- 172.21.15.49:0/1924625292 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7a94003a60 con 0x7f7aa415bb80 2023-07-21T22:12:11.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.731+0000 7f7a99ffb700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7a88066320 0x7f7a880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:11.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.731+0000 7f7a99ffb700 1 -- 172.21.15.49:0/1924625292 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f7a94020070 con 0x7f7aa415bb80 2023-07-21T22:12:11.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.731+0000 7f7aa9769700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7a88066320 0x7f7a880687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:11.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.731+0000 7f7aa9769700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7a88066320 0x7f7a880687d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009bc0 tx=0x7f7aa0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:11.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.739+0000 7f7a99ffb700 1 -- 172.21.15.49:0/1924625292 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7a94052710 con 0x7f7aa415bb80 2023-07-21T22:12:11.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:11.923+0000 7f7aab9cd700 1 -- 172.21.15.49:0/1924625292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7aa40cce50 con 0x7f7aa415bb80 2023-07-21T22:12:12.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.507+0000 7f7a99ffb700 1 -- 172.21.15.49:0/1924625292 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7a94055d30 con 0x7f7aa415bb80 2023-07-21T22:12:12.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.511+0000 7f7aab9cd700 1 -- 172.21.15.49:0/1924625292 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7a88066320 msgr2=0x7f7a880687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:12.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.511+0000 7f7aab9cd700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7a88066320 0x7f7a880687d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009bc0 tx=0x7f7aa0008040 comp rx=0 tx=0).stop 2023-07-21T22:12:12.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.511+0000 7f7aab9cd700 1 -- 172.21.15.49:0/1924625292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aa415bb80 msgr2=0x7f7aa40c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:12.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.511+0000 7f7aab9cd700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aa415bb80 0x7f7aa40c9f80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40b51d0 tx=0x7f7a94004770 comp rx=0 tx=0).stop 2023-07-21T22:12:12.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.511+0000 7f7aab9cd700 1 -- 172.21.15.49:0/1924625292 shutdown_connections 2023-07-21T22:12:12.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.511+0000 7f7aab9cd700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7a88066320 0x7f7a880687d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:12.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.511+0000 7f7aab9cd700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aa415bb80 0x7f7aa40c9f80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:12.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.511+0000 7f7aab9cd700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa415bf50 0x7f7aa41446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:12.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.511+0000 7f7aab9cd700 1 --2- 172.21.15.49:0/1924625292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aa40b5430 0x7f7aa40c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:12.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.511+0000 7f7aab9cd700 1 -- 172.21.15.49:0/1924625292 >> 172.21.15.49:0/1924625292 conn(0x7f7aa406fdc0 msgr2=0x7f7aa40b76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:12.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.511+0000 7f7aab9cd700 1 -- 172.21.15.49:0/1924625292 shutdown_connections 2023-07-21T22:12:12.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.511+0000 7f7aab9cd700 1 -- 172.21.15.49:0/1924625292 wait complete. 2023-07-21T22:12:12.561 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-07-21T22:12:12.582 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-07-21T22:12:12.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76ffff700 1 Processor -- start 2023-07-21T22:12:12.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76ffff700 1 -- start start 2023-07-21T22:12:12.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa770159c60 0x7fa7700ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:12.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7700caa90 0x7fa7700c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:12.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76ffff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7700ce610 con 0x7fa7700afaf0 2023-07-21T22:12:12.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76ffff700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7700ca430 con 0x7fa7700caa90 2023-07-21T22:12:12.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76ffff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700ca710 con 0x7fa770159c60 2023-07-21T22:12:12.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76e7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7700caa90 0x7fa7700c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:12.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76e7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7700caa90 0x7fa7700c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43706/0 (socket says 172.21.15.49:43706) 2023-07-21T22:12:12.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76e7fc700 1 -- 172.21.15.49:0/3403909718 learned_addr learned my addr 172.21.15.49:0/3403909718 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:12.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76effd700 1 --2- 172.21.15.49:0/3403909718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa770159c60 0x7fa7700ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:12.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76e7fc700 1 -- 172.21.15.49:0/3403909718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa770159c60 msgr2=0x7fa7700ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:12.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76e7fc700 1 --2- 172.21.15.49:0/3403909718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa770159c60 0x7fa7700ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:12.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76e7fc700 1 -- 172.21.15.49:0/3403909718 >> v1:172.21.15.150:6789/0 conn(0x7fa7700afaf0 legacy=0x7fa7700c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:12.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.723+0000 7fa76e7fc700 1 -- 172.21.15.49:0/3403909718 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7700cdfc0 con 0x7fa7700caa90 2023-07-21T22:12:12.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.727+0000 7fa76e7fc700 1 --2- 172.21.15.49:0/3403909718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7700caa90 0x7fa7700c9b30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa764009910 tx=0x7fa764009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562557838294f579 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:12.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.727+0000 7fa76dffb700 1 -- 172.21.15.49:0/3403909718 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764011830 con 0x7fa7700caa90 2023-07-21T22:12:12.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.727+0000 7fa76dffb700 1 -- 172.21.15.49:0/3403909718 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa764011990 con 0x7fa7700caa90 2023-07-21T22:12:12.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.727+0000 7fa76dffb700 1 -- 172.21.15.49:0/3403909718 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764011d40 con 0x7fa7700caa90 2023-07-21T22:12:12.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.727+0000 7fa76ffff700 1 -- 172.21.15.49:0/3403909718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7700caa90 msgr2=0x7fa7700c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:12.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.727+0000 7fa76ffff700 1 --2- 172.21.15.49:0/3403909718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7700caa90 0x7fa7700c9b30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa764009910 tx=0x7fa764009c20 comp rx=0 tx=0).stop 2023-07-21T22:12:12.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.727+0000 7fa76ffff700 1 -- 172.21.15.49:0/3403909718 shutdown_connections 2023-07-21T22:12:12.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.727+0000 7fa76ffff700 1 --2- 172.21.15.49:0/3403909718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7700caa90 0x7fa7700c9b30 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:12.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.727+0000 7fa76ffff700 1 --2- 172.21.15.49:0/3403909718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa770159c60 0x7fa7700ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:12.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.727+0000 7fa76ffff700 1 -- 172.21.15.49:0/3403909718 >> 172.21.15.49:0/3403909718 conn(0x7fa77006e960 msgr2=0x7fa77006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:12.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.727+0000 7fa76ffff700 1 -- 172.21.15.49:0/3403909718 shutdown_connections 2023-07-21T22:12:12.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.727+0000 7fa76ffff700 1 -- 172.21.15.49:0/3403909718 wait complete. 2023-07-21T22:12:12.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.731+0000 7fa76ffff700 1 Processor -- start 2023-07-21T22:12:12.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.731+0000 7fa76ffff700 1 -- start start 2023-07-21T22:12:12.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.731+0000 7fa76ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7700afaf0 0x7fa7700c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:12.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.731+0000 7fa76ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7700caa90 0x7fa7700b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:12.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.731+0000 7fa76ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa770159c60 0x7fa770157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:12.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.731+0000 7fa76ffff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700c4d60 con 0x7fa770159c60 2023-07-21T22:12:12.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.731+0000 7fa76ffff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700abc40 con 0x7fa7700caa90 2023-07-21T22:12:12.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.731+0000 7fa76ffff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700abf20 con 0x7fa7700afaf0 2023-07-21T22:12:12.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.731+0000 7fa76f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa770159c60 0x7fa770157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:12.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.731+0000 7fa76f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa770159c60 0x7fa770157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43722/0 (socket says 172.21.15.49:43722) 2023-07-21T22:12:12.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.731+0000 7fa76f7fe700 1 -- 172.21.15.49:0/4134719345 learned_addr learned my addr 172.21.15.49:0/4134719345 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.731+0000 7fa76effd700 1 --2- 172.21.15.49:0/4134719345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7700afaf0 0x7fa7700c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.731+0000 7fa76e7fc700 1 --2- 172.21.15.49:0/4134719345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7700caa90 0x7fa7700b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.735+0000 7fa76f7fe700 1 -- 172.21.15.49:0/4134719345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7700afaf0 msgr2=0x7fa7700c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.735+0000 7fa76f7fe700 1 --2- 172.21.15.49:0/4134719345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7700afaf0 0x7fa7700c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.735+0000 7fa76f7fe700 1 -- 172.21.15.49:0/4134719345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7700caa90 msgr2=0x7fa7700b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.735+0000 7fa76f7fe700 1 --2- 172.21.15.49:0/4134719345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7700caa90 0x7fa7700b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.735+0000 7fa76f7fe700 1 -- 172.21.15.49:0/4134719345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa764009570 con 0x7fa770159c60 2023-07-21T22:12:12.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.735+0000 7fa76f7fe700 1 --2- 172.21.15.49:0/4134719345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa770159c60 0x7fa770157d20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa76800cc50 tx=0x7fa76800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:12.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.735+0000 7fa7577fe700 1 -- 172.21.15.49:0/4134719345 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768003c20 con 0x7fa770159c60 2023-07-21T22:12:12.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.735+0000 7fa7577fe700 1 -- 172.21.15.49:0/4134719345 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa768003d80 con 0x7fa770159c60 2023-07-21T22:12:12.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.735+0000 7fa7577fe700 1 -- 172.21.15.49:0/4134719345 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76800aab0 con 0x7fa770159c60 2023-07-21T22:12:12.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.735+0000 7fa76ffff700 1 -- 172.21.15.49:0/4134719345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7700ac200 con 0x7fa770159c60 2023-07-21T22:12:12.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.735+0000 7fa76ffff700 1 -- 172.21.15.49:0/4134719345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7700ac7c0 con 0x7fa770159c60 2023-07-21T22:12:12.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.735+0000 7fa76ffff700 1 -- 172.21.15.49:0/4134719345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7700ac950 con 0x7fa770159c60 2023-07-21T22:12:12.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.739+0000 7fa7577fe700 1 -- 172.21.15.49:0/4134719345 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa76800ac10 con 0x7fa770159c60 2023-07-21T22:12:12.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.739+0000 7fa7577fe700 1 --2- 172.21.15.49:0/4134719345 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa75c0662f0 0x7fa75c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:12.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.739+0000 7fa7577fe700 1 -- 172.21.15.49:0/4134719345 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fa768083da0 con 0x7fa770159c60 2023-07-21T22:12:12.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.739+0000 7fa76effd700 1 --2- 172.21.15.49:0/4134719345 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa75c0662f0 0x7fa75c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:12.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.743+0000 7fa76effd700 1 --2- 172.21.15.49:0/4134719345 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa75c0662f0 0x7fa75c0687a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa760009b50 tx=0x7fa760009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:12.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.747+0000 7fa7577fe700 1 -- 172.21.15.49:0/4134719345 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa768051110 con 0x7fa770159c60 2023-07-21T22:12:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:12.923+0000 7fa76ffff700 1 -- 172.21.15.49:0/4134719345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa77004dcb0 con 0x7fa770159c60 2023-07-21T22:12:13.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.519+0000 7fa7577fe700 1 -- 172.21.15.49:0/4134719345 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v36) v1 ==== 178+0+0 (secure 0 0 0) 0x7fa768054730 con 0x7fa770159c60 2023-07-21T22:12:13.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.527+0000 7fa76ffff700 1 -- 172.21.15.49:0/4134719345 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa75c0662f0 msgr2=0x7fa75c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:13.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.527+0000 7fa76ffff700 1 --2- 172.21.15.49:0/4134719345 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa75c0662f0 0x7fa75c0687a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa760009b50 tx=0x7fa760009240 comp rx=0 tx=0).stop 2023-07-21T22:12:13.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.527+0000 7fa76ffff700 1 -- 172.21.15.49:0/4134719345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa770159c60 msgr2=0x7fa770157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:13.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.527+0000 7fa76ffff700 1 --2- 172.21.15.49:0/4134719345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa770159c60 0x7fa770157d20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa76800cc50 tx=0x7fa76800cf60 comp rx=0 tx=0).stop 2023-07-21T22:12:13.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.527+0000 7fa76ffff700 1 -- 172.21.15.49:0/4134719345 shutdown_connections 2023-07-21T22:12:13.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.527+0000 7fa76ffff700 1 --2- 172.21.15.49:0/4134719345 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa75c0662f0 0x7fa75c0687a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:13.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.527+0000 7fa76ffff700 1 --2- 172.21.15.49:0/4134719345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa770159c60 0x7fa770157d20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:13.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.527+0000 7fa76ffff700 1 --2- 172.21.15.49:0/4134719345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7700caa90 0x7fa7700b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:13.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.527+0000 7fa76ffff700 1 --2- 172.21.15.49:0/4134719345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7700afaf0 0x7fa7700c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:13.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.527+0000 7fa76ffff700 1 -- 172.21.15.49:0/4134719345 >> 172.21.15.49:0/4134719345 conn(0x7fa77006e960 msgr2=0x7fa770070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:13.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.527+0000 7fa76ffff700 1 -- 172.21.15.49:0/4134719345 shutdown_connections 2023-07-21T22:12:13.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.527+0000 7fa76ffff700 1 -- 172.21.15.49:0/4134719345 wait complete. 2023-07-21T22:12:13.573 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data_ec' removed 2023-07-21T22:12:13.594 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T22:12:13.594 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T22:12:13.594 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T22:12:13.595 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:12:13.595 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T22:12:13.595 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T22:12:13.595 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T22:12:13.596 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:12:13.596 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T22:12:13.596 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T22:12:13.596 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T22:12:13.597 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:12:13.597 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T22:12:13.597 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T22:12:13.597 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T22:12:13.597 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:12:13.616 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T22:12:13.617 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T22:12:13.618 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T22:12:13.618 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T22:12:13.619 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T22:12:13.619 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T22:12:13.623 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T22:12:13.623 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T22:12:13.672 INFO:tasks.ceph.mds.d:Started 2023-07-21T22:12:13.673 DEBUG:teuthology.parallel:result is None 2023-07-21T22:12:13.674 INFO:tasks.ceph.mds.c:Started 2023-07-21T22:12:13.674 DEBUG:teuthology.parallel:result is None 2023-07-21T22:12:13.677 INFO:tasks.ceph.mds.a:Started 2023-07-21T22:12:13.677 DEBUG:teuthology.parallel:result is None 2023-07-21T22:12:13.678 INFO:tasks.ceph.mds.b:Started 2023-07-21T22:12:13.678 DEBUG:teuthology.parallel:result is None 2023-07-21T22:12:13.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T22:12:13.790 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-07-21T22:12:13.791 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-07-21T22:12:13.795 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-07-21T22:12:13.796 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-07-21T22:12:13.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.807+0000 7fe13f053700 1 Processor -- start 2023-07-21T22:12:13.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13f053700 1 -- start start 2023-07-21T22:12:13.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13f053700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1380b0200 0x7fe1380ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:13.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13f053700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1380cbc40 0x7fe1380ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:13.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13f053700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1380cb270 con 0x7fe13815bf30 2023-07-21T22:12:13.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13f053700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe13815c300 con 0x7fe1380b0200 2023-07-21T22:12:13.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13f053700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1380acac0 con 0x7fe1380cbc40 2023-07-21T22:12:13.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13e051700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe13815bf30 0x7fe1380afaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53132/0 (socket says 172.21.15.49:53132) 2023-07-21T22:12:13.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13e051700 1 -- 172.21.15.49:0/3842887027 learned_addr learned my addr 172.21.15.49:0/3842887027 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:13.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13d850700 1 --2- 172.21.15.49:0/3842887027 >> v2:172.21.15.49:3300/0 conn(0x7fe1380b0200 0x7fe1380ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:13.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13e852700 1 --2- 172.21.15.49:0/3842887027 >> v2:172.21.15.150:3300/0 conn(0x7fe1380cbc40 0x7fe1380ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:13.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13d04f700 1 -- 172.21.15.49:0/3842887027 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993872075 0 0) 0x7fe1380cb270 con 0x7fe13815bf30 2023-07-21T22:12:13.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13d04f700 1 -- 172.21.15.49:0/3842887027 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1240035d0 con 0x7fe13815bf30 2023-07-21T22:12:13.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13d850700 1 -- 172.21.15.49:0/3842887027 >> v2:172.21.15.150:3300/0 conn(0x7fe1380cbc40 msgr2=0x7fe1380ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:13.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13d850700 1 --2- 172.21.15.49:0/3842887027 >> v2:172.21.15.150:3300/0 conn(0x7fe1380cbc40 0x7fe1380ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:13.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13d850700 1 -- 172.21.15.49:0/3842887027 >> v1:172.21.15.49:6789/0 conn(0x7fe13815bf30 legacy=0x7fe1380afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:13.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.811+0000 7fe13d850700 1 -- 172.21.15.49:0/3842887027 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13806f740 con 0x7fe1380b0200 2023-07-21T22:12:13.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.815+0000 7fe13d850700 1 --2- 172.21.15.49:0/3842887027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1380b0200 0x7fe1380ad350 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe13806ad30 tx=0x7fe128009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a69666411fae0e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:13.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.815+0000 7fe13d04f700 1 -- 172.21.15.49:0/3842887027 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128011830 con 0x7fe1380b0200 2023-07-21T22:12:13.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.815+0000 7fe13d04f700 1 -- 172.21.15.49:0/3842887027 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe128011990 con 0x7fe1380b0200 2023-07-21T22:12:13.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.815+0000 7fe13d04f700 1 -- 172.21.15.49:0/3842887027 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128011d20 con 0x7fe1380b0200 2023-07-21T22:12:13.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.815+0000 7fe13f053700 1 -- 172.21.15.49:0/3842887027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1380b0200 msgr2=0x7fe1380ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:13.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.815+0000 7fe13f053700 1 --2- 172.21.15.49:0/3842887027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1380b0200 0x7fe1380ad350 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe13806ad30 tx=0x7fe128009b30 comp rx=0 tx=0).stop 2023-07-21T22:12:13.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.815+0000 7fe13f053700 1 -- 172.21.15.49:0/3842887027 shutdown_connections 2023-07-21T22:12:13.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.815+0000 7fe13f053700 1 --2- 172.21.15.49:0/3842887027 >> v2:172.21.15.150:3300/0 conn(0x7fe1380cbc40 0x7fe1380ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:13.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.815+0000 7fe13f053700 1 --2- 172.21.15.49:0/3842887027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1380b0200 0x7fe1380ad350 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:13.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.815+0000 7fe13f053700 1 -- 172.21.15.49:0/3842887027 >> 172.21.15.49:0/3842887027 conn(0x7fe138070450 msgr2=0x7fe138070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:13.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.815+0000 7fe13f053700 1 -- 172.21.15.49:0/3842887027 shutdown_connections 2023-07-21T22:12:13.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.815+0000 7fe13f053700 1 -- 172.21.15.49:0/3842887027 wait complete. 2023-07-21T22:12:13.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13f053700 1 Processor -- start 2023-07-21T22:12:13.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13f053700 1 -- start start 2023-07-21T22:12:13.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13f053700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1380b0200 0x7fe1381588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:13.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13f053700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1380cbc40 0x7fe13815ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:13.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13f053700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe13815bf30 0x7fe1380b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:13.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13f053700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1381604a0 con 0x7fe1380b0200 2023-07-21T22:12:13.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13f053700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe138158e10 con 0x7fe1380cbc40 2023-07-21T22:12:13.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13f053700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13815f890 con 0x7fe13815bf30 2023-07-21T22:12:13.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13e051700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1380b0200 0x7fe1381588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:13.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13e051700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1380b0200 0x7fe1381588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43776/0 (socket says 172.21.15.49:43776) 2023-07-21T22:12:13.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13e051700 1 -- 172.21.15.49:0/1373090597 learned_addr learned my addr 172.21.15.49:0/1373090597 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:13.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13d850700 1 --2- 172.21.15.49:0/1373090597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1380cbc40 0x7fe13815ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:13.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13e852700 1 --2- 172.21.15.49:0/1373090597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe13815bf30 0x7fe1380b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:13.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13e051700 1 -- 172.21.15.49:0/1373090597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe13815bf30 msgr2=0x7fe1380b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:13.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13e051700 1 --2- 172.21.15.49:0/1373090597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe13815bf30 0x7fe1380b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:13.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13e051700 1 -- 172.21.15.49:0/1373090597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1380cbc40 msgr2=0x7fe13815ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:13.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13e051700 1 --2- 172.21.15.49:0/1373090597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1380cbc40 0x7fe13815ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:13.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.819+0000 7fe13e051700 1 -- 172.21.15.49:0/1373090597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1280094b0 con 0x7fe1380b0200 2023-07-21T22:12:13.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.823+0000 7fe13e051700 1 --2- 172.21.15.49:0/1373090597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1380b0200 0x7fe1381588d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe13400c700 tx=0x7fe13400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:13.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.823+0000 7fe12effd700 1 -- 172.21.15.49:0/1373090597 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134005d90 con 0x7fe1380b0200 2023-07-21T22:12:13.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.823+0000 7fe12effd700 1 -- 172.21.15.49:0/1373090597 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1340070d0 con 0x7fe1380b0200 2023-07-21T22:12:13.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.823+0000 7fe12effd700 1 -- 172.21.15.49:0/1373090597 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134007480 con 0x7fe1380b0200 2023-07-21T22:12:13.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.823+0000 7fe13f053700 1 -- 172.21.15.49:0/1373090597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13815fb70 con 0x7fe1380b0200 2023-07-21T22:12:13.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.823+0000 7fe13f053700 1 -- 172.21.15.49:0/1373090597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe138160130 con 0x7fe1380b0200 2023-07-21T22:12:13.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.823+0000 7fe13f053700 1 -- 172.21.15.49:0/1373090597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe13804dcb0 con 0x7fe1380b0200 2023-07-21T22:12:13.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.827+0000 7fe12effd700 1 -- 172.21.15.49:0/1373090597 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1340075e0 con 0x7fe1380b0200 2023-07-21T22:12:13.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.827+0000 7fe12effd700 1 --2- 172.21.15.49:0/1373090597 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe11c066320 0x7fe11c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.827+0000 7fe12effd700 1 -- 172.21.15.49:0/1373090597 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe134082fd0 con 0x7fe1380b0200 2023-07-21T22:12:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.827+0000 7fe13d850700 1 --2- 172.21.15.49:0/1373090597 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe11c066320 0x7fe11c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:13.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.827+0000 7fe13d850700 1 --2- 172.21.15.49:0/1373090597 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe11c066320 0x7fe11c0687d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe1380b05f0 tx=0x7fe128008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:13.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:13.835+0000 7fe12effd700 1 -- 172.21.15.49:0/1373090597 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe134050590 con 0x7fe1380b0200 2023-07-21T22:12:14.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.035+0000 7fe13f053700 1 -- 172.21.15.49:0/1373090597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe1381608b0 con 0x7fe1380b0200 2023-07-21T22:12:14.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.539+0000 7fe12effd700 1 -- 172.21.15.49:0/1373090597 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v38) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe134017070 con 0x7fe1380b0200 2023-07-21T22:12:14.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.543+0000 7fe13f053700 1 -- 172.21.15.49:0/1373090597 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe11c066320 msgr2=0x7fe11c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:14.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.543+0000 7fe13f053700 1 --2- 172.21.15.49:0/1373090597 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe11c066320 0x7fe11c0687d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe1380b05f0 tx=0x7fe128008030 comp rx=0 tx=0).stop 2023-07-21T22:12:14.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.543+0000 7fe13f053700 1 -- 172.21.15.49:0/1373090597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1380b0200 msgr2=0x7fe1381588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:14.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.543+0000 7fe13f053700 1 --2- 172.21.15.49:0/1373090597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1380b0200 0x7fe1381588d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe13400c700 tx=0x7fe13400ca10 comp rx=0 tx=0).stop 2023-07-21T22:12:14.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.543+0000 7fe13f053700 1 -- 172.21.15.49:0/1373090597 shutdown_connections 2023-07-21T22:12:14.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.543+0000 7fe13f053700 1 --2- 172.21.15.49:0/1373090597 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe11c066320 0x7fe11c0687d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:14.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.543+0000 7fe13f053700 1 --2- 172.21.15.49:0/1373090597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe13815bf30 0x7fe1380b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:14.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.543+0000 7fe13f053700 1 --2- 172.21.15.49:0/1373090597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1380cbc40 0x7fe13815ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:14.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.543+0000 7fe13f053700 1 --2- 172.21.15.49:0/1373090597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1380b0200 0x7fe1381588d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:14.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.543+0000 7fe13f053700 1 -- 172.21.15.49:0/1373090597 >> 172.21.15.49:0/1373090597 conn(0x7fe138070450 msgr2=0x7fe13806d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:14.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.543+0000 7fe13f053700 1 -- 172.21.15.49:0/1373090597 shutdown_connections 2023-07-21T22:12:14.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.543+0000 7fe13f053700 1 -- 172.21.15.49:0/1373090597 wait complete. 2023-07-21T22:12:14.592 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-07-21T22:12:14.612 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T22:12:14.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.743+0000 7f7551781700 1 Processor -- start 2023-07-21T22:12:14.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.743+0000 7f7551781700 1 -- start start 2023-07-21T22:12:14.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f7551781700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f754c158c00 0x7f754c15d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:14.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f7551781700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f754c06da70 0x7f754c06c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:14.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f7551781700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754c158fd0 con 0x7f754c0c90d0 2023-07-21T22:12:14.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f7551781700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754c06d650 con 0x7f754c158c00 2023-07-21T22:12:14.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f7551781700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c06c9d0 con 0x7f754c06da70 2023-07-21T22:12:14.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f754b7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f754c0c90d0 0x7f754c0cbc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37216/0 (socket says 172.21.15.49:37216) 2023-07-21T22:12:14.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f754b7fe700 1 -- 172.21.15.49:0/4061527208 learned_addr learned my addr 172.21.15.49:0/4061527208 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:14.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f754affd700 1 --2- 172.21.15.49:0/4061527208 >> v2:172.21.15.49:3300/0 conn(0x7f754c158c00 0x7f754c15d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:14.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f754a7fc700 1 --2- 172.21.15.49:0/4061527208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f754c06da70 0x7f754c06c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:14.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f7549ffb700 1 -- 172.21.15.49:0/4061527208 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569189117 0 0) 0x7f754c158fd0 con 0x7f754c0c90d0 2023-07-21T22:12:14.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f7549ffb700 1 -- 172.21.15.49:0/4061527208 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75340035d0 con 0x7f754c0c90d0 2023-07-21T22:12:14.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f754affd700 1 -- 172.21.15.49:0/4061527208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f754c06da70 msgr2=0x7f754c06c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:14.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f754affd700 1 --2- 172.21.15.49:0/4061527208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f754c06da70 0x7f754c06c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:14.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f7549ffb700 1 -- 172.21.15.49:0/4061527208 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3974463988 0 0) 0x7f75340035d0 con 0x7f754c0c90d0 2023-07-21T22:12:14.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f754affd700 1 -- 172.21.15.49:0/4061527208 >> v1:172.21.15.49:6789/0 conn(0x7f754c0c90d0 legacy=0x7f754c0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:14.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.747+0000 7f754affd700 1 -- 172.21.15.49:0/4061527208 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c06ccb0 con 0x7f754c158c00 2023-07-21T22:12:14.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.751+0000 7f754affd700 1 --2- 172.21.15.49:0/4061527208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c158c00 0x7f754c15d180 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f753c009850 tx=0x7f753c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6fe0e3226d873d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:14.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.751+0000 7f7549ffb700 1 -- 172.21.15.49:0/4061527208 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440019f0 con 0x7f754c158c00 2023-07-21T22:12:14.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.751+0000 7f7549ffb700 1 -- 172.21.15.49:0/4061527208 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c004030 con 0x7f754c158c00 2023-07-21T22:12:14.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.751+0000 7f7549ffb700 1 -- 172.21.15.49:0/4061527208 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c0043e0 con 0x7f754c158c00 2023-07-21T22:12:14.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.751+0000 7f7551781700 1 -- 172.21.15.49:0/4061527208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c158c00 msgr2=0x7f754c15d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:14.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.751+0000 7f7551781700 1 --2- 172.21.15.49:0/4061527208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c158c00 0x7f754c15d180 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f753c009850 tx=0x7f753c009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:14.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.751+0000 7f7551781700 1 -- 172.21.15.49:0/4061527208 shutdown_connections 2023-07-21T22:12:14.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.751+0000 7f7551781700 1 --2- 172.21.15.49:0/4061527208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f754c06da70 0x7f754c06c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:14.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.751+0000 7f7551781700 1 --2- 172.21.15.49:0/4061527208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c158c00 0x7f754c15d180 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:14.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.751+0000 7f7551781700 1 -- 172.21.15.49:0/4061527208 >> 172.21.15.49:0/4061527208 conn(0x7f754c070450 msgr2=0x7f754c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:14.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.751+0000 7f7551781700 1 -- 172.21.15.49:0/4061527208 shutdown_connections 2023-07-21T22:12:14.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.751+0000 7f7551781700 1 -- 172.21.15.49:0/4061527208 wait complete. 2023-07-21T22:12:14.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f7551781700 1 Processor -- start 2023-07-21T22:12:14.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f7551781700 1 -- start start 2023-07-21T22:12:14.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f7551781700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f754c06da70 0x7f754c14de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:14.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f7551781700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f754c0c90d0 0x7f754c0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:14.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f7551781700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c158c00 0x7f754c0b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:14.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f7551781700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0c37c0 con 0x7f754c158c00 2023-07-21T22:12:14.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f7551781700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0c2e20 con 0x7f754c06da70 2023-07-21T22:12:14.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f7551781700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0c3100 con 0x7f754c0c90d0 2023-07-21T22:12:14.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f754b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c158c00 0x7f754c0b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:14.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f754b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c158c00 0x7f754c0b1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34634/0 (socket says 172.21.15.49:34634) 2023-07-21T22:12:14.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f754b7fe700 1 -- 172.21.15.49:0/3253542055 learned_addr learned my addr 172.21.15.49:0/3253542055 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:14.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f754affd700 1 --2- 172.21.15.49:0/3253542055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f754c06da70 0x7f754c14de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:14.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f754a7fc700 1 --2- 172.21.15.49:0/3253542055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f754c0c90d0 0x7f754c0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f754b7fe700 1 -- 172.21.15.49:0/3253542055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f754c0c90d0 msgr2=0x7f754c0b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f754b7fe700 1 --2- 172.21.15.49:0/3253542055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f754c0c90d0 0x7f754c0b1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f754b7fe700 1 -- 172.21.15.49:0/3253542055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f754c06da70 msgr2=0x7f754c14de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:14.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f754b7fe700 1 --2- 172.21.15.49:0/3253542055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f754c06da70 0x7f754c14de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:14.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f754b7fe700 1 -- 172.21.15.49:0/3253542055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c0094b0 con 0x7f754c158c00 2023-07-21T22:12:14.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.755+0000 7f754b7fe700 1 --2- 172.21.15.49:0/3253542055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c158c00 0x7f754c0b1e90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f754400cc00 tx=0x7f754400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:14.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.759+0000 7f75337fe700 1 -- 172.21.15.49:0/3253542055 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754400aa20 con 0x7f754c158c00 2023-07-21T22:12:14.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.759+0000 7f75337fe700 1 -- 172.21.15.49:0/3253542055 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754400aba0 con 0x7f754c158c00 2023-07-21T22:12:14.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.759+0000 7f75337fe700 1 -- 172.21.15.49:0/3253542055 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440070d0 con 0x7f754c158c00 2023-07-21T22:12:14.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.759+0000 7f7551781700 1 -- 172.21.15.49:0/3253542055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c0c33e0 con 0x7f754c158c00 2023-07-21T22:12:14.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.759+0000 7f7551781700 1 -- 172.21.15.49:0/3253542055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754c0b24a0 con 0x7f754c158c00 2023-07-21T22:12:14.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.759+0000 7f7551781700 1 -- 172.21.15.49:0/3253542055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754c0c3900 con 0x7f754c158c00 2023-07-21T22:12:14.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.759+0000 7f75337fe700 1 -- 172.21.15.49:0/3253542055 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7544007230 con 0x7f754c158c00 2023-07-21T22:12:14.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.763+0000 7f75337fe700 1 --2- 172.21.15.49:0/3253542055 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75380662f0 0x7f75380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:14.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.763+0000 7f75337fe700 1 -- 172.21.15.49:0/3253542055 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f75440834b0 con 0x7f754c158c00 2023-07-21T22:12:14.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.763+0000 7f754affd700 1 --2- 172.21.15.49:0/3253542055 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75380662f0 0x7f75380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:14.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.763+0000 7f754affd700 1 --2- 172.21.15.49:0/3253542055 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75380662f0 0x7f75380687a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f753c0090b0 tx=0x7f753c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:14.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:14.767+0000 7f75337fe700 1 -- 172.21.15.49:0/3253542055 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f754c0c3900 con 0x7f754c158c00 2023-07-21T22:12:15.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.003+0000 7f7551781700 1 -- 172.21.15.49:0/3253542055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f754c0c3900 con 0x7f754c158c00 2023-07-21T22:12:15.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.003+0000 7f75337fe700 1 -- 172.21.15.49:0/3253542055 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f754c0c3900 con 0x7f754c158c00 2023-07-21T22:12:15.049 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:15.049 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:12:15.049 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-07-21T22:12:15.049 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.050 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-07-21T22:12:15.050 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAcArtk9UDlNxAAfGvmHDNUYOtexEgfEkEmbw==", 2023-07-21T22:12:15.050 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.050 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:12:15.050 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-07-21T22:12:15.050 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-07-21T22:12:15.050 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.050 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.051 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.051 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.052 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-07-21T22:12:15.052 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdArtkQifxDxAANHRBlqFItDR5CjqajW6gvQ==", 2023-07-21T22:12:15.052 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.052 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:12:15.053 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-07-21T22:12:15.053 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-07-21T22:12:15.053 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.053 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.053 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.053 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-07-21T22:12:15.054 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdArtkBfhVBxAAWPmw5Kgh9IAwd3x6ONx/3Q==", 2023-07-21T22:12:15.054 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.054 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:12:15.054 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-07-21T22:12:15.054 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-07-21T22:12:15.054 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.054 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.055 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.055 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.056 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-07-21T22:12:15.056 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdArtkJYR+GhAAoQnle9Wp4nO/t7tXuW7QRg==", 2023-07-21T22:12:15.056 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.056 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:12:15.056 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-07-21T22:12:15.057 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-07-21T22:12:15.057 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.057 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.057 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.057 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.057 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-07-21T22:12:15.057 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAfArtkXyOTDRAA6+dWJD8HAjbKOVKNMmU47w==", 2023-07-21T22:12:15.058 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.058 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:12:15.058 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:12:15.058 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.058 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.058 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.058 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.058 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-07-21T22:12:15.059 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAiArtkK1XVHBAAfg3u9BuD16Nqvd4aSxkHrQ==", 2023-07-21T22:12:15.059 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.059 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:12:15.059 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:12:15.059 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.059 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.060 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.060 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-07-21T22:12:15.060 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAlArtkqCt+KRAAYL2UpqU5lgci033misJwCw==", 2023-07-21T22:12:15.060 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.060 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:12:15.060 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:12:15.060 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.060 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.061 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.061 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-07-21T22:12:15.061 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAoArtk3rxoNxAAcTy+TyE877c3ygcSSYR4Fw==", 2023-07-21T22:12:15.061 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.061 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:12:15.061 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:12:15.062 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.062 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.062 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.062 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-07-21T22:12:15.062 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAvArtkKVmkDxAAvnbiPrBm8CsqtltAiYvBLA==", 2023-07-21T22:12:15.062 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.062 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:12:15.063 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:12:15.063 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.063 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.063 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.063 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-07-21T22:12:15.063 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAyArtkVZZ4HxAAh/a+roCiNHjhfWBgQglK9w==", 2023-07-21T22:12:15.063 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.064 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:12:15.064 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:12:15.064 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.064 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.064 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-07-21T22:12:15.065 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA1ArtkqvL1LBAAyR54RZM2jeJkacFJYYSg4w==", 2023-07-21T22:12:15.065 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.065 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:12:15.065 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:12:15.065 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.065 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.065 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.066 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-07-21T22:12:15.066 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA4ArtkE0qJOhAAoVsMETcdMCOVJu1LeodZaQ==", 2023-07-21T22:12:15.066 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.066 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:12:15.066 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:12:15.066 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.066 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.067 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.067 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.067 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-07-21T22:12:15.067 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdArtkU5ZaIRAAchCJhuM71+rGOBHBlX77wA==", 2023-07-21T22:12:15.067 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.067 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:12:15.067 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-07-21T22:12:15.067 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-07-21T22:12:15.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-07-21T22:12:15.068 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.068 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.068 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-07-21T22:12:15.068 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdArtkehK+LRAALlZYibBiTgcHfl7suRYhcQ==", 2023-07-21T22:12:15.068 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.069 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:12:15.069 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-07-21T22:12:15.069 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-07-21T22:12:15.069 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-07-21T22:12:15.069 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.069 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.069 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-07-21T22:12:15.070 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdArtkyk2fJxAAnJF1MTnXB6u+gAzfn4Db3g==", 2023-07-21T22:12:15.070 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.070 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:12:15.070 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-07-21T22:12:15.070 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-07-21T22:12:15.070 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-07-21T22:12:15.070 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.071 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.071 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-07-21T22:12:15.071 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdArtks6bXMxAAcFY848luRxhQPSE+99Q5qg==", 2023-07-21T22:12:15.071 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.071 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:12:15.071 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-07-21T22:12:15.071 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-07-21T22:12:15.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-07-21T22:12:15.072 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.072 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.072 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-07-21T22:12:15.072 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAcArtkQ6UTDRAACZZjWYxDlkMYzWCGeU2qXA==", 2023-07-21T22:12:15.072 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.073 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-07-21T22:12:15.073 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-07-21T22:12:15.073 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-07-21T22:12:15.073 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.073 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.073 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.073 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-mds", 2023-07-21T22:12:15.074 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBAArtkRZlMCxAAji3AkpSrZnmnrKBzNlUDqQ==", 2023-07-21T22:12:15.074 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.074 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-mds" 2023-07-21T22:12:15.074 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.074 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.074 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.074 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-mgr", 2023-07-21T22:12:15.075 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBAArtkfbRMCxAAGeW3SrTIsg58s5mrhiHutg==", 2023-07-21T22:12:15.075 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.075 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-21T22:12:15.075 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.075 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.075 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.075 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-osd", 2023-07-21T22:12:15.075 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBAArtk+M5MCxAAMyvNyfz1zAwa3mbXGI0KSw==", 2023-07-21T22:12:15.076 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.076 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-osd" 2023-07-21T22:12:15.076 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.076 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.076 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.076 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rbd", 2023-07-21T22:12:15.076 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBAArtksuRMCxAAiRL25AB3GUJc6idwAb5GCQ==", 2023-07-21T22:12:15.077 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.077 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-21T22:12:15.077 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.077 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.077 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.077 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-21T22:12:15.077 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBAArtk1vNMCxAAJB5DLFBu5dfe6PES0OLzCw==", 2023-07-21T22:12:15.077 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.078 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-21T22:12:15.078 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.078 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.078 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.078 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rgw", 2023-07-21T22:12:15.078 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBAArtkcQJNCxAAvJub+dLL6T417tqZvjqUtA==", 2023-07-21T22:12:15.078 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.079 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-21T22:12:15.079 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.079 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.079 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.079 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-07-21T22:12:15.079 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAcArtkP5msMBAAmy/OTWL5IKQObiHS6qGHug==", 2023-07-21T22:12:15.079 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.079 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-07-21T22:12:15.080 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-07-21T22:12:15.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.080 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.080 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:15.080 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:15.080 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-07-21T22:12:15.080 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAcArtkbrpZKhAATgNLjLrjiq5kGV5kD5a61g==", 2023-07-21T22:12:15.080 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:12:15.081 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-07-21T22:12:15.081 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-07-21T22:12:15.081 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:12:15.081 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.081 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:15.081 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-07-21T22:12:15.081 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:12:15.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.007+0000 7f7551781700 1 -- 172.21.15.49:0/3253542055 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75380662f0 msgr2=0x7f75380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:15.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.007+0000 7f7551781700 1 --2- 172.21.15.49:0/3253542055 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75380662f0 0x7f75380687a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f753c0090b0 tx=0x7f753c008030 comp rx=0 tx=0).stop 2023-07-21T22:12:15.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.007+0000 7f7551781700 1 -- 172.21.15.49:0/3253542055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c158c00 msgr2=0x7f754c0b1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:15.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.007+0000 7f7551781700 1 --2- 172.21.15.49:0/3253542055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c158c00 0x7f754c0b1e90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f754400cc00 tx=0x7f754400cf10 comp rx=0 tx=0).stop 2023-07-21T22:12:15.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.007+0000 7f7551781700 1 -- 172.21.15.49:0/3253542055 shutdown_connections 2023-07-21T22:12:15.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.007+0000 7f7551781700 1 --2- 172.21.15.49:0/3253542055 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75380662f0 0x7f75380687a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.007+0000 7f7551781700 1 --2- 172.21.15.49:0/3253542055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c158c00 0x7f754c0b1e90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.007+0000 7f7551781700 1 --2- 172.21.15.49:0/3253542055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f754c0c90d0 0x7f754c0b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.007+0000 7f7551781700 1 --2- 172.21.15.49:0/3253542055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f754c06da70 0x7f754c14de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.007+0000 7f7551781700 1 -- 172.21.15.49:0/3253542055 >> 172.21.15.49:0/3253542055 conn(0x7f754c070450 msgr2=0x7f754c0cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:15.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.007+0000 7f7551781700 1 -- 172.21.15.49:0/3253542055 shutdown_connections 2023-07-21T22:12:15.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.007+0000 7f7551781700 1 -- 172.21.15.49:0/3253542055 wait complete. 2023-07-21T22:12:15.085 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-21T22:12:15.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.219+0000 7f96719c6700 1 Processor -- start 2023-07-21T22:12:15.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.219+0000 7f96719c6700 1 -- start start 2023-07-21T22:12:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.219+0000 7f96719c6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f966c158b20 0x7f966c0b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:15.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.219+0000 7f96719c6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966c0ce340 con 0x7f966c15c570 2023-07-21T22:12:15.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f96719c6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966c15cae0 con 0x7f966c06efd0 2023-07-21T22:12:15.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f96719c6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0cf850 con 0x7f966c158b20 2023-07-21T22:12:15.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f966bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f966c15c570 0x7f966c06a0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37224/0 (socket says 172.21.15.49:37224) 2023-07-21T22:12:15.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f966bfff700 1 -- 172.21.15.49:0/3029022446 learned_addr learned my addr 172.21.15.49:0/3029022446 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:15.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f966affd700 1 --2- 172.21.15.49:0/3029022446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f966c158b20 0x7f966c0b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:15.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f9669ffb700 1 -- 172.21.15.49:0/3029022446 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110899519 0 0) 0x7f966c15cae0 con 0x7f966c06efd0 2023-07-21T22:12:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f9669ffb700 1 -- 172.21.15.49:0/3029022446 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96540035d0 con 0x7f966c06efd0 2023-07-21T22:12:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f9669ffb700 1 -- 172.21.15.49:0/3029022446 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391616067 0 0) 0x7f966c0ce340 con 0x7f966c15c570 2023-07-21T22:12:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f9669ffb700 1 -- 172.21.15.49:0/3029022446 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f966c15cae0 con 0x7f966c15c570 2023-07-21T22:12:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f966affd700 1 -- 172.21.15.49:0/3029022446 >> v1:172.21.15.150:6789/0 conn(0x7f966c06efd0 legacy=0x7f966c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f966affd700 1 -- 172.21.15.49:0/3029022446 >> v1:172.21.15.49:6789/0 conn(0x7f966c15c570 legacy=0x7f966c06a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f966affd700 1 -- 172.21.15.49:0/3029022446 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c15cdc0 con 0x7f966c158b20 2023-07-21T22:12:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f966affd700 1 --2- 172.21.15.49:0/3029022446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f966c158b20 0x7f966c0b1430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f965c009880 tx=0x7f965c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ad8219dfbae40eb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f9669ffb700 1 -- 172.21.15.49:0/3029022446 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c011830 con 0x7f966c158b20 2023-07-21T22:12:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f9669ffb700 1 -- 172.21.15.49:0/3029022446 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c011990 con 0x7f966c158b20 2023-07-21T22:12:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.223+0000 7f9669ffb700 1 -- 172.21.15.49:0/3029022446 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c011d20 con 0x7f966c158b20 2023-07-21T22:12:15.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.227+0000 7f96719c6700 1 -- 172.21.15.49:0/3029022446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f966c158b20 msgr2=0x7f966c0b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:15.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.227+0000 7f96719c6700 1 --2- 172.21.15.49:0/3029022446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f966c158b20 0x7f966c0b1430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f965c009880 tx=0x7f965c009b90 comp rx=0 tx=0).stop 2023-07-21T22:12:15.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.227+0000 7f96719c6700 1 -- 172.21.15.49:0/3029022446 shutdown_connections 2023-07-21T22:12:15.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.227+0000 7f96719c6700 1 --2- 172.21.15.49:0/3029022446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f966c158b20 0x7f966c0b1430 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.227+0000 7f96719c6700 1 -- 172.21.15.49:0/3029022446 >> 172.21.15.49:0/3029022446 conn(0x7f966c0cc430 msgr2=0x7f966c0cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:15.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.227+0000 7f96719c6700 1 -- 172.21.15.49:0/3029022446 shutdown_connections 2023-07-21T22:12:15.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.227+0000 7f96719c6700 1 -- 172.21.15.49:0/3029022446 wait complete. 2023-07-21T22:12:15.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.227+0000 7f96719c6700 1 Processor -- start 2023-07-21T22:12:15.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f96719c6700 1 -- start start 2023-07-21T22:12:15.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f96719c6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f966c06efd0 0x7f966c0c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:15.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f96719c6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f966c158b20 0x7f966c0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:15.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f96719c6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f966c15c570 0x7f966c154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:15.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f96719c6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0caf60 con 0x7f966c06efd0 2023-07-21T22:12:15.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f96719c6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c15a370 con 0x7f966c158b20 2023-07-21T22:12:15.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f96719c6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0c47e0 con 0x7f966c15c570 2023-07-21T22:12:15.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f966affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f966c06efd0 0x7f966c0c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:15.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f966affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f966c06efd0 0x7f966c0c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34636/0 (socket says 172.21.15.49:34636) 2023-07-21T22:12:15.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f966affd700 1 -- 172.21.15.49:0/14362084 learned_addr learned my addr 172.21.15.49:0/14362084 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:15.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f966bfff700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f966c15c570 0x7f966c154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:15.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f966a7fc700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f966c158b20 0x7f966c0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:15.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f966affd700 1 -- 172.21.15.49:0/14362084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f966c15c570 msgr2=0x7f966c154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:15.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f966affd700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f966c15c570 0x7f966c154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f966affd700 1 -- 172.21.15.49:0/14362084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f966c158b20 msgr2=0x7f966c0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:15.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f966affd700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f966c158b20 0x7f966c0b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f966affd700 1 -- 172.21.15.49:0/14362084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c0094b0 con 0x7f966c06efd0 2023-07-21T22:12:15.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f966bfff700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f966c15c570 0x7f966c154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.231+0000 7f966affd700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f966c06efd0 0x7f966c0c3ed0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f965c013040 tx=0x7f965c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.235+0000 7f9653fff700 1 -- 172.21.15.49:0/14362084 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c01a8c0 con 0x7f966c06efd0 2023-07-21T22:12:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.235+0000 7f9653fff700 1 -- 172.21.15.49:0/14362084 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c01e070 con 0x7f966c06efd0 2023-07-21T22:12:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.235+0000 7f9653fff700 1 -- 172.21.15.49:0/14362084 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c01ac60 con 0x7f966c06efd0 2023-07-21T22:12:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.235+0000 7f96719c6700 1 -- 172.21.15.49:0/14362084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966c0c4500 con 0x7f966c06efd0 2023-07-21T22:12:15.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.235+0000 7f96719c6700 1 -- 172.21.15.49:0/14362084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966c15a880 con 0x7f966c06efd0 2023-07-21T22:12:15.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.235+0000 7f96719c6700 1 -- 172.21.15.49:0/14362084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966c04dcb0 con 0x7f966c06efd0 2023-07-21T22:12:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.235+0000 7f9653fff700 1 -- 172.21.15.49:0/14362084 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f965c02d450 con 0x7f966c06efd0 2023-07-21T22:12:15.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.239+0000 7f9653fff700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f96580662f0 0x7f96580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:15.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.239+0000 7f9653fff700 1 -- 172.21.15.49:0/14362084 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f965c084a10 con 0x7f966c06efd0 2023-07-21T22:12:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.239+0000 7f966a7fc700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f96580662f0 0x7f96580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.239+0000 7f966a7fc700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f96580662f0 0x7f96580687a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f966c155fb0 tx=0x7f9660009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:15.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.243+0000 7f9653fff700 1 -- 172.21.15.49:0/14362084 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f965c052010 con 0x7f966c06efd0 2023-07-21T22:12:15.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.487+0000 7f96719c6700 1 -- 172.21.15.49:0/14362084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f966c15d070 con 0x7f966c06efd0 2023-07-21T22:12:15.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.495+0000 7f9653fff700 1 -- 172.21.15.49:0/14362084 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f965c0200a0 con 0x7f966c06efd0 2023-07-21T22:12:15.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.499+0000 7f96719c6700 1 -- 172.21.15.49:0/14362084 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f96580662f0 msgr2=0x7f96580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:15.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.499+0000 7f96719c6700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f96580662f0 0x7f96580687a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f966c155fb0 tx=0x7f9660009040 comp rx=0 tx=0).stop 2023-07-21T22:12:15.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.499+0000 7f96719c6700 1 -- 172.21.15.49:0/14362084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f966c06efd0 msgr2=0x7f966c0c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:15.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.499+0000 7f96719c6700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f966c06efd0 0x7f966c0c3ed0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f965c013040 tx=0x7f965c004770 comp rx=0 tx=0).stop 2023-07-21T22:12:15.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.499+0000 7f96719c6700 1 -- 172.21.15.49:0/14362084 shutdown_connections 2023-07-21T22:12:15.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.499+0000 7f96719c6700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f96580662f0 0x7f96580687a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.499+0000 7f96719c6700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f966c15c570 0x7f966c154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.499+0000 7f96719c6700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f966c158b20 0x7f966c0b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.499+0000 7f96719c6700 1 --2- 172.21.15.49:0/14362084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f966c06efd0 0x7f966c0c3ed0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.499+0000 7f96719c6700 1 -- 172.21.15.49:0/14362084 >> 172.21.15.49:0/14362084 conn(0x7f966c0cc430 msgr2=0x7f966c1568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:15.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.499+0000 7f96719c6700 1 -- 172.21.15.49:0/14362084 shutdown_connections 2023-07-21T22:12:15.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.499+0000 7f96719c6700 1 -- 172.21.15.49:0/14362084 wait complete. 2023-07-21T22:12:15.565 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-21T22:12:15.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.695+0000 7f79da965700 1 Processor -- start 2023-07-21T22:12:15.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.695+0000 7f79da965700 1 -- start start 2023-07-21T22:12:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79da965700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f79d41628f0 0x7f79d4164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79da965700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d40b0330 con 0x7f79d406d5d0 2023-07-21T22:12:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79da965700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d40b0600 con 0x7f79d4159f60 2023-07-21T22:12:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79da965700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d415a470 con 0x7f79d41628f0 2023-07-21T22:12:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f79d406d5d0 0x7f79d406d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37226/0 (socket says 172.21.15.49:37226) 2023-07-21T22:12:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d3fff700 1 -- 172.21.15.49:0/1476396399 learned_addr learned my addr 172.21.15.49:0/1476396399 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d8f02700 1 --2- 172.21.15.49:0/1476396399 >> v2:172.21.15.150:3300/0 conn(0x7f79d41628f0 0x7f79d4164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417109192 0 0) 0x7f79d40b0330 con 0x7f79d406d5d0 2023-07-21T22:12:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79bc0035d0 con 0x7f79d406d5d0 2023-07-21T22:12:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433028517 0 0) 0x7f79d40b0600 con 0x7f79d4159f60 2023-07-21T22:12:15.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79d40b0330 con 0x7f79d4159f60 2023-07-21T22:12:15.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1096043462 0 0) 0x7f79bc0035d0 con 0x7f79d406d5d0 2023-07-21T22:12:15.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 >> v2:172.21.15.150:3300/0 conn(0x7f79d41628f0 msgr2=0x7f79d4164cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:15.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 --2- 172.21.15.49:0/1476396399 >> v2:172.21.15.150:3300/0 conn(0x7f79d41628f0 0x7f79d4164cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 >> v1:172.21.15.150:6789/0 conn(0x7f79d4159f60 legacy=0x7f79d40afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d415a750 con 0x7f79d406d5d0 2023-07-21T22:12:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f79c4001670 con 0x7f79d406d5d0 2023-07-21T22:12:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 >> v1:172.21.15.49:6789/0 conn(0x7f79d406d5d0 legacy=0x7f79d406d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 --2- 172.21.15.49:0/1476396399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc003c20 0x7f79bc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 --2- 172.21.15.49:0/1476396399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc004870 0x7f79bc004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 --2- 172.21.15.49:0/1476396399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79bc005330 0x7f79bc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:15.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d415a470 con 0x7f79bc005330 2023-07-21T22:12:15.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc00c230 con 0x7f79bc004870 2023-07-21T22:12:15.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc00c3f0 con 0x7f79bc003c20 2023-07-21T22:12:15.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d8f02700 1 --2- 172.21.15.49:0/1476396399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79bc005330 0x7f79bc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:15.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.699+0000 7f79d37fe700 1 --2- 172.21.15.49:0/1476396399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc004870 0x7f79bc004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:15.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79d3fff700 1 --2- 172.21.15.49:0/1476396399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc003c20 0x7f79bc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:15.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79d8f02700 1 -- 172.21.15.49:0/1476396399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc003c20 msgr2=0x7f79bc004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:15.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79d8f02700 1 --2- 172.21.15.49:0/1476396399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc003c20 0x7f79bc004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79d8f02700 1 -- 172.21.15.49:0/1476396399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc004870 msgr2=0x7f79bc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:15.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79d8f02700 1 --2- 172.21.15.49:0/1476396399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc004870 0x7f79bc004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79d8f02700 1 -- 172.21.15.49:0/1476396399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc0035d0 con 0x7f79bc005330 2023-07-21T22:12:15.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79d8f02700 1 -- 172.21.15.49:0/1476396399 reap_dead start 2023-07-21T22:12:15.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79d8f02700 1 --2- 172.21.15.49:0/1476396399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79bc005330 0x7f79bc00ba30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f79d4071820 tx=0x7f79bc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892664ad4a9ff93b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:15.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc018070 con 0x7f79bc005330 2023-07-21T22:12:15.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc00f040 con 0x7f79bc005330 2023-07-21T22:12:15.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79d2ffd700 1 -- 172.21.15.49:0/1476396399 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00ebd0 con 0x7f79bc005330 2023-07-21T22:12:15.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79da965700 1 -- 172.21.15.49:0/1476396399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79bc005330 msgr2=0x7f79bc00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:15.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79da965700 1 --2- 172.21.15.49:0/1476396399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79bc005330 0x7f79bc00ba30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f79d4071820 tx=0x7f79bc0058a0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79da965700 1 -- 172.21.15.49:0/1476396399 shutdown_connections 2023-07-21T22:12:15.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79da965700 1 --2- 172.21.15.49:0/1476396399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79bc005330 0x7f79bc00ba30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79da965700 1 -- 172.21.15.49:0/1476396399 >> 172.21.15.49:0/1476396399 conn(0x7f79d406f5a0 msgr2=0x7f79d40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:15.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79da965700 1 -- 172.21.15.49:0/1476396399 shutdown_connections 2023-07-21T22:12:15.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.703+0000 7f79da965700 1 -- 172.21.15.49:0/1476396399 wait complete. 2023-07-21T22:12:15.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79da965700 1 Processor -- start 2023-07-21T22:12:15.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79da965700 1 -- start start 2023-07-21T22:12:15.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79da965700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc005330 0x7f79d414e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:15.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79da965700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d414ef80 0x7f79d4154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:15.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79da965700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d414f4b0 0x7f79d4155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:15.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79da965700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d4151840 con 0x7f79d414ef80 2023-07-21T22:12:15.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79da965700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d4151530 con 0x7f79bc005330 2023-07-21T22:12:15.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79da965700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d40af3d0 con 0x7f79d414f4b0 2023-07-21T22:12:15.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79d37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d414ef80 0x7f79d4154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:15.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79d37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d414ef80 0x7f79d4154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34654/0 (socket says 172.21.15.49:34654) 2023-07-21T22:12:15.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79d37fe700 1 -- 172.21.15.49:0/3145515041 learned_addr learned my addr 172.21.15.49:0/3145515041 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:15.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79d8f02700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d414f4b0 0x7f79d4155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:15.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79d3fff700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc005330 0x7f79d414e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:15.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79d37fe700 1 -- 172.21.15.49:0/3145515041 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d414f4b0 msgr2=0x7f79d4155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:15.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79d37fe700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d414f4b0 0x7f79d4155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79d37fe700 1 -- 172.21.15.49:0/3145515041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc005330 msgr2=0x7f79d414e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:15.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79d37fe700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc005330 0x7f79d414e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:15.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79d37fe700 1 -- 172.21.15.49:0/3145515041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d41547f0 con 0x7f79d414ef80 2023-07-21T22:12:15.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.707+0000 7f79d3fff700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc005330 0x7f79d414e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:15.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.711+0000 7f79d37fe700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d414ef80 0x7f79d4154fd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f79c800f7a0 tx=0x7f79c800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:15.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.711+0000 7f79d0ff9700 1 -- 172.21.15.49:0/3145515041 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8005320 con 0x7f79d414ef80 2023-07-21T22:12:15.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.711+0000 7f79d0ff9700 1 -- 172.21.15.49:0/3145515041 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c80054a0 con 0x7f79d414ef80 2023-07-21T22:12:15.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.711+0000 7f79da965700 1 -- 172.21.15.49:0/3145515041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d4154ad0 con 0x7f79d414ef80 2023-07-21T22:12:15.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.711+0000 7f79d0ff9700 1 -- 172.21.15.49:0/3145515041 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8006ac0 con 0x7f79d414ef80 2023-07-21T22:12:15.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.711+0000 7f79da965700 1 -- 172.21.15.49:0/3145515041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d414ec60 con 0x7f79d414ef80 2023-07-21T22:12:15.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.711+0000 7f79da965700 1 -- 172.21.15.49:0/3145515041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d4073130 con 0x7f79d414ef80 2023-07-21T22:12:15.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.715+0000 7f79d0ff9700 1 -- 172.21.15.49:0/3145515041 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f79c8006c20 con 0x7f79d414ef80 2023-07-21T22:12:15.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.715+0000 7f79d0ff9700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f79c00662f0 0x7f79c00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:15.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.715+0000 7f79d0ff9700 1 -- 172.21.15.49:0/3145515041 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f79c80831a0 con 0x7f79d414ef80 2023-07-21T22:12:15.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.715+0000 7f79d3fff700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f79c00662f0 0x7f79c00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:15.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.715+0000 7f79d3fff700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f79c00662f0 0x7f79c00687a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f79d40ca530 tx=0x7f79c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:15.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.719+0000 7f79d0ff9700 1 -- 172.21.15.49:0/3145515041 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79c8050820 con 0x7f79d414ef80 2023-07-21T22:12:16.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.959+0000 7f79da965700 1 -- 172.21.15.49:0/3145515041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f79d4154cc0 con 0x7f79d414ef80 2023-07-21T22:12:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.967+0000 7f79d0ff9700 1 -- 172.21.15.49:0/3145515041 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f79d4154cc0 con 0x7f79d414ef80 2023-07-21T22:12:16.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.971+0000 7f79da965700 1 -- 172.21.15.49:0/3145515041 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f79c00662f0 msgr2=0x7f79c00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:16.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.971+0000 7f79da965700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f79c00662f0 0x7f79c00687a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f79d40ca530 tx=0x7f79c4009040 comp rx=0 tx=0).stop 2023-07-21T22:12:16.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.971+0000 7f79da965700 1 -- 172.21.15.49:0/3145515041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d414ef80 msgr2=0x7f79d4154fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:16.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.971+0000 7f79da965700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d414ef80 0x7f79d4154fd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f79c800f7a0 tx=0x7f79c800fab0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.971+0000 7f79da965700 1 -- 172.21.15.49:0/3145515041 shutdown_connections 2023-07-21T22:12:16.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.971+0000 7f79da965700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f79c00662f0 0x7f79c00687a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.971+0000 7f79da965700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d414ef80 0x7f79d4154fd0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.971+0000 7f79da965700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d414f4b0 0x7f79d4155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.971+0000 7f79da965700 1 --2- 172.21.15.49:0/3145515041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc005330 0x7f79d414e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.971+0000 7f79da965700 1 -- 172.21.15.49:0/3145515041 >> 172.21.15.49:0/3145515041 conn(0x7f79d406f5a0 msgr2=0x7f79d415cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:16.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.971+0000 7f79da965700 1 -- 172.21.15.49:0/3145515041 shutdown_connections 2023-07-21T22:12:16.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:15.971+0000 7f79da965700 1 -- 172.21.15.49:0/3145515041 wait complete. 2023-07-21T22:12:16.040 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-21T22:12:16.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.175+0000 7ff4f4d15700 1 Processor -- start 2023-07-21T22:12:16.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.175+0000 7ff4f4d15700 1 -- start start 2023-07-21T22:12:16.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4f4d15700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4f006d380 0x7ff4f006d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:16.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4f4d15700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4f00cafb0 0x7ff4f00cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:16.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4f4d15700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f00cab20 con 0x7ff4f0071c70 2023-07-21T22:12:16.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4f4d15700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f00c9e80 con 0x7ff4f006d380 2023-07-21T22:12:16.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4f4d15700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00afeb0 con 0x7ff4f00cafb0 2023-07-21T22:12:16.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4ef7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4f006d380 0x7ff4f006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:16.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4effff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4f00cafb0 0x7ff4f00cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:16.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4eeffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff4f0071c70 0x7ff4f00b0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:58148/0 (socket says 172.21.15.49:58148) 2023-07-21T22:12:16.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4eeffd700 1 -- 172.21.15.49:0/2448207263 learned_addr learned my addr 172.21.15.49:0/2448207263 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:16.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4ef7fe700 1 --2- 172.21.15.49:0/2448207263 >> v2:172.21.15.49:3300/0 conn(0x7ff4f006d380 0x7ff4f006d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34666/0 (socket says 172.21.15.49:34666) 2023-07-21T22:12:16.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4ee7fc700 1 -- 172.21.15.49:0/2448207263 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092378776 0 0) 0x7ff4f00cab20 con 0x7ff4f0071c70 2023-07-21T22:12:16.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4effff700 1 -- 172.21.15.49:0/2448207263 >> v2:172.21.15.49:3300/0 conn(0x7ff4f006d380 msgr2=0x7ff4f006d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:16.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4effff700 1 --2- 172.21.15.49:0/2448207263 >> v2:172.21.15.49:3300/0 conn(0x7ff4f006d380 0x7ff4f006d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4effff700 1 -- 172.21.15.49:0/2448207263 >> v1:172.21.15.150:6789/0 conn(0x7ff4f0071c70 legacy=0x7ff4f00b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:16.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4effff700 1 -- 172.21.15.49:0/2448207263 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f006dc90 con 0x7ff4f00cafb0 2023-07-21T22:12:16.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.179+0000 7ff4effff700 1 --2- 172.21.15.49:0/2448207263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4f00cafb0 0x7ff4f00cb430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009d90 tx=0x7ff4e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd6befc6bce99823 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:16.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.183+0000 7ff4ee7fc700 1 -- 172.21.15.49:0/2448207263 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e800e070 con 0x7ff4f00cafb0 2023-07-21T22:12:16.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.183+0000 7ff4ee7fc700 1 -- 172.21.15.49:0/2448207263 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e800bb20 con 0x7ff4f00cafb0 2023-07-21T22:12:16.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.183+0000 7ff4ee7fc700 1 -- 172.21.15.49:0/2448207263 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8012430 con 0x7ff4f00cafb0 2023-07-21T22:12:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.183+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2448207263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4f00cafb0 msgr2=0x7ff4f00cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.183+0000 7ff4f4d15700 1 --2- 172.21.15.49:0/2448207263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4f00cafb0 0x7ff4f00cb430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009d90 tx=0x7ff4e800b330 comp rx=0 tx=0).stop 2023-07-21T22:12:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.183+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2448207263 shutdown_connections 2023-07-21T22:12:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.183+0000 7ff4f4d15700 1 --2- 172.21.15.49:0/2448207263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4f00cafb0 0x7ff4f00cb430 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.183+0000 7ff4f4d15700 1 --2- 172.21.15.49:0/2448207263 >> v2:172.21.15.49:3300/0 conn(0x7ff4f006d380 0x7ff4f006d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.183+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2448207263 >> 172.21.15.49:0/2448207263 conn(0x7ff4f0070450 msgr2=0x7ff4f0070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.183+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2448207263 shutdown_connections 2023-07-21T22:12:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.183+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2448207263 wait complete. 2023-07-21T22:12:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.187+0000 7ff4f4d15700 1 Processor -- start 2023-07-21T22:12:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.187+0000 7ff4f4d15700 1 -- start start 2023-07-21T22:12:16.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.187+0000 7ff4f4d15700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f006d380 0x7ff4f014e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:16.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.187+0000 7ff4f4d15700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f0071c70 0x7ff4f00a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:16.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.187+0000 7ff4f4d15700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4f00cafb0 0x7ff4f00ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:16.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.187+0000 7ff4f4d15700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00c3e20 con 0x7ff4f0071c70 2023-07-21T22:12:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.187+0000 7ff4f4d15700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00c4100 con 0x7ff4f006d380 2023-07-21T22:12:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.187+0000 7ff4f4d15700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00c43e0 con 0x7ff4f00cafb0 2023-07-21T22:12:16.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.187+0000 7ff4eeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f0071c70 0x7ff4f00a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:16.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.187+0000 7ff4eeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f0071c70 0x7ff4f00a7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34668/0 (socket says 172.21.15.49:34668) 2023-07-21T22:12:16.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.187+0000 7ff4eeffd700 1 -- 172.21.15.49:0/2535879558 learned_addr learned my addr 172.21.15.49:0/2535879558 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:16.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.187+0000 7ff4ef7fe700 1 --2- 172.21.15.49:0/2535879558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f006d380 0x7ff4f014e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:16.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.187+0000 7ff4effff700 1 --2- 172.21.15.49:0/2535879558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4f00cafb0 0x7ff4f00ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:16.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.191+0000 7ff4eeffd700 1 -- 172.21.15.49:0/2535879558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4f00cafb0 msgr2=0x7ff4f00ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:16.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.191+0000 7ff4eeffd700 1 --2- 172.21.15.49:0/2535879558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4f00cafb0 0x7ff4f00ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.191+0000 7ff4eeffd700 1 -- 172.21.15.49:0/2535879558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f006d380 msgr2=0x7ff4f014e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:16.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.191+0000 7ff4eeffd700 1 --2- 172.21.15.49:0/2535879558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f006d380 0x7ff4f014e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.191+0000 7ff4eeffd700 1 -- 172.21.15.49:0/2535879558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e8009a70 con 0x7ff4f0071c70 2023-07-21T22:12:16.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.191+0000 7ff4eeffd700 1 --2- 172.21.15.49:0/2535879558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f0071c70 0x7ff4f00a7ff0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c580 tx=0x7ff4e400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:16.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.191+0000 7ff4d7fff700 1 -- 172.21.15.49:0/2535879558 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4004ca0 con 0x7ff4f0071c70 2023-07-21T22:12:16.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.191+0000 7ff4d7fff700 1 -- 172.21.15.49:0/2535879558 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4004e20 con 0x7ff4f0071c70 2023-07-21T22:12:16.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.191+0000 7ff4d7fff700 1 -- 172.21.15.49:0/2535879558 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4007310 con 0x7ff4f0071c70 2023-07-21T22:12:16.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.191+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2535879558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f00c46c0 con 0x7ff4f0071c70 2023-07-21T22:12:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.191+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2535879558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f00c3a40 con 0x7ff4f0071c70 2023-07-21T22:12:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.191+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2535879558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f004dcb0 con 0x7ff4f0071c70 2023-07-21T22:12:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.195+0000 7ff4d7fff700 1 -- 172.21.15.49:0/2535879558 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4e4007470 con 0x7ff4f0071c70 2023-07-21T22:12:16.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.195+0000 7ff4d7fff700 1 --2- 172.21.15.49:0/2535879558 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff4dc0662f0 0x7ff4dc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:16.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.195+0000 7ff4d7fff700 1 -- 172.21.15.49:0/2535879558 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff4e4083730 con 0x7ff4f0071c70 2023-07-21T22:12:16.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.195+0000 7ff4ef7fe700 1 --2- 172.21.15.49:0/2535879558 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff4dc0662f0 0x7ff4dc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:16.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.195+0000 7ff4ef7fe700 1 --2- 172.21.15.49:0/2535879558 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff4dc0662f0 0x7ff4dc0687a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00c1940 tx=0x7ff4e0009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.203+0000 7ff4d7fff700 1 -- 172.21.15.49:0/2535879558 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4e4050dd0 con 0x7ff4f0071c70 2023-07-21T22:12:16.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.443+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2535879558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7ff4f00b3ff0 con 0x7ff4f0071c70 2023-07-21T22:12:16.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.451+0000 7ff4d7fff700 1 -- 172.21.15.49:0/2535879558 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff4e4007720 con 0x7ff4f0071c70 2023-07-21T22:12:16.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.455+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2535879558 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff4dc0662f0 msgr2=0x7ff4dc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:16.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.455+0000 7ff4f4d15700 1 --2- 172.21.15.49:0/2535879558 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff4dc0662f0 0x7ff4dc0687a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00c1940 tx=0x7ff4e0009240 comp rx=0 tx=0).stop 2023-07-21T22:12:16.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.455+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2535879558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f0071c70 msgr2=0x7ff4f00a7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:16.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.455+0000 7ff4f4d15700 1 --2- 172.21.15.49:0/2535879558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f0071c70 0x7ff4f00a7ff0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c580 tx=0x7ff4e400c890 comp rx=0 tx=0).stop 2023-07-21T22:12:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.455+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2535879558 shutdown_connections 2023-07-21T22:12:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.455+0000 7ff4f4d15700 1 --2- 172.21.15.49:0/2535879558 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff4dc0662f0 0x7ff4dc0687a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.455+0000 7ff4f4d15700 1 --2- 172.21.15.49:0/2535879558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f0071c70 0x7ff4f00a7ff0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.455+0000 7ff4f4d15700 1 --2- 172.21.15.49:0/2535879558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4f00cafb0 0x7ff4f00ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.455+0000 7ff4f4d15700 1 --2- 172.21.15.49:0/2535879558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f006d380 0x7ff4f014e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.455+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2535879558 >> 172.21.15.49:0/2535879558 conn(0x7ff4f0070450 msgr2=0x7ff4f00b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.455+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2535879558 shutdown_connections 2023-07-21T22:12:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.455+0000 7ff4f4d15700 1 -- 172.21.15.49:0/2535879558 wait complete. 2023-07-21T22:12:16.524 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-21T22:12:16.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.655+0000 7fa23354c700 1 Processor -- start 2023-07-21T22:12:16.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.655+0000 7fa23354c700 1 -- start start 2023-07-21T22:12:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa23354c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa22c1582f0 0x7fa22c0cb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa23354c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa22c0c8dd0 0x7fa22c0ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa23354c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22c1586c0 con 0x7fa22c15c870 2023-07-21T22:12:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa23354c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22c0cbad0 con 0x7fa22c0c8dd0 2023-07-21T22:12:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa23354c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c15cd50 con 0x7fa22c1582f0 2023-07-21T22:12:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa232d4b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa22c0c8dd0 0x7fa22c0ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa231d49700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa22c15c870 0x7fa22c0c86c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:58150/0 (socket says 172.21.15.49:58150) 2023-07-21T22:12:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa23254a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa22c1582f0 0x7fa22c0cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:16.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa231d49700 1 -- 172.21.15.49:0/2652500697 learned_addr learned my addr 172.21.15.49:0/2652500697 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:16.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa231548700 1 -- 172.21.15.49:0/2652500697 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107452534 0 0) 0x7fa22c1586c0 con 0x7fa22c15c870 2023-07-21T22:12:16.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa231548700 1 -- 172.21.15.49:0/2652500697 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2180035d0 con 0x7fa22c15c870 2023-07-21T22:12:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa23254a700 1 -- 172.21.15.49:0/2652500697 >> v2:172.21.15.49:3300/0 conn(0x7fa22c0c8dd0 msgr2=0x7fa22c0ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa23254a700 1 --2- 172.21.15.49:0/2652500697 >> v2:172.21.15.49:3300/0 conn(0x7fa22c0c8dd0 0x7fa22c0ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa23254a700 1 -- 172.21.15.49:0/2652500697 >> v1:172.21.15.150:6789/0 conn(0x7fa22c15c870 legacy=0x7fa22c0c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.659+0000 7fa23254a700 1 -- 172.21.15.49:0/2652500697 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c0cbce0 con 0x7fa22c1582f0 2023-07-21T22:12:16.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.663+0000 7fa23254a700 1 --2- 172.21.15.49:0/2652500697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa22c1582f0 0x7fa22c0cb590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa22800a970 tx=0x7fa22800ac80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5f14e4432d0c72f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:16.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.663+0000 7fa231548700 1 -- 172.21.15.49:0/2652500697 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22800c870 con 0x7fa22c1582f0 2023-07-21T22:12:16.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.663+0000 7fa231548700 1 -- 172.21.15.49:0/2652500697 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22800c9d0 con 0x7fa22c1582f0 2023-07-21T22:12:16.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.663+0000 7fa231548700 1 -- 172.21.15.49:0/2652500697 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22800cd60 con 0x7fa22c1582f0 2023-07-21T22:12:16.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.663+0000 7fa23354c700 1 -- 172.21.15.49:0/2652500697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa22c1582f0 msgr2=0x7fa22c0cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:16.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.663+0000 7fa23354c700 1 --2- 172.21.15.49:0/2652500697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa22c1582f0 0x7fa22c0cb590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa22800a970 tx=0x7fa22800ac80 comp rx=0 tx=0).stop 2023-07-21T22:12:16.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.663+0000 7fa23354c700 1 -- 172.21.15.49:0/2652500697 shutdown_connections 2023-07-21T22:12:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.663+0000 7fa23354c700 1 --2- 172.21.15.49:0/2652500697 >> v2:172.21.15.49:3300/0 conn(0x7fa22c0c8dd0 0x7fa22c0ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.663+0000 7fa23354c700 1 --2- 172.21.15.49:0/2652500697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa22c1582f0 0x7fa22c0cb590 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.663+0000 7fa23354c700 1 -- 172.21.15.49:0/2652500697 >> 172.21.15.49:0/2652500697 conn(0x7fa22c070450 msgr2=0x7fa22c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.663+0000 7fa23354c700 1 -- 172.21.15.49:0/2652500697 shutdown_connections 2023-07-21T22:12:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.663+0000 7fa23354c700 1 -- 172.21.15.49:0/2652500697 wait complete. 2023-07-21T22:12:16.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.667+0000 7fa23354c700 1 Processor -- start 2023-07-21T22:12:16.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.667+0000 7fa23354c700 1 -- start start 2023-07-21T22:12:16.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.667+0000 7fa23354c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22c0c8dd0 0x7fa22c0b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:16.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.667+0000 7fa23354c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa22c1582f0 0x7fa22c0c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:16.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.667+0000 7fa23354c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa22c15c870 0x7fa22c15bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:16.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.667+0000 7fa23354c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0b1420 con 0x7fa22c1582f0 2023-07-21T22:12:16.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.667+0000 7fa23354c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0b1700 con 0x7fa22c0c8dd0 2023-07-21T22:12:16.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.667+0000 7fa23354c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0b19e0 con 0x7fa22c15c870 2023-07-21T22:12:16.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa231d49700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa22c1582f0 0x7fa22c0c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:16.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa231d49700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa22c1582f0 0x7fa22c0c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34686/0 (socket says 172.21.15.49:34686) 2023-07-21T22:12:16.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa231d49700 1 -- 172.21.15.49:0/530151355 learned_addr learned my addr 172.21.15.49:0/530151355 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:16.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa23254a700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22c0c8dd0 0x7fa22c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:16.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa232d4b700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa22c15c870 0x7fa22c15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:16.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa231d49700 1 -- 172.21.15.49:0/530151355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa22c15c870 msgr2=0x7fa22c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:16.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa231d49700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa22c15c870 0x7fa22c15bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa231d49700 1 -- 172.21.15.49:0/530151355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22c0c8dd0 msgr2=0x7fa22c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:16.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa231d49700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22c0c8dd0 0x7fa22c0b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa231d49700 1 -- 172.21.15.49:0/530151355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22800a5d0 con 0x7fa22c1582f0 2023-07-21T22:12:16.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa232d4b700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa22c15c870 0x7fa22c15bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:16.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa231d49700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa22c1582f0 0x7fa22c0c7150 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa21c005930 tx=0x7fa21c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:16.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa222ffd700 1 -- 172.21.15.49:0/530151355 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c005d90 con 0x7fa22c1582f0 2023-07-21T22:12:16.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa23354c700 1 -- 172.21.15.49:0/530151355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22c0b1cc0 con 0x7fa22c1582f0 2023-07-21T22:12:16.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa222ffd700 1 -- 172.21.15.49:0/530151355 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c0070d0 con 0x7fa22c1582f0 2023-07-21T22:12:16.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa222ffd700 1 -- 172.21.15.49:0/530151355 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c007480 con 0x7fa22c1582f0 2023-07-21T22:12:16.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa23354c700 1 -- 172.21.15.49:0/530151355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c0b2a00 con 0x7fa22c1582f0 2023-07-21T22:12:16.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.671+0000 7fa23354c700 1 -- 172.21.15.49:0/530151355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22c0b21e0 con 0x7fa22c1582f0 2023-07-21T22:12:16.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.675+0000 7fa222ffd700 1 -- 172.21.15.49:0/530151355 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa21c0075e0 con 0x7fa22c1582f0 2023-07-21T22:12:16.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.675+0000 7fa222ffd700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2100662f0 0x7fa2100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:16.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.675+0000 7fa222ffd700 1 -- 172.21.15.49:0/530151355 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa21c082fe0 con 0x7fa22c1582f0 2023-07-21T22:12:16.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.675+0000 7fa23254a700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2100662f0 0x7fa2100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:16.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.679+0000 7fa23254a700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2100662f0 0x7fa2100687a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa22800a970 tx=0x7fa228009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:16.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.683+0000 7fa222ffd700 1 -- 172.21.15.49:0/530151355 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa22c0b21e0 con 0x7fa22c1582f0 2023-07-21T22:12:16.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.919+0000 7fa23354c700 1 -- 172.21.15.49:0/530151355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa22c0b21e0 con 0x7fa22c1582f0 2023-07-21T22:12:16.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.931+0000 7fa222ffd700 1 -- 172.21.15.49:0/530151355 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa22c0b21e0 con 0x7fa22c1582f0 2023-07-21T22:12:16.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.931+0000 7fa23354c700 1 -- 172.21.15.49:0/530151355 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2100662f0 msgr2=0x7fa2100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:16.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.931+0000 7fa23354c700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2100662f0 0x7fa2100687a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa22800a970 tx=0x7fa228009030 comp rx=0 tx=0).stop 2023-07-21T22:12:16.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.931+0000 7fa23354c700 1 -- 172.21.15.49:0/530151355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa22c1582f0 msgr2=0x7fa22c0c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:16.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.931+0000 7fa23354c700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa22c1582f0 0x7fa22c0c7150 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa21c005930 tx=0x7fa21c00c7b0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.935+0000 7fa23354c700 1 -- 172.21.15.49:0/530151355 shutdown_connections 2023-07-21T22:12:16.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.935+0000 7fa23354c700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2100662f0 0x7fa2100687a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.935+0000 7fa23354c700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa22c1582f0 0x7fa22c0c7150 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.935+0000 7fa23354c700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa22c15c870 0x7fa22c15bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.935+0000 7fa23354c700 1 --2- 172.21.15.49:0/530151355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22c0c8dd0 0x7fa22c0b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:16.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.935+0000 7fa23354c700 1 -- 172.21.15.49:0/530151355 >> 172.21.15.49:0/530151355 conn(0x7fa22c070450 msgr2=0x7fa22c0afc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:16.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.935+0000 7fa23354c700 1 -- 172.21.15.49:0/530151355 shutdown_connections 2023-07-21T22:12:16.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:16.935+0000 7fa23354c700 1 -- 172.21.15.49:0/530151355 wait complete. 2023-07-21T22:12:17.000 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-21T22:12:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.135+0000 7f2e16989700 1 Processor -- start 2023-07-21T22:12:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.135+0000 7f2e16989700 1 -- start start 2023-07-21T22:12:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e16989700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2e10160370 0x7f2e1006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e16989700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2e100c1470 0x7f2e100c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e16989700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1006e010 con 0x7f2e100ca2c0 2023-07-21T22:12:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e16989700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e10160740 con 0x7f2e10160370 2023-07-21T22:12:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e16989700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e100ccc50 con 0x7f2e100c1470 2023-07-21T22:12:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e15987700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2e10160370 0x7f2e1006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e15987700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2e10160370 0x7f2e1006d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34688/0 (socket says 172.21.15.49:34688) 2023-07-21T22:12:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e15987700 1 -- 172.21.15.49:0/2319825251 learned_addr learned my addr 172.21.15.49:0/2319825251 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e15186700 1 --2- 172.21.15.49:0/2319825251 >> v2:172.21.15.150:3300/0 conn(0x7f2e100c1470 0x7f2e100c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e15987700 1 -- 172.21.15.49:0/2319825251 >> v2:172.21.15.150:3300/0 conn(0x7f2e100c1470 msgr2=0x7f2e100c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:17.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e15987700 1 --2- 172.21.15.49:0/2319825251 >> v2:172.21.15.150:3300/0 conn(0x7f2e100c1470 0x7f2e100c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e15987700 1 -- 172.21.15.49:0/2319825251 >> v1:172.21.15.150:6789/0 conn(0x7f2e100ca2c0 legacy=0x7f2e100caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e15987700 1 -- 172.21.15.49:0/2319825251 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e100afc90 con 0x7f2e10160370 2023-07-21T22:12:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e15186700 1 --2- 172.21.15.49:0/2319825251 >> v2:172.21.15.150:3300/0 conn(0x7f2e100c1470 0x7f2e100c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.139+0000 7f2e14985700 1 -- 172.21.15.49:0/2319825251 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149329988 0 0) 0x7f2e1006e010 con 0x7f2e100ca2c0 2023-07-21T22:12:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.143+0000 7f2e15987700 1 --2- 172.21.15.49:0/2319825251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e10160370 0x7f2e1006d7e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2e100c9a80 tx=0x7f2e0c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e696137f772874 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:17.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.143+0000 7f2e14985700 1 -- 172.21.15.49:0/2319825251 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c011830 con 0x7f2e10160370 2023-07-21T22:12:17.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.143+0000 7f2e14985700 1 -- 172.21.15.49:0/2319825251 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c011990 con 0x7f2e10160370 2023-07-21T22:12:17.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.143+0000 7f2e14985700 1 -- 172.21.15.49:0/2319825251 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c011d20 con 0x7f2e10160370 2023-07-21T22:12:17.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.143+0000 7f2e16989700 1 -- 172.21.15.49:0/2319825251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e10160370 msgr2=0x7f2e1006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.143+0000 7f2e16989700 1 --2- 172.21.15.49:0/2319825251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e10160370 0x7f2e1006d7e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2e100c9a80 tx=0x7f2e0c009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.143+0000 7f2e16989700 1 -- 172.21.15.49:0/2319825251 shutdown_connections 2023-07-21T22:12:17.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.143+0000 7f2e16989700 1 --2- 172.21.15.49:0/2319825251 >> v2:172.21.15.150:3300/0 conn(0x7f2e100c1470 0x7f2e100c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.143+0000 7f2e16989700 1 --2- 172.21.15.49:0/2319825251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e10160370 0x7f2e1006d7e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.143+0000 7f2e16989700 1 -- 172.21.15.49:0/2319825251 >> 172.21.15.49:0/2319825251 conn(0x7f2e10070450 msgr2=0x7f2e10070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:17.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.143+0000 7f2e16989700 1 -- 172.21.15.49:0/2319825251 shutdown_connections 2023-07-21T22:12:17.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.143+0000 7f2e16989700 1 -- 172.21.15.49:0/2319825251 wait complete. 2023-07-21T22:12:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.143+0000 7f2e16989700 1 Processor -- start 2023-07-21T22:12:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.143+0000 7f2e16989700 1 -- start start 2023-07-21T22:12:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e16989700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e100c1470 0x7f2e1014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e16989700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e100ca2c0 0x7f2e100c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e16989700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e100c4130 0x7f2e100c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e16989700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100c2920 con 0x7f2e100c1470 2023-07-21T22:12:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e16989700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100c2b50 con 0x7f2e100ca2c0 2023-07-21T22:12:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e16989700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100c2e30 con 0x7f2e100c4130 2023-07-21T22:12:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e15987700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e100c1470 0x7f2e1014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e15987700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e100c1470 0x7f2e1014f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34696/0 (socket says 172.21.15.49:34696) 2023-07-21T22:12:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e15987700 1 -- 172.21.15.49:0/4190197725 learned_addr learned my addr 172.21.15.49:0/4190197725 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e16188700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e100c4130 0x7f2e100c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e15186700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e100ca2c0 0x7f2e100c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e15987700 1 -- 172.21.15.49:0/4190197725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e100c4130 msgr2=0x7f2e100c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e15987700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e100c4130 0x7f2e100c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e15987700 1 -- 172.21.15.49:0/4190197725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e100ca2c0 msgr2=0x7f2e100c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e15987700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e100ca2c0 0x7f2e100c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e15987700 1 -- 172.21.15.49:0/4190197725 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e000094b0 con 0x7f2e100c1470 2023-07-21T22:12:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e15186700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e100ca2c0 0x7f2e100c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e16188700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e100c4130 0x7f2e100c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e15987700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e100c1470 0x7f2e1014f2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c013000 tx=0x7f2e0c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:17.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e067fc700 1 -- 172.21.15.49:0/4190197725 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0036c0 con 0x7f2e100c1470 2023-07-21T22:12:17.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e067fc700 1 -- 172.21.15.49:0/4190197725 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c01f070 con 0x7f2e100c1470 2023-07-21T22:12:17.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e16989700 1 -- 172.21.15.49:0/4190197725 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0c009570 con 0x7f2e100c1470 2023-07-21T22:12:17.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e067fc700 1 -- 172.21.15.49:0/4190197725 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c003a80 con 0x7f2e100c1470 2023-07-21T22:12:17.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.147+0000 7f2e16989700 1 -- 172.21.15.49:0/4190197725 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e100c33f0 con 0x7f2e100c1470 2023-07-21T22:12:17.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.151+0000 7f2e16989700 1 -- 172.21.15.49:0/4190197725 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1004dcb0 con 0x7f2e100c1470 2023-07-21T22:12:17.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.151+0000 7f2e067fc700 1 -- 172.21.15.49:0/4190197725 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e0c003be0 con 0x7f2e100c1470 2023-07-21T22:12:17.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.151+0000 7f2e067fc700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2df4066320 0x7f2df40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.155+0000 7f2e067fc700 1 -- 172.21.15.49:0/4190197725 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2e0c021070 con 0x7f2e100c1470 2023-07-21T22:12:17.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.155+0000 7f2e15186700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2df4066320 0x7f2df40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.155+0000 7f2e15186700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2df4066320 0x7f2df40687d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2e101f9280 tx=0x7f2e00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:17.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.159+0000 7f2e067fc700 1 -- 172.21.15.49:0/4190197725 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e0c088030 con 0x7f2e100c1470 2023-07-21T22:12:17.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.391+0000 7f2e16989700 1 -- 172.21.15.49:0/4190197725 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f2e100aff40 con 0x7f2e100c1470 2023-07-21T22:12:17.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.399+0000 7f2e067fc700 1 -- 172.21.15.49:0/4190197725 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2e0c0150a0 con 0x7f2e100c1470 2023-07-21T22:12:17.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.403+0000 7f2e16989700 1 -- 172.21.15.49:0/4190197725 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2df4066320 msgr2=0x7f2df40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.403+0000 7f2e16989700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2df4066320 0x7f2df40687d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2e101f9280 tx=0x7f2e00008040 comp rx=0 tx=0).stop 2023-07-21T22:12:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.403+0000 7f2e16989700 1 -- 172.21.15.49:0/4190197725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e100c1470 msgr2=0x7f2e1014f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.403+0000 7f2e16989700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e100c1470 0x7f2e1014f2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c013000 tx=0x7f2e0c004770 comp rx=0 tx=0).stop 2023-07-21T22:12:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.403+0000 7f2e16989700 1 -- 172.21.15.49:0/4190197725 shutdown_connections 2023-07-21T22:12:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.403+0000 7f2e16989700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2df4066320 0x7f2df40687d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.403+0000 7f2e16989700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e100c4130 0x7f2e100c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.403+0000 7f2e16989700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e100ca2c0 0x7f2e100c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.403+0000 7f2e16989700 1 --2- 172.21.15.49:0/4190197725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e100c1470 0x7f2e1014f2f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.403+0000 7f2e16989700 1 -- 172.21.15.49:0/4190197725 >> 172.21.15.49:0/4190197725 conn(0x7f2e10070450 msgr2=0x7f2e100cb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.403+0000 7f2e16989700 1 -- 172.21.15.49:0/4190197725 shutdown_connections 2023-07-21T22:12:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.403+0000 7f2e16989700 1 -- 172.21.15.49:0/4190197725 wait complete. 2023-07-21T22:12:17.471 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-21T22:12:17.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.611+0000 7faf89d9e700 1 Processor -- start 2023-07-21T22:12:17.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.611+0000 7faf89d9e700 1 -- start start 2023-07-21T22:12:17.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.611+0000 7faf89d9e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faf840b7af0 0x7faf840b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.611+0000 7faf89d9e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf840d1e40 0x7faf8415f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.611+0000 7faf89d9e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf840b3e80 con 0x7faf840cee10 2023-07-21T22:12:17.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.611+0000 7faf89d9e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf840cea00 con 0x7faf840d1e40 2023-07-21T22:12:17.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.611+0000 7faf89d9e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf840ccbf0 con 0x7faf840b7af0 2023-07-21T22:12:17.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf83fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf840d1e40 0x7faf8415f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf83fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf840d1e40 0x7faf8415f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34708/0 (socket says 172.21.15.49:34708) 2023-07-21T22:12:17.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf83fff700 1 -- 172.21.15.49:0/3260278595 learned_addr learned my addr 172.21.15.49:0/3260278595 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:17.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf88d9c700 1 --2- 172.21.15.49:0/3260278595 >> v2:172.21.15.150:3300/0 conn(0x7faf840b7af0 0x7faf840b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf83fff700 1 -- 172.21.15.49:0/3260278595 >> v2:172.21.15.150:3300/0 conn(0x7faf840b7af0 msgr2=0x7faf840b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:17.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf83fff700 1 --2- 172.21.15.49:0/3260278595 >> v2:172.21.15.150:3300/0 conn(0x7faf840b7af0 0x7faf840b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf83fff700 1 -- 172.21.15.49:0/3260278595 >> v1:172.21.15.150:6789/0 conn(0x7faf840cee10 legacy=0x7faf840b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf83fff700 1 -- 172.21.15.49:0/3260278595 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf840cced0 con 0x7faf840d1e40 2023-07-21T22:12:17.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf83fff700 1 --2- 172.21.15.49:0/3260278595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf840d1e40 0x7faf8415f630 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7faf840cede0 tx=0x7faf74009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80589f6f73363247 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:17.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf837fe700 1 -- 172.21.15.49:0/3260278595 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7400b8a0 con 0x7faf840d1e40 2023-07-21T22:12:17.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf837fe700 1 -- 172.21.15.49:0/3260278595 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7400ba00 con 0x7faf840d1e40 2023-07-21T22:12:17.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf837fe700 1 -- 172.21.15.49:0/3260278595 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7400bd90 con 0x7faf840d1e40 2023-07-21T22:12:17.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf89d9e700 1 -- 172.21.15.49:0/3260278595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf840d1e40 msgr2=0x7faf8415f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf89d9e700 1 --2- 172.21.15.49:0/3260278595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf840d1e40 0x7faf8415f630 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7faf840cede0 tx=0x7faf74009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf89d9e700 1 -- 172.21.15.49:0/3260278595 shutdown_connections 2023-07-21T22:12:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf89d9e700 1 --2- 172.21.15.49:0/3260278595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf840d1e40 0x7faf8415f630 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf89d9e700 1 --2- 172.21.15.49:0/3260278595 >> v2:172.21.15.150:3300/0 conn(0x7faf840b7af0 0x7faf840b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf89d9e700 1 -- 172.21.15.49:0/3260278595 >> 172.21.15.49:0/3260278595 conn(0x7faf8406e960 msgr2=0x7faf8406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf89d9e700 1 -- 172.21.15.49:0/3260278595 shutdown_connections 2023-07-21T22:12:17.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.615+0000 7faf89d9e700 1 -- 172.21.15.49:0/3260278595 wait complete. 2023-07-21T22:12:17.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.619+0000 7faf89d9e700 1 Processor -- start 2023-07-21T22:12:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.619+0000 7faf89d9e700 1 -- start start 2023-07-21T22:12:17.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf89d9e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf840b7af0 0x7faf84150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf89d9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf840cee10 0x7faf8415caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf89d9e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf840d1e40 0x7faf841e81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf89d9e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8415e9c0 con 0x7faf840cee10 2023-07-21T22:12:17.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf89d9e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf841510e0 con 0x7faf840d1e40 2023-07-21T22:12:17.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf89d9e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8415cfe0 con 0x7faf840b7af0 2023-07-21T22:12:17.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf83fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf840cee10 0x7faf8415caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf83fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf840cee10 0x7faf8415caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34716/0 (socket says 172.21.15.49:34716) 2023-07-21T22:12:17.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf83fff700 1 -- 172.21.15.49:0/1951819332 learned_addr learned my addr 172.21.15.49:0/1951819332 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:17.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf88d9c700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf840b7af0 0x7faf84150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf8959d700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf840d1e40 0x7faf841e81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf83fff700 1 -- 172.21.15.49:0/1951819332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf840b7af0 msgr2=0x7faf84150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf83fff700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf840b7af0 0x7faf84150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf83fff700 1 -- 172.21.15.49:0/1951819332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf840d1e40 msgr2=0x7faf841e81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf83fff700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf840d1e40 0x7faf841e81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf83fff700 1 -- 172.21.15.49:0/1951819332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf74009570 con 0x7faf840cee10 2023-07-21T22:12:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf8959d700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf840d1e40 0x7faf841e81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf83fff700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf840cee10 0x7faf8415caa0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7faf74000c00 tx=0x7faf74004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:17.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf817fa700 1 -- 172.21.15.49:0/1951819332 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74012ce0 con 0x7faf840cee10 2023-07-21T22:12:17.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf817fa700 1 -- 172.21.15.49:0/1951819332 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7401e070 con 0x7faf840cee10 2023-07-21T22:12:17.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf89d9e700 1 -- 172.21.15.49:0/1951819332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf841e5d70 con 0x7faf840cee10 2023-07-21T22:12:17.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf817fa700 1 -- 172.21.15.49:0/1951819332 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7401a640 con 0x7faf840cee10 2023-07-21T22:12:17.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.623+0000 7faf89d9e700 1 -- 172.21.15.49:0/1951819332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf841e6330 con 0x7faf840cee10 2023-07-21T22:12:17.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.627+0000 7faf89d9e700 1 -- 172.21.15.49:0/1951819332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf84072a50 con 0x7faf840cee10 2023-07-21T22:12:17.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.627+0000 7faf817fa700 1 -- 172.21.15.49:0/1951819332 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf7401a7a0 con 0x7faf840cee10 2023-07-21T22:12:17.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.631+0000 7faf817fa700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faf700662f0 0x7faf700687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.631+0000 7faf817fa700 1 -- 172.21.15.49:0/1951819332 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7faf74084ea0 con 0x7faf840cee10 2023-07-21T22:12:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.631+0000 7faf88d9c700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faf700662f0 0x7faf700687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.631+0000 7faf88d9c700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faf700662f0 0x7faf700687a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faf78009a00 tx=0x7faf78008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:17.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.635+0000 7faf817fa700 1 -- 172.21.15.49:0/1951819332 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf74052520 con 0x7faf840cee10 2023-07-21T22:12:17.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.871+0000 7faf89d9e700 1 -- 172.21.15.49:0/1951819332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7faf8404dcb0 con 0x7faf840cee10 2023-07-21T22:12:17.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.879+0000 7faf817fa700 1 -- 172.21.15.49:0/1951819332 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7faf74055b40 con 0x7faf840cee10 2023-07-21T22:12:17.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.879+0000 7faf89d9e700 1 -- 172.21.15.49:0/1951819332 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faf700662f0 msgr2=0x7faf700687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.879+0000 7faf89d9e700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faf700662f0 0x7faf700687a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faf78009a00 tx=0x7faf78008040 comp rx=0 tx=0).stop 2023-07-21T22:12:17.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.879+0000 7faf89d9e700 1 -- 172.21.15.49:0/1951819332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf840cee10 msgr2=0x7faf8415caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.879+0000 7faf89d9e700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf840cee10 0x7faf8415caa0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7faf74000c00 tx=0x7faf74004770 comp rx=0 tx=0).stop 2023-07-21T22:12:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.883+0000 7faf89d9e700 1 -- 172.21.15.49:0/1951819332 shutdown_connections 2023-07-21T22:12:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.883+0000 7faf89d9e700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faf700662f0 0x7faf700687a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.883+0000 7faf89d9e700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf840cee10 0x7faf8415caa0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.883+0000 7faf89d9e700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf840d1e40 0x7faf841e81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.883+0000 7faf89d9e700 1 --2- 172.21.15.49:0/1951819332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf840b7af0 0x7faf84150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.883+0000 7faf89d9e700 1 -- 172.21.15.49:0/1951819332 >> 172.21.15.49:0/1951819332 conn(0x7faf8406e960 msgr2=0x7faf840b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:17.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.883+0000 7faf89d9e700 1 -- 172.21.15.49:0/1951819332 shutdown_connections 2023-07-21T22:12:17.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:17.883+0000 7faf89d9e700 1 -- 172.21.15.49:0/1951819332 wait complete. 2023-07-21T22:12:17.950 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:12:18.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.091+0000 7f509971f700 1 Processor -- start 2023-07-21T22:12:18.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.091+0000 7f509971f700 1 -- start start 2023-07-21T22:12:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f509971f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50940cde80 0x7f50940ce250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f509971f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f509415a2a0 0x7f50940b1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f509971f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50940ce790 con 0x7f50940afbf0 2023-07-21T22:12:18.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f509971f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50940cea40 con 0x7f50940cde80 2023-07-21T22:12:18.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f509971f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50940b04f0 con 0x7f509415a2a0 2023-07-21T22:12:18.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f5093fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50940cde80 0x7f50940ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f5093fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50940cde80 0x7f50940ce250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34718/0 (socket says 172.21.15.49:34718) 2023-07-21T22:12:18.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f5093fff700 1 -- 172.21.15.49:0/1379489449 learned_addr learned my addr 172.21.15.49:0/1379489449 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:18.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f5098f1e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f50940afbf0 0x7f50940ca900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37232/0 (socket says 172.21.15.49:37232) 2023-07-21T22:12:18.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f508bfff700 1 --2- 172.21.15.49:0/1379489449 >> v2:172.21.15.150:3300/0 conn(0x7f509415a2a0 0x7f50940b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f5093fff700 1 -- 172.21.15.49:0/1379489449 >> v2:172.21.15.150:3300/0 conn(0x7f509415a2a0 msgr2=0x7f50940b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:18.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f5093fff700 1 --2- 172.21.15.49:0/1379489449 >> v2:172.21.15.150:3300/0 conn(0x7f509415a2a0 0x7f50940b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f5093fff700 1 -- 172.21.15.49:0/1379489449 >> v1:172.21.15.49:6789/0 conn(0x7f50940afbf0 legacy=0x7f50940ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f5093fff700 1 -- 172.21.15.49:0/1379489449 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50940b07d0 con 0x7f50940cde80 2023-07-21T22:12:18.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f508bfff700 1 --2- 172.21.15.49:0/1379489449 >> v2:172.21.15.150:3300/0 conn(0x7f509415a2a0 0x7f50940b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:18.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f5093fff700 1 --2- 172.21.15.49:0/1379489449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50940cde80 0x7f50940ce250 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f509406dd70 tx=0x7f5084009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6d817efeedca60 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:18.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f50937fe700 1 -- 172.21.15.49:0/1379489449 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084005e50 con 0x7f50940cde80 2023-07-21T22:12:18.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f50937fe700 1 -- 172.21.15.49:0/1379489449 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5084006030 con 0x7f50940cde80 2023-07-21T22:12:18.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f50937fe700 1 -- 172.21.15.49:0/1379489449 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50840063c0 con 0x7f50940cde80 2023-07-21T22:12:18.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f509971f700 1 -- 172.21.15.49:0/1379489449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50940cde80 msgr2=0x7f50940ce250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f509971f700 1 --2- 172.21.15.49:0/1379489449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50940cde80 0x7f50940ce250 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f509406dd70 tx=0x7f5084009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f509971f700 1 -- 172.21.15.49:0/1379489449 shutdown_connections 2023-07-21T22:12:18.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f509971f700 1 --2- 172.21.15.49:0/1379489449 >> v2:172.21.15.150:3300/0 conn(0x7f509415a2a0 0x7f50940b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f509971f700 1 --2- 172.21.15.49:0/1379489449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50940cde80 0x7f50940ce250 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f509971f700 1 -- 172.21.15.49:0/1379489449 >> 172.21.15.49:0/1379489449 conn(0x7f5094089fe0 msgr2=0x7f50940d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:18.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.095+0000 7f509971f700 1 -- 172.21.15.49:0/1379489449 shutdown_connections 2023-07-21T22:12:18.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.099+0000 7f509971f700 1 -- 172.21.15.49:0/1379489449 wait complete. 2023-07-21T22:12:18.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.103+0000 7f509971f700 1 Processor -- start 2023-07-21T22:12:18.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.103+0000 7f509971f700 1 -- start start 2023-07-21T22:12:18.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.103+0000 7f509971f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50940afbf0 0x7f50940b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.103+0000 7f509971f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50940cde80 0x7f50940c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.103+0000 7f509971f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f509415a2a0 0x7f50940c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.103+0000 7f509971f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50940c7d50 con 0x7f50940afbf0 2023-07-21T22:12:18.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.103+0000 7f509971f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5094150380 con 0x7f50940cde80 2023-07-21T22:12:18.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.103+0000 7f509971f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50940c7420 con 0x7f509415a2a0 2023-07-21T22:12:18.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.103+0000 7f5093fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50940afbf0 0x7f50940b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.103+0000 7f5093fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50940afbf0 0x7f50940b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34730/0 (socket says 172.21.15.49:34730) 2023-07-21T22:12:18.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.103+0000 7f5093fff700 1 -- 172.21.15.49:0/2684780336 learned_addr learned my addr 172.21.15.49:0/2684780336 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:18.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.103+0000 7f508bfff700 1 --2- 172.21.15.49:0/2684780336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50940cde80 0x7f50940c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.103+0000 7f5098f1e700 1 --2- 172.21.15.49:0/2684780336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f509415a2a0 0x7f50940c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.107+0000 7f5093fff700 1 -- 172.21.15.49:0/2684780336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f509415a2a0 msgr2=0x7f50940c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.107+0000 7f5093fff700 1 --2- 172.21.15.49:0/2684780336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f509415a2a0 0x7f50940c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.107+0000 7f5093fff700 1 -- 172.21.15.49:0/2684780336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50940cde80 msgr2=0x7f50940c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.107+0000 7f5093fff700 1 --2- 172.21.15.49:0/2684780336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50940cde80 0x7f50940c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.107+0000 7f5093fff700 1 -- 172.21.15.49:0/2684780336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5084009520 con 0x7f50940afbf0 2023-07-21T22:12:18.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.107+0000 7f5093fff700 1 --2- 172.21.15.49:0/2684780336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50940afbf0 0x7f50940b5600 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5084009c30 tx=0x7f5084004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:18.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.107+0000 7f50917fa700 1 -- 172.21.15.49:0/2684780336 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508400b690 con 0x7f50940afbf0 2023-07-21T22:12:18.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.107+0000 7f50917fa700 1 -- 172.21.15.49:0/2684780336 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5084020070 con 0x7f50940afbf0 2023-07-21T22:12:18.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.107+0000 7f509971f700 1 -- 172.21.15.49:0/2684780336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50940c7700 con 0x7f50940afbf0 2023-07-21T22:12:18.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.107+0000 7f50917fa700 1 -- 172.21.15.49:0/2684780336 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508400ba50 con 0x7f50940afbf0 2023-07-21T22:12:18.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.107+0000 7f509971f700 1 -- 172.21.15.49:0/2684780336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50940c9a20 con 0x7f50940afbf0 2023-07-21T22:12:18.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.107+0000 7f509971f700 1 -- 172.21.15.49:0/2684780336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509404dcb0 con 0x7f50940afbf0 2023-07-21T22:12:18.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.111+0000 7f50917fa700 1 -- 172.21.15.49:0/2684780336 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5084022030 con 0x7f50940afbf0 2023-07-21T22:12:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.111+0000 7f50917fa700 1 --2- 172.21.15.49:0/2684780336 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f50740662f0 0x7f50740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.111+0000 7f50917fa700 1 -- 172.21.15.49:0/2684780336 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f50840853c0 con 0x7f50940afbf0 2023-07-21T22:12:18.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.111+0000 7f508bfff700 1 --2- 172.21.15.49:0/2684780336 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f50740662f0 0x7f50740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.111+0000 7f508bfff700 1 --2- 172.21.15.49:0/2684780336 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f50740662f0 0x7f50740687a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f50940b2bc0 tx=0x7f507c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.119+0000 7f50917fa700 1 -- 172.21.15.49:0/2684780336 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5084052a40 con 0x7f50940afbf0 2023-07-21T22:12:18.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.295+0000 7f509971f700 1 -- 172.21.15.49:0/2684780336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f509406ab00 con 0x7f50940afbf0 2023-07-21T22:12:18.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.295+0000 7f50917fa700 1 -- 172.21.15.49:0/2684780336 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+14808 (secure 0 0 0) 0x7f5084056060 con 0x7f50940afbf0 2023-07-21T22:12:18.343 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:18.343 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:12:14.551825+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:12:18.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.299+0000 7f509971f700 1 -- 172.21.15.49:0/2684780336 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f50740662f0 msgr2=0x7f50740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.299+0000 7f509971f700 1 --2- 172.21.15.49:0/2684780336 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f50740662f0 0x7f50740687a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f50940b2bc0 tx=0x7f507c008040 comp rx=0 tx=0).stop 2023-07-21T22:12:18.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.299+0000 7f509971f700 1 -- 172.21.15.49:0/2684780336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50940afbf0 msgr2=0x7f50940b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.299+0000 7f509971f700 1 --2- 172.21.15.49:0/2684780336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50940afbf0 0x7f50940b5600 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5084009c30 tx=0x7f5084004770 comp rx=0 tx=0).stop 2023-07-21T22:12:18.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.303+0000 7f509971f700 1 -- 172.21.15.49:0/2684780336 shutdown_connections 2023-07-21T22:12:18.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.303+0000 7f509971f700 1 --2- 172.21.15.49:0/2684780336 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f50740662f0 0x7f50740687a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.303+0000 7f509971f700 1 --2- 172.21.15.49:0/2684780336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f509415a2a0 0x7f50940c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.303+0000 7f509971f700 1 --2- 172.21.15.49:0/2684780336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50940cde80 0x7f50940c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.303+0000 7f509971f700 1 --2- 172.21.15.49:0/2684780336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50940afbf0 0x7f50940b5600 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.303+0000 7f509971f700 1 -- 172.21.15.49:0/2684780336 >> 172.21.15.49:0/2684780336 conn(0x7f5094089fe0 msgr2=0x7f50940ad160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:18.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.303+0000 7f509971f700 1 -- 172.21.15.49:0/2684780336 shutdown_connections 2023-07-21T22:12:18.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.303+0000 7f509971f700 1 -- 172.21.15.49:0/2684780336 wait complete. 2023-07-21T22:12:18.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:12:18.372 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:12:18.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f9432411700 1 Processor -- start 2023-07-21T22:12:18.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f9432411700 1 -- start start 2023-07-21T22:12:18.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f9432411700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942c15e380 0x7f942c0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f9432411700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f942c0b3a50 0x7f942c0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f9432411700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f942c0ca190 con 0x7f942c0c9cd0 2023-07-21T22:12:18.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f9432411700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f942c159fd0 con 0x7f942c0b3a50 2023-07-21T22:12:18.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f9432411700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942c15d6e0 con 0x7f942c15e380 2023-07-21T22:12:18.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f94309ae700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f942c0c9cd0 0x7f942c0c8820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37248/0 (socket says 172.21.15.49:37248) 2023-07-21T22:12:18.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f94309ae700 1 -- 172.21.15.49:0/3259229863 learned_addr learned my addr 172.21.15.49:0/3259229863 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:18.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f942bfff700 1 --2- 172.21.15.49:0/3259229863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942c15e380 0x7f942c0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f94237fe700 1 --2- 172.21.15.49:0/3259229863 >> v2:172.21.15.150:3300/0 conn(0x7f942c0b3a50 0x7f942c0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f942bfff700 1 -- 172.21.15.49:0/3259229863 >> v2:172.21.15.150:3300/0 conn(0x7f942c0b3a50 msgr2=0x7f942c0cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f942bfff700 1 --2- 172.21.15.49:0/3259229863 >> v2:172.21.15.150:3300/0 conn(0x7f942c0b3a50 0x7f942c0cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f942bfff700 1 -- 172.21.15.49:0/3259229863 >> v1:172.21.15.49:6789/0 conn(0x7f942c0c9cd0 legacy=0x7f942c0c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f942bfff700 1 -- 172.21.15.49:0/3259229863 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c0ca900 con 0x7f942c15e380 2023-07-21T22:12:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.511+0000 7f942b7fe700 1 -- 172.21.15.49:0/3259229863 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246889483 0 0) 0x7f942c0ca190 con 0x7f942c0c9cd0 2023-07-21T22:12:18.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.515+0000 7f942bfff700 1 --2- 172.21.15.49:0/3259229863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942c15e380 0x7f942c0cabe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f941c009850 tx=0x7f941c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86eaffdec0df27c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:18.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.515+0000 7f942b7fe700 1 -- 172.21.15.49:0/3259229863 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c011830 con 0x7f942c15e380 2023-07-21T22:12:18.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.515+0000 7f942b7fe700 1 -- 172.21.15.49:0/3259229863 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c011990 con 0x7f942c15e380 2023-07-21T22:12:18.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.515+0000 7f942b7fe700 1 -- 172.21.15.49:0/3259229863 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c011d40 con 0x7f942c15e380 2023-07-21T22:12:18.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.515+0000 7f9432411700 1 -- 172.21.15.49:0/3259229863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942c15e380 msgr2=0x7f942c0cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.515+0000 7f9432411700 1 --2- 172.21.15.49:0/3259229863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942c15e380 0x7f942c0cabe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f941c009850 tx=0x7f941c009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:18.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.515+0000 7f9432411700 1 -- 172.21.15.49:0/3259229863 shutdown_connections 2023-07-21T22:12:18.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.515+0000 7f9432411700 1 --2- 172.21.15.49:0/3259229863 >> v2:172.21.15.150:3300/0 conn(0x7f942c0b3a50 0x7f942c0cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.515+0000 7f9432411700 1 --2- 172.21.15.49:0/3259229863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942c15e380 0x7f942c0cabe0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.515+0000 7f9432411700 1 -- 172.21.15.49:0/3259229863 >> 172.21.15.49:0/3259229863 conn(0x7f942c06e960 msgr2=0x7f942c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:18.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.515+0000 7f9432411700 1 -- 172.21.15.49:0/3259229863 shutdown_connections 2023-07-21T22:12:18.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.515+0000 7f9432411700 1 -- 172.21.15.49:0/3259229863 wait complete. 2023-07-21T22:12:18.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f9432411700 1 Processor -- start 2023-07-21T22:12:18.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f9432411700 1 -- start start 2023-07-21T22:12:18.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f9432411700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942c0b3a50 0x7f942c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f9432411700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f942c0c9cd0 0x7f942c1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f9432411700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f942c15e380 0x7f942c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f9432411700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c0b38a0 con 0x7f942c15e380 2023-07-21T22:12:18.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f9432411700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c15a6e0 con 0x7f942c0c9cd0 2023-07-21T22:12:18.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f9432411700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942c15b520 con 0x7f942c0b3a50 2023-07-21T22:12:18.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f94309ae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f942c15e380 0x7f942c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f942bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942c0b3a50 0x7f942c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f94309ae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f942c15e380 0x7f942c0c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34744/0 (socket says 172.21.15.49:34744) 2023-07-21T22:12:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f94309ae700 1 -- 172.21.15.49:0/4018905556 learned_addr learned my addr 172.21.15.49:0/4018905556 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f94237fe700 1 --2- 172.21.15.49:0/4018905556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f942c0c9cd0 0x7f942c1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f94309ae700 1 -- 172.21.15.49:0/4018905556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942c0b3a50 msgr2=0x7f942c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f94309ae700 1 --2- 172.21.15.49:0/4018905556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942c0b3a50 0x7f942c15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f94309ae700 1 -- 172.21.15.49:0/4018905556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f942c0c9cd0 msgr2=0x7f942c1569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f94309ae700 1 --2- 172.21.15.49:0/4018905556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f942c0c9cd0 0x7f942c1569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f94309ae700 1 -- 172.21.15.49:0/4018905556 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0094b0 con 0x7f942c15e380 2023-07-21T22:12:18.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.519+0000 7f94309ae700 1 --2- 172.21.15.49:0/4018905556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f942c15e380 0x7f942c0c52a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f942400cbe0 tx=0x7f942400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:18.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.523+0000 7f94297fa700 1 -- 172.21.15.49:0/4018905556 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942400aaa0 con 0x7f942c15e380 2023-07-21T22:12:18.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.523+0000 7f94297fa700 1 -- 172.21.15.49:0/4018905556 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942400ac20 con 0x7f942c15e380 2023-07-21T22:12:18.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.523+0000 7f9432411700 1 -- 172.21.15.49:0/4018905556 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942c156ee0 con 0x7f942c15e380 2023-07-21T22:12:18.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.523+0000 7f94297fa700 1 -- 172.21.15.49:0/4018905556 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94240070d0 con 0x7f942c15e380 2023-07-21T22:12:18.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.523+0000 7f9432411700 1 -- 172.21.15.49:0/4018905556 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942c15abf0 con 0x7f942c15e380 2023-07-21T22:12:18.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.523+0000 7f9432411700 1 -- 172.21.15.49:0/4018905556 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f942c15b6b0 con 0x7f942c15e380 2023-07-21T22:12:18.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.527+0000 7f94297fa700 1 -- 172.21.15.49:0/4018905556 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9424007230 con 0x7f942c15e380 2023-07-21T22:12:18.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.527+0000 7f94297fa700 1 --2- 172.21.15.49:0/4018905556 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f940c0662f0 0x7f940c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.527+0000 7f94297fa700 1 -- 172.21.15.49:0/4018905556 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f94240835d0 con 0x7f942c15e380 2023-07-21T22:12:18.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.527+0000 7f942bfff700 1 --2- 172.21.15.49:0/4018905556 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f940c0662f0 0x7f940c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.531+0000 7f942bfff700 1 --2- 172.21.15.49:0/4018905556 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f940c0662f0 0x7f940c0687a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f941c0090b0 tx=0x7f941c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:18.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.535+0000 7f94297fa700 1 -- 172.21.15.49:0/4018905556 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9424050c60 con 0x7f942c15e380 2023-07-21T22:12:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.703+0000 7f9432411700 1 -- 172.21.15.49:0/4018905556 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f942c04dd50 con 0x7f942c15e380 2023-07-21T22:12:18.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.707+0000 7f94297fa700 1 -- 172.21.15.49:0/4018905556 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9424018020 con 0x7f942c15e380 2023-07-21T22:12:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:12:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.707+0000 7f9432411700 1 -- 172.21.15.49:0/4018905556 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f940c0662f0 msgr2=0x7f940c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.707+0000 7f9432411700 1 --2- 172.21.15.49:0/4018905556 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f940c0662f0 0x7f940c0687a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f941c0090b0 tx=0x7f941c01c040 comp rx=0 tx=0).stop 2023-07-21T22:12:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.707+0000 7f9432411700 1 -- 172.21.15.49:0/4018905556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f942c15e380 msgr2=0x7f942c0c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.707+0000 7f9432411700 1 --2- 172.21.15.49:0/4018905556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f942c15e380 0x7f942c0c52a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f942400cbe0 tx=0x7f942400cef0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.707+0000 7f9432411700 1 -- 172.21.15.49:0/4018905556 shutdown_connections 2023-07-21T22:12:18.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.707+0000 7f9432411700 1 --2- 172.21.15.49:0/4018905556 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f940c0662f0 0x7f940c0687a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.707+0000 7f9432411700 1 --2- 172.21.15.49:0/4018905556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f942c15e380 0x7f942c0c52a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.707+0000 7f9432411700 1 --2- 172.21.15.49:0/4018905556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f942c0c9cd0 0x7f942c1569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.707+0000 7f9432411700 1 --2- 172.21.15.49:0/4018905556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942c0b3a50 0x7f942c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.707+0000 7f9432411700 1 -- 172.21.15.49:0/4018905556 >> 172.21.15.49:0/4018905556 conn(0x7f942c06e960 msgr2=0x7f942c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.711+0000 7f9432411700 1 -- 172.21.15.49:0/4018905556 shutdown_connections 2023-07-21T22:12:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.711+0000 7f9432411700 1 -- 172.21.15.49:0/4018905556 wait complete. 2023-07-21T22:12:18.778 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:12:18.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.915+0000 7f08ad93a700 1 Processor -- start 2023-07-21T22:12:18.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.915+0000 7f08ad93a700 1 -- start start 2023-07-21T22:12:18.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.915+0000 7f08ad93a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f08a80ca550 0x7f08a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.915+0000 7f08ad93a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08a806d6d0 0x7f08a80698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.915+0000 7f08ad93a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a80c8b80 con 0x7f08a8159be0 2023-07-21T22:12:18.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.915+0000 7f08ad93a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a80c9720 con 0x7f08a80ca550 2023-07-21T22:12:18.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.915+0000 7f08ad93a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a806db90 con 0x7f08a806d6d0 2023-07-21T22:12:18.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.915+0000 7f08a6ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f08a8159be0 0x7f08a80c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37252/0 (socket says 172.21.15.49:37252) 2023-07-21T22:12:18.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.915+0000 7f08a67fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f08a80ca550 0x7f08a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.915+0000 7f08a6ffd700 1 -- 172.21.15.49:0/3045654615 learned_addr learned my addr 172.21.15.49:0/3045654615 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:18.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.915+0000 7f08a77fe700 1 --2- 172.21.15.49:0/3045654615 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08a806d6d0 0x7f08a80698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08a67fc700 1 -- 172.21.15.49:0/3045654615 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08a806d6d0 msgr2=0x7f08a80698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:18.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08a67fc700 1 --2- 172.21.15.49:0/3045654615 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08a806d6d0 0x7f08a80698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08a67fc700 1 -- 172.21.15.49:0/3045654615 >> v1:172.21.15.49:6789/0 conn(0x7f08a8159be0 legacy=0x7f08a80c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08a67fc700 1 -- 172.21.15.49:0/3045654615 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a806de70 con 0x7f08a80ca550 2023-07-21T22:12:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08a67fc700 1 --2- 172.21.15.49:0/3045654615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08a80ca550 0x7f08a806d190 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f089c009850 tx=0x7f089c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa93839eeb023c20 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08a5ffb700 1 -- 172.21.15.49:0/3045654615 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c011830 con 0x7f08a80ca550 2023-07-21T22:12:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08a5ffb700 1 -- 172.21.15.49:0/3045654615 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089c011990 con 0x7f08a80ca550 2023-07-21T22:12:18.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08a5ffb700 1 -- 172.21.15.49:0/3045654615 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c011d40 con 0x7f08a80ca550 2023-07-21T22:12:18.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08ad93a700 1 -- 172.21.15.49:0/3045654615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08a80ca550 msgr2=0x7f08a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08ad93a700 1 --2- 172.21.15.49:0/3045654615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08a80ca550 0x7f08a806d190 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f089c009850 tx=0x7f089c009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:18.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08ad93a700 1 -- 172.21.15.49:0/3045654615 shutdown_connections 2023-07-21T22:12:18.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08ad93a700 1 --2- 172.21.15.49:0/3045654615 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08a806d6d0 0x7f08a80698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08ad93a700 1 --2- 172.21.15.49:0/3045654615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08a80ca550 0x7f08a806d190 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08ad93a700 1 -- 172.21.15.49:0/3045654615 >> 172.21.15.49:0/3045654615 conn(0x7f08a80ce0d0 msgr2=0x7f08a80ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:18.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08ad93a700 1 -- 172.21.15.49:0/3045654615 shutdown_connections 2023-07-21T22:12:18.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.919+0000 7f08ad93a700 1 -- 172.21.15.49:0/3045654615 wait complete. 2023-07-21T22:12:18.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08ad93a700 1 Processor -- start 2023-07-21T22:12:18.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08ad93a700 1 -- start start 2023-07-21T22:12:18.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08ad93a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08a806d6d0 0x7f08a80c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08ad93a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08a80ca550 0x7f08a80b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08ad93a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a8159be0 0x7f08a80c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08ad93a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a80b3e50 con 0x7f08a806d6d0 2023-07-21T22:12:18.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08ad93a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a80b3230 con 0x7f08a8159be0 2023-07-21T22:12:18.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08ad93a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a80b1900 con 0x7f08a80ca550 2023-07-21T22:12:18.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08a6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08a806d6d0 0x7f08a80c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08a77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a8159be0 0x7f08a80c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08a77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a8159be0 0x7f08a80c6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:54506/0 (socket says 172.21.15.49:54506) 2023-07-21T22:12:18.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08a77fe700 1 -- 172.21.15.49:0/3376230261 learned_addr learned my addr 172.21.15.49:0/3376230261 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:18.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08a67fc700 1 --2- 172.21.15.49:0/3376230261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08a80ca550 0x7f08a80b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08a77fe700 1 -- 172.21.15.49:0/3376230261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08a80ca550 msgr2=0x7f08a80b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08a77fe700 1 --2- 172.21.15.49:0/3376230261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08a80ca550 0x7f08a80b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08a77fe700 1 -- 172.21.15.49:0/3376230261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08a806d6d0 msgr2=0x7f08a80c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:18.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08a77fe700 1 --2- 172.21.15.49:0/3376230261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08a806d6d0 0x7f08a80c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:18.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.923+0000 7f08a77fe700 1 -- 172.21.15.49:0/3376230261 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c0094b0 con 0x7f08a8159be0 2023-07-21T22:12:18.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.927+0000 7f08a77fe700 1 --2- 172.21.15.49:0/3376230261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a8159be0 0x7f08a80c6c00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f08a000efc0 tx=0x7f08a000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:18.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.927+0000 7f088ffff700 1 -- 172.21.15.49:0/3376230261 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0009ea0 con 0x7f08a8159be0 2023-07-21T22:12:18.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.927+0000 7f088ffff700 1 -- 172.21.15.49:0/3376230261 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a000f040 con 0x7f08a8159be0 2023-07-21T22:12:18.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.927+0000 7f088ffff700 1 -- 172.21.15.49:0/3376230261 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a000ce90 con 0x7f08a8159be0 2023-07-21T22:12:18.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.927+0000 7f08ad93a700 1 -- 172.21.15.49:0/3376230261 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a80b34d0 con 0x7f08a8159be0 2023-07-21T22:12:18.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.927+0000 7f08ad93a700 1 -- 172.21.15.49:0/3376230261 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a80b1ba0 con 0x7f08a8159be0 2023-07-21T22:12:18.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.927+0000 7f08ad93a700 1 -- 172.21.15.49:0/3376230261 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a80b1d90 con 0x7f08a8159be0 2023-07-21T22:12:18.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.931+0000 7f088ffff700 1 -- 172.21.15.49:0/3376230261 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08a0014480 con 0x7f08a8159be0 2023-07-21T22:12:18.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.931+0000 7f088ffff700 1 --2- 172.21.15.49:0/3376230261 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f08940662f0 0x7f08940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:18.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.931+0000 7f088ffff700 1 -- 172.21.15.49:0/3376230261 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f08a00846d0 con 0x7f08a8159be0 2023-07-21T22:12:18.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.931+0000 7f08a6ffd700 1 --2- 172.21.15.49:0/3376230261 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f08940662f0 0x7f08940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:18.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.931+0000 7f08a6ffd700 1 --2- 172.21.15.49:0/3376230261 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f08940662f0 0x7f08940687a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0898005930 tx=0x7f0898009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:18.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:18.939+0000 7f088ffff700 1 -- 172.21.15.49:0/3376230261 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08a0051cc0 con 0x7f08a8159be0 2023-07-21T22:12:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.115+0000 7f08ad93a700 1 -- 172.21.15.49:0/3376230261 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f08a804dcb0 con 0x7f08a8159be0 2023-07-21T22:12:19.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.115+0000 7f088ffff700 1 -- 172.21.15.49:0/3376230261 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f08a00180a0 con 0x7f08a8159be0 2023-07-21T22:12:19.162 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:12:19.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.119+0000 7f08ad93a700 1 -- 172.21.15.49:0/3376230261 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f08940662f0 msgr2=0x7f08940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:19.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.119+0000 7f08ad93a700 1 --2- 172.21.15.49:0/3376230261 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f08940662f0 0x7f08940687a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0898005930 tx=0x7f0898009040 comp rx=0 tx=0).stop 2023-07-21T22:12:19.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.119+0000 7f08ad93a700 1 -- 172.21.15.49:0/3376230261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a8159be0 msgr2=0x7f08a80c6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:19.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.119+0000 7f08ad93a700 1 --2- 172.21.15.49:0/3376230261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a8159be0 0x7f08a80c6c00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f08a000efc0 tx=0x7f08a000c3a0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.119+0000 7f08ad93a700 1 -- 172.21.15.49:0/3376230261 shutdown_connections 2023-07-21T22:12:19.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.119+0000 7f08ad93a700 1 --2- 172.21.15.49:0/3376230261 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f08940662f0 0x7f08940687a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.119+0000 7f08ad93a700 1 --2- 172.21.15.49:0/3376230261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a8159be0 0x7f08a80c6c00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.119+0000 7f08ad93a700 1 --2- 172.21.15.49:0/3376230261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08a80ca550 0x7f08a80b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.119+0000 7f08ad93a700 1 --2- 172.21.15.49:0/3376230261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08a806d6d0 0x7f08a80c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.119+0000 7f08ad93a700 1 -- 172.21.15.49:0/3376230261 >> 172.21.15.49:0/3376230261 conn(0x7f08a80ce0d0 msgr2=0x7f08a80ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:19.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.119+0000 7f08ad93a700 1 -- 172.21.15.49:0/3376230261 shutdown_connections 2023-07-21T22:12:19.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.119+0000 7f08ad93a700 1 -- 172.21.15.49:0/3376230261 wait complete. 2023-07-21T22:12:19.188 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:12:19.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.315+0000 7fb962f54700 1 Processor -- start 2023-07-21T22:12:19.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.315+0000 7fb962f54700 1 -- start start 2023-07-21T22:12:19.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb962f54700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb95c06d5d0 0x7fb95c06d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:19.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb962f54700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb95c159f60 0x7fb95c0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb962f54700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb95c06dee0 con 0x7fb95c0b0160 2023-07-21T22:12:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb962f54700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95c0b0600 con 0x7fb95c159f60 2023-07-21T22:12:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb962f54700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c15a470 con 0x7fb95c06d5d0 2023-07-21T22:12:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb953fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb95c159f60 0x7fb95c0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb953fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb95c159f60 0x7fb95c0afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34782/0 (socket says 172.21.15.49:34782) 2023-07-21T22:12:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb9614f1700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb95c0b0160 0x7fb95c070600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37264/0 (socket says 172.21.15.49:37264) 2023-07-21T22:12:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb953fff700 1 -- 172.21.15.49:0/3247938287 learned_addr learned my addr 172.21.15.49:0/3247938287 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb960cf0700 1 --2- 172.21.15.49:0/3247938287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb95c06d5d0 0x7fb95c06d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb953fff700 1 -- 172.21.15.49:0/3247938287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb95c06d5d0 msgr2=0x7fb95c06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb953fff700 1 --2- 172.21.15.49:0/3247938287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb95c06d5d0 0x7fb95c06d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb953fff700 1 -- 172.21.15.49:0/3247938287 >> v1:172.21.15.49:6789/0 conn(0x7fb95c0b0160 legacy=0x7fb95c070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb9537fe700 1 -- 172.21.15.49:0/3247938287 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756722523 0 0) 0x7fb95c06dee0 con 0x7fb95c0b0160 2023-07-21T22:12:19.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.319+0000 7fb953fff700 1 -- 172.21.15.49:0/3247938287 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c15a750 con 0x7fb95c159f60 2023-07-21T22:12:19.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.323+0000 7fb953fff700 1 --2- 172.21.15.49:0/3247938287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb95c159f60 0x7fb95c0afc20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009910 tx=0x7fb94c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266b29c6715b5196 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:19.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.323+0000 7fb9537fe700 1 -- 172.21.15.49:0/3247938287 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c011830 con 0x7fb95c159f60 2023-07-21T22:12:19.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.323+0000 7fb9537fe700 1 -- 172.21.15.49:0/3247938287 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c011990 con 0x7fb95c159f60 2023-07-21T22:12:19.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.323+0000 7fb9537fe700 1 -- 172.21.15.49:0/3247938287 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c011d40 con 0x7fb95c159f60 2023-07-21T22:12:19.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.323+0000 7fb962f54700 1 -- 172.21.15.49:0/3247938287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb95c159f60 msgr2=0x7fb95c0afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:19.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.323+0000 7fb962f54700 1 --2- 172.21.15.49:0/3247938287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb95c159f60 0x7fb95c0afc20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009910 tx=0x7fb94c009c20 comp rx=0 tx=0).stop 2023-07-21T22:12:19.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.323+0000 7fb962f54700 1 -- 172.21.15.49:0/3247938287 shutdown_connections 2023-07-21T22:12:19.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.323+0000 7fb962f54700 1 --2- 172.21.15.49:0/3247938287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb95c159f60 0x7fb95c0afc20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.323+0000 7fb962f54700 1 --2- 172.21.15.49:0/3247938287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb95c06d5d0 0x7fb95c06d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.323+0000 7fb962f54700 1 -- 172.21.15.49:0/3247938287 >> 172.21.15.49:0/3247938287 conn(0x7fb95c06f5a0 msgr2=0x7fb95c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:19.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.323+0000 7fb962f54700 1 -- 172.21.15.49:0/3247938287 shutdown_connections 2023-07-21T22:12:19.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.323+0000 7fb962f54700 1 -- 172.21.15.49:0/3247938287 wait complete. 2023-07-21T22:12:19.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.327+0000 7fb962f54700 1 Processor -- start 2023-07-21T22:12:19.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.327+0000 7fb962f54700 1 -- start start 2023-07-21T22:12:19.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.327+0000 7fb962f54700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb95c06d5d0 0x7fb95c14cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:19.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.327+0000 7fb962f54700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb95c0b0160 0x7fb95c0c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:19.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.327+0000 7fb962f54700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb95c159f60 0x7fb95c0c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:19.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.327+0000 7fb962f54700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c0c2ab0 con 0x7fb95c159f60 2023-07-21T22:12:19.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.327+0000 7fb962f54700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c0c2d90 con 0x7fb95c06d5d0 2023-07-21T22:12:19.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.327+0000 7fb962f54700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c0c3070 con 0x7fb95c0b0160 2023-07-21T22:12:19.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.327+0000 7fb9614f1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb95c159f60 0x7fb95c0c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:19.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.327+0000 7fb9614f1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb95c159f60 0x7fb95c0c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34798/0 (socket says 172.21.15.49:34798) 2023-07-21T22:12:19.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.327+0000 7fb9614f1700 1 -- 172.21.15.49:0/1184129647 learned_addr learned my addr 172.21.15.49:0/1184129647 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:19.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.327+0000 7fb960cf0700 1 --2- 172.21.15.49:0/1184129647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb95c06d5d0 0x7fb95c14cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:19.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.327+0000 7fb953fff700 1 --2- 172.21.15.49:0/1184129647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb95c0b0160 0x7fb95c0c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:19.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.331+0000 7fb9614f1700 1 -- 172.21.15.49:0/1184129647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb95c0b0160 msgr2=0x7fb95c0c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.331+0000 7fb9614f1700 1 --2- 172.21.15.49:0/1184129647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb95c0b0160 0x7fb95c0c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.331+0000 7fb9614f1700 1 -- 172.21.15.49:0/1184129647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb95c06d5d0 msgr2=0x7fb95c14cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.331+0000 7fb9614f1700 1 --2- 172.21.15.49:0/1184129647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb95c06d5d0 0x7fb95c14cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.331+0000 7fb9614f1700 1 -- 172.21.15.49:0/1184129647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c009570 con 0x7fb95c159f60 2023-07-21T22:12:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.331+0000 7fb9614f1700 1 --2- 172.21.15.49:0/1184129647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb95c159f60 0x7fb95c0c43d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb95400cc10 tx=0x7fb95400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.331+0000 7fb9517fa700 1 -- 172.21.15.49:0/1184129647 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95400aaa0 con 0x7fb95c159f60 2023-07-21T22:12:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.331+0000 7fb9517fa700 1 -- 172.21.15.49:0/1184129647 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95400ac20 con 0x7fb95c159f60 2023-07-21T22:12:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.331+0000 7fb9517fa700 1 -- 172.21.15.49:0/1184129647 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9540070d0 con 0x7fb95c159f60 2023-07-21T22:12:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.331+0000 7fb962f54700 1 -- 172.21.15.49:0/1184129647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95c0c3350 con 0x7fb95c159f60 2023-07-21T22:12:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.331+0000 7fb962f54700 1 -- 172.21.15.49:0/1184129647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95c0c1d40 con 0x7fb95c159f60 2023-07-21T22:12:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.331+0000 7fb962f54700 1 -- 172.21.15.49:0/1184129647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95c073130 con 0x7fb95c159f60 2023-07-21T22:12:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.335+0000 7fb9517fa700 1 -- 172.21.15.49:0/1184129647 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb954007230 con 0x7fb95c159f60 2023-07-21T22:12:19.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.335+0000 7fb9517fa700 1 --2- 172.21.15.49:0/1184129647 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb9480662f0 0x7fb9480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:19.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.335+0000 7fb9517fa700 1 -- 172.21.15.49:0/1184129647 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb954083540 con 0x7fb95c159f60 2023-07-21T22:12:19.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.335+0000 7fb960cf0700 1 --2- 172.21.15.49:0/1184129647 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb9480662f0 0x7fb9480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:19.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.339+0000 7fb960cf0700 1 --2- 172.21.15.49:0/1184129647 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb9480662f0 0x7fb9480687a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb958009b50 tx=0x7fb958009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:19.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.343+0000 7fb9517fa700 1 -- 172.21.15.49:0/1184129647 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb954050bd0 con 0x7fb95c159f60 2023-07-21T22:12:19.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.527+0000 7fb962f54700 1 -- 172.21.15.49:0/1184129647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb95c157310 con 0x7fb95c159f60 2023-07-21T22:12:19.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.527+0000 7fb9517fa700 1 -- 172.21.15.49:0/1184129647 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+126 (secure 0 0 0) 0x7fb9540541f0 con 0x7fb95c159f60 2023-07-21T22:12:19.575 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:19.575 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-07-21T22:12:19.576 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:19.576 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-07-21T22:12:19.576 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-07-21T22:12:19.576 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:19.576 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:12:19.576 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-07-21T22:12:19.577 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-07-21T22:12:19.577 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:19.577 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-07-21T22:12:19.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.531+0000 7fb962f54700 1 -- 172.21.15.49:0/1184129647 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb9480662f0 msgr2=0x7fb9480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:19.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.531+0000 7fb962f54700 1 --2- 172.21.15.49:0/1184129647 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb9480662f0 0x7fb9480687a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb958009b50 tx=0x7fb958009240 comp rx=0 tx=0).stop 2023-07-21T22:12:19.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.531+0000 7fb962f54700 1 -- 172.21.15.49:0/1184129647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb95c159f60 msgr2=0x7fb95c0c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:19.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.531+0000 7fb962f54700 1 --2- 172.21.15.49:0/1184129647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb95c159f60 0x7fb95c0c43d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb95400cc10 tx=0x7fb95400cf20 comp rx=0 tx=0).stop 2023-07-21T22:12:19.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.531+0000 7fb962f54700 1 -- 172.21.15.49:0/1184129647 shutdown_connections 2023-07-21T22:12:19.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.531+0000 7fb962f54700 1 --2- 172.21.15.49:0/1184129647 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb9480662f0 0x7fb9480687a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.531+0000 7fb962f54700 1 --2- 172.21.15.49:0/1184129647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb95c159f60 0x7fb95c0c43d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.531+0000 7fb962f54700 1 --2- 172.21.15.49:0/1184129647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb95c0b0160 0x7fb95c0c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.531+0000 7fb962f54700 1 --2- 172.21.15.49:0/1184129647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb95c06d5d0 0x7fb95c14cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.531+0000 7fb962f54700 1 -- 172.21.15.49:0/1184129647 >> 172.21.15.49:0/1184129647 conn(0x7fb95c06f5a0 msgr2=0x7fb95c06d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:19.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.531+0000 7fb962f54700 1 -- 172.21.15.49:0/1184129647 shutdown_connections 2023-07-21T22:12:19.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.531+0000 7fb962f54700 1 -- 172.21.15.49:0/1184129647 wait complete. 2023-07-21T22:12:19.599 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:12:19.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:12:19.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.739+0000 7f10cfd26700 1 Processor -- start 2023-07-21T22:12:19.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.739+0000 7f10cfd26700 1 -- start start 2023-07-21T22:12:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.743+0000 7f10cfd26700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f10c8071330 0x7f10c8160b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.743+0000 7f10cfd26700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10c8161090 0x7f10c80c1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:19.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.743+0000 7f10cfd26700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c8070600 con 0x7f10c80afce0 2023-07-21T22:12:19.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.743+0000 7f10cfd26700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c8070ea0 con 0x7f10c8161090 2023-07-21T22:12:19.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.743+0000 7f10cfd26700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c8161880 con 0x7f10c8071330 2023-07-21T22:12:19.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.743+0000 7f10ce2c3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10c8161090 0x7f10c80c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:19.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.743+0000 7f10cd2c1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f10c8071330 0x7f10c8160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:19.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.743+0000 7f10ce2c3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10c8161090 0x7f10c80c1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34806/0 (socket says 172.21.15.49:34806) 2023-07-21T22:12:19.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.743+0000 7f10ce2c3700 1 -- 172.21.15.49:0/2713443981 learned_addr learned my addr 172.21.15.49:0/2713443981 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:19.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.743+0000 7f10ccac0700 1 -- 172.21.15.49:0/2713443981 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335616643 0 0) 0x7f10c8070600 con 0x7f10c80afce0 2023-07-21T22:12:19.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.743+0000 7f10ce2c3700 1 -- 172.21.15.49:0/2713443981 >> v2:172.21.15.150:3300/0 conn(0x7f10c8071330 msgr2=0x7f10c8160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:19.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.743+0000 7f10ce2c3700 1 --2- 172.21.15.49:0/2713443981 >> v2:172.21.15.150:3300/0 conn(0x7f10c8071330 0x7f10c8160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.743+0000 7f10ce2c3700 1 -- 172.21.15.49:0/2713443981 >> v1:172.21.15.150:6789/0 conn(0x7f10c80afce0 legacy=0x7f10c80b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:19.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.743+0000 7f10ce2c3700 1 -- 172.21.15.49:0/2713443981 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8070850 con 0x7f10c8161090 2023-07-21T22:12:19.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.747+0000 7f10ce2c3700 1 --2- 172.21.15.49:0/2713443981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10c8161090 0x7f10c80c1090 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f10c8066ca0 tx=0x7f10c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0ab74f8ce76b57 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:19.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.747+0000 7f10ccac0700 1 -- 172.21.15.49:0/2713443981 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c000e070 con 0x7f10c8161090 2023-07-21T22:12:19.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.747+0000 7f10ccac0700 1 -- 172.21.15.49:0/2713443981 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c000b910 con 0x7f10c8161090 2023-07-21T22:12:19.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.747+0000 7f10ccac0700 1 -- 172.21.15.49:0/2713443981 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c000bcc0 con 0x7f10c8161090 2023-07-21T22:12:19.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.747+0000 7f10cfd26700 1 -- 172.21.15.49:0/2713443981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10c8161090 msgr2=0x7f10c80c1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:19.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.747+0000 7f10cfd26700 1 --2- 172.21.15.49:0/2713443981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10c8161090 0x7f10c80c1090 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f10c8066ca0 tx=0x7f10c000b330 comp rx=0 tx=0).stop 2023-07-21T22:12:19.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.747+0000 7f10cfd26700 1 -- 172.21.15.49:0/2713443981 shutdown_connections 2023-07-21T22:12:19.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.747+0000 7f10cfd26700 1 --2- 172.21.15.49:0/2713443981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10c8161090 0x7f10c80c1090 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.747+0000 7f10cfd26700 1 --2- 172.21.15.49:0/2713443981 >> v2:172.21.15.150:3300/0 conn(0x7f10c8071330 0x7f10c8160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.747+0000 7f10cfd26700 1 -- 172.21.15.49:0/2713443981 >> 172.21.15.49:0/2713443981 conn(0x7f10c80cace0 msgr2=0x7f10c80cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.747+0000 7f10cfd26700 1 -- 172.21.15.49:0/2713443981 shutdown_connections 2023-07-21T22:12:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.747+0000 7f10cfd26700 1 -- 172.21.15.49:0/2713443981 wait complete. 2023-07-21T22:12:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cfd26700 1 Processor -- start 2023-07-21T22:12:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cfd26700 1 -- start start 2023-07-21T22:12:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cfd26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10c8071330 0x7f10c80c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cfd26700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10c80afce0 0x7f10c815b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cfd26700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c8161090 0x7f10c80c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cfd26700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c815db50 con 0x7f10c8071330 2023-07-21T22:12:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cfd26700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c815ced0 con 0x7f10c8161090 2023-07-21T22:12:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cfd26700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c815d1b0 con 0x7f10c80afce0 2023-07-21T22:12:19.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cdac2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10c8071330 0x7f10c80c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cdac2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10c8071330 0x7f10c80c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34814/0 (socket says 172.21.15.49:34814) 2023-07-21T22:12:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cdac2700 1 -- 172.21.15.49:0/402865337 learned_addr learned my addr 172.21.15.49:0/402865337 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cd2c1700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10c80afce0 0x7f10c815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10ce2c3700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c8161090 0x7f10c80c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cdac2700 1 -- 172.21.15.49:0/402865337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10c80afce0 msgr2=0x7f10c815b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cdac2700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10c80afce0 0x7f10c815b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cdac2700 1 -- 172.21.15.49:0/402865337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c8161090 msgr2=0x7f10c80c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cdac2700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c8161090 0x7f10c80c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cdac2700 1 -- 172.21.15.49:0/402865337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c0009b30 con 0x7f10c8071330 2023-07-21T22:12:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10ce2c3700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c8161090 0x7f10c80c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.751+0000 7f10cdac2700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10c8071330 0x7f10c80c5330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f10c40011e0 tx=0x7f10c400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.755+0000 7f10be7fc700 1 -- 172.21.15.49:0/402865337 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40054e0 con 0x7f10c8071330 2023-07-21T22:12:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.755+0000 7f10be7fc700 1 -- 172.21.15.49:0/402865337 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c40036a0 con 0x7f10c8071330 2023-07-21T22:12:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.755+0000 7f10be7fc700 1 -- 172.21.15.49:0/402865337 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4003a50 con 0x7f10c8071330 2023-07-21T22:12:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.755+0000 7f10cfd26700 1 -- 172.21.15.49:0/402865337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c815d490 con 0x7f10c8071330 2023-07-21T22:12:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.755+0000 7f10cfd26700 1 -- 172.21.15.49:0/402865337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c815b8b0 con 0x7f10c8071330 2023-07-21T22:12:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.755+0000 7f10cfd26700 1 -- 172.21.15.49:0/402865337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c804dd20 con 0x7f10c8071330 2023-07-21T22:12:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.755+0000 7f10be7fc700 1 -- 172.21.15.49:0/402865337 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10c4003bb0 con 0x7f10c8071330 2023-07-21T22:12:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.759+0000 7f10be7fc700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10ac0662f0 0x7f10ac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.759+0000 7f10be7fc700 1 -- 172.21.15.49:0/402865337 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f10c4082ff0 con 0x7f10c8071330 2023-07-21T22:12:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.759+0000 7f10cd2c1700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10ac0662f0 0x7f10ac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.759+0000 7f10cd2c1700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10ac0662f0 0x7f10ac0687a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f10c80af2b0 tx=0x7f10b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:19.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.763+0000 7f10be7fc700 1 -- 172.21.15.49:0/402865337 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f10c40506d0 con 0x7f10c8071330 2023-07-21T22:12:19.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:19.943+0000 7f10cfd26700 1 -- 172.21.15.49:0/402865337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f10c806df90 con 0x7f10c8071330 2023-07-21T22:12:20.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.571+0000 7f10be7fc700 1 -- 172.21.15.49:0/402865337 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7f10c40170b0 con 0x7f10c8071330 2023-07-21T22:12:20.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.579+0000 7f10cfd26700 1 -- 172.21.15.49:0/402865337 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10ac0662f0 msgr2=0x7f10ac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:20.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.579+0000 7f10cfd26700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10ac0662f0 0x7f10ac0687a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f10c80af2b0 tx=0x7f10b8008040 comp rx=0 tx=0).stop 2023-07-21T22:12:20.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.579+0000 7f10cfd26700 1 -- 172.21.15.49:0/402865337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10c8071330 msgr2=0x7f10c80c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:20.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.579+0000 7f10cfd26700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10c8071330 0x7f10c80c5330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f10c40011e0 tx=0x7f10c400cae0 comp rx=0 tx=0).stop 2023-07-21T22:12:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.579+0000 7f10cfd26700 1 -- 172.21.15.49:0/402865337 shutdown_connections 2023-07-21T22:12:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.579+0000 7f10cfd26700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10ac0662f0 0x7f10ac0687a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.579+0000 7f10cfd26700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c8161090 0x7f10c80c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.579+0000 7f10cfd26700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10c80afce0 0x7f10c815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.579+0000 7f10cfd26700 1 --2- 172.21.15.49:0/402865337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10c8071330 0x7f10c80c5330 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.579+0000 7f10cfd26700 1 -- 172.21.15.49:0/402865337 >> 172.21.15.49:0/402865337 conn(0x7f10c80cace0 msgr2=0x7f10c80ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:20.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.579+0000 7f10cfd26700 1 -- 172.21.15.49:0/402865337 shutdown_connections 2023-07-21T22:12:20.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.583+0000 7f10cfd26700 1 -- 172.21.15.49:0/402865337 wait complete. 2023-07-21T22:12:20.631 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-07-21T22:12:20.649 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:12:20.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.787+0000 7f884a67d700 1 Processor -- start 2023-07-21T22:12:20.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.787+0000 7f884a67d700 1 -- start start 2023-07-21T22:12:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.791+0000 7f884a67d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8844160000 0x7f88440b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.791+0000 7f884a67d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8844070680 0x7f8844070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.791+0000 7f884a67d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88440b2c40 con 0x7f884406be00 2023-07-21T22:12:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.791+0000 7f884a67d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884406de00 con 0x7f8844160000 2023-07-21T22:12:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.791+0000 7f884a67d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88440b1f00 con 0x7f8844070680 2023-07-21T22:12:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.791+0000 7f884967b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8844160000 0x7f88440b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.791+0000 7f884967b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8844160000 0x7f88440b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34820/0 (socket says 172.21.15.49:34820) 2023-07-21T22:12:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.791+0000 7f884967b700 1 -- 172.21.15.49:0/1386739901 learned_addr learned my addr 172.21.15.49:0/1386739901 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.791+0000 7f8849e7c700 1 --2- 172.21.15.49:0/1386739901 >> v2:172.21.15.150:3300/0 conn(0x7f8844070680 0x7f8844070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.791+0000 7f884967b700 1 -- 172.21.15.49:0/1386739901 >> v2:172.21.15.150:3300/0 conn(0x7f8844070680 msgr2=0x7f8844070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.791+0000 7f884967b700 1 --2- 172.21.15.49:0/1386739901 >> v2:172.21.15.150:3300/0 conn(0x7f8844070680 0x7f8844070ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.791+0000 7f884967b700 1 -- 172.21.15.49:0/1386739901 >> v1:172.21.15.150:6789/0 conn(0x7f884406be00 legacy=0x7f88441603d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.791+0000 7f884967b700 1 -- 172.21.15.49:0/1386739901 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844070ff0 con 0x7f8844160000 2023-07-21T22:12:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.795+0000 7f884967b700 1 --2- 172.21.15.49:0/1386739901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8844160000 0x7f88440b19c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f884406c2b0 tx=0x7f8840009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496563b219543956 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.795+0000 7f883bfff700 1 -- 172.21.15.49:0/1386739901 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840011830 con 0x7f8844160000 2023-07-21T22:12:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.795+0000 7f883bfff700 1 -- 172.21.15.49:0/1386739901 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8840011990 con 0x7f8844160000 2023-07-21T22:12:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.795+0000 7f883bfff700 1 -- 172.21.15.49:0/1386739901 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840011d20 con 0x7f8844160000 2023-07-21T22:12:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.795+0000 7f884a67d700 1 -- 172.21.15.49:0/1386739901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8844160000 msgr2=0x7f88440b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.795+0000 7f884a67d700 1 --2- 172.21.15.49:0/1386739901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8844160000 0x7f88440b19c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f884406c2b0 tx=0x7f8840009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.795+0000 7f884a67d700 1 -- 172.21.15.49:0/1386739901 shutdown_connections 2023-07-21T22:12:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.795+0000 7f884a67d700 1 --2- 172.21.15.49:0/1386739901 >> v2:172.21.15.150:3300/0 conn(0x7f8844070680 0x7f8844070ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.795+0000 7f884a67d700 1 --2- 172.21.15.49:0/1386739901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8844160000 0x7f88440b19c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.795+0000 7f884a67d700 1 -- 172.21.15.49:0/1386739901 >> 172.21.15.49:0/1386739901 conn(0x7f884406e960 msgr2=0x7f884406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.795+0000 7f884a67d700 1 -- 172.21.15.49:0/1386739901 shutdown_connections 2023-07-21T22:12:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.795+0000 7f884a67d700 1 -- 172.21.15.49:0/1386739901 wait complete. 2023-07-21T22:12:20.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.799+0000 7f884a67d700 1 Processor -- start 2023-07-21T22:12:20.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.799+0000 7f884a67d700 1 -- start start 2023-07-21T22:12:20.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.799+0000 7f884a67d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f884406be00 0x7f88441f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:20.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.799+0000 7f884a67d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844070680 0x7f8844158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:20.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.799+0000 7f884a67d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8844160000 0x7f884415a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:20.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.799+0000 7f884a67d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88440ca750 con 0x7f8844160000 2023-07-21T22:12:20.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.799+0000 7f884a67d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88440cb290 con 0x7f8844070680 2023-07-21T22:12:20.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.799+0000 7f884a67d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88440ca960 con 0x7f884406be00 2023-07-21T22:12:20.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.799+0000 7f8849e7c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8844160000 0x7f884415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:20.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.799+0000 7f8849e7c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8844160000 0x7f884415a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34834/0 (socket says 172.21.15.49:34834) 2023-07-21T22:12:20.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.799+0000 7f8849e7c700 1 -- 172.21.15.49:0/2399467180 learned_addr learned my addr 172.21.15.49:0/2399467180 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.799+0000 7f884967b700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f884406be00 0x7f88441f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.799+0000 7f8848e7a700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844070680 0x7f8844158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.803+0000 7f8849e7c700 1 -- 172.21.15.49:0/2399467180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f884406be00 msgr2=0x7f88441f6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.803+0000 7f8849e7c700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f884406be00 0x7f88441f6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.803+0000 7f8849e7c700 1 -- 172.21.15.49:0/2399467180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844070680 msgr2=0x7f8844158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.803+0000 7f8849e7c700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844070680 0x7f8844158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.803+0000 7f8849e7c700 1 -- 172.21.15.49:0/2399467180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840009570 con 0x7f8844160000 2023-07-21T22:12:20.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.803+0000 7f8848e7a700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844070680 0x7f8844158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:20.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.803+0000 7f8849e7c700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8844160000 0x7f884415a150 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f883c00efc0 tx=0x7f883c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:20.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.803+0000 7f8839ffb700 1 -- 172.21.15.49:0/2399467180 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c009ea0 con 0x7f8844160000 2023-07-21T22:12:20.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.803+0000 7f8839ffb700 1 -- 172.21.15.49:0/2399467180 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c00f040 con 0x7f8844160000 2023-07-21T22:12:20.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.803+0000 7f884a67d700 1 -- 172.21.15.49:0/2399467180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88440cac40 con 0x7f8844160000 2023-07-21T22:12:20.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.803+0000 7f8839ffb700 1 -- 172.21.15.49:0/2399467180 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c014480 con 0x7f8844160000 2023-07-21T22:12:20.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.803+0000 7f884a67d700 1 -- 172.21.15.49:0/2399467180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88441f70b0 con 0x7f8844160000 2023-07-21T22:12:20.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.803+0000 7f884a67d700 1 -- 172.21.15.49:0/2399467180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884404dcb0 con 0x7f8844160000 2023-07-21T22:12:20.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.807+0000 7f8839ffb700 1 -- 172.21.15.49:0/2399467180 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f883c0145e0 con 0x7f8844160000 2023-07-21T22:12:20.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.807+0000 7f8839ffb700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f88280662f0 0x7f88280687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:20.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.807+0000 7f8839ffb700 1 -- 172.21.15.49:0/2399467180 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f883c084650 con 0x7f8844160000 2023-07-21T22:12:20.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.807+0000 7f884967b700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f88280662f0 0x7f88280687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:20.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.811+0000 7f884967b700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f88280662f0 0x7f88280687a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8840000c00 tx=0x7f8840008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:20.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.815+0000 7f8839ffb700 1 -- 172.21.15.49:0/2399467180 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f883c051ad0 con 0x7f8844160000 2023-07-21T22:12:21.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:20.987+0000 7f884a67d700 1 -- 172.21.15.49:0/2399467180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f88440ce7f0 con 0x7f8844160000 2023-07-21T22:12:21.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.587+0000 7f8839ffb700 1 -- 172.21.15.49:0/2399467180 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) v1 ==== 170+0+0 (secure 0 0 0) 0x7f883c0550f0 con 0x7f8844160000 2023-07-21T22:12:21.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.595+0000 7f884a67d700 1 -- 172.21.15.49:0/2399467180 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f88280662f0 msgr2=0x7f88280687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:21.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.599+0000 7f884a67d700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f88280662f0 0x7f88280687a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8840000c00 tx=0x7f8840008030 comp rx=0 tx=0).stop 2023-07-21T22:12:21.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.599+0000 7f884a67d700 1 -- 172.21.15.49:0/2399467180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8844160000 msgr2=0x7f884415a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:21.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.599+0000 7f884a67d700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8844160000 0x7f884415a150 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f883c00efc0 tx=0x7f883c00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:12:21.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.599+0000 7f884a67d700 1 -- 172.21.15.49:0/2399467180 shutdown_connections 2023-07-21T22:12:21.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.599+0000 7f884a67d700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f88280662f0 0x7f88280687a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:21.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.599+0000 7f884a67d700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8844160000 0x7f884415a150 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:21.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.599+0000 7f884a67d700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844070680 0x7f8844158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:21.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.599+0000 7f884a67d700 1 --2- 172.21.15.49:0/2399467180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f884406be00 0x7f88441f6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:21.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.599+0000 7f884a67d700 1 -- 172.21.15.49:0/2399467180 >> 172.21.15.49:0/2399467180 conn(0x7f884406e960 msgr2=0x7f884406a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:21.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.603+0000 7f884a67d700 1 -- 172.21.15.49:0/2399467180 shutdown_connections 2023-07-21T22:12:21.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.603+0000 7f884a67d700 1 -- 172.21.15.49:0/2399467180 wait complete. 2023-07-21T22:12:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-07-21T22:12:21.674 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:12:21.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.811+0000 7f1fc0be3700 1 Processor -- start 2023-07-21T22:12:21.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.811+0000 7f1fc0be3700 1 -- start start 2023-07-21T22:12:21.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fc0be3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fbc1589a0 0x7f1fbc06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:21.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fc0be3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1fbc06c6d0 0x7f1fbc0698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:21.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fc0be3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fbc158d70 con 0x7f1fbc069de0 2023-07-21T22:12:21.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fc0be3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fbc06a280 con 0x7f1fbc06c6d0 2023-07-21T22:12:21.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fc0be3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc15c800 con 0x7f1fbc1589a0 2023-07-21T22:12:21.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fb3fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1fbc06c6d0 0x7f1fbc0698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:21.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fb3fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1fbc06c6d0 0x7f1fbc0698a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34844/0 (socket says 172.21.15.49:34844) 2023-07-21T22:12:21.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fb3fff700 1 -- 172.21.15.49:0/2507530965 learned_addr learned my addr 172.21.15.49:0/2507530965 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:21.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fbb7fe700 1 --2- 172.21.15.49:0/2507530965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fbc1589a0 0x7f1fbc06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:21.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fb3fff700 1 -- 172.21.15.49:0/2507530965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fbc1589a0 msgr2=0x7f1fbc06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:21.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fb3fff700 1 --2- 172.21.15.49:0/2507530965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fbc1589a0 0x7f1fbc06c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:21.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fb3fff700 1 -- 172.21.15.49:0/2507530965 >> v1:172.21.15.150:6789/0 conn(0x7f1fbc069de0 legacy=0x7f1fbc0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:21.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fb3fff700 1 -- 172.21.15.49:0/2507530965 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc0cc990 con 0x7f1fbc06c6d0 2023-07-21T22:12:21.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fbaffd700 1 -- 172.21.15.49:0/2507530965 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22307250 0 0) 0x7f1fb4001490 con 0x7f1fbc069de0 2023-07-21T22:12:21.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fb3fff700 1 --2- 172.21.15.49:0/2507530965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc06c6d0 0x7f1fbc0698a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400bbb0 tx=0x7f1fa400bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9973865a7928954 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:21.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fbaffd700 1 -- 172.21.15.49:0/2507530965 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa400dd30 con 0x7f1fbc06c6d0 2023-07-21T22:12:21.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fbaffd700 1 -- 172.21.15.49:0/2507530965 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa400de90 con 0x7f1fbc06c6d0 2023-07-21T22:12:21.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.815+0000 7f1fbaffd700 1 -- 172.21.15.49:0/2507530965 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4010690 con 0x7f1fbc06c6d0 2023-07-21T22:12:21.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.819+0000 7f1fc0be3700 1 -- 172.21.15.49:0/2507530965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc06c6d0 msgr2=0x7f1fbc0698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:21.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.819+0000 7f1fc0be3700 1 --2- 172.21.15.49:0/2507530965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc06c6d0 0x7f1fbc0698a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400bbb0 tx=0x7f1fa400bec0 comp rx=0 tx=0).stop 2023-07-21T22:12:21.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.819+0000 7f1fc0be3700 1 -- 172.21.15.49:0/2507530965 shutdown_connections 2023-07-21T22:12:21.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.819+0000 7f1fc0be3700 1 --2- 172.21.15.49:0/2507530965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc06c6d0 0x7f1fbc0698a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:21.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.819+0000 7f1fc0be3700 1 --2- 172.21.15.49:0/2507530965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fbc1589a0 0x7f1fbc06c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:21.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.819+0000 7f1fc0be3700 1 -- 172.21.15.49:0/2507530965 >> 172.21.15.49:0/2507530965 conn(0x7f1fbc0ce0d0 msgr2=0x7f1fbc0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.819+0000 7f1fc0be3700 1 -- 172.21.15.49:0/2507530965 shutdown_connections 2023-07-21T22:12:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.819+0000 7f1fc0be3700 1 -- 172.21.15.49:0/2507530965 wait complete. 2023-07-21T22:12:21.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fc0be3700 1 Processor -- start 2023-07-21T22:12:21.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fc0be3700 1 -- start start 2023-07-21T22:12:21.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fc0be3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc069de0 0x7f1fbc14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:21.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fc0be3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fbc06c6d0 0x7f1fbc157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:21.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fc0be3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fbc1589a0 0x7f1fbc155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:21.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fc0be3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc157160 con 0x7f1fbc069de0 2023-07-21T22:12:21.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fc0be3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc157940 con 0x7f1fbc1589a0 2023-07-21T22:12:21.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fc0be3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc1559d0 con 0x7f1fbc06c6d0 2023-07-21T22:12:21.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fbb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc069de0 0x7f1fbc14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:21.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fbb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc069de0 0x7f1fbc14fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34852/0 (socket says 172.21.15.49:34852) 2023-07-21T22:12:21.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fb3fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fbc06c6d0 0x7f1fbc157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:21.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fbb7fe700 1 -- 172.21.15.49:0/3126804104 learned_addr learned my addr 172.21.15.49:0/3126804104 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:21.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fbbfff700 1 --2- 172.21.15.49:0/3126804104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fbc1589a0 0x7f1fbc155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:21.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fbb7fe700 1 -- 172.21.15.49:0/3126804104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fbc06c6d0 msgr2=0x7f1fbc157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:21.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fbb7fe700 1 --2- 172.21.15.49:0/3126804104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fbc06c6d0 0x7f1fbc157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:21.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fbb7fe700 1 -- 172.21.15.49:0/3126804104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fbc1589a0 msgr2=0x7f1fbc155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:21.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fbb7fe700 1 --2- 172.21.15.49:0/3126804104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fbc1589a0 0x7f1fbc155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:21.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fbb7fe700 1 -- 172.21.15.49:0/3126804104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa400b810 con 0x7f1fbc069de0 2023-07-21T22:12:21.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.823+0000 7f1fb3fff700 1 --2- 172.21.15.49:0/3126804104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fbc06c6d0 0x7f1fbc157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:21.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.827+0000 7f1fbb7fe700 1 --2- 172.21.15.49:0/3126804104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc069de0 0x7f1fbc14fbd0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00e870 tx=0x7f1fac00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:21.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.827+0000 7f1fb8ff9700 1 -- 172.21.15.49:0/3126804104 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0095a0 con 0x7f1fbc069de0 2023-07-21T22:12:21.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.827+0000 7f1fb8ff9700 1 -- 172.21.15.49:0/3126804104 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac013680 con 0x7f1fbc069de0 2023-07-21T22:12:21.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.827+0000 7f1fb8ff9700 1 -- 172.21.15.49:0/3126804104 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0139f0 con 0x7f1fbc069de0 2023-07-21T22:12:21.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.827+0000 7f1fc0be3700 1 -- 172.21.15.49:0/3126804104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fbc1563a0 con 0x7f1fbc069de0 2023-07-21T22:12:21.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.827+0000 7f1fc0be3700 1 -- 172.21.15.49:0/3126804104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fbc156e80 con 0x7f1fbc069de0 2023-07-21T22:12:21.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.827+0000 7f1fc0be3700 1 -- 172.21.15.49:0/3126804104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fbc04dcb0 con 0x7f1fbc069de0 2023-07-21T22:12:21.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.831+0000 7f1fb8ff9700 1 -- 172.21.15.49:0/3126804104 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1fac013b50 con 0x7f1fbc069de0 2023-07-21T22:12:21.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.831+0000 7f1fb8ff9700 1 --2- 172.21.15.49:0/3126804104 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1f9c0662f0 0x7f1f9c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:21.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.831+0000 7f1fb8ff9700 1 -- 172.21.15.49:0/3126804104 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f1fac083be0 con 0x7f1fbc069de0 2023-07-21T22:12:21.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.831+0000 7f1fb3fff700 1 --2- 172.21.15.49:0/3126804104 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1f9c0662f0 0x7f1f9c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:21.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.835+0000 7f1fb3fff700 1 --2- 172.21.15.49:0/3126804104 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1f9c0662f0 0x7f1f9c0687a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400bbb0 tx=0x7f1fa401b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:21.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:21.839+0000 7f1fb8ff9700 1 -- 172.21.15.49:0/3126804104 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1fac054aa0 con 0x7f1fbc069de0 2023-07-21T22:12:22.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.051+0000 7f1fc0be3700 1 -- 172.21.15.49:0/3126804104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1fbc0cc310 con 0x7f1fbc069de0 2023-07-21T22:12:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.639+0000 7f1fb8ff9700 1 -- 172.21.15.49:0/3126804104 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1fac054630 con 0x7f1fbc069de0 2023-07-21T22:12:22.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.643+0000 7f1fc0be3700 1 -- 172.21.15.49:0/3126804104 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1f9c0662f0 msgr2=0x7f1f9c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:22.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.643+0000 7f1fc0be3700 1 --2- 172.21.15.49:0/3126804104 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1f9c0662f0 0x7f1f9c0687a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400bbb0 tx=0x7f1fa401b040 comp rx=0 tx=0).stop 2023-07-21T22:12:22.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.643+0000 7f1fc0be3700 1 -- 172.21.15.49:0/3126804104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc069de0 msgr2=0x7f1fbc14fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:22.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.643+0000 7f1fc0be3700 1 --2- 172.21.15.49:0/3126804104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc069de0 0x7f1fbc14fbd0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00e870 tx=0x7f1fac00eb80 comp rx=0 tx=0).stop 2023-07-21T22:12:22.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.651+0000 7f1fc0be3700 1 -- 172.21.15.49:0/3126804104 shutdown_connections 2023-07-21T22:12:22.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.651+0000 7f1fc0be3700 1 --2- 172.21.15.49:0/3126804104 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1f9c0662f0 0x7f1f9c0687a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:22.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.651+0000 7f1fc0be3700 1 --2- 172.21.15.49:0/3126804104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fbc1589a0 0x7f1fbc155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:22.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.651+0000 7f1fc0be3700 1 --2- 172.21.15.49:0/3126804104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fbc06c6d0 0x7f1fbc157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:22.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.655+0000 7f1fc0be3700 1 --2- 172.21.15.49:0/3126804104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc069de0 0x7f1fbc14fbd0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:22.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.655+0000 7f1fc0be3700 1 -- 172.21.15.49:0/3126804104 >> 172.21.15.49:0/3126804104 conn(0x7f1fbc0ce0d0 msgr2=0x7f1fbc06d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:22.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.655+0000 7f1fc0be3700 1 -- 172.21.15.49:0/3126804104 shutdown_connections 2023-07-21T22:12:22.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.655+0000 7f1fc0be3700 1 -- 172.21.15.49:0/3126804104 wait complete. 2023-07-21T22:12:22.702 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 6 and data pool 7 2023-07-21T22:12:22.724 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:12:22.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.855+0000 7f6dd1384700 1 Processor -- start 2023-07-21T22:12:22.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.855+0000 7f6dd1384700 1 -- start start 2023-07-21T22:12:22.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.855+0000 7f6dd1384700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dcc071c70 0x7f6dcc0b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:22.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.855+0000 7f6dd1384700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc0cab20 con 0x7f6dcc06d380 2023-07-21T22:12:22.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.855+0000 7f6dd1384700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc0ca1f0 con 0x7f6dcc0b1400 2023-07-21T22:12:22.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.855+0000 7f6dd1384700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0c9e80 con 0x7f6dcc071c70 2023-07-21T22:12:22.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.855+0000 7f6dcbfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6dcc06d380 0x7f6dcc06d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37278/0 (socket says 172.21.15.49:37278) 2023-07-21T22:12:22.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.855+0000 7f6dcbfff700 1 -- 172.21.15.49:0/1454501133 learned_addr learned my addr 172.21.15.49:0/1454501133 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:22.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dcb7fe700 1 --2- 172.21.15.49:0/1454501133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dcc071c70 0x7f6dcc0b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:22.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dcaffd700 1 -- 172.21.15.49:0/1454501133 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257623051 0 0) 0x7f6dcc0cab20 con 0x7f6dcc06d380 2023-07-21T22:12:22.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dcaffd700 1 -- 172.21.15.49:0/1454501133 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6db40035d0 con 0x7f6dcc06d380 2023-07-21T22:12:22.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dcaffd700 1 -- 172.21.15.49:0/1454501133 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304287137 0 0) 0x7f6dcc0ca1f0 con 0x7f6dcc0b1400 2023-07-21T22:12:22.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dcaffd700 1 -- 172.21.15.49:0/1454501133 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dcc0cab20 con 0x7f6dcc0b1400 2023-07-21T22:12:22.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dcb7fe700 1 -- 172.21.15.49:0/1454501133 >> v1:172.21.15.150:6789/0 conn(0x7f6dcc0b1400 legacy=0x7f6dcc0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:22.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dcb7fe700 1 -- 172.21.15.49:0/1454501133 >> v1:172.21.15.49:6789/0 conn(0x7f6dcc06d380 legacy=0x7f6dcc06d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:22.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dcb7fe700 1 -- 172.21.15.49:0/1454501133 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc0ca4d0 con 0x7f6dcc071c70 2023-07-21T22:12:22.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dcb7fe700 1 --2- 172.21.15.49:0/1454501133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dcc071c70 0x7f6dcc0b0ec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009880 tx=0x7f6dc0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a422523301fe914b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:22.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dcaffd700 1 -- 172.21.15.49:0/1454501133 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0011830 con 0x7f6dcc071c70 2023-07-21T22:12:22.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dcaffd700 1 -- 172.21.15.49:0/1454501133 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc0011990 con 0x7f6dcc071c70 2023-07-21T22:12:22.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dcaffd700 1 -- 172.21.15.49:0/1454501133 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0011d20 con 0x7f6dcc071c70 2023-07-21T22:12:22.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dd1384700 1 -- 172.21.15.49:0/1454501133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dcc071c70 msgr2=0x7f6dcc0b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:22.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dd1384700 1 --2- 172.21.15.49:0/1454501133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dcc071c70 0x7f6dcc0b0ec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009880 tx=0x7f6dc0009b90 comp rx=0 tx=0).stop 2023-07-21T22:12:22.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dd1384700 1 -- 172.21.15.49:0/1454501133 shutdown_connections 2023-07-21T22:12:22.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dd1384700 1 --2- 172.21.15.49:0/1454501133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dcc071c70 0x7f6dcc0b0ec0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:22.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.859+0000 7f6dd1384700 1 -- 172.21.15.49:0/1454501133 >> 172.21.15.49:0/1454501133 conn(0x7f6dcc070450 msgr2=0x7f6dcc070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:22.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.863+0000 7f6dd1384700 1 -- 172.21.15.49:0/1454501133 shutdown_connections 2023-07-21T22:12:22.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.863+0000 7f6dd1384700 1 -- 172.21.15.49:0/1454501133 wait complete. 2023-07-21T22:12:22.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.863+0000 7f6dd1384700 1 Processor -- start 2023-07-21T22:12:22.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dd1384700 1 -- start start 2023-07-21T22:12:22.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dd1384700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc06d380 0x7f6dcc0aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dd1384700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dcc071c70 0x7f6dcc154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dd1384700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dcc0b1400 0x7f6dcc1f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dd1384700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0cbc40 con 0x7f6dcc06d380 2023-07-21T22:12:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dd1384700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0cbe90 con 0x7f6dcc071c70 2023-07-21T22:12:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dd1384700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0cc170 con 0x7f6dcc0b1400 2023-07-21T22:12:22.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dcbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc06d380 0x7f6dcc0aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dcbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc06d380 0x7f6dcc0aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34860/0 (socket says 172.21.15.49:34860) 2023-07-21T22:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dcbfff700 1 -- 172.21.15.49:0/1669548146 learned_addr learned my addr 172.21.15.49:0/1669548146 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dd0b83700 1 --2- 172.21.15.49:0/1669548146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dcc0b1400 0x7f6dcc1f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dcb7fe700 1 --2- 172.21.15.49:0/1669548146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dcc071c70 0x7f6dcc154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dcbfff700 1 -- 172.21.15.49:0/1669548146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dcc0b1400 msgr2=0x7f6dcc1f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dcbfff700 1 --2- 172.21.15.49:0/1669548146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dcc0b1400 0x7f6dcc1f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dcbfff700 1 -- 172.21.15.49:0/1669548146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dcc071c70 msgr2=0x7f6dcc154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dcbfff700 1 --2- 172.21.15.49:0/1669548146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dcc071c70 0x7f6dcc154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dcbfff700 1 -- 172.21.15.49:0/1669548146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc00094b0 con 0x7f6dcc06d380 2023-07-21T22:12:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.867+0000 7f6dcbfff700 1 --2- 172.21.15.49:0/1669548146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc06d380 0x7f6dcc0aefd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00c730 tx=0x7f6dbc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.871+0000 7f6dc8ff9700 1 -- 172.21.15.49:0/1669548146 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc005d90 con 0x7f6dcc06d380 2023-07-21T22:12:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.871+0000 7f6dc8ff9700 1 -- 172.21.15.49:0/1669548146 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc0070d0 con 0x7f6dcc06d380 2023-07-21T22:12:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.871+0000 7f6dc8ff9700 1 -- 172.21.15.49:0/1669548146 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc007440 con 0x7f6dcc06d380 2023-07-21T22:12:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.871+0000 7f6dd1384700 1 -- 172.21.15.49:0/1669548146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc0cc450 con 0x7f6dcc06d380 2023-07-21T22:12:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.871+0000 7f6dd1384700 1 -- 172.21.15.49:0/1669548146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc154a60 con 0x7f6dcc06d380 2023-07-21T22:12:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.871+0000 7f6dd1384700 1 -- 172.21.15.49:0/1669548146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dcc0cc970 con 0x7f6dcc06d380 2023-07-21T22:12:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.871+0000 7f6dc8ff9700 1 -- 172.21.15.49:0/1669548146 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6dbc0075a0 con 0x7f6dcc06d380 2023-07-21T22:12:22.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.875+0000 7f6dc8ff9700 1 --2- 172.21.15.49:0/1669548146 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6db80662f0 0x7f6db80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:22.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.875+0000 7f6dc8ff9700 1 -- 172.21.15.49:0/1669548146 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6dbc083450 con 0x7f6dcc06d380 2023-07-21T22:12:22.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.875+0000 7f6dcb7fe700 1 --2- 172.21.15.49:0/1669548146 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6db80662f0 0x7f6db80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.875+0000 7f6dcb7fe700 1 --2- 172.21.15.49:0/1669548146 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6db80662f0 0x7f6db80687a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00090b0 tx=0x7f6dc001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:22.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:22.879+0000 7f6dc8ff9700 1 -- 172.21.15.49:0/1669548146 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6dbc0508b0 con 0x7f6dcc06d380 2023-07-21T22:12:23.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.067+0000 7f6dd1384700 1 -- 172.21.15.49:0/1669548146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6dcc0cc970 con 0x7f6dcc06d380 2023-07-21T22:12:23.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.071+0000 7f6dc8ff9700 1 -- 172.21.15.49:0/1669548146 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18477 (secure 0 0 0) 0x7f6dcc0cc970 con 0x7f6dcc06d380 2023-07-21T22:12:23.117 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:23.117 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":43,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:12:22.057156+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:12:20.014383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T22:12:21.059436+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:12:23.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.075+0000 7f6dd1384700 1 -- 172.21.15.49:0/1669548146 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6db80662f0 msgr2=0x7f6db80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:23.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.075+0000 7f6dd1384700 1 --2- 172.21.15.49:0/1669548146 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6db80662f0 0x7f6db80687a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00090b0 tx=0x7f6dc001c040 comp rx=0 tx=0).stop 2023-07-21T22:12:23.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.075+0000 7f6dd1384700 1 -- 172.21.15.49:0/1669548146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc06d380 msgr2=0x7f6dcc0aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:23.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.075+0000 7f6dd1384700 1 --2- 172.21.15.49:0/1669548146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc06d380 0x7f6dcc0aefd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00c730 tx=0x7f6dbc00ca40 comp rx=0 tx=0).stop 2023-07-21T22:12:23.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.075+0000 7f6dd1384700 1 -- 172.21.15.49:0/1669548146 shutdown_connections 2023-07-21T22:12:23.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.075+0000 7f6dd1384700 1 --2- 172.21.15.49:0/1669548146 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6db80662f0 0x7f6db80687a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.075+0000 7f6dd1384700 1 --2- 172.21.15.49:0/1669548146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dcc0b1400 0x7f6dcc1f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.075+0000 7f6dd1384700 1 --2- 172.21.15.49:0/1669548146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dcc071c70 0x7f6dcc154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.075+0000 7f6dd1384700 1 --2- 172.21.15.49:0/1669548146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc06d380 0x7f6dcc0aefd0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.075+0000 7f6dd1384700 1 -- 172.21.15.49:0/1669548146 >> 172.21.15.49:0/1669548146 conn(0x7f6dcc070450 msgr2=0x7f6dcc0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:23.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.075+0000 7f6dd1384700 1 -- 172.21.15.49:0/1669548146 shutdown_connections 2023-07-21T22:12:23.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.075+0000 7f6dd1384700 1 -- 172.21.15.49:0/1669548146 wait complete. 2023-07-21T22:12:23.144 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:12:23.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.279+0000 7f35ba369700 1 Processor -- start 2023-07-21T22:12:23.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.279+0000 7f35ba369700 1 -- start start 2023-07-21T22:12:23.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35ba369700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f35b41628f0 0x7f35b4164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:23.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35ba369700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b40b0330 con 0x7f35b406d5d0 2023-07-21T22:12:23.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35ba369700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b40b0600 con 0x7f35b4159f60 2023-07-21T22:12:23.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35ba369700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b415a470 con 0x7f35b41628f0 2023-07-21T22:12:23.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35b3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f35b406d5d0 0x7f35b406d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37288/0 (socket says 172.21.15.49:37288) 2023-07-21T22:12:23.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35b3fff700 1 -- 172.21.15.49:0/4263797492 learned_addr learned my addr 172.21.15.49:0/4263797492 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:23.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35b8906700 1 --2- 172.21.15.49:0/4263797492 >> v2:172.21.15.150:3300/0 conn(0x7f35b41628f0 0x7f35b4164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:23.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35b37fe700 1 -- 172.21.15.49:0/4263797492 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655025815 0 0) 0x7f35b40b0330 con 0x7f35b406d5d0 2023-07-21T22:12:23.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35b37fe700 1 -- 172.21.15.49:0/4263797492 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a00035d0 con 0x7f35b406d5d0 2023-07-21T22:12:23.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35b37fe700 1 -- 172.21.15.49:0/4263797492 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 947008773 0 0) 0x7f35a00035d0 con 0x7f35b406d5d0 2023-07-21T22:12:23.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35b37fe700 1 -- 172.21.15.49:0/4263797492 >> v2:172.21.15.150:3300/0 conn(0x7f35b41628f0 msgr2=0x7f35b4164cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:23.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35b37fe700 1 --2- 172.21.15.49:0/4263797492 >> v2:172.21.15.150:3300/0 conn(0x7f35b41628f0 0x7f35b4164cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35b37fe700 1 -- 172.21.15.49:0/4263797492 >> v1:172.21.15.150:6789/0 conn(0x7f35b4159f60 legacy=0x7f35b40afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:23.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35b37fe700 1 -- 172.21.15.49:0/4263797492 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b415a750 con 0x7f35b406d5d0 2023-07-21T22:12:23.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35b37fe700 1 -- 172.21.15.49:0/4263797492 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f35a4001670 con 0x7f35b406d5d0 2023-07-21T22:12:23.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35b37fe700 1 -- 172.21.15.49:0/4263797492 >> v1:172.21.15.49:6789/0 conn(0x7f35b406d5d0 legacy=0x7f35b406d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:23.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.283+0000 7f35b37fe700 1 --2- 172.21.15.49:0/4263797492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a0003a90 0x7f35a0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:23.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b37fe700 1 --2- 172.21.15.49:0/4263797492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35a0004870 0x7f35a0004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:23.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b37fe700 1 --2- 172.21.15.49:0/4263797492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35a0005290 0x7f35a000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:23.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b37fe700 1 -- 172.21.15.49:0/4263797492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b415a470 con 0x7f35a0003a90 2023-07-21T22:12:23.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b37fe700 1 -- 172.21.15.49:0/4263797492 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a000c1d0 con 0x7f35a0004870 2023-07-21T22:12:23.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b37fe700 1 -- 172.21.15.49:0/4263797492 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a000c390 con 0x7f35a0005290 2023-07-21T22:12:23.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b3fff700 1 --2- 172.21.15.49:0/4263797492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a0003a90 0x7f35a0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:23.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35ab7fe700 1 --2- 172.21.15.49:0/4263797492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35a0004870 0x7f35a0004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:23.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b8906700 1 --2- 172.21.15.49:0/4263797492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35a0005290 0x7f35a000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:23.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b3fff700 1 -- 172.21.15.49:0/4263797492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35a0005290 msgr2=0x7f35a000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:23.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b3fff700 1 --2- 172.21.15.49:0/4263797492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35a0005290 0x7f35a000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b3fff700 1 -- 172.21.15.49:0/4263797492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35a0004870 msgr2=0x7f35a0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:23.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b3fff700 1 --2- 172.21.15.49:0/4263797492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35a0004870 0x7f35a0004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b3fff700 1 -- 172.21.15.49:0/4263797492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00035d0 con 0x7f35a0003a90 2023-07-21T22:12:23.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35ab7fe700 1 --2- 172.21.15.49:0/4263797492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35a0004870 0x7f35a0004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:23.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b8906700 1 --2- 172.21.15.49:0/4263797492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35a0005290 0x7f35a000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:23.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b8906700 1 -- 172.21.15.49:0/4263797492 reap_dead start 2023-07-21T22:12:23.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b3fff700 1 --2- 172.21.15.49:0/4263797492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a0003a90 0x7f35a0003e60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f35a400c2f0 tx=0x7f35a00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80279c24d05c1f0c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:23.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b37fe700 1 -- 172.21.15.49:0/4263797492 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a400ccf0 con 0x7f35a0003a90 2023-07-21T22:12:23.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b37fe700 1 -- 172.21.15.49:0/4263797492 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a400ce50 con 0x7f35a0003a90 2023-07-21T22:12:23.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35b37fe700 1 -- 172.21.15.49:0/4263797492 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4005ba0 con 0x7f35a0003a90 2023-07-21T22:12:23.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35ba369700 1 -- 172.21.15.49:0/4263797492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a0003a90 msgr2=0x7f35a0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:23.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.287+0000 7f35ba369700 1 --2- 172.21.15.49:0/4263797492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a0003a90 0x7f35a0003e60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f35a400c2f0 tx=0x7f35a00058a0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.291+0000 7f35ba369700 1 -- 172.21.15.49:0/4263797492 shutdown_connections 2023-07-21T22:12:23.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.291+0000 7f35ba369700 1 --2- 172.21.15.49:0/4263797492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a0003a90 0x7f35a0003e60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.291+0000 7f35ba369700 1 -- 172.21.15.49:0/4263797492 >> 172.21.15.49:0/4263797492 conn(0x7f35b406f5a0 msgr2=0x7f35b40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:23.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.291+0000 7f35ba369700 1 -- 172.21.15.49:0/4263797492 shutdown_connections 2023-07-21T22:12:23.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.291+0000 7f35ba369700 1 -- 172.21.15.49:0/4263797492 wait complete. 2023-07-21T22:12:23.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.291+0000 7f35ba369700 1 Processor -- start 2023-07-21T22:12:23.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.291+0000 7f35ba369700 1 -- start start 2023-07-21T22:12:23.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35ba369700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a0003a90 0x7f35b40c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:23.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35ba369700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35b4161900 0x7f35b4161d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:23.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35ba369700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b41f1220 0x7f35b41f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:23.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35ba369700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b41622b0 con 0x7f35a0003a90 2023-07-21T22:12:23.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35ba369700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40c40c0 con 0x7f35b41f1220 2023-07-21T22:12:23.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35ba369700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40c43a0 con 0x7f35b4161900 2023-07-21T22:12:23.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35b3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a0003a90 0x7f35b40c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:23.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35b3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a0003a90 0x7f35b40c2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34874/0 (socket says 172.21.15.49:34874) 2023-07-21T22:12:23.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35b3fff700 1 -- 172.21.15.49:0/2686655694 learned_addr learned my addr 172.21.15.49:0/2686655694 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:23.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35b8906700 1 --2- 172.21.15.49:0/2686655694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b41f1220 0x7f35b41f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:23.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35ab7fe700 1 --2- 172.21.15.49:0/2686655694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35b4161900 0x7f35b4161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:23.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35b3fff700 1 -- 172.21.15.49:0/2686655694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35b4161900 msgr2=0x7f35b4161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:23.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35b3fff700 1 --2- 172.21.15.49:0/2686655694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35b4161900 0x7f35b4161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35b3fff700 1 -- 172.21.15.49:0/2686655694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b41f1220 msgr2=0x7f35b41f1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:23.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35b3fff700 1 --2- 172.21.15.49:0/2686655694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b41f1220 0x7f35b41f1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35b3fff700 1 -- 172.21.15.49:0/2686655694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b40c4680 con 0x7f35a0003a90 2023-07-21T22:12:23.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35b3fff700 1 --2- 172.21.15.49:0/2686655694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a0003a90 0x7f35b40c2df0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f35a000c1a0 tx=0x7f35a4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:23.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.295+0000 7f35b17fa700 1 -- 172.21.15.49:0/2686655694 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4004ca0 con 0x7f35a0003a90 2023-07-21T22:12:23.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.299+0000 7f35b17fa700 1 -- 172.21.15.49:0/2686655694 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a4004e20 con 0x7f35a0003a90 2023-07-21T22:12:23.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.299+0000 7f35ba369700 1 -- 172.21.15.49:0/2686655694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b40c4960 con 0x7f35a0003a90 2023-07-21T22:12:23.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.299+0000 7f35b17fa700 1 -- 172.21.15.49:0/2686655694 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4007310 con 0x7f35a0003a90 2023-07-21T22:12:23.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.299+0000 7f35ba369700 1 -- 172.21.15.49:0/2686655694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b41f1bd0 con 0x7f35a0003a90 2023-07-21T22:12:23.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.299+0000 7f35ba369700 1 -- 172.21.15.49:0/2686655694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b4073130 con 0x7f35a0003a90 2023-07-21T22:12:23.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.303+0000 7f35b17fa700 1 -- 172.21.15.49:0/2686655694 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35a4019050 con 0x7f35a0003a90 2023-07-21T22:12:23.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.303+0000 7f35b17fa700 1 --2- 172.21.15.49:0/2686655694 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3594066320 0x7f35940687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:23.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.303+0000 7f35b17fa700 1 -- 172.21.15.49:0/2686655694 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f35a40847e0 con 0x7f35a0003a90 2023-07-21T22:12:23.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.303+0000 7f35ab7fe700 1 --2- 172.21.15.49:0/2686655694 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3594066320 0x7f35940687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:23.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.303+0000 7f35ab7fe700 1 --2- 172.21.15.49:0/2686655694 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3594066320 0x7f35940687d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f359c0014c0 tx=0x7f359c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:23.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.311+0000 7f35b17fa700 1 -- 172.21.15.49:0/2686655694 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35a4051c30 con 0x7f35a0003a90 2023-07-21T22:12:23.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.487+0000 7f35ba369700 1 -- 172.21.15.49:0/2686655694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35b40c4af0 con 0x7f35a0003a90 2023-07-21T22:12:23.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.487+0000 7f35b17fa700 1 -- 172.21.15.49:0/2686655694 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18477 (secure 0 0 0) 0x7f35a4055250 con 0x7f35a0003a90 2023-07-21T22:12:23.535 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:23.535 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":43,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:12:22.057156+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:12:20.014383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T22:12:21.059436+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:12:23.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.491+0000 7f35ba369700 1 -- 172.21.15.49:0/2686655694 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3594066320 msgr2=0x7f35940687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:23.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.491+0000 7f35ba369700 1 --2- 172.21.15.49:0/2686655694 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3594066320 0x7f35940687d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f359c0014c0 tx=0x7f359c009040 comp rx=0 tx=0).stop 2023-07-21T22:12:23.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.491+0000 7f35ba369700 1 -- 172.21.15.49:0/2686655694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a0003a90 msgr2=0x7f35b40c2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:23.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.491+0000 7f35ba369700 1 --2- 172.21.15.49:0/2686655694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a0003a90 0x7f35b40c2df0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f35a000c1a0 tx=0x7f35a4001a00 comp rx=0 tx=0).stop 2023-07-21T22:12:23.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.491+0000 7f35ba369700 1 -- 172.21.15.49:0/2686655694 shutdown_connections 2023-07-21T22:12:23.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.491+0000 7f35ba369700 1 --2- 172.21.15.49:0/2686655694 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3594066320 0x7f35940687d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.491+0000 7f35ba369700 1 --2- 172.21.15.49:0/2686655694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b41f1220 0x7f35b41f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.491+0000 7f35ba369700 1 --2- 172.21.15.49:0/2686655694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35b4161900 0x7f35b4161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.491+0000 7f35ba369700 1 --2- 172.21.15.49:0/2686655694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a0003a90 0x7f35b40c2df0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.491+0000 7f35ba369700 1 -- 172.21.15.49:0/2686655694 >> 172.21.15.49:0/2686655694 conn(0x7f35b406f5a0 msgr2=0x7f35b40afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:23.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.491+0000 7f35ba369700 1 -- 172.21.15.49:0/2686655694 shutdown_connections 2023-07-21T22:12:23.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.491+0000 7f35ba369700 1 -- 172.21.15.49:0/2686655694 wait complete. 2023-07-21T22:12:23.559 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:12:23.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.695+0000 7ff8be7c3700 1 Processor -- start 2023-07-21T22:12:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.695+0000 7ff8be7c3700 1 -- start start 2023-07-21T22:12:23.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.695+0000 7ff8be7c3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8b8159be0 0x7ff8b80c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:23.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.695+0000 7ff8be7c3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8b80698a0 0x7ff8b8069d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:23.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.695+0000 7ff8be7c3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b80c8b80 con 0x7ff8b80ca550 2023-07-21T22:12:23.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.695+0000 7ff8be7c3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b806a260 con 0x7ff8b80698a0 2023-07-21T22:12:23.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.695+0000 7ff8be7c3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b806db90 con 0x7ff8b8159be0 2023-07-21T22:12:23.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8bdfc2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8b80698a0 0x7ff8b8069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:23.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8bdfc2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8b80698a0 0x7ff8b8069d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34886/0 (socket says 172.21.15.49:34886) 2023-07-21T22:12:23.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8bdfc2700 1 -- 172.21.15.49:0/3456158958 learned_addr learned my addr 172.21.15.49:0/3456158958 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:23.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8bd7c1700 1 --2- 172.21.15.49:0/3456158958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8b8159be0 0x7ff8b80c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:23.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8bdfc2700 1 -- 172.21.15.49:0/3456158958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8b8159be0 msgr2=0x7ff8b80c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:23.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8bdfc2700 1 --2- 172.21.15.49:0/3456158958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8b8159be0 0x7ff8b80c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8bdfc2700 1 -- 172.21.15.49:0/3456158958 >> v1:172.21.15.150:6789/0 conn(0x7ff8b80ca550 legacy=0x7ff8b806d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:23.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8bdfc2700 1 -- 172.21.15.49:0/3456158958 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b806de70 con 0x7ff8b80698a0 2023-07-21T22:12:23.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8bdfc2700 1 --2- 172.21.15.49:0/3456158958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8b80698a0 0x7ff8b8069d20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009e50 tx=0x7ff8b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54b5621d4dcc0ec server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:23.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8affff700 1 -- 172.21.15.49:0/3456158958 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000e070 con 0x7ff8b80698a0 2023-07-21T22:12:23.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8affff700 1 -- 172.21.15.49:0/3456158958 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b000b9c0 con 0x7ff8b80698a0 2023-07-21T22:12:23.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8affff700 1 -- 172.21.15.49:0/3456158958 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000bd70 con 0x7ff8b80698a0 2023-07-21T22:12:23.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8be7c3700 1 -- 172.21.15.49:0/3456158958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8b80698a0 msgr2=0x7ff8b8069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:23.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8be7c3700 1 --2- 172.21.15.49:0/3456158958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8b80698a0 0x7ff8b8069d20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009e50 tx=0x7ff8b000b330 comp rx=0 tx=0).stop 2023-07-21T22:12:23.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8be7c3700 1 -- 172.21.15.49:0/3456158958 shutdown_connections 2023-07-21T22:12:23.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8be7c3700 1 --2- 172.21.15.49:0/3456158958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8b80698a0 0x7ff8b8069d20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8be7c3700 1 --2- 172.21.15.49:0/3456158958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8b8159be0 0x7ff8b80c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8be7c3700 1 -- 172.21.15.49:0/3456158958 >> 172.21.15.49:0/3456158958 conn(0x7ff8b80ce0d0 msgr2=0x7ff8b80ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:23.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8be7c3700 1 -- 172.21.15.49:0/3456158958 shutdown_connections 2023-07-21T22:12:23.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.699+0000 7ff8be7c3700 1 -- 172.21.15.49:0/3456158958 wait complete. 2023-07-21T22:12:23.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.703+0000 7ff8be7c3700 1 Processor -- start 2023-07-21T22:12:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.703+0000 7ff8be7c3700 1 -- start start 2023-07-21T22:12:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8be7c3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8b80698a0 0x7ff8b80acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8be7c3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8b80ca550 0x7ff8b8151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8be7c3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8b8159be0 0x7ff8b80b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8be7c3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b80ab8d0 con 0x7ff8b80698a0 2023-07-21T22:12:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8be7c3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b80abbb0 con 0x7ff8b8159be0 2023-07-21T22:12:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8be7c3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b80abe90 con 0x7ff8b80ca550 2023-07-21T22:12:23.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8bd7c1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8b80698a0 0x7ff8b80acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:23.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8bd7c1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8b80698a0 0x7ff8b80acc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34892/0 (socket says 172.21.15.49:34892) 2023-07-21T22:12:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8bd7c1700 1 -- 172.21.15.49:0/1514366315 learned_addr learned my addr 172.21.15.49:0/1514366315 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8bcfc0700 1 --2- 172.21.15.49:0/1514366315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8b80ca550 0x7ff8b8151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8bdfc2700 1 --2- 172.21.15.49:0/1514366315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8b8159be0 0x7ff8b80b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8bd7c1700 1 -- 172.21.15.49:0/1514366315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8b80ca550 msgr2=0x7ff8b8151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8bd7c1700 1 --2- 172.21.15.49:0/1514366315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8b80ca550 0x7ff8b8151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8bd7c1700 1 -- 172.21.15.49:0/1514366315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8b8159be0 msgr2=0x7ff8b80b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8bd7c1700 1 --2- 172.21.15.49:0/1514366315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8b8159be0 0x7ff8b80b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8bd7c1700 1 -- 172.21.15.49:0/1514366315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b0009b30 con 0x7ff8b80698a0 2023-07-21T22:12:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8bd7c1700 1 --2- 172.21.15.49:0/1514366315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8b80698a0 0x7ff8b80acc50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400e760 tx=0x7ff8b400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8adffb700 1 -- 172.21.15.49:0/1514366315 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400c070 con 0x7ff8b80698a0 2023-07-21T22:12:23.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8adffb700 1 -- 172.21.15.49:0/1514366315 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b4013610 con 0x7ff8b80698a0 2023-07-21T22:12:23.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8be7c3700 1 -- 172.21.15.49:0/1514366315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b80ac170 con 0x7ff8b80698a0 2023-07-21T22:12:23.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.707+0000 7ff8adffb700 1 -- 172.21.15.49:0/1514366315 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4013980 con 0x7ff8b80698a0 2023-07-21T22:12:23.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.711+0000 7ff8be7c3700 1 -- 172.21.15.49:0/1514366315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b80ac730 con 0x7ff8b80698a0 2023-07-21T22:12:23.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.711+0000 7ff8be7c3700 1 -- 172.21.15.49:0/1514366315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b80c87f0 con 0x7ff8b80698a0 2023-07-21T22:12:23.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.711+0000 7ff8adffb700 1 -- 172.21.15.49:0/1514366315 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8b4013ae0 con 0x7ff8b80698a0 2023-07-21T22:12:23.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.715+0000 7ff8adffb700 1 --2- 172.21.15.49:0/1514366315 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff89c066320 0x7ff89c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:23.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.715+0000 7ff8adffb700 1 -- 172.21.15.49:0/1514366315 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff8b4083bf0 con 0x7ff8b80698a0 2023-07-21T22:12:23.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.715+0000 7ff8bcfc0700 1 --2- 172.21.15.49:0/1514366315 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff89c066320 0x7ff89c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:23.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.715+0000 7ff8bcfc0700 1 --2- 172.21.15.49:0/1514366315 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff89c066320 0x7ff89c0687d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8158e70 tx=0x7ff8a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.719+0000 7ff8adffb700 1 -- 172.21.15.49:0/1514366315 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8b80c87f0 con 0x7ff8b80698a0 2023-07-21T22:12:23.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:23.935+0000 7ff8be7c3700 1 -- 172.21.15.49:0/1514366315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff8b80c87c0 con 0x7ff8b80698a0 2023-07-21T22:12:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.635+0000 7ff8adffb700 1 -- 172.21.15.49:0/1514366315 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff8b4050e90 con 0x7ff8b80698a0 2023-07-21T22:12:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.639+0000 7ff8be7c3700 1 -- 172.21.15.49:0/1514366315 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff89c066320 msgr2=0x7ff89c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.639+0000 7ff8be7c3700 1 --2- 172.21.15.49:0/1514366315 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff89c066320 0x7ff89c0687d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8158e70 tx=0x7ff8a8009040 comp rx=0 tx=0).stop 2023-07-21T22:12:24.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.639+0000 7ff8be7c3700 1 -- 172.21.15.49:0/1514366315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8b80698a0 msgr2=0x7ff8b80acc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:24.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.639+0000 7ff8be7c3700 1 --2- 172.21.15.49:0/1514366315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8b80698a0 0x7ff8b80acc50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400e760 tx=0x7ff8b400ea70 comp rx=0 tx=0).stop 2023-07-21T22:12:24.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.639+0000 7ff8be7c3700 1 -- 172.21.15.49:0/1514366315 shutdown_connections 2023-07-21T22:12:24.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.639+0000 7ff8be7c3700 1 --2- 172.21.15.49:0/1514366315 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff89c066320 0x7ff89c0687d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.639+0000 7ff8be7c3700 1 --2- 172.21.15.49:0/1514366315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8b8159be0 0x7ff8b80b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.639+0000 7ff8be7c3700 1 --2- 172.21.15.49:0/1514366315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8b80ca550 0x7ff8b8151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.639+0000 7ff8be7c3700 1 --2- 172.21.15.49:0/1514366315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8b80698a0 0x7ff8b80acc50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.639+0000 7ff8be7c3700 1 -- 172.21.15.49:0/1514366315 >> 172.21.15.49:0/1514366315 conn(0x7ff8b80ce0d0 msgr2=0x7ff8b8153f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.639+0000 7ff8be7c3700 1 -- 172.21.15.49:0/1514366315 shutdown_connections 2023-07-21T22:12:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.639+0000 7ff8be7c3700 1 -- 172.21.15.49:0/1514366315 wait complete. 2023-07-21T22:12:24.709 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T22:12:24.709 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T22:12:24.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.851+0000 7f92f9689700 1 Processor -- start 2023-07-21T22:12:24.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.851+0000 7f92f9689700 1 -- start start 2023-07-21T22:12:24.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.851+0000 7f92f9689700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f92f406e960 0x7f92f40b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:24.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.851+0000 7f92f9689700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f40cf040 con 0x7f92f40cb8f0 2023-07-21T22:12:24.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.851+0000 7f92f9689700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f40b5210 con 0x7f92f40ce140 2023-07-21T22:12:24.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.851+0000 7f92f9689700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f40cbf00 con 0x7f92f406e960 2023-07-21T22:12:24.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.855+0000 7f92f2ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f92f406e960 0x7f92f40b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:24.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.855+0000 7f92f37fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f92f40cb8f0 0x7f92f40cc390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49154/0 (socket says 172.21.15.49:49154) 2023-07-21T22:12:24.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.855+0000 7f92f37fe700 1 -- 172.21.15.49:0/3260225136 learned_addr learned my addr 172.21.15.49:0/3260225136 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.855+0000 7f92f1ffb700 1 -- 172.21.15.49:0/3260225136 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 558848246 0 0) 0x7f92f40cf040 con 0x7f92f40cb8f0 2023-07-21T22:12:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.855+0000 7f92f1ffb700 1 -- 172.21.15.49:0/3260225136 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92dc0035d0 con 0x7f92f40cb8f0 2023-07-21T22:12:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.855+0000 7f92f2ffd700 1 -- 172.21.15.49:0/3260225136 >> v1:172.21.15.150:6789/0 conn(0x7f92f40ce140 legacy=0x7f92f406ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.855+0000 7f92f2ffd700 1 -- 172.21.15.49:0/3260225136 >> v1:172.21.15.49:6789/0 conn(0x7f92f40cb8f0 legacy=0x7f92f40cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.855+0000 7f92f2ffd700 1 -- 172.21.15.49:0/3260225136 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f40ce7a0 con 0x7f92f406e960 2023-07-21T22:12:24.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.855+0000 7f92f2ffd700 1 --2- 172.21.15.49:0/3260225136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92f406e960 0x7f92f40b4cd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009850 tx=0x7f92e4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fab2cf9c77f0ec07 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:24.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.855+0000 7f92f1ffb700 1 -- 172.21.15.49:0/3260225136 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4011830 con 0x7f92f406e960 2023-07-21T22:12:24.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.855+0000 7f92f1ffb700 1 -- 172.21.15.49:0/3260225136 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e4011990 con 0x7f92f406e960 2023-07-21T22:12:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.855+0000 7f92f1ffb700 1 -- 172.21.15.49:0/3260225136 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4011d40 con 0x7f92f406e960 2023-07-21T22:12:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.859+0000 7f92f9689700 1 -- 172.21.15.49:0/3260225136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92f406e960 msgr2=0x7f92f40b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.859+0000 7f92f9689700 1 --2- 172.21.15.49:0/3260225136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92f406e960 0x7f92f40b4cd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009850 tx=0x7f92e4009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.859+0000 7f92f9689700 1 -- 172.21.15.49:0/3260225136 shutdown_connections 2023-07-21T22:12:24.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.859+0000 7f92f9689700 1 --2- 172.21.15.49:0/3260225136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92f406e960 0x7f92f40b4cd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:24.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.859+0000 7f92f9689700 1 -- 172.21.15.49:0/3260225136 >> 172.21.15.49:0/3260225136 conn(0x7f92f40b0e30 msgr2=0x7f92f40b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:24.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.859+0000 7f92f9689700 1 -- 172.21.15.49:0/3260225136 shutdown_connections 2023-07-21T22:12:24.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.859+0000 7f92f9689700 1 -- 172.21.15.49:0/3260225136 wait complete. 2023-07-21T22:12:24.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.863+0000 7f92f9689700 1 Processor -- start 2023-07-21T22:12:24.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.863+0000 7f92f9689700 1 -- start start 2023-07-21T22:12:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.863+0000 7f92f9689700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92f406e960 0x7f92f40c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.863+0000 7f92f9689700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f40cb8f0 0x7f92f41f9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.863+0000 7f92f9689700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92f40ce140 0x7f92f41f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.863+0000 7f92f9689700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40c9bb0 con 0x7f92f40cb8f0 2023-07-21T22:12:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.863+0000 7f92f9689700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f406aaa0 con 0x7f92f406e960 2023-07-21T22:12:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.863+0000 7f92f9689700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40c98d0 con 0x7f92f40ce140 2023-07-21T22:12:24.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.863+0000 7f92f27fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f40cb8f0 0x7f92f41f9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:24.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.863+0000 7f92f27fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f40cb8f0 0x7f92f41f9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45834/0 (socket says 172.21.15.49:45834) 2023-07-21T22:12:24.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.863+0000 7f92f27fc700 1 -- 172.21.15.49:0/2728986667 learned_addr learned my addr 172.21.15.49:0/2728986667 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:24.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.863+0000 7f92f37fe700 1 --2- 172.21.15.49:0/2728986667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92f40ce140 0x7f92f41f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:24.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.863+0000 7f92f2ffd700 1 --2- 172.21.15.49:0/2728986667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92f406e960 0x7f92f40c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:24.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.867+0000 7f92f27fc700 1 -- 172.21.15.49:0/2728986667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92f40ce140 msgr2=0x7f92f41f97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:24.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.867+0000 7f92f27fc700 1 --2- 172.21.15.49:0/2728986667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92f40ce140 0x7f92f41f97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:24.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.867+0000 7f92f27fc700 1 -- 172.21.15.49:0/2728986667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92f406e960 msgr2=0x7f92f40c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:24.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.867+0000 7f92f27fc700 1 --2- 172.21.15.49:0/2728986667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92f406e960 0x7f92f40c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:24.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.867+0000 7f92f27fc700 1 -- 172.21.15.49:0/2728986667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e40094b0 con 0x7f92f40cb8f0 2023-07-21T22:12:24.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.867+0000 7f92f27fc700 1 --2- 172.21.15.49:0/2728986667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f40cb8f0 0x7f92f41f9280 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f92e800c500 tx=0x7f92e800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:24.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.867+0000 7f92db7fe700 1 -- 172.21.15.49:0/2728986667 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e80052d0 con 0x7f92f40cb8f0 2023-07-21T22:12:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.867+0000 7f92db7fe700 1 -- 172.21.15.49:0/2728986667 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e8005430 con 0x7f92f40cb8f0 2023-07-21T22:12:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.867+0000 7f92db7fe700 1 -- 172.21.15.49:0/2728986667 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e80055a0 con 0x7f92f40cb8f0 2023-07-21T22:12:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.867+0000 7f92f9689700 1 -- 172.21.15.49:0/2728986667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f406a450 con 0x7f92f40cb8f0 2023-07-21T22:12:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.867+0000 7f92f9689700 1 -- 172.21.15.49:0/2728986667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f40c7f20 con 0x7f92f40cb8f0 2023-07-21T22:12:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.867+0000 7f92f9689700 1 -- 172.21.15.49:0/2728986667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f406a2b0 con 0x7f92f40cb8f0 2023-07-21T22:12:24.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.871+0000 7f92db7fe700 1 -- 172.21.15.49:0/2728986667 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92e80038e0 con 0x7f92f40cb8f0 2023-07-21T22:12:24.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.871+0000 7f92db7fe700 1 --2- 172.21.15.49:0/2728986667 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f92e00662f0 0x7f92e00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:24.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.871+0000 7f92db7fe700 1 -- 172.21.15.49:0/2728986667 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f92e8083070 con 0x7f92f40cb8f0 2023-07-21T22:12:24.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.871+0000 7f92f2ffd700 1 --2- 172.21.15.49:0/2728986667 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f92e00662f0 0x7f92e00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:24.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.875+0000 7f92f2ffd700 1 --2- 172.21.15.49:0/2728986667 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f92e00662f0 0x7f92e00687a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f92e40090b0 tx=0x7f92e4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:24.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:24.879+0000 7f92db7fe700 1 -- 172.21.15.49:0/2728986667 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92e80b3700 con 0x7f92f40cb8f0 2023-07-21T22:12:25.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.091+0000 7f92f9689700 1 -- 172.21.15.49:0/2728986667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f92f406ac50 con 0x7f92f40cb8f0 2023-07-21T22:12:25.597 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-07-21T22:12:25.555+0000 7faab34c7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:12:25.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.647+0000 7f92db7fe700 1 -- 172.21.15.49:0/2728986667 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f92f406ac50 con 0x7f92f40cb8f0 2023-07-21T22:12:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.651+0000 7f92f9689700 1 -- 172.21.15.49:0/2728986667 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f92e00662f0 msgr2=0x7f92e00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:25.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.651+0000 7f92f9689700 1 --2- 172.21.15.49:0/2728986667 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f92e00662f0 0x7f92e00687a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f92e40090b0 tx=0x7f92e4008030 comp rx=0 tx=0).stop 2023-07-21T22:12:25.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.651+0000 7f92f9689700 1 -- 172.21.15.49:0/2728986667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f40cb8f0 msgr2=0x7f92f41f9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:25.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.651+0000 7f92f9689700 1 --2- 172.21.15.49:0/2728986667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f40cb8f0 0x7f92f41f9280 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f92e800c500 tx=0x7f92e800c810 comp rx=0 tx=0).stop 2023-07-21T22:12:25.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.651+0000 7f92f9689700 1 -- 172.21.15.49:0/2728986667 shutdown_connections 2023-07-21T22:12:25.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.655+0000 7f92f9689700 1 --2- 172.21.15.49:0/2728986667 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f92e00662f0 0x7f92e00687a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:25.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.655+0000 7f92f9689700 1 --2- 172.21.15.49:0/2728986667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f40cb8f0 0x7f92f41f9280 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:25.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.655+0000 7f92f9689700 1 --2- 172.21.15.49:0/2728986667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92f40ce140 0x7f92f41f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:25.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.655+0000 7f92f9689700 1 --2- 172.21.15.49:0/2728986667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92f406e960 0x7f92f40c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:25.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.655+0000 7f92f9689700 1 -- 172.21.15.49:0/2728986667 >> 172.21.15.49:0/2728986667 conn(0x7f92f40b0e30 msgr2=0x7f92f40cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:25.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.655+0000 7f92f9689700 1 -- 172.21.15.49:0/2728986667 shutdown_connections 2023-07-21T22:12:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.655+0000 7f92f9689700 1 -- 172.21.15.49:0/2728986667 wait complete. 2023-07-21T22:12:25.723 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T22:12:25.723 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:12:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.855+0000 7febac964700 1 Processor -- start 2023-07-21T22:12:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.855+0000 7febac964700 1 -- start start 2023-07-21T22:12:25.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7febac964700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feba815bf30 0x7feba80ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:25.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7febac964700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feba80b0200 0x7feba80ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:25.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7febac964700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba80cb270 con 0x7feba80cbc40 2023-07-21T22:12:25.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7febac964700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba815c300 con 0x7feba80b0200 2023-07-21T22:12:25.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7febac964700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba80acac0 con 0x7feba815bf30 2023-07-21T22:12:25.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7feba759e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feba80b0200 0x7feba80ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:25.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7feba759e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feba80b0200 0x7feba80ab8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45836/0 (socket says 172.21.15.49:45836) 2023-07-21T22:12:25.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7feba759e700 1 -- 172.21.15.49:0/1057392858 learned_addr learned my addr 172.21.15.49:0/1057392858 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:25.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7feb9ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feba80cbc40 0x7feba80afaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49166/0 (socket says 172.21.15.49:49166) 2023-07-21T22:12:25.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7feba6d9d700 1 --2- 172.21.15.49:0/1057392858 >> v2:172.21.15.150:3300/0 conn(0x7feba815bf30 0x7feba80ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:25.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7feba759e700 1 -- 172.21.15.49:0/1057392858 >> v2:172.21.15.150:3300/0 conn(0x7feba815bf30 msgr2=0x7feba80ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:25.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7feba759e700 1 --2- 172.21.15.49:0/1057392858 >> v2:172.21.15.150:3300/0 conn(0x7feba815bf30 0x7feba80ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:25.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7feba759e700 1 -- 172.21.15.49:0/1057392858 >> v1:172.21.15.49:6789/0 conn(0x7feba80cbc40 legacy=0x7feba80afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:25.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7feba759e700 1 -- 172.21.15.49:0/1057392858 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba806f740 con 0x7feba80b0200 2023-07-21T22:12:25.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7feba759e700 1 --2- 172.21.15.49:0/1057392858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feba80b0200 0x7feba80ab8d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7feba80cbbc0 tx=0x7feba0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3f499f22fc8fe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:25.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7feba659c700 1 -- 172.21.15.49:0/1057392858 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba000b8a0 con 0x7feba80b0200 2023-07-21T22:12:25.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7feba659c700 1 -- 172.21.15.49:0/1057392858 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba000ba00 con 0x7feba80b0200 2023-07-21T22:12:25.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7feba659c700 1 -- 172.21.15.49:0/1057392858 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba000bd90 con 0x7feba80b0200 2023-07-21T22:12:25.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7febac964700 1 -- 172.21.15.49:0/1057392858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feba80b0200 msgr2=0x7feba80ab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:25.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7febac964700 1 --2- 172.21.15.49:0/1057392858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feba80b0200 0x7feba80ab8d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7feba80cbbc0 tx=0x7feba0009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:25.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7febac964700 1 -- 172.21.15.49:0/1057392858 shutdown_connections 2023-07-21T22:12:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7febac964700 1 --2- 172.21.15.49:0/1057392858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feba80b0200 0x7feba80ab8d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7febac964700 1 --2- 172.21.15.49:0/1057392858 >> v2:172.21.15.150:3300/0 conn(0x7feba815bf30 0x7feba80ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.859+0000 7febac964700 1 -- 172.21.15.49:0/1057392858 >> 172.21.15.49:0/1057392858 conn(0x7feba8070450 msgr2=0x7feba8070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.863+0000 7febac964700 1 -- 172.21.15.49:0/1057392858 shutdown_connections 2023-07-21T22:12:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.863+0000 7febac964700 1 -- 172.21.15.49:0/1057392858 wait complete. 2023-07-21T22:12:25.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.863+0000 7febac964700 1 Processor -- start 2023-07-21T22:12:25.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.863+0000 7febac964700 1 -- start start 2023-07-21T22:12:25.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.863+0000 7febac964700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feba80b0200 0x7feba80c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:25.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.863+0000 7febac964700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feba80cbc40 0x7feba806cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:25.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.863+0000 7febac964700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba815bf30 0x7feba8145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:25.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.863+0000 7febac964700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba80c3000 con 0x7feba80b0200 2023-07-21T22:12:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.863+0000 7febac964700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba80c20e0 con 0x7feba815bf30 2023-07-21T22:12:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.863+0000 7febac964700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba80c2380 con 0x7feba80cbc40 2023-07-21T22:12:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7feba6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feba80b0200 0x7feba80c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7feba6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feba80b0200 0x7feba80c1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45842/0 (socket says 172.21.15.49:45842) 2023-07-21T22:12:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7feba6d9d700 1 -- 172.21.15.49:0/1812816527 learned_addr learned my addr 172.21.15.49:0/1812816527 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7feba759e700 1 --2- 172.21.15.49:0/1812816527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba815bf30 0x7feba8145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7feb9ffff700 1 --2- 172.21.15.49:0/1812816527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feba80cbc40 0x7feba806cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7feba6d9d700 1 -- 172.21.15.49:0/1812816527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feba80cbc40 msgr2=0x7feba806cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7feba6d9d700 1 --2- 172.21.15.49:0/1812816527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feba80cbc40 0x7feba806cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7feba6d9d700 1 -- 172.21.15.49:0/1812816527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba815bf30 msgr2=0x7feba8145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7feba6d9d700 1 --2- 172.21.15.49:0/1812816527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba815bf30 0x7feba8145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7feba6d9d700 1 -- 172.21.15.49:0/1812816527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba0009570 con 0x7feba80b0200 2023-07-21T22:12:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7feba6d9d700 1 --2- 172.21.15.49:0/1812816527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feba80b0200 0x7feba80c1ba0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7feb98007ef0 tx=0x7feb9800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7feb9f7fe700 1 -- 172.21.15.49:0/1812816527 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800edf0 con 0x7feba80b0200 2023-07-21T22:12:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7febac964700 1 -- 172.21.15.49:0/1812816527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba80c2660 con 0x7feba80b0200 2023-07-21T22:12:25.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7feb9f7fe700 1 -- 172.21.15.49:0/1812816527 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb98014420 con 0x7feba80b0200 2023-07-21T22:12:25.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7feb9f7fe700 1 -- 172.21.15.49:0/1812816527 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980147d0 con 0x7feba80b0200 2023-07-21T22:12:25.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.867+0000 7febac964700 1 -- 172.21.15.49:0/1812816527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba80c2c20 con 0x7feba80b0200 2023-07-21T22:12:25.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.871+0000 7febac964700 1 -- 172.21.15.49:0/1812816527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba8151ee0 con 0x7feba80b0200 2023-07-21T22:12:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.871+0000 7feb9f7fe700 1 -- 172.21.15.49:0/1812816527 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feb98014930 con 0x7feba80b0200 2023-07-21T22:12:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.871+0000 7feb9f7fe700 1 --2- 172.21.15.49:0/1812816527 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb880662f0 0x7feb880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.871+0000 7feb9f7fe700 1 -- 172.21.15.49:0/1812816527 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7feb98084570 con 0x7feba80b0200 2023-07-21T22:12:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.871+0000 7feb9ffff700 1 --2- 172.21.15.49:0/1812816527 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb880662f0 0x7feb880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:25.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.871+0000 7feb9ffff700 1 --2- 172.21.15.49:0/1812816527 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb880662f0 0x7feb880687a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feba81f5280 tx=0x7feb90007f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:25.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:25.875+0000 7feb9f7fe700 1 -- 172.21.15.49:0/1812816527 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb980518a0 con 0x7feba80b0200 2023-07-21T22:12:26.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.091+0000 7febac964700 1 -- 172.21.15.49:0/1812816527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feba804dcb0 con 0x7feba80b0200 2023-07-21T22:12:26.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.091+0000 7feb9f7fe700 1 -- 172.21.15.49:0/1812816527 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4677 (secure 0 0 0) 0x7feb98054ec0 con 0x7feba80b0200 2023-07-21T22:12:26.138 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:26.139 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2563650108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2563650108},{"type":"v1","addr":"172.21.15.49:6835","nonce":2563650108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2639704311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2639704311},{"type":"v1","addr":"172.21.15.150:6833","nonce":2639704311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1930443415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1930443415},{"type":"v1","addr":"172.21.15.150:6835","nonce":1930443415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:12:22.057988+0000","modified":"2023-07-21T22:12:25.638925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5631":{"gid":5631,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/3511065368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3511065368},{"type":"v1","addr":"172.21.15.49:6837","nonce":3511065368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T22:12:26.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.095+0000 7febac964700 1 -- 172.21.15.49:0/1812816527 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb880662f0 msgr2=0x7feb880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:26.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.095+0000 7febac964700 1 --2- 172.21.15.49:0/1812816527 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb880662f0 0x7feb880687a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feba81f5280 tx=0x7feb90007f30 comp rx=0 tx=0).stop 2023-07-21T22:12:26.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.095+0000 7febac964700 1 -- 172.21.15.49:0/1812816527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feba80b0200 msgr2=0x7feba80c1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:26.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.095+0000 7febac964700 1 --2- 172.21.15.49:0/1812816527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feba80b0200 0x7feba80c1ba0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7feb98007ef0 tx=0x7feb9800e3c0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.095+0000 7febac964700 1 -- 172.21.15.49:0/1812816527 shutdown_connections 2023-07-21T22:12:26.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.095+0000 7febac964700 1 --2- 172.21.15.49:0/1812816527 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb880662f0 0x7feb880687a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.095+0000 7febac964700 1 --2- 172.21.15.49:0/1812816527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba815bf30 0x7feba8145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.095+0000 7febac964700 1 --2- 172.21.15.49:0/1812816527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feba80cbc40 0x7feba806cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.095+0000 7febac964700 1 --2- 172.21.15.49:0/1812816527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feba80b0200 0x7feba80c1ba0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.095+0000 7febac964700 1 -- 172.21.15.49:0/1812816527 >> 172.21.15.49:0/1812816527 conn(0x7feba8070450 msgr2=0x7feba815a430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:26.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.099+0000 7febac964700 1 -- 172.21.15.49:0/1812816527 shutdown_connections 2023-07-21T22:12:26.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.099+0000 7febac964700 1 -- 172.21.15.49:0/1812816527 wait complete. 2023-07-21T22:12:26.146 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 17 2023-07-21T22:12:26.165 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:12:26.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.295+0000 7f65fb59e700 1 Processor -- start 2023-07-21T22:12:26.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.295+0000 7f65fb59e700 1 -- start start 2023-07-21T22:12:26.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65fb59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f65fc06d380 0x7f65fc06d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65fb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65fc0cafb0 0x7f65fc0cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65fb59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65fc0cab20 con 0x7f65fc071c70 2023-07-21T22:12:26.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65fb59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65fc0c9e80 con 0x7f65fc06d380 2023-07-21T22:12:26.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65fb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc0afeb0 con 0x7f65fc0cafb0 2023-07-21T22:12:26.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65f1d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f65fc071c70 0x7f65fc0b0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49176/0 (socket says 172.21.15.49:49176) 2023-07-21T22:12:26.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65f1d9b700 1 -- 172.21.15.49:0/3354669297 learned_addr learned my addr 172.21.15.49:0/3354669297 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:26.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65fa59c700 1 --2- 172.21.15.49:0/3354669297 >> v2:172.21.15.150:3300/0 conn(0x7f65fc06d380 0x7f65fc06d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65fad9d700 1 --2- 172.21.15.49:0/3354669297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65fc0cafb0 0x7f65fc0cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65f9d9b700 1 -- 172.21.15.49:0/3354669297 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945060470 0 0) 0x7f65fc0cab20 con 0x7f65fc071c70 2023-07-21T22:12:26.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65f9d9b700 1 -- 172.21.15.49:0/3354669297 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65e80035d0 con 0x7f65fc071c70 2023-07-21T22:12:26.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65fa59c700 1 -- 172.21.15.49:0/3354669297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65fc0cafb0 msgr2=0x7f65fc0cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:26.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65fa59c700 1 --2- 172.21.15.49:0/3354669297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65fc0cafb0 0x7f65fc0cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65fa59c700 1 -- 172.21.15.49:0/3354669297 >> v1:172.21.15.49:6789/0 conn(0x7f65fc071c70 legacy=0x7f65fc0b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:26.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.299+0000 7f65fa59c700 1 -- 172.21.15.49:0/3354669297 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc06dc90 con 0x7f65fc06d380 2023-07-21T22:12:26.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.303+0000 7f65fa59c700 1 --2- 172.21.15.49:0/3354669297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65fc06d380 0x7f65fc06d750 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009880 tx=0x7f65ec009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a318634e9ff4d6f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:26.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.303+0000 7f65f9d9b700 1 -- 172.21.15.49:0/3354669297 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec011830 con 0x7f65fc06d380 2023-07-21T22:12:26.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.303+0000 7f65f9d9b700 1 -- 172.21.15.49:0/3354669297 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec011990 con 0x7f65fc06d380 2023-07-21T22:12:26.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.303+0000 7f65f9d9b700 1 -- 172.21.15.49:0/3354669297 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec011d20 con 0x7f65fc06d380 2023-07-21T22:12:26.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.303+0000 7f65fb59e700 1 -- 172.21.15.49:0/3354669297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65fc06d380 msgr2=0x7f65fc06d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:26.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.303+0000 7f65fb59e700 1 --2- 172.21.15.49:0/3354669297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65fc06d380 0x7f65fc06d750 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009880 tx=0x7f65ec009b90 comp rx=0 tx=0).stop 2023-07-21T22:12:26.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.303+0000 7f65fb59e700 1 -- 172.21.15.49:0/3354669297 shutdown_connections 2023-07-21T22:12:26.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.303+0000 7f65fb59e700 1 --2- 172.21.15.49:0/3354669297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65fc0cafb0 0x7f65fc0cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.303+0000 7f65fb59e700 1 --2- 172.21.15.49:0/3354669297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65fc06d380 0x7f65fc06d750 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.303+0000 7f65fb59e700 1 -- 172.21.15.49:0/3354669297 >> 172.21.15.49:0/3354669297 conn(0x7f65fc070450 msgr2=0x7f65fc070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:26.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.303+0000 7f65fb59e700 1 -- 172.21.15.49:0/3354669297 shutdown_connections 2023-07-21T22:12:26.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.303+0000 7f65fb59e700 1 -- 172.21.15.49:0/3354669297 wait complete. 2023-07-21T22:12:26.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.307+0000 7f65fb59e700 1 Processor -- start 2023-07-21T22:12:26.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.307+0000 7f65fb59e700 1 -- start start 2023-07-21T22:12:26.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fb59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65fc06d380 0x7f65fc0c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65fc071c70 0x7f65fc151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fb59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65fc0cafb0 0x7f65fc0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fb59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc0c4a20 con 0x7f65fc0cafb0 2023-07-21T22:12:26.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fb59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc0c4740 con 0x7f65fc06d380 2023-07-21T22:12:26.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc0c1d20 con 0x7f65fc071c70 2023-07-21T22:12:26.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65fc0cafb0 0x7f65fc0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65fc0cafb0 0x7f65fc0c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45856/0 (socket says 172.21.15.49:45856) 2023-07-21T22:12:26.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fad9d700 1 -- 172.21.15.49:0/3186519316 learned_addr learned my addr 172.21.15.49:0/3186519316 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:26.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65f1d9b700 1 --2- 172.21.15.49:0/3186519316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65fc071c70 0x7f65fc151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fa59c700 1 --2- 172.21.15.49:0/3186519316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65fc06d380 0x7f65fc0c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fad9d700 1 -- 172.21.15.49:0/3186519316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65fc071c70 msgr2=0x7f65fc151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:26.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fad9d700 1 --2- 172.21.15.49:0/3186519316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65fc071c70 0x7f65fc151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fad9d700 1 -- 172.21.15.49:0/3186519316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65fc06d380 msgr2=0x7f65fc0c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:26.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fad9d700 1 --2- 172.21.15.49:0/3186519316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65fc06d380 0x7f65fc0c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fad9d700 1 -- 172.21.15.49:0/3186519316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec0094b0 con 0x7f65fc0cafb0 2023-07-21T22:12:26.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fad9d700 1 --2- 172.21.15.49:0/3186519316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65fc0cafb0 0x7f65fc0c2800 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f65f400efc0 tx=0x7f65f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:26.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65f37fe700 1 -- 172.21.15.49:0/3186519316 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4009ea0 con 0x7f65fc0cafb0 2023-07-21T22:12:26.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65f37fe700 1 -- 172.21.15.49:0/3186519316 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f400f040 con 0x7f65fc0cafb0 2023-07-21T22:12:26.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fb59e700 1 -- 172.21.15.49:0/3186519316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65fc0c2000 con 0x7f65fc0cafb0 2023-07-21T22:12:26.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65f37fe700 1 -- 172.21.15.49:0/3186519316 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f400ced0 con 0x7f65fc0cafb0 2023-07-21T22:12:26.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.311+0000 7f65fb59e700 1 -- 172.21.15.49:0/3186519316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65fc151a20 con 0x7f65fc0cafb0 2023-07-21T22:12:26.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.315+0000 7f65fb59e700 1 -- 172.21.15.49:0/3186519316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65fc0c2520 con 0x7f65fc0cafb0 2023-07-21T22:12:26.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.315+0000 7f65f37fe700 1 -- 172.21.15.49:0/3186519316 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f65f4014480 con 0x7f65fc0cafb0 2023-07-21T22:12:26.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.315+0000 7f65f37fe700 1 --2- 172.21.15.49:0/3186519316 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65dc0662f0 0x7f65dc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.315+0000 7f65f37fe700 1 -- 172.21.15.49:0/3186519316 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f65f4084640 con 0x7f65fc0cafb0 2023-07-21T22:12:26.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.315+0000 7f65fa59c700 1 --2- 172.21.15.49:0/3186519316 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65dc0662f0 0x7f65dc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.319+0000 7f65fa59c700 1 --2- 172.21.15.49:0/3186519316 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65dc0662f0 0x7f65dc0687a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0090b0 tx=0x7f65ec008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:26.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.319+0000 7f65f37fe700 1 -- 172.21.15.49:0/3186519316 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65fc0c2520 con 0x7f65fc0cafb0 2023-07-21T22:12:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.495+0000 7f65fb59e700 1 -- 172.21.15.49:0/3186519316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65fc0c2520 con 0x7f65fc0cafb0 2023-07-21T22:12:26.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.499+0000 7f65f37fe700 1 -- 172.21.15.49:0/3186519316 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18464 (secure 0 0 0) 0x7f65fc0c2520 con 0x7f65fc0cafb0 2023-07-21T22:12:26.545 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:26.545 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":44,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:12:23.612779+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:12:20.014383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T22:12:21.059436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:12:26.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.503+0000 7f65fb59e700 1 -- 172.21.15.49:0/3186519316 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65dc0662f0 msgr2=0x7f65dc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:26.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.503+0000 7f65fb59e700 1 --2- 172.21.15.49:0/3186519316 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65dc0662f0 0x7f65dc0687a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0090b0 tx=0x7f65ec008030 comp rx=0 tx=0).stop 2023-07-21T22:12:26.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.503+0000 7f65fb59e700 1 -- 172.21.15.49:0/3186519316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65fc0cafb0 msgr2=0x7f65fc0c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:26.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.503+0000 7f65fb59e700 1 --2- 172.21.15.49:0/3186519316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65fc0cafb0 0x7f65fc0c2800 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f65f400efc0 tx=0x7f65f400c3a0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.503+0000 7f65fb59e700 1 -- 172.21.15.49:0/3186519316 shutdown_connections 2023-07-21T22:12:26.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.503+0000 7f65fb59e700 1 --2- 172.21.15.49:0/3186519316 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65dc0662f0 0x7f65dc0687a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.503+0000 7f65fb59e700 1 --2- 172.21.15.49:0/3186519316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65fc0cafb0 0x7f65fc0c2800 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.503+0000 7f65fb59e700 1 --2- 172.21.15.49:0/3186519316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65fc071c70 0x7f65fc151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.503+0000 7f65fb59e700 1 --2- 172.21.15.49:0/3186519316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65fc06d380 0x7f65fc0c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.503+0000 7f65fb59e700 1 -- 172.21.15.49:0/3186519316 >> 172.21.15.49:0/3186519316 conn(0x7f65fc070450 msgr2=0x7f65fc0b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:26.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.503+0000 7f65fb59e700 1 -- 172.21.15.49:0/3186519316 shutdown_connections 2023-07-21T22:12:26.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.503+0000 7f65fb59e700 1 -- 172.21.15.49:0/3186519316 wait complete. 2023-07-21T22:12:26.572 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:12:26.573 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:12:26.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.707+0000 7f2742edc700 1 Processor -- start 2023-07-21T22:12:26.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.707+0000 7f2742edc700 1 -- start start 2023-07-21T22:12:26.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.707+0000 7f2742edc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f273c0b7af0 0x7f273c0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.707+0000 7f2742edc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f273c0cee10 0x7f273c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.707+0000 7f2742edc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c0b3e80 con 0x7f273c0d1e40 2023-07-21T22:12:26.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.707+0000 7f2742edc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273c0cf7d0 con 0x7f273c0b7af0 2023-07-21T22:12:26.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.707+0000 7f2742edc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c15fd40 con 0x7f273c0cee10 2023-07-21T22:12:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.707+0000 7f27416d9700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f273c0d1e40 0x7f273c15f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49190/0 (socket says 172.21.15.49:49190) 2023-07-21T22:12:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.707+0000 7f27416d9700 1 -- 172.21.15.49:0/1852708641 learned_addr learned my addr 172.21.15.49:0/1852708641 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f27426db700 1 --2- 172.21.15.49:0/1852708641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f273c0cee10 0x7f273c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2741eda700 1 --2- 172.21.15.49:0/1852708641 >> v2:172.21.15.150:3300/0 conn(0x7f273c0b7af0 0x7f273c0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 -- 172.21.15.49:0/1852708641 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649927011 0 0) 0x7f273c0b3e80 con 0x7f273c0d1e40 2023-07-21T22:12:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 -- 172.21.15.49:0/1852708641 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27280035d0 con 0x7f273c0d1e40 2023-07-21T22:12:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 -- 172.21.15.49:0/1852708641 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2369895162 0 0) 0x7f27280035d0 con 0x7f273c0d1e40 2023-07-21T22:12:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 -- 172.21.15.49:0/1852708641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f273c0cee10 msgr2=0x7f273c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 --2- 172.21.15.49:0/1852708641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f273c0cee10 0x7f273c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 -- 172.21.15.49:0/1852708641 >> v2:172.21.15.150:3300/0 conn(0x7f273c0b7af0 msgr2=0x7f273c0b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 --2- 172.21.15.49:0/1852708641 >> v2:172.21.15.150:3300/0 conn(0x7f273c0b7af0 0x7f273c0b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 -- 172.21.15.49:0/1852708641 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c0cea00 con 0x7f273c0d1e40 2023-07-21T22:12:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 -- 172.21.15.49:0/1852708641 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f272c001670 con 0x7f273c0d1e40 2023-07-21T22:12:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2741eda700 1 --2- 172.21.15.49:0/1852708641 >> v2:172.21.15.150:3300/0 conn(0x7f273c0b7af0 0x7f273c0b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 -- 172.21.15.49:0/1852708641 >> v1:172.21.15.49:6789/0 conn(0x7f273c0d1e40 legacy=0x7f273c15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 --2- 172.21.15.49:0/1852708641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f273c0cee10 0x7f2728003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 --2- 172.21.15.49:0/1852708641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2728003fa0 0x7f2728004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 --2- 172.21.15.49:0/1852708641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2728004db0 0x7f2728005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 -- 172.21.15.49:0/1852708641 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0cf7d0 con 0x7f2728004db0 2023-07-21T22:12:26.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 -- 172.21.15.49:0/1852708641 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c15fd40 con 0x7f2728003fa0 2023-07-21T22:12:26.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 -- 172.21.15.49:0/1852708641 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272800ba30 con 0x7f273c0cee10 2023-07-21T22:12:26.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f27426db700 1 --2- 172.21.15.49:0/1852708641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2728004db0 0x7f2728005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2741eda700 1 --2- 172.21.15.49:0/1852708641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f273c0cee10 0x7f2728003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f27416d9700 1 --2- 172.21.15.49:0/1852708641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2728003fa0 0x7f2728004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f27426db700 1 -- 172.21.15.49:0/1852708641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f273c0cee10 msgr2=0x7f2728003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:26.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f27426db700 1 --2- 172.21.15.49:0/1852708641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f273c0cee10 0x7f2728003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f27426db700 1 -- 172.21.15.49:0/1852708641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2728003fa0 msgr2=0x7f2728004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:26.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f27426db700 1 --2- 172.21.15.49:0/1852708641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2728003fa0 0x7f2728004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f27426db700 1 -- 172.21.15.49:0/1852708641 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27280035d0 con 0x7f2728004db0 2023-07-21T22:12:26.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f27426db700 1 --2- 172.21.15.49:0/1852708641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2728004db0 0x7f2728005220 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2734009fc0 tx=0x7f27280058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4633ea1cdc07b96 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:26.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 -- 172.21.15.49:0/1852708641 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273400ec30 con 0x7f2728004db0 2023-07-21T22:12:26.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 -- 172.21.15.49:0/1852708641 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273400f040 con 0x7f2728004db0 2023-07-21T22:12:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.711+0000 7f2740ed8700 1 -- 172.21.15.49:0/1852708641 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734014480 con 0x7f2728004db0 2023-07-21T22:12:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.715+0000 7f2742edc700 1 -- 172.21.15.49:0/1852708641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2728004db0 msgr2=0x7f2728005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.715+0000 7f2742edc700 1 --2- 172.21.15.49:0/1852708641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2728004db0 0x7f2728005220 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2734009fc0 tx=0x7f27280058a0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.715+0000 7f27426db700 1 -- 172.21.15.49:0/1852708641 reap_dead start 2023-07-21T22:12:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.715+0000 7f2742edc700 1 -- 172.21.15.49:0/1852708641 shutdown_connections 2023-07-21T22:12:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.715+0000 7f2742edc700 1 -- 172.21.15.49:0/1852708641 >> 172.21.15.49:0/1852708641 conn(0x7f273c06e960 msgr2=0x7f273c06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.715+0000 7f2742edc700 1 -- 172.21.15.49:0/1852708641 shutdown_connections 2023-07-21T22:12:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.715+0000 7f2742edc700 1 -- 172.21.15.49:0/1852708641 wait complete. 2023-07-21T22:12:26.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.715+0000 7f2742edc700 1 Processor -- start 2023-07-21T22:12:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2742edc700 1 -- start start 2023-07-21T22:12:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2742edc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2728004db0 0x7f273c0b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2742edc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f273c15eba0 0x7f273c157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2742edc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f273c0cac10 0x7f273c0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2742edc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0c6f80 con 0x7f2728004db0 2023-07-21T22:12:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2742edc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0cb5c0 con 0x7f273c15eba0 2023-07-21T22:12:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2742edc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0c9ee0 con 0x7f273c0cac10 2023-07-21T22:12:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2741eda700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2728004db0 0x7f273c0b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2741eda700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2728004db0 0x7f273c0b47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45866/0 (socket says 172.21.15.49:45866) 2023-07-21T22:12:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2741eda700 1 -- 172.21.15.49:0/654270853 learned_addr learned my addr 172.21.15.49:0/654270853 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f27416d9700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f273c15eba0 0x7f273c157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f27426db700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f273c0cac10 0x7f273c0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2741eda700 1 -- 172.21.15.49:0/654270853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f273c0cac10 msgr2=0x7f273c0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:26.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2741eda700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f273c0cac10 0x7f273c0cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2741eda700 1 -- 172.21.15.49:0/654270853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f273c15eba0 msgr2=0x7f273c157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2741eda700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f273c15eba0 0x7f273c157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2741eda700 1 -- 172.21.15.49:0/654270853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c0ca130 con 0x7f2728004db0 2023-07-21T22:12:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f27426db700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f273c0cac10 0x7f273c0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2741eda700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2728004db0 0x7f273c0b47b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2738011d30 tx=0x7f273800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f27327fc700 1 -- 172.21.15.49:0/654270853 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800fb30 con 0x7f2728004db0 2023-07-21T22:12:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2742edc700 1 -- 172.21.15.49:0/654270853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c0ca410 con 0x7f2728004db0 2023-07-21T22:12:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f27327fc700 1 -- 172.21.15.49:0/654270853 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273800fc90 con 0x7f2728004db0 2023-07-21T22:12:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f27327fc700 1 -- 172.21.15.49:0/654270853 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738014440 con 0x7f2728004db0 2023-07-21T22:12:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.719+0000 7f2742edc700 1 -- 172.21.15.49:0/654270853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c0c7190 con 0x7f2728004db0 2023-07-21T22:12:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.723+0000 7f2742edc700 1 -- 172.21.15.49:0/654270853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273c0b3e50 con 0x7f2728004db0 2023-07-21T22:12:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.723+0000 7f27327fc700 1 -- 172.21.15.49:0/654270853 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27380145a0 con 0x7f2728004db0 2023-07-21T22:12:26.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.727+0000 7f27327fc700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2720066320 0x7f27200687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.727+0000 7f27327fc700 1 -- 172.21.15.49:0/654270853 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2738084810 con 0x7f2728004db0 2023-07-21T22:12:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.727+0000 7f27416d9700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2720066320 0x7f27200687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.727+0000 7f27416d9700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2720066320 0x7f27200687d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f273c0b6fe0 tx=0x7f272c0079a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:26.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.731+0000 7f27327fc700 1 -- 172.21.15.49:0/654270853 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2738051a30 con 0x7f2728004db0 2023-07-21T22:12:26.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.903+0000 7f2742edc700 1 -- 172.21.15.49:0/654270853 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f273c0ca930 con 0x7f2720066320 2023-07-21T22:12:26.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.915+0000 7f27327fc700 1 -- 172.21.15.49:0/654270853 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297531 (secure 0 0 0) 0x7f273c0ca930 con 0x7f2720066320 2023-07-21T22:12:26.965 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:26.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.923+0000 7f2742edc700 1 -- 172.21.15.49:0/654270853 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2720066320 msgr2=0x7f27200687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:26.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.923+0000 7f2742edc700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2720066320 0x7f27200687d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f273c0b6fe0 tx=0x7f272c0079a0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.923+0000 7f2742edc700 1 -- 172.21.15.49:0/654270853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2728004db0 msgr2=0x7f273c0b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:26.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.923+0000 7f2742edc700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2728004db0 0x7f273c0b47b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2738011d30 tx=0x7f273800f520 comp rx=0 tx=0).stop 2023-07-21T22:12:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.923+0000 7f2742edc700 1 -- 172.21.15.49:0/654270853 shutdown_connections 2023-07-21T22:12:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.923+0000 7f2742edc700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2720066320 0x7f27200687d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.923+0000 7f2742edc700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f273c0cac10 0x7f273c0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.923+0000 7f2742edc700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f273c15eba0 0x7f273c157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.923+0000 7f2742edc700 1 --2- 172.21.15.49:0/654270853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2728004db0 0x7f273c0b47b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.923+0000 7f2742edc700 1 -- 172.21.15.49:0/654270853 >> 172.21.15.49:0/654270853 conn(0x7f273c06e960 msgr2=0x7f273c0d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:26.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.923+0000 7f2742edc700 1 -- 172.21.15.49:0/654270853 shutdown_connections 2023-07-21T22:12:26.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:26.923+0000 7f2742edc700 1 -- 172.21.15.49:0/654270853 wait complete. 2023-07-21T22:12:26.970 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:12:26.990 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-07-21T22:12:26.344466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":88,"acting":88,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236812,"kb_used_data":4812,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754737908,"statfs":{"total":773094113280,"available":772851617792,"internally_reserved":0,"allocated":4927488,"data_stored":2798345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.767528"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380969+0000","last_change":"2023-07-21T22:12:22.633465+0000","last_active":"2023-07-21T22:12:24.380969+0000","last_peered":"2023-07-21T22:12:24.380969+0000","last_clean":"2023-07-21T22:12:24.380969+0000","last_became_active":"2023-07-21T22:12:22.633130+0000","last_became_peered":"2023-07-21T22:12:22.633130+0000","last_unstale":"2023-07-21T22:12:24.380969+0000","last_undegraded":"2023-07-21T22:12:24.380969+0000","last_fullsized":"2023-07-21T22:12:24.380969+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:12:44.009405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.581923+0000","last_change":"2023-07-21T22:12:20.581923+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.581923+0000","last_undegraded":"2023-07-21T22:12:20.581923+0000","last_fullsized":"2023-07-21T22:12:20.581923+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580400+0000","last_change":"2023-07-21T22:12:20.580400+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580400+0000","last_undegraded":"2023-07-21T22:12:20.580400+0000","last_fullsized":"2023-07-21T22:12:20.580400+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382287+0000","last_change":"2023-07-21T22:12:21.607987+0000","last_active":"2023-07-21T22:12:24.382287+0000","last_peered":"2023-07-21T22:12:24.382287+0000","last_clean":"2023-07-21T22:12:24.382287+0000","last_became_active":"2023-07-21T22:12:21.607205+0000","last_became_peered":"2023-07-21T22:12:21.607205+0000","last_unstale":"2023-07-21T22:12:24.382287+0000","last_undegraded":"2023-07-21T22:12:24.382287+0000","last_fullsized":"2023-07-21T22:12:24.382287+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:48.071266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381990+0000","last_change":"2023-07-21T22:12:22.642404+0000","last_active":"2023-07-21T22:12:24.381990+0000","last_peered":"2023-07-21T22:12:24.381990+0000","last_clean":"2023-07-21T22:12:24.381990+0000","last_became_active":"2023-07-21T22:12:22.642006+0000","last_became_peered":"2023-07-21T22:12:22.642006+0000","last_unstale":"2023-07-21T22:12:24.381990+0000","last_undegraded":"2023-07-21T22:12:24.381990+0000","last_fullsized":"2023-07-21T22:12:24.381990+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:18:49.922082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583388+0000","last_change":"2023-07-21T22:12:20.583388+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583388+0000","last_undegraded":"2023-07-21T22:12:20.583388+0000","last_fullsized":"2023-07-21T22:12:20.583388+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.581688+0000","last_change":"2023-07-21T22:12:20.581688+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.581688+0000","last_undegraded":"2023-07-21T22:12:20.581688+0000","last_fullsized":"2023-07-21T22:12:20.581688+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580117+0000","last_change":"2023-07-21T22:12:20.580117+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580117+0000","last_undegraded":"2023-07-21T22:12:20.580117+0000","last_fullsized":"2023-07-21T22:12:20.580117+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579376+0000","last_change":"2023-07-21T22:12:20.579376+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579376+0000","last_undegraded":"2023-07-21T22:12:20.579376+0000","last_fullsized":"2023-07-21T22:12:20.579376+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.585923+0000","last_change":"2023-07-21T22:12:20.585923+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.585923+0000","last_undegraded":"2023-07-21T22:12:20.585923+0000","last_fullsized":"2023-07-21T22:12:20.585923+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579418+0000","last_change":"2023-07-21T22:12:20.579418+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579418+0000","last_undegraded":"2023-07-21T22:12:20.579418+0000","last_fullsized":"2023-07-21T22:12:20.579418+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.585044+0000","last_change":"2023-07-21T22:12:20.585044+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.585044+0000","last_undegraded":"2023-07-21T22:12:20.585044+0000","last_fullsized":"2023-07-21T22:12:20.585044+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.584443+0000","last_change":"2023-07-21T22:12:20.584443+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.584443+0000","last_undegraded":"2023-07-21T22:12:20.584443+0000","last_fullsized":"2023-07-21T22:12:20.584443+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.587786+0000","last_change":"2023-07-21T22:12:20.587786+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.587786+0000","last_undegraded":"2023-07-21T22:12:20.587786+0000","last_fullsized":"2023-07-21T22:12:20.587786+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580862+0000","last_change":"2023-07-21T22:12:20.580862+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580862+0000","last_undegraded":"2023-07-21T22:12:20.580862+0000","last_fullsized":"2023-07-21T22:12:20.580862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583153+0000","last_change":"2023-07-21T22:12:20.583153+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583153+0000","last_undegraded":"2023-07-21T22:12:20.583153+0000","last_fullsized":"2023-07-21T22:12:20.583153+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580128+0000","last_change":"2023-07-21T22:12:20.580128+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580128+0000","last_undegraded":"2023-07-21T22:12:20.580128+0000","last_fullsized":"2023-07-21T22:12:20.580128+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.585388+0000","last_change":"2023-07-21T22:12:20.585388+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.585388+0000","last_undegraded":"2023-07-21T22:12:20.585388+0000","last_fullsized":"2023-07-21T22:12:20.585388+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.587658+0000","last_change":"2023-07-21T22:12:20.587658+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.587658+0000","last_undegraded":"2023-07-21T22:12:20.587658+0000","last_fullsized":"2023-07-21T22:12:20.587658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579153+0000","last_change":"2023-07-21T22:12:20.579153+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579153+0000","last_undegraded":"2023-07-21T22:12:20.579153+0000","last_fullsized":"2023-07-21T22:12:20.579153+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579445+0000","last_change":"2023-07-21T22:12:20.579445+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579445+0000","last_undegraded":"2023-07-21T22:12:20.579445+0000","last_fullsized":"2023-07-21T22:12:20.579445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579939+0000","last_change":"2023-07-21T22:12:20.579939+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579939+0000","last_undegraded":"2023-07-21T22:12:20.579939+0000","last_fullsized":"2023-07-21T22:12:20.579939+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579938+0000","last_change":"2023-07-21T22:12:20.579938+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579938+0000","last_undegraded":"2023-07-21T22:12:20.579938+0000","last_fullsized":"2023-07-21T22:12:20.579938+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381004+0000","last_change":"2023-07-21T22:12:22.628639+0000","last_active":"2023-07-21T22:12:24.381004+0000","last_peered":"2023-07-21T22:12:24.381004+0000","last_clean":"2023-07-21T22:12:24.381004+0000","last_became_active":"2023-07-21T22:12:22.628353+0000","last_became_peered":"2023-07-21T22:12:22.628353+0000","last_unstale":"2023-07-21T22:12:24.381004+0000","last_undegraded":"2023-07-21T22:12:24.381004+0000","last_fullsized":"2023-07-21T22:12:24.381004+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:25.942541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580292+0000","last_change":"2023-07-21T22:12:20.580292+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580292+0000","last_undegraded":"2023-07-21T22:12:20.580292+0000","last_fullsized":"2023-07-21T22:12:20.580292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.584880+0000","last_change":"2023-07-21T22:12:20.584880+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.584880+0000","last_undegraded":"2023-07-21T22:12:20.584880+0000","last_fullsized":"2023-07-21T22:12:20.584880+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583080+0000","last_change":"2023-07-21T22:12:20.583080+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583080+0000","last_undegraded":"2023-07-21T22:12:20.583080+0000","last_fullsized":"2023-07-21T22:12:20.583080+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583278+0000","last_change":"2023-07-21T22:12:20.583278+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583278+0000","last_undegraded":"2023-07-21T22:12:20.583278+0000","last_fullsized":"2023-07-21T22:12:20.583278+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.583895+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:12:20.583895+0000","last_peered":"2023-07-21T22:12:20.583895+0000","last_clean":"2023-07-21T22:12:20.583895+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:12:20.583895+0000","last_undegraded":"2023-07-21T22:12:20.583895+0000","last_fullsized":"2023-07-21T22:12:20.583895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:14:59.136928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579208+0000","last_change":"2023-07-21T22:12:20.579208+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579208+0000","last_undegraded":"2023-07-21T22:12:20.579208+0000","last_fullsized":"2023-07-21T22:12:20.579208+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381126+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:12:24.381126+0000","last_peered":"2023-07-21T22:12:24.381126+0000","last_clean":"2023-07-21T22:12:24.381126+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:12:24.381126+0000","last_undegraded":"2023-07-21T22:12:24.381126+0000","last_fullsized":"2023-07-21T22:12:24.381126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:31:37.838038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380896+0000","last_change":"2023-07-21T22:12:21.611685+0000","last_active":"2023-07-21T22:12:24.380896+0000","last_peered":"2023-07-21T22:12:24.380896+0000","last_clean":"2023-07-21T22:12:24.380896+0000","last_became_active":"2023-07-21T22:12:21.611382+0000","last_became_peered":"2023-07-21T22:12:21.611382+0000","last_unstale":"2023-07-21T22:12:24.380896+0000","last_undegraded":"2023-07-21T22:12:24.380896+0000","last_fullsized":"2023-07-21T22:12:24.380896+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:05:47.955186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.585525+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:12:20.585525+0000","last_peered":"2023-07-21T22:12:20.585525+0000","last_clean":"2023-07-21T22:12:20.585525+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:12:20.585525+0000","last_undegraded":"2023-07-21T22:12:20.585525+0000","last_fullsized":"2023-07-21T22:12:20.585525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:22:21.165816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.584848+0000","last_change":"2023-07-21T22:12:20.584848+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.584848+0000","last_undegraded":"2023-07-21T22:12:20.584848+0000","last_fullsized":"2023-07-21T22:12:20.584848+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381102+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:12:24.381102+0000","last_peered":"2023-07-21T22:12:24.381102+0000","last_clean":"2023-07-21T22:12:24.381102+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:12:24.381102+0000","last_undegraded":"2023-07-21T22:12:24.381102+0000","last_fullsized":"2023-07-21T22:12:24.381102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:38.424071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579728+0000","last_change":"2023-07-21T22:12:20.579728+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579728+0000","last_undegraded":"2023-07-21T22:12:20.579728+0000","last_fullsized":"2023-07-21T22:12:20.579728+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.581000+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:12:20.581000+0000","last_peered":"2023-07-21T22:12:20.581000+0000","last_clean":"2023-07-21T22:12:20.581000+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:12:20.581000+0000","last_undegraded":"2023-07-21T22:12:20.581000+0000","last_fullsized":"2023-07-21T22:12:20.581000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:43.553038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583936+0000","last_change":"2023-07-21T22:12:20.583936+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583936+0000","last_undegraded":"2023-07-21T22:12:20.583936+0000","last_fullsized":"2023-07-21T22:12:20.583936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.588348+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:12:20.588348+0000","last_peered":"2023-07-21T22:12:20.588348+0000","last_clean":"2023-07-21T22:12:20.588348+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:12:20.588348+0000","last_undegraded":"2023-07-21T22:12:20.588348+0000","last_fullsized":"2023-07-21T22:12:20.588348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:15:59.904194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380888+0000","last_change":"2023-07-21T22:12:21.607945+0000","last_active":"2023-07-21T22:12:24.380888+0000","last_peered":"2023-07-21T22:12:24.380888+0000","last_clean":"2023-07-21T22:12:24.380888+0000","last_became_active":"2023-07-21T22:12:21.607453+0000","last_became_peered":"2023-07-21T22:12:21.607453+0000","last_unstale":"2023-07-21T22:12:24.380888+0000","last_undegraded":"2023-07-21T22:12:24.380888+0000","last_fullsized":"2023-07-21T22:12:24.380888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:06.804163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.584928+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:12:20.584928+0000","last_peered":"2023-07-21T22:12:20.584928+0000","last_clean":"2023-07-21T22:12:20.584928+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:12:20.584928+0000","last_undegraded":"2023-07-21T22:12:20.584928+0000","last_fullsized":"2023-07-21T22:12:20.584928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:43:49.744710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.581493+0000","last_change":"2023-07-21T22:12:20.581493+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.581493+0000","last_undegraded":"2023-07-21T22:12:20.581493+0000","last_fullsized":"2023-07-21T22:12:20.581493+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.580877+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:12:20.580877+0000","last_peered":"2023-07-21T22:12:20.580877+0000","last_clean":"2023-07-21T22:12:20.580877+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:12:20.580877+0000","last_undegraded":"2023-07-21T22:12:20.580877+0000","last_fullsized":"2023-07-21T22:12:20.580877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:54:41.899398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":199,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.584999+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:12:20.584999+0000","last_peered":"2023-07-21T22:12:20.584999+0000","last_clean":"2023-07-21T22:12:20.584999+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:12:20.584999+0000","last_undegraded":"2023-07-21T22:12:20.584999+0000","last_fullsized":"2023-07-21T22:12:20.584999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:25:44.419102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":6,"acting":6,"num_store_stats":1},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":1048576,"data_stored":785834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.1319999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.218}]},{"osd":2,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.512},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.2649999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.6200000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.464}]},{"osd":5,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.288}]},{"osd":6,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.7869999999999999,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.476,"5min":2.476,"15min":2.476},"last":1.5589999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":201956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":1.488}]},{"osd":1,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.002},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.3919999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.911,"5min":2.911,"15min":2.911},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.4399999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.611},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":1.204}]},{"osd":4,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":4.2779999999999996,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.571}]},{"osd":5,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.6339999999999999,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.6539999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":4.194,"5min":4.194,"15min":4.194},"last":1.8979999999999999},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":2.5379999999999998,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.78}]}]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":201956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.66700000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.143}]},{"osd":2,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.95099999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.4179999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.3169999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.369},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.8839999999999999,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.391}]}]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":201956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.71699999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.111}]},{"osd":2,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.621}]},{"osd":3,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.153}]},{"osd":5,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.028}]},{"osd":6,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.242}]}]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":466944,"data_stored":201956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.72799999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.0269999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.153},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.3169999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.242},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.2030000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.585},{"interface":"front","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.377}]},{"osd":6,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.6739999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.734},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.4390000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":454656,"data_stored":195466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.1000000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.246}]},{"osd":3,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":1.202},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.92600000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.3440000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":3.331,"5min":3.331,"15min":3.331},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.4370000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.633,"5min":2.633,"15min":2.633},"last":1.377},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.155}]},{"osd":7,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":3.0569999999999999,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.319}]}]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":1048576,"data_stored":785834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.68500000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.0229999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.234},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.1060000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.3200000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":1.548}]},{"osd":6,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.385},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.415}]},{"osd":7,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":2.5990000000000002,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":1.8540000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542173,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":507904,"data_stored":223387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89800000000000002,"15min":0.90000000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.3109999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.403,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.91000000000000003,"15min":0.90400000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":1.246},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.1040000000000001,"15min":1.125},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.0190000000000001,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.2070000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.3680000000000001,"15min":1.4099999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.444,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.2350000000000001,"15min":1.2669999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.881,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":1.4970000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.3049999999999999,"15min":1.3180000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6910000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.393},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.288,"15min":1.3069999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":3.0419999999999998,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.367}]},{"osd":5,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.3500000000000001,"15min":1.3720000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.534},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.4630000000000001,"15min":1.494},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0630000000000002,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.581}]},{"osd":6,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.4159999999999999,"15min":1.4359999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.738,"5min":2.238,"15min":2.238},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.4359999999999999,"15min":1.45},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":2.1000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.534,"15min":1.5589999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.3250000000000002,"5min":4.391,"15min":4.391},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.508,"15min":1.526},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7849999999999999,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.6990000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:12:26.997 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:12:27.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.159+0000 7f4587d7d700 1 Processor -- start 2023-07-21T22:12:27.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.163+0000 7f4587d7d700 1 -- start start 2023-07-21T22:12:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.163+0000 7f4587d7d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f458006d5d0 0x7f458006d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.163+0000 7f4587d7d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f458015d780 0x7f458015dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.163+0000 7f4587d7d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458006dee0 con 0x7f4580159f60 2023-07-21T22:12:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.163+0000 7f4587d7d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45800b0330 con 0x7f458006d5d0 2023-07-21T22:12:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.163+0000 7f4587d7d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45800b0600 con 0x7f458015d780 2023-07-21T22:12:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.163+0000 7f4585318700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4580159f60 0x7f45800afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49192/0 (socket says 172.21.15.49:49192) 2023-07-21T22:12:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.163+0000 7f4585318700 1 -- 172.21.15.49:0/2564821488 learned_addr learned my addr 172.21.15.49:0/2564821488 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.163+0000 7f4585b19700 1 --2- 172.21.15.49:0/2564821488 >> v2:172.21.15.49:3300/0 conn(0x7f458006d5d0 0x7f458006d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:27.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.163+0000 7f458631a700 1 --2- 172.21.15.49:0/2564821488 >> v2:172.21.15.150:3300/0 conn(0x7f458015d780 0x7f458015dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:27.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.163+0000 7f4584b17700 1 -- 172.21.15.49:0/2564821488 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646373775 0 0) 0x7f458006dee0 con 0x7f4580159f60 2023-07-21T22:12:27.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.163+0000 7f4584b17700 1 -- 172.21.15.49:0/2564821488 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f456c0035d0 con 0x7f4580159f60 2023-07-21T22:12:27.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f458631a700 1 -- 172.21.15.49:0/2564821488 >> v2:172.21.15.49:3300/0 conn(0x7f458006d5d0 msgr2=0x7f458006d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:27.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f458631a700 1 --2- 172.21.15.49:0/2564821488 >> v2:172.21.15.49:3300/0 conn(0x7f458006d5d0 0x7f458006d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f458631a700 1 -- 172.21.15.49:0/2564821488 >> v1:172.21.15.49:6789/0 conn(0x7f4580159f60 legacy=0x7f45800afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:27.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f458631a700 1 -- 172.21.15.49:0/2564821488 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458015a470 con 0x7f458015d780 2023-07-21T22:12:27.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f458631a700 1 --2- 172.21.15.49:0/2564821488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f458015d780 0x7f458015dc20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f45800cb5e0 tx=0x7f457800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d7f601254fcf569 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f4584b17700 1 -- 172.21.15.49:0/2564821488 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457800e070 con 0x7f458015d780 2023-07-21T22:12:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f4584b17700 1 -- 172.21.15.49:0/2564821488 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457800bb20 con 0x7f458015d780 2023-07-21T22:12:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f4584b17700 1 -- 172.21.15.49:0/2564821488 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578012430 con 0x7f458015d780 2023-07-21T22:12:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f4587d7d700 1 -- 172.21.15.49:0/2564821488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f458015d780 msgr2=0x7f458015dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f4587d7d700 1 --2- 172.21.15.49:0/2564821488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f458015d780 0x7f458015dc20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f45800cb5e0 tx=0x7f457800b330 comp rx=0 tx=0).stop 2023-07-21T22:12:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f4587d7d700 1 -- 172.21.15.49:0/2564821488 shutdown_connections 2023-07-21T22:12:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f4587d7d700 1 --2- 172.21.15.49:0/2564821488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f458015d780 0x7f458015dc20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f4587d7d700 1 --2- 172.21.15.49:0/2564821488 >> v2:172.21.15.49:3300/0 conn(0x7f458006d5d0 0x7f458006d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f4587d7d700 1 -- 172.21.15.49:0/2564821488 >> 172.21.15.49:0/2564821488 conn(0x7f458006f5a0 msgr2=0x7f45800cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:27.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f4587d7d700 1 -- 172.21.15.49:0/2564821488 shutdown_connections 2023-07-21T22:12:27.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.167+0000 7f4587d7d700 1 -- 172.21.15.49:0/2564821488 wait complete. 2023-07-21T22:12:27.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.171+0000 7f4587d7d700 1 Processor -- start 2023-07-21T22:12:27.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.171+0000 7f4587d7d700 1 -- start start 2023-07-21T22:12:27.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.171+0000 7f4587d7d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f458006d5d0 0x7f45800c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:27.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.171+0000 7f4587d7d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4580159f60 0x7f4580152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:27.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.171+0000 7f4587d7d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f458015d780 0x7f45801561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:27.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.171+0000 7f4587d7d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458015c940 con 0x7f458015d780 2023-07-21T22:12:27.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.171+0000 7f4587d7d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800c4a50 con 0x7f458006d5d0 2023-07-21T22:12:27.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.171+0000 7f4587d7d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458015cb90 con 0x7f4580159f60 2023-07-21T22:12:27.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.171+0000 7f458631a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f458015d780 0x7f45801561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:27.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.171+0000 7f458631a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f458015d780 0x7f45801561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45876/0 (socket says 172.21.15.49:45876) 2023-07-21T22:12:27.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.171+0000 7f458631a700 1 -- 172.21.15.49:0/3175923702 learned_addr learned my addr 172.21.15.49:0/3175923702 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:27.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.175+0000 7f4585b19700 1 --2- 172.21.15.49:0/3175923702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f458006d5d0 0x7f45800c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:27.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.175+0000 7f4585318700 1 --2- 172.21.15.49:0/3175923702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4580159f60 0x7f4580152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:27.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.175+0000 7f458631a700 1 -- 172.21.15.49:0/3175923702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4580159f60 msgr2=0x7f4580152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:27.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.175+0000 7f458631a700 1 --2- 172.21.15.49:0/3175923702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4580159f60 0x7f4580152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.175+0000 7f458631a700 1 -- 172.21.15.49:0/3175923702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f458006d5d0 msgr2=0x7f45800c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:27.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.175+0000 7f458631a700 1 --2- 172.21.15.49:0/3175923702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f458006d5d0 0x7f45800c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.175+0000 7f458631a700 1 -- 172.21.15.49:0/3175923702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4578009a70 con 0x7f458015d780 2023-07-21T22:12:27.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.175+0000 7f458631a700 1 --2- 172.21.15.49:0/3175923702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f458015d780 0x7f45801561a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4578014040 tx=0x7f4578004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:27.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.175+0000 7f45767fc700 1 -- 172.21.15.49:0/3175923702 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578004780 con 0x7f458015d780 2023-07-21T22:12:27.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.175+0000 7f45767fc700 1 -- 172.21.15.49:0/3175923702 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4578020070 con 0x7f458015d780 2023-07-21T22:12:27.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.175+0000 7f4587d7d700 1 -- 172.21.15.49:0/3175923702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458015ce70 con 0x7f458015d780 2023-07-21T22:12:27.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.175+0000 7f45767fc700 1 -- 172.21.15.49:0/3175923702 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45780276c0 con 0x7f458015d780 2023-07-21T22:12:27.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.175+0000 7f4587d7d700 1 -- 172.21.15.49:0/3175923702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4580152de0 con 0x7f458015d780 2023-07-21T22:12:27.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.175+0000 7f4587d7d700 1 -- 172.21.15.49:0/3175923702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4580073130 con 0x7f458015d780 2023-07-21T22:12:27.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.179+0000 7f45767fc700 1 -- 172.21.15.49:0/3175923702 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4578012430 con 0x7f458015d780 2023-07-21T22:12:27.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.179+0000 7f45767fc700 1 --2- 172.21.15.49:0/3175923702 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4564066320 0x7f45640687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:27.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.179+0000 7f45767fc700 1 -- 172.21.15.49:0/3175923702 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4578022070 con 0x7f458015d780 2023-07-21T22:12:27.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.179+0000 7f4585b19700 1 --2- 172.21.15.49:0/3175923702 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4564066320 0x7f45640687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:27.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.183+0000 7f4585b19700 1 --2- 172.21.15.49:0/3175923702 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4564066320 0x7f45640687d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f45800c8710 tx=0x7f457c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:27.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.187+0000 7f45767fc700 1 -- 172.21.15.49:0/3175923702 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4578052c60 con 0x7f458015d780 2023-07-21T22:12:27.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.359+0000 7f4587d7d700 1 -- 172.21.15.49:0/3175923702 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f458015aa30 con 0x7f4564066320 2023-07-21T22:12:27.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.375+0000 7f45767fc700 1 -- 172.21.15.49:0/3175923702 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297531 (secure 0 0 0) 0x7f457c0118f0 con 0x7f4564066320 2023-07-21T22:12:27.426 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:27.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.383+0000 7f4587d7d700 1 -- 172.21.15.49:0/3175923702 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4564066320 msgr2=0x7f45640687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:27.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.383+0000 7f4587d7d700 1 --2- 172.21.15.49:0/3175923702 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4564066320 0x7f45640687d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f45800c8710 tx=0x7f457c009240 comp rx=0 tx=0).stop 2023-07-21T22:12:27.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.383+0000 7f4587d7d700 1 -- 172.21.15.49:0/3175923702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f458015d780 msgr2=0x7f45801561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:27.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.383+0000 7f4587d7d700 1 --2- 172.21.15.49:0/3175923702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f458015d780 0x7f45801561a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4578014040 tx=0x7f4578004af0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.383+0000 7f4587d7d700 1 -- 172.21.15.49:0/3175923702 shutdown_connections 2023-07-21T22:12:27.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.383+0000 7f4587d7d700 1 --2- 172.21.15.49:0/3175923702 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4564066320 0x7f45640687d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.383+0000 7f4587d7d700 1 --2- 172.21.15.49:0/3175923702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f458015d780 0x7f45801561a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.383+0000 7f4587d7d700 1 --2- 172.21.15.49:0/3175923702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4580159f60 0x7f4580152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.383+0000 7f4587d7d700 1 --2- 172.21.15.49:0/3175923702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f458006d5d0 0x7f45800c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.383+0000 7f4587d7d700 1 -- 172.21.15.49:0/3175923702 >> 172.21.15.49:0/3175923702 conn(0x7f458006f5a0 msgr2=0x7f45800ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.383+0000 7f4587d7d700 1 -- 172.21.15.49:0/3175923702 shutdown_connections 2023-07-21T22:12:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.383+0000 7f4587d7d700 1 -- 172.21.15.49:0/3175923702 wait complete. 2023-07-21T22:12:27.432 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:12:27.452 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-07-21T22:12:26.344466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":88,"acting":88,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236812,"kb_used_data":4812,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754737908,"statfs":{"total":773094113280,"available":772851617792,"internally_reserved":0,"allocated":4927488,"data_stored":2798345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.767528"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380969+0000","last_change":"2023-07-21T22:12:22.633465+0000","last_active":"2023-07-21T22:12:24.380969+0000","last_peered":"2023-07-21T22:12:24.380969+0000","last_clean":"2023-07-21T22:12:24.380969+0000","last_became_active":"2023-07-21T22:12:22.633130+0000","last_became_peered":"2023-07-21T22:12:22.633130+0000","last_unstale":"2023-07-21T22:12:24.380969+0000","last_undegraded":"2023-07-21T22:12:24.380969+0000","last_fullsized":"2023-07-21T22:12:24.380969+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:12:44.009405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.581923+0000","last_change":"2023-07-21T22:12:20.581923+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.581923+0000","last_undegraded":"2023-07-21T22:12:20.581923+0000","last_fullsized":"2023-07-21T22:12:20.581923+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580400+0000","last_change":"2023-07-21T22:12:20.580400+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580400+0000","last_undegraded":"2023-07-21T22:12:20.580400+0000","last_fullsized":"2023-07-21T22:12:20.580400+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382287+0000","last_change":"2023-07-21T22:12:21.607987+0000","last_active":"2023-07-21T22:12:24.382287+0000","last_peered":"2023-07-21T22:12:24.382287+0000","last_clean":"2023-07-21T22:12:24.382287+0000","last_became_active":"2023-07-21T22:12:21.607205+0000","last_became_peered":"2023-07-21T22:12:21.607205+0000","last_unstale":"2023-07-21T22:12:24.382287+0000","last_undegraded":"2023-07-21T22:12:24.382287+0000","last_fullsized":"2023-07-21T22:12:24.382287+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:48.071266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381990+0000","last_change":"2023-07-21T22:12:22.642404+0000","last_active":"2023-07-21T22:12:24.381990+0000","last_peered":"2023-07-21T22:12:24.381990+0000","last_clean":"2023-07-21T22:12:24.381990+0000","last_became_active":"2023-07-21T22:12:22.642006+0000","last_became_peered":"2023-07-21T22:12:22.642006+0000","last_unstale":"2023-07-21T22:12:24.381990+0000","last_undegraded":"2023-07-21T22:12:24.381990+0000","last_fullsized":"2023-07-21T22:12:24.381990+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:18:49.922082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583388+0000","last_change":"2023-07-21T22:12:20.583388+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583388+0000","last_undegraded":"2023-07-21T22:12:20.583388+0000","last_fullsized":"2023-07-21T22:12:20.583388+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.581688+0000","last_change":"2023-07-21T22:12:20.581688+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.581688+0000","last_undegraded":"2023-07-21T22:12:20.581688+0000","last_fullsized":"2023-07-21T22:12:20.581688+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580117+0000","last_change":"2023-07-21T22:12:20.580117+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580117+0000","last_undegraded":"2023-07-21T22:12:20.580117+0000","last_fullsized":"2023-07-21T22:12:20.580117+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579376+0000","last_change":"2023-07-21T22:12:20.579376+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579376+0000","last_undegraded":"2023-07-21T22:12:20.579376+0000","last_fullsized":"2023-07-21T22:12:20.579376+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.585923+0000","last_change":"2023-07-21T22:12:20.585923+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.585923+0000","last_undegraded":"2023-07-21T22:12:20.585923+0000","last_fullsized":"2023-07-21T22:12:20.585923+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579418+0000","last_change":"2023-07-21T22:12:20.579418+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579418+0000","last_undegraded":"2023-07-21T22:12:20.579418+0000","last_fullsized":"2023-07-21T22:12:20.579418+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.585044+0000","last_change":"2023-07-21T22:12:20.585044+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.585044+0000","last_undegraded":"2023-07-21T22:12:20.585044+0000","last_fullsized":"2023-07-21T22:12:20.585044+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.584443+0000","last_change":"2023-07-21T22:12:20.584443+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.584443+0000","last_undegraded":"2023-07-21T22:12:20.584443+0000","last_fullsized":"2023-07-21T22:12:20.584443+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.587786+0000","last_change":"2023-07-21T22:12:20.587786+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.587786+0000","last_undegraded":"2023-07-21T22:12:20.587786+0000","last_fullsized":"2023-07-21T22:12:20.587786+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580862+0000","last_change":"2023-07-21T22:12:20.580862+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580862+0000","last_undegraded":"2023-07-21T22:12:20.580862+0000","last_fullsized":"2023-07-21T22:12:20.580862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583153+0000","last_change":"2023-07-21T22:12:20.583153+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583153+0000","last_undegraded":"2023-07-21T22:12:20.583153+0000","last_fullsized":"2023-07-21T22:12:20.583153+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580128+0000","last_change":"2023-07-21T22:12:20.580128+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580128+0000","last_undegraded":"2023-07-21T22:12:20.580128+0000","last_fullsized":"2023-07-21T22:12:20.580128+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.585388+0000","last_change":"2023-07-21T22:12:20.585388+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.585388+0000","last_undegraded":"2023-07-21T22:12:20.585388+0000","last_fullsized":"2023-07-21T22:12:20.585388+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.587658+0000","last_change":"2023-07-21T22:12:20.587658+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.587658+0000","last_undegraded":"2023-07-21T22:12:20.587658+0000","last_fullsized":"2023-07-21T22:12:20.587658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579153+0000","last_change":"2023-07-21T22:12:20.579153+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579153+0000","last_undegraded":"2023-07-21T22:12:20.579153+0000","last_fullsized":"2023-07-21T22:12:20.579153+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579445+0000","last_change":"2023-07-21T22:12:20.579445+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579445+0000","last_undegraded":"2023-07-21T22:12:20.579445+0000","last_fullsized":"2023-07-21T22:12:20.579445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579939+0000","last_change":"2023-07-21T22:12:20.579939+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579939+0000","last_undegraded":"2023-07-21T22:12:20.579939+0000","last_fullsized":"2023-07-21T22:12:20.579939+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579938+0000","last_change":"2023-07-21T22:12:20.579938+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579938+0000","last_undegraded":"2023-07-21T22:12:20.579938+0000","last_fullsized":"2023-07-21T22:12:20.579938+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381004+0000","last_change":"2023-07-21T22:12:22.628639+0000","last_active":"2023-07-21T22:12:24.381004+0000","last_peered":"2023-07-21T22:12:24.381004+0000","last_clean":"2023-07-21T22:12:24.381004+0000","last_became_active":"2023-07-21T22:12:22.628353+0000","last_became_peered":"2023-07-21T22:12:22.628353+0000","last_unstale":"2023-07-21T22:12:24.381004+0000","last_undegraded":"2023-07-21T22:12:24.381004+0000","last_fullsized":"2023-07-21T22:12:24.381004+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:25.942541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580292+0000","last_change":"2023-07-21T22:12:20.580292+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580292+0000","last_undegraded":"2023-07-21T22:12:20.580292+0000","last_fullsized":"2023-07-21T22:12:20.580292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.584880+0000","last_change":"2023-07-21T22:12:20.584880+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.584880+0000","last_undegraded":"2023-07-21T22:12:20.584880+0000","last_fullsized":"2023-07-21T22:12:20.584880+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583080+0000","last_change":"2023-07-21T22:12:20.583080+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583080+0000","last_undegraded":"2023-07-21T22:12:20.583080+0000","last_fullsized":"2023-07-21T22:12:20.583080+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583278+0000","last_change":"2023-07-21T22:12:20.583278+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583278+0000","last_undegraded":"2023-07-21T22:12:20.583278+0000","last_fullsized":"2023-07-21T22:12:20.583278+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.583895+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:12:20.583895+0000","last_peered":"2023-07-21T22:12:20.583895+0000","last_clean":"2023-07-21T22:12:20.583895+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:12:20.583895+0000","last_undegraded":"2023-07-21T22:12:20.583895+0000","last_fullsized":"2023-07-21T22:12:20.583895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:14:59.136928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579208+0000","last_change":"2023-07-21T22:12:20.579208+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579208+0000","last_undegraded":"2023-07-21T22:12:20.579208+0000","last_fullsized":"2023-07-21T22:12:20.579208+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381126+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:12:24.381126+0000","last_peered":"2023-07-21T22:12:24.381126+0000","last_clean":"2023-07-21T22:12:24.381126+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:12:24.381126+0000","last_undegraded":"2023-07-21T22:12:24.381126+0000","last_fullsized":"2023-07-21T22:12:24.381126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:31:37.838038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380896+0000","last_change":"2023-07-21T22:12:21.611685+0000","last_active":"2023-07-21T22:12:24.380896+0000","last_peered":"2023-07-21T22:12:24.380896+0000","last_clean":"2023-07-21T22:12:24.380896+0000","last_became_active":"2023-07-21T22:12:21.611382+0000","last_became_peered":"2023-07-21T22:12:21.611382+0000","last_unstale":"2023-07-21T22:12:24.380896+0000","last_undegraded":"2023-07-21T22:12:24.380896+0000","last_fullsized":"2023-07-21T22:12:24.380896+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:05:47.955186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.585525+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:12:20.585525+0000","last_peered":"2023-07-21T22:12:20.585525+0000","last_clean":"2023-07-21T22:12:20.585525+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:12:20.585525+0000","last_undegraded":"2023-07-21T22:12:20.585525+0000","last_fullsized":"2023-07-21T22:12:20.585525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:22:21.165816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.584848+0000","last_change":"2023-07-21T22:12:20.584848+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.584848+0000","last_undegraded":"2023-07-21T22:12:20.584848+0000","last_fullsized":"2023-07-21T22:12:20.584848+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381102+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:12:24.381102+0000","last_peered":"2023-07-21T22:12:24.381102+0000","last_clean":"2023-07-21T22:12:24.381102+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:12:24.381102+0000","last_undegraded":"2023-07-21T22:12:24.381102+0000","last_fullsized":"2023-07-21T22:12:24.381102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:38.424071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579728+0000","last_change":"2023-07-21T22:12:20.579728+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579728+0000","last_undegraded":"2023-07-21T22:12:20.579728+0000","last_fullsized":"2023-07-21T22:12:20.579728+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.581000+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:12:20.581000+0000","last_peered":"2023-07-21T22:12:20.581000+0000","last_clean":"2023-07-21T22:12:20.581000+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:12:20.581000+0000","last_undegraded":"2023-07-21T22:12:20.581000+0000","last_fullsized":"2023-07-21T22:12:20.581000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:43.553038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583936+0000","last_change":"2023-07-21T22:12:20.583936+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583936+0000","last_undegraded":"2023-07-21T22:12:20.583936+0000","last_fullsized":"2023-07-21T22:12:20.583936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.588348+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:12:20.588348+0000","last_peered":"2023-07-21T22:12:20.588348+0000","last_clean":"2023-07-21T22:12:20.588348+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:12:20.588348+0000","last_undegraded":"2023-07-21T22:12:20.588348+0000","last_fullsized":"2023-07-21T22:12:20.588348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:15:59.904194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380888+0000","last_change":"2023-07-21T22:12:21.607945+0000","last_active":"2023-07-21T22:12:24.380888+0000","last_peered":"2023-07-21T22:12:24.380888+0000","last_clean":"2023-07-21T22:12:24.380888+0000","last_became_active":"2023-07-21T22:12:21.607453+0000","last_became_peered":"2023-07-21T22:12:21.607453+0000","last_unstale":"2023-07-21T22:12:24.380888+0000","last_undegraded":"2023-07-21T22:12:24.380888+0000","last_fullsized":"2023-07-21T22:12:24.380888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:06.804163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.584928+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:12:20.584928+0000","last_peered":"2023-07-21T22:12:20.584928+0000","last_clean":"2023-07-21T22:12:20.584928+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:12:20.584928+0000","last_undegraded":"2023-07-21T22:12:20.584928+0000","last_fullsized":"2023-07-21T22:12:20.584928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:43:49.744710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.581493+0000","last_change":"2023-07-21T22:12:20.581493+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.581493+0000","last_undegraded":"2023-07-21T22:12:20.581493+0000","last_fullsized":"2023-07-21T22:12:20.581493+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.580877+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:12:20.580877+0000","last_peered":"2023-07-21T22:12:20.580877+0000","last_clean":"2023-07-21T22:12:20.580877+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:12:20.580877+0000","last_undegraded":"2023-07-21T22:12:20.580877+0000","last_fullsized":"2023-07-21T22:12:20.580877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:54:41.899398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":199,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.584999+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:12:20.584999+0000","last_peered":"2023-07-21T22:12:20.584999+0000","last_clean":"2023-07-21T22:12:20.584999+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:12:20.584999+0000","last_undegraded":"2023-07-21T22:12:20.584999+0000","last_fullsized":"2023-07-21T22:12:20.584999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:25:44.419102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":6,"acting":6,"num_store_stats":1},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":1048576,"data_stored":785834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.1319999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.218}]},{"osd":2,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.512},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.2649999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.6200000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.464}]},{"osd":5,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.288}]},{"osd":6,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.7869999999999999,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.476,"5min":2.476,"15min":2.476},"last":1.5589999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":201956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":1.488}]},{"osd":1,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.002},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.3919999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.911,"5min":2.911,"15min":2.911},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.4399999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.611},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":1.204}]},{"osd":4,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":4.2779999999999996,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.571}]},{"osd":5,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.6339999999999999,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.6539999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":4.194,"5min":4.194,"15min":4.194},"last":1.8979999999999999},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":2.5379999999999998,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.78}]}]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":201956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.66700000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.143}]},{"osd":2,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.95099999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.4179999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.3169999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.369},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.8839999999999999,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.391}]}]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":201956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.71699999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.111}]},{"osd":2,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.621}]},{"osd":3,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.153}]},{"osd":5,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.028}]},{"osd":6,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.242}]}]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":466944,"data_stored":201956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.72799999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.0269999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.153},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.3169999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.242},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.2030000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.585},{"interface":"front","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.377}]},{"osd":6,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.6739999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.734},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.4390000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":454656,"data_stored":195466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.1000000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.246}]},{"osd":3,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":1.202},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.92600000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.3440000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":3.331,"5min":3.331,"15min":3.331},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.4370000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.633,"5min":2.633,"15min":2.633},"last":1.377},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.155}]},{"osd":7,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":3.0569999999999999,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.319}]}]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":1048576,"data_stored":785834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.68500000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.0229999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.234},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.1060000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.3200000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":1.548}]},{"osd":6,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.385},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.415}]},{"osd":7,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":2.5990000000000002,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":1.8540000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542173,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":507904,"data_stored":223387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89800000000000002,"15min":0.90000000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.3109999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.403,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.91000000000000003,"15min":0.90400000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":1.246},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.1040000000000001,"15min":1.125},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.0190000000000001,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.2070000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.3680000000000001,"15min":1.4099999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.444,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.2350000000000001,"15min":1.2669999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.881,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":1.4970000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.3049999999999999,"15min":1.3180000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6910000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.393},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.288,"15min":1.3069999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":3.0419999999999998,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.367}]},{"osd":5,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.3500000000000001,"15min":1.3720000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.534},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.4630000000000001,"15min":1.494},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0630000000000002,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.581}]},{"osd":6,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.4159999999999999,"15min":1.4359999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.738,"5min":2.238,"15min":2.238},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.4359999999999999,"15min":1.45},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":2.1000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.534,"15min":1.5589999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.3250000000000002,"5min":4.391,"15min":4.391},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.508,"15min":1.526},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7849999999999999,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.6990000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:12:27.458 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:12:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.635+0000 7f3fca6dd700 1 Processor -- start 2023-07-21T22:12:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.635+0000 7f3fca6dd700 1 -- start start 2023-07-21T22:12:27.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fca6dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc40ab8d0 0x7f3fc40afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:27.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fca6dd700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc40cdd70 con 0x7f3fc415c0a0 2023-07-21T22:12:27.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fca6dd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc40cda40 con 0x7f3fc40cb800 2023-07-21T22:12:27.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fca6dd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40abdd0 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fc3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3fc415c0a0 0x7f3fc40ad350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49208/0 (socket says 172.21.15.49:49208) 2023-07-21T22:12:27.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fc3fff700 1 -- 172.21.15.49:0/2284692605 learned_addr learned my addr 172.21.15.49:0/2284692605 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:27.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fc37fe700 1 --2- 172.21.15.49:0/2284692605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc40ab8d0 0x7f3fc40afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:27.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fc2ffd700 1 -- 172.21.15.49:0/2284692605 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229935440 0 0) 0x7f3fc40cdd70 con 0x7f3fc415c0a0 2023-07-21T22:12:27.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fc2ffd700 1 -- 172.21.15.49:0/2284692605 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fac0035d0 con 0x7f3fc415c0a0 2023-07-21T22:12:27.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fc2ffd700 1 -- 172.21.15.49:0/2284692605 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631847023 0 0) 0x7f3fc40cda40 con 0x7f3fc40cb800 2023-07-21T22:12:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fc37fe700 1 -- 172.21.15.49:0/2284692605 >> v1:172.21.15.150:6789/0 conn(0x7f3fc40cb800 legacy=0x7f3fc4070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fc37fe700 1 -- 172.21.15.49:0/2284692605 >> v1:172.21.15.49:6789/0 conn(0x7f3fc415c0a0 legacy=0x7f3fc40ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fc37fe700 1 -- 172.21.15.49:0/2284692605 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc40cccc0 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fc37fe700 1 --2- 172.21.15.49:0/2284692605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc40ab8d0 0x7f3fc40afc20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009880 tx=0x7f3fb8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f76423efc16bb51 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fc2ffd700 1 -- 172.21.15.49:0/2284692605 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4001670 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fc2ffd700 1 -- 172.21.15.49:0/2284692605 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb8010590 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.639+0000 7f3fc2ffd700 1 -- 172.21.15.49:0/2284692605 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8010940 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.643+0000 7f3fca6dd700 1 -- 172.21.15.49:0/2284692605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc40ab8d0 msgr2=0x7f3fc40afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:27.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.643+0000 7f3fca6dd700 1 --2- 172.21.15.49:0/2284692605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc40ab8d0 0x7f3fc40afc20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009880 tx=0x7f3fb8009b90 comp rx=0 tx=0).stop 2023-07-21T22:12:27.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.643+0000 7f3fca6dd700 1 -- 172.21.15.49:0/2284692605 shutdown_connections 2023-07-21T22:12:27.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.643+0000 7f3fca6dd700 1 --2- 172.21.15.49:0/2284692605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc40ab8d0 0x7f3fc40afc20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.643+0000 7f3fca6dd700 1 -- 172.21.15.49:0/2284692605 >> 172.21.15.49:0/2284692605 conn(0x7f3fc406f5a0 msgr2=0x7f3fc40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:27.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.643+0000 7f3fca6dd700 1 -- 172.21.15.49:0/2284692605 shutdown_connections 2023-07-21T22:12:27.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.643+0000 7f3fca6dd700 1 -- 172.21.15.49:0/2284692605 wait complete. 2023-07-21T22:12:27.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.643+0000 7f3fca6dd700 1 Processor -- start 2023-07-21T22:12:27.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fca6dd700 1 -- start start 2023-07-21T22:12:27.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fca6dd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc40ab8d0 0x7f3fc41f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:27.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fca6dd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc40cb800 0x7f3fc40b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:27.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fca6dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc415c0a0 0x7f3fc40c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:27.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fca6dd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40b2760 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fca6dd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40b31b0 con 0x7f3fc40cb800 2023-07-21T22:12:27.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fca6dd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40b3490 con 0x7f3fc415c0a0 2023-07-21T22:12:27.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fc3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc40ab8d0 0x7f3fc41f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:27.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fc3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc40ab8d0 0x7f3fc41f1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45890/0 (socket says 172.21.15.49:45890) 2023-07-21T22:12:27.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fc3fff700 1 -- 172.21.15.49:0/3496957066 learned_addr learned my addr 172.21.15.49:0/3496957066 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:27.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fc37fe700 1 --2- 172.21.15.49:0/3496957066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc40cb800 0x7f3fc40b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:27.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fc8c7a700 1 --2- 172.21.15.49:0/3496957066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc415c0a0 0x7f3fc40c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:27.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fc3fff700 1 -- 172.21.15.49:0/3496957066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc415c0a0 msgr2=0x7f3fc40c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:27.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fc3fff700 1 --2- 172.21.15.49:0/3496957066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc415c0a0 0x7f3fc40c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fc3fff700 1 -- 172.21.15.49:0/3496957066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc40cb800 msgr2=0x7f3fc40b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:27.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fc3fff700 1 --2- 172.21.15.49:0/3496957066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc40cb800 0x7f3fc40b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fc3fff700 1 -- 172.21.15.49:0/3496957066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb80094b0 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fc3fff700 1 --2- 172.21.15.49:0/3496957066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc40ab8d0 0x7f3fc41f1660 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400c6d0 tx=0x7f3fb400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:27.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fc0ff9700 1 -- 172.21.15.49:0/3496957066 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4004ca0 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fc0ff9700 1 -- 172.21.15.49:0/3496957066 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb4004e20 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fc0ff9700 1 -- 172.21.15.49:0/3496957066 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4007310 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.647+0000 7f3fca6dd700 1 -- 172.21.15.49:0/3496957066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc40b3770 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.651+0000 7f3fca6dd700 1 -- 172.21.15.49:0/3496957066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc40b3d30 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.651+0000 7f3fca6dd700 1 -- 172.21.15.49:0/3496957066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc404dcb0 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.651+0000 7f3fc0ff9700 1 -- 172.21.15.49:0/3496957066 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3fb4007470 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.655+0000 7f3fc0ff9700 1 --2- 172.21.15.49:0/3496957066 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fb00662f0 0x7f3fb00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:27.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.655+0000 7f3fc0ff9700 1 -- 172.21.15.49:0/3496957066 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3fb4083090 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.655+0000 7f3fc37fe700 1 --2- 172.21.15.49:0/3496957066 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fb00662f0 0x7f3fb00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:27.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.655+0000 7f3fc37fe700 1 --2- 172.21.15.49:0/3496957066 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fb00662f0 0x7f3fb00687a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009880 tx=0x7f3fb8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:27.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.659+0000 7f3fc0ff9700 1 -- 172.21.15.49:0/3496957066 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3fb4050460 con 0x7f3fc40ab8d0 2023-07-21T22:12:27.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.839+0000 7f3fca6dd700 1 -- 172.21.15.49:0/3496957066 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fc40b3320 con 0x7f3fb00662f0 2023-07-21T22:12:27.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.851+0000 7f3fc0ff9700 1 -- 172.21.15.49:0/3496957066 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297531 (secure 0 0 0) 0x7f3fc40b3320 con 0x7f3fb00662f0 2023-07-21T22:12:27.898 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:27.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.859+0000 7f3fca6dd700 1 -- 172.21.15.49:0/3496957066 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fb00662f0 msgr2=0x7f3fb00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:27.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.859+0000 7f3fca6dd700 1 --2- 172.21.15.49:0/3496957066 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fb00662f0 0x7f3fb00687a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009880 tx=0x7f3fb8010000 comp rx=0 tx=0).stop 2023-07-21T22:12:27.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.859+0000 7f3fca6dd700 1 -- 172.21.15.49:0/3496957066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc40ab8d0 msgr2=0x7f3fc41f1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:27.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.859+0000 7f3fca6dd700 1 --2- 172.21.15.49:0/3496957066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc40ab8d0 0x7f3fc41f1660 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400c6d0 tx=0x7f3fb400ca90 comp rx=0 tx=0).stop 2023-07-21T22:12:27.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.859+0000 7f3fca6dd700 1 -- 172.21.15.49:0/3496957066 shutdown_connections 2023-07-21T22:12:27.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.859+0000 7f3fca6dd700 1 --2- 172.21.15.49:0/3496957066 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fb00662f0 0x7f3fb00687a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.859+0000 7f3fca6dd700 1 --2- 172.21.15.49:0/3496957066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fc415c0a0 0x7f3fc40c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.859+0000 7f3fca6dd700 1 --2- 172.21.15.49:0/3496957066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc40cb800 0x7f3fc40b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.859+0000 7f3fca6dd700 1 --2- 172.21.15.49:0/3496957066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc40ab8d0 0x7f3fc41f1660 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:27.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.859+0000 7f3fca6dd700 1 -- 172.21.15.49:0/3496957066 >> 172.21.15.49:0/3496957066 conn(0x7f3fc406f5a0 msgr2=0x7f3fc40ad350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:27.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.859+0000 7f3fca6dd700 1 -- 172.21.15.49:0/3496957066 shutdown_connections 2023-07-21T22:12:27.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:27.859+0000 7f3fca6dd700 1 -- 172.21.15.49:0/3496957066 wait complete. 2023-07-21T22:12:27.906 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:12:27.924 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-07-21T22:12:26.344466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":88,"acting":88,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236812,"kb_used_data":4812,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754737908,"statfs":{"total":773094113280,"available":772851617792,"internally_reserved":0,"allocated":4927488,"data_stored":2798345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.767528"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380969+0000","last_change":"2023-07-21T22:12:22.633465+0000","last_active":"2023-07-21T22:12:24.380969+0000","last_peered":"2023-07-21T22:12:24.380969+0000","last_clean":"2023-07-21T22:12:24.380969+0000","last_became_active":"2023-07-21T22:12:22.633130+0000","last_became_peered":"2023-07-21T22:12:22.633130+0000","last_unstale":"2023-07-21T22:12:24.380969+0000","last_undegraded":"2023-07-21T22:12:24.380969+0000","last_fullsized":"2023-07-21T22:12:24.380969+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:12:44.009405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.581923+0000","last_change":"2023-07-21T22:12:20.581923+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.581923+0000","last_undegraded":"2023-07-21T22:12:20.581923+0000","last_fullsized":"2023-07-21T22:12:20.581923+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580400+0000","last_change":"2023-07-21T22:12:20.580400+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580400+0000","last_undegraded":"2023-07-21T22:12:20.580400+0000","last_fullsized":"2023-07-21T22:12:20.580400+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382287+0000","last_change":"2023-07-21T22:12:21.607987+0000","last_active":"2023-07-21T22:12:24.382287+0000","last_peered":"2023-07-21T22:12:24.382287+0000","last_clean":"2023-07-21T22:12:24.382287+0000","last_became_active":"2023-07-21T22:12:21.607205+0000","last_became_peered":"2023-07-21T22:12:21.607205+0000","last_unstale":"2023-07-21T22:12:24.382287+0000","last_undegraded":"2023-07-21T22:12:24.382287+0000","last_fullsized":"2023-07-21T22:12:24.382287+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:48.071266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381990+0000","last_change":"2023-07-21T22:12:22.642404+0000","last_active":"2023-07-21T22:12:24.381990+0000","last_peered":"2023-07-21T22:12:24.381990+0000","last_clean":"2023-07-21T22:12:24.381990+0000","last_became_active":"2023-07-21T22:12:22.642006+0000","last_became_peered":"2023-07-21T22:12:22.642006+0000","last_unstale":"2023-07-21T22:12:24.381990+0000","last_undegraded":"2023-07-21T22:12:24.381990+0000","last_fullsized":"2023-07-21T22:12:24.381990+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:18:49.922082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583388+0000","last_change":"2023-07-21T22:12:20.583388+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583388+0000","last_undegraded":"2023-07-21T22:12:20.583388+0000","last_fullsized":"2023-07-21T22:12:20.583388+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.581688+0000","last_change":"2023-07-21T22:12:20.581688+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.581688+0000","last_undegraded":"2023-07-21T22:12:20.581688+0000","last_fullsized":"2023-07-21T22:12:20.581688+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580117+0000","last_change":"2023-07-21T22:12:20.580117+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580117+0000","last_undegraded":"2023-07-21T22:12:20.580117+0000","last_fullsized":"2023-07-21T22:12:20.580117+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579376+0000","last_change":"2023-07-21T22:12:20.579376+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579376+0000","last_undegraded":"2023-07-21T22:12:20.579376+0000","last_fullsized":"2023-07-21T22:12:20.579376+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.585923+0000","last_change":"2023-07-21T22:12:20.585923+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.585923+0000","last_undegraded":"2023-07-21T22:12:20.585923+0000","last_fullsized":"2023-07-21T22:12:20.585923+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579418+0000","last_change":"2023-07-21T22:12:20.579418+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579418+0000","last_undegraded":"2023-07-21T22:12:20.579418+0000","last_fullsized":"2023-07-21T22:12:20.579418+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.585044+0000","last_change":"2023-07-21T22:12:20.585044+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.585044+0000","last_undegraded":"2023-07-21T22:12:20.585044+0000","last_fullsized":"2023-07-21T22:12:20.585044+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.584443+0000","last_change":"2023-07-21T22:12:20.584443+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.584443+0000","last_undegraded":"2023-07-21T22:12:20.584443+0000","last_fullsized":"2023-07-21T22:12:20.584443+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.587786+0000","last_change":"2023-07-21T22:12:20.587786+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.587786+0000","last_undegraded":"2023-07-21T22:12:20.587786+0000","last_fullsized":"2023-07-21T22:12:20.587786+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580862+0000","last_change":"2023-07-21T22:12:20.580862+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580862+0000","last_undegraded":"2023-07-21T22:12:20.580862+0000","last_fullsized":"2023-07-21T22:12:20.580862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583153+0000","last_change":"2023-07-21T22:12:20.583153+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583153+0000","last_undegraded":"2023-07-21T22:12:20.583153+0000","last_fullsized":"2023-07-21T22:12:20.583153+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580128+0000","last_change":"2023-07-21T22:12:20.580128+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580128+0000","last_undegraded":"2023-07-21T22:12:20.580128+0000","last_fullsized":"2023-07-21T22:12:20.580128+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.585388+0000","last_change":"2023-07-21T22:12:20.585388+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.585388+0000","last_undegraded":"2023-07-21T22:12:20.585388+0000","last_fullsized":"2023-07-21T22:12:20.585388+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.587658+0000","last_change":"2023-07-21T22:12:20.587658+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.587658+0000","last_undegraded":"2023-07-21T22:12:20.587658+0000","last_fullsized":"2023-07-21T22:12:20.587658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579153+0000","last_change":"2023-07-21T22:12:20.579153+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579153+0000","last_undegraded":"2023-07-21T22:12:20.579153+0000","last_fullsized":"2023-07-21T22:12:20.579153+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579445+0000","last_change":"2023-07-21T22:12:20.579445+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579445+0000","last_undegraded":"2023-07-21T22:12:20.579445+0000","last_fullsized":"2023-07-21T22:12:20.579445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579939+0000","last_change":"2023-07-21T22:12:20.579939+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579939+0000","last_undegraded":"2023-07-21T22:12:20.579939+0000","last_fullsized":"2023-07-21T22:12:20.579939+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579938+0000","last_change":"2023-07-21T22:12:20.579938+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579938+0000","last_undegraded":"2023-07-21T22:12:20.579938+0000","last_fullsized":"2023-07-21T22:12:20.579938+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381004+0000","last_change":"2023-07-21T22:12:22.628639+0000","last_active":"2023-07-21T22:12:24.381004+0000","last_peered":"2023-07-21T22:12:24.381004+0000","last_clean":"2023-07-21T22:12:24.381004+0000","last_became_active":"2023-07-21T22:12:22.628353+0000","last_became_peered":"2023-07-21T22:12:22.628353+0000","last_unstale":"2023-07-21T22:12:24.381004+0000","last_undegraded":"2023-07-21T22:12:24.381004+0000","last_fullsized":"2023-07-21T22:12:24.381004+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:25.942541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.580292+0000","last_change":"2023-07-21T22:12:20.580292+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.580292+0000","last_undegraded":"2023-07-21T22:12:20.580292+0000","last_fullsized":"2023-07-21T22:12:20.580292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.584880+0000","last_change":"2023-07-21T22:12:20.584880+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.584880+0000","last_undegraded":"2023-07-21T22:12:20.584880+0000","last_fullsized":"2023-07-21T22:12:20.584880+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583080+0000","last_change":"2023-07-21T22:12:20.583080+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583080+0000","last_undegraded":"2023-07-21T22:12:20.583080+0000","last_fullsized":"2023-07-21T22:12:20.583080+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583278+0000","last_change":"2023-07-21T22:12:20.583278+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583278+0000","last_undegraded":"2023-07-21T22:12:20.583278+0000","last_fullsized":"2023-07-21T22:12:20.583278+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.583895+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:12:20.583895+0000","last_peered":"2023-07-21T22:12:20.583895+0000","last_clean":"2023-07-21T22:12:20.583895+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:12:20.583895+0000","last_undegraded":"2023-07-21T22:12:20.583895+0000","last_fullsized":"2023-07-21T22:12:20.583895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:14:59.136928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579208+0000","last_change":"2023-07-21T22:12:20.579208+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579208+0000","last_undegraded":"2023-07-21T22:12:20.579208+0000","last_fullsized":"2023-07-21T22:12:20.579208+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381126+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:12:24.381126+0000","last_peered":"2023-07-21T22:12:24.381126+0000","last_clean":"2023-07-21T22:12:24.381126+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:12:24.381126+0000","last_undegraded":"2023-07-21T22:12:24.381126+0000","last_fullsized":"2023-07-21T22:12:24.381126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:31:37.838038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380896+0000","last_change":"2023-07-21T22:12:21.611685+0000","last_active":"2023-07-21T22:12:24.380896+0000","last_peered":"2023-07-21T22:12:24.380896+0000","last_clean":"2023-07-21T22:12:24.380896+0000","last_became_active":"2023-07-21T22:12:21.611382+0000","last_became_peered":"2023-07-21T22:12:21.611382+0000","last_unstale":"2023-07-21T22:12:24.380896+0000","last_undegraded":"2023-07-21T22:12:24.380896+0000","last_fullsized":"2023-07-21T22:12:24.380896+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:05:47.955186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.585525+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:12:20.585525+0000","last_peered":"2023-07-21T22:12:20.585525+0000","last_clean":"2023-07-21T22:12:20.585525+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:12:20.585525+0000","last_undegraded":"2023-07-21T22:12:20.585525+0000","last_fullsized":"2023-07-21T22:12:20.585525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:22:21.165816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.584848+0000","last_change":"2023-07-21T22:12:20.584848+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.584848+0000","last_undegraded":"2023-07-21T22:12:20.584848+0000","last_fullsized":"2023-07-21T22:12:20.584848+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381102+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:12:24.381102+0000","last_peered":"2023-07-21T22:12:24.381102+0000","last_clean":"2023-07-21T22:12:24.381102+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:12:24.381102+0000","last_undegraded":"2023-07-21T22:12:24.381102+0000","last_fullsized":"2023-07-21T22:12:24.381102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:38.424071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.579728+0000","last_change":"2023-07-21T22:12:20.579728+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.579728+0000","last_undegraded":"2023-07-21T22:12:20.579728+0000","last_fullsized":"2023-07-21T22:12:20.579728+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.581000+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:12:20.581000+0000","last_peered":"2023-07-21T22:12:20.581000+0000","last_clean":"2023-07-21T22:12:20.581000+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:12:20.581000+0000","last_undegraded":"2023-07-21T22:12:20.581000+0000","last_fullsized":"2023-07-21T22:12:20.581000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:43.553038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.583936+0000","last_change":"2023-07-21T22:12:20.583936+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.583936+0000","last_undegraded":"2023-07-21T22:12:20.583936+0000","last_fullsized":"2023-07-21T22:12:20.583936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.588348+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:12:20.588348+0000","last_peered":"2023-07-21T22:12:20.588348+0000","last_clean":"2023-07-21T22:12:20.588348+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:12:20.588348+0000","last_undegraded":"2023-07-21T22:12:20.588348+0000","last_fullsized":"2023-07-21T22:12:20.588348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:15:59.904194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380888+0000","last_change":"2023-07-21T22:12:21.607945+0000","last_active":"2023-07-21T22:12:24.380888+0000","last_peered":"2023-07-21T22:12:24.380888+0000","last_clean":"2023-07-21T22:12:24.380888+0000","last_became_active":"2023-07-21T22:12:21.607453+0000","last_became_peered":"2023-07-21T22:12:21.607453+0000","last_unstale":"2023-07-21T22:12:24.380888+0000","last_undegraded":"2023-07-21T22:12:24.380888+0000","last_fullsized":"2023-07-21T22:12:24.380888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:06.804163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.584928+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:12:20.584928+0000","last_peered":"2023-07-21T22:12:20.584928+0000","last_clean":"2023-07-21T22:12:20.584928+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:12:20.584928+0000","last_undegraded":"2023-07-21T22:12:20.584928+0000","last_fullsized":"2023-07-21T22:12:20.584928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:43:49.744710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:12:21.574993+0000","last_change":"2023-07-21T22:12:21.574993+0000","last_active":"2023-07-21T22:12:21.574993+0000","last_peered":"2023-07-21T22:12:21.574993+0000","last_clean":"2023-07-21T22:12:21.574993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:21.574993+0000","last_undegraded":"2023-07-21T22:12:21.574993+0000","last_fullsized":"2023-07-21T22:12:21.574993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-07-21T22:12:20.581493+0000","last_change":"2023-07-21T22:12:20.581493+0000","last_active":"2023-07-21T22:12:20.562296+0000","last_peered":"2023-07-21T22:12:20.562296+0000","last_clean":"2023-07-21T22:12:20.562296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:12:20.581493+0000","last_undegraded":"2023-07-21T22:12:20.581493+0000","last_fullsized":"2023-07-21T22:12:20.581493+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.580877+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:12:20.580877+0000","last_peered":"2023-07-21T22:12:20.580877+0000","last_clean":"2023-07-21T22:12:20.580877+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:12:20.580877+0000","last_undegraded":"2023-07-21T22:12:20.580877+0000","last_fullsized":"2023-07-21T22:12:20.580877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:54:41.899398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":199,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-21T22:12:20.584999+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:12:20.584999+0000","last_peered":"2023-07-21T22:12:20.584999+0000","last_clean":"2023-07-21T22:12:20.584999+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:12:20.584999+0000","last_undegraded":"2023-07-21T22:12:20.584999+0000","last_fullsized":"2023-07-21T22:12:20.584999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:25:44.419102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":6,"acting":6,"num_store_stats":1},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":1048576,"data_stored":785834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.1319999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.218}]},{"osd":2,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.512},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.2649999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.6200000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.464}]},{"osd":5,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.288}]},{"osd":6,"last update":"Fri Jul 21 22:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.7869999999999999,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.476,"5min":2.476,"15min":2.476},"last":1.5589999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":201956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":1.488}]},{"osd":1,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.002},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.3919999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.911,"5min":2.911,"15min":2.911},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.4399999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.611},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":1.204}]},{"osd":4,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":4.2779999999999996,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.571}]},{"osd":5,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.6339999999999999,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.6539999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":4.194,"5min":4.194,"15min":4.194},"last":1.8979999999999999},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":2.5379999999999998,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.78}]}]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":201956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.66700000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.143}]},{"osd":2,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.95099999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.4179999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.3169999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.369},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.8839999999999999,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.391}]}]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":201956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.71699999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.111}]},{"osd":2,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.621}]},{"osd":3,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.153}]},{"osd":5,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.028}]},{"osd":6,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.242}]}]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":466944,"data_stored":201956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.72799999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.0269999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.153},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.3169999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.242},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.2030000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.585},{"interface":"front","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.377}]},{"osd":6,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.6739999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.734},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.4390000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":454656,"data_stored":195466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.1000000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.246}]},{"osd":3,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":1.202},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.92600000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.3440000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":3.331,"5min":3.331,"15min":3.331},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.4370000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.633,"5min":2.633,"15min":2.633},"last":1.377},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.155}]},{"osd":7,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":3.0569999999999999,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.319}]}]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":1048576,"data_stored":785834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.68500000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.0229999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.234},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.1060000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.3200000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":1.548}]},{"osd":6,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.385},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.415}]},{"osd":7,"last update":"Fri Jul 21 22:11:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":2.5990000000000002,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":1.8540000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542173,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":507904,"data_stored":223387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89800000000000002,"15min":0.90000000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.3109999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.403,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.91000000000000003,"15min":0.90400000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":1.246},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.1040000000000001,"15min":1.125},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.0190000000000001,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.2070000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.3680000000000001,"15min":1.4099999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.444,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.2350000000000001,"15min":1.2669999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.881,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":1.4970000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.3049999999999999,"15min":1.3180000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6910000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.393},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.288,"15min":1.3069999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":3.0419999999999998,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.367}]},{"osd":5,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.3500000000000001,"15min":1.3720000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.534},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.4630000000000001,"15min":1.494},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0630000000000002,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.581}]},{"osd":6,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.4159999999999999,"15min":1.4359999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.738,"5min":2.238,"15min":2.238},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.4359999999999999,"15min":1.45},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":2.1000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.534,"15min":1.5589999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.3250000000000002,"5min":4.391,"15min":4.391},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.508,"15min":1.526},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7849999999999999,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.6990000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:12:27.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-07-21T22:12:27.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-07-21T22:12:27.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-07-21T22:12:27.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-07-21T22:12:27.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-07-21T22:12:27.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-07-21T22:12:27.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-07-21T22:12:27.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-07-21T22:12:27.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-07-21T22:12:27.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-07-21T22:12:27.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-07-21T22:12:27.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-07-21T22:12:27.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-07-21T22:12:27.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-07-21T22:12:27.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-07-21T22:12:27.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-07-21T22:12:27.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-07-21T22:12:27.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-07-21T22:12:27.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-07-21T22:12:27.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-07-21T22:12:27.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-07-21T22:12:27.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-07-21T22:12:27.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-07-21T22:12:27.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-07-21T22:12:27.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-07-21T22:12:27.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-07-21T22:12:27.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-07-21T22:12:27.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-07-21T22:12:27.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-07-21T22:12:27.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-07-21T22:12:27.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-07-21T22:12:27.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-07-21T22:12:27.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-07-21T22:12:27.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.581923+0000', 'last_change': '2023-07-21T22:12:20.581923+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.581923+0000', 'last_undegraded': '2023-07-21T22:12:20.581923+0000', 'last_fullsized': '2023-07-21T22:12:20.581923+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:12:27.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-07-21T22:12:27.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-07-21T22:12:27.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.580400+0000', 'last_change': '2023-07-21T22:12:20.580400+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.580400+0000', 'last_undegraded': '2023-07-21T22:12:20.580400+0000', 'last_fullsized': '2023-07-21T22:12:20.580400+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:12:27.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-07-21T22:12:27.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-07-21T22:12:27.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.583388+0000', 'last_change': '2023-07-21T22:12:20.583388+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.583388+0000', 'last_undegraded': '2023-07-21T22:12:20.583388+0000', 'last_fullsized': '2023-07-21T22:12:20.583388+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:12:27.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-07-21T22:12:27.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-07-21T22:12:27.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.581688+0000', 'last_change': '2023-07-21T22:12:20.581688+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.581688+0000', 'last_undegraded': '2023-07-21T22:12:20.581688+0000', 'last_fullsized': '2023-07-21T22:12:20.581688+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:12:27.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-07-21T22:12:27.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-07-21T22:12:27.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.580117+0000', 'last_change': '2023-07-21T22:12:20.580117+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.580117+0000', 'last_undegraded': '2023-07-21T22:12:20.580117+0000', 'last_fullsized': '2023-07-21T22:12:20.580117+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:12:27.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-07-21T22:12:27.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-07-21T22:12:27.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.579376+0000', 'last_change': '2023-07-21T22:12:20.579376+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.579376+0000', 'last_undegraded': '2023-07-21T22:12:20.579376+0000', 'last_fullsized': '2023-07-21T22:12:20.579376+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:12:27.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-07-21T22:12:27.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-07-21T22:12:27.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.585923+0000', 'last_change': '2023-07-21T22:12:20.585923+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.585923+0000', 'last_undegraded': '2023-07-21T22:12:20.585923+0000', 'last_fullsized': '2023-07-21T22:12:20.585923+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:12:27.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-07-21T22:12:27.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-07-21T22:12:27.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.579418+0000', 'last_change': '2023-07-21T22:12:20.579418+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.579418+0000', 'last_undegraded': '2023-07-21T22:12:20.579418+0000', 'last_fullsized': '2023-07-21T22:12:20.579418+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:12:27.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-07-21T22:12:27.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-07-21T22:12:27.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.585044+0000', 'last_change': '2023-07-21T22:12:20.585044+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.585044+0000', 'last_undegraded': '2023-07-21T22:12:20.585044+0000', 'last_fullsized': '2023-07-21T22:12:20.585044+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:12:27.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-07-21T22:12:27.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-07-21T22:12:27.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.584443+0000', 'last_change': '2023-07-21T22:12:20.584443+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.584443+0000', 'last_undegraded': '2023-07-21T22:12:20.584443+0000', 'last_fullsized': '2023-07-21T22:12:20.584443+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:12:27.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-07-21T22:12:27.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-07-21T22:12:27.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.587786+0000', 'last_change': '2023-07-21T22:12:20.587786+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.587786+0000', 'last_undegraded': '2023-07-21T22:12:20.587786+0000', 'last_fullsized': '2023-07-21T22:12:20.587786+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:12:27.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-07-21T22:12:27.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-07-21T22:12:27.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.580862+0000', 'last_change': '2023-07-21T22:12:20.580862+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.580862+0000', 'last_undegraded': '2023-07-21T22:12:20.580862+0000', 'last_fullsized': '2023-07-21T22:12:20.580862+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:12:27.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-07-21T22:12:27.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-07-21T22:12:27.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.583153+0000', 'last_change': '2023-07-21T22:12:20.583153+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.583153+0000', 'last_undegraded': '2023-07-21T22:12:20.583153+0000', 'last_fullsized': '2023-07-21T22:12:20.583153+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:12:27.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-07-21T22:12:27.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-07-21T22:12:27.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.580128+0000', 'last_change': '2023-07-21T22:12:20.580128+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.580128+0000', 'last_undegraded': '2023-07-21T22:12:20.580128+0000', 'last_fullsized': '2023-07-21T22:12:20.580128+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:12:27.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-07-21T22:12:27.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-07-21T22:12:27.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.585388+0000', 'last_change': '2023-07-21T22:12:20.585388+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.585388+0000', 'last_undegraded': '2023-07-21T22:12:20.585388+0000', 'last_fullsized': '2023-07-21T22:12:20.585388+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:12:27.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-07-21T22:12:27.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-07-21T22:12:27.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.587658+0000', 'last_change': '2023-07-21T22:12:20.587658+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.587658+0000', 'last_undegraded': '2023-07-21T22:12:20.587658+0000', 'last_fullsized': '2023-07-21T22:12:20.587658+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:12:27.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-07-21T22:12:27.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-07-21T22:12:27.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.579153+0000', 'last_change': '2023-07-21T22:12:20.579153+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.579153+0000', 'last_undegraded': '2023-07-21T22:12:20.579153+0000', 'last_fullsized': '2023-07-21T22:12:20.579153+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:12:27.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-07-21T22:12:27.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-07-21T22:12:27.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.579445+0000', 'last_change': '2023-07-21T22:12:20.579445+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.579445+0000', 'last_undegraded': '2023-07-21T22:12:20.579445+0000', 'last_fullsized': '2023-07-21T22:12:20.579445+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:12:27.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-07-21T22:12:27.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-07-21T22:12:27.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.579939+0000', 'last_change': '2023-07-21T22:12:20.579939+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.579939+0000', 'last_undegraded': '2023-07-21T22:12:20.579939+0000', 'last_fullsized': '2023-07-21T22:12:20.579939+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:12:27.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-07-21T22:12:27.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-07-21T22:12:27.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.579938+0000', 'last_change': '2023-07-21T22:12:20.579938+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.579938+0000', 'last_undegraded': '2023-07-21T22:12:20.579938+0000', 'last_fullsized': '2023-07-21T22:12:20.579938+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:12:27.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-07-21T22:12:27.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.580292+0000', 'last_change': '2023-07-21T22:12:20.580292+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.580292+0000', 'last_undegraded': '2023-07-21T22:12:20.580292+0000', 'last_fullsized': '2023-07-21T22:12:20.580292+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:12:27.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-07-21T22:12:27.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-07-21T22:12:27.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.584880+0000', 'last_change': '2023-07-21T22:12:20.584880+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.584880+0000', 'last_undegraded': '2023-07-21T22:12:20.584880+0000', 'last_fullsized': '2023-07-21T22:12:20.584880+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:12:27.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-07-21T22:12:27.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-07-21T22:12:27.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.583080+0000', 'last_change': '2023-07-21T22:12:20.583080+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.583080+0000', 'last_undegraded': '2023-07-21T22:12:20.583080+0000', 'last_fullsized': '2023-07-21T22:12:20.583080+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:12:27.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-07-21T22:12:27.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-07-21T22:12:27.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.583278+0000', 'last_change': '2023-07-21T22:12:20.583278+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.583278+0000', 'last_undegraded': '2023-07-21T22:12:20.583278+0000', 'last_fullsized': '2023-07-21T22:12:20.583278+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:12:27.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-07-21T22:12:27.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-07-21T22:12:27.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.579208+0000', 'last_change': '2023-07-21T22:12:20.579208+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.579208+0000', 'last_undegraded': '2023-07-21T22:12:20.579208+0000', 'last_fullsized': '2023-07-21T22:12:20.579208+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:12:27.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-07-21T22:12:27.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-07-21T22:12:27.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-07-21T22:12:27.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.584848+0000', 'last_change': '2023-07-21T22:12:20.584848+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.584848+0000', 'last_undegraded': '2023-07-21T22:12:20.584848+0000', 'last_fullsized': '2023-07-21T22:12:20.584848+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:12:27.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-07-21T22:12:27.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-07-21T22:12:27.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.579728+0000', 'last_change': '2023-07-21T22:12:20.579728+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.579728+0000', 'last_undegraded': '2023-07-21T22:12:20.579728+0000', 'last_fullsized': '2023-07-21T22:12:20.579728+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:12:27.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-07-21T22:12:27.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-07-21T22:12:27.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.583936+0000', 'last_change': '2023-07-21T22:12:20.583936+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.583936+0000', 'last_undegraded': '2023-07-21T22:12:20.583936+0000', 'last_fullsized': '2023-07-21T22:12:20.583936+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:12:27.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-07-21T22:12:27.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-07-21T22:12:27.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:12:21.574993+0000', 'last_change': '2023-07-21T22:12:21.574993+0000', 'last_active': '2023-07-21T22:12:21.574993+0000', 'last_peered': '2023-07-21T22:12:21.574993+0000', 'last_clean': '2023-07-21T22:12:21.574993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:21.574993+0000', 'last_undegraded': '2023-07-21T22:12:21.574993+0000', 'last_fullsized': '2023-07-21T22:12:21.574993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:21.574993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:12:27.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-07-21T22:12:27.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:12:20.581493+0000', 'last_change': '2023-07-21T22:12:20.581493+0000', 'last_active': '2023-07-21T22:12:20.562296+0000', 'last_peered': '2023-07-21T22:12:20.562296+0000', 'last_clean': '2023-07-21T22:12:20.562296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:12:20.581493+0000', 'last_undegraded': '2023-07-21T22:12:20.581493+0000', 'last_fullsized': '2023-07-21T22:12:20.581493+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'last_clean_scrub_stamp': '2023-07-21T22:12:20.562296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:12:27.994 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-21T22:12:28.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.127+0000 7f1bf0c5a700 1 Processor -- start 2023-07-21T22:12:28.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.127+0000 7f1bf0c5a700 1 -- start start 2023-07-21T22:12:28.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.127+0000 7f1bf0c5a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1bec0c9ba0 0x7f1bec159d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:28.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.127+0000 7f1bf0c5a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bec15d610 con 0x7f1bec06d470 2023-07-21T22:12:28.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.127+0000 7f1bf0c5a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bec0c4fe0 con 0x7f1bec0b0350 2023-07-21T22:12:28.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.127+0000 7f1bf0c5a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec15e4e0 con 0x7f1bec0c9ba0 2023-07-21T22:12:28.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1beb7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1bec06d470 0x7f1bec06d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49218/0 (socket says 172.21.15.49:49218) 2023-07-21T22:12:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1beb7fe700 1 -- 172.21.15.49:0/1443225953 learned_addr learned my addr 172.21.15.49:0/1443225953 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1be2ffd700 1 --2- 172.21.15.49:0/1443225953 >> v2:172.21.15.49:3300/0 conn(0x7f1bec0c9ba0 0x7f1bec159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1be2ffd700 1 -- 172.21.15.49:0/1443225953 >> v1:172.21.15.150:6789/0 conn(0x7f1bec0b0350 legacy=0x7f1bec0c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1be2ffd700 1 -- 172.21.15.49:0/1443225953 >> v1:172.21.15.49:6789/0 conn(0x7f1bec06d470 legacy=0x7f1bec06d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1be2ffd700 1 -- 172.21.15.49:0/1443225953 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec15d860 con 0x7f1bec0c9ba0 2023-07-21T22:12:28.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1be2ffd700 1 --2- 172.21.15.49:0/1443225953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bec0c9ba0 0x7f1bec159d40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009850 tx=0x7f1bd4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c4e739173ec38c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:28.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1beaffd700 1 -- 172.21.15.49:0/1443225953 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4004230 con 0x7f1bec0c9ba0 2023-07-21T22:12:28.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1beaffd700 1 -- 172.21.15.49:0/1443225953 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd4004390 con 0x7f1bec0c9ba0 2023-07-21T22:12:28.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1beaffd700 1 -- 172.21.15.49:0/1443225953 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd40036c0 con 0x7f1bec0c9ba0 2023-07-21T22:12:28.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/1443225953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bec0c9ba0 msgr2=0x7f1bec159d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:28.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1bf0c5a700 1 --2- 172.21.15.49:0/1443225953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bec0c9ba0 0x7f1bec159d40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009850 tx=0x7f1bd4009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:28.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/1443225953 shutdown_connections 2023-07-21T22:12:28.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1bf0c5a700 1 --2- 172.21.15.49:0/1443225953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bec0c9ba0 0x7f1bec159d40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/1443225953 >> 172.21.15.49:0/1443225953 conn(0x7f1bec06a530 msgr2=0x7f1bec0afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:28.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/1443225953 shutdown_connections 2023-07-21T22:12:28.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.131+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/1443225953 wait complete. 2023-07-21T22:12:28.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.135+0000 7f1bf0c5a700 1 Processor -- start 2023-07-21T22:12:28.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.135+0000 7f1bf0c5a700 1 -- start start 2023-07-21T22:12:28.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1bf0c5a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bec06d470 0x7f1bec0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:28.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1bf0c5a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bec0b0350 0x7f1bec149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:28.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1bf0c5a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bec0c9ba0 0x7f1bec0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:28.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1bf0c5a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0b3c30 con 0x7f1bec0b0350 2023-07-21T22:12:28.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1bf0c5a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec15d390 con 0x7f1bec06d470 2023-07-21T22:12:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1bf0c5a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0b10e0 con 0x7f1bec0c9ba0 2023-07-21T22:12:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1be2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bec0b0350 0x7f1bec149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1be2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bec0b0350 0x7f1bec149810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45910/0 (socket says 172.21.15.49:45910) 2023-07-21T22:12:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1be2ffd700 1 -- 172.21.15.49:0/3662722855 learned_addr learned my addr 172.21.15.49:0/3662722855 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:28.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1beb7fe700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bec06d470 0x7f1bec0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:28.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1bebfff700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bec0c9ba0 0x7f1bec0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:28.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1be2ffd700 1 -- 172.21.15.49:0/3662722855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bec0c9ba0 msgr2=0x7f1bec0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:28.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1be2ffd700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bec0c9ba0 0x7f1bec0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1be2ffd700 1 -- 172.21.15.49:0/3662722855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bec06d470 msgr2=0x7f1bec0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:28.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1be2ffd700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bec06d470 0x7f1bec0b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1be2ffd700 1 -- 172.21.15.49:0/3662722855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd40094b0 con 0x7f1bec0b0350 2023-07-21T22:12:28.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1beb7fe700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bec06d470 0x7f1bec0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:28.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1be2ffd700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bec0b0350 0x7f1bec149810 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4004000 tx=0x7f1bd4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:28.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1be8ff9700 1 -- 172.21.15.49:0/3662722855 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4006ea0 con 0x7f1bec0b0350 2023-07-21T22:12:28.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1be8ff9700 1 -- 172.21.15.49:0/3662722855 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd401f070 con 0x7f1bec0b0350 2023-07-21T22:12:28.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/3662722855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bec149d50 con 0x7f1bec0b0350 2023-07-21T22:12:28.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1be8ff9700 1 -- 172.21.15.49:0/3662722855 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4011a70 con 0x7f1bec0b0350 2023-07-21T22:12:28.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.139+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/3662722855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bec15d0b0 con 0x7f1bec0b0350 2023-07-21T22:12:28.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.143+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/3662722855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bec0b0f40 con 0x7f1bec0b0350 2023-07-21T22:12:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.143+0000 7f1be8ff9700 1 -- 172.21.15.49:0/3662722855 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1bd4021030 con 0x7f1bec0b0350 2023-07-21T22:12:28.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.147+0000 7f1be8ff9700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1bd00662f0 0x7f1bd00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:28.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.147+0000 7f1be8ff9700 1 -- 172.21.15.49:0/3662722855 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1bd4085480 con 0x7f1bec0b0350 2023-07-21T22:12:28.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.147+0000 7f1beb7fe700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1bd00662f0 0x7f1bd00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:28.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.147+0000 7f1beb7fe700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1bd00662f0 0x7f1bd00687a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc000f60 tx=0x7f1bdc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:28.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.151+0000 7f1be8ff9700 1 -- 172.21.15.49:0/3662722855 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1bec0b0f40 con 0x7f1bec0b0350 2023-07-21T22:12:28.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.387+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/3662722855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1bec0b0f40 con 0x7f1bec0b0350 2023-07-21T22:12:28.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.391+0000 7f1be8ff9700 1 -- 172.21.15.49:0/3662722855 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1171 (secure 0 0 0) 0x7f1bec0b0f40 con 0x7f1bec0b0350 2023-07-21T22:12:28.436 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:28.436 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":140,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":44,"num_osds":8,"num_up_osds":8,"osd_up_since":1689977420,"num_in_osds":8,"osd_in_since":1689977411,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":61},{"state_name":"creating+peering","count":29},{"state_name":"active+clean","count":15}],"num_pgs":105,"num_pools":4,"num_objects":3,"data_bytes":590368,"bytes_used":242495488,"bytes_avail":772851617792,"bytes_total":773094113280,"unknown_pgs_ratio":0.58095240592956543,"inactive_pgs_ratio":0.27619048953056335,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5631}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-07-21T22:11:40.327434+0000","services":{}},"progress_events":{}} 2023-07-21T22:12:28.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.391+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/3662722855 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1bd00662f0 msgr2=0x7f1bd00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:28.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.391+0000 7f1bf0c5a700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1bd00662f0 0x7f1bd00687a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc000f60 tx=0x7f1bdc009040 comp rx=0 tx=0).stop 2023-07-21T22:12:28.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.391+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/3662722855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bec0b0350 msgr2=0x7f1bec149810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:28.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.391+0000 7f1bf0c5a700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bec0b0350 0x7f1bec149810 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4004000 tx=0x7f1bd4004770 comp rx=0 tx=0).stop 2023-07-21T22:12:28.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.391+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/3662722855 shutdown_connections 2023-07-21T22:12:28.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.391+0000 7f1bf0c5a700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1bd00662f0 0x7f1bd00687a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.391+0000 7f1bf0c5a700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bec0b0350 0x7f1bec149810 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.391+0000 7f1bf0c5a700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bec0c9ba0 0x7f1bec0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.391+0000 7f1bf0c5a700 1 --2- 172.21.15.49:0/3662722855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bec06d470 0x7f1bec0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.391+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/3662722855 >> 172.21.15.49:0/3662722855 conn(0x7f1bec06a530 msgr2=0x7f1bec152700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:28.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.395+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/3662722855 shutdown_connections 2023-07-21T22:12:28.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.395+0000 7f1bf0c5a700 1 -- 172.21.15.49:0/3662722855 wait complete. 2023-07-21T22:12:28.462 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-21T22:12:28.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:12:28.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.599+0000 7f7d8f9cd700 1 Processor -- start 2023-07-21T22:12:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.599+0000 7f7d8f9cd700 1 -- start start 2023-07-21T22:12:28.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d8f9cd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7d880b0330 0x7f7d88070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:28.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d8f9cd700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d880cdd70 con 0x7f7d8815c0a0 2023-07-21T22:12:28.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d8f9cd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d880cda40 con 0x7f7d880ab8d0 2023-07-21T22:12:28.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d8f9cd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d880abdd0 con 0x7f7d880b0330 2023-07-21T22:12:28.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d8d769700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7d8815c0a0 0x7f7d880ad350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49234/0 (socket says 172.21.15.49:49234) 2023-07-21T22:12:28.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d8d769700 1 -- 172.21.15.49:0/150761661 learned_addr learned my addr 172.21.15.49:0/150761661 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:28.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d8df6a700 1 --2- 172.21.15.49:0/150761661 >> v2:172.21.15.150:3300/0 conn(0x7f7d880b0330 0x7f7d88070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:28.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d7ffff700 1 -- 172.21.15.49:0/150761661 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368549332 0 0) 0x7f7d880cda40 con 0x7f7d880ab8d0 2023-07-21T22:12:28.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d7ffff700 1 -- 172.21.15.49:0/150761661 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d740035d0 con 0x7f7d880ab8d0 2023-07-21T22:12:28.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d7ffff700 1 -- 172.21.15.49:0/150761661 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602135 0 0) 0x7f7d880cdd70 con 0x7f7d8815c0a0 2023-07-21T22:12:28.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d7ffff700 1 -- 172.21.15.49:0/150761661 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d880cda40 con 0x7f7d8815c0a0 2023-07-21T22:12:28.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d8df6a700 1 -- 172.21.15.49:0/150761661 >> v1:172.21.15.150:6789/0 conn(0x7f7d880ab8d0 legacy=0x7f7d880afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:28.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d8df6a700 1 -- 172.21.15.49:0/150761661 >> v1:172.21.15.49:6789/0 conn(0x7f7d8815c0a0 legacy=0x7f7d880ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d8df6a700 1 -- 172.21.15.49:0/150761661 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d880cccc0 con 0x7f7d880b0330 2023-07-21T22:12:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d8df6a700 1 --2- 172.21.15.49:0/150761661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d880b0330 0x7f7d88070600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009d90 tx=0x7f7d8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a49e80fe31d5f978 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d7ffff700 1 -- 172.21.15.49:0/150761661 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000e070 con 0x7f7d880b0330 2023-07-21T22:12:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d7ffff700 1 -- 172.21.15.49:0/150761661 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8000bb20 con 0x7f7d880b0330 2023-07-21T22:12:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.603+0000 7f7d7ffff700 1 -- 172.21.15.49:0/150761661 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000be90 con 0x7f7d880b0330 2023-07-21T22:12:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.607+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/150761661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d880b0330 msgr2=0x7f7d88070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.607+0000 7f7d8f9cd700 1 --2- 172.21.15.49:0/150761661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d880b0330 0x7f7d88070600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009d90 tx=0x7f7d8000b330 comp rx=0 tx=0).stop 2023-07-21T22:12:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.607+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/150761661 shutdown_connections 2023-07-21T22:12:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.607+0000 7f7d8f9cd700 1 --2- 172.21.15.49:0/150761661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d880b0330 0x7f7d88070600 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.607+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/150761661 >> 172.21.15.49:0/150761661 conn(0x7f7d8806f5a0 msgr2=0x7f7d880cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.607+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/150761661 shutdown_connections 2023-07-21T22:12:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.607+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/150761661 wait complete. 2023-07-21T22:12:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.607+0000 7f7d8f9cd700 1 Processor -- start 2023-07-21T22:12:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.607+0000 7f7d8f9cd700 1 -- start start 2023-07-21T22:12:28.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8f9cd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d880ab8d0 0x7f7d880c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:28.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8f9cd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d880b0330 0x7f7d881f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:28.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8f9cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d8815c0a0 0x7f7d880c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:28.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8f9cd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d881f2980 con 0x7f7d8815c0a0 2023-07-21T22:12:28.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8f9cd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d881f4c70 con 0x7f7d880ab8d0 2023-07-21T22:12:28.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8f9cd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d881f52a0 con 0x7f7d880b0330 2023-07-21T22:12:28.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8df6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d8815c0a0 0x7f7d880c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:28.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8df6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d8815c0a0 0x7f7d880c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45922/0 (socket says 172.21.15.49:45922) 2023-07-21T22:12:28.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8df6a700 1 -- 172.21.15.49:0/1409901979 learned_addr learned my addr 172.21.15.49:0/1409901979 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:28.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8d769700 1 --2- 172.21.15.49:0/1409901979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d880ab8d0 0x7f7d880c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8cf68700 1 --2- 172.21.15.49:0/1409901979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d880b0330 0x7f7d881f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8df6a700 1 -- 172.21.15.49:0/1409901979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d880b0330 msgr2=0x7f7d881f4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8df6a700 1 --2- 172.21.15.49:0/1409901979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d880b0330 0x7f7d881f4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8df6a700 1 -- 172.21.15.49:0/1409901979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d880ab8d0 msgr2=0x7f7d880c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8df6a700 1 --2- 172.21.15.49:0/1409901979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d880ab8d0 0x7f7d880c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8df6a700 1 -- 172.21.15.49:0/1409901979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d80009a70 con 0x7f7d8815c0a0 2023-07-21T22:12:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8df6a700 1 --2- 172.21.15.49:0/1409901979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d8815c0a0 0x7f7d880c87d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7d8806b800 tx=0x7f7d80004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d7dffb700 1 -- 172.21.15.49:0/1409901979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d800098f0 con 0x7f7d8815c0a0 2023-07-21T22:12:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d7dffb700 1 -- 172.21.15.49:0/1409901979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d80020070 con 0x7f7d8815c0a0 2023-07-21T22:12:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/1409901979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d881f5580 con 0x7f7d8815c0a0 2023-07-21T22:12:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d7dffb700 1 -- 172.21.15.49:0/1409901979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d800276c0 con 0x7f7d8815c0a0 2023-07-21T22:12:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.611+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/1409901979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d881f5b40 con 0x7f7d8815c0a0 2023-07-21T22:12:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.615+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/1409901979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d881f2ac0 con 0x7f7d8815c0a0 2023-07-21T22:12:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.615+0000 7f7d7dffb700 1 -- 172.21.15.49:0/1409901979 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d80012430 con 0x7f7d8815c0a0 2023-07-21T22:12:28.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.619+0000 7f7d7dffb700 1 --2- 172.21.15.49:0/1409901979 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7d6c0662f0 0x7f7d6c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:28.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.619+0000 7f7d7dffb700 1 -- 172.21.15.49:0/1409901979 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7d80022070 con 0x7f7d8815c0a0 2023-07-21T22:12:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.619+0000 7f7d8d769700 1 --2- 172.21.15.49:0/1409901979 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7d6c0662f0 0x7f7d6c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.619+0000 7f7d8d769700 1 --2- 172.21.15.49:0/1409901979 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7d6c0662f0 0x7f7d6c0687a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7d84005930 tx=0x7f7d84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:28.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.623+0000 7f7d7dffb700 1 -- 172.21.15.49:0/1409901979 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d80052fc0 con 0x7f7d8815c0a0 2023-07-21T22:12:28.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.787+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/1409901979 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d880ccfa0 con 0x7f7d6c0662f0 2023-07-21T22:12:28.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.803+0000 7f7d7dffb700 1 -- 172.21.15.49:0/1409901979 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308637 (secure 0 0 0) 0x7f7d840013e0 con 0x7f7d6c0662f0 2023-07-21T22:12:28.851 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:28.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.811+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/1409901979 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7d6c0662f0 msgr2=0x7f7d6c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:28.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.811+0000 7f7d8f9cd700 1 --2- 172.21.15.49:0/1409901979 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7d6c0662f0 0x7f7d6c0687a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7d84005930 tx=0x7f7d84009040 comp rx=0 tx=0).stop 2023-07-21T22:12:28.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.811+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/1409901979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d8815c0a0 msgr2=0x7f7d880c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:28.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.811+0000 7f7d8f9cd700 1 --2- 172.21.15.49:0/1409901979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d8815c0a0 0x7f7d880c87d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7d8806b800 tx=0x7f7d80004af0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.811+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/1409901979 shutdown_connections 2023-07-21T22:12:28.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.811+0000 7f7d8f9cd700 1 --2- 172.21.15.49:0/1409901979 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7d6c0662f0 0x7f7d6c0687a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.811+0000 7f7d8f9cd700 1 --2- 172.21.15.49:0/1409901979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d8815c0a0 0x7f7d880c87d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.811+0000 7f7d8f9cd700 1 --2- 172.21.15.49:0/1409901979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d880b0330 0x7f7d881f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.811+0000 7f7d8f9cd700 1 --2- 172.21.15.49:0/1409901979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d880ab8d0 0x7f7d880c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:28.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.811+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/1409901979 >> 172.21.15.49:0/1409901979 conn(0x7f7d8806f5a0 msgr2=0x7f7d8815a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:28.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.811+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/1409901979 shutdown_connections 2023-07-21T22:12:28.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:28.811+0000 7f7d8f9cd700 1 -- 172.21.15.49:0/1409901979 wait complete. 2023-07-21T22:12:28.860 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:12:28.879 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-07-21T22:12:28.345091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237160,"kb_used_data":5160,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754737560,"statfs":{"total":773094113280,"available":772851261440,"internally_reserved":0,"allocated":5283840,"data_stored":2971996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.759469"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379624+0000","last_change":"2023-07-21T22:12:22.646898+0000","last_active":"2023-07-21T22:12:24.379624+0000","last_peered":"2023-07-21T22:12:24.379624+0000","last_clean":"2023-07-21T22:12:24.379624+0000","last_became_active":"2023-07-21T22:12:22.646588+0000","last_became_peered":"2023-07-21T22:12:22.646588+0000","last_unstale":"2023-07-21T22:12:24.379624+0000","last_undegraded":"2023-07-21T22:12:24.379624+0000","last_fullsized":"2023-07-21T22:12:24.379624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:05.465644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628863+0000","last_change":"2023-07-21T22:12:22.647456+0000","last_active":"2023-07-21T22:12:23.628863+0000","last_peered":"2023-07-21T22:12:23.628863+0000","last_clean":"2023-07-21T22:12:23.628863+0000","last_became_active":"2023-07-21T22:12:22.647150+0000","last_became_peered":"2023-07-21T22:12:22.647150+0000","last_unstale":"2023-07-21T22:12:23.628863+0000","last_undegraded":"2023-07-21T22:12:23.628863+0000","last_fullsized":"2023-07-21T22:12:23.628863+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:40:43.274392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629157+0000","last_change":"2023-07-21T22:12:22.626076+0000","last_active":"2023-07-21T22:12:23.629157+0000","last_peered":"2023-07-21T22:12:23.629157+0000","last_clean":"2023-07-21T22:12:23.629157+0000","last_became_active":"2023-07-21T22:12:22.625776+0000","last_became_peered":"2023-07-21T22:12:22.625776+0000","last_unstale":"2023-07-21T22:12:23.629157+0000","last_undegraded":"2023-07-21T22:12:23.629157+0000","last_fullsized":"2023-07-21T22:12:23.629157+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:58:45.276996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382389+0000","last_change":"2023-07-21T22:12:22.649992+0000","last_active":"2023-07-21T22:12:24.382389+0000","last_peered":"2023-07-21T22:12:24.382389+0000","last_clean":"2023-07-21T22:12:24.382389+0000","last_became_active":"2023-07-21T22:12:22.643386+0000","last_became_peered":"2023-07-21T22:12:22.643386+0000","last_unstale":"2023-07-21T22:12:24.382389+0000","last_undegraded":"2023-07-21T22:12:24.382389+0000","last_fullsized":"2023-07-21T22:12:24.382389+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:42.739425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628533+0000","last_change":"2023-07-21T22:12:22.636090+0000","last_active":"2023-07-21T22:12:23.628533+0000","last_peered":"2023-07-21T22:12:23.628533+0000","last_clean":"2023-07-21T22:12:23.628533+0000","last_became_active":"2023-07-21T22:12:22.635758+0000","last_became_peered":"2023-07-21T22:12:22.635758+0000","last_unstale":"2023-07-21T22:12:23.628533+0000","last_undegraded":"2023-07-21T22:12:23.628533+0000","last_fullsized":"2023-07-21T22:12:23.628533+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:37:20.979605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.770684+0000","last_change":"2023-07-21T22:12:22.639506+0000","last_active":"2023-07-21T22:12:23.770684+0000","last_peered":"2023-07-21T22:12:23.770684+0000","last_clean":"2023-07-21T22:12:23.770684+0000","last_became_active":"2023-07-21T22:12:22.639225+0000","last_became_peered":"2023-07-21T22:12:22.639225+0000","last_unstale":"2023-07-21T22:12:23.770684+0000","last_undegraded":"2023-07-21T22:12:23.770684+0000","last_fullsized":"2023-07-21T22:12:23.770684+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:46:55.181788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379650+0000","last_change":"2023-07-21T22:12:22.646898+0000","last_active":"2023-07-21T22:12:24.379650+0000","last_peered":"2023-07-21T22:12:24.379650+0000","last_clean":"2023-07-21T22:12:24.379650+0000","last_became_active":"2023-07-21T22:12:22.646609+0000","last_became_peered":"2023-07-21T22:12:22.646609+0000","last_unstale":"2023-07-21T22:12:24.379650+0000","last_undegraded":"2023-07-21T22:12:24.379650+0000","last_fullsized":"2023-07-21T22:12:24.379650+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:51:36.688418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381451+0000","last_change":"2023-07-21T22:12:22.641776+0000","last_active":"2023-07-21T22:12:24.381451+0000","last_peered":"2023-07-21T22:12:24.381451+0000","last_clean":"2023-07-21T22:12:24.381451+0000","last_became_active":"2023-07-21T22:12:22.641466+0000","last_became_peered":"2023-07-21T22:12:22.641466+0000","last_unstale":"2023-07-21T22:12:24.381451+0000","last_undegraded":"2023-07-21T22:12:24.381451+0000","last_fullsized":"2023-07-21T22:12:24.381451+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:00.624292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382430+0000","last_change":"2023-07-21T22:12:22.648946+0000","last_active":"2023-07-21T22:12:24.382430+0000","last_peered":"2023-07-21T22:12:24.382430+0000","last_clean":"2023-07-21T22:12:24.382430+0000","last_became_active":"2023-07-21T22:12:22.648679+0000","last_became_peered":"2023-07-21T22:12:22.648679+0000","last_unstale":"2023-07-21T22:12:24.382430+0000","last_undegraded":"2023-07-21T22:12:24.382430+0000","last_fullsized":"2023-07-21T22:12:24.382430+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:02:44.072502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382471+0000","last_change":"2023-07-21T22:12:22.650401+0000","last_active":"2023-07-21T22:12:24.382471+0000","last_peered":"2023-07-21T22:12:24.382471+0000","last_clean":"2023-07-21T22:12:24.382471+0000","last_became_active":"2023-07-21T22:12:22.647782+0000","last_became_peered":"2023-07-21T22:12:22.647782+0000","last_unstale":"2023-07-21T22:12:24.382471+0000","last_undegraded":"2023-07-21T22:12:24.382471+0000","last_fullsized":"2023-07-21T22:12:24.382471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:08:35.885628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382770+0000","last_change":"2023-07-21T22:12:22.648596+0000","last_active":"2023-07-21T22:12:24.382770+0000","last_peered":"2023-07-21T22:12:24.382770+0000","last_clean":"2023-07-21T22:12:24.382770+0000","last_became_active":"2023-07-21T22:12:22.648273+0000","last_became_peered":"2023-07-21T22:12:22.648273+0000","last_unstale":"2023-07-21T22:12:24.382770+0000","last_undegraded":"2023-07-21T22:12:24.382770+0000","last_fullsized":"2023-07-21T22:12:24.382770+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:22:21.899677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628892+0000","last_change":"2023-07-21T22:12:22.633969+0000","last_active":"2023-07-21T22:12:23.628892+0000","last_peered":"2023-07-21T22:12:23.628892+0000","last_clean":"2023-07-21T22:12:23.628892+0000","last_became_active":"2023-07-21T22:12:22.633655+0000","last_became_peered":"2023-07-21T22:12:22.633655+0000","last_unstale":"2023-07-21T22:12:23.628892+0000","last_undegraded":"2023-07-21T22:12:23.628892+0000","last_fullsized":"2023-07-21T22:12:23.628892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:32:19.092336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628661+0000","last_change":"2023-07-21T22:12:22.639417+0000","last_active":"2023-07-21T22:12:23.628661+0000","last_peered":"2023-07-21T22:12:23.628661+0000","last_clean":"2023-07-21T22:12:23.628661+0000","last_became_active":"2023-07-21T22:12:22.638071+0000","last_became_peered":"2023-07-21T22:12:22.638071+0000","last_unstale":"2023-07-21T22:12:23.628661+0000","last_undegraded":"2023-07-21T22:12:23.628661+0000","last_fullsized":"2023-07-21T22:12:23.628661+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:32:59.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381999+0000","last_change":"2023-07-21T22:12:22.642279+0000","last_active":"2023-07-21T22:12:24.381999+0000","last_peered":"2023-07-21T22:12:24.381999+0000","last_clean":"2023-07-21T22:12:24.381999+0000","last_became_active":"2023-07-21T22:12:22.641640+0000","last_became_peered":"2023-07-21T22:12:22.641640+0000","last_unstale":"2023-07-21T22:12:24.381999+0000","last_undegraded":"2023-07-21T22:12:24.381999+0000","last_fullsized":"2023-07-21T22:12:24.381999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:17:24.498434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.770692+0000","last_change":"2023-07-21T22:12:22.644849+0000","last_active":"2023-07-21T22:12:23.770692+0000","last_peered":"2023-07-21T22:12:23.770692+0000","last_clean":"2023-07-21T22:12:23.770692+0000","last_became_active":"2023-07-21T22:12:22.644226+0000","last_became_peered":"2023-07-21T22:12:22.644226+0000","last_unstale":"2023-07-21T22:12:23.770692+0000","last_undegraded":"2023-07-21T22:12:23.770692+0000","last_fullsized":"2023-07-21T22:12:23.770692+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:03:04.298524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666207+0000","last_change":"2023-07-21T22:12:22.654856+0000","last_active":"2023-07-21T22:12:23.666207+0000","last_peered":"2023-07-21T22:12:23.666207+0000","last_clean":"2023-07-21T22:12:23.666207+0000","last_became_active":"2023-07-21T22:12:22.654571+0000","last_became_peered":"2023-07-21T22:12:22.654571+0000","last_unstale":"2023-07-21T22:12:23.666207+0000","last_undegraded":"2023-07-21T22:12:23.666207+0000","last_fullsized":"2023-07-21T22:12:23.666207+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:57.144115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.630007+0000","last_change":"2023-07-21T22:12:22.626117+0000","last_active":"2023-07-21T22:12:23.630007+0000","last_peered":"2023-07-21T22:12:23.630007+0000","last_clean":"2023-07-21T22:12:23.630007+0000","last_became_active":"2023-07-21T22:12:22.625780+0000","last_became_peered":"2023-07-21T22:12:22.625780+0000","last_unstale":"2023-07-21T22:12:23.630007+0000","last_undegraded":"2023-07-21T22:12:23.630007+0000","last_fullsized":"2023-07-21T22:12:23.630007+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:11:43.602036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629687+0000","last_change":"2023-07-21T22:12:22.633772+0000","last_active":"2023-07-21T22:12:23.629687+0000","last_peered":"2023-07-21T22:12:23.629687+0000","last_clean":"2023-07-21T22:12:23.629687+0000","last_became_active":"2023-07-21T22:12:22.633499+0000","last_became_peered":"2023-07-21T22:12:22.633499+0000","last_unstale":"2023-07-21T22:12:23.629687+0000","last_undegraded":"2023-07-21T22:12:23.629687+0000","last_fullsized":"2023-07-21T22:12:23.629687+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:42.535791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.667034+0000","last_change":"2023-07-21T22:12:22.654897+0000","last_active":"2023-07-21T22:12:23.667034+0000","last_peered":"2023-07-21T22:12:23.667034+0000","last_clean":"2023-07-21T22:12:23.667034+0000","last_became_active":"2023-07-21T22:12:22.654660+0000","last_became_peered":"2023-07-21T22:12:22.654660+0000","last_unstale":"2023-07-21T22:12:23.667034+0000","last_undegraded":"2023-07-21T22:12:23.667034+0000","last_fullsized":"2023-07-21T22:12:23.667034+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:44:21.789759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629098+0000","last_change":"2023-07-21T22:12:22.637690+0000","last_active":"2023-07-21T22:12:23.629098+0000","last_peered":"2023-07-21T22:12:23.629098+0000","last_clean":"2023-07-21T22:12:23.629098+0000","last_became_active":"2023-07-21T22:12:22.637145+0000","last_became_peered":"2023-07-21T22:12:22.637145+0000","last_unstale":"2023-07-21T22:12:23.629098+0000","last_undegraded":"2023-07-21T22:12:23.629098+0000","last_fullsized":"2023-07-21T22:12:23.629098+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:08:55.254364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771102+0000","last_change":"2023-07-21T22:12:22.660920+0000","last_active":"2023-07-21T22:12:23.771102+0000","last_peered":"2023-07-21T22:12:23.771102+0000","last_clean":"2023-07-21T22:12:23.771102+0000","last_became_active":"2023-07-21T22:12:22.660762+0000","last_became_peered":"2023-07-21T22:12:22.660762+0000","last_unstale":"2023-07-21T22:12:23.771102+0000","last_undegraded":"2023-07-21T22:12:23.771102+0000","last_fullsized":"2023-07-21T22:12:23.771102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:21:06.707045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382295+0000","last_change":"2023-07-21T22:12:22.642579+0000","last_active":"2023-07-21T22:12:24.382295+0000","last_peered":"2023-07-21T22:12:24.382295+0000","last_clean":"2023-07-21T22:12:24.382295+0000","last_became_active":"2023-07-21T22:12:22.642013+0000","last_became_peered":"2023-07-21T22:12:22.642013+0000","last_unstale":"2023-07-21T22:12:24.382295+0000","last_undegraded":"2023-07-21T22:12:24.382295+0000","last_fullsized":"2023-07-21T22:12:24.382295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:16:34.212178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666438+0000","last_change":"2023-07-21T22:12:22.639319+0000","last_active":"2023-07-21T22:12:23.666438+0000","last_peered":"2023-07-21T22:12:23.666438+0000","last_clean":"2023-07-21T22:12:23.666438+0000","last_became_active":"2023-07-21T22:12:22.639000+0000","last_became_peered":"2023-07-21T22:12:22.639000+0000","last_unstale":"2023-07-21T22:12:23.666438+0000","last_undegraded":"2023-07-21T22:12:23.666438+0000","last_fullsized":"2023-07-21T22:12:23.666438+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:07:59.649739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666177+0000","last_change":"2023-07-21T22:12:22.639408+0000","last_active":"2023-07-21T22:12:23.666177+0000","last_peered":"2023-07-21T22:12:23.666177+0000","last_clean":"2023-07-21T22:12:23.666177+0000","last_became_active":"2023-07-21T22:12:22.639077+0000","last_became_peered":"2023-07-21T22:12:22.639077+0000","last_unstale":"2023-07-21T22:12:23.666177+0000","last_undegraded":"2023-07-21T22:12:23.666177+0000","last_fullsized":"2023-07-21T22:12:23.666177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:18:12.567822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.667081+0000","last_change":"2023-07-21T22:12:22.651499+0000","last_active":"2023-07-21T22:12:23.667081+0000","last_peered":"2023-07-21T22:12:23.667081+0000","last_clean":"2023-07-21T22:12:23.667081+0000","last_became_active":"2023-07-21T22:12:22.651281+0000","last_became_peered":"2023-07-21T22:12:22.651281+0000","last_unstale":"2023-07-21T22:12:23.667081+0000","last_undegraded":"2023-07-21T22:12:23.667081+0000","last_fullsized":"2023-07-21T22:12:23.667081+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:08.579874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628988+0000","last_change":"2023-07-21T22:12:22.638877+0000","last_active":"2023-07-21T22:12:23.628988+0000","last_peered":"2023-07-21T22:12:23.628988+0000","last_clean":"2023-07-21T22:12:23.628988+0000","last_became_active":"2023-07-21T22:12:22.638598+0000","last_became_peered":"2023-07-21T22:12:22.638598+0000","last_unstale":"2023-07-21T22:12:23.628988+0000","last_undegraded":"2023-07-21T22:12:23.628988+0000","last_fullsized":"2023-07-21T22:12:23.628988+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:41:11.410251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629550+0000","last_change":"2023-07-21T22:12:22.626071+0000","last_active":"2023-07-21T22:12:23.629550+0000","last_peered":"2023-07-21T22:12:23.629550+0000","last_clean":"2023-07-21T22:12:23.629550+0000","last_became_active":"2023-07-21T22:12:22.625732+0000","last_became_peered":"2023-07-21T22:12:22.625732+0000","last_unstale":"2023-07-21T22:12:23.629550+0000","last_undegraded":"2023-07-21T22:12:23.629550+0000","last_fullsized":"2023-07-21T22:12:23.629550+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:37.462856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628629+0000","last_change":"2023-07-21T22:12:22.638119+0000","last_active":"2023-07-21T22:12:23.628629+0000","last_peered":"2023-07-21T22:12:23.628629+0000","last_clean":"2023-07-21T22:12:23.628629+0000","last_became_active":"2023-07-21T22:12:22.637145+0000","last_became_peered":"2023-07-21T22:12:22.637145+0000","last_unstale":"2023-07-21T22:12:23.628629+0000","last_undegraded":"2023-07-21T22:12:23.628629+0000","last_fullsized":"2023-07-21T22:12:23.628629+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:53:27.799339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666628+0000","last_change":"2023-07-21T22:12:22.645861+0000","last_active":"2023-07-21T22:12:23.666628+0000","last_peered":"2023-07-21T22:12:23.666628+0000","last_clean":"2023-07-21T22:12:23.666628+0000","last_became_active":"2023-07-21T22:12:22.645542+0000","last_became_peered":"2023-07-21T22:12:22.645542+0000","last_unstale":"2023-07-21T22:12:23.666628+0000","last_undegraded":"2023-07-21T22:12:23.666628+0000","last_fullsized":"2023-07-21T22:12:23.666628+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:50:17.975826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629325+0000","last_change":"2023-07-21T22:12:22.638133+0000","last_active":"2023-07-21T22:12:23.629325+0000","last_peered":"2023-07-21T22:12:23.629325+0000","last_clean":"2023-07-21T22:12:23.629325+0000","last_became_active":"2023-07-21T22:12:22.637849+0000","last_became_peered":"2023-07-21T22:12:22.637849+0000","last_unstale":"2023-07-21T22:12:23.629325+0000","last_undegraded":"2023-07-21T22:12:23.629325+0000","last_fullsized":"2023-07-21T22:12:23.629325+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:30:55.808186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.770755+0000","last_change":"2023-07-21T22:12:22.645052+0000","last_active":"2023-07-21T22:12:23.770755+0000","last_peered":"2023-07-21T22:12:23.770755+0000","last_clean":"2023-07-21T22:12:23.770755+0000","last_became_active":"2023-07-21T22:12:22.644587+0000","last_became_peered":"2023-07-21T22:12:22.644587+0000","last_unstale":"2023-07-21T22:12:23.770755+0000","last_undegraded":"2023-07-21T22:12:23.770755+0000","last_fullsized":"2023-07-21T22:12:23.770755+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:29.317320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628600+0000","last_change":"2023-07-21T22:12:22.634629+0000","last_active":"2023-07-21T22:12:23.628600+0000","last_peered":"2023-07-21T22:12:23.628600+0000","last_clean":"2023-07-21T22:12:23.628600+0000","last_became_active":"2023-07-21T22:12:22.634302+0000","last_became_peered":"2023-07-21T22:12:22.634302+0000","last_unstale":"2023-07-21T22:12:23.628600+0000","last_undegraded":"2023-07-21T22:12:23.628600+0000","last_fullsized":"2023-07-21T22:12:23.628600+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:54:25.574993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380969+0000","last_change":"2023-07-21T22:12:22.633465+0000","last_active":"2023-07-21T22:12:24.380969+0000","last_peered":"2023-07-21T22:12:24.380969+0000","last_clean":"2023-07-21T22:12:24.380969+0000","last_became_active":"2023-07-21T22:12:22.633130+0000","last_became_peered":"2023-07-21T22:12:22.633130+0000","last_unstale":"2023-07-21T22:12:24.380969+0000","last_undegraded":"2023-07-21T22:12:24.380969+0000","last_fullsized":"2023-07-21T22:12:24.380969+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:12:44.009405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771800+0000","last_change":"2023-07-21T22:12:21.609883+0000","last_active":"2023-07-21T22:12:23.771800+0000","last_peered":"2023-07-21T22:12:23.771800+0000","last_clean":"2023-07-21T22:12:23.771800+0000","last_became_active":"2023-07-21T22:12:21.607019+0000","last_became_peered":"2023-07-21T22:12:21.607019+0000","last_unstale":"2023-07-21T22:12:23.771800+0000","last_undegraded":"2023-07-21T22:12:23.771800+0000","last_fullsized":"2023-07-21T22:12:23.771800+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:47:40.623448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666983+0000","last_change":"2023-07-21T22:12:22.646133+0000","last_active":"2023-07-21T22:12:23.666983+0000","last_peered":"2023-07-21T22:12:23.666983+0000","last_clean":"2023-07-21T22:12:23.666983+0000","last_became_active":"2023-07-21T22:12:22.645867+0000","last_became_peered":"2023-07-21T22:12:22.645867+0000","last_unstale":"2023-07-21T22:12:23.666983+0000","last_undegraded":"2023-07-21T22:12:23.666983+0000","last_fullsized":"2023-07-21T22:12:23.666983+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:43.574673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629824+0000","last_change":"2023-07-21T22:12:21.608310+0000","last_active":"2023-07-21T22:12:23.629824+0000","last_peered":"2023-07-21T22:12:23.629824+0000","last_clean":"2023-07-21T22:12:23.629824+0000","last_became_active":"2023-07-21T22:12:21.608033+0000","last_became_peered":"2023-07-21T22:12:21.608033+0000","last_unstale":"2023-07-21T22:12:23.629824+0000","last_undegraded":"2023-07-21T22:12:23.629824+0000","last_fullsized":"2023-07-21T22:12:23.629824+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:05:58.216486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628832+0000","last_change":"2023-07-21T22:12:22.638321+0000","last_active":"2023-07-21T22:12:23.628832+0000","last_peered":"2023-07-21T22:12:23.628832+0000","last_clean":"2023-07-21T22:12:23.628832+0000","last_became_active":"2023-07-21T22:12:22.637151+0000","last_became_peered":"2023-07-21T22:12:22.637151+0000","last_unstale":"2023-07-21T22:12:23.628832+0000","last_undegraded":"2023-07-21T22:12:23.628832+0000","last_fullsized":"2023-07-21T22:12:23.628832+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:21:34.801017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382287+0000","last_change":"2023-07-21T22:12:21.607987+0000","last_active":"2023-07-21T22:12:24.382287+0000","last_peered":"2023-07-21T22:12:24.382287+0000","last_clean":"2023-07-21T22:12:24.382287+0000","last_became_active":"2023-07-21T22:12:21.607205+0000","last_became_peered":"2023-07-21T22:12:21.607205+0000","last_unstale":"2023-07-21T22:12:24.382287+0000","last_undegraded":"2023-07-21T22:12:24.382287+0000","last_fullsized":"2023-07-21T22:12:24.382287+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:48.071266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381990+0000","last_change":"2023-07-21T22:12:22.642404+0000","last_active":"2023-07-21T22:12:24.381990+0000","last_peered":"2023-07-21T22:12:24.381990+0000","last_clean":"2023-07-21T22:12:24.381990+0000","last_became_active":"2023-07-21T22:12:22.642006+0000","last_became_peered":"2023-07-21T22:12:22.642006+0000","last_unstale":"2023-07-21T22:12:24.381990+0000","last_undegraded":"2023-07-21T22:12:24.381990+0000","last_fullsized":"2023-07-21T22:12:24.381990+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:18:49.922082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379212+0000","last_change":"2023-07-21T22:12:21.603184+0000","last_active":"2023-07-21T22:12:24.379212+0000","last_peered":"2023-07-21T22:12:24.379212+0000","last_clean":"2023-07-21T22:12:24.379212+0000","last_became_active":"2023-07-21T22:12:21.602889+0000","last_became_peered":"2023-07-21T22:12:21.602889+0000","last_unstale":"2023-07-21T22:12:24.379212+0000","last_undegraded":"2023-07-21T22:12:24.379212+0000","last_fullsized":"2023-07-21T22:12:24.379212+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:43:27.198307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629324+0000","last_change":"2023-07-21T22:12:22.640449+0000","last_active":"2023-07-21T22:12:23.629324+0000","last_peered":"2023-07-21T22:12:23.629324+0000","last_clean":"2023-07-21T22:12:23.629324+0000","last_became_active":"2023-07-21T22:12:22.640195+0000","last_became_peered":"2023-07-21T22:12:22.640195+0000","last_unstale":"2023-07-21T22:12:23.629324+0000","last_undegraded":"2023-07-21T22:12:23.629324+0000","last_fullsized":"2023-07-21T22:12:23.629324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:59:54.151125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771150+0000","last_change":"2023-07-21T22:12:21.601769+0000","last_active":"2023-07-21T22:12:23.771150+0000","last_peered":"2023-07-21T22:12:23.771150+0000","last_clean":"2023-07-21T22:12:23.771150+0000","last_became_active":"2023-07-21T22:12:21.601385+0000","last_became_peered":"2023-07-21T22:12:21.601385+0000","last_unstale":"2023-07-21T22:12:23.771150+0000","last_undegraded":"2023-07-21T22:12:23.771150+0000","last_fullsized":"2023-07-21T22:12:23.771150+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:11:28.191838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381332+0000","last_change":"2023-07-21T22:12:22.647592+0000","last_active":"2023-07-21T22:12:24.381332+0000","last_peered":"2023-07-21T22:12:24.381332+0000","last_clean":"2023-07-21T22:12:24.381332+0000","last_became_active":"2023-07-21T22:12:22.643447+0000","last_became_peered":"2023-07-21T22:12:22.643447+0000","last_unstale":"2023-07-21T22:12:24.381332+0000","last_undegraded":"2023-07-21T22:12:24.381332+0000","last_fullsized":"2023-07-21T22:12:24.381332+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:56.482177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629470+0000","last_change":"2023-07-21T22:12:21.605477+0000","last_active":"2023-07-21T22:12:23.629470+0000","last_peered":"2023-07-21T22:12:23.629470+0000","last_clean":"2023-07-21T22:12:23.629470+0000","last_became_active":"2023-07-21T22:12:21.605165+0000","last_became_peered":"2023-07-21T22:12:21.605165+0000","last_unstale":"2023-07-21T22:12:23.629470+0000","last_undegraded":"2023-07-21T22:12:23.629470+0000","last_fullsized":"2023-07-21T22:12:23.629470+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:29.197253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381510+0000","last_change":"2023-07-21T22:12:22.642601+0000","last_active":"2023-07-21T22:12:24.381510+0000","last_peered":"2023-07-21T22:12:24.381510+0000","last_clean":"2023-07-21T22:12:24.381510+0000","last_became_active":"2023-07-21T22:12:22.641820+0000","last_became_peered":"2023-07-21T22:12:22.641820+0000","last_unstale":"2023-07-21T22:12:24.381510+0000","last_undegraded":"2023-07-21T22:12:24.381510+0000","last_fullsized":"2023-07-21T22:12:24.381510+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:03.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628101+0000","last_change":"2023-07-21T22:12:21.606759+0000","last_active":"2023-07-21T22:12:23.628101+0000","last_peered":"2023-07-21T22:12:23.628101+0000","last_clean":"2023-07-21T22:12:23.628101+0000","last_became_active":"2023-07-21T22:12:21.606472+0000","last_became_peered":"2023-07-21T22:12:21.606472+0000","last_unstale":"2023-07-21T22:12:23.628101+0000","last_undegraded":"2023-07-21T22:12:23.628101+0000","last_fullsized":"2023-07-21T22:12:23.628101+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:04.452948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666160+0000","last_change":"2023-07-21T22:12:22.639395+0000","last_active":"2023-07-21T22:12:23.666160+0000","last_peered":"2023-07-21T22:12:23.666160+0000","last_clean":"2023-07-21T22:12:23.666160+0000","last_became_active":"2023-07-21T22:12:22.639107+0000","last_became_peered":"2023-07-21T22:12:22.639107+0000","last_unstale":"2023-07-21T22:12:23.666160+0000","last_undegraded":"2023-07-21T22:12:23.666160+0000","last_fullsized":"2023-07-21T22:12:23.666160+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:29:43.758435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381695+0000","last_change":"2023-07-21T22:12:21.616075+0000","last_active":"2023-07-21T22:12:24.381695+0000","last_peered":"2023-07-21T22:12:24.381695+0000","last_clean":"2023-07-21T22:12:24.381695+0000","last_became_active":"2023-07-21T22:12:21.615645+0000","last_became_peered":"2023-07-21T22:12:21.615645+0000","last_unstale":"2023-07-21T22:12:24.381695+0000","last_undegraded":"2023-07-21T22:12:24.381695+0000","last_fullsized":"2023-07-21T22:12:24.381695+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:39:45.581092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629625+0000","last_change":"2023-07-21T22:12:22.633603+0000","last_active":"2023-07-21T22:12:23.629625+0000","last_peered":"2023-07-21T22:12:23.629625+0000","last_clean":"2023-07-21T22:12:23.629625+0000","last_became_active":"2023-07-21T22:12:22.632978+0000","last_became_peered":"2023-07-21T22:12:22.632978+0000","last_unstale":"2023-07-21T22:12:23.629625+0000","last_undegraded":"2023-07-21T22:12:23.629625+0000","last_fullsized":"2023-07-21T22:12:23.629625+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:20:48.235788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.630049+0000","last_change":"2023-07-21T22:12:21.605065+0000","last_active":"2023-07-21T22:12:23.630049+0000","last_peered":"2023-07-21T22:12:23.630049+0000","last_clean":"2023-07-21T22:12:23.630049+0000","last_became_active":"2023-07-21T22:12:21.604786+0000","last_became_peered":"2023-07-21T22:12:21.604786+0000","last_unstale":"2023-07-21T22:12:23.630049+0000","last_undegraded":"2023-07-21T22:12:23.630049+0000","last_fullsized":"2023-07-21T22:12:23.630049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:30.021297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379664+0000","last_change":"2023-07-21T22:12:22.642469+0000","last_active":"2023-07-21T22:12:24.379664+0000","last_peered":"2023-07-21T22:12:24.379664+0000","last_clean":"2023-07-21T22:12:24.379664+0000","last_became_active":"2023-07-21T22:12:22.641997+0000","last_became_peered":"2023-07-21T22:12:22.641997+0000","last_unstale":"2023-07-21T22:12:24.379664+0000","last_undegraded":"2023-07-21T22:12:24.379664+0000","last_fullsized":"2023-07-21T22:12:24.379664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:14:29.089939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382946+0000","last_change":"2023-07-21T22:12:21.619690+0000","last_active":"2023-07-21T22:12:24.382946+0000","last_peered":"2023-07-21T22:12:24.382946+0000","last_clean":"2023-07-21T22:12:24.382946+0000","last_became_active":"2023-07-21T22:12:21.619369+0000","last_became_peered":"2023-07-21T22:12:21.619369+0000","last_unstale":"2023-07-21T22:12:24.382946+0000","last_undegraded":"2023-07-21T22:12:24.382946+0000","last_fullsized":"2023-07-21T22:12:24.382946+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:38:35.761808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771538+0000","last_change":"2023-07-21T22:12:22.660251+0000","last_active":"2023-07-21T22:12:23.771538+0000","last_peered":"2023-07-21T22:12:23.771538+0000","last_clean":"2023-07-21T22:12:23.771538+0000","last_became_active":"2023-07-21T22:12:22.646444+0000","last_became_peered":"2023-07-21T22:12:22.646444+0000","last_unstale":"2023-07-21T22:12:23.771538+0000","last_undegraded":"2023-07-21T22:12:23.771538+0000","last_fullsized":"2023-07-21T22:12:23.771538+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:54.203729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379642+0000","last_change":"2023-07-21T22:12:21.608773+0000","last_active":"2023-07-21T22:12:24.379642+0000","last_peered":"2023-07-21T22:12:24.379642+0000","last_clean":"2023-07-21T22:12:24.379642+0000","last_became_active":"2023-07-21T22:12:21.608475+0000","last_became_peered":"2023-07-21T22:12:21.608475+0000","last_unstale":"2023-07-21T22:12:24.379642+0000","last_undegraded":"2023-07-21T22:12:24.379642+0000","last_fullsized":"2023-07-21T22:12:24.379642+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:37:19.966908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379239+0000","last_change":"2023-07-21T22:12:22.647138+0000","last_active":"2023-07-21T22:12:24.379239+0000","last_peered":"2023-07-21T22:12:24.379239+0000","last_clean":"2023-07-21T22:12:24.379239+0000","last_became_active":"2023-07-21T22:12:22.646814+0000","last_became_peered":"2023-07-21T22:12:22.646814+0000","last_unstale":"2023-07-21T22:12:24.379239+0000","last_undegraded":"2023-07-21T22:12:24.379239+0000","last_fullsized":"2023-07-21T22:12:24.379239+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:38:42.171793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629237+0000","last_change":"2023-07-21T22:12:21.609348+0000","last_active":"2023-07-21T22:12:23.629237+0000","last_peered":"2023-07-21T22:12:23.629237+0000","last_clean":"2023-07-21T22:12:23.629237+0000","last_became_active":"2023-07-21T22:12:21.609052+0000","last_became_peered":"2023-07-21T22:12:21.609052+0000","last_unstale":"2023-07-21T22:12:23.629237+0000","last_undegraded":"2023-07-21T22:12:23.629237+0000","last_fullsized":"2023-07-21T22:12:23.629237+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:38:27.588511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666779+0000","last_change":"2023-07-21T22:12:22.655637+0000","last_active":"2023-07-21T22:12:23.666779+0000","last_peered":"2023-07-21T22:12:23.666779+0000","last_clean":"2023-07-21T22:12:23.666779+0000","last_became_active":"2023-07-21T22:12:22.655361+0000","last_became_peered":"2023-07-21T22:12:22.655361+0000","last_unstale":"2023-07-21T22:12:23.666779+0000","last_undegraded":"2023-07-21T22:12:23.666779+0000","last_fullsized":"2023-07-21T22:12:23.666779+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:49:38.897493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771368+0000","last_change":"2023-07-21T22:12:21.617222+0000","last_active":"2023-07-21T22:12:23.771368+0000","last_peered":"2023-07-21T22:12:23.771368+0000","last_clean":"2023-07-21T22:12:23.771368+0000","last_became_active":"2023-07-21T22:12:21.616954+0000","last_became_peered":"2023-07-21T22:12:21.616954+0000","last_unstale":"2023-07-21T22:12:23.771368+0000","last_undegraded":"2023-07-21T22:12:23.771368+0000","last_fullsized":"2023-07-21T22:12:23.771368+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:03.173166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381599+0000","last_change":"2023-07-21T22:12:22.640238+0000","last_active":"2023-07-21T22:12:24.381599+0000","last_peered":"2023-07-21T22:12:24.381599+0000","last_clean":"2023-07-21T22:12:24.381599+0000","last_became_active":"2023-07-21T22:12:22.639975+0000","last_became_peered":"2023-07-21T22:12:22.639975+0000","last_unstale":"2023-07-21T22:12:24.381599+0000","last_undegraded":"2023-07-21T22:12:24.381599+0000","last_fullsized":"2023-07-21T22:12:24.381599+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:25.899817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379159+0000","last_change":"2023-07-21T22:12:21.602070+0000","last_active":"2023-07-21T22:12:24.379159+0000","last_peered":"2023-07-21T22:12:24.379159+0000","last_clean":"2023-07-21T22:12:24.379159+0000","last_became_active":"2023-07-21T22:12:21.600983+0000","last_became_peered":"2023-07-21T22:12:21.600983+0000","last_unstale":"2023-07-21T22:12:24.379159+0000","last_undegraded":"2023-07-21T22:12:24.379159+0000","last_fullsized":"2023-07-21T22:12:24.379159+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:02:18.693632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.770727+0000","last_change":"2023-07-21T22:12:22.645069+0000","last_active":"2023-07-21T22:12:23.770727+0000","last_peered":"2023-07-21T22:12:23.770727+0000","last_clean":"2023-07-21T22:12:23.770727+0000","last_became_active":"2023-07-21T22:12:22.644792+0000","last_became_peered":"2023-07-21T22:12:22.644792+0000","last_unstale":"2023-07-21T22:12:23.770727+0000","last_undegraded":"2023-07-21T22:12:23.770727+0000","last_fullsized":"2023-07-21T22:12:23.770727+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:56:14.066685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771004+0000","last_change":"2023-07-21T22:12:21.616218+0000","last_active":"2023-07-21T22:12:23.771004+0000","last_peered":"2023-07-21T22:12:23.771004+0000","last_clean":"2023-07-21T22:12:23.771004+0000","last_became_active":"2023-07-21T22:12:21.615937+0000","last_became_peered":"2023-07-21T22:12:21.615937+0000","last_unstale":"2023-07-21T22:12:23.771004+0000","last_undegraded":"2023-07-21T22:12:23.771004+0000","last_fullsized":"2023-07-21T22:12:23.771004+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:43:48.862531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379455+0000","last_change":"2023-07-21T22:12:22.642348+0000","last_active":"2023-07-21T22:12:24.379455+0000","last_peered":"2023-07-21T22:12:24.379455+0000","last_clean":"2023-07-21T22:12:24.379455+0000","last_became_active":"2023-07-21T22:12:22.642061+0000","last_became_peered":"2023-07-21T22:12:22.642061+0000","last_unstale":"2023-07-21T22:12:24.379455+0000","last_undegraded":"2023-07-21T22:12:24.379455+0000","last_fullsized":"2023-07-21T22:12:24.379455+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:47:57.317565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381770+0000","last_change":"2023-07-21T22:12:21.617648+0000","last_active":"2023-07-21T22:12:24.381770+0000","last_peered":"2023-07-21T22:12:24.381770+0000","last_clean":"2023-07-21T22:12:24.381770+0000","last_became_active":"2023-07-21T22:12:21.617357+0000","last_became_peered":"2023-07-21T22:12:21.617357+0000","last_unstale":"2023-07-21T22:12:24.381770+0000","last_undegraded":"2023-07-21T22:12:24.381770+0000","last_fullsized":"2023-07-21T22:12:24.381770+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:02.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628890+0000","last_change":"2023-07-21T22:12:22.632452+0000","last_active":"2023-07-21T22:12:23.628890+0000","last_peered":"2023-07-21T22:12:23.628890+0000","last_clean":"2023-07-21T22:12:23.628890+0000","last_became_active":"2023-07-21T22:12:22.632103+0000","last_became_peered":"2023-07-21T22:12:22.632103+0000","last_unstale":"2023-07-21T22:12:23.628890+0000","last_undegraded":"2023-07-21T22:12:23.628890+0000","last_fullsized":"2023-07-21T22:12:23.628890+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:24:40.736147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628827+0000","last_change":"2023-07-21T22:12:21.617908+0000","last_active":"2023-07-21T22:12:23.628827+0000","last_peered":"2023-07-21T22:12:23.628827+0000","last_clean":"2023-07-21T22:12:23.628827+0000","last_became_active":"2023-07-21T22:12:21.617579+0000","last_became_peered":"2023-07-21T22:12:21.617579+0000","last_unstale":"2023-07-21T22:12:23.628827+0000","last_undegraded":"2023-07-21T22:12:23.628827+0000","last_fullsized":"2023-07-21T22:12:23.628827+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:44.012848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382473+0000","last_change":"2023-07-21T22:12:22.638466+0000","last_active":"2023-07-21T22:12:24.382473+0000","last_peered":"2023-07-21T22:12:24.382473+0000","last_clean":"2023-07-21T22:12:24.382473+0000","last_became_active":"2023-07-21T22:12:22.638176+0000","last_became_peered":"2023-07-21T22:12:22.638176+0000","last_unstale":"2023-07-21T22:12:24.382473+0000","last_undegraded":"2023-07-21T22:12:24.382473+0000","last_fullsized":"2023-07-21T22:12:24.382473+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:07:37.624184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629811+0000","last_change":"2023-07-21T22:12:21.606203+0000","last_active":"2023-07-21T22:12:23.629811+0000","last_peered":"2023-07-21T22:12:23.629811+0000","last_clean":"2023-07-21T22:12:23.629811+0000","last_became_active":"2023-07-21T22:12:21.605950+0000","last_became_peered":"2023-07-21T22:12:21.605950+0000","last_unstale":"2023-07-21T22:12:23.629811+0000","last_undegraded":"2023-07-21T22:12:23.629811+0000","last_fullsized":"2023-07-21T22:12:23.629811+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:42:03.742168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666647+0000","last_change":"2023-07-21T22:12:22.659919+0000","last_active":"2023-07-21T22:12:23.666647+0000","last_peered":"2023-07-21T22:12:23.666647+0000","last_clean":"2023-07-21T22:12:23.666647+0000","last_became_active":"2023-07-21T22:12:22.659595+0000","last_became_peered":"2023-07-21T22:12:22.659595+0000","last_unstale":"2023-07-21T22:12:23.666647+0000","last_undegraded":"2023-07-21T22:12:23.666647+0000","last_fullsized":"2023-07-21T22:12:23.666647+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:50.131643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628857+0000","last_change":"2023-07-21T22:12:21.607942+0000","last_active":"2023-07-21T22:12:23.628857+0000","last_peered":"2023-07-21T22:12:23.628857+0000","last_clean":"2023-07-21T22:12:23.628857+0000","last_became_active":"2023-07-21T22:12:21.607667+0000","last_became_peered":"2023-07-21T22:12:21.607667+0000","last_unstale":"2023-07-21T22:12:23.628857+0000","last_undegraded":"2023-07-21T22:12:23.628857+0000","last_fullsized":"2023-07-21T22:12:23.628857+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:42:05.495270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666951+0000","last_change":"2023-07-21T22:12:22.652621+0000","last_active":"2023-07-21T22:12:23.666951+0000","last_peered":"2023-07-21T22:12:23.666951+0000","last_clean":"2023-07-21T22:12:23.666951+0000","last_became_active":"2023-07-21T22:12:22.652293+0000","last_became_peered":"2023-07-21T22:12:22.652293+0000","last_unstale":"2023-07-21T22:12:23.666951+0000","last_undegraded":"2023-07-21T22:12:23.666951+0000","last_fullsized":"2023-07-21T22:12:23.666951+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:17:54.390337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771641+0000","last_change":"2023-07-21T22:12:21.610547+0000","last_active":"2023-07-21T22:12:23.771641+0000","last_peered":"2023-07-21T22:12:23.771641+0000","last_clean":"2023-07-21T22:12:23.771641+0000","last_became_active":"2023-07-21T22:12:21.610273+0000","last_became_peered":"2023-07-21T22:12:21.610273+0000","last_unstale":"2023-07-21T22:12:23.771641+0000","last_undegraded":"2023-07-21T22:12:23.771641+0000","last_fullsized":"2023-07-21T22:12:23.771641+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:20:18.559114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.770861+0000","last_change":"2023-07-21T22:12:22.660282+0000","last_active":"2023-07-21T22:12:23.770861+0000","last_peered":"2023-07-21T22:12:23.770861+0000","last_clean":"2023-07-21T22:12:23.770861+0000","last_became_active":"2023-07-21T22:12:22.646212+0000","last_became_peered":"2023-07-21T22:12:22.646212+0000","last_unstale":"2023-07-21T22:12:23.770861+0000","last_undegraded":"2023-07-21T22:12:23.770861+0000","last_fullsized":"2023-07-21T22:12:23.770861+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:37.238062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771622+0000","last_change":"2023-07-21T22:12:21.601832+0000","last_active":"2023-07-21T22:12:23.771622+0000","last_peered":"2023-07-21T22:12:23.771622+0000","last_clean":"2023-07-21T22:12:23.771622+0000","last_became_active":"2023-07-21T22:12:21.601535+0000","last_became_peered":"2023-07-21T22:12:21.601535+0000","last_unstale":"2023-07-21T22:12:23.771622+0000","last_undegraded":"2023-07-21T22:12:23.771622+0000","last_fullsized":"2023-07-21T22:12:23.771622+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:41.563505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381004+0000","last_change":"2023-07-21T22:12:22.628639+0000","last_active":"2023-07-21T22:12:24.381004+0000","last_peered":"2023-07-21T22:12:24.381004+0000","last_clean":"2023-07-21T22:12:24.381004+0000","last_became_active":"2023-07-21T22:12:22.628353+0000","last_became_peered":"2023-07-21T22:12:22.628353+0000","last_unstale":"2023-07-21T22:12:24.381004+0000","last_undegraded":"2023-07-21T22:12:24.381004+0000","last_fullsized":"2023-07-21T22:12:24.381004+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:25.942541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628162+0000","last_change":"2023-07-21T22:12:21.608858+0000","last_active":"2023-07-21T22:12:23.628162+0000","last_peered":"2023-07-21T22:12:23.628162+0000","last_clean":"2023-07-21T22:12:23.628162+0000","last_became_active":"2023-07-21T22:12:21.608596+0000","last_became_peered":"2023-07-21T22:12:21.608596+0000","last_unstale":"2023-07-21T22:12:23.628162+0000","last_undegraded":"2023-07-21T22:12:23.628162+0000","last_fullsized":"2023-07-21T22:12:23.628162+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:51:35.675722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628807+0000","last_change":"2023-07-21T22:12:22.639837+0000","last_active":"2023-07-21T22:12:23.628807+0000","last_peered":"2023-07-21T22:12:23.628807+0000","last_clean":"2023-07-21T22:12:23.628807+0000","last_became_active":"2023-07-21T22:12:22.639512+0000","last_became_peered":"2023-07-21T22:12:22.639512+0000","last_unstale":"2023-07-21T22:12:23.628807+0000","last_undegraded":"2023-07-21T22:12:23.628807+0000","last_fullsized":"2023-07-21T22:12:23.628807+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:09:59.540438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382911+0000","last_change":"2023-07-21T22:12:21.614880+0000","last_active":"2023-07-21T22:12:24.382911+0000","last_peered":"2023-07-21T22:12:24.382911+0000","last_clean":"2023-07-21T22:12:24.382911+0000","last_became_active":"2023-07-21T22:12:21.614486+0000","last_became_peered":"2023-07-21T22:12:21.614486+0000","last_unstale":"2023-07-21T22:12:24.382911+0000","last_undegraded":"2023-07-21T22:12:24.382911+0000","last_fullsized":"2023-07-21T22:12:24.382911+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:22:19.622259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381489+0000","last_change":"2023-07-21T22:12:22.649274+0000","last_active":"2023-07-21T22:12:24.381489+0000","last_peered":"2023-07-21T22:12:24.381489+0000","last_clean":"2023-07-21T22:12:24.381489+0000","last_became_active":"2023-07-21T22:12:22.648201+0000","last_became_peered":"2023-07-21T22:12:22.648201+0000","last_unstale":"2023-07-21T22:12:24.381489+0000","last_undegraded":"2023-07-21T22:12:24.381489+0000","last_fullsized":"2023-07-21T22:12:24.381489+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:49:55.291010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.378783+0000","last_change":"2023-07-21T22:12:21.603129+0000","last_active":"2023-07-21T22:12:24.378783+0000","last_peered":"2023-07-21T22:12:24.378783+0000","last_clean":"2023-07-21T22:12:24.378783+0000","last_became_active":"2023-07-21T22:12:21.602834+0000","last_became_peered":"2023-07-21T22:12:21.602834+0000","last_unstale":"2023-07-21T22:12:24.378783+0000","last_undegraded":"2023-07-21T22:12:24.378783+0000","last_fullsized":"2023-07-21T22:12:24.378783+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:51.989115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771178+0000","last_change":"2023-07-21T22:12:22.661683+0000","last_active":"2023-07-21T22:12:23.771178+0000","last_peered":"2023-07-21T22:12:23.771178+0000","last_clean":"2023-07-21T22:12:23.771178+0000","last_became_active":"2023-07-21T22:12:22.659989+0000","last_became_peered":"2023-07-21T22:12:22.659989+0000","last_unstale":"2023-07-21T22:12:23.771178+0000","last_undegraded":"2023-07-21T22:12:23.771178+0000","last_fullsized":"2023-07-21T22:12:23.771178+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:38.154518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379382+0000","last_change":"2023-07-21T22:12:21.609223+0000","last_active":"2023-07-21T22:12:24.379382+0000","last_peered":"2023-07-21T22:12:24.379382+0000","last_clean":"2023-07-21T22:12:24.379382+0000","last_became_active":"2023-07-21T22:12:21.608882+0000","last_became_peered":"2023-07-21T22:12:21.608882+0000","last_unstale":"2023-07-21T22:12:24.379382+0000","last_undegraded":"2023-07-21T22:12:24.379382+0000","last_fullsized":"2023-07-21T22:12:24.379382+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:13:20.662264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.667285+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:12:23.667285+0000","last_peered":"2023-07-21T22:12:23.667285+0000","last_clean":"2023-07-21T22:12:23.667285+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:12:23.667285+0000","last_undegraded":"2023-07-21T22:12:23.667285+0000","last_fullsized":"2023-07-21T22:12:23.667285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:23:02.419049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771040+0000","last_change":"2023-07-21T22:12:22.645778+0000","last_active":"2023-07-21T22:12:23.771040+0000","last_peered":"2023-07-21T22:12:23.771040+0000","last_clean":"2023-07-21T22:12:23.771040+0000","last_became_active":"2023-07-21T22:12:22.645526+0000","last_became_peered":"2023-07-21T22:12:22.645526+0000","last_unstale":"2023-07-21T22:12:23.771040+0000","last_undegraded":"2023-07-21T22:12:23.771040+0000","last_fullsized":"2023-07-21T22:12:23.771040+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:16.990106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629657+0000","last_change":"2023-07-21T22:12:21.612615+0000","last_active":"2023-07-21T22:12:23.629657+0000","last_peered":"2023-07-21T22:12:23.629657+0000","last_clean":"2023-07-21T22:12:23.629657+0000","last_became_active":"2023-07-21T22:12:21.612343+0000","last_became_peered":"2023-07-21T22:12:21.612343+0000","last_unstale":"2023-07-21T22:12:23.629657+0000","last_undegraded":"2023-07-21T22:12:23.629657+0000","last_fullsized":"2023-07-21T22:12:23.629657+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:13:04.346697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381126+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:12:24.381126+0000","last_peered":"2023-07-21T22:12:24.381126+0000","last_clean":"2023-07-21T22:12:24.381126+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:12:24.381126+0000","last_undegraded":"2023-07-21T22:12:24.381126+0000","last_fullsized":"2023-07-21T22:12:24.381126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:31:37.838038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628285+0000","last_change":"2023-07-21T22:12:22.632522+0000","last_active":"2023-07-21T22:12:23.628285+0000","last_peered":"2023-07-21T22:12:23.628285+0000","last_clean":"2023-07-21T22:12:23.628285+0000","last_became_active":"2023-07-21T22:12:22.632256+0000","last_became_peered":"2023-07-21T22:12:22.632256+0000","last_unstale":"2023-07-21T22:12:23.628285+0000","last_undegraded":"2023-07-21T22:12:23.628285+0000","last_fullsized":"2023-07-21T22:12:23.628285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:14:29.089939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380896+0000","last_change":"2023-07-21T22:12:21.611685+0000","last_active":"2023-07-21T22:12:24.380896+0000","last_peered":"2023-07-21T22:12:24.380896+0000","last_clean":"2023-07-21T22:12:24.380896+0000","last_became_active":"2023-07-21T22:12:21.611382+0000","last_became_peered":"2023-07-21T22:12:21.611382+0000","last_unstale":"2023-07-21T22:12:24.380896+0000","last_undegraded":"2023-07-21T22:12:24.380896+0000","last_fullsized":"2023-07-21T22:12:24.380896+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:05:47.955186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379833+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:12:24.379833+0000","last_peered":"2023-07-21T22:12:24.379833+0000","last_clean":"2023-07-21T22:12:24.379833+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:12:24.379833+0000","last_undegraded":"2023-07-21T22:12:24.379833+0000","last_fullsized":"2023-07-21T22:12:24.379833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:51:34.302311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629065+0000","last_change":"2023-07-21T22:12:22.636228+0000","last_active":"2023-07-21T22:12:23.629065+0000","last_peered":"2023-07-21T22:12:23.629065+0000","last_clean":"2023-07-21T22:12:23.629065+0000","last_became_active":"2023-07-21T22:12:22.635935+0000","last_became_peered":"2023-07-21T22:12:22.635935+0000","last_unstale":"2023-07-21T22:12:23.629065+0000","last_undegraded":"2023-07-21T22:12:23.629065+0000","last_fullsized":"2023-07-21T22:12:23.629065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:50:35.389978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382012+0000","last_change":"2023-07-21T22:12:21.618366+0000","last_active":"2023-07-21T22:12:24.382012+0000","last_peered":"2023-07-21T22:12:24.382012+0000","last_clean":"2023-07-21T22:12:24.382012+0000","last_became_active":"2023-07-21T22:12:21.617965+0000","last_became_peered":"2023-07-21T22:12:21.617965+0000","last_unstale":"2023-07-21T22:12:24.382012+0000","last_undegraded":"2023-07-21T22:12:24.382012+0000","last_fullsized":"2023-07-21T22:12:24.382012+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:02:57.952042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381102+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:12:24.381102+0000","last_peered":"2023-07-21T22:12:24.381102+0000","last_clean":"2023-07-21T22:12:24.381102+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:12:24.381102+0000","last_undegraded":"2023-07-21T22:12:24.381102+0000","last_fullsized":"2023-07-21T22:12:24.381102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:38.424071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.667098+0000","last_change":"2023-07-21T22:12:22.662460+0000","last_active":"2023-07-21T22:12:23.667098+0000","last_peered":"2023-07-21T22:12:23.667098+0000","last_clean":"2023-07-21T22:12:23.667098+0000","last_became_active":"2023-07-21T22:12:22.662117+0000","last_became_peered":"2023-07-21T22:12:22.662117+0000","last_unstale":"2023-07-21T22:12:23.667098+0000","last_undegraded":"2023-07-21T22:12:23.667098+0000","last_fullsized":"2023-07-21T22:12:23.667098+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:14.633616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771782+0000","last_change":"2023-07-21T22:12:21.606595+0000","last_active":"2023-07-21T22:12:23.771782+0000","last_peered":"2023-07-21T22:12:23.771782+0000","last_clean":"2023-07-21T22:12:23.771782+0000","last_became_active":"2023-07-21T22:12:21.606244+0000","last_became_peered":"2023-07-21T22:12:21.606244+0000","last_unstale":"2023-07-21T22:12:23.771782+0000","last_undegraded":"2023-07-21T22:12:23.771782+0000","last_fullsized":"2023-07-21T22:12:23.771782+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:36:53.515697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628281+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:12:23.628281+0000","last_peered":"2023-07-21T22:12:23.628281+0000","last_clean":"2023-07-21T22:12:23.628281+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:12:23.628281+0000","last_undegraded":"2023-07-21T22:12:23.628281+0000","last_fullsized":"2023-07-21T22:12:23.628281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:02:02.395341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382737+0000","last_change":"2023-07-21T22:12:22.639308+0000","last_active":"2023-07-21T22:12:24.382737+0000","last_peered":"2023-07-21T22:12:24.382737+0000","last_clean":"2023-07-21T22:12:24.382737+0000","last_became_active":"2023-07-21T22:12:22.638996+0000","last_became_peered":"2023-07-21T22:12:22.638996+0000","last_unstale":"2023-07-21T22:12:24.382737+0000","last_undegraded":"2023-07-21T22:12:24.382737+0000","last_fullsized":"2023-07-21T22:12:24.382737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:38:34.946660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379628+0000","last_change":"2023-07-21T22:12:21.610628+0000","last_active":"2023-07-21T22:12:24.379628+0000","last_peered":"2023-07-21T22:12:24.379628+0000","last_clean":"2023-07-21T22:12:24.379628+0000","last_became_active":"2023-07-21T22:12:21.610371+0000","last_became_peered":"2023-07-21T22:12:21.610371+0000","last_unstale":"2023-07-21T22:12:24.379628+0000","last_undegraded":"2023-07-21T22:12:24.379628+0000","last_fullsized":"2023-07-21T22:12:24.379628+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:54.879672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628392+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:12:23.628392+0000","last_peered":"2023-07-21T22:12:23.628392+0000","last_clean":"2023-07-21T22:12:23.628392+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:12:23.628392+0000","last_undegraded":"2023-07-21T22:12:23.628392+0000","last_fullsized":"2023-07-21T22:12:23.628392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:52.725011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379292+0000","last_change":"2023-07-21T22:12:22.644968+0000","last_active":"2023-07-21T22:12:24.379292+0000","last_peered":"2023-07-21T22:12:24.379292+0000","last_clean":"2023-07-21T22:12:24.379292+0000","last_became_active":"2023-07-21T22:12:22.644662+0000","last_became_peered":"2023-07-21T22:12:22.644662+0000","last_unstale":"2023-07-21T22:12:24.379292+0000","last_undegraded":"2023-07-21T22:12:24.379292+0000","last_fullsized":"2023-07-21T22:12:24.379292+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:32.664045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380888+0000","last_change":"2023-07-21T22:12:21.607945+0000","last_active":"2023-07-21T22:12:24.380888+0000","last_peered":"2023-07-21T22:12:24.380888+0000","last_clean":"2023-07-21T22:12:24.380888+0000","last_became_active":"2023-07-21T22:12:21.607453+0000","last_became_peered":"2023-07-21T22:12:21.607453+0000","last_unstale":"2023-07-21T22:12:24.380888+0000","last_undegraded":"2023-07-21T22:12:24.380888+0000","last_fullsized":"2023-07-21T22:12:24.380888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:06.804163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.378776+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:12:24.378776+0000","last_peered":"2023-07-21T22:12:24.378776+0000","last_clean":"2023-07-21T22:12:24.378776+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:12:24.378776+0000","last_undegraded":"2023-07-21T22:12:24.378776+0000","last_fullsized":"2023-07-21T22:12:24.378776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:32:17.919429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382739+0000","last_change":"2023-07-21T22:12:22.648121+0000","last_active":"2023-07-21T22:12:24.382739+0000","last_peered":"2023-07-21T22:12:24.382739+0000","last_clean":"2023-07-21T22:12:24.382739+0000","last_became_active":"2023-07-21T22:12:22.643658+0000","last_became_peered":"2023-07-21T22:12:22.643658+0000","last_unstale":"2023-07-21T22:12:24.382739+0000","last_undegraded":"2023-07-21T22:12:24.382739+0000","last_fullsized":"2023-07-21T22:12:24.382739+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:36.960941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628831+0000","last_change":"2023-07-21T22:12:21.612525+0000","last_active":"2023-07-21T22:12:23.628831+0000","last_peered":"2023-07-21T22:12:23.628831+0000","last_clean":"2023-07-21T22:12:23.628831+0000","last_became_active":"2023-07-21T22:12:21.612268+0000","last_became_peered":"2023-07-21T22:12:21.612268+0000","last_unstale":"2023-07-21T22:12:23.628831+0000","last_undegraded":"2023-07-21T22:12:23.628831+0000","last_fullsized":"2023-07-21T22:12:23.628831+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:21:39.323443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628687+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:12:23.628687+0000","last_peered":"2023-07-21T22:12:23.628687+0000","last_clean":"2023-07-21T22:12:23.628687+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:12:23.628687+0000","last_undegraded":"2023-07-21T22:12:23.628687+0000","last_fullsized":"2023-07-21T22:12:23.628687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:15.005931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":206,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379511+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:12:24.379511+0000","last_peered":"2023-07-21T22:12:24.379511+0000","last_clean":"2023-07-21T22:12:24.379511+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:12:24.379511+0000","last_undegraded":"2023-07-21T22:12:24.379511+0000","last_fullsized":"2023-07-21T22:12:24.379511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:34:38.203636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1101824,"data_stored":813775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.206,"15min":1.218},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2909999999999999,"15min":1.3140000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8300000000000001,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.1659999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.21,"15min":1.2230000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.2709999999999999,"15min":1.2849999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.681,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.4950000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.2250000000000001,"15min":1.23},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.246,"5min":1.2989999999999999,"15min":1.3080000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.6830000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.296,"15min":1.2989999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.5409999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.538},{"interface":"front","average":{"1min":1.212,"5min":1.3999999999999999,"15min":1.431},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.4410000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.23,"15min":1.238},"min":{"1min":0.81699999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.806,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.3300000000000001,"15min":1.3420000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.619}]},{"osd":5,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.361,"15min":1.3700000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.591},{"interface":"front","average":{"1min":1.292,"5min":1.3759999999999999,"15min":1.3899999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.744,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.649}]},{"osd":6,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.4930000000000001,"15min":1.51},"min":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.776,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.752},{"interface":"front","average":{"1min":1.383,"5min":1.4239999999999999,"15min":1.431},"min":{"1min":0.83799999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.3210000000000002,"5min":2.476,"15min":2.476},"last":1.7230000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":512000,"data_stored":223989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.1080000000000001,"15min":1.1200000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.075,"5min":1.139,"15min":1.1499999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.488,"5min":2.802,"15min":2.802},"last":0.95999999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.232,"15min":1.252},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5980000000000001,"5min":1.839,"15min":1.839},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.2290000000000001,"15min":1.256},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.726,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.78500000000000003}]},{"osd":2,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2589999999999999,"15min":1.2769999999999999},"min":{"1min":0.78700000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.4330000000000001,"5min":2.911,"15min":2.911},"last":1.145},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.335,"15min":1.371},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7390000000000001,"5min":2.379,"15min":2.379},"last":0.93300000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.4139999999999999,"15min":1.4379999999999999},"min":{"1min":0.88700000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.649,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.397,"15min":1.419},"min":{"1min":0.81299999999999994,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.645,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.276,"15min":1.278},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.9950000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.381,"15min":1.3959999999999999},"min":{"1min":0.876,"5min":0.745,"15min":0.745},"max":{"1min":1.788,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.0629999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3999999999999999,"15min":1.405},"min":{"1min":0.84999999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.028,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.391},{"interface":"front","average":{"1min":1.411,"5min":1.4510000000000001,"15min":1.4570000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.915,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.24}]},{"osd":7,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.4430000000000001,"15min":1.448},"min":{"1min":1.044,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.8979999999999999,"5min":4.194,"15min":4.194},"last":1.212},{"interface":"front","average":{"1min":1.486,"5min":1.548,"15min":1.5580000000000001},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.0910000000000002,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.27}]}]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":223387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.087,"15min":1.099},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.5349999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.256},{"interface":"front","average":{"1min":1.077,"5min":1.133,"15min":1.1419999999999999},"min":{"1min":0.66700000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5069999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.22}]},{"osd":1,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1910000000000001,"15min":1.2090000000000001},"min":{"1min":0.75800000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.385,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.139,"5min":1.1839999999999999,"15min":1.1919999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.5489999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.97599999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1579999999999999,"15min":1.165},"min":{"1min":0.81799999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4850000000000001,"5min":1.625,"15min":1.625},"last":1.335},{"interface":"front","average":{"1min":1.165,"5min":1.29,"15min":1.3109999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.615,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.103}]},{"osd":3,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.248,"15min":1.2569999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.51,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.395,"15min":1.409},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.6259999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1259999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.327,"15min":1.343},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.7829999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.304,"15min":1.3080000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.6040000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1759999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.276,"15min":1.29},"min":{"1min":0.98999999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6060000000000001,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.288},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.3320000000000001,"15min":1.3440000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7569999999999999,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.028}]},{"osd":7,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3069999999999999,"15min":1.3120000000000001},"min":{"1min":0.76200000000000001,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.639,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.073},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.512,"15min":1.528},"min":{"1min":1.0189999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7390000000000001,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.395}]}]},{"osd":4,"up_from":15,"seq":64424509468,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":516096,"data_stored":224881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1120000000000001,"15min":1.103},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.085,"5min":1.1619999999999999,"15min":1.175},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.2529999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.222,"15min":1.234},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7070000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.2010000000000001,"15min":1.198},"min":{"1min":0.83199999999999996,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.2090000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.77900000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.6040000000000001,"5min":1.609,"15min":1.609},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.2849999999999999,"15min":1.302},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.5169999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.296,"15min":1.3140000000000001},"min":{"1min":0.90000000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.5389999999999999,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.413},{"interface":"front","average":{"1min":1.222,"5min":1.23,"15min":1.2310000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5600000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.133}]},{"osd":5,"last update":"Fri Jul 21 22:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2769999999999999,"15min":1.3049999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.6659999999999999,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.999},{"interface":"front","average":{"1min":1.286,"5min":1.2430000000000001,"15min":1.236},"min":{"1min":0.92900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6499999999999999,"5min":1.794,"15min":1.794},"last":1.3480000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.202,"15min":1.2010000000000001},"min":{"1min":0.75,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.538,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.056},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.407,"15min":1.4299999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8839999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.1599999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.369,"15min":1.363},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.73,"5min":1.887,"15min":1.887},"last":1.472},{"interface":"front","average":{"1min":1.401,"5min":1.4059999999999999,"15min":1.407},"min":{"1min":0.99399999999999999,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":1.7450000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.306}]}]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":516096,"data_stored":223955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.755}]},{"osd":1,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.155}]},{"osd":2,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.093}]},{"osd":4,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.395},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.347}]},{"osd":5,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.45},{"interface":"front","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.518}]},{"osd":6,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.554}]},{"osd":7,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.615},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.653}]}]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":520192,"data_stored":224903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.875,"15min":0.88100000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.151,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.024,"15min":1.032},"min":{"1min":0.65600000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.274}]},{"osd":1,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.96399999999999997,"15min":0.96499999999999997},"min":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.349,"5min":1.486,"15min":1.486},"last":1.05},{"interface":"front","average":{"1min":1.077,"5min":1.117,"15min":1.1240000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.6220000000000001,"5min":1.958,"15min":1.958},"last":1.6220000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.147,"15min":1.1459999999999999},"min":{"1min":0.65300000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.323},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1499999999999999,"15min":1.1619999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.732,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.4359999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.411,"15min":1.425},"min":{"1min":0.745,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.794,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.5069999999999999,"15min":1.52},"min":{"1min":1.127,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.786,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.3680000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.508,"15min":1.516},"min":{"1min":1.1279999999999999,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":1.7130000000000001,"5min":3.331,"15min":3.331},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.5529999999999999,"15min":1.5660000000000001},"min":{"1min":1.2130000000000001,"5min":1.085,"15min":1.085},"max":{"1min":1.8160000000000001,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.599}]},{"osd":6,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.462,"15min":1.466},"min":{"1min":1.1559999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":1.8919999999999999,"5min":2.633,"15min":2.633},"last":1.534},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.444,"15min":1.466},"min":{"1min":1.0569999999999999,"5min":0.878,"15min":0.878},"max":{"1min":1.7410000000000001,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.556}]},{"osd":7,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4830000000000001,"15min":1.4910000000000001},"min":{"1min":1.0429999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.6899999999999999,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.494},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.569,"15min":1.5760000000000001},"min":{"1min":1.167,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.1520000000000001,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.403}]}]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":1101824,"data_stored":813719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.871,"15min":0.88600000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2689999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.95899999999999996,"15min":0.97699999999999998},"min":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2370000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.121}]},{"osd":2,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.93700000000000006,"15min":0.93300000000000005},"min":{"1min":0.58499999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.389,"5min":1.55,"15min":1.55},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.51600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1}]},{"osd":3,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.94199999999999995,"15min":0.94299999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.079,"5min":1.155,"15min":1.167},"min":{"1min":0.58099999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":1.038}]},{"osd":4,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.242,"15min":1.254},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.6379999999999999,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.087},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3819999999999999,"15min":1.389},"min":{"1min":1.0429999999999999,"5min":1,"15min":1},"max":{"1min":1.927,"5min":2.464,"15min":2.464},"last":1.2050000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.46,"15min":1.4970000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.6559999999999999,"5min":2.419,"15min":2.419},"last":1.319},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3839999999999999,"15min":1.4039999999999999},"min":{"1min":0.88700000000000001,"5min":0.872,"15min":0.872},"max":{"1min":1.552,"5min":2.528,"15min":2.528},"last":1.409}]},{"osd":6,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.5029999999999999,"15min":1.5269999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.1509999999999998,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.4930000000000001,"15min":1.524},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":1.736,"5min":2.335,"15min":2.335},"last":1.518}]},{"osd":7,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.522,"15min":1.548},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":1.8009999999999999,"5min":2.504,"15min":2.504},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.48,"15min":1.508},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.8540000000000001,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":1.341}]}]},{"osd":1,"up_from":14,"seq":60129542173,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":507904,"data_stored":223387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89800000000000002,"15min":0.90000000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.3109999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.403,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.91000000000000003,"15min":0.90400000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":1.246},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.1040000000000001,"15min":1.125},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.0190000000000001,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.2070000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.3680000000000001,"15min":1.4099999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.444,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.2350000000000001,"15min":1.2669999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.881,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":1.4970000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.3049999999999999,"15min":1.3180000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6910000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.393},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.288,"15min":1.3069999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":3.0419999999999998,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.367}]},{"osd":5,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.3500000000000001,"15min":1.3720000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.534},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.4630000000000001,"15min":1.494},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0630000000000002,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.581}]},{"osd":6,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.4159999999999999,"15min":1.4359999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.738,"5min":2.238,"15min":2.238},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.4359999999999999,"15min":1.45},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":2.1000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.534,"15min":1.5589999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.3250000000000002,"5min":4.391,"15min":4.391},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.508,"15min":1.526},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7849999999999999,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.6990000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:12:30.112 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:12:30.120 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:12:31.886 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:12:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.019+0000 7fb876fd2700 1 Processor -- start 2023-07-21T22:12:32.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.023+0000 7fb876fd2700 1 -- start start 2023-07-21T22:12:32.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.023+0000 7fb876fd2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8700c1470 0x7fb8700c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:32.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.023+0000 7fb876fd2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb8700ca2c0 0x7fb870163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:32.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.023+0000 7fb876fd2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87006e010 con 0x7fb870160370 2023-07-21T22:12:32.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.023+0000 7fb876fd2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb870160740 con 0x7fb8700c1470 2023-07-21T22:12:32.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.023+0000 7fb876fd2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8700ccc50 con 0x7fb8700ca2c0 2023-07-21T22:12:32.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.023+0000 7fb8757cf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8700c1470 0x7fb8700c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:32.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.023+0000 7fb8757cf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8700c1470 0x7fb8700c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45924/0 (socket says 172.21.15.49:45924) 2023-07-21T22:12:32.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.023+0000 7fb8757cf700 1 -- 172.21.15.49:0/696442675 learned_addr learned my addr 172.21.15.49:0/696442675 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:32.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.023+0000 7fb8767d1700 1 --2- 172.21.15.49:0/696442675 >> v2:172.21.15.150:3300/0 conn(0x7fb8700ca2c0 0x7fb870163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:32.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb8757cf700 1 -- 172.21.15.49:0/696442675 >> v2:172.21.15.150:3300/0 conn(0x7fb8700ca2c0 msgr2=0x7fb870163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb8757cf700 1 --2- 172.21.15.49:0/696442675 >> v2:172.21.15.150:3300/0 conn(0x7fb8700ca2c0 0x7fb870163ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb8757cf700 1 -- 172.21.15.49:0/696442675 >> v1:172.21.15.150:6789/0 conn(0x7fb870160370 legacy=0x7fb87006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb8757cf700 1 -- 172.21.15.49:0/696442675 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8700afc90 con 0x7fb8700c1470 2023-07-21T22:12:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb8767d1700 1 --2- 172.21.15.49:0/696442675 >> v2:172.21.15.150:3300/0 conn(0x7fb8700ca2c0 0x7fb870163ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb8757cf700 1 --2- 172.21.15.49:0/696442675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700c1470 0x7fb8700c9d80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb87006bc50 tx=0x7fb860009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec7d31726cb804d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:32.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb874fce700 1 -- 172.21.15.49:0/696442675 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000b8a0 con 0x7fb8700c1470 2023-07-21T22:12:32.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb874fce700 1 -- 172.21.15.49:0/696442675 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86000ba00 con 0x7fb8700c1470 2023-07-21T22:12:32.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb874fce700 1 -- 172.21.15.49:0/696442675 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000bd90 con 0x7fb8700c1470 2023-07-21T22:12:32.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb876fd2700 1 -- 172.21.15.49:0/696442675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700c1470 msgr2=0x7fb8700c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:32.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb876fd2700 1 --2- 172.21.15.49:0/696442675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700c1470 0x7fb8700c9d80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb87006bc50 tx=0x7fb860009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb876fd2700 1 -- 172.21.15.49:0/696442675 shutdown_connections 2023-07-21T22:12:32.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb876fd2700 1 --2- 172.21.15.49:0/696442675 >> v2:172.21.15.150:3300/0 conn(0x7fb8700ca2c0 0x7fb870163ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb876fd2700 1 --2- 172.21.15.49:0/696442675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700c1470 0x7fb8700c9d80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb876fd2700 1 -- 172.21.15.49:0/696442675 >> 172.21.15.49:0/696442675 conn(0x7fb870070450 msgr2=0x7fb870070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:32.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb876fd2700 1 -- 172.21.15.49:0/696442675 shutdown_connections 2023-07-21T22:12:32.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.027+0000 7fb876fd2700 1 -- 172.21.15.49:0/696442675 wait complete. 2023-07-21T22:12:32.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb876fd2700 1 Processor -- start 2023-07-21T22:12:32.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb876fd2700 1 -- start start 2023-07-21T22:12:32.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb876fd2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700c1470 0x7fb870161c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:32.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb876fd2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8700ca2c0 0x7fb8700c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:32.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb876fd2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb870160370 0x7fb87015e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:32.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb876fd2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700c2d40 con 0x7fb8700c1470 2023-07-21T22:12:32.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb876fd2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700c3020 con 0x7fb8700ca2c0 2023-07-21T22:12:32.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb876fd2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700b2440 con 0x7fb870160370 2023-07-21T22:12:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb875fd0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700c1470 0x7fb870161c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb875fd0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700c1470 0x7fb870161c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45932/0 (socket says 172.21.15.49:45932) 2023-07-21T22:12:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb875fd0700 1 -- 172.21.15.49:0/2791973305 learned_addr learned my addr 172.21.15.49:0/2791973305 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb8757cf700 1 --2- 172.21.15.49:0/2791973305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8700ca2c0 0x7fb8700c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb8767d1700 1 --2- 172.21.15.49:0/2791973305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb870160370 0x7fb87015e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb875fd0700 1 -- 172.21.15.49:0/2791973305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb870160370 msgr2=0x7fb87015e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:32.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb875fd0700 1 --2- 172.21.15.49:0/2791973305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb870160370 0x7fb87015e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb875fd0700 1 -- 172.21.15.49:0/2791973305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8700ca2c0 msgr2=0x7fb8700c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:32.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb875fd0700 1 --2- 172.21.15.49:0/2791973305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8700ca2c0 0x7fb8700c22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.031+0000 7fb875fd0700 1 -- 172.21.15.49:0/2791973305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb860009570 con 0x7fb8700c1470 2023-07-21T22:12:32.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.035+0000 7fb875fd0700 1 --2- 172.21.15.49:0/2791973305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700c1470 0x7fb870161c70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00cbc0 tx=0x7fb86c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:32.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.035+0000 7fb8667fc700 1 -- 172.21.15.49:0/2791973305 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c003c20 con 0x7fb8700c1470 2023-07-21T22:12:32.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.035+0000 7fb8667fc700 1 -- 172.21.15.49:0/2791973305 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c003d80 con 0x7fb8700c1470 2023-07-21T22:12:32.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.035+0000 7fb8667fc700 1 -- 172.21.15.49:0/2791973305 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c00abb0 con 0x7fb8700c1470 2023-07-21T22:12:32.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.035+0000 7fb876fd2700 1 -- 172.21.15.49:0/2791973305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8700b2720 con 0x7fb8700c1470 2023-07-21T22:12:32.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.035+0000 7fb876fd2700 1 -- 172.21.15.49:0/2791973305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87015f950 con 0x7fb8700c1470 2023-07-21T22:12:32.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.035+0000 7fb876fd2700 1 -- 172.21.15.49:0/2791973305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8700b22a0 con 0x7fb8700c1470 2023-07-21T22:12:32.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.039+0000 7fb8667fc700 1 -- 172.21.15.49:0/2791973305 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb86c00ad10 con 0x7fb8700c1470 2023-07-21T22:12:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.039+0000 7fb8667fc700 1 --2- 172.21.15.49:0/2791973305 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8540662f0 0x7fb8540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.039+0000 7fb8667fc700 1 -- 172.21.15.49:0/2791973305 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb86c083fc0 con 0x7fb8700c1470 2023-07-21T22:12:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.039+0000 7fb8757cf700 1 --2- 172.21.15.49:0/2791973305 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8540662f0 0x7fb8540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.039+0000 7fb8757cf700 1 --2- 172.21.15.49:0/2791973305 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8540662f0 0x7fb8540687a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb860000c00 tx=0x7fb860008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.047+0000 7fb8667fc700 1 -- 172.21.15.49:0/2791973305 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb8700b22a0 con 0x7fb8700c1470 2023-07-21T22:12:32.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.215+0000 7fb876fd2700 1 -- 172.21.15.49:0/2791973305 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8700b0250 con 0x7fb8540662f0 2023-07-21T22:12:32.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.227+0000 7fb8667fc700 1 -- 172.21.15.49:0/2791973305 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308637 (secure 0 0 0) 0x7fb860004040 con 0x7fb8540662f0 2023-07-21T22:12:32.277 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.239+0000 7fb876fd2700 1 -- 172.21.15.49:0/2791973305 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8540662f0 msgr2=0x7fb8540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.239+0000 7fb876fd2700 1 --2- 172.21.15.49:0/2791973305 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8540662f0 0x7fb8540687a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb860000c00 tx=0x7fb860008030 comp rx=0 tx=0).stop 2023-07-21T22:12:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.239+0000 7fb876fd2700 1 -- 172.21.15.49:0/2791973305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700c1470 msgr2=0x7fb870161c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.239+0000 7fb876fd2700 1 --2- 172.21.15.49:0/2791973305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700c1470 0x7fb870161c70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00cbc0 tx=0x7fb86c00cf80 comp rx=0 tx=0).stop 2023-07-21T22:12:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.239+0000 7fb876fd2700 1 -- 172.21.15.49:0/2791973305 shutdown_connections 2023-07-21T22:12:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.239+0000 7fb876fd2700 1 --2- 172.21.15.49:0/2791973305 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8540662f0 0x7fb8540687a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.239+0000 7fb876fd2700 1 --2- 172.21.15.49:0/2791973305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb870160370 0x7fb87015e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.239+0000 7fb876fd2700 1 --2- 172.21.15.49:0/2791973305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8700ca2c0 0x7fb8700c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.239+0000 7fb876fd2700 1 --2- 172.21.15.49:0/2791973305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700c1470 0x7fb870161c70 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.239+0000 7fb876fd2700 1 -- 172.21.15.49:0/2791973305 >> 172.21.15.49:0/2791973305 conn(0x7fb870070450 msgr2=0x7fb87006bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.239+0000 7fb876fd2700 1 -- 172.21.15.49:0/2791973305 shutdown_connections 2023-07-21T22:12:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.239+0000 7fb876fd2700 1 -- 172.21.15.49:0/2791973305 wait complete. 2023-07-21T22:12:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:12:32.308 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2023-07-21T22:12:30.345975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237160,"kb_used_data":5160,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754737560,"statfs":{"total":773094113280,"available":772851261440,"internally_reserved":0,"allocated":5283840,"data_stored":2971996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002820"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379624+0000","last_change":"2023-07-21T22:12:22.646898+0000","last_active":"2023-07-21T22:12:24.379624+0000","last_peered":"2023-07-21T22:12:24.379624+0000","last_clean":"2023-07-21T22:12:24.379624+0000","last_became_active":"2023-07-21T22:12:22.646588+0000","last_became_peered":"2023-07-21T22:12:22.646588+0000","last_unstale":"2023-07-21T22:12:24.379624+0000","last_undegraded":"2023-07-21T22:12:24.379624+0000","last_fullsized":"2023-07-21T22:12:24.379624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:05.465644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628863+0000","last_change":"2023-07-21T22:12:22.647456+0000","last_active":"2023-07-21T22:12:23.628863+0000","last_peered":"2023-07-21T22:12:23.628863+0000","last_clean":"2023-07-21T22:12:23.628863+0000","last_became_active":"2023-07-21T22:12:22.647150+0000","last_became_peered":"2023-07-21T22:12:22.647150+0000","last_unstale":"2023-07-21T22:12:23.628863+0000","last_undegraded":"2023-07-21T22:12:23.628863+0000","last_fullsized":"2023-07-21T22:12:23.628863+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:40:43.274392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629157+0000","last_change":"2023-07-21T22:12:22.626076+0000","last_active":"2023-07-21T22:12:23.629157+0000","last_peered":"2023-07-21T22:12:23.629157+0000","last_clean":"2023-07-21T22:12:23.629157+0000","last_became_active":"2023-07-21T22:12:22.625776+0000","last_became_peered":"2023-07-21T22:12:22.625776+0000","last_unstale":"2023-07-21T22:12:23.629157+0000","last_undegraded":"2023-07-21T22:12:23.629157+0000","last_fullsized":"2023-07-21T22:12:23.629157+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:58:45.276996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382389+0000","last_change":"2023-07-21T22:12:22.649992+0000","last_active":"2023-07-21T22:12:24.382389+0000","last_peered":"2023-07-21T22:12:24.382389+0000","last_clean":"2023-07-21T22:12:24.382389+0000","last_became_active":"2023-07-21T22:12:22.643386+0000","last_became_peered":"2023-07-21T22:12:22.643386+0000","last_unstale":"2023-07-21T22:12:24.382389+0000","last_undegraded":"2023-07-21T22:12:24.382389+0000","last_fullsized":"2023-07-21T22:12:24.382389+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:42.739425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628533+0000","last_change":"2023-07-21T22:12:22.636090+0000","last_active":"2023-07-21T22:12:23.628533+0000","last_peered":"2023-07-21T22:12:23.628533+0000","last_clean":"2023-07-21T22:12:23.628533+0000","last_became_active":"2023-07-21T22:12:22.635758+0000","last_became_peered":"2023-07-21T22:12:22.635758+0000","last_unstale":"2023-07-21T22:12:23.628533+0000","last_undegraded":"2023-07-21T22:12:23.628533+0000","last_fullsized":"2023-07-21T22:12:23.628533+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:37:20.979605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.770684+0000","last_change":"2023-07-21T22:12:22.639506+0000","last_active":"2023-07-21T22:12:23.770684+0000","last_peered":"2023-07-21T22:12:23.770684+0000","last_clean":"2023-07-21T22:12:23.770684+0000","last_became_active":"2023-07-21T22:12:22.639225+0000","last_became_peered":"2023-07-21T22:12:22.639225+0000","last_unstale":"2023-07-21T22:12:23.770684+0000","last_undegraded":"2023-07-21T22:12:23.770684+0000","last_fullsized":"2023-07-21T22:12:23.770684+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:46:55.181788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379650+0000","last_change":"2023-07-21T22:12:22.646898+0000","last_active":"2023-07-21T22:12:24.379650+0000","last_peered":"2023-07-21T22:12:24.379650+0000","last_clean":"2023-07-21T22:12:24.379650+0000","last_became_active":"2023-07-21T22:12:22.646609+0000","last_became_peered":"2023-07-21T22:12:22.646609+0000","last_unstale":"2023-07-21T22:12:24.379650+0000","last_undegraded":"2023-07-21T22:12:24.379650+0000","last_fullsized":"2023-07-21T22:12:24.379650+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:51:36.688418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381451+0000","last_change":"2023-07-21T22:12:22.641776+0000","last_active":"2023-07-21T22:12:24.381451+0000","last_peered":"2023-07-21T22:12:24.381451+0000","last_clean":"2023-07-21T22:12:24.381451+0000","last_became_active":"2023-07-21T22:12:22.641466+0000","last_became_peered":"2023-07-21T22:12:22.641466+0000","last_unstale":"2023-07-21T22:12:24.381451+0000","last_undegraded":"2023-07-21T22:12:24.381451+0000","last_fullsized":"2023-07-21T22:12:24.381451+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:00.624292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382430+0000","last_change":"2023-07-21T22:12:22.648946+0000","last_active":"2023-07-21T22:12:24.382430+0000","last_peered":"2023-07-21T22:12:24.382430+0000","last_clean":"2023-07-21T22:12:24.382430+0000","last_became_active":"2023-07-21T22:12:22.648679+0000","last_became_peered":"2023-07-21T22:12:22.648679+0000","last_unstale":"2023-07-21T22:12:24.382430+0000","last_undegraded":"2023-07-21T22:12:24.382430+0000","last_fullsized":"2023-07-21T22:12:24.382430+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:02:44.072502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382471+0000","last_change":"2023-07-21T22:12:22.650401+0000","last_active":"2023-07-21T22:12:24.382471+0000","last_peered":"2023-07-21T22:12:24.382471+0000","last_clean":"2023-07-21T22:12:24.382471+0000","last_became_active":"2023-07-21T22:12:22.647782+0000","last_became_peered":"2023-07-21T22:12:22.647782+0000","last_unstale":"2023-07-21T22:12:24.382471+0000","last_undegraded":"2023-07-21T22:12:24.382471+0000","last_fullsized":"2023-07-21T22:12:24.382471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:08:35.885628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382770+0000","last_change":"2023-07-21T22:12:22.648596+0000","last_active":"2023-07-21T22:12:24.382770+0000","last_peered":"2023-07-21T22:12:24.382770+0000","last_clean":"2023-07-21T22:12:24.382770+0000","last_became_active":"2023-07-21T22:12:22.648273+0000","last_became_peered":"2023-07-21T22:12:22.648273+0000","last_unstale":"2023-07-21T22:12:24.382770+0000","last_undegraded":"2023-07-21T22:12:24.382770+0000","last_fullsized":"2023-07-21T22:12:24.382770+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:22:21.899677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628892+0000","last_change":"2023-07-21T22:12:22.633969+0000","last_active":"2023-07-21T22:12:23.628892+0000","last_peered":"2023-07-21T22:12:23.628892+0000","last_clean":"2023-07-21T22:12:23.628892+0000","last_became_active":"2023-07-21T22:12:22.633655+0000","last_became_peered":"2023-07-21T22:12:22.633655+0000","last_unstale":"2023-07-21T22:12:23.628892+0000","last_undegraded":"2023-07-21T22:12:23.628892+0000","last_fullsized":"2023-07-21T22:12:23.628892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:32:19.092336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628661+0000","last_change":"2023-07-21T22:12:22.639417+0000","last_active":"2023-07-21T22:12:23.628661+0000","last_peered":"2023-07-21T22:12:23.628661+0000","last_clean":"2023-07-21T22:12:23.628661+0000","last_became_active":"2023-07-21T22:12:22.638071+0000","last_became_peered":"2023-07-21T22:12:22.638071+0000","last_unstale":"2023-07-21T22:12:23.628661+0000","last_undegraded":"2023-07-21T22:12:23.628661+0000","last_fullsized":"2023-07-21T22:12:23.628661+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:32:59.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381999+0000","last_change":"2023-07-21T22:12:22.642279+0000","last_active":"2023-07-21T22:12:24.381999+0000","last_peered":"2023-07-21T22:12:24.381999+0000","last_clean":"2023-07-21T22:12:24.381999+0000","last_became_active":"2023-07-21T22:12:22.641640+0000","last_became_peered":"2023-07-21T22:12:22.641640+0000","last_unstale":"2023-07-21T22:12:24.381999+0000","last_undegraded":"2023-07-21T22:12:24.381999+0000","last_fullsized":"2023-07-21T22:12:24.381999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:17:24.498434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.770692+0000","last_change":"2023-07-21T22:12:22.644849+0000","last_active":"2023-07-21T22:12:23.770692+0000","last_peered":"2023-07-21T22:12:23.770692+0000","last_clean":"2023-07-21T22:12:23.770692+0000","last_became_active":"2023-07-21T22:12:22.644226+0000","last_became_peered":"2023-07-21T22:12:22.644226+0000","last_unstale":"2023-07-21T22:12:23.770692+0000","last_undegraded":"2023-07-21T22:12:23.770692+0000","last_fullsized":"2023-07-21T22:12:23.770692+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:03:04.298524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666207+0000","last_change":"2023-07-21T22:12:22.654856+0000","last_active":"2023-07-21T22:12:23.666207+0000","last_peered":"2023-07-21T22:12:23.666207+0000","last_clean":"2023-07-21T22:12:23.666207+0000","last_became_active":"2023-07-21T22:12:22.654571+0000","last_became_peered":"2023-07-21T22:12:22.654571+0000","last_unstale":"2023-07-21T22:12:23.666207+0000","last_undegraded":"2023-07-21T22:12:23.666207+0000","last_fullsized":"2023-07-21T22:12:23.666207+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:57.144115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.630007+0000","last_change":"2023-07-21T22:12:22.626117+0000","last_active":"2023-07-21T22:12:23.630007+0000","last_peered":"2023-07-21T22:12:23.630007+0000","last_clean":"2023-07-21T22:12:23.630007+0000","last_became_active":"2023-07-21T22:12:22.625780+0000","last_became_peered":"2023-07-21T22:12:22.625780+0000","last_unstale":"2023-07-21T22:12:23.630007+0000","last_undegraded":"2023-07-21T22:12:23.630007+0000","last_fullsized":"2023-07-21T22:12:23.630007+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:11:43.602036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629687+0000","last_change":"2023-07-21T22:12:22.633772+0000","last_active":"2023-07-21T22:12:23.629687+0000","last_peered":"2023-07-21T22:12:23.629687+0000","last_clean":"2023-07-21T22:12:23.629687+0000","last_became_active":"2023-07-21T22:12:22.633499+0000","last_became_peered":"2023-07-21T22:12:22.633499+0000","last_unstale":"2023-07-21T22:12:23.629687+0000","last_undegraded":"2023-07-21T22:12:23.629687+0000","last_fullsized":"2023-07-21T22:12:23.629687+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:42.535791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.667034+0000","last_change":"2023-07-21T22:12:22.654897+0000","last_active":"2023-07-21T22:12:23.667034+0000","last_peered":"2023-07-21T22:12:23.667034+0000","last_clean":"2023-07-21T22:12:23.667034+0000","last_became_active":"2023-07-21T22:12:22.654660+0000","last_became_peered":"2023-07-21T22:12:22.654660+0000","last_unstale":"2023-07-21T22:12:23.667034+0000","last_undegraded":"2023-07-21T22:12:23.667034+0000","last_fullsized":"2023-07-21T22:12:23.667034+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:44:21.789759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629098+0000","last_change":"2023-07-21T22:12:22.637690+0000","last_active":"2023-07-21T22:12:23.629098+0000","last_peered":"2023-07-21T22:12:23.629098+0000","last_clean":"2023-07-21T22:12:23.629098+0000","last_became_active":"2023-07-21T22:12:22.637145+0000","last_became_peered":"2023-07-21T22:12:22.637145+0000","last_unstale":"2023-07-21T22:12:23.629098+0000","last_undegraded":"2023-07-21T22:12:23.629098+0000","last_fullsized":"2023-07-21T22:12:23.629098+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:08:55.254364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771102+0000","last_change":"2023-07-21T22:12:22.660920+0000","last_active":"2023-07-21T22:12:23.771102+0000","last_peered":"2023-07-21T22:12:23.771102+0000","last_clean":"2023-07-21T22:12:23.771102+0000","last_became_active":"2023-07-21T22:12:22.660762+0000","last_became_peered":"2023-07-21T22:12:22.660762+0000","last_unstale":"2023-07-21T22:12:23.771102+0000","last_undegraded":"2023-07-21T22:12:23.771102+0000","last_fullsized":"2023-07-21T22:12:23.771102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:21:06.707045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382295+0000","last_change":"2023-07-21T22:12:22.642579+0000","last_active":"2023-07-21T22:12:24.382295+0000","last_peered":"2023-07-21T22:12:24.382295+0000","last_clean":"2023-07-21T22:12:24.382295+0000","last_became_active":"2023-07-21T22:12:22.642013+0000","last_became_peered":"2023-07-21T22:12:22.642013+0000","last_unstale":"2023-07-21T22:12:24.382295+0000","last_undegraded":"2023-07-21T22:12:24.382295+0000","last_fullsized":"2023-07-21T22:12:24.382295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:16:34.212178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666438+0000","last_change":"2023-07-21T22:12:22.639319+0000","last_active":"2023-07-21T22:12:23.666438+0000","last_peered":"2023-07-21T22:12:23.666438+0000","last_clean":"2023-07-21T22:12:23.666438+0000","last_became_active":"2023-07-21T22:12:22.639000+0000","last_became_peered":"2023-07-21T22:12:22.639000+0000","last_unstale":"2023-07-21T22:12:23.666438+0000","last_undegraded":"2023-07-21T22:12:23.666438+0000","last_fullsized":"2023-07-21T22:12:23.666438+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:07:59.649739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666177+0000","last_change":"2023-07-21T22:12:22.639408+0000","last_active":"2023-07-21T22:12:23.666177+0000","last_peered":"2023-07-21T22:12:23.666177+0000","last_clean":"2023-07-21T22:12:23.666177+0000","last_became_active":"2023-07-21T22:12:22.639077+0000","last_became_peered":"2023-07-21T22:12:22.639077+0000","last_unstale":"2023-07-21T22:12:23.666177+0000","last_undegraded":"2023-07-21T22:12:23.666177+0000","last_fullsized":"2023-07-21T22:12:23.666177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:18:12.567822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.667081+0000","last_change":"2023-07-21T22:12:22.651499+0000","last_active":"2023-07-21T22:12:23.667081+0000","last_peered":"2023-07-21T22:12:23.667081+0000","last_clean":"2023-07-21T22:12:23.667081+0000","last_became_active":"2023-07-21T22:12:22.651281+0000","last_became_peered":"2023-07-21T22:12:22.651281+0000","last_unstale":"2023-07-21T22:12:23.667081+0000","last_undegraded":"2023-07-21T22:12:23.667081+0000","last_fullsized":"2023-07-21T22:12:23.667081+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:08.579874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628988+0000","last_change":"2023-07-21T22:12:22.638877+0000","last_active":"2023-07-21T22:12:23.628988+0000","last_peered":"2023-07-21T22:12:23.628988+0000","last_clean":"2023-07-21T22:12:23.628988+0000","last_became_active":"2023-07-21T22:12:22.638598+0000","last_became_peered":"2023-07-21T22:12:22.638598+0000","last_unstale":"2023-07-21T22:12:23.628988+0000","last_undegraded":"2023-07-21T22:12:23.628988+0000","last_fullsized":"2023-07-21T22:12:23.628988+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:41:11.410251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629550+0000","last_change":"2023-07-21T22:12:22.626071+0000","last_active":"2023-07-21T22:12:23.629550+0000","last_peered":"2023-07-21T22:12:23.629550+0000","last_clean":"2023-07-21T22:12:23.629550+0000","last_became_active":"2023-07-21T22:12:22.625732+0000","last_became_peered":"2023-07-21T22:12:22.625732+0000","last_unstale":"2023-07-21T22:12:23.629550+0000","last_undegraded":"2023-07-21T22:12:23.629550+0000","last_fullsized":"2023-07-21T22:12:23.629550+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:37.462856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628629+0000","last_change":"2023-07-21T22:12:22.638119+0000","last_active":"2023-07-21T22:12:23.628629+0000","last_peered":"2023-07-21T22:12:23.628629+0000","last_clean":"2023-07-21T22:12:23.628629+0000","last_became_active":"2023-07-21T22:12:22.637145+0000","last_became_peered":"2023-07-21T22:12:22.637145+0000","last_unstale":"2023-07-21T22:12:23.628629+0000","last_undegraded":"2023-07-21T22:12:23.628629+0000","last_fullsized":"2023-07-21T22:12:23.628629+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:53:27.799339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666628+0000","last_change":"2023-07-21T22:12:22.645861+0000","last_active":"2023-07-21T22:12:23.666628+0000","last_peered":"2023-07-21T22:12:23.666628+0000","last_clean":"2023-07-21T22:12:23.666628+0000","last_became_active":"2023-07-21T22:12:22.645542+0000","last_became_peered":"2023-07-21T22:12:22.645542+0000","last_unstale":"2023-07-21T22:12:23.666628+0000","last_undegraded":"2023-07-21T22:12:23.666628+0000","last_fullsized":"2023-07-21T22:12:23.666628+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:50:17.975826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629325+0000","last_change":"2023-07-21T22:12:22.638133+0000","last_active":"2023-07-21T22:12:23.629325+0000","last_peered":"2023-07-21T22:12:23.629325+0000","last_clean":"2023-07-21T22:12:23.629325+0000","last_became_active":"2023-07-21T22:12:22.637849+0000","last_became_peered":"2023-07-21T22:12:22.637849+0000","last_unstale":"2023-07-21T22:12:23.629325+0000","last_undegraded":"2023-07-21T22:12:23.629325+0000","last_fullsized":"2023-07-21T22:12:23.629325+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:30:55.808186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.770755+0000","last_change":"2023-07-21T22:12:22.645052+0000","last_active":"2023-07-21T22:12:23.770755+0000","last_peered":"2023-07-21T22:12:23.770755+0000","last_clean":"2023-07-21T22:12:23.770755+0000","last_became_active":"2023-07-21T22:12:22.644587+0000","last_became_peered":"2023-07-21T22:12:22.644587+0000","last_unstale":"2023-07-21T22:12:23.770755+0000","last_undegraded":"2023-07-21T22:12:23.770755+0000","last_fullsized":"2023-07-21T22:12:23.770755+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:29.317320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628600+0000","last_change":"2023-07-21T22:12:22.634629+0000","last_active":"2023-07-21T22:12:23.628600+0000","last_peered":"2023-07-21T22:12:23.628600+0000","last_clean":"2023-07-21T22:12:23.628600+0000","last_became_active":"2023-07-21T22:12:22.634302+0000","last_became_peered":"2023-07-21T22:12:22.634302+0000","last_unstale":"2023-07-21T22:12:23.628600+0000","last_undegraded":"2023-07-21T22:12:23.628600+0000","last_fullsized":"2023-07-21T22:12:23.628600+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:54:25.574993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380969+0000","last_change":"2023-07-21T22:12:22.633465+0000","last_active":"2023-07-21T22:12:24.380969+0000","last_peered":"2023-07-21T22:12:24.380969+0000","last_clean":"2023-07-21T22:12:24.380969+0000","last_became_active":"2023-07-21T22:12:22.633130+0000","last_became_peered":"2023-07-21T22:12:22.633130+0000","last_unstale":"2023-07-21T22:12:24.380969+0000","last_undegraded":"2023-07-21T22:12:24.380969+0000","last_fullsized":"2023-07-21T22:12:24.380969+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:12:44.009405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771800+0000","last_change":"2023-07-21T22:12:21.609883+0000","last_active":"2023-07-21T22:12:23.771800+0000","last_peered":"2023-07-21T22:12:23.771800+0000","last_clean":"2023-07-21T22:12:23.771800+0000","last_became_active":"2023-07-21T22:12:21.607019+0000","last_became_peered":"2023-07-21T22:12:21.607019+0000","last_unstale":"2023-07-21T22:12:23.771800+0000","last_undegraded":"2023-07-21T22:12:23.771800+0000","last_fullsized":"2023-07-21T22:12:23.771800+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:47:40.623448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666983+0000","last_change":"2023-07-21T22:12:22.646133+0000","last_active":"2023-07-21T22:12:23.666983+0000","last_peered":"2023-07-21T22:12:23.666983+0000","last_clean":"2023-07-21T22:12:23.666983+0000","last_became_active":"2023-07-21T22:12:22.645867+0000","last_became_peered":"2023-07-21T22:12:22.645867+0000","last_unstale":"2023-07-21T22:12:23.666983+0000","last_undegraded":"2023-07-21T22:12:23.666983+0000","last_fullsized":"2023-07-21T22:12:23.666983+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:43.574673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629824+0000","last_change":"2023-07-21T22:12:21.608310+0000","last_active":"2023-07-21T22:12:23.629824+0000","last_peered":"2023-07-21T22:12:23.629824+0000","last_clean":"2023-07-21T22:12:23.629824+0000","last_became_active":"2023-07-21T22:12:21.608033+0000","last_became_peered":"2023-07-21T22:12:21.608033+0000","last_unstale":"2023-07-21T22:12:23.629824+0000","last_undegraded":"2023-07-21T22:12:23.629824+0000","last_fullsized":"2023-07-21T22:12:23.629824+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:05:58.216486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628832+0000","last_change":"2023-07-21T22:12:22.638321+0000","last_active":"2023-07-21T22:12:23.628832+0000","last_peered":"2023-07-21T22:12:23.628832+0000","last_clean":"2023-07-21T22:12:23.628832+0000","last_became_active":"2023-07-21T22:12:22.637151+0000","last_became_peered":"2023-07-21T22:12:22.637151+0000","last_unstale":"2023-07-21T22:12:23.628832+0000","last_undegraded":"2023-07-21T22:12:23.628832+0000","last_fullsized":"2023-07-21T22:12:23.628832+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:21:34.801017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382287+0000","last_change":"2023-07-21T22:12:21.607987+0000","last_active":"2023-07-21T22:12:24.382287+0000","last_peered":"2023-07-21T22:12:24.382287+0000","last_clean":"2023-07-21T22:12:24.382287+0000","last_became_active":"2023-07-21T22:12:21.607205+0000","last_became_peered":"2023-07-21T22:12:21.607205+0000","last_unstale":"2023-07-21T22:12:24.382287+0000","last_undegraded":"2023-07-21T22:12:24.382287+0000","last_fullsized":"2023-07-21T22:12:24.382287+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:48.071266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381990+0000","last_change":"2023-07-21T22:12:22.642404+0000","last_active":"2023-07-21T22:12:24.381990+0000","last_peered":"2023-07-21T22:12:24.381990+0000","last_clean":"2023-07-21T22:12:24.381990+0000","last_became_active":"2023-07-21T22:12:22.642006+0000","last_became_peered":"2023-07-21T22:12:22.642006+0000","last_unstale":"2023-07-21T22:12:24.381990+0000","last_undegraded":"2023-07-21T22:12:24.381990+0000","last_fullsized":"2023-07-21T22:12:24.381990+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:18:49.922082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379212+0000","last_change":"2023-07-21T22:12:21.603184+0000","last_active":"2023-07-21T22:12:24.379212+0000","last_peered":"2023-07-21T22:12:24.379212+0000","last_clean":"2023-07-21T22:12:24.379212+0000","last_became_active":"2023-07-21T22:12:21.602889+0000","last_became_peered":"2023-07-21T22:12:21.602889+0000","last_unstale":"2023-07-21T22:12:24.379212+0000","last_undegraded":"2023-07-21T22:12:24.379212+0000","last_fullsized":"2023-07-21T22:12:24.379212+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:43:27.198307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629324+0000","last_change":"2023-07-21T22:12:22.640449+0000","last_active":"2023-07-21T22:12:23.629324+0000","last_peered":"2023-07-21T22:12:23.629324+0000","last_clean":"2023-07-21T22:12:23.629324+0000","last_became_active":"2023-07-21T22:12:22.640195+0000","last_became_peered":"2023-07-21T22:12:22.640195+0000","last_unstale":"2023-07-21T22:12:23.629324+0000","last_undegraded":"2023-07-21T22:12:23.629324+0000","last_fullsized":"2023-07-21T22:12:23.629324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:59:54.151125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771150+0000","last_change":"2023-07-21T22:12:21.601769+0000","last_active":"2023-07-21T22:12:23.771150+0000","last_peered":"2023-07-21T22:12:23.771150+0000","last_clean":"2023-07-21T22:12:23.771150+0000","last_became_active":"2023-07-21T22:12:21.601385+0000","last_became_peered":"2023-07-21T22:12:21.601385+0000","last_unstale":"2023-07-21T22:12:23.771150+0000","last_undegraded":"2023-07-21T22:12:23.771150+0000","last_fullsized":"2023-07-21T22:12:23.771150+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:11:28.191838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381332+0000","last_change":"2023-07-21T22:12:22.647592+0000","last_active":"2023-07-21T22:12:24.381332+0000","last_peered":"2023-07-21T22:12:24.381332+0000","last_clean":"2023-07-21T22:12:24.381332+0000","last_became_active":"2023-07-21T22:12:22.643447+0000","last_became_peered":"2023-07-21T22:12:22.643447+0000","last_unstale":"2023-07-21T22:12:24.381332+0000","last_undegraded":"2023-07-21T22:12:24.381332+0000","last_fullsized":"2023-07-21T22:12:24.381332+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:56.482177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629470+0000","last_change":"2023-07-21T22:12:21.605477+0000","last_active":"2023-07-21T22:12:23.629470+0000","last_peered":"2023-07-21T22:12:23.629470+0000","last_clean":"2023-07-21T22:12:23.629470+0000","last_became_active":"2023-07-21T22:12:21.605165+0000","last_became_peered":"2023-07-21T22:12:21.605165+0000","last_unstale":"2023-07-21T22:12:23.629470+0000","last_undegraded":"2023-07-21T22:12:23.629470+0000","last_fullsized":"2023-07-21T22:12:23.629470+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:29.197253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381510+0000","last_change":"2023-07-21T22:12:22.642601+0000","last_active":"2023-07-21T22:12:24.381510+0000","last_peered":"2023-07-21T22:12:24.381510+0000","last_clean":"2023-07-21T22:12:24.381510+0000","last_became_active":"2023-07-21T22:12:22.641820+0000","last_became_peered":"2023-07-21T22:12:22.641820+0000","last_unstale":"2023-07-21T22:12:24.381510+0000","last_undegraded":"2023-07-21T22:12:24.381510+0000","last_fullsized":"2023-07-21T22:12:24.381510+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:03.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628101+0000","last_change":"2023-07-21T22:12:21.606759+0000","last_active":"2023-07-21T22:12:23.628101+0000","last_peered":"2023-07-21T22:12:23.628101+0000","last_clean":"2023-07-21T22:12:23.628101+0000","last_became_active":"2023-07-21T22:12:21.606472+0000","last_became_peered":"2023-07-21T22:12:21.606472+0000","last_unstale":"2023-07-21T22:12:23.628101+0000","last_undegraded":"2023-07-21T22:12:23.628101+0000","last_fullsized":"2023-07-21T22:12:23.628101+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:04.452948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666160+0000","last_change":"2023-07-21T22:12:22.639395+0000","last_active":"2023-07-21T22:12:23.666160+0000","last_peered":"2023-07-21T22:12:23.666160+0000","last_clean":"2023-07-21T22:12:23.666160+0000","last_became_active":"2023-07-21T22:12:22.639107+0000","last_became_peered":"2023-07-21T22:12:22.639107+0000","last_unstale":"2023-07-21T22:12:23.666160+0000","last_undegraded":"2023-07-21T22:12:23.666160+0000","last_fullsized":"2023-07-21T22:12:23.666160+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:29:43.758435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381695+0000","last_change":"2023-07-21T22:12:21.616075+0000","last_active":"2023-07-21T22:12:24.381695+0000","last_peered":"2023-07-21T22:12:24.381695+0000","last_clean":"2023-07-21T22:12:24.381695+0000","last_became_active":"2023-07-21T22:12:21.615645+0000","last_became_peered":"2023-07-21T22:12:21.615645+0000","last_unstale":"2023-07-21T22:12:24.381695+0000","last_undegraded":"2023-07-21T22:12:24.381695+0000","last_fullsized":"2023-07-21T22:12:24.381695+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:39:45.581092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629625+0000","last_change":"2023-07-21T22:12:22.633603+0000","last_active":"2023-07-21T22:12:23.629625+0000","last_peered":"2023-07-21T22:12:23.629625+0000","last_clean":"2023-07-21T22:12:23.629625+0000","last_became_active":"2023-07-21T22:12:22.632978+0000","last_became_peered":"2023-07-21T22:12:22.632978+0000","last_unstale":"2023-07-21T22:12:23.629625+0000","last_undegraded":"2023-07-21T22:12:23.629625+0000","last_fullsized":"2023-07-21T22:12:23.629625+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:20:48.235788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.630049+0000","last_change":"2023-07-21T22:12:21.605065+0000","last_active":"2023-07-21T22:12:23.630049+0000","last_peered":"2023-07-21T22:12:23.630049+0000","last_clean":"2023-07-21T22:12:23.630049+0000","last_became_active":"2023-07-21T22:12:21.604786+0000","last_became_peered":"2023-07-21T22:12:21.604786+0000","last_unstale":"2023-07-21T22:12:23.630049+0000","last_undegraded":"2023-07-21T22:12:23.630049+0000","last_fullsized":"2023-07-21T22:12:23.630049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:30.021297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379664+0000","last_change":"2023-07-21T22:12:22.642469+0000","last_active":"2023-07-21T22:12:24.379664+0000","last_peered":"2023-07-21T22:12:24.379664+0000","last_clean":"2023-07-21T22:12:24.379664+0000","last_became_active":"2023-07-21T22:12:22.641997+0000","last_became_peered":"2023-07-21T22:12:22.641997+0000","last_unstale":"2023-07-21T22:12:24.379664+0000","last_undegraded":"2023-07-21T22:12:24.379664+0000","last_fullsized":"2023-07-21T22:12:24.379664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:14:29.089939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382946+0000","last_change":"2023-07-21T22:12:21.619690+0000","last_active":"2023-07-21T22:12:24.382946+0000","last_peered":"2023-07-21T22:12:24.382946+0000","last_clean":"2023-07-21T22:12:24.382946+0000","last_became_active":"2023-07-21T22:12:21.619369+0000","last_became_peered":"2023-07-21T22:12:21.619369+0000","last_unstale":"2023-07-21T22:12:24.382946+0000","last_undegraded":"2023-07-21T22:12:24.382946+0000","last_fullsized":"2023-07-21T22:12:24.382946+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:38:35.761808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771538+0000","last_change":"2023-07-21T22:12:22.660251+0000","last_active":"2023-07-21T22:12:23.771538+0000","last_peered":"2023-07-21T22:12:23.771538+0000","last_clean":"2023-07-21T22:12:23.771538+0000","last_became_active":"2023-07-21T22:12:22.646444+0000","last_became_peered":"2023-07-21T22:12:22.646444+0000","last_unstale":"2023-07-21T22:12:23.771538+0000","last_undegraded":"2023-07-21T22:12:23.771538+0000","last_fullsized":"2023-07-21T22:12:23.771538+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:54.203729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379642+0000","last_change":"2023-07-21T22:12:21.608773+0000","last_active":"2023-07-21T22:12:24.379642+0000","last_peered":"2023-07-21T22:12:24.379642+0000","last_clean":"2023-07-21T22:12:24.379642+0000","last_became_active":"2023-07-21T22:12:21.608475+0000","last_became_peered":"2023-07-21T22:12:21.608475+0000","last_unstale":"2023-07-21T22:12:24.379642+0000","last_undegraded":"2023-07-21T22:12:24.379642+0000","last_fullsized":"2023-07-21T22:12:24.379642+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:37:19.966908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379239+0000","last_change":"2023-07-21T22:12:22.647138+0000","last_active":"2023-07-21T22:12:24.379239+0000","last_peered":"2023-07-21T22:12:24.379239+0000","last_clean":"2023-07-21T22:12:24.379239+0000","last_became_active":"2023-07-21T22:12:22.646814+0000","last_became_peered":"2023-07-21T22:12:22.646814+0000","last_unstale":"2023-07-21T22:12:24.379239+0000","last_undegraded":"2023-07-21T22:12:24.379239+0000","last_fullsized":"2023-07-21T22:12:24.379239+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:38:42.171793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629237+0000","last_change":"2023-07-21T22:12:21.609348+0000","last_active":"2023-07-21T22:12:23.629237+0000","last_peered":"2023-07-21T22:12:23.629237+0000","last_clean":"2023-07-21T22:12:23.629237+0000","last_became_active":"2023-07-21T22:12:21.609052+0000","last_became_peered":"2023-07-21T22:12:21.609052+0000","last_unstale":"2023-07-21T22:12:23.629237+0000","last_undegraded":"2023-07-21T22:12:23.629237+0000","last_fullsized":"2023-07-21T22:12:23.629237+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:38:27.588511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666779+0000","last_change":"2023-07-21T22:12:22.655637+0000","last_active":"2023-07-21T22:12:23.666779+0000","last_peered":"2023-07-21T22:12:23.666779+0000","last_clean":"2023-07-21T22:12:23.666779+0000","last_became_active":"2023-07-21T22:12:22.655361+0000","last_became_peered":"2023-07-21T22:12:22.655361+0000","last_unstale":"2023-07-21T22:12:23.666779+0000","last_undegraded":"2023-07-21T22:12:23.666779+0000","last_fullsized":"2023-07-21T22:12:23.666779+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:49:38.897493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771368+0000","last_change":"2023-07-21T22:12:21.617222+0000","last_active":"2023-07-21T22:12:23.771368+0000","last_peered":"2023-07-21T22:12:23.771368+0000","last_clean":"2023-07-21T22:12:23.771368+0000","last_became_active":"2023-07-21T22:12:21.616954+0000","last_became_peered":"2023-07-21T22:12:21.616954+0000","last_unstale":"2023-07-21T22:12:23.771368+0000","last_undegraded":"2023-07-21T22:12:23.771368+0000","last_fullsized":"2023-07-21T22:12:23.771368+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:03.173166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381599+0000","last_change":"2023-07-21T22:12:22.640238+0000","last_active":"2023-07-21T22:12:24.381599+0000","last_peered":"2023-07-21T22:12:24.381599+0000","last_clean":"2023-07-21T22:12:24.381599+0000","last_became_active":"2023-07-21T22:12:22.639975+0000","last_became_peered":"2023-07-21T22:12:22.639975+0000","last_unstale":"2023-07-21T22:12:24.381599+0000","last_undegraded":"2023-07-21T22:12:24.381599+0000","last_fullsized":"2023-07-21T22:12:24.381599+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:25.899817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379159+0000","last_change":"2023-07-21T22:12:21.602070+0000","last_active":"2023-07-21T22:12:24.379159+0000","last_peered":"2023-07-21T22:12:24.379159+0000","last_clean":"2023-07-21T22:12:24.379159+0000","last_became_active":"2023-07-21T22:12:21.600983+0000","last_became_peered":"2023-07-21T22:12:21.600983+0000","last_unstale":"2023-07-21T22:12:24.379159+0000","last_undegraded":"2023-07-21T22:12:24.379159+0000","last_fullsized":"2023-07-21T22:12:24.379159+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:02:18.693632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.770727+0000","last_change":"2023-07-21T22:12:22.645069+0000","last_active":"2023-07-21T22:12:23.770727+0000","last_peered":"2023-07-21T22:12:23.770727+0000","last_clean":"2023-07-21T22:12:23.770727+0000","last_became_active":"2023-07-21T22:12:22.644792+0000","last_became_peered":"2023-07-21T22:12:22.644792+0000","last_unstale":"2023-07-21T22:12:23.770727+0000","last_undegraded":"2023-07-21T22:12:23.770727+0000","last_fullsized":"2023-07-21T22:12:23.770727+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:56:14.066685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771004+0000","last_change":"2023-07-21T22:12:21.616218+0000","last_active":"2023-07-21T22:12:23.771004+0000","last_peered":"2023-07-21T22:12:23.771004+0000","last_clean":"2023-07-21T22:12:23.771004+0000","last_became_active":"2023-07-21T22:12:21.615937+0000","last_became_peered":"2023-07-21T22:12:21.615937+0000","last_unstale":"2023-07-21T22:12:23.771004+0000","last_undegraded":"2023-07-21T22:12:23.771004+0000","last_fullsized":"2023-07-21T22:12:23.771004+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:43:48.862531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379455+0000","last_change":"2023-07-21T22:12:22.642348+0000","last_active":"2023-07-21T22:12:24.379455+0000","last_peered":"2023-07-21T22:12:24.379455+0000","last_clean":"2023-07-21T22:12:24.379455+0000","last_became_active":"2023-07-21T22:12:22.642061+0000","last_became_peered":"2023-07-21T22:12:22.642061+0000","last_unstale":"2023-07-21T22:12:24.379455+0000","last_undegraded":"2023-07-21T22:12:24.379455+0000","last_fullsized":"2023-07-21T22:12:24.379455+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:47:57.317565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381770+0000","last_change":"2023-07-21T22:12:21.617648+0000","last_active":"2023-07-21T22:12:24.381770+0000","last_peered":"2023-07-21T22:12:24.381770+0000","last_clean":"2023-07-21T22:12:24.381770+0000","last_became_active":"2023-07-21T22:12:21.617357+0000","last_became_peered":"2023-07-21T22:12:21.617357+0000","last_unstale":"2023-07-21T22:12:24.381770+0000","last_undegraded":"2023-07-21T22:12:24.381770+0000","last_fullsized":"2023-07-21T22:12:24.381770+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:02.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628890+0000","last_change":"2023-07-21T22:12:22.632452+0000","last_active":"2023-07-21T22:12:23.628890+0000","last_peered":"2023-07-21T22:12:23.628890+0000","last_clean":"2023-07-21T22:12:23.628890+0000","last_became_active":"2023-07-21T22:12:22.632103+0000","last_became_peered":"2023-07-21T22:12:22.632103+0000","last_unstale":"2023-07-21T22:12:23.628890+0000","last_undegraded":"2023-07-21T22:12:23.628890+0000","last_fullsized":"2023-07-21T22:12:23.628890+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:24:40.736147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628827+0000","last_change":"2023-07-21T22:12:21.617908+0000","last_active":"2023-07-21T22:12:23.628827+0000","last_peered":"2023-07-21T22:12:23.628827+0000","last_clean":"2023-07-21T22:12:23.628827+0000","last_became_active":"2023-07-21T22:12:21.617579+0000","last_became_peered":"2023-07-21T22:12:21.617579+0000","last_unstale":"2023-07-21T22:12:23.628827+0000","last_undegraded":"2023-07-21T22:12:23.628827+0000","last_fullsized":"2023-07-21T22:12:23.628827+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:44.012848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382473+0000","last_change":"2023-07-21T22:12:22.638466+0000","last_active":"2023-07-21T22:12:24.382473+0000","last_peered":"2023-07-21T22:12:24.382473+0000","last_clean":"2023-07-21T22:12:24.382473+0000","last_became_active":"2023-07-21T22:12:22.638176+0000","last_became_peered":"2023-07-21T22:12:22.638176+0000","last_unstale":"2023-07-21T22:12:24.382473+0000","last_undegraded":"2023-07-21T22:12:24.382473+0000","last_fullsized":"2023-07-21T22:12:24.382473+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:07:37.624184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629811+0000","last_change":"2023-07-21T22:12:21.606203+0000","last_active":"2023-07-21T22:12:23.629811+0000","last_peered":"2023-07-21T22:12:23.629811+0000","last_clean":"2023-07-21T22:12:23.629811+0000","last_became_active":"2023-07-21T22:12:21.605950+0000","last_became_peered":"2023-07-21T22:12:21.605950+0000","last_unstale":"2023-07-21T22:12:23.629811+0000","last_undegraded":"2023-07-21T22:12:23.629811+0000","last_fullsized":"2023-07-21T22:12:23.629811+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:42:03.742168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666647+0000","last_change":"2023-07-21T22:12:22.659919+0000","last_active":"2023-07-21T22:12:23.666647+0000","last_peered":"2023-07-21T22:12:23.666647+0000","last_clean":"2023-07-21T22:12:23.666647+0000","last_became_active":"2023-07-21T22:12:22.659595+0000","last_became_peered":"2023-07-21T22:12:22.659595+0000","last_unstale":"2023-07-21T22:12:23.666647+0000","last_undegraded":"2023-07-21T22:12:23.666647+0000","last_fullsized":"2023-07-21T22:12:23.666647+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:50.131643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628857+0000","last_change":"2023-07-21T22:12:21.607942+0000","last_active":"2023-07-21T22:12:23.628857+0000","last_peered":"2023-07-21T22:12:23.628857+0000","last_clean":"2023-07-21T22:12:23.628857+0000","last_became_active":"2023-07-21T22:12:21.607667+0000","last_became_peered":"2023-07-21T22:12:21.607667+0000","last_unstale":"2023-07-21T22:12:23.628857+0000","last_undegraded":"2023-07-21T22:12:23.628857+0000","last_fullsized":"2023-07-21T22:12:23.628857+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:42:05.495270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.666951+0000","last_change":"2023-07-21T22:12:22.652621+0000","last_active":"2023-07-21T22:12:23.666951+0000","last_peered":"2023-07-21T22:12:23.666951+0000","last_clean":"2023-07-21T22:12:23.666951+0000","last_became_active":"2023-07-21T22:12:22.652293+0000","last_became_peered":"2023-07-21T22:12:22.652293+0000","last_unstale":"2023-07-21T22:12:23.666951+0000","last_undegraded":"2023-07-21T22:12:23.666951+0000","last_fullsized":"2023-07-21T22:12:23.666951+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:17:54.390337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771641+0000","last_change":"2023-07-21T22:12:21.610547+0000","last_active":"2023-07-21T22:12:23.771641+0000","last_peered":"2023-07-21T22:12:23.771641+0000","last_clean":"2023-07-21T22:12:23.771641+0000","last_became_active":"2023-07-21T22:12:21.610273+0000","last_became_peered":"2023-07-21T22:12:21.610273+0000","last_unstale":"2023-07-21T22:12:23.771641+0000","last_undegraded":"2023-07-21T22:12:23.771641+0000","last_fullsized":"2023-07-21T22:12:23.771641+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:20:18.559114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.770861+0000","last_change":"2023-07-21T22:12:22.660282+0000","last_active":"2023-07-21T22:12:23.770861+0000","last_peered":"2023-07-21T22:12:23.770861+0000","last_clean":"2023-07-21T22:12:23.770861+0000","last_became_active":"2023-07-21T22:12:22.646212+0000","last_became_peered":"2023-07-21T22:12:22.646212+0000","last_unstale":"2023-07-21T22:12:23.770861+0000","last_undegraded":"2023-07-21T22:12:23.770861+0000","last_fullsized":"2023-07-21T22:12:23.770861+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:37.238062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771622+0000","last_change":"2023-07-21T22:12:21.601832+0000","last_active":"2023-07-21T22:12:23.771622+0000","last_peered":"2023-07-21T22:12:23.771622+0000","last_clean":"2023-07-21T22:12:23.771622+0000","last_became_active":"2023-07-21T22:12:21.601535+0000","last_became_peered":"2023-07-21T22:12:21.601535+0000","last_unstale":"2023-07-21T22:12:23.771622+0000","last_undegraded":"2023-07-21T22:12:23.771622+0000","last_fullsized":"2023-07-21T22:12:23.771622+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:41.563505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381004+0000","last_change":"2023-07-21T22:12:22.628639+0000","last_active":"2023-07-21T22:12:24.381004+0000","last_peered":"2023-07-21T22:12:24.381004+0000","last_clean":"2023-07-21T22:12:24.381004+0000","last_became_active":"2023-07-21T22:12:22.628353+0000","last_became_peered":"2023-07-21T22:12:22.628353+0000","last_unstale":"2023-07-21T22:12:24.381004+0000","last_undegraded":"2023-07-21T22:12:24.381004+0000","last_fullsized":"2023-07-21T22:12:24.381004+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:25.942541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628162+0000","last_change":"2023-07-21T22:12:21.608858+0000","last_active":"2023-07-21T22:12:23.628162+0000","last_peered":"2023-07-21T22:12:23.628162+0000","last_clean":"2023-07-21T22:12:23.628162+0000","last_became_active":"2023-07-21T22:12:21.608596+0000","last_became_peered":"2023-07-21T22:12:21.608596+0000","last_unstale":"2023-07-21T22:12:23.628162+0000","last_undegraded":"2023-07-21T22:12:23.628162+0000","last_fullsized":"2023-07-21T22:12:23.628162+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:51:35.675722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628807+0000","last_change":"2023-07-21T22:12:22.639837+0000","last_active":"2023-07-21T22:12:23.628807+0000","last_peered":"2023-07-21T22:12:23.628807+0000","last_clean":"2023-07-21T22:12:23.628807+0000","last_became_active":"2023-07-21T22:12:22.639512+0000","last_became_peered":"2023-07-21T22:12:22.639512+0000","last_unstale":"2023-07-21T22:12:23.628807+0000","last_undegraded":"2023-07-21T22:12:23.628807+0000","last_fullsized":"2023-07-21T22:12:23.628807+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:09:59.540438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382911+0000","last_change":"2023-07-21T22:12:21.614880+0000","last_active":"2023-07-21T22:12:24.382911+0000","last_peered":"2023-07-21T22:12:24.382911+0000","last_clean":"2023-07-21T22:12:24.382911+0000","last_became_active":"2023-07-21T22:12:21.614486+0000","last_became_peered":"2023-07-21T22:12:21.614486+0000","last_unstale":"2023-07-21T22:12:24.382911+0000","last_undegraded":"2023-07-21T22:12:24.382911+0000","last_fullsized":"2023-07-21T22:12:24.382911+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:22:19.622259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381489+0000","last_change":"2023-07-21T22:12:22.649274+0000","last_active":"2023-07-21T22:12:24.381489+0000","last_peered":"2023-07-21T22:12:24.381489+0000","last_clean":"2023-07-21T22:12:24.381489+0000","last_became_active":"2023-07-21T22:12:22.648201+0000","last_became_peered":"2023-07-21T22:12:22.648201+0000","last_unstale":"2023-07-21T22:12:24.381489+0000","last_undegraded":"2023-07-21T22:12:24.381489+0000","last_fullsized":"2023-07-21T22:12:24.381489+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:49:55.291010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.378783+0000","last_change":"2023-07-21T22:12:21.603129+0000","last_active":"2023-07-21T22:12:24.378783+0000","last_peered":"2023-07-21T22:12:24.378783+0000","last_clean":"2023-07-21T22:12:24.378783+0000","last_became_active":"2023-07-21T22:12:21.602834+0000","last_became_peered":"2023-07-21T22:12:21.602834+0000","last_unstale":"2023-07-21T22:12:24.378783+0000","last_undegraded":"2023-07-21T22:12:24.378783+0000","last_fullsized":"2023-07-21T22:12:24.378783+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:51.989115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771178+0000","last_change":"2023-07-21T22:12:22.661683+0000","last_active":"2023-07-21T22:12:23.771178+0000","last_peered":"2023-07-21T22:12:23.771178+0000","last_clean":"2023-07-21T22:12:23.771178+0000","last_became_active":"2023-07-21T22:12:22.659989+0000","last_became_peered":"2023-07-21T22:12:22.659989+0000","last_unstale":"2023-07-21T22:12:23.771178+0000","last_undegraded":"2023-07-21T22:12:23.771178+0000","last_fullsized":"2023-07-21T22:12:23.771178+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:38.154518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379382+0000","last_change":"2023-07-21T22:12:21.609223+0000","last_active":"2023-07-21T22:12:24.379382+0000","last_peered":"2023-07-21T22:12:24.379382+0000","last_clean":"2023-07-21T22:12:24.379382+0000","last_became_active":"2023-07-21T22:12:21.608882+0000","last_became_peered":"2023-07-21T22:12:21.608882+0000","last_unstale":"2023-07-21T22:12:24.379382+0000","last_undegraded":"2023-07-21T22:12:24.379382+0000","last_fullsized":"2023-07-21T22:12:24.379382+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:13:20.662264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.667285+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:12:23.667285+0000","last_peered":"2023-07-21T22:12:23.667285+0000","last_clean":"2023-07-21T22:12:23.667285+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:12:23.667285+0000","last_undegraded":"2023-07-21T22:12:23.667285+0000","last_fullsized":"2023-07-21T22:12:23.667285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:23:02.419049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771040+0000","last_change":"2023-07-21T22:12:22.645778+0000","last_active":"2023-07-21T22:12:23.771040+0000","last_peered":"2023-07-21T22:12:23.771040+0000","last_clean":"2023-07-21T22:12:23.771040+0000","last_became_active":"2023-07-21T22:12:22.645526+0000","last_became_peered":"2023-07-21T22:12:22.645526+0000","last_unstale":"2023-07-21T22:12:23.771040+0000","last_undegraded":"2023-07-21T22:12:23.771040+0000","last_fullsized":"2023-07-21T22:12:23.771040+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:16.990106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629657+0000","last_change":"2023-07-21T22:12:21.612615+0000","last_active":"2023-07-21T22:12:23.629657+0000","last_peered":"2023-07-21T22:12:23.629657+0000","last_clean":"2023-07-21T22:12:23.629657+0000","last_became_active":"2023-07-21T22:12:21.612343+0000","last_became_peered":"2023-07-21T22:12:21.612343+0000","last_unstale":"2023-07-21T22:12:23.629657+0000","last_undegraded":"2023-07-21T22:12:23.629657+0000","last_fullsized":"2023-07-21T22:12:23.629657+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:13:04.346697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381126+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:12:24.381126+0000","last_peered":"2023-07-21T22:12:24.381126+0000","last_clean":"2023-07-21T22:12:24.381126+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:12:24.381126+0000","last_undegraded":"2023-07-21T22:12:24.381126+0000","last_fullsized":"2023-07-21T22:12:24.381126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:31:37.838038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628285+0000","last_change":"2023-07-21T22:12:22.632522+0000","last_active":"2023-07-21T22:12:23.628285+0000","last_peered":"2023-07-21T22:12:23.628285+0000","last_clean":"2023-07-21T22:12:23.628285+0000","last_became_active":"2023-07-21T22:12:22.632256+0000","last_became_peered":"2023-07-21T22:12:22.632256+0000","last_unstale":"2023-07-21T22:12:23.628285+0000","last_undegraded":"2023-07-21T22:12:23.628285+0000","last_fullsized":"2023-07-21T22:12:23.628285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:14:29.089939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380896+0000","last_change":"2023-07-21T22:12:21.611685+0000","last_active":"2023-07-21T22:12:24.380896+0000","last_peered":"2023-07-21T22:12:24.380896+0000","last_clean":"2023-07-21T22:12:24.380896+0000","last_became_active":"2023-07-21T22:12:21.611382+0000","last_became_peered":"2023-07-21T22:12:21.611382+0000","last_unstale":"2023-07-21T22:12:24.380896+0000","last_undegraded":"2023-07-21T22:12:24.380896+0000","last_fullsized":"2023-07-21T22:12:24.380896+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:05:47.955186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379833+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:12:24.379833+0000","last_peered":"2023-07-21T22:12:24.379833+0000","last_clean":"2023-07-21T22:12:24.379833+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:12:24.379833+0000","last_undegraded":"2023-07-21T22:12:24.379833+0000","last_fullsized":"2023-07-21T22:12:24.379833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:51:34.302311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.629065+0000","last_change":"2023-07-21T22:12:22.636228+0000","last_active":"2023-07-21T22:12:23.629065+0000","last_peered":"2023-07-21T22:12:23.629065+0000","last_clean":"2023-07-21T22:12:23.629065+0000","last_became_active":"2023-07-21T22:12:22.635935+0000","last_became_peered":"2023-07-21T22:12:22.635935+0000","last_unstale":"2023-07-21T22:12:23.629065+0000","last_undegraded":"2023-07-21T22:12:23.629065+0000","last_fullsized":"2023-07-21T22:12:23.629065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:50:35.389978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382012+0000","last_change":"2023-07-21T22:12:21.618366+0000","last_active":"2023-07-21T22:12:24.382012+0000","last_peered":"2023-07-21T22:12:24.382012+0000","last_clean":"2023-07-21T22:12:24.382012+0000","last_became_active":"2023-07-21T22:12:21.617965+0000","last_became_peered":"2023-07-21T22:12:21.617965+0000","last_unstale":"2023-07-21T22:12:24.382012+0000","last_undegraded":"2023-07-21T22:12:24.382012+0000","last_fullsized":"2023-07-21T22:12:24.382012+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:02:57.952042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.381102+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:12:24.381102+0000","last_peered":"2023-07-21T22:12:24.381102+0000","last_clean":"2023-07-21T22:12:24.381102+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:12:24.381102+0000","last_undegraded":"2023-07-21T22:12:24.381102+0000","last_fullsized":"2023-07-21T22:12:24.381102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:38.424071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.667098+0000","last_change":"2023-07-21T22:12:22.662460+0000","last_active":"2023-07-21T22:12:23.667098+0000","last_peered":"2023-07-21T22:12:23.667098+0000","last_clean":"2023-07-21T22:12:23.667098+0000","last_became_active":"2023-07-21T22:12:22.662117+0000","last_became_peered":"2023-07-21T22:12:22.662117+0000","last_unstale":"2023-07-21T22:12:23.667098+0000","last_undegraded":"2023-07-21T22:12:23.667098+0000","last_fullsized":"2023-07-21T22:12:23.667098+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:14.633616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.771782+0000","last_change":"2023-07-21T22:12:21.606595+0000","last_active":"2023-07-21T22:12:23.771782+0000","last_peered":"2023-07-21T22:12:23.771782+0000","last_clean":"2023-07-21T22:12:23.771782+0000","last_became_active":"2023-07-21T22:12:21.606244+0000","last_became_peered":"2023-07-21T22:12:21.606244+0000","last_unstale":"2023-07-21T22:12:23.771782+0000","last_undegraded":"2023-07-21T22:12:23.771782+0000","last_fullsized":"2023-07-21T22:12:23.771782+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:36:53.515697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628281+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:12:23.628281+0000","last_peered":"2023-07-21T22:12:23.628281+0000","last_clean":"2023-07-21T22:12:23.628281+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:12:23.628281+0000","last_undegraded":"2023-07-21T22:12:23.628281+0000","last_fullsized":"2023-07-21T22:12:23.628281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:02:02.395341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382737+0000","last_change":"2023-07-21T22:12:22.639308+0000","last_active":"2023-07-21T22:12:24.382737+0000","last_peered":"2023-07-21T22:12:24.382737+0000","last_clean":"2023-07-21T22:12:24.382737+0000","last_became_active":"2023-07-21T22:12:22.638996+0000","last_became_peered":"2023-07-21T22:12:22.638996+0000","last_unstale":"2023-07-21T22:12:24.382737+0000","last_undegraded":"2023-07-21T22:12:24.382737+0000","last_fullsized":"2023-07-21T22:12:24.382737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:38:34.946660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379628+0000","last_change":"2023-07-21T22:12:21.610628+0000","last_active":"2023-07-21T22:12:24.379628+0000","last_peered":"2023-07-21T22:12:24.379628+0000","last_clean":"2023-07-21T22:12:24.379628+0000","last_became_active":"2023-07-21T22:12:21.610371+0000","last_became_peered":"2023-07-21T22:12:21.610371+0000","last_unstale":"2023-07-21T22:12:24.379628+0000","last_undegraded":"2023-07-21T22:12:24.379628+0000","last_fullsized":"2023-07-21T22:12:24.379628+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:54.879672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628392+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:12:23.628392+0000","last_peered":"2023-07-21T22:12:23.628392+0000","last_clean":"2023-07-21T22:12:23.628392+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:12:23.628392+0000","last_undegraded":"2023-07-21T22:12:23.628392+0000","last_fullsized":"2023-07-21T22:12:23.628392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:52.725011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379292+0000","last_change":"2023-07-21T22:12:22.644968+0000","last_active":"2023-07-21T22:12:24.379292+0000","last_peered":"2023-07-21T22:12:24.379292+0000","last_clean":"2023-07-21T22:12:24.379292+0000","last_became_active":"2023-07-21T22:12:22.644662+0000","last_became_peered":"2023-07-21T22:12:22.644662+0000","last_unstale":"2023-07-21T22:12:24.379292+0000","last_undegraded":"2023-07-21T22:12:24.379292+0000","last_fullsized":"2023-07-21T22:12:24.379292+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:32.664045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.380888+0000","last_change":"2023-07-21T22:12:21.607945+0000","last_active":"2023-07-21T22:12:24.380888+0000","last_peered":"2023-07-21T22:12:24.380888+0000","last_clean":"2023-07-21T22:12:24.380888+0000","last_became_active":"2023-07-21T22:12:21.607453+0000","last_became_peered":"2023-07-21T22:12:21.607453+0000","last_unstale":"2023-07-21T22:12:24.380888+0000","last_undegraded":"2023-07-21T22:12:24.380888+0000","last_fullsized":"2023-07-21T22:12:24.380888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:06.804163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.378776+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:12:24.378776+0000","last_peered":"2023-07-21T22:12:24.378776+0000","last_clean":"2023-07-21T22:12:24.378776+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:12:24.378776+0000","last_undegraded":"2023-07-21T22:12:24.378776+0000","last_fullsized":"2023-07-21T22:12:24.378776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:32:17.919429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.382739+0000","last_change":"2023-07-21T22:12:22.648121+0000","last_active":"2023-07-21T22:12:24.382739+0000","last_peered":"2023-07-21T22:12:24.382739+0000","last_clean":"2023-07-21T22:12:24.382739+0000","last_became_active":"2023-07-21T22:12:22.643658+0000","last_became_peered":"2023-07-21T22:12:22.643658+0000","last_unstale":"2023-07-21T22:12:24.382739+0000","last_undegraded":"2023-07-21T22:12:24.382739+0000","last_fullsized":"2023-07-21T22:12:24.382739+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:21.574993+0000","last_clean_scrub_stamp":"2023-07-21T22:12:21.574993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:36.960941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628831+0000","last_change":"2023-07-21T22:12:21.612525+0000","last_active":"2023-07-21T22:12:23.628831+0000","last_peered":"2023-07-21T22:12:23.628831+0000","last_clean":"2023-07-21T22:12:23.628831+0000","last_became_active":"2023-07-21T22:12:21.612268+0000","last_became_peered":"2023-07-21T22:12:21.612268+0000","last_unstale":"2023-07-21T22:12:23.628831+0000","last_undegraded":"2023-07-21T22:12:23.628831+0000","last_fullsized":"2023-07-21T22:12:23.628831+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:20.562296+0000","last_clean_scrub_stamp":"2023-07-21T22:12:20.562296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:21:39.323443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:23.628687+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:12:23.628687+0000","last_peered":"2023-07-21T22:12:23.628687+0000","last_clean":"2023-07-21T22:12:23.628687+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:12:23.628687+0000","last_undegraded":"2023-07-21T22:12:23.628687+0000","last_fullsized":"2023-07-21T22:12:23.628687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:15.005931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":206,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-21T22:12:24.379511+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:12:24.379511+0000","last_peered":"2023-07-21T22:12:24.379511+0000","last_clean":"2023-07-21T22:12:24.379511+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:12:24.379511+0000","last_undegraded":"2023-07-21T22:12:24.379511+0000","last_fullsized":"2023-07-21T22:12:24.379511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:34:38.203636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1101824,"data_stored":813775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.206,"15min":1.218},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2909999999999999,"15min":1.3140000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8300000000000001,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.1659999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.21,"15min":1.2230000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.2709999999999999,"15min":1.2849999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.681,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.4950000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.2250000000000001,"15min":1.23},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.246,"5min":1.2989999999999999,"15min":1.3080000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.6830000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.296,"15min":1.2989999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.5409999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.538},{"interface":"front","average":{"1min":1.212,"5min":1.3999999999999999,"15min":1.431},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.4410000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.23,"15min":1.238},"min":{"1min":0.81699999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.806,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.3300000000000001,"15min":1.3420000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.619}]},{"osd":5,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.361,"15min":1.3700000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.591},{"interface":"front","average":{"1min":1.292,"5min":1.3759999999999999,"15min":1.3899999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.744,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.649}]},{"osd":6,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.4930000000000001,"15min":1.51},"min":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.776,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.752},{"interface":"front","average":{"1min":1.383,"5min":1.4239999999999999,"15min":1.431},"min":{"1min":0.83799999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.3210000000000002,"5min":2.476,"15min":2.476},"last":1.7230000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":512000,"data_stored":223989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.1080000000000001,"15min":1.1200000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.075,"5min":1.139,"15min":1.1499999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.488,"5min":2.802,"15min":2.802},"last":0.95999999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.232,"15min":1.252},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5980000000000001,"5min":1.839,"15min":1.839},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.2290000000000001,"15min":1.256},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.726,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.78500000000000003}]},{"osd":2,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2589999999999999,"15min":1.2769999999999999},"min":{"1min":0.78700000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.4330000000000001,"5min":2.911,"15min":2.911},"last":1.145},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.335,"15min":1.371},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7390000000000001,"5min":2.379,"15min":2.379},"last":0.93300000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.4139999999999999,"15min":1.4379999999999999},"min":{"1min":0.88700000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.649,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.397,"15min":1.419},"min":{"1min":0.81299999999999994,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.645,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.276,"15min":1.278},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.9950000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.381,"15min":1.3959999999999999},"min":{"1min":0.876,"5min":0.745,"15min":0.745},"max":{"1min":1.788,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.0629999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3999999999999999,"15min":1.405},"min":{"1min":0.84999999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.028,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.391},{"interface":"front","average":{"1min":1.411,"5min":1.4510000000000001,"15min":1.4570000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.915,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.24}]},{"osd":7,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.4430000000000001,"15min":1.448},"min":{"1min":1.044,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.8979999999999999,"5min":4.194,"15min":4.194},"last":1.212},{"interface":"front","average":{"1min":1.486,"5min":1.548,"15min":1.5580000000000001},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.0910000000000002,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.27}]}]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":223387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.087,"15min":1.099},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.5349999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.256},{"interface":"front","average":{"1min":1.077,"5min":1.133,"15min":1.1419999999999999},"min":{"1min":0.66700000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5069999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.22}]},{"osd":1,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1910000000000001,"15min":1.2090000000000001},"min":{"1min":0.75800000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.385,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.139,"5min":1.1839999999999999,"15min":1.1919999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.5489999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.97599999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1579999999999999,"15min":1.165},"min":{"1min":0.81799999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4850000000000001,"5min":1.625,"15min":1.625},"last":1.335},{"interface":"front","average":{"1min":1.165,"5min":1.29,"15min":1.3109999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.615,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.103}]},{"osd":3,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.248,"15min":1.2569999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.51,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.395,"15min":1.409},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.6259999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1259999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.327,"15min":1.343},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.7829999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.304,"15min":1.3080000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.6040000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1759999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.276,"15min":1.29},"min":{"1min":0.98999999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6060000000000001,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.288},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.3320000000000001,"15min":1.3440000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7569999999999999,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.028}]},{"osd":7,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3069999999999999,"15min":1.3120000000000001},"min":{"1min":0.76200000000000001,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.639,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.073},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.512,"15min":1.528},"min":{"1min":1.0189999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7390000000000001,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.395}]}]},{"osd":4,"up_from":15,"seq":64424509468,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":516096,"data_stored":224881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1120000000000001,"15min":1.103},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.085,"5min":1.1619999999999999,"15min":1.175},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.2529999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.222,"15min":1.234},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7070000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.2010000000000001,"15min":1.198},"min":{"1min":0.83199999999999996,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.2090000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.77900000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.6040000000000001,"5min":1.609,"15min":1.609},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.2849999999999999,"15min":1.302},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.5169999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.296,"15min":1.3140000000000001},"min":{"1min":0.90000000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.5389999999999999,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.413},{"interface":"front","average":{"1min":1.222,"5min":1.23,"15min":1.2310000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5600000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.133}]},{"osd":5,"last update":"Fri Jul 21 22:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2769999999999999,"15min":1.3049999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.6659999999999999,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.999},{"interface":"front","average":{"1min":1.286,"5min":1.2430000000000001,"15min":1.236},"min":{"1min":0.92900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6499999999999999,"5min":1.794,"15min":1.794},"last":1.3480000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.202,"15min":1.2010000000000001},"min":{"1min":0.75,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.538,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.056},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.407,"15min":1.4299999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8839999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.1599999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.369,"15min":1.363},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.73,"5min":1.887,"15min":1.887},"last":1.472},{"interface":"front","average":{"1min":1.401,"5min":1.4059999999999999,"15min":1.407},"min":{"1min":0.99399999999999999,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":1.7450000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.306}]}]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":516096,"data_stored":223955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.755}]},{"osd":1,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.155}]},{"osd":2,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.093}]},{"osd":4,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.395},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.347}]},{"osd":5,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.45},{"interface":"front","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.518}]},{"osd":6,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.554}]},{"osd":7,"last update":"Fri Jul 21 22:11:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.615},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.653}]}]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":520192,"data_stored":224903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.875,"15min":0.88100000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.151,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.024,"15min":1.032},"min":{"1min":0.65600000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.274}]},{"osd":1,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.96399999999999997,"15min":0.96499999999999997},"min":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.349,"5min":1.486,"15min":1.486},"last":1.05},{"interface":"front","average":{"1min":1.077,"5min":1.117,"15min":1.1240000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.6220000000000001,"5min":1.958,"15min":1.958},"last":1.6220000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.147,"15min":1.1459999999999999},"min":{"1min":0.65300000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.323},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1499999999999999,"15min":1.1619999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.732,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.4359999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.411,"15min":1.425},"min":{"1min":0.745,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.794,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.5069999999999999,"15min":1.52},"min":{"1min":1.127,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.786,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.3680000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.508,"15min":1.516},"min":{"1min":1.1279999999999999,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":1.7130000000000001,"5min":3.331,"15min":3.331},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.5529999999999999,"15min":1.5660000000000001},"min":{"1min":1.2130000000000001,"5min":1.085,"15min":1.085},"max":{"1min":1.8160000000000001,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.599}]},{"osd":6,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.462,"15min":1.466},"min":{"1min":1.1559999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":1.8919999999999999,"5min":2.633,"15min":2.633},"last":1.534},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.444,"15min":1.466},"min":{"1min":1.0569999999999999,"5min":0.878,"15min":0.878},"max":{"1min":1.7410000000000001,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.556}]},{"osd":7,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4830000000000001,"15min":1.4910000000000001},"min":{"1min":1.0429999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.6899999999999999,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.494},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.569,"15min":1.5760000000000001},"min":{"1min":1.167,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.1520000000000001,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.403}]}]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":1101824,"data_stored":813719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.871,"15min":0.88600000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2689999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.95899999999999996,"15min":0.97699999999999998},"min":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2370000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.121}]},{"osd":2,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.93700000000000006,"15min":0.93300000000000005},"min":{"1min":0.58499999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.389,"5min":1.55,"15min":1.55},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.51600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1}]},{"osd":3,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.94199999999999995,"15min":0.94299999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.079,"5min":1.155,"15min":1.167},"min":{"1min":0.58099999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":1.038}]},{"osd":4,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.242,"15min":1.254},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.6379999999999999,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.087},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3819999999999999,"15min":1.389},"min":{"1min":1.0429999999999999,"5min":1,"15min":1},"max":{"1min":1.927,"5min":2.464,"15min":2.464},"last":1.2050000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.46,"15min":1.4970000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.6559999999999999,"5min":2.419,"15min":2.419},"last":1.319},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3839999999999999,"15min":1.4039999999999999},"min":{"1min":0.88700000000000001,"5min":0.872,"15min":0.872},"max":{"1min":1.552,"5min":2.528,"15min":2.528},"last":1.409}]},{"osd":6,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.5029999999999999,"15min":1.5269999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.1509999999999998,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.4930000000000001,"15min":1.524},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":1.736,"5min":2.335,"15min":2.335},"last":1.518}]},{"osd":7,"last update":"Fri Jul 21 22:12:25 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.522,"15min":1.548},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":1.8009999999999999,"5min":2.504,"15min":2.504},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.48,"15min":1.508},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.8540000000000001,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":1.341}]}]},{"osd":1,"up_from":14,"seq":60129542173,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":507904,"data_stored":223387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89800000000000002,"15min":0.90000000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.3109999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.403,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.91000000000000003,"15min":0.90400000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":1.246},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.1040000000000001,"15min":1.125},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.0190000000000001,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.2070000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.3680000000000001,"15min":1.4099999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.444,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.2350000000000001,"15min":1.2669999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.881,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":1.4970000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.3049999999999999,"15min":1.3180000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6910000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.393},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.288,"15min":1.3069999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":3.0419999999999998,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.367}]},{"osd":5,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.3500000000000001,"15min":1.3720000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.534},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.4630000000000001,"15min":1.494},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0630000000000002,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.581}]},{"osd":6,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.4159999999999999,"15min":1.4359999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.738,"5min":2.238,"15min":2.238},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.4359999999999999,"15min":1.45},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":2.1000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:12:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.534,"15min":1.5589999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.3250000000000002,"5min":4.391,"15min":4.391},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.508,"15min":1.526},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7849999999999999,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.6990000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:12:32.315 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:12:32.316 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T22:12:32.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.495+0000 7f6e218bc700 1 Processor -- start 2023-07-21T22:12:32.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.495+0000 7f6e218bc700 1 -- start start 2023-07-21T22:12:32.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e218bc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6e1c0cd890 0x7f6e1c0cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:32.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e218bc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e1c0c8820 0x7f6e1c0c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:32.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e218bc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1c0cc790 con 0x7f6e1c1582c0 2023-07-21T22:12:32.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e218bc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1c0c91e0 con 0x7f6e1c0cd890 2023-07-21T22:12:32.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e218bc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c15c110 con 0x7f6e1c0c8820 2023-07-21T22:12:32.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e1a7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6e1c0cd890 0x7f6e1c0cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:32.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e1a7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6e1c0cd890 0x7f6e1c0cc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:50260/0 (socket says 172.21.15.49:50260) 2023-07-21T22:12:32.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e1a7fc700 1 -- 172.21.15.49:0/1555608063 learned_addr learned my addr 172.21.15.49:0/1555608063 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:32.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e1b7fe700 1 --2- 172.21.15.49:0/1555608063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e1c0c8820 0x7f6e1c0c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:32.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e1a7fc700 1 -- 172.21.15.49:0/1555608063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e1c0c8820 msgr2=0x7f6e1c0c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:32.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e1a7fc700 1 --2- 172.21.15.49:0/1555608063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e1c0c8820 0x7f6e1c0c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e1a7fc700 1 -- 172.21.15.49:0/1555608063 >> v1:172.21.15.150:6789/0 conn(0x7f6e1c1582c0 legacy=0x7f6e1c15c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:32.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e1a7fc700 1 -- 172.21.15.49:0/1555608063 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c15ccb0 con 0x7f6e1c0cd890 2023-07-21T22:12:32.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e1a7fc700 1 --2- 172.21.15.49:0/1555608063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e1c0cd890 0x7f6e1c0cc250 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009910 tx=0x7f6e10009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e3acce7d3da53b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:32.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e19ffb700 1 -- 172.21.15.49:0/1555608063 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10005e50 con 0x7f6e1c0cd890 2023-07-21T22:12:32.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e19ffb700 1 -- 172.21.15.49:0/1555608063 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e10006030 con 0x7f6e1c0cd890 2023-07-21T22:12:32.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.499+0000 7f6e19ffb700 1 -- 172.21.15.49:0/1555608063 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e100063e0 con 0x7f6e1c0cd890 2023-07-21T22:12:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.503+0000 7f6e218bc700 1 -- 172.21.15.49:0/1555608063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e1c0cd890 msgr2=0x7f6e1c0cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.503+0000 7f6e218bc700 1 --2- 172.21.15.49:0/1555608063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e1c0cd890 0x7f6e1c0cc250 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009910 tx=0x7f6e10009c20 comp rx=0 tx=0).stop 2023-07-21T22:12:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.503+0000 7f6e218bc700 1 -- 172.21.15.49:0/1555608063 shutdown_connections 2023-07-21T22:12:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.503+0000 7f6e218bc700 1 --2- 172.21.15.49:0/1555608063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e1c0c8820 0x7f6e1c0c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.503+0000 7f6e218bc700 1 --2- 172.21.15.49:0/1555608063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e1c0cd890 0x7f6e1c0cc250 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.503+0000 7f6e218bc700 1 -- 172.21.15.49:0/1555608063 >> 172.21.15.49:0/1555608063 conn(0x7f6e1c06e960 msgr2=0x7f6e1c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:32.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.503+0000 7f6e218bc700 1 -- 172.21.15.49:0/1555608063 shutdown_connections 2023-07-21T22:12:32.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.503+0000 7f6e218bc700 1 -- 172.21.15.49:0/1555608063 wait complete. 2023-07-21T22:12:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e218bc700 1 Processor -- start 2023-07-21T22:12:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e218bc700 1 -- start start 2023-07-21T22:12:32.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e218bc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e1c0c8820 0x7f6e1c158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:32.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e218bc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e1c0cd890 0x7f6e1c15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:32.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e218bc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e1c1582c0 0x7f6e1c15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:32.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e218bc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c15b810 con 0x7f6e1c0cd890 2023-07-21T22:12:32.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e218bc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0b1830 con 0x7f6e1c1582c0 2023-07-21T22:12:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e218bc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c15b530 con 0x7f6e1c0c8820 2023-07-21T22:12:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e1a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e1c0cd890 0x7f6e1c15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e1a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e1c0cd890 0x7f6e1c15a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45946/0 (socket says 172.21.15.49:45946) 2023-07-21T22:12:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e1a7fc700 1 -- 172.21.15.49:0/303001145 learned_addr learned my addr 172.21.15.49:0/303001145 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e1b7fe700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e1c1582c0 0x7f6e1c15aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e1affd700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e1c0c8820 0x7f6e1c158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e1a7fc700 1 -- 172.21.15.49:0/303001145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e1c0c8820 msgr2=0x7f6e1c158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e1a7fc700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e1c0c8820 0x7f6e1c158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e1a7fc700 1 -- 172.21.15.49:0/303001145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e1c1582c0 msgr2=0x7f6e1c15aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e1a7fc700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e1c1582c0 0x7f6e1c15aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e1a7fc700 1 -- 172.21.15.49:0/303001145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e10009520 con 0x7f6e1c0cd890 2023-07-21T22:12:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e1b7fe700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e1c1582c0 0x7f6e1c15aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.507+0000 7f6e1a7fc700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e1c0cd890 0x7f6e1c15a9b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6e10000c00 tx=0x7f6e10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.511+0000 7f6e03fff700 1 -- 172.21.15.49:0/303001145 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10006960 con 0x7f6e1c0cd890 2023-07-21T22:12:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.511+0000 7f6e03fff700 1 -- 172.21.15.49:0/303001145 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e10020070 con 0x7f6e1c0cd890 2023-07-21T22:12:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.511+0000 7f6e218bc700 1 -- 172.21.15.49:0/303001145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c0b11e0 con 0x7f6e1c0cd890 2023-07-21T22:12:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.511+0000 7f6e03fff700 1 -- 172.21.15.49:0/303001145 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10025670 con 0x7f6e1c0cd890 2023-07-21T22:12:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.511+0000 7f6e218bc700 1 -- 172.21.15.49:0/303001145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1c1509a0 con 0x7f6e1c0cd890 2023-07-21T22:12:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.511+0000 7f6e218bc700 1 -- 172.21.15.49:0/303001145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1c0b1040 con 0x7f6e1c0cd890 2023-07-21T22:12:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.511+0000 7f6e03fff700 1 -- 172.21.15.49:0/303001145 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6e10022030 con 0x7f6e1c0cd890 2023-07-21T22:12:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.515+0000 7f6e03fff700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6e080662f0 0x7f6e080687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.515+0000 7f6e03fff700 1 -- 172.21.15.49:0/303001145 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6e10085480 con 0x7f6e1c0cd890 2023-07-21T22:12:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.515+0000 7f6e1affd700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6e080662f0 0x7f6e080687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.515+0000 7f6e1affd700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6e080662f0 0x7f6e080687a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c000f60 tx=0x7f6e0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.523+0000 7f6e03fff700 1 -- 172.21.15.49:0/303001145 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6e1c0b1040 con 0x7f6e1c0cd890 2023-07-21T22:12:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.755+0000 7f6e218bc700 1 -- 172.21.15.49:0/303001145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6e1c0b1040 con 0x7f6e1c0cd890 2023-07-21T22:12:32.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.763+0000 7f6e03fff700 1 -- 172.21.15.49:0/303001145 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6e1c0b1040 con 0x7f6e1c0cd890 2023-07-21T22:12:32.809 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2023-07-21T22:12:32.809 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtkU5ZaIRAAchCJhuM71+rGOBHBlX77wA== 2023-07-21T22:12:32.809 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow" 2023-07-21T22:12:32.809 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2023-07-21T22:12:32.809 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T22:12:32.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.767+0000 7f6e218bc700 1 -- 172.21.15.49:0/303001145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6e080662f0 msgr2=0x7f6e080687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.767+0000 7f6e218bc700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6e080662f0 0x7f6e080687a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c000f60 tx=0x7f6e0c009040 comp rx=0 tx=0).stop 2023-07-21T22:12:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.767+0000 7f6e218bc700 1 -- 172.21.15.49:0/303001145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e1c0cd890 msgr2=0x7f6e1c15a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.767+0000 7f6e218bc700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e1c0cd890 0x7f6e1c15a9b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6e10000c00 tx=0x7f6e10004770 comp rx=0 tx=0).stop 2023-07-21T22:12:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.767+0000 7f6e218bc700 1 -- 172.21.15.49:0/303001145 shutdown_connections 2023-07-21T22:12:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.767+0000 7f6e218bc700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6e080662f0 0x7f6e080687a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.767+0000 7f6e218bc700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e1c0cd890 0x7f6e1c15a9b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.767+0000 7f6e218bc700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e1c1582c0 0x7f6e1c15aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.767+0000 7f6e218bc700 1 --2- 172.21.15.49:0/303001145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e1c0c8820 0x7f6e1c158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.767+0000 7f6e218bc700 1 -- 172.21.15.49:0/303001145 >> 172.21.15.49:0/303001145 conn(0x7f6e1c06e960 msgr2=0x7f6e1c15c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.767+0000 7f6e218bc700 1 -- 172.21.15.49:0/303001145 shutdown_connections 2023-07-21T22:12:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.767+0000 7f6e218bc700 1 -- 172.21.15.49:0/303001145 wait complete. 2023-07-21T22:12:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-07-21T22:12:32.833 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:12:33.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.963+0000 7f65860d6700 1 Processor -- start 2023-07-21T22:12:33.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.967+0000 7f65860d6700 1 -- start start 2023-07-21T22:12:33.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.967+0000 7f65860d6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f65800afc20 0x7f65800cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.967+0000 7f65860d6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65800cdeb0 con 0x7f65800c8860 2023-07-21T22:12:33.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.967+0000 7f65860d6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6580163df0 con 0x7f65801604c0 2023-07-21T22:12:33.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.967+0000 7f65860d6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65801640d0 con 0x7f65800afc20 2023-07-21T22:12:33.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f657f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f65800afc20 0x7f65800cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f657ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f65800c8860 0x7f6580070600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49248/0 (socket says 172.21.15.49:49248) 2023-07-21T22:12:33.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f657ffff700 1 -- 172.21.15.49:0/1265124891 learned_addr learned my addr 172.21.15.49:0/1265124891 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:33.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f657f7fe700 1 -- 172.21.15.49:0/1265124891 >> v1:172.21.15.150:6789/0 conn(0x7f65801604c0 legacy=0x7f65800afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f657f7fe700 1 -- 172.21.15.49:0/1265124891 >> v1:172.21.15.49:6789/0 conn(0x7f65800c8860 legacy=0x7f6580070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f657f7fe700 1 -- 172.21.15.49:0/1265124891 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65801643b0 con 0x7f65800afc20 2023-07-21T22:12:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f657f7fe700 1 --2- 172.21.15.49:0/1265124891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65800afc20 0x7f65800cd970 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6570009850 tx=0x7f6570009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9952e73dbe784ac server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f657e7fc700 1 -- 172.21.15.49:0/1265124891 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570011830 con 0x7f65800afc20 2023-07-21T22:12:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f657e7fc700 1 -- 172.21.15.49:0/1265124891 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6570011990 con 0x7f65800afc20 2023-07-21T22:12:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f657e7fc700 1 -- 172.21.15.49:0/1265124891 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570011d20 con 0x7f65800afc20 2023-07-21T22:12:33.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f65860d6700 1 -- 172.21.15.49:0/1265124891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65800afc20 msgr2=0x7f65800cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f65860d6700 1 --2- 172.21.15.49:0/1265124891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65800afc20 0x7f65800cd970 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6570009850 tx=0x7f6570009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:33.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f65860d6700 1 -- 172.21.15.49:0/1265124891 shutdown_connections 2023-07-21T22:12:33.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f65860d6700 1 --2- 172.21.15.49:0/1265124891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65800afc20 0x7f65800cd970 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f65860d6700 1 -- 172.21.15.49:0/1265124891 >> 172.21.15.49:0/1265124891 conn(0x7f658006f5a0 msgr2=0x7f65800cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:33.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f65860d6700 1 -- 172.21.15.49:0/1265124891 shutdown_connections 2023-07-21T22:12:33.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.971+0000 7f65860d6700 1 -- 172.21.15.49:0/1265124891 wait complete. 2023-07-21T22:12:33.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f65860d6700 1 Processor -- start 2023-07-21T22:12:33.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f65860d6700 1 -- start start 2023-07-21T22:12:33.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f65860d6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65800afc20 0x7f658015f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f65860d6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65800c8860 0x7f65800c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f65860d6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65801604c0 0x7f65801eb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f65860d6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65801619a0 con 0x7f65800afc20 2023-07-21T22:12:33.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f65860d6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658015fce0 con 0x7f65800c8860 2023-07-21T22:12:33.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f65860d6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65800c6aa0 con 0x7f65801604c0 2023-07-21T22:12:33.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f657f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65800afc20 0x7f658015f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f657f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65800afc20 0x7f658015f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45956/0 (socket says 172.21.15.49:45956) 2023-07-21T22:12:33.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f657f7fe700 1 -- 172.21.15.49:0/2893475152 learned_addr learned my addr 172.21.15.49:0/2893475152 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:33.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f657effd700 1 --2- 172.21.15.49:0/2893475152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65800c8860 0x7f65800c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f657f7fe700 1 -- 172.21.15.49:0/2893475152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65801604c0 msgr2=0x7f65801eb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f657f7fe700 1 --2- 172.21.15.49:0/2893475152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65801604c0 0x7f65801eb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.975+0000 7f657f7fe700 1 -- 172.21.15.49:0/2893475152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65800c8860 msgr2=0x7f65800c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.979+0000 7f657f7fe700 1 --2- 172.21.15.49:0/2893475152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65800c8860 0x7f65800c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.979+0000 7f657f7fe700 1 -- 172.21.15.49:0/2893475152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700094b0 con 0x7f65800afc20 2023-07-21T22:12:33.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.979+0000 7f657effd700 1 --2- 172.21.15.49:0/2893475152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65800c8860 0x7f65800c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:33.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.979+0000 7f657f7fe700 1 --2- 172.21.15.49:0/2893475152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65800afc20 0x7f658015f7a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f658006b800 tx=0x7f6570004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:33.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.979+0000 7f6567fff700 1 -- 172.21.15.49:0/2893475152 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65700038c0 con 0x7f65800afc20 2023-07-21T22:12:33.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.979+0000 7f6567fff700 1 -- 172.21.15.49:0/2893475152 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6570003a20 con 0x7f65800afc20 2023-07-21T22:12:33.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.979+0000 7f6567fff700 1 -- 172.21.15.49:0/2893475152 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570003dd0 con 0x7f65800afc20 2023-07-21T22:12:33.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.979+0000 7f65860d6700 1 -- 172.21.15.49:0/2893475152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65800c6d80 con 0x7f65800afc20 2023-07-21T22:12:33.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.979+0000 7f65860d6700 1 -- 172.21.15.49:0/2893475152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65800c7060 con 0x7f65800afc20 2023-07-21T22:12:33.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.979+0000 7f65860d6700 1 -- 172.21.15.49:0/2893475152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6580161e80 con 0x7f65800afc20 2023-07-21T22:12:33.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.979+0000 7f6567fff700 1 -- 172.21.15.49:0/2893475152 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f657001a430 con 0x7f65800afc20 2023-07-21T22:12:33.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.983+0000 7f6567fff700 1 --2- 172.21.15.49:0/2893475152 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f656c066320 0x7f656c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.983+0000 7f6567fff700 1 -- 172.21.15.49:0/2893475152 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6570021030 con 0x7f65800afc20 2023-07-21T22:12:33.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.983+0000 7f657effd700 1 --2- 172.21.15.49:0/2893475152 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f656c066320 0x7f656c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.983+0000 7f657effd700 1 --2- 172.21.15.49:0/2893475152 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f656c066320 0x7f656c0687d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f65800c4e60 tx=0x7f6574009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:33.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:32.991+0000 7f6567fff700 1 -- 172.21.15.49:0/2893475152 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6580161e80 con 0x7f65800afc20 2023-07-21T22:12:33.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.207+0000 7f65860d6700 1 -- 172.21.15.49:0/2893475152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6580161e80 con 0x7f65800afc20 2023-07-21T22:12:33.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.207+0000 7f6567fff700 1 -- 172.21.15.49:0/2893475152 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f6580161e80 con 0x7f65800afc20 2023-07-21T22:12:33.253 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:33.254 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2563650108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2563650108},{"type":"v1","addr":"172.21.15.49:6835","nonce":2563650108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2639704311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2639704311},{"type":"v1","addr":"172.21.15.150:6833","nonce":2639704311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1930443415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1930443415},{"type":"v1","addr":"172.21.15.150:6835","nonce":1930443415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:12:22.057988+0000","modified":"2023-07-21T22:12:25.638925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5631":{"gid":5631,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/3511065368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3511065368},{"type":"v1","addr":"172.21.15.49:6837","nonce":3511065368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T22:12:33.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.211+0000 7f65860d6700 1 -- 172.21.15.49:0/2893475152 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f656c066320 msgr2=0x7f656c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.211+0000 7f65860d6700 1 --2- 172.21.15.49:0/2893475152 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f656c066320 0x7f656c0687d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f65800c4e60 tx=0x7f6574009040 comp rx=0 tx=0).stop 2023-07-21T22:12:33.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.211+0000 7f65860d6700 1 -- 172.21.15.49:0/2893475152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65800afc20 msgr2=0x7f658015f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.211+0000 7f65860d6700 1 --2- 172.21.15.49:0/2893475152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65800afc20 0x7f658015f7a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f658006b800 tx=0x7f6570004770 comp rx=0 tx=0).stop 2023-07-21T22:12:33.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.211+0000 7f65860d6700 1 -- 172.21.15.49:0/2893475152 shutdown_connections 2023-07-21T22:12:33.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.211+0000 7f65860d6700 1 --2- 172.21.15.49:0/2893475152 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f656c066320 0x7f656c0687d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.211+0000 7f65860d6700 1 --2- 172.21.15.49:0/2893475152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65801604c0 0x7f65801eb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.211+0000 7f65860d6700 1 --2- 172.21.15.49:0/2893475152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65800c8860 0x7f65800c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.211+0000 7f65860d6700 1 --2- 172.21.15.49:0/2893475152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65800afc20 0x7f658015f7a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.211+0000 7f65860d6700 1 -- 172.21.15.49:0/2893475152 >> 172.21.15.49:0/2893475152 conn(0x7f658006f5a0 msgr2=0x7f65800afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:33.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.211+0000 7f65860d6700 1 -- 172.21.15.49:0/2893475152 shutdown_connections 2023-07-21T22:12:33.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.211+0000 7f65860d6700 1 -- 172.21.15.49:0/2893475152 wait complete. 2023-07-21T22:12:33.261 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 17 2023-07-21T22:12:33.682 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:12:22.057988+0000', 'modified': '2023-07-21T22:12:25.638925+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5631}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5631': {'gid': 5631, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.49:6837/3511065368', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6836', 'nonce': 3511065368}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 3511065368}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:12:33.682 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:12:33.683 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-21T22:12:33.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.819+0000 7fb83d8ee700 1 Processor -- start 2023-07-21T22:12:33.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.823+0000 7fb83d8ee700 1 -- start start 2023-07-21T22:12:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.823+0000 7fb83d8ee700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8380d1e40 0x7fb8380b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.823+0000 7fb83d8ee700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8380b3e80 con 0x7fb8380cee10 2023-07-21T22:12:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.823+0000 7fb83d8ee700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83815fd40 con 0x7fb8380b7af0 2023-07-21T22:12:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.823+0000 7fb83d8ee700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380cea00 con 0x7fb8380d1e40 2023-07-21T22:12:33.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.823+0000 7fb8377fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb8380cee10 0x7fb8380b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49262/0 (socket says 172.21.15.49:49262) 2023-07-21T22:12:33.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.823+0000 7fb8377fe700 1 -- 172.21.15.49:0/1615412911 learned_addr learned my addr 172.21.15.49:0/1615412911 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:33.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb8367fc700 1 --2- 172.21.15.49:0/1615412911 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8380d1e40 0x7fb8380b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb835ffb700 1 -- 172.21.15.49:0/1615412911 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256037711 0 0) 0x7fb8380b3e80 con 0x7fb8380cee10 2023-07-21T22:12:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb835ffb700 1 -- 172.21.15.49:0/1615412911 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8200035d0 con 0x7fb8380cee10 2023-07-21T22:12:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb8367fc700 1 -- 172.21.15.49:0/1615412911 >> v1:172.21.15.150:6789/0 conn(0x7fb8380b7af0 legacy=0x7fb83815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb8367fc700 1 -- 172.21.15.49:0/1615412911 >> v1:172.21.15.49:6789/0 conn(0x7fb8380cee10 legacy=0x7fb8380b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb8367fc700 1 -- 172.21.15.49:0/1615412911 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8380ccbf0 con 0x7fb8380d1e40 2023-07-21T22:12:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb8367fc700 1 --2- 172.21.15.49:0/1615412911 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8380d1e40 0x7fb8380b1630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009880 tx=0x7fb82c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30e5acd0a9d35b39 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb835ffb700 1 -- 172.21.15.49:0/1615412911 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c004230 con 0x7fb8380d1e40 2023-07-21T22:12:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb835ffb700 1 -- 172.21.15.49:0/1615412911 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c004390 con 0x7fb8380d1e40 2023-07-21T22:12:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb835ffb700 1 -- 172.21.15.49:0/1615412911 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c0036c0 con 0x7fb8380d1e40 2023-07-21T22:12:33.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb83d8ee700 1 -- 172.21.15.49:0/1615412911 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8380d1e40 msgr2=0x7fb8380b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb83d8ee700 1 --2- 172.21.15.49:0/1615412911 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8380d1e40 0x7fb8380b1630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009880 tx=0x7fb82c009b90 comp rx=0 tx=0).stop 2023-07-21T22:12:33.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb83d8ee700 1 -- 172.21.15.49:0/1615412911 shutdown_connections 2023-07-21T22:12:33.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb83d8ee700 1 --2- 172.21.15.49:0/1615412911 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8380d1e40 0x7fb8380b1630 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb83d8ee700 1 -- 172.21.15.49:0/1615412911 >> 172.21.15.49:0/1615412911 conn(0x7fb83806e960 msgr2=0x7fb83806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:33.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb83d8ee700 1 -- 172.21.15.49:0/1615412911 shutdown_connections 2023-07-21T22:12:33.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.827+0000 7fb83d8ee700 1 -- 172.21.15.49:0/1615412911 wait complete. 2023-07-21T22:12:33.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.831+0000 7fb83d8ee700 1 Processor -- start 2023-07-21T22:12:33.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.831+0000 7fb83d8ee700 1 -- start start 2023-07-21T22:12:33.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.831+0000 7fb83d8ee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8380b7af0 0x7fb8380c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.831+0000 7fb83d8ee700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8380cee10 0x7fb8380c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.831+0000 7fb83d8ee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8380d1e40 0x7fb8381f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.831+0000 7fb83d8ee700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83815f010 con 0x7fb8380b7af0 2023-07-21T22:12:33.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.831+0000 7fb83d8ee700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380ca6e0 con 0x7fb8380d1e40 2023-07-21T22:12:33.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.831+0000 7fb83d8ee700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380c7550 con 0x7fb8380cee10 2023-07-21T22:12:33.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.831+0000 7fb836ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8380b7af0 0x7fb8380c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.831+0000 7fb8367fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8380cee10 0x7fb8380c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.831+0000 7fb8367fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8380cee10 0x7fb8380c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:47612/0 (socket says 172.21.15.49:47612) 2023-07-21T22:12:33.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.831+0000 7fb8367fc700 1 -- 172.21.15.49:0/3779768164 learned_addr learned my addr 172.21.15.49:0/3779768164 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:33.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.831+0000 7fb8377fe700 1 --2- 172.21.15.49:0/3779768164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8380d1e40 0x7fb8381f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.835+0000 7fb8367fc700 1 -- 172.21.15.49:0/3779768164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8380d1e40 msgr2=0x7fb8381f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.835+0000 7fb8367fc700 1 --2- 172.21.15.49:0/3779768164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8380d1e40 0x7fb8381f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.835+0000 7fb8367fc700 1 -- 172.21.15.49:0/3779768164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8380b7af0 msgr2=0x7fb8380c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.835+0000 7fb8367fc700 1 --2- 172.21.15.49:0/3779768164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8380b7af0 0x7fb8380c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.835+0000 7fb8367fc700 1 -- 172.21.15.49:0/3779768164 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c0094b0 con 0x7fb8380cee10 2023-07-21T22:12:33.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.835+0000 7fb836ffd700 1 --2- 172.21.15.49:0/3779768164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8380b7af0 0x7fb8380c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:33.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.835+0000 7fb8367fc700 1 --2- 172.21.15.49:0/3779768164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8380cee10 0x7fb8380c7e00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0090b0 tx=0x7fb82c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:33.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.835+0000 7fb81ffff700 1 -- 172.21.15.49:0/3779768164 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c006ea0 con 0x7fb8380cee10 2023-07-21T22:12:33.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.835+0000 7fb81ffff700 1 -- 172.21.15.49:0/3779768164 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c01f070 con 0x7fb8380cee10 2023-07-21T22:12:33.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.835+0000 7fb81ffff700 1 -- 172.21.15.49:0/3779768164 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c003ea0 con 0x7fb8380cee10 2023-07-21T22:12:33.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.835+0000 7fb83d8ee700 1 -- 172.21.15.49:0/3779768164 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8380c6cb0 con 0x7fb8380cee10 2023-07-21T22:12:33.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.835+0000 7fb83d8ee700 1 -- 172.21.15.49:0/3779768164 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8380c7270 con 0x7fb8380cee10 2023-07-21T22:12:33.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.839+0000 7fb81ffff700 1 -- 172.21.15.49:0/3779768164 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb82c021030 con 0x7fb8380cee10 2023-07-21T22:12:33.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.843+0000 7fb81ffff700 1 --2- 172.21.15.49:0/3779768164 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8240662f0 0x7fb8240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.843+0000 7fb81ffff700 1 -- 172.21.15.49:0/3779768164 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb82c085220 con 0x7fb8380cee10 2023-07-21T22:12:33.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.843+0000 7fb836ffd700 1 --2- 172.21.15.49:0/3779768164 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8240662f0 0x7fb8240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.843+0000 7fb840b73740 1 Processor -- start 2023-07-21T22:12:33.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.843+0000 7fb836ffd700 1 --2- 172.21.15.49:0/3779768164 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8240662f0 0x7fb8240687a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb838072830 tx=0x7fb828009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:33.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.843+0000 7fb840b73740 1 -- start start 2023-07-21T22:12:33.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.843+0000 7fb840b73740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159eb0 0x2412840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.843+0000 7fb840b73740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159ae0 0x2412d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.843+0000 7fb840b73740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 0x23c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.843+0000 7fb840b73740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x22e6270 con 0x2159ae0 2023-07-21T22:12:33.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.843+0000 7fb840b73740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x23393a0 con 0x2159eb0 2023-07-21T22:12:33.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.843+0000 7fb840b73740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x2332600 con 0x2159710 2023-07-21T22:12:33.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb8367fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159ae0 0x2412d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb8367fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159ae0 0x2412d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45966/0 (socket says 172.21.15.49:45966) 2023-07-21T22:12:33.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb8367fc700 1 -- 172.21.15.49:0/1342628182 learned_addr learned my addr 172.21.15.49:0/1342628182 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:33.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb836ffd700 1 --2- 172.21.15.49:0/1342628182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159eb0 0x2412840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb8377fe700 1 --2- 172.21.15.49:0/1342628182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 0x23c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb8367fc700 1 -- 172.21.15.49:0/1342628182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 msgr2=0x23c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:33.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb8367fc700 1 --2- 172.21.15.49:0/1342628182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 0x23c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb8367fc700 1 -- 172.21.15.49:0/1342628182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159eb0 msgr2=0x2412840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:33.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb8367fc700 1 --2- 172.21.15.49:0/1342628182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159eb0 0x2412840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb8367fc700 1 -- 172.21.15.49:0/1342628182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21a59e0 con 0x2159ae0 2023-07-21T22:12:33.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb8367fc700 1 --2- 172.21.15.49:0/1342628182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159ae0 0x2412d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0833e0 tx=0x7fb82c0560e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ea677f14bb4129 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:33.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb81d7fa700 1 -- 172.21.15.49:0/1342628182 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c022380 con 0x2159ae0 2023-07-21T22:12:33.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb81d7fa700 1 -- 172.21.15.49:0/1342628182 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c05a1d0 con 0x2159ae0 2023-07-21T22:12:33.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb81d7fa700 1 -- 172.21.15.49:0/1342628182 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c05e560 con 0x2159ae0 2023-07-21T22:12:33.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb840b73740 1 -- 172.21.15.49:0/1342628182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159ae0 msgr2=0x2412d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb840b73740 1 --2- 172.21.15.49:0/1342628182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159ae0 0x2412d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0833e0 tx=0x7fb82c0560e0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb840b73740 1 -- 172.21.15.49:0/1342628182 shutdown_connections 2023-07-21T22:12:33.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb840b73740 1 --2- 172.21.15.49:0/1342628182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159ae0 0x2412d80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb840b73740 1 --2- 172.21.15.49:0/1342628182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 0x23c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb840b73740 1 --2- 172.21.15.49:0/1342628182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159eb0 0x2412840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb840b73740 1 -- 172.21.15.49:0/1342628182 >> 172.21.15.49:0/1342628182 conn(0x23c3b60 msgr2=0x23ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:33.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb840b73740 1 -- 172.21.15.49:0/1342628182 shutdown_connections 2023-07-21T22:12:33.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb840b73740 1 -- 172.21.15.49:0/1342628182 wait complete. 2023-07-21T22:12:33.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb840b73740 1 -- start start 2023-07-21T22:12:33.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.847+0000 7fb840b73740 1 Processor -- start 2023-07-21T22:12:33.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb840b73740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 0x23f72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb840b73740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159ae0 0x23f8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb840b73740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x23f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb840b73740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x22f4b00 con 0x2159eb0 2023-07-21T22:12:33.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb840b73740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x22f3470 con 0x2159ae0 2023-07-21T22:12:33.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb840b73740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x21deb20 con 0x2159710 2023-07-21T22:12:33.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb840b73740 10 client.0 _ll_register_callbacks cb 0x2358530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:12:33.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x23f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x23f8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45974/0 (socket says 172.21.15.49:45974) 2023-07-21T22:12:33.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8377fe700 1 -- 172.21.15.49:0/1056966738 learned_addr learned my addr 172.21.15.49:0/1056966738 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:33.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb836ffd700 1 --2- 172.21.15.49:0/1056966738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 0x23f72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8367fc700 1 --2- 172.21.15.49:0/1056966738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159ae0 0x23f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8377fe700 1 -- 172.21.15.49:0/1056966738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 msgr2=0x23f72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:33.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8377fe700 1 --2- 172.21.15.49:0/1056966738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 0x23f72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8377fe700 1 -- 172.21.15.49:0/1056966738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159ae0 msgr2=0x23f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:33.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8377fe700 1 --2- 172.21.15.49:0/1056966738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159ae0 0x23f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8377fe700 1 -- 172.21.15.49:0/1056966738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8380c7270 con 0x2159eb0 2023-07-21T22:12:33.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8367fc700 1 --2- 172.21.15.49:0/1056966738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159ae0 0x23f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:33.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8377fe700 1 --2- 172.21.15.49:0/1056966738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x23f8ab0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb830007b80 tx=0x7fb8300125a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944195a26a89cc17 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:33.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8167fc700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-07-21T22:12:33.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8167fc700 1 -- 172.21.15.49:0/1056966738 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830012d10 con 0x2159eb0 2023-07-21T22:12:33.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb840b73740 1 -- 172.21.15.49:0/1056966738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x232b5e0 con 0x2159eb0 2023-07-21T22:12:33.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8167fc700 1 -- 172.21.15.49:0/1056966738 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb830012e70 con 0x2159eb0 2023-07-21T22:12:33.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8167fc700 1 -- 172.21.15.49:0/1056966738 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb830015440 con 0x2159eb0 2023-07-21T22:12:33.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb840b73740 10 client.5841 fetch_fsmap learned FSMap version 17 2023-07-21T22:12:33.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb840b73740 1 -- 172.21.15.49:0/1056966738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x22f8250 con 0x2159eb0 2023-07-21T22:12:33.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.851+0000 7fb8167fc700 1 -- 172.21.15.49:0/1056966738 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x232b5e0 con 0x2159eb0 2023-07-21T22:12:33.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb8167fc700 1 -- 172.21.15.49:0/1056966738 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb83001d350 con 0x2159eb0 2023-07-21T22:12:33.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 10 client.5841 fetch_fsmap finished waiting for FSMap version 17 2023-07-21T22:12:33.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 10 client.5841 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-21T22:12:33.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 20 client.5841 populate_metadata read hostname 'smithi049' 2023-07-21T22:12:33.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 1 --2- 172.21.15.49:0/1056966738 >> [v2:172.21.15.49:6836/3511065368,v1:172.21.15.49:6837/3511065368] conn(0x21a4790 0x241b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 4 client.5841 mds_command: new command op to 5631 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:12:33.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 1 -- 172.21.15.49:0/1056966738 --> [v2:172.21.15.49:6836/3511065368,v1:172.21.15.49:6837/3511065368] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x232b300 con 0x21a4790 2023-07-21T22:12:33.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb836ffd700 1 --2- 172.21.15.49:0/1056966738 >> [v2:172.21.15.49:6836/3511065368,v1:172.21.15.49:6837/3511065368] conn(0x21a4790 0x241b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb836ffd700 1 --2- 172.21.15.49:0/1056966738 >> [v2:172.21.15.49:6836/3511065368,v1:172.21.15.49:6837/3511065368] conn(0x21a4790 0x241b840 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39a1fe588dfb8d7f server_cookie=9fe475f9206b362d in_seq=0 out_seq=0 2023-07-21T22:12:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb8167fc700 10 client.5841 ms_handle_connect on v2:172.21.15.49:6836/3511065368 2023-07-21T22:12:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb8167fc700 1 -- 172.21.15.49:0/1056966738 <== mds.0 v2:172.21.15.49:6836/3511065368 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x232b300 con 0x21a4790 2023-07-21T22:12:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb8167fc700 10 client.5841 handle_command_reply: tid=0 2023-07-21T22:12:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 1 client.5841 shutdown 2023-07-21T22:12:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 1 -- 172.21.15.49:0/1056966738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 msgr2=0x23f8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 1 --2- 172.21.15.49:0/1056966738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x23f8ab0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb830007b80 tx=0x7fb8300125a0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 1 -- 172.21.15.49:0/1056966738 shutdown_connections 2023-07-21T22:12:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 1 --2- 172.21.15.49:0/1056966738 >> [v2:172.21.15.49:6836/3511065368,v1:172.21.15.49:6837/3511065368] conn(0x21a4790 0x241b840 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 1 --2- 172.21.15.49:0/1056966738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x23f8ab0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb8167fc700 0 client.5841 ms_handle_reset on v2:172.21.15.49:6836/3511065368 2023-07-21T22:12:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 1 --2- 172.21.15.49:0/1056966738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159ae0 0x23f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 1 --2- 172.21.15.49:0/1056966738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 0x23f72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 1 -- 172.21.15.49:0/1056966738 >> 172.21.15.49:0/1056966738 conn(0x23c3b60 msgr2=0x23f5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 1 -- 172.21.15.49:0/1056966738 shutdown_connections 2023-07-21T22:12:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.855+0000 7fb840b73740 1 -- 172.21.15.49:0/1056966738 wait complete. 2023-07-21T22:12:33.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.859+0000 7fb840b73740 20 client.5841 trim_cache size 0 max 16384 2023-07-21T22:12:33.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb840b73740 1 Processor -- start 2023-07-21T22:12:33.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb840b73740 1 -- start start 2023-07-21T22:12:33.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb840b73740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159710 0x2417880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb840b73740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159ae0 0x2411390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb840b73740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x24118d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb840b73740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2336600 con 0x2159eb0 2023-07-21T22:12:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb840b73740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x2335160 con 0x2159710 2023-07-21T22:12:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb840b73740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x22d0f30 con 0x2159ae0 2023-07-21T22:12:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb8377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x24118d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb8377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x24118d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45990/0 (socket says 172.21.15.49:45990) 2023-07-21T22:12:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb8377fe700 1 -- 172.21.15.49:0/176719309 learned_addr learned my addr 172.21.15.49:0/176719309 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb8367fc700 1 --2- 172.21.15.49:0/176719309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159ae0 0x2411390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb836ffd700 1 --2- 172.21.15.49:0/176719309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159710 0x2417880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb8377fe700 1 -- 172.21.15.49:0/176719309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159ae0 msgr2=0x2411390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:33.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb8377fe700 1 --2- 172.21.15.49:0/176719309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159ae0 0x2411390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb8377fe700 1 -- 172.21.15.49:0/176719309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159710 msgr2=0x2417880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:33.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb8377fe700 1 --2- 172.21.15.49:0/176719309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159710 0x2417880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb8377fe700 1 -- 172.21.15.49:0/176719309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8381f4fe0 con 0x2159eb0 2023-07-21T22:12:33.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb8367fc700 1 --2- 172.21.15.49:0/176719309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159ae0 0x2411390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:33.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.879+0000 7fb8377fe700 1 --2- 172.21.15.49:0/176719309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x24118d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb8300125e0 tx=0x7fb83000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d78aa2563f417e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:33.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.883+0000 7fb81dffb700 1 -- 172.21.15.49:0/176719309 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83001d8b0 con 0x2159eb0 2023-07-21T22:12:33.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.883+0000 7fb81dffb700 1 -- 172.21.15.49:0/176719309 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb830001ed0 con 0x2159eb0 2023-07-21T22:12:33.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.883+0000 7fb81dffb700 1 -- 172.21.15.49:0/176719309 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830012d10 con 0x2159eb0 2023-07-21T22:12:33.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.883+0000 7fb840b73740 1 -- 172.21.15.49:0/176719309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 msgr2=0x24118d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.883+0000 7fb840b73740 1 --2- 172.21.15.49:0/176719309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x24118d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb8300125e0 tx=0x7fb83000c000 comp rx=0 tx=0).stop 2023-07-21T22:12:33.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.883+0000 7fb840b73740 1 -- 172.21.15.49:0/176719309 shutdown_connections 2023-07-21T22:12:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.883+0000 7fb840b73740 1 --2- 172.21.15.49:0/176719309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x24118d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.883+0000 7fb840b73740 1 --2- 172.21.15.49:0/176719309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159ae0 0x2411390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.883+0000 7fb840b73740 1 --2- 172.21.15.49:0/176719309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159710 0x2417880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.883+0000 7fb840b73740 1 -- 172.21.15.49:0/176719309 >> 172.21.15.49:0/176719309 conn(0x23c3b60 msgr2=0x2421490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.883+0000 7fb840b73740 1 -- 172.21.15.49:0/176719309 shutdown_connections 2023-07-21T22:12:33.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.883+0000 7fb840b73740 1 -- 172.21.15.49:0/176719309 wait complete. 2023-07-21T22:12:33.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.883+0000 7fb840b73740 1 -- start start 2023-07-21T22:12:33.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.883+0000 7fb840b73740 1 Processor -- start 2023-07-21T22:12:33.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 0x2416bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159ae0 0x245a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x245b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x232fa00 con 0x2159eb0 2023-07-21T22:12:33.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x24170f0 con 0x2159ae0 2023-07-21T22:12:33.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x245ac30 con 0x2159710 2023-07-21T22:12:33.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 10 client.0 _ll_register_callbacks cb 0x22ea800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:12:33.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x245b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x245b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45996/0 (socket says 172.21.15.49:45996) 2023-07-21T22:12:33.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8377fe700 1 -- 172.21.15.49:0/1319802082 learned_addr learned my addr 172.21.15.49:0/1319802082 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:33.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb836ffd700 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 0x2416bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8367fc700 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159ae0 0x245a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8377fe700 1 -- 172.21.15.49:0/1319802082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 msgr2=0x2416bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:33.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8377fe700 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 0x2416bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8377fe700 1 -- 172.21.15.49:0/1319802082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159ae0 msgr2=0x245a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:33.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8377fe700 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159ae0 0x245a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8377fe700 1 -- 172.21.15.49:0/1319802082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x22f8250 con 0x2159eb0 2023-07-21T22:12:33.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb836ffd700 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 0x2416bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:33.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8367fc700 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159ae0 0x245a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:33.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8377fe700 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x245b9b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb830007c60 tx=0x7fb8300012a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c13413bb7f35044 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:33.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8167fc700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-07-21T22:12:33.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8167fc700 1 -- 172.21.15.49:0/1319802082 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8300078d0 con 0x2159eb0 2023-07-21T22:12:33.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8167fc700 1 -- 172.21.15.49:0/1319802082 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb830015440 con 0x2159eb0 2023-07-21T22:12:33.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 1 -- 172.21.15.49:0/1319802082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb82c05a1d0 con 0x2159eb0 2023-07-21T22:12:33.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8167fc700 1 -- 172.21.15.49:0/1319802082 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb830015600 con 0x2159eb0 2023-07-21T22:12:33.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 10 client.5847 fetch_fsmap learned FSMap version 17 2023-07-21T22:12:33.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 1 -- 172.21.15.49:0/1319802082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x22de5c0 con 0x2159eb0 2023-07-21T22:12:33.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8167fc700 1 -- 172.21.15.49:0/1319802082 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c05a1d0 con 0x2159eb0 2023-07-21T22:12:33.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb8167fc700 1 -- 172.21.15.49:0/1319802082 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb830015760 con 0x2159eb0 2023-07-21T22:12:33.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 10 client.5847 fetch_fsmap finished waiting for FSMap version 17 2023-07-21T22:12:33.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 10 client.5847 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-21T22:12:33.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 20 client.5847 populate_metadata read hostname 'smithi049' 2023-07-21T22:12:33.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.49:6836/3511065368,v1:172.21.15.49:6837/3511065368] conn(0x2417ea0 0x24117f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:33.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 4 client.5847 mds_command: new command op to 5631 tid=0[{"prefix": "status"}] 2023-07-21T22:12:33.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb840b73740 1 -- 172.21.15.49:0/1319802082 --> [v2:172.21.15.49:6836/3511065368,v1:172.21.15.49:6837/3511065368] -- command(tid 0: {"prefix": "status"}) v1 -- 0x21b14e0 con 0x2417ea0 2023-07-21T22:12:33.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.887+0000 7fb836ffd700 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.49:6836/3511065368,v1:172.21.15.49:6837/3511065368] conn(0x2417ea0 0x24117f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:33.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb8167fc700 10 client.5847 ms_handle_connect on v2:172.21.15.49:6836/3511065368 2023-07-21T22:12:33.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb836ffd700 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.49:6836/3511065368,v1:172.21.15.49:6837/3511065368] conn(0x2417ea0 0x24117f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5edaf97f78f9c540 server_cookie=7899c87b0e0ca881 in_seq=0 out_seq=0 2023-07-21T22:12:33.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb8167fc700 1 -- 172.21.15.49:0/1319802082 <== mds.0 v2:172.21.15.49:6836/3511065368 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x21b14e0 con 0x2417ea0 2023-07-21T22:12:33.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb8167fc700 10 client.5847 handle_command_reply: tid=0 2023-07-21T22:12:33.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb840b73740 1 client.5847 shutdown 2023-07-21T22:12:33.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb840b73740 1 -- 172.21.15.49:0/1319802082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 msgr2=0x245b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb840b73740 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x245b9b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb830007c60 tx=0x7fb8300012a0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb840b73740 1 -- 172.21.15.49:0/1319802082 shutdown_connections 2023-07-21T22:12:33.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb840b73740 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.49:6836/3511065368,v1:172.21.15.49:6837/3511065368] conn(0x2417ea0 0x24117f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb840b73740 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2159eb0 0x245b9b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb840b73740 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x2159ae0 0x245a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb840b73740 1 --2- 172.21.15.49:0/1319802082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x2159710 0x2416bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb8167fc700 0 client.5847 ms_handle_reset on v2:172.21.15.49:6836/3511065368 2023-07-21T22:12:33.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb840b73740 1 -- 172.21.15.49:0/1319802082 >> 172.21.15.49:0/1319802082 conn(0x23c3b60 msgr2=0x23f47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:33.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb840b73740 1 -- 172.21.15.49:0/1319802082 shutdown_connections 2023-07-21T22:12:33.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb840b73740 1 -- 172.21.15.49:0/1319802082 wait complete. 2023-07-21T22:12:33.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb840b73740 20 client.5847 trim_cache size 0 max 16384 2023-07-21T22:12:33.947 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:12:33.947 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "c1346180-e695-42c2-8f5b-b72be8101116", 2023-07-21T22:12:33.948 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-07-21T22:12:33.948 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5631, 2023-07-21T22:12:33.948 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-07-21T22:12:33.948 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-07-21T22:12:33.948 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-07-21T22:12:33.948 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 11.254761792, 2023-07-21T22:12:33.948 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 17, 2023-07-21T22:12:33.949 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 44, 2023-07-21T22:12:33.949 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 44, 2023-07-21T22:12:33.949 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 20.13343579 2023-07-21T22:12:33.949 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:12:33.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb83d8ee700 1 -- 172.21.15.49:0/3779768164 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8240662f0 msgr2=0x7fb8240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb83d8ee700 1 --2- 172.21.15.49:0/3779768164 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8240662f0 0x7fb8240687a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb838072830 tx=0x7fb828009040 comp rx=0 tx=0).stop 2023-07-21T22:12:33.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb83d8ee700 1 -- 172.21.15.49:0/3779768164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8380cee10 msgr2=0x7fb8380c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:33.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb83d8ee700 1 --2- 172.21.15.49:0/3779768164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8380cee10 0x7fb8380c7e00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0090b0 tx=0x7fb82c004770 comp rx=0 tx=0).stop 2023-07-21T22:12:33.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb83d8ee700 1 -- 172.21.15.49:0/3779768164 shutdown_connections 2023-07-21T22:12:33.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb83d8ee700 1 --2- 172.21.15.49:0/3779768164 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb8240662f0 0x7fb8240687a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb83d8ee700 1 --2- 172.21.15.49:0/3779768164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8380d1e40 0x7fb8381f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb83d8ee700 1 --2- 172.21.15.49:0/3779768164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8380cee10 0x7fb8380c7e00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb83d8ee700 1 --2- 172.21.15.49:0/3779768164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8380b7af0 0x7fb8380c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:33.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb83d8ee700 1 -- 172.21.15.49:0/3779768164 >> 172.21.15.49:0/3779768164 conn(0x7fb83806e960 msgr2=0x7fb8380b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:33.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb83d8ee700 1 -- 172.21.15.49:0/3779768164 shutdown_connections 2023-07-21T22:12:33.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:33.891+0000 7fb83d8ee700 1 -- 172.21.15.49:0/3779768164 wait complete. 2023-07-21T22:12:33.959 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:12:34.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.091+0000 7fe2d7fff700 1 Processor -- start 2023-07-21T22:12:34.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.091+0000 7fe2d7fff700 1 -- start start 2023-07-21T22:12:34.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.095+0000 7fe2d7fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe2d80b7af0 0x7fe2d80b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:34.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.095+0000 7fe2d7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d80d1e40 0x7fe2d815f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:34.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.095+0000 7fe2d7fff700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d80b3e80 con 0x7fe2d80cee10 2023-07-21T22:12:34.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.095+0000 7fe2d7fff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d80cea00 con 0x7fe2d80b7af0 2023-07-21T22:12:34.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.095+0000 7fe2d7fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80ccbf0 con 0x7fe2d80d1e40 2023-07-21T22:12:34.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.095+0000 7fe2d77fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe2d80cee10 0x7fe2d80b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49276/0 (socket says 172.21.15.49:49276) 2023-07-21T22:12:34.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.095+0000 7fe2d77fe700 1 -- 172.21.15.49:0/3661552491 learned_addr learned my addr 172.21.15.49:0/3661552491 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:34.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.095+0000 7fe2d6ffd700 1 --2- 172.21.15.49:0/3661552491 >> v2:172.21.15.150:3300/0 conn(0x7fe2d80b7af0 0x7fe2d80b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:34.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.095+0000 7fe2d67fc700 1 --2- 172.21.15.49:0/3661552491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d80d1e40 0x7fe2d815f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:34.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.095+0000 7fe2d5ffb700 1 -- 172.21.15.49:0/3661552491 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239333411 0 0) 0x7fe2d80b3e80 con 0x7fe2d80cee10 2023-07-21T22:12:34.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.095+0000 7fe2d5ffb700 1 -- 172.21.15.49:0/3661552491 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2c00035d0 con 0x7fe2d80cee10 2023-07-21T22:12:34.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d67fc700 1 -- 172.21.15.49:0/3661552491 >> v2:172.21.15.150:3300/0 conn(0x7fe2d80b7af0 msgr2=0x7fe2d80b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:34.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d67fc700 1 --2- 172.21.15.49:0/3661552491 >> v2:172.21.15.150:3300/0 conn(0x7fe2d80b7af0 0x7fe2d80b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:34.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d67fc700 1 -- 172.21.15.49:0/3661552491 >> v1:172.21.15.49:6789/0 conn(0x7fe2d80cee10 legacy=0x7fe2d80b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:34.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d67fc700 1 -- 172.21.15.49:0/3661552491 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80cced0 con 0x7fe2d80d1e40 2023-07-21T22:12:34.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d6ffd700 1 --2- 172.21.15.49:0/3661552491 >> v2:172.21.15.150:3300/0 conn(0x7fe2d80b7af0 0x7fe2d80b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:34.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d67fc700 1 --2- 172.21.15.49:0/3661552491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d80d1e40 0x7fe2d815f630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009850 tx=0x7fe2cc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c0530a941672be4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:34.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d5ffb700 1 -- 172.21.15.49:0/3661552491 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc011830 con 0x7fe2d80d1e40 2023-07-21T22:12:34.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d5ffb700 1 -- 172.21.15.49:0/3661552491 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc011990 con 0x7fe2d80d1e40 2023-07-21T22:12:34.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d5ffb700 1 -- 172.21.15.49:0/3661552491 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc011d40 con 0x7fe2d80d1e40 2023-07-21T22:12:34.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d7fff700 1 -- 172.21.15.49:0/3661552491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d80d1e40 msgr2=0x7fe2d815f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:34.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d7fff700 1 --2- 172.21.15.49:0/3661552491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d80d1e40 0x7fe2d815f630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009850 tx=0x7fe2cc009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:34.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d7fff700 1 -- 172.21.15.49:0/3661552491 shutdown_connections 2023-07-21T22:12:34.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d7fff700 1 --2- 172.21.15.49:0/3661552491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d80d1e40 0x7fe2d815f630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:34.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d7fff700 1 --2- 172.21.15.49:0/3661552491 >> v2:172.21.15.150:3300/0 conn(0x7fe2d80b7af0 0x7fe2d80b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:34.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d7fff700 1 -- 172.21.15.49:0/3661552491 >> 172.21.15.49:0/3661552491 conn(0x7fe2d806e960 msgr2=0x7fe2d806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:34.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d7fff700 1 -- 172.21.15.49:0/3661552491 shutdown_connections 2023-07-21T22:12:34.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.099+0000 7fe2d7fff700 1 -- 172.21.15.49:0/3661552491 wait complete. 2023-07-21T22:12:34.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.103+0000 7fe2d7fff700 1 Processor -- start 2023-07-21T22:12:34.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.103+0000 7fe2d7fff700 1 -- start start 2023-07-21T22:12:34.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.103+0000 7fe2d7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d80b7af0 0x7fe2d80c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:34.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.103+0000 7fe2d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2d80cee10 0x7fe2d8153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:34.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.103+0000 7fe2d7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d80d1e40 0x7fe2d80b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:34.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.103+0000 7fe2d7fff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80c9bc0 con 0x7fe2d80cee10 2023-07-21T22:12:34.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.103+0000 7fe2d7fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d81542d0 con 0x7fe2d80d1e40 2023-07-21T22:12:34.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.103+0000 7fe2d7fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80cc390 con 0x7fe2d80b7af0 2023-07-21T22:12:34.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.103+0000 7fe2d67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2d80cee10 0x7fe2d8153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:34.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.103+0000 7fe2d67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2d80cee10 0x7fe2d8153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46010/0 (socket says 172.21.15.49:46010) 2023-07-21T22:12:34.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.103+0000 7fe2d67fc700 1 -- 172.21.15.49:0/397007146 learned_addr learned my addr 172.21.15.49:0/397007146 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:34.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.103+0000 7fe2d77fe700 1 --2- 172.21.15.49:0/397007146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d80d1e40 0x7fe2d80b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:34.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.103+0000 7fe2d6ffd700 1 --2- 172.21.15.49:0/397007146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d80b7af0 0x7fe2d80c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:34.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.103+0000 7fe2d67fc700 1 -- 172.21.15.49:0/397007146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d80b7af0 msgr2=0x7fe2d80c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:34.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.107+0000 7fe2d67fc700 1 --2- 172.21.15.49:0/397007146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d80b7af0 0x7fe2d80c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:34.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.107+0000 7fe2d67fc700 1 -- 172.21.15.49:0/397007146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d80d1e40 msgr2=0x7fe2d80b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:34.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.107+0000 7fe2d67fc700 1 --2- 172.21.15.49:0/397007146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d80d1e40 0x7fe2d80b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:34.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.107+0000 7fe2d67fc700 1 -- 172.21.15.49:0/397007146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c80094b0 con 0x7fe2d80cee10 2023-07-21T22:12:34.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.107+0000 7fe2d67fc700 1 --2- 172.21.15.49:0/397007146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2d80cee10 0x7fe2d8153d90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc014040 tx=0x7fe2cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:34.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.107+0000 7fe2bf7fe700 1 -- 172.21.15.49:0/397007146 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc004510 con 0x7fe2d80cee10 2023-07-21T22:12:34.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.107+0000 7fe2d7fff700 1 -- 172.21.15.49:0/397007146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc0094b0 con 0x7fe2d80cee10 2023-07-21T22:12:34.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.107+0000 7fe2bf7fe700 1 -- 172.21.15.49:0/397007146 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc01e070 con 0x7fe2d80cee10 2023-07-21T22:12:34.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.107+0000 7fe2bf7fe700 1 -- 172.21.15.49:0/397007146 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc003900 con 0x7fe2d80cee10 2023-07-21T22:12:34.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.107+0000 7fe2d7fff700 1 -- 172.21.15.49:0/397007146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d80c60c0 con 0x7fe2d80cee10 2023-07-21T22:12:34.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.107+0000 7fe2d7fff700 1 -- 172.21.15.49:0/397007146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d804dcb0 con 0x7fe2d80cee10 2023-07-21T22:12:34.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.107+0000 7fe2bf7fe700 1 -- 172.21.15.49:0/397007146 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe2cc003a60 con 0x7fe2d80cee10 2023-07-21T22:12:34.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.111+0000 7fe2bf7fe700 1 --2- 172.21.15.49:0/397007146 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe2c40662f0 0x7fe2c40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:34.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.111+0000 7fe2bf7fe700 1 -- 172.21.15.49:0/397007146 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe2cc020070 con 0x7fe2d80cee10 2023-07-21T22:12:34.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.111+0000 7fe2d6ffd700 1 --2- 172.21.15.49:0/397007146 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe2c40662f0 0x7fe2c40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:34.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.111+0000 7fe2d6ffd700 1 --2- 172.21.15.49:0/397007146 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe2c40662f0 0x7fe2c40687a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009d80 tx=0x7fe2c8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:34.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.115+0000 7fe2bf7fe700 1 -- 172.21.15.49:0/397007146 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2cc0b5700 con 0x7fe2d80cee10 2023-07-21T22:12:34.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.327+0000 7fe2d7fff700 1 -- 172.21.15.49:0/397007146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe2d81e5e90 con 0x7fe2d80cee10 2023-07-21T22:12:34.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.327+0000 7fe2bf7fe700 1 -- 172.21.15.49:0/397007146 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe2cc0524e0 con 0x7fe2d80cee10 2023-07-21T22:12:34.373 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:12:34.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.331+0000 7fe2d7fff700 1 -- 172.21.15.49:0/397007146 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe2c40662f0 msgr2=0x7fe2c40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:34.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.331+0000 7fe2d7fff700 1 --2- 172.21.15.49:0/397007146 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe2c40662f0 0x7fe2c40687a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009d80 tx=0x7fe2c8009240 comp rx=0 tx=0).stop 2023-07-21T22:12:34.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.331+0000 7fe2d7fff700 1 -- 172.21.15.49:0/397007146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2d80cee10 msgr2=0x7fe2d8153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:34.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.331+0000 7fe2d7fff700 1 --2- 172.21.15.49:0/397007146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2d80cee10 0x7fe2d8153d90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc014040 tx=0x7fe2cc004770 comp rx=0 tx=0).stop 2023-07-21T22:12:34.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.331+0000 7fe2d7fff700 1 -- 172.21.15.49:0/397007146 shutdown_connections 2023-07-21T22:12:34.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.331+0000 7fe2d7fff700 1 --2- 172.21.15.49:0/397007146 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe2c40662f0 0x7fe2c40687a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:34.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.331+0000 7fe2d7fff700 1 --2- 172.21.15.49:0/397007146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2d80cee10 0x7fe2d8153d90 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:34.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.331+0000 7fe2d7fff700 1 --2- 172.21.15.49:0/397007146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d80d1e40 0x7fe2d80b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:34.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.331+0000 7fe2d7fff700 1 --2- 172.21.15.49:0/397007146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d80b7af0 0x7fe2d80c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:34.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.331+0000 7fe2d7fff700 1 -- 172.21.15.49:0/397007146 >> 172.21.15.49:0/397007146 conn(0x7fe2d806e960 msgr2=0x7fe2d80cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:34.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.331+0000 7fe2d7fff700 1 -- 172.21.15.49:0/397007146 shutdown_connections 2023-07-21T22:12:34.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:34.331+0000 7fe2d7fff700 1 -- 172.21.15.49:0/397007146 wait complete. 2023-07-21T22:12:34.397 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:12:34.398 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:12:34.398 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-07-21T22:12:34.398 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:12:34.398 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:12:34.399 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:12:34.399 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:12:34.399 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:12:34.400 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:12:34.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:34.401 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-07-21T22:12:34.418 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:12:34.418 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:12:34.418 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:12:34.418 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:34.419 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-07-21T22:12:34.419 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:34.419 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:12:34.419 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:12:34.419 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-07-21T22:12:34.419 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:12:34.420 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:12:34.420 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-07-21T22:12:34.420 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:12:34.420 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:12:34.420 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-07-21T22:12:34.421 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:12:34.421 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42200sec preferred_lft 42200sec 2023-07-21T22:12:34.421 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-07-21T22:12:34.421 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:34.421 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:12:34.421 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:12:34.422 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-07-21T22:12:34.422 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:12:34.422 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:19:e1:20:16 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:12:34.422 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:12:34.422 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:34.422 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:12:34.423 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether aa:11:6f:e1:a1:5e brd ff:ff:ff:ff:ff:ff 2023-07-21T22:12:34.423 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:12:34.423 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:34.423 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec43:77ff:fe1f:6f26/64 scope link 2023-07-21T22:12:34.423 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:34.423 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:12:34.424 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether aa:11:6f:e1:a1:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:12:34.424 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a811:6fff:fee1:a15e/64 scope link 2023-07-21T22:12:34.424 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:34.424 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:12:34.424 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether da:09:9c:11:2a:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:12:34.424 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::d809:9cff:fe11:2aa0/64 scope link 2023-07-21T22:12:34.425 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:34.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:34.426 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:12:34.503 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-07-21T22:12:34.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:34.506 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-07-21T22:12:34.567 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-07-21T22:12:34.568 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:12:34.568 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:12:34.568 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:12:34.568 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:12:34.568 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:12:34.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:34.569 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:12:34.569 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:12:34.570 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:12:34.570 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:12:34.570 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:12:34.571 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:12:34.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:34.709 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-07-21T22:12:34.726 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:12:34.727 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:12:34.728 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:12:34.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:34.728 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-07-21T22:12:34.811 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-21T22:12:34.811 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:12:34.812 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:12:34.873 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:12:34.874 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:12:34.874 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:12:34.936 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:12:35.019 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:12:35.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:12:35.096 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:12:35.100 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:12:35.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:35.101 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:12:35.160 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-21T22:12:35.160 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-21T22:12:35.209 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:12:35.241 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:12:35.241 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:12:35.312 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:12:35.314 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:12:35.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:35.315 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:12:35.351 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2023-07-21T22:12:35.307+0000 7ffaca722640 -1 init, newargv = 0x55ce169b3db0 newargc=15 2023-07-21T22:12:35.352 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[45329]: starting ceph client 2023-07-21T22:12:35.366 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[45329]: starting fuse 2023-07-21T22:12:35.369 INFO:teuthology.orchestra.run.smithi049.stdout:49 2023-07-21T22:12:35.369 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-07-21T22:12:35.370 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T22:12:35.370 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2023-07-21T22:12:35.371 DEBUG:teuthology.orchestra.run.smithi049:> import re 2023-07-21T22:12:35.371 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-07-21T22:12:35.371 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-07-21T22:12:35.371 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:12:35.372 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2023-07-21T22:12:35.372 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-21T22:12:35.372 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2023-07-21T22:12:35.373 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-21T22:12:35.373 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:12:35.373 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2023-07-21T22:12:35.374 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2023-07-21T22:12:35.374 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2023-07-21T22:12:35.374 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2023-07-21T22:12:35.374 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:12:35.375 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2023-07-21T22:12:35.375 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T22:12:35.375 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T22:12:35.376 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T22:12:35.376 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2023-07-21T22:12:35.376 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2023-07-21T22:12:35.377 DEBUG:teuthology.orchestra.run.smithi049:> return f 2023-07-21T22:12:35.377 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T22:12:35.377 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:12:35.377 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2023-07-21T22:12:35.378 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-07-21T22:12:35.531 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.45329.asok 2023-07-21T22:12:35.715 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45329.asok 2023-07-21T22:12:35.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:35.716 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45329.asok status 2023-07-21T22:12:35.909 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:12:35.910 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2023-07-21T22:12:35.910 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea", 2023-07-21T22:12:35.910 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:12:35.910 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2023-07-21T22:12:35.910 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2023-07-21T22:12:35.911 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-21T22:12:35.911 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "45329", 2023-07-21T22:12:35.911 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2023-07-21T22:12:35.911 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:35.911 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2023-07-21T22:12:35.911 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2023-07-21T22:12:35.911 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5862, 2023-07-21T22:12:35.911 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2023-07-21T22:12:35.912 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2023-07-21T22:12:35.912 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2023-07-21T22:12:35.912 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 5862 2023-07-21T22:12:35.912 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:35.912 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:12:35.912 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:12:35.912 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:12:35.913 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2809916542 2023-07-21T22:12:35.913 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:35.913 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:35.913 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:12:35.913 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:12:35.913 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:12:35.913 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2809916542 2023-07-21T22:12:35.913 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:35.914 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.5862 192.168.0.1:0/2809916542", 2023-07-21T22:12:35.914 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/2809916542", 2023-07-21T22:12:35.914 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2023-07-21T22:12:35.914 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 17, 2023-07-21T22:12:35.914 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 44, 2023-07-21T22:12:35.914 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2023-07-21T22:12:35.914 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2023-07-21T22:12:35.914 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2023-07-21T22:12:35.915 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:12:35.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:35.924 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2023-07-21T22:12:35.924 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-21T22:12:35.943 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2023-07-21T22:12:35.944 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-21T22:12:35.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:35.945 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:12:36.022 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2023-07-21T22:12:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.207+0000 7fdaa4e48700 1 Processor -- start 2023-07-21T22:12:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.211+0000 7fdaa4e48700 1 -- start start 2023-07-21T22:12:36.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.211+0000 7fdaa4e48700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdaa006e960 0x7fdaa006ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:36.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.211+0000 7fdaa4e48700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdaa00cecb0 0x7fdaa006af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:36.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.211+0000 7fdaa4e48700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaa006b4c0 0x7fdaa015f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:36.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.211+0000 7fdaa4e48700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa015d3f0 con 0x7fdaa00cecb0 2023-07-21T22:12:36.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fdaa4e48700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa015ce20 con 0x7fdaa006e960 2023-07-21T22:12:36.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fdaa4e48700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa015c230 con 0x7fdaa006b4c0 2023-07-21T22:12:36.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fda9effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdaa00cecb0 0x7fdaa006af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:36.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fda9effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdaa00cecb0 0x7fdaa006af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39440/0 (socket says 172.21.15.49:39440) 2023-07-21T22:12:36.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fda9f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdaa006e960 0x7fdaa006ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:36.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fda9effd700 1 -- 172.21.15.49:0/2524686487 learned_addr learned my addr 172.21.15.49:0/2524686487 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:36.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fda9ffff700 1 --2- 172.21.15.49:0/2524686487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaa006b4c0 0x7fdaa015f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:36.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fda9effd700 1 -- 172.21.15.49:0/2524686487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaa006b4c0 msgr2=0x7fdaa015f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:36.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fda9effd700 1 --2- 172.21.15.49:0/2524686487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaa006b4c0 0x7fdaa015f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:36.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fda9effd700 1 -- 172.21.15.49:0/2524686487 >> v2:172.21.15.150:3300/0 conn(0x7fdaa006e960 msgr2=0x7fdaa006ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:36.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fda9effd700 1 --2- 172.21.15.49:0/2524686487 >> v2:172.21.15.150:3300/0 conn(0x7fdaa006e960 0x7fdaa006ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:36.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fda9effd700 1 -- 172.21.15.49:0/2524686487 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa006f270 con 0x7fdaa00cecb0 2023-07-21T22:12:36.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fda9effd700 1 --2- 172.21.15.49:0/2524686487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaa00cecb0 0x7fdaa006af80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdaa006f460 tx=0x7fda94009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff13614da668e254 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:36.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fda9e7fc700 1 -- 172.21.15.49:0/2524686487 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94004230 con 0x7fdaa00cecb0 2023-07-21T22:12:36.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fda9e7fc700 1 -- 172.21.15.49:0/2524686487 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda94004390 con 0x7fdaa00cecb0 2023-07-21T22:12:36.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fda9e7fc700 1 -- 172.21.15.49:0/2524686487 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940036c0 con 0x7fdaa00cecb0 2023-07-21T22:12:36.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fdaa4e48700 1 -- 172.21.15.49:0/2524686487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaa00cecb0 msgr2=0x7fdaa006af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:36.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fdaa4e48700 1 --2- 172.21.15.49:0/2524686487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaa00cecb0 0x7fdaa006af80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdaa006f460 tx=0x7fda94009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:36.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fdaa4e48700 1 -- 172.21.15.49:0/2524686487 shutdown_connections 2023-07-21T22:12:36.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fdaa4e48700 1 --2- 172.21.15.49:0/2524686487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaa006b4c0 0x7fdaa015f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:36.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fdaa4e48700 1 --2- 172.21.15.49:0/2524686487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaa00cecb0 0x7fdaa006af80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:36.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fdaa4e48700 1 --2- 172.21.15.49:0/2524686487 >> v2:172.21.15.150:3300/0 conn(0x7fdaa006e960 0x7fdaa006ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:36.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fdaa4e48700 1 -- 172.21.15.49:0/2524686487 >> 172.21.15.49:0/2524686487 conn(0x7fdaa00b0c50 msgr2=0x7fdaa00b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:36.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fdaa4e48700 1 -- 172.21.15.49:0/2524686487 shutdown_connections 2023-07-21T22:12:36.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.215+0000 7fdaa4e48700 1 -- 172.21.15.49:0/2524686487 wait complete. 2023-07-21T22:12:36.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.219+0000 7fdaa4e48700 1 Processor -- start 2023-07-21T22:12:36.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.219+0000 7fdaa4e48700 1 -- start start 2023-07-21T22:12:36.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.219+0000 7fdaa4e48700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaa006b4c0 0x7fdaa01525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:36.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.219+0000 7fdaa4e48700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaa006e960 0x7fdaa01559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:36.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.219+0000 7fdaa4e48700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaa00cecb0 0x7fdaa00af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:36.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.219+0000 7fdaa4e48700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0152ae0 con 0x7fdaa00cecb0 2023-07-21T22:12:36.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.219+0000 7fdaa4e48700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0154950 con 0x7fdaa006e960 2023-07-21T22:12:36.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.219+0000 7fdaa4e48700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0154c30 con 0x7fdaa006b4c0 2023-07-21T22:12:36.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda9ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaa00cecb0 0x7fdaa00af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:36.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda9effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaa006e960 0x7fdaa01559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:36.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda9ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaa00cecb0 0x7fdaa00af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39446/0 (socket says 172.21.15.49:39446) 2023-07-21T22:12:36.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda9ffff700 1 -- 172.21.15.49:0/347558027 learned_addr learned my addr 172.21.15.49:0/347558027 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:36.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda9f7fe700 1 --2- 172.21.15.49:0/347558027 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaa006b4c0 0x7fdaa01525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:36.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda9effd700 1 -- 172.21.15.49:0/347558027 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaa006b4c0 msgr2=0x7fdaa01525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:36.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda9effd700 1 --2- 172.21.15.49:0/347558027 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaa006b4c0 0x7fdaa01525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:36.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda9effd700 1 -- 172.21.15.49:0/347558027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaa00cecb0 msgr2=0x7fdaa00af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:36.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda9effd700 1 --2- 172.21.15.49:0/347558027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaa00cecb0 0x7fdaa00af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:36.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda9effd700 1 -- 172.21.15.49:0/347558027 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94009570 con 0x7fdaa006e960 2023-07-21T22:12:36.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda9ffff700 1 --2- 172.21.15.49:0/347558027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaa00cecb0 0x7fdaa00af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:36.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda9effd700 1 --2- 172.21.15.49:0/347558027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaa006e960 0x7fdaa01559f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fda94015000 tx=0x7fda94004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:36.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda87fff700 1 -- 172.21.15.49:0/347558027 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94003d00 con 0x7fdaa006e960 2023-07-21T22:12:36.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda87fff700 1 -- 172.21.15.49:0/347558027 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda94011630 con 0x7fdaa006e960 2023-07-21T22:12:36.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fdaa4e48700 1 -- 172.21.15.49:0/347558027 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa0154f10 con 0x7fdaa006e960 2023-07-21T22:12:36.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fda87fff700 1 -- 172.21.15.49:0/347558027 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940119e0 con 0x7fdaa006e960 2023-07-21T22:12:36.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.223+0000 7fdaa4e48700 1 -- 172.21.15.49:0/347558027 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa01554d0 con 0x7fdaa006e960 2023-07-21T22:12:36.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.227+0000 7fdaa4e48700 1 -- 172.21.15.49:0/347558027 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa006e1b0 con 0x7fdaa006e960 2023-07-21T22:12:36.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.227+0000 7fda87fff700 1 -- 172.21.15.49:0/347558027 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fda94021070 con 0x7fdaa006e960 2023-07-21T22:12:36.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.227+0000 7fda87fff700 1 --2- 172.21.15.49:0/347558027 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fda8c0662f0 0x7fda8c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:36.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.231+0000 7fda87fff700 1 -- 172.21.15.49:0/347558027 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fda94085400 con 0x7fdaa006e960 2023-07-21T22:12:36.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.231+0000 7fda9f7fe700 1 --2- 172.21.15.49:0/347558027 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fda8c0662f0 0x7fda8c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:36.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.231+0000 7fda9f7fe700 1 --2- 172.21.15.49:0/347558027 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fda8c0662f0 0x7fda8c0687a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdaa015f210 tx=0x7fda90009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:36.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.239+0000 7fda87fff700 1 -- 172.21.15.49:0/347558027 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda94052910 con 0x7fdaa006e960 2023-07-21T22:12:36.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:36.419+0000 7fdaa4e48700 1 -- 172.21.15.49:0/347558027 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) v1 -- 0x7fdaa01556c0 con 0x7fdaa006e960 2023-07-21T22:12:37.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.091+0000 7fda87fff700 1 -- 172.21.15.49:0/347558027 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v45) v1 ==== 124+0+0 (secure 0 0 0) 0x7fda94055f30 con 0x7fdaa006e960 2023-07-21T22:12:37.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.099+0000 7fdaa4e48700 1 -- 172.21.15.49:0/347558027 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fda8c0662f0 msgr2=0x7fda8c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:37.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.099+0000 7fdaa4e48700 1 --2- 172.21.15.49:0/347558027 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fda8c0662f0 0x7fda8c0687a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdaa015f210 tx=0x7fda90009240 comp rx=0 tx=0).stop 2023-07-21T22:12:37.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.099+0000 7fdaa4e48700 1 -- 172.21.15.49:0/347558027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaa006e960 msgr2=0x7fdaa01559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:37.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.099+0000 7fdaa4e48700 1 --2- 172.21.15.49:0/347558027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaa006e960 0x7fdaa01559f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fda94015000 tx=0x7fda94004770 comp rx=0 tx=0).stop 2023-07-21T22:12:37.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.099+0000 7fdaa4e48700 1 -- 172.21.15.49:0/347558027 shutdown_connections 2023-07-21T22:12:37.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.099+0000 7fdaa4e48700 1 --2- 172.21.15.49:0/347558027 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fda8c0662f0 0x7fda8c0687a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:37.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.099+0000 7fdaa4e48700 1 --2- 172.21.15.49:0/347558027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaa00cecb0 0x7fdaa00af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:37.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.099+0000 7fdaa4e48700 1 --2- 172.21.15.49:0/347558027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaa006e960 0x7fdaa01559f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:37.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.099+0000 7fdaa4e48700 1 --2- 172.21.15.49:0/347558027 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaa006b4c0 0x7fdaa01525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:37.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.099+0000 7fdaa4e48700 1 -- 172.21.15.49:0/347558027 >> 172.21.15.49:0/347558027 conn(0x7fdaa00b0c50 msgr2=0x7fdaa015e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:37.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.099+0000 7fdaa4e48700 1 -- 172.21.15.49:0/347558027 shutdown_connections 2023-07-21T22:12:37.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.099+0000 7fdaa4e48700 1 -- 172.21.15.49:0/347558027 wait complete. 2023-07-21T22:12:37.147 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'data_new' created 2023-07-21T22:12:37.165 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2023-07-21T22:12:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.303+0000 7fc243f8d700 1 Processor -- start 2023-07-21T22:12:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.303+0000 7fc243f8d700 1 -- start start 2023-07-21T22:12:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.303+0000 7fc243f8d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc23c0cabe0 0x7fc23c0cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.303+0000 7fc243f8d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc23c15f9d0 0x7fc23c15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.303+0000 7fc243f8d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c0c88c0 con 0x7fc23c0ce120 2023-07-21T22:12:37.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.303+0000 7fc243f8d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23c15c220 con 0x7fc23c0cabe0 2023-07-21T22:12:37.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.303+0000 7fc243f8d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0ca620 con 0x7fc23c15f9d0 2023-07-21T22:12:37.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.303+0000 7fc24252a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc23c0ce120 0x7fc23c0ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34484/0 (socket says 172.21.15.49:34484) 2023-07-21T22:12:37.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.303+0000 7fc24252a700 1 -- 172.21.15.49:0/1124752510 learned_addr learned my addr 172.21.15.49:0/1124752510 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:37.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc241528700 1 --2- 172.21.15.49:0/1124752510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc23c15f9d0 0x7fc23c15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:37.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc241d29700 1 --2- 172.21.15.49:0/1124752510 >> v2:172.21.15.150:3300/0 conn(0x7fc23c0cabe0 0x7fc23c0cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:37.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc240d27700 1 -- 172.21.15.49:0/1124752510 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161255875 0 0) 0x7fc23c0c88c0 con 0x7fc23c0ce120 2023-07-21T22:12:37.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc240d27700 1 -- 172.21.15.49:0/1124752510 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2280035d0 con 0x7fc23c0ce120 2023-07-21T22:12:37.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc240d27700 1 -- 172.21.15.49:0/1124752510 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1171223250 0 0) 0x7fc2280035d0 con 0x7fc23c0ce120 2023-07-21T22:12:37.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc241528700 1 -- 172.21.15.49:0/1124752510 >> v2:172.21.15.150:3300/0 conn(0x7fc23c0cabe0 msgr2=0x7fc23c0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:37.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc241528700 1 --2- 172.21.15.49:0/1124752510 >> v2:172.21.15.150:3300/0 conn(0x7fc23c0cabe0 0x7fc23c0cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:37.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc241528700 1 -- 172.21.15.49:0/1124752510 >> v1:172.21.15.49:6789/0 conn(0x7fc23c0ce120 legacy=0x7fc23c0ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:37.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc241528700 1 -- 172.21.15.49:0/1124752510 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c0cb4f0 con 0x7fc23c15f9d0 2023-07-21T22:12:37.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc241528700 1 --2- 172.21.15.49:0/1124752510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc23c15f9d0 0x7fc23c15fe20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009840 tx=0x7fc22c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0afbf5721ba2a49 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:37.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc240d27700 1 -- 172.21.15.49:0/1124752510 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340019f0 con 0x7fc23c15f9d0 2023-07-21T22:12:37.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc240d27700 1 -- 172.21.15.49:0/1124752510 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c004030 con 0x7fc23c15f9d0 2023-07-21T22:12:37.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc240d27700 1 -- 172.21.15.49:0/1124752510 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c0043c0 con 0x7fc23c15f9d0 2023-07-21T22:12:37.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc243f8d700 1 -- 172.21.15.49:0/1124752510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc23c15f9d0 msgr2=0x7fc23c15fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:37.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc243f8d700 1 --2- 172.21.15.49:0/1124752510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc23c15f9d0 0x7fc23c15fe20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009840 tx=0x7fc22c009b50 comp rx=0 tx=0).stop 2023-07-21T22:12:37.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc243f8d700 1 -- 172.21.15.49:0/1124752510 shutdown_connections 2023-07-21T22:12:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc243f8d700 1 --2- 172.21.15.49:0/1124752510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc23c15f9d0 0x7fc23c15fe20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc243f8d700 1 --2- 172.21.15.49:0/1124752510 >> v2:172.21.15.150:3300/0 conn(0x7fc23c0cabe0 0x7fc23c0cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.307+0000 7fc243f8d700 1 -- 172.21.15.49:0/1124752510 >> 172.21.15.49:0/1124752510 conn(0x7fc23c06e960 msgr2=0x7fc23c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.311+0000 7fc243f8d700 1 -- 172.21.15.49:0/1124752510 shutdown_connections 2023-07-21T22:12:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.311+0000 7fc243f8d700 1 -- 172.21.15.49:0/1124752510 wait complete. 2023-07-21T22:12:37.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.311+0000 7fc243f8d700 1 Processor -- start 2023-07-21T22:12:37.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.311+0000 7fc243f8d700 1 -- start start 2023-07-21T22:12:37.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc243f8d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc23c0cabe0 0x7fc23c15a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:37.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc243f8d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc23c0ce120 0x7fc23c06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:37.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc243f8d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc23c15f9d0 0x7fc23c06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:37.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc243f8d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c1f58f0 con 0x7fc23c0ce120 2023-07-21T22:12:37.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc243f8d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c1f5b90 con 0x7fc23c15f9d0 2023-07-21T22:12:37.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc243f8d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c1f5e70 con 0x7fc23c0cabe0 2023-07-21T22:12:37.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc241528700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc23c0ce120 0x7fc23c06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:37.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc241528700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc23c0ce120 0x7fc23c06c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39456/0 (socket says 172.21.15.49:39456) 2023-07-21T22:12:37.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc241528700 1 -- 172.21.15.49:0/899763613 learned_addr learned my addr 172.21.15.49:0/899763613 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc241d29700 1 --2- 172.21.15.49:0/899763613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc23c0cabe0 0x7fc23c15a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc24252a700 1 --2- 172.21.15.49:0/899763613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc23c15f9d0 0x7fc23c06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc241528700 1 -- 172.21.15.49:0/899763613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc23c0cabe0 msgr2=0x7fc23c15a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc241528700 1 --2- 172.21.15.49:0/899763613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc23c0cabe0 0x7fc23c15a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc241528700 1 -- 172.21.15.49:0/899763613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc23c15f9d0 msgr2=0x7fc23c06cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc241528700 1 --2- 172.21.15.49:0/899763613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc23c15f9d0 0x7fc23c06cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc241528700 1 -- 172.21.15.49:0/899763613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c009450 con 0x7fc23c0ce120 2023-07-21T22:12:37.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc241528700 1 --2- 172.21.15.49:0/899763613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc23c0ce120 0x7fc23c06c670 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009ea0 tx=0x7fc22c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:37.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc2327fc700 1 -- 172.21.15.49:0/899763613 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c003a40 con 0x7fc23c0ce120 2023-07-21T22:12:37.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc2327fc700 1 -- 172.21.15.49:0/899763613 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c020070 con 0x7fc23c0ce120 2023-07-21T22:12:37.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc243f8d700 1 -- 172.21.15.49:0/899763613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23c1f6150 con 0x7fc23c0ce120 2023-07-21T22:12:37.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc2327fc700 1 -- 172.21.15.49:0/899763613 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c003da0 con 0x7fc23c0ce120 2023-07-21T22:12:37.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.315+0000 7fc243f8d700 1 -- 172.21.15.49:0/899763613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23c1f6670 con 0x7fc23c0ce120 2023-07-21T22:12:37.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.319+0000 7fc243f8d700 1 -- 172.21.15.49:0/899763613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23c1f6360 con 0x7fc23c0ce120 2023-07-21T22:12:37.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.319+0000 7fc2327fc700 1 -- 172.21.15.49:0/899763613 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc22c022030 con 0x7fc23c0ce120 2023-07-21T22:12:37.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.323+0000 7fc2327fc700 1 --2- 172.21.15.49:0/899763613 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc2200662f0 0x7fc2200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:37.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.323+0000 7fc2327fc700 1 -- 172.21.15.49:0/899763613 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6745+0+0 (secure 0 0 0) 0x7fc22c0855f0 con 0x7fc23c0ce120 2023-07-21T22:12:37.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.323+0000 7fc241d29700 1 --2- 172.21.15.49:0/899763613 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc2200662f0 0x7fc2200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:37.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.323+0000 7fc241d29700 1 --2- 172.21.15.49:0/899763613 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc2200662f0 0x7fc2200687a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc238009b50 tx=0x7fc238009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:37.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.331+0000 7fc2327fc700 1 -- 172.21.15.49:0/899763613 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc22c0527b0 con 0x7fc23c0ce120 2023-07-21T22:12:37.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:37.539+0000 7fc243f8d700 1 -- 172.21.15.49:0/899763613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) v1 -- 0x7fc23c04dd50 con 0x7fc23c0ce120 2023-07-21T22:12:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.091+0000 7fc2327fc700 1 -- 172.21.15.49:0/899763613 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 8 to fsmap v18) v1 ==== 131+0+0 (secure 0 0 0) 0x7fc22c055dd0 con 0x7fc23c0ce120 2023-07-21T22:12:38.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.095+0000 7fc243f8d700 1 -- 172.21.15.49:0/899763613 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc2200662f0 msgr2=0x7fc2200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.095+0000 7fc243f8d700 1 --2- 172.21.15.49:0/899763613 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc2200662f0 0x7fc2200687a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc238009b50 tx=0x7fc238009240 comp rx=0 tx=0).stop 2023-07-21T22:12:38.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.095+0000 7fc243f8d700 1 -- 172.21.15.49:0/899763613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc23c0ce120 msgr2=0x7fc23c06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.095+0000 7fc243f8d700 1 --2- 172.21.15.49:0/899763613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc23c0ce120 0x7fc23c06c670 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009ea0 tx=0x7fc22c004770 comp rx=0 tx=0).stop 2023-07-21T22:12:38.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.095+0000 7fc243f8d700 1 -- 172.21.15.49:0/899763613 shutdown_connections 2023-07-21T22:12:38.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.095+0000 7fc243f8d700 1 --2- 172.21.15.49:0/899763613 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc2200662f0 0x7fc2200687a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.095+0000 7fc243f8d700 1 --2- 172.21.15.49:0/899763613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc23c0ce120 0x7fc23c06c670 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.095+0000 7fc243f8d700 1 --2- 172.21.15.49:0/899763613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc23c15f9d0 0x7fc23c06cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.095+0000 7fc243f8d700 1 --2- 172.21.15.49:0/899763613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc23c0cabe0 0x7fc23c15a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.095+0000 7fc243f8d700 1 -- 172.21.15.49:0/899763613 >> 172.21.15.49:0/899763613 conn(0x7fc23c06e960 msgr2=0x7fc23c0ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:38.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.095+0000 7fc243f8d700 1 -- 172.21.15.49:0/899763613 shutdown_connections 2023-07-21T22:12:38.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.095+0000 7fc243f8d700 1 -- 172.21.15.49:0/899763613 wait complete. 2023-07-21T22:12:38.146 INFO:teuthology.orchestra.run.smithi049.stderr:added data pool 8 to fsmap 2023-07-21T22:12:38.164 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:12:38.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.299+0000 7fb44359e700 1 Processor -- start 2023-07-21T22:12:38.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.299+0000 7fb44359e700 1 -- start start 2023-07-21T22:12:38.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.299+0000 7fb44359e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb44406d380 0x7fb44406d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:38.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.299+0000 7fb44359e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4440cab20 con 0x7fb4440cafb0 2023-07-21T22:12:38.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.299+0000 7fb44359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44406dc90 con 0x7fb444071c70 2023-07-21T22:12:38.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.299+0000 7fb44359e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4440c9e80 con 0x7fb44406d380 2023-07-21T22:12:38.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.299+0000 7fb44259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb44406d380 0x7fb44406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:38.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.299+0000 7fb44259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb44406d380 0x7fb44406d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39466/0 (socket says 172.21.15.49:39466) 2023-07-21T22:12:38.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.299+0000 7fb44259c700 1 -- 172.21.15.49:0/2359244194 learned_addr learned my addr 172.21.15.49:0/2359244194 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:38.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.299+0000 7fb442d9d700 1 --1- 172.21.15.49:0/2359244194 >> v1:172.21.15.49:6789/0 conn(0x7fb4440cafb0 0x7fb444164730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34488/0 (socket says 172.21.15.49:34488) 2023-07-21T22:12:38.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44259c700 1 -- 172.21.15.49:0/2359244194 >> v1:172.21.15.150:6789/0 conn(0x7fb444071c70 legacy=0x7fb4440b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44259c700 1 -- 172.21.15.49:0/2359244194 >> v1:172.21.15.49:6789/0 conn(0x7fb4440cafb0 legacy=0x7fb444164730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44259c700 1 -- 172.21.15.49:0/2359244194 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4440ca1f0 con 0x7fb44406d380 2023-07-21T22:12:38.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44159a700 1 -- 172.21.15.49:0/2359244194 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243037164 0 0) 0x7fb4440cab20 con 0x7fb4440cafb0 2023-07-21T22:12:38.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44259c700 1 --2- 172.21.15.49:0/2359244194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44406d380 0x7fb44406d750 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb434009910 tx=0x7fb434009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6666bc02abe95181 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:38.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44159a700 1 -- 172.21.15.49:0/2359244194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400ba60 con 0x7fb44406d380 2023-07-21T22:12:38.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44159a700 1 -- 172.21.15.49:0/2359244194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400bbc0 con 0x7fb44406d380 2023-07-21T22:12:38.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44159a700 1 -- 172.21.15.49:0/2359244194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434009e60 con 0x7fb44406d380 2023-07-21T22:12:38.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44359e700 1 -- 172.21.15.49:0/2359244194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44406d380 msgr2=0x7fb44406d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44359e700 1 --2- 172.21.15.49:0/2359244194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44406d380 0x7fb44406d750 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb434009910 tx=0x7fb434009c20 comp rx=0 tx=0).stop 2023-07-21T22:12:38.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44359e700 1 -- 172.21.15.49:0/2359244194 shutdown_connections 2023-07-21T22:12:38.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44359e700 1 --2- 172.21.15.49:0/2359244194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44406d380 0x7fb44406d750 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44359e700 1 -- 172.21.15.49:0/2359244194 >> 172.21.15.49:0/2359244194 conn(0x7fb444070450 msgr2=0x7fb444070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:38.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44359e700 1 -- 172.21.15.49:0/2359244194 shutdown_connections 2023-07-21T22:12:38.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.303+0000 7fb44359e700 1 -- 172.21.15.49:0/2359244194 wait complete. 2023-07-21T22:12:38.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.307+0000 7fb44359e700 1 Processor -- start 2023-07-21T22:12:38.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.307+0000 7fb44359e700 1 -- start start 2023-07-21T22:12:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb44359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb44406d380 0x7fb44415c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb44359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb444071c70 0x7fb4440c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb44359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4440cafb0 0x7fb4440c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb44359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb444151210 con 0x7fb4440cafb0 2023-07-21T22:12:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb44359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44415bda0 con 0x7fb44406d380 2023-07-21T22:12:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb44359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4440c58a0 con 0x7fb444071c70 2023-07-21T22:12:38.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb442d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4440cafb0 0x7fb4440c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:38.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb442d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4440cafb0 0x7fb4440c2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39470/0 (socket says 172.21.15.49:39470) 2023-07-21T22:12:38.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb442d9d700 1 -- 172.21.15.49:0/2838351026 learned_addr learned my addr 172.21.15.49:0/2838351026 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:38.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb44259c700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb44406d380 0x7fb44415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:38.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb441d9b700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb444071c70 0x7fb4440c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:38.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb442d9d700 1 -- 172.21.15.49:0/2838351026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb444071c70 msgr2=0x7fb4440c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb442d9d700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb444071c70 0x7fb4440c5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb442d9d700 1 -- 172.21.15.49:0/2838351026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb44406d380 msgr2=0x7fb44415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb442d9d700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb44406d380 0x7fb44415c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb442d9d700 1 -- 172.21.15.49:0/2838351026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb434009570 con 0x7fb4440cafb0 2023-07-21T22:12:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb441d9b700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb444071c70 0x7fb4440c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb442d9d700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4440cafb0 0x7fb4440c2c70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00cc70 tx=0x7fb43c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb432ffd700 1 -- 172.21.15.49:0/2838351026 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c00ab70 con 0x7fb4440cafb0 2023-07-21T22:12:38.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb432ffd700 1 -- 172.21.15.49:0/2838351026 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c00acf0 con 0x7fb4440cafb0 2023-07-21T22:12:38.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb432ffd700 1 -- 172.21.15.49:0/2838351026 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c007310 con 0x7fb4440cafb0 2023-07-21T22:12:38.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb44359e700 1 -- 172.21.15.49:0/2838351026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4440c52e0 con 0x7fb4440cafb0 2023-07-21T22:12:38.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.311+0000 7fb44359e700 1 -- 172.21.15.49:0/2838351026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44415ba30 con 0x7fb4440cafb0 2023-07-21T22:12:38.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.315+0000 7fb44359e700 1 -- 172.21.15.49:0/2838351026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44415bf50 con 0x7fb4440cafb0 2023-07-21T22:12:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.315+0000 7fb432ffd700 1 -- 172.21.15.49:0/2838351026 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb43c007470 con 0x7fb4440cafb0 2023-07-21T22:12:38.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.319+0000 7fb432ffd700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb4240662f0 0x7fb4240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.319+0000 7fb432ffd700 1 -- 172.21.15.49:0/2838351026 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fb43c083a70 con 0x7fb4440cafb0 2023-07-21T22:12:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.319+0000 7fb44259c700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb4240662f0 0x7fb4240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:38.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.319+0000 7fb44259c700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb4240662f0 0x7fb4240687a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb434006f80 tx=0x7fb43401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.323+0000 7fb432ffd700 1 -- 172.21.15.49:0/2838351026 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb44415bf50 con 0x7fb4440cafb0 2023-07-21T22:12:38.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.531+0000 7fb44359e700 1 -- 172.21.15.49:0/2838351026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb44415bf50 con 0x7fb4440cafb0 2023-07-21T22:12:38.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.531+0000 7fb432ffd700 1 -- 172.21.15.49:0/2838351026 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fb44415bf50 con 0x7fb4440cafb0 2023-07-21T22:12:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:38.579 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2563650108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2563650108},{"type":"v1","addr":"172.21.15.49:6835","nonce":2563650108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2639704311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2639704311},{"type":"v1","addr":"172.21.15.150:6833","nonce":2639704311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1930443415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1930443415},{"type":"v1","addr":"172.21.15.150:6835","nonce":1930443415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:12:22.057988+0000","modified":"2023-07-21T22:12:38.083444+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5631":{"gid":5631,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/3511065368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3511065368},{"type":"v1","addr":"172.21.15.49:6837","nonce":3511065368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T22:12:38.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.535+0000 7fb44359e700 1 -- 172.21.15.49:0/2838351026 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb4240662f0 msgr2=0x7fb4240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.535+0000 7fb44359e700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb4240662f0 0x7fb4240687a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb434006f80 tx=0x7fb43401c040 comp rx=0 tx=0).stop 2023-07-21T22:12:38.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.535+0000 7fb44359e700 1 -- 172.21.15.49:0/2838351026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4440cafb0 msgr2=0x7fb4440c2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.535+0000 7fb44359e700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4440cafb0 0x7fb4440c2c70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00cc70 tx=0x7fb43c00cf80 comp rx=0 tx=0).stop 2023-07-21T22:12:38.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.535+0000 7fb44359e700 1 -- 172.21.15.49:0/2838351026 shutdown_connections 2023-07-21T22:12:38.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.535+0000 7fb44359e700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb4240662f0 0x7fb4240687a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.535+0000 7fb44359e700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4440cafb0 0x7fb4440c2c70 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.535+0000 7fb44359e700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb444071c70 0x7fb4440c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.535+0000 7fb44359e700 1 --2- 172.21.15.49:0/2838351026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb44406d380 0x7fb44415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.535+0000 7fb44359e700 1 -- 172.21.15.49:0/2838351026 >> 172.21.15.49:0/2838351026 conn(0x7fb444070450 msgr2=0x7fb4440b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:38.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.535+0000 7fb44359e700 1 -- 172.21.15.49:0/2838351026 shutdown_connections 2023-07-21T22:12:38.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.535+0000 7fb44359e700 1 -- 172.21.15.49:0/2838351026 wait complete. 2023-07-21T22:12:38.584 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 18 2023-07-21T22:12:38.603 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:12:38.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.731+0000 7f84f053e700 1 Processor -- start 2023-07-21T22:12:38.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.731+0000 7f84f053e700 1 -- start start 2023-07-21T22:12:38.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84f053e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f84e8159f60 0x7f84e80afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:38.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84f053e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f84e80b0160 0x7f84e815d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:38.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84f053e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e80b0600 con 0x7f84e806d5d0 2023-07-21T22:12:38.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84f053e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e815a470 con 0x7f84e80b0160 2023-07-21T22:12:38.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84f053e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e815a750 con 0x7f84e8159f60 2023-07-21T22:12:38.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84eeadb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f84e80b0160 0x7f84e815d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:38.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84edad9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f84e8159f60 0x7f84e80afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:38.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84ee2da700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f84e806d5d0 0x7f84e806d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34504/0 (socket says 172.21.15.49:34504) 2023-07-21T22:12:38.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84ee2da700 1 -- 172.21.15.49:0/722304888 learned_addr learned my addr 172.21.15.49:0/722304888 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:38.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84eeadb700 1 -- 172.21.15.49:0/722304888 >> v2:172.21.15.150:3300/0 conn(0x7f84e8159f60 msgr2=0x7f84e80afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:38.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84eeadb700 1 --2- 172.21.15.49:0/722304888 >> v2:172.21.15.150:3300/0 conn(0x7f84e8159f60 0x7f84e80afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84eeadb700 1 -- 172.21.15.49:0/722304888 >> v1:172.21.15.49:6789/0 conn(0x7f84e806d5d0 legacy=0x7f84e806d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84eeadb700 1 -- 172.21.15.49:0/722304888 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e815aa30 con 0x7f84e80b0160 2023-07-21T22:12:38.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84eeadb700 1 --2- 172.21.15.49:0/722304888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e80b0160 0x7f84e815d780 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f84e80b4200 tx=0x7f84e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7332583a0fb4ed2c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:38.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84ed2d8700 1 -- 172.21.15.49:0/722304888 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e000e070 con 0x7f84e80b0160 2023-07-21T22:12:38.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84ed2d8700 1 -- 172.21.15.49:0/722304888 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e000bb20 con 0x7f84e80b0160 2023-07-21T22:12:38.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.735+0000 7f84ed2d8700 1 -- 172.21.15.49:0/722304888 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0012430 con 0x7f84e80b0160 2023-07-21T22:12:38.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.739+0000 7f84f053e700 1 -- 172.21.15.49:0/722304888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e80b0160 msgr2=0x7f84e815d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.739+0000 7f84f053e700 1 --2- 172.21.15.49:0/722304888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e80b0160 0x7f84e815d780 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f84e80b4200 tx=0x7f84e000b330 comp rx=0 tx=0).stop 2023-07-21T22:12:38.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.739+0000 7f84f053e700 1 -- 172.21.15.49:0/722304888 shutdown_connections 2023-07-21T22:12:38.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.739+0000 7f84f053e700 1 --2- 172.21.15.49:0/722304888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e80b0160 0x7f84e815d780 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.739+0000 7f84f053e700 1 --2- 172.21.15.49:0/722304888 >> v2:172.21.15.150:3300/0 conn(0x7f84e8159f60 0x7f84e80afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.739+0000 7f84f053e700 1 -- 172.21.15.49:0/722304888 >> 172.21.15.49:0/722304888 conn(0x7f84e806f5a0 msgr2=0x7f84e80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:38.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.739+0000 7f84f053e700 1 -- 172.21.15.49:0/722304888 shutdown_connections 2023-07-21T22:12:38.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.739+0000 7f84f053e700 1 -- 172.21.15.49:0/722304888 wait complete. 2023-07-21T22:12:38.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84f053e700 1 Processor -- start 2023-07-21T22:12:38.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84f053e700 1 -- start start 2023-07-21T22:12:38.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84f053e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e806d5d0 0x7f84e81429f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:38.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84f053e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e80b0160 0x7f84e8152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:38.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84f053e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84e8159f60 0x7f84e80c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:38.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84f053e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8142f30 con 0x7f84e806d5d0 2023-07-21T22:12:38.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84f053e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8140340 con 0x7f84e80b0160 2023-07-21T22:12:38.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84f053e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8140620 con 0x7f84e8159f60 2023-07-21T22:12:38.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84ee2da700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e806d5d0 0x7f84e81429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:38.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84ee2da700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e806d5d0 0x7f84e81429f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39488/0 (socket says 172.21.15.49:39488) 2023-07-21T22:12:38.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84ee2da700 1 -- 172.21.15.49:0/614626052 learned_addr learned my addr 172.21.15.49:0/614626052 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84eeadb700 1 --2- 172.21.15.49:0/614626052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84e8159f60 0x7f84e80c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84edad9700 1 --2- 172.21.15.49:0/614626052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e80b0160 0x7f84e8152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84ee2da700 1 -- 172.21.15.49:0/614626052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84e8159f60 msgr2=0x7f84e80c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84ee2da700 1 --2- 172.21.15.49:0/614626052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84e8159f60 0x7f84e80c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84ee2da700 1 -- 172.21.15.49:0/614626052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e80b0160 msgr2=0x7f84e8152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84ee2da700 1 --2- 172.21.15.49:0/614626052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e80b0160 0x7f84e8152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.743+0000 7f84ee2da700 1 -- 172.21.15.49:0/614626052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e0009a70 con 0x7f84e806d5d0 2023-07-21T22:12:38.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.747+0000 7f84ee2da700 1 --2- 172.21.15.49:0/614626052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e806d5d0 0x7f84e81429f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f84e4001eb0 tx=0x7f84e400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:38.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.747+0000 7f84deffd700 1 -- 172.21.15.49:0/614626052 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e4005d90 con 0x7f84e806d5d0 2023-07-21T22:12:38.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.747+0000 7f84deffd700 1 -- 172.21.15.49:0/614626052 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e40070d0 con 0x7f84e806d5d0 2023-07-21T22:12:38.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.747+0000 7f84f053e700 1 -- 172.21.15.49:0/614626052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e8140900 con 0x7f84e806d5d0 2023-07-21T22:12:38.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.747+0000 7f84deffd700 1 -- 172.21.15.49:0/614626052 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e4007440 con 0x7f84e806d5d0 2023-07-21T22:12:38.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.747+0000 7f84f053e700 1 -- 172.21.15.49:0/614626052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e8140ec0 con 0x7f84e806d5d0 2023-07-21T22:12:38.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.747+0000 7f84f053e700 1 -- 172.21.15.49:0/614626052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e8073130 con 0x7f84e806d5d0 2023-07-21T22:12:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.751+0000 7f84deffd700 1 -- 172.21.15.49:0/614626052 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84e40075a0 con 0x7f84e806d5d0 2023-07-21T22:12:38.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.751+0000 7f84deffd700 1 --2- 172.21.15.49:0/614626052 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f84cc0662f0 0x7f84cc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:38.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.751+0000 7f84deffd700 1 -- 172.21.15.49:0/614626052 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f84e4083280 con 0x7f84e806d5d0 2023-07-21T22:12:38.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.751+0000 7f84edad9700 1 --2- 172.21.15.49:0/614626052 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f84cc0662f0 0x7f84cc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:38.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.751+0000 7f84edad9700 1 --2- 172.21.15.49:0/614626052 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f84cc0662f0 0x7f84cc0687a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f84e80c4d80 tx=0x7f84d8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:38.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.759+0000 7f84deffd700 1 -- 172.21.15.49:0/614626052 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84e4050460 con 0x7f84e806d5d0 2023-07-21T22:12:38.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.935+0000 7f84f053e700 1 -- 172.21.15.49:0/614626052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84e804dcb0 con 0x7f84e806d5d0 2023-07-21T22:12:38.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.939+0000 7f84deffd700 1 -- 172.21.15.49:0/614626052 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+20252 (secure 0 0 0) 0x7f84e4053a80 con 0x7f84e806d5d0 2023-07-21T22:12:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:38.985 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":46,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:12:37.546162+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:12:20.014383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T22:12:21.059436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"data_new","create_time":"2023-07-21T22:12:36.491357+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:12:38.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.943+0000 7f84f053e700 1 -- 172.21.15.49:0/614626052 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f84cc0662f0 msgr2=0x7f84cc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.943+0000 7f84f053e700 1 --2- 172.21.15.49:0/614626052 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f84cc0662f0 0x7f84cc0687a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f84e80c4d80 tx=0x7f84d8009240 comp rx=0 tx=0).stop 2023-07-21T22:12:38.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.943+0000 7f84f053e700 1 -- 172.21.15.49:0/614626052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e806d5d0 msgr2=0x7f84e81429f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.943+0000 7f84f053e700 1 --2- 172.21.15.49:0/614626052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e806d5d0 0x7f84e81429f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f84e4001eb0 tx=0x7f84e400c7b0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.943+0000 7f84f053e700 1 -- 172.21.15.49:0/614626052 shutdown_connections 2023-07-21T22:12:38.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.943+0000 7f84f053e700 1 --2- 172.21.15.49:0/614626052 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f84cc0662f0 0x7f84cc0687a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.943+0000 7f84f053e700 1 --2- 172.21.15.49:0/614626052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84e8159f60 0x7f84e80c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.943+0000 7f84f053e700 1 --2- 172.21.15.49:0/614626052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84e80b0160 0x7f84e8152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.943+0000 7f84f053e700 1 --2- 172.21.15.49:0/614626052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e806d5d0 0x7f84e81429f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.943+0000 7f84f053e700 1 -- 172.21.15.49:0/614626052 >> 172.21.15.49:0/614626052 conn(0x7f84e806f5a0 msgr2=0x7f84e815c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:38.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.943+0000 7f84f053e700 1 -- 172.21.15.49:0/614626052 shutdown_connections 2023-07-21T22:12:38.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:38.943+0000 7f84f053e700 1 -- 172.21.15.49:0/614626052 wait complete. 2023-07-21T22:12:39.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:39.011 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2023-07-21T22:12:39.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:39.041 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2023-07-21T22:12:39.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2023-07-21T22:12:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.299+0000 7f2e06ae4700 1 Processor -- start 2023-07-21T22:12:39.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.299+0000 7f2e06ae4700 1 -- start start 2023-07-21T22:12:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.303+0000 7f2e06ae4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e0015bed0 0x7f2e000ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.303+0000 7f2e06ae4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2e000d0980 0x7f2e000b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.303+0000 7f2e06ae4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e000d0e00 con 0x7f2e000cef30 2023-07-21T22:12:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.303+0000 7f2e06ae4700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e000b5460 con 0x7f2e000d0980 2023-07-21T22:12:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.303+0000 7f2e06ae4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e000d1030 con 0x7f2e0015bed0 2023-07-21T22:12:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.303+0000 7f2e062e3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2e000d0980 0x7f2e000b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.303+0000 7f2e062e3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2e000d0980 0x7f2e000b5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39496/0 (socket says 172.21.15.49:39496) 2023-07-21T22:12:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.303+0000 7f2e062e3700 1 -- 172.21.15.49:0/3866033999 learned_addr learned my addr 172.21.15.49:0/3866033999 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.303+0000 7f2e05ae2700 1 --2- 172.21.15.49:0/3866033999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e0015bed0 0x7f2e000ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e062e3700 1 -- 172.21.15.49:0/3866033999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e0015bed0 msgr2=0x7f2e000ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e062e3700 1 --2- 172.21.15.49:0/3866033999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e0015bed0 0x7f2e000ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e062e3700 1 -- 172.21.15.49:0/3866033999 >> v1:172.21.15.150:6789/0 conn(0x7f2e000cef30 legacy=0x7f2e000d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e062e3700 1 -- 172.21.15.49:0/3866033999 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e000d1310 con 0x7f2e000d0980 2023-07-21T22:12:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e062e3700 1 --2- 172.21.15.49:0/3866033999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e000d0980 0x7f2e000b5bd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009e50 tx=0x7f2df800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cfba49d863579 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e04ae0700 1 -- 172.21.15.49:0/3866033999 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800e070 con 0x7f2e000d0980 2023-07-21T22:12:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e04ae0700 1 -- 172.21.15.49:0/3866033999 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df800b910 con 0x7f2e000d0980 2023-07-21T22:12:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e04ae0700 1 -- 172.21.15.49:0/3866033999 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800bcc0 con 0x7f2e000d0980 2023-07-21T22:12:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e06ae4700 1 -- 172.21.15.49:0/3866033999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e000d0980 msgr2=0x7f2e000b5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e06ae4700 1 --2- 172.21.15.49:0/3866033999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e000d0980 0x7f2e000b5bd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009e50 tx=0x7f2df800b330 comp rx=0 tx=0).stop 2023-07-21T22:12:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e06ae4700 1 -- 172.21.15.49:0/3866033999 shutdown_connections 2023-07-21T22:12:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e06ae4700 1 --2- 172.21.15.49:0/3866033999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e000d0980 0x7f2e000b5bd0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e06ae4700 1 --2- 172.21.15.49:0/3866033999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e0015bed0 0x7f2e000ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e06ae4700 1 -- 172.21.15.49:0/3866033999 >> 172.21.15.49:0/3866033999 conn(0x7f2e00065af0 msgr2=0x7f2e0006fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:39.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e06ae4700 1 -- 172.21.15.49:0/3866033999 shutdown_connections 2023-07-21T22:12:39.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.307+0000 7f2e06ae4700 1 -- 172.21.15.49:0/3866033999 wait complete. 2023-07-21T22:12:39.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e06ae4700 1 Processor -- start 2023-07-21T22:12:39.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e06ae4700 1 -- start start 2023-07-21T22:12:39.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e06ae4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000cef30 0x7f2e00152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:39.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e06ae4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e000d0980 0x7f2e000c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:39.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e06ae4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0015bed0 0x7f2e0015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:39.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e06ae4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e00153180 con 0x7f2e0015bed0 2023-07-21T22:12:39.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e06ae4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0015c440 con 0x7f2e000cef30 2023-07-21T22:12:39.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e06ae4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0015c720 con 0x7f2e000d0980 2023-07-21T22:12:39.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e062e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0015bed0 0x7f2e0015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:39.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e062e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0015bed0 0x7f2e0015a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39508/0 (socket says 172.21.15.49:39508) 2023-07-21T22:12:39.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e062e3700 1 -- 172.21.15.49:0/781864221 learned_addr learned my addr 172.21.15.49:0/781864221 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:39.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e05ae2700 1 --2- 172.21.15.49:0/781864221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000cef30 0x7f2e00152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:39.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e052e1700 1 --2- 172.21.15.49:0/781864221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e000d0980 0x7f2e000c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:39.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e062e3700 1 -- 172.21.15.49:0/781864221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e000d0980 msgr2=0x7f2e000c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:39.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e062e3700 1 --2- 172.21.15.49:0/781864221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e000d0980 0x7f2e000c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e062e3700 1 -- 172.21.15.49:0/781864221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000cef30 msgr2=0x7f2e00152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:39.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e062e3700 1 --2- 172.21.15.49:0/781864221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000cef30 0x7f2e00152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e062e3700 1 -- 172.21.15.49:0/781864221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df8009b30 con 0x7f2e0015bed0 2023-07-21T22:12:39.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.311+0000 7f2e062e3700 1 --2- 172.21.15.49:0/781864221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0015bed0 0x7f2e0015a790 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2e00066030 tx=0x7f2df8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:39.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.315+0000 7f2df67fc700 1 -- 172.21.15.49:0/781864221 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80048f0 con 0x7f2e0015bed0 2023-07-21T22:12:39.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.315+0000 7f2df67fc700 1 -- 172.21.15.49:0/781864221 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df80099b0 con 0x7f2e0015bed0 2023-07-21T22:12:39.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.315+0000 7f2e06ae4700 1 -- 172.21.15.49:0/781864221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0015ca00 con 0x7f2e0015bed0 2023-07-21T22:12:39.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.315+0000 7f2df67fc700 1 -- 172.21.15.49:0/781864221 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df801c680 con 0x7f2e0015bed0 2023-07-21T22:12:39.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.315+0000 7f2e06ae4700 1 -- 172.21.15.49:0/781864221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0015cfc0 con 0x7f2e0015bed0 2023-07-21T22:12:39.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.315+0000 7f2e06ae4700 1 -- 172.21.15.49:0/781864221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0015d1b0 con 0x7f2e0015bed0 2023-07-21T22:12:39.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.319+0000 7f2df67fc700 1 -- 172.21.15.49:0/781864221 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2df801c7e0 con 0x7f2e0015bed0 2023-07-21T22:12:39.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.319+0000 7f2df67fc700 1 --2- 172.21.15.49:0/781864221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2de4066320 0x7f2de40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:39.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.319+0000 7f2df67fc700 1 -- 172.21.15.49:0/781864221 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f2df8085c10 con 0x7f2e0015bed0 2023-07-21T22:12:39.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.319+0000 7f2e05ae2700 1 --2- 172.21.15.49:0/781864221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2de4066320 0x7f2de40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:39.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.319+0000 7f2e05ae2700 1 --2- 172.21.15.49:0/781864221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2de4066320 0x7f2de40687d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009bf0 tx=0x7f2dfc009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:39.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.327+0000 7f2df67fc700 1 -- 172.21.15.49:0/781864221 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2df8052e50 con 0x7f2e0015bed0 2023-07-21T22:12:39.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.563+0000 7f2e06ae4700 1 -- 172.21.15.49:0/781864221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f2e0004dcb0 con 0x7f2e0015bed0 2023-07-21T22:12:39.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.571+0000 7f2df67fc700 1 -- 172.21.15.49:0/781864221 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v14) v1 ==== 210+0+167 (secure 0 0 0) 0x7f2df8056470 con 0x7f2e0015bed0 2023-07-21T22:12:39.618 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2023-07-21T22:12:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtkU5ZaIRAAchCJhuM71+rGOBHBlX77wA== 2023-07-21T22:12:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow rw" 2023-07-21T22:12:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2023-07-21T22:12:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2023-07-21T22:12:39.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.575+0000 7f2e06ae4700 1 -- 172.21.15.49:0/781864221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2de4066320 msgr2=0x7f2de40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:39.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.575+0000 7f2e06ae4700 1 --2- 172.21.15.49:0/781864221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2de4066320 0x7f2de40687d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009bf0 tx=0x7f2dfc009240 comp rx=0 tx=0).stop 2023-07-21T22:12:39.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.575+0000 7f2e06ae4700 1 -- 172.21.15.49:0/781864221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0015bed0 msgr2=0x7f2e0015a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:39.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.575+0000 7f2e06ae4700 1 --2- 172.21.15.49:0/781864221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0015bed0 0x7f2e0015a790 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2e00066030 tx=0x7f2df8004af0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.575+0000 7f2e06ae4700 1 -- 172.21.15.49:0/781864221 shutdown_connections 2023-07-21T22:12:39.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.575+0000 7f2e06ae4700 1 --2- 172.21.15.49:0/781864221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2de4066320 0x7f2de40687d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.575+0000 7f2e06ae4700 1 --2- 172.21.15.49:0/781864221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0015bed0 0x7f2e0015a790 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.575+0000 7f2e06ae4700 1 --2- 172.21.15.49:0/781864221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e000d0980 0x7f2e000c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.575+0000 7f2e06ae4700 1 --2- 172.21.15.49:0/781864221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e000cef30 0x7f2e00152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.575+0000 7f2e06ae4700 1 -- 172.21.15.49:0/781864221 >> 172.21.15.49:0/781864221 conn(0x7f2e00065af0 msgr2=0x7f2e000b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:39.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.575+0000 7f2e06ae4700 1 -- 172.21.15.49:0/781864221 shutdown_connections 2023-07-21T22:12:39.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.575+0000 7f2e06ae4700 1 -- 172.21.15.49:0/781864221 wait complete. 2023-07-21T22:12:39.623 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-07-21T22:12:39.643 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:12:39.643 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:12:39.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:12:39.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.831+0000 7f447ffff700 1 Processor -- start 2023-07-21T22:12:39.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.831+0000 7f447ffff700 1 -- start start 2023-07-21T22:12:39.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.835+0000 7f447ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f448006e960 0x7f448006ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:39.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.835+0000 7f447ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f448006b420 0x7f44800cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:39.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.835+0000 7f447ffff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448015d240 con 0x7f448006af80 2023-07-21T22:12:39.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.835+0000 7f447ffff700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448006b8d0 con 0x7f448006b420 2023-07-21T22:12:39.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.835+0000 7f447ffff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44800698a0 con 0x7f448006e960 2023-07-21T22:12:39.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.835+0000 7f447f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f448006b420 0x7f44800cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:39.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.835+0000 7f447f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f448006b420 0x7f44800cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39520/0 (socket says 172.21.15.49:39520) 2023-07-21T22:12:39.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.835+0000 7f447f7fe700 1 -- 172.21.15.49:0/3018858563 learned_addr learned my addr 172.21.15.49:0/3018858563 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:39.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.835+0000 7f447effd700 1 --2- 172.21.15.49:0/3018858563 >> v2:172.21.15.150:3300/0 conn(0x7f448006e960 0x7f448006ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:39.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447f7fe700 1 -- 172.21.15.49:0/3018858563 >> v2:172.21.15.150:3300/0 conn(0x7f448006e960 msgr2=0x7f448006ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:39.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447f7fe700 1 --2- 172.21.15.49:0/3018858563 >> v2:172.21.15.150:3300/0 conn(0x7f448006e960 0x7f448006ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447f7fe700 1 -- 172.21.15.49:0/3018858563 >> v1:172.21.15.150:6789/0 conn(0x7f448006af80 legacy=0x7f44800cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:39.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447f7fe700 1 -- 172.21.15.49:0/3018858563 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448006f270 con 0x7f448006b420 2023-07-21T22:12:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447f7fe700 1 --2- 172.21.15.49:0/3018858563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448006b420 0x7f44800cc290 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f448006cc50 tx=0x7f447800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496bdc086ac745de server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447dffb700 1 -- 172.21.15.49:0/3018858563 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447800e070 con 0x7f448006b420 2023-07-21T22:12:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447dffb700 1 -- 172.21.15.49:0/3018858563 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447800b9c0 con 0x7f448006b420 2023-07-21T22:12:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447dffb700 1 -- 172.21.15.49:0/3018858563 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447800bd70 con 0x7f448006b420 2023-07-21T22:12:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447ffff700 1 -- 172.21.15.49:0/3018858563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448006b420 msgr2=0x7f44800cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447ffff700 1 --2- 172.21.15.49:0/3018858563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448006b420 0x7f44800cc290 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f448006cc50 tx=0x7f447800b330 comp rx=0 tx=0).stop 2023-07-21T22:12:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447ffff700 1 -- 172.21.15.49:0/3018858563 shutdown_connections 2023-07-21T22:12:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447ffff700 1 --2- 172.21.15.49:0/3018858563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448006b420 0x7f44800cc290 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447ffff700 1 --2- 172.21.15.49:0/3018858563 >> v2:172.21.15.150:3300/0 conn(0x7f448006e960 0x7f448006ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447ffff700 1 -- 172.21.15.49:0/3018858563 >> 172.21.15.49:0/3018858563 conn(0x7f44800b0cc0 msgr2=0x7f44800b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447ffff700 1 -- 172.21.15.49:0/3018858563 shutdown_connections 2023-07-21T22:12:39.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.839+0000 7f447ffff700 1 -- 172.21.15.49:0/3018858563 wait complete. 2023-07-21T22:12:39.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.843+0000 7f447ffff700 1 Processor -- start 2023-07-21T22:12:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.843+0000 7f447ffff700 1 -- start start 2023-07-21T22:12:39.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448006af80 0x7f4480152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:39.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f448006b420 0x7f44800b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:39.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448006e960 0x7f44800ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:39.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447ffff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4480152680 con 0x7f448006e960 2023-07-21T22:12:39.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447ffff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44800b5020 con 0x7f448006b420 2023-07-21T22:12:39.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447ffff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44800ad0b0 con 0x7f448006af80 2023-07-21T22:12:39.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448006e960 0x7f44800ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:39.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448006e960 0x7f44800ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39524/0 (socket says 172.21.15.49:39524) 2023-07-21T22:12:39.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447f7fe700 1 -- 172.21.15.49:0/270138747 learned_addr learned my addr 172.21.15.49:0/270138747 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:39.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447e7fc700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f448006b420 0x7f44800b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:39.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447effd700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448006af80 0x7f4480152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:39.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447f7fe700 1 -- 172.21.15.49:0/270138747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448006af80 msgr2=0x7f4480152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:39.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447f7fe700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448006af80 0x7f4480152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447f7fe700 1 -- 172.21.15.49:0/270138747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f448006b420 msgr2=0x7f44800b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:39.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447f7fe700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f448006b420 0x7f44800b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:39.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447f7fe700 1 -- 172.21.15.49:0/270138747 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4478009b30 con 0x7f448006e960 2023-07-21T22:12:39.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447e7fc700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f448006b420 0x7f44800b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:39.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447f7fe700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448006e960 0x7f44800ae150 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4478012000 tx=0x7f4478004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:39.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f4467fff700 1 -- 172.21.15.49:0/270138747 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4478004930 con 0x7f448006e960 2023-07-21T22:12:39.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f4467fff700 1 -- 172.21.15.49:0/270138747 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44780099b0 con 0x7f448006e960 2023-07-21T22:12:39.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f4467fff700 1 -- 172.21.15.49:0/270138747 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447801c680 con 0x7f448006e960 2023-07-21T22:12:39.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447ffff700 1 -- 172.21.15.49:0/270138747 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44800ad390 con 0x7f448006e960 2023-07-21T22:12:39.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.847+0000 7f447ffff700 1 -- 172.21.15.49:0/270138747 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44800ad950 con 0x7f448006e960 2023-07-21T22:12:39.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.851+0000 7f447ffff700 1 -- 172.21.15.49:0/270138747 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448004dcb0 con 0x7f448006e960 2023-07-21T22:12:39.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.851+0000 7f4467fff700 1 -- 172.21.15.49:0/270138747 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f447801c7e0 con 0x7f448006e960 2023-07-21T22:12:39.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.855+0000 7f4467fff700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f446c0662f0 0x7f446c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:39.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.855+0000 7f4467fff700 1 -- 172.21.15.49:0/270138747 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f44780858f0 con 0x7f448006e960 2023-07-21T22:12:39.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.855+0000 7f447effd700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f446c0662f0 0x7f446c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:39.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.855+0000 7f447effd700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f446c0662f0 0x7f446c0687a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4470006b40 tx=0x7f4470008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:39.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:39.859+0000 7f4467fff700 1 -- 172.21.15.49:0/270138747 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4478052a90 con 0x7f448006e960 2023-07-21T22:12:40.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.039+0000 7f447ffff700 1 -- 172.21.15.49:0/270138747 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44800cb960 con 0x7f448006e960 2023-07-21T22:12:40.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.043+0000 7f4467fff700 1 -- 172.21.15.49:0/270138747 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+20239 (secure 0 0 0) 0x7f44780560b0 con 0x7f448006e960 2023-07-21T22:12:40.089 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:40.089 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":47,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:12:39.024259+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:12:20.014383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T22:12:21.059436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"data_new","create_time":"2023-07-21T22:12:36.491357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:12:40.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.047+0000 7f447ffff700 1 -- 172.21.15.49:0/270138747 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f446c0662f0 msgr2=0x7f446c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.047+0000 7f447ffff700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f446c0662f0 0x7f446c0687a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4470006b40 tx=0x7f4470008040 comp rx=0 tx=0).stop 2023-07-21T22:12:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.047+0000 7f447ffff700 1 -- 172.21.15.49:0/270138747 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448006e960 msgr2=0x7f44800ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.047+0000 7f447ffff700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448006e960 0x7f44800ae150 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4478012000 tx=0x7f4478004af0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.047+0000 7f447ffff700 1 -- 172.21.15.49:0/270138747 shutdown_connections 2023-07-21T22:12:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.047+0000 7f447ffff700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f446c0662f0 0x7f446c0687a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.047+0000 7f447ffff700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448006e960 0x7f44800ae150 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.047+0000 7f447ffff700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f448006b420 0x7f44800b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.047+0000 7f447ffff700 1 --2- 172.21.15.49:0/270138747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448006af80 0x7f4480152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.047+0000 7f447ffff700 1 -- 172.21.15.49:0/270138747 >> 172.21.15.49:0/270138747 conn(0x7f44800b0cc0 msgr2=0x7f44800b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:40.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.047+0000 7f447ffff700 1 -- 172.21.15.49:0/270138747 shutdown_connections 2023-07-21T22:12:40.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.047+0000 7f447ffff700 1 -- 172.21.15.49:0/270138747 wait complete. 2023-07-21T22:12:40.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:12:20.014383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:12:21.059436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'data_new', 'create_time': '2023-07-21T22:12:36.491357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:12:40.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:12:40.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.247+0000 7fe01109f700 1 Processor -- start 2023-07-21T22:12:40.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.247+0000 7fe01109f700 1 -- start start 2023-07-21T22:12:40.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.251+0000 7fe01109f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe00c15bf20 0x7fe00c0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:40.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.251+0000 7fe01109f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c0b19b0 0x7fe00c0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:40.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.251+0000 7fe01109f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00c1607a0 con 0x7fe00c0b4460 2023-07-21T22:12:40.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.251+0000 7fe01109f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00c0b48e0 con 0x7fe00c15bf20 2023-07-21T22:12:40.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.251+0000 7fe01109f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0ceda0 con 0x7fe00c0b19b0 2023-07-21T22:12:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.251+0000 7fe00bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe00c15bf20 0x7fe00c0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.251+0000 7fe00bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe00c15bf20 0x7fe00c0ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39532/0 (socket says 172.21.15.49:39532) 2023-07-21T22:12:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.251+0000 7fe00bfff700 1 -- 172.21.15.49:0/1692593846 learned_addr learned my addr 172.21.15.49:0/1692593846 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.251+0000 7fe00b7fe700 1 --2- 172.21.15.49:0/1692593846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c0b19b0 0x7fe00c0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe00bfff700 1 -- 172.21.15.49:0/1692593846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c0b19b0 msgr2=0x7fe00c0b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe00bfff700 1 --2- 172.21.15.49:0/1692593846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c0b19b0 0x7fe00c0b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe00bfff700 1 -- 172.21.15.49:0/1692593846 >> v1:172.21.15.150:6789/0 conn(0x7fe00c0b4460 legacy=0x7fe00c06e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe00bfff700 1 -- 172.21.15.49:0/1692593846 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c15f8b0 con 0x7fe00c15bf20 2023-07-21T22:12:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe00b7fe700 1 --2- 172.21.15.49:0/1692593846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c0b19b0 0x7fe00c0b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe00bfff700 1 --2- 172.21.15.49:0/1692593846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c15bf20 0x7fe00c0ce860 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009910 tx=0x7fdffc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380afccf528bff44 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:40.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe00affd700 1 -- 172.21.15.49:0/1692593846 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00ba60 con 0x7fe00c15bf20 2023-07-21T22:12:40.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe00affd700 1 -- 172.21.15.49:0/1692593846 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc00bbc0 con 0x7fe00c15bf20 2023-07-21T22:12:40.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe00affd700 1 -- 172.21.15.49:0/1692593846 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc009e60 con 0x7fe00c15bf20 2023-07-21T22:12:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe01109f700 1 -- 172.21.15.49:0/1692593846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c15bf20 msgr2=0x7fe00c0ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe01109f700 1 --2- 172.21.15.49:0/1692593846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c15bf20 0x7fe00c0ce860 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009910 tx=0x7fdffc009c20 comp rx=0 tx=0).stop 2023-07-21T22:12:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe01109f700 1 -- 172.21.15.49:0/1692593846 shutdown_connections 2023-07-21T22:12:40.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe01109f700 1 --2- 172.21.15.49:0/1692593846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c0b19b0 0x7fe00c0b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe01109f700 1 --2- 172.21.15.49:0/1692593846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c15bf20 0x7fe00c0ce860 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe01109f700 1 -- 172.21.15.49:0/1692593846 >> 172.21.15.49:0/1692593846 conn(0x7fe00c0cef20 msgr2=0x7fe00c0cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:40.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe01109f700 1 -- 172.21.15.49:0/1692593846 shutdown_connections 2023-07-21T22:12:40.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.255+0000 7fe01109f700 1 -- 172.21.15.49:0/1692593846 wait complete. 2023-07-21T22:12:40.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.259+0000 7fe01109f700 1 Processor -- start 2023-07-21T22:12:40.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.259+0000 7fe01109f700 1 -- start start 2023-07-21T22:12:40.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01109f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c0b19b0 0x7fe00c1f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:40.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01109f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00c0b4460 0x7fe00c0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:40.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01109f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c15bf20 0x7fe00c0c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01109f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0c63e0 con 0x7fe00c15bf20 2023-07-21T22:12:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01109f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0b6cc0 con 0x7fe00c0b4460 2023-07-21T22:12:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01109f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0c8080 con 0x7fe00c0b19b0 2023-07-21T22:12:40.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01089e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c15bf20 0x7fe00c0c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:40.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01089e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c15bf20 0x7fe00c0c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39538/0 (socket says 172.21.15.49:39538) 2023-07-21T22:12:40.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01089e700 1 -- 172.21.15.49:0/2009008029 learned_addr learned my addr 172.21.15.49:0/2009008029 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:40.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe00b7fe700 1 --2- 172.21.15.49:0/2009008029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00c0b4460 0x7fe00c0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:40.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe00bfff700 1 --2- 172.21.15.49:0/2009008029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c0b19b0 0x7fe00c1f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:40.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01089e700 1 -- 172.21.15.49:0/2009008029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c0b19b0 msgr2=0x7fe00c1f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01089e700 1 --2- 172.21.15.49:0/2009008029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c0b19b0 0x7fe00c1f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01089e700 1 -- 172.21.15.49:0/2009008029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00c0b4460 msgr2=0x7fe00c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01089e700 1 --2- 172.21.15.49:0/2009008029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00c0b4460 0x7fe00c0b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01089e700 1 -- 172.21.15.49:0/2009008029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc009570 con 0x7fe00c15bf20 2023-07-21T22:12:40.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01089e700 1 --2- 172.21.15.49:0/2009008029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c15bf20 0x7fe00c0c77e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe00400cc50 tx=0x7fe00400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:40.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe008ff9700 1 -- 172.21.15.49:0/2009008029 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004003c20 con 0x7fe00c15bf20 2023-07-21T22:12:40.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe008ff9700 1 -- 172.21.15.49:0/2009008029 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe004003d80 con 0x7fe00c15bf20 2023-07-21T22:12:40.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe008ff9700 1 -- 172.21.15.49:0/2009008029 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00400aab0 con 0x7fe00c15bf20 2023-07-21T22:12:40.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01109f700 1 -- 172.21.15.49:0/2009008029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00c0c8360 con 0x7fe00c15bf20 2023-07-21T22:12:40.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.263+0000 7fe01109f700 1 -- 172.21.15.49:0/2009008029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00c0c8920 con 0x7fe00c15bf20 2023-07-21T22:12:40.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.267+0000 7fe01109f700 1 -- 172.21.15.49:0/2009008029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00c04dcb0 con 0x7fe00c15bf20 2023-07-21T22:12:40.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.267+0000 7fe008ff9700 1 -- 172.21.15.49:0/2009008029 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe00400ac10 con 0x7fe00c15bf20 2023-07-21T22:12:40.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.267+0000 7fe008ff9700 1 --2- 172.21.15.49:0/2009008029 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdff80662f0 0x7fdff80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.271+0000 7fe008ff9700 1 -- 172.21.15.49:0/2009008029 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fe004083f50 con 0x7fe00c15bf20 2023-07-21T22:12:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.271+0000 7fe00bfff700 1 --2- 172.21.15.49:0/2009008029 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdff80662f0 0x7fdff80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:40.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.271+0000 7fe00bfff700 1 --2- 172.21.15.49:0/2009008029 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdff80662f0 0x7fdff80687a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdffc000c00 tx=0x7fdffc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:40.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.279+0000 7fe008ff9700 1 -- 172.21.15.49:0/2009008029 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe004051110 con 0x7fe00c15bf20 2023-07-21T22:12:40.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.455+0000 7fe01109f700 1 -- 172.21.15.49:0/2009008029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe00c0b4e80 con 0x7fe00c15bf20 2023-07-21T22:12:40.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.459+0000 7fe008ff9700 1 -- 172.21.15.49:0/2009008029 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe004054730 con 0x7fe00c15bf20 2023-07-21T22:12:40.503 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:12:40.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.459+0000 7fe01109f700 1 -- 172.21.15.49:0/2009008029 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdff80662f0 msgr2=0x7fdff80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.459+0000 7fe01109f700 1 --2- 172.21.15.49:0/2009008029 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdff80662f0 0x7fdff80687a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdffc000c00 tx=0x7fdffc008030 comp rx=0 tx=0).stop 2023-07-21T22:12:40.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.459+0000 7fe01109f700 1 -- 172.21.15.49:0/2009008029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c15bf20 msgr2=0x7fe00c0c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.459+0000 7fe01109f700 1 --2- 172.21.15.49:0/2009008029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c15bf20 0x7fe00c0c77e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe00400cc50 tx=0x7fe00400cf60 comp rx=0 tx=0).stop 2023-07-21T22:12:40.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.459+0000 7fe01109f700 1 -- 172.21.15.49:0/2009008029 shutdown_connections 2023-07-21T22:12:40.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.459+0000 7fe01109f700 1 --2- 172.21.15.49:0/2009008029 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdff80662f0 0x7fdff80687a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.459+0000 7fe01109f700 1 --2- 172.21.15.49:0/2009008029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c15bf20 0x7fe00c0c77e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.459+0000 7fe01109f700 1 --2- 172.21.15.49:0/2009008029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00c0b4460 0x7fe00c0b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.459+0000 7fe01109f700 1 --2- 172.21.15.49:0/2009008029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c0b19b0 0x7fe00c1f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.459+0000 7fe01109f700 1 -- 172.21.15.49:0/2009008029 >> 172.21.15.49:0/2009008029 conn(0x7fe00c0cef20 msgr2=0x7fe00c0d2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:40.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.459+0000 7fe01109f700 1 -- 172.21.15.49:0/2009008029 shutdown_connections 2023-07-21T22:12:40.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.459+0000 7fe01109f700 1 -- 172.21.15.49:0/2009008029 wait complete. 2023-07-21T22:12:40.527 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:12:40.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.663+0000 7fc79d515700 1 Processor -- start 2023-07-21T22:12:40.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.663+0000 7fc79d515700 1 -- start start 2023-07-21T22:12:40.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc79d515700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7980d1e40 0x7fc7980b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:40.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc79d515700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7980b3e80 con 0x7fc7980cee10 2023-07-21T22:12:40.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc79d515700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79815fd40 con 0x7fc7980b7af0 2023-07-21T22:12:40.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc79d515700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7980cea00 con 0x7fc7980d1e40 2023-07-21T22:12:40.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc7977fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7980d1e40 0x7fc7980b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:40.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc79cd14700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc7980cee10 0x7fc7980b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34512/0 (socket says 172.21.15.49:34512) 2023-07-21T22:12:40.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc79cd14700 1 -- 172.21.15.49:0/1556419810 learned_addr learned my addr 172.21.15.49:0/1556419810 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:40.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc796ffd700 1 -- 172.21.15.49:0/1556419810 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147602216 0 0) 0x7fc7980b3e80 con 0x7fc7980cee10 2023-07-21T22:12:40.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc796ffd700 1 -- 172.21.15.49:0/1556419810 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7800035d0 con 0x7fc7980cee10 2023-07-21T22:12:40.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc7977fe700 1 -- 172.21.15.49:0/1556419810 >> v1:172.21.15.150:6789/0 conn(0x7fc7980b7af0 legacy=0x7fc79815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc7977fe700 1 -- 172.21.15.49:0/1556419810 >> v1:172.21.15.49:6789/0 conn(0x7fc7980cee10 legacy=0x7fc7980b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc7977fe700 1 -- 172.21.15.49:0/1556419810 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7980ccbf0 con 0x7fc7980d1e40 2023-07-21T22:12:40.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc7977fe700 1 --2- 172.21.15.49:0/1556419810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7980d1e40 0x7fc7980b1630 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc78c009850 tx=0x7fc78c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c65f8e043ea69a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:40.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc796ffd700 1 -- 172.21.15.49:0/1556419810 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c011830 con 0x7fc7980d1e40 2023-07-21T22:12:40.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc796ffd700 1 -- 172.21.15.49:0/1556419810 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c011990 con 0x7fc7980d1e40 2023-07-21T22:12:40.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.667+0000 7fc796ffd700 1 -- 172.21.15.49:0/1556419810 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c011d40 con 0x7fc7980d1e40 2023-07-21T22:12:40.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.671+0000 7fc79d515700 1 -- 172.21.15.49:0/1556419810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7980d1e40 msgr2=0x7fc7980b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.671+0000 7fc79d515700 1 --2- 172.21.15.49:0/1556419810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7980d1e40 0x7fc7980b1630 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc78c009850 tx=0x7fc78c009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:40.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.671+0000 7fc79d515700 1 -- 172.21.15.49:0/1556419810 shutdown_connections 2023-07-21T22:12:40.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.671+0000 7fc79d515700 1 --2- 172.21.15.49:0/1556419810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7980d1e40 0x7fc7980b1630 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.671+0000 7fc79d515700 1 -- 172.21.15.49:0/1556419810 >> 172.21.15.49:0/1556419810 conn(0x7fc79806e960 msgr2=0x7fc79806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:40.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.671+0000 7fc79d515700 1 -- 172.21.15.49:0/1556419810 shutdown_connections 2023-07-21T22:12:40.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.671+0000 7fc79d515700 1 -- 172.21.15.49:0/1556419810 wait complete. 2023-07-21T22:12:40.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.675+0000 7fc79d515700 1 Processor -- start 2023-07-21T22:12:40.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.675+0000 7fc79d515700 1 -- start start 2023-07-21T22:12:40.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.675+0000 7fc79d515700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7980b7af0 0x7fc7980ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:40.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.675+0000 7fc79d515700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7980cee10 0x7fc798151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:40.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.675+0000 7fc79d515700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7980d1e40 0x7fc7980cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:40.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.675+0000 7fc79d515700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980c9fd0 con 0x7fc7980b7af0 2023-07-21T22:12:40.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.675+0000 7fc79d515700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79815b1f0 con 0x7fc7980d1e40 2023-07-21T22:12:40.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.675+0000 7fc79d515700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980c9670 con 0x7fc7980cee10 2023-07-21T22:12:40.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.675+0000 7fc797fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7980b7af0 0x7fc7980ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:40.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.675+0000 7fc797fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7980b7af0 0x7fc7980ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39566/0 (socket says 172.21.15.49:39566) 2023-07-21T22:12:40.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.675+0000 7fc797fff700 1 -- 172.21.15.49:0/2086170389 learned_addr learned my addr 172.21.15.49:0/2086170389 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:40.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.675+0000 7fc7977fe700 1 --2- 172.21.15.49:0/2086170389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7980cee10 0x7fc798151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:40.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.675+0000 7fc79cd14700 1 --2- 172.21.15.49:0/2086170389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7980d1e40 0x7fc7980cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:40.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.679+0000 7fc797fff700 1 -- 172.21.15.49:0/2086170389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7980cee10 msgr2=0x7fc798151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.679+0000 7fc797fff700 1 --2- 172.21.15.49:0/2086170389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7980cee10 0x7fc798151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.679+0000 7fc797fff700 1 -- 172.21.15.49:0/2086170389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7980d1e40 msgr2=0x7fc7980cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.679+0000 7fc797fff700 1 --2- 172.21.15.49:0/2086170389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7980d1e40 0x7fc7980cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.679+0000 7fc797fff700 1 -- 172.21.15.49:0/2086170389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c0094b0 con 0x7fc7980b7af0 2023-07-21T22:12:40.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.679+0000 7fc797fff700 1 --2- 172.21.15.49:0/2086170389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7980b7af0 0x7fc7980ca3f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc78800c530 tx=0x7fc78800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:40.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.679+0000 7fc794ff9700 1 -- 172.21.15.49:0/2086170389 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7880052d0 con 0x7fc7980b7af0 2023-07-21T22:12:40.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.679+0000 7fc794ff9700 1 -- 172.21.15.49:0/2086170389 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc788005430 con 0x7fc7980b7af0 2023-07-21T22:12:40.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.679+0000 7fc79d515700 1 -- 172.21.15.49:0/2086170389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7980c87c0 con 0x7fc7980b7af0 2023-07-21T22:12:40.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.679+0000 7fc794ff9700 1 -- 172.21.15.49:0/2086170389 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7880055a0 con 0x7fc7980b7af0 2023-07-21T22:12:40.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.679+0000 7fc79d515700 1 -- 172.21.15.49:0/2086170389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7980c9bf0 con 0x7fc7980b7af0 2023-07-21T22:12:40.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.679+0000 7fc79d515700 1 -- 172.21.15.49:0/2086170389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7980ca110 con 0x7fc7980b7af0 2023-07-21T22:12:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.683+0000 7fc794ff9700 1 -- 172.21.15.49:0/2086170389 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7880038e0 con 0x7fc7980b7af0 2023-07-21T22:12:40.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.683+0000 7fc794ff9700 1 --2- 172.21.15.49:0/2086170389 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc7840662f0 0x7fc7840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:40.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.683+0000 7fc794ff9700 1 -- 172.21.15.49:0/2086170389 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fc7880834e0 con 0x7fc7980b7af0 2023-07-21T22:12:40.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.683+0000 7fc7977fe700 1 --2- 172.21.15.49:0/2086170389 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc7840662f0 0x7fc7840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.687+0000 7fc7977fe700 1 --2- 172.21.15.49:0/2086170389 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc7840662f0 0x7fc7840687a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0090b0 tx=0x7fc78c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:40.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.691+0000 7fc794ff9700 1 -- 172.21.15.49:0/2086170389 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc7980ca110 con 0x7fc7980b7af0 2023-07-21T22:12:40.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.867+0000 7fc79d515700 1 -- 172.21.15.49:0/2086170389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc7980ca110 con 0x7fc7980b7af0 2023-07-21T22:12:40.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.871+0000 7fc794ff9700 1 -- 172.21.15.49:0/2086170389 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc7980ca110 con 0x7fc7980b7af0 2023-07-21T22:12:40.915 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.875+0000 7fc79d515700 1 -- 172.21.15.49:0/2086170389 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc7840662f0 msgr2=0x7fc7840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.875+0000 7fc79d515700 1 --2- 172.21.15.49:0/2086170389 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc7840662f0 0x7fc7840687a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0090b0 tx=0x7fc78c01c040 comp rx=0 tx=0).stop 2023-07-21T22:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.875+0000 7fc79d515700 1 -- 172.21.15.49:0/2086170389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7980b7af0 msgr2=0x7fc7980ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.875+0000 7fc79d515700 1 --2- 172.21.15.49:0/2086170389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7980b7af0 0x7fc7980ca3f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc78800c530 tx=0x7fc78800c8f0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.875+0000 7fc79d515700 1 -- 172.21.15.49:0/2086170389 shutdown_connections 2023-07-21T22:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.875+0000 7fc79d515700 1 --2- 172.21.15.49:0/2086170389 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc7840662f0 0x7fc7840687a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.875+0000 7fc79d515700 1 --2- 172.21.15.49:0/2086170389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7980d1e40 0x7fc7980cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.875+0000 7fc79d515700 1 --2- 172.21.15.49:0/2086170389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7980cee10 0x7fc798151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.875+0000 7fc79d515700 1 --2- 172.21.15.49:0/2086170389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7980b7af0 0x7fc7980ca3f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.875+0000 7fc79d515700 1 -- 172.21.15.49:0/2086170389 >> 172.21.15.49:0/2086170389 conn(0x7fc79806e960 msgr2=0x7fc7980b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.875+0000 7fc79d515700 1 -- 172.21.15.49:0/2086170389 shutdown_connections 2023-07-21T22:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:40.875+0000 7fc79d515700 1 -- 172.21.15.49:0/2086170389 wait complete. 2023-07-21T22:12:40.942 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:12:41.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.071+0000 7f876bfff700 1 Processor -- start 2023-07-21T22:12:41.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.071+0000 7f876bfff700 1 -- start start 2023-07-21T22:12:41.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.075+0000 7f876bfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f876c1603e0 0x7f876c164370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.075+0000 7f876bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f876c1648b0 0x7f876c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.075+0000 7f876bfff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876c163ee0 con 0x7f876c160010 2023-07-21T22:12:41.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.075+0000 7f876bfff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876c0cdf70 con 0x7f876c1603e0 2023-07-21T22:12:41.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.075+0000 7f876bfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0cd6d0 con 0x7f876c1648b0 2023-07-21T22:12:41.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.075+0000 7f876a7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f876c1603e0 0x7f876c164370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.075+0000 7f876a7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f876c1603e0 0x7f876c164370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:43496/0 (socket says 172.21.15.49:43496) 2023-07-21T22:12:41.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.075+0000 7f876a7fc700 1 -- 172.21.15.49:0/259612910 learned_addr learned my addr 172.21.15.49:0/259612910 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:41.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.075+0000 7f876b7fe700 1 --2- 172.21.15.49:0/259612910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f876c1648b0 0x7f876c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.075+0000 7f876a7fc700 1 -- 172.21.15.49:0/259612910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f876c1648b0 msgr2=0x7f876c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:41.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.075+0000 7f876a7fc700 1 --2- 172.21.15.49:0/259612910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f876c1648b0 0x7f876c0cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.075+0000 7f876a7fc700 1 -- 172.21.15.49:0/259612910 >> v1:172.21.15.150:6789/0 conn(0x7f876c160010 legacy=0x7f876c0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.075+0000 7f876a7fc700 1 -- 172.21.15.49:0/259612910 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c0cd9b0 con 0x7f876c1603e0 2023-07-21T22:12:41.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.075+0000 7f876b7fe700 1 --2- 172.21.15.49:0/259612910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f876c1648b0 0x7f876c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:41.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.079+0000 7f876a7fc700 1 --2- 172.21.15.49:0/259612910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c1603e0 0x7f876c164370 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8760009910 tx=0x7f8760009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7108215dd59a554 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:41.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.079+0000 7f8769ffb700 1 -- 172.21.15.49:0/259612910 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760011830 con 0x7f876c1603e0 2023-07-21T22:12:41.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.079+0000 7f8769ffb700 1 -- 172.21.15.49:0/259612910 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8760011990 con 0x7f876c1603e0 2023-07-21T22:12:41.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.079+0000 7f8769ffb700 1 -- 172.21.15.49:0/259612910 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760011d40 con 0x7f876c1603e0 2023-07-21T22:12:41.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.079+0000 7f876bfff700 1 -- 172.21.15.49:0/259612910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c1603e0 msgr2=0x7f876c164370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.079+0000 7f876bfff700 1 --2- 172.21.15.49:0/259612910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c1603e0 0x7f876c164370 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8760009910 tx=0x7f8760009c20 comp rx=0 tx=0).stop 2023-07-21T22:12:41.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.079+0000 7f876bfff700 1 -- 172.21.15.49:0/259612910 shutdown_connections 2023-07-21T22:12:41.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.079+0000 7f876bfff700 1 --2- 172.21.15.49:0/259612910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f876c1648b0 0x7f876c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.079+0000 7f876bfff700 1 --2- 172.21.15.49:0/259612910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c1603e0 0x7f876c164370 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.079+0000 7f876bfff700 1 -- 172.21.15.49:0/259612910 >> 172.21.15.49:0/259612910 conn(0x7f876c0ce0d0 msgr2=0x7f876c0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:41.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.079+0000 7f876bfff700 1 -- 172.21.15.49:0/259612910 shutdown_connections 2023-07-21T22:12:41.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.079+0000 7f876bfff700 1 -- 172.21.15.49:0/259612910 wait complete. 2023-07-21T22:12:41.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.083+0000 7f876bfff700 1 Processor -- start 2023-07-21T22:12:41.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.083+0000 7f876bfff700 1 -- start start 2023-07-21T22:12:41.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.083+0000 7f876bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c160010 0x7f876c0b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.083+0000 7f876bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f876c1603e0 0x7f876c0b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.083+0000 7f876bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f876c1648b0 0x7f876c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.083+0000 7f876bfff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0b25a0 con 0x7f876c1603e0 2023-07-21T22:12:41.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.083+0000 7f876bfff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0aecd0 con 0x7f876c160010 2023-07-21T22:12:41.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.083+0000 7f876bfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0af290 con 0x7f876c1648b0 2023-07-21T22:12:41.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f876a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f876c1603e0 0x7f876c0b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f876a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f876c1603e0 0x7f876c0b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39580/0 (socket says 172.21.15.49:39580) 2023-07-21T22:12:41.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f876a7fc700 1 -- 172.21.15.49:0/1516321600 learned_addr learned my addr 172.21.15.49:0/1516321600 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:41.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f876affd700 1 --2- 172.21.15.49:0/1516321600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c160010 0x7f876c0b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f876b7fe700 1 --2- 172.21.15.49:0/1516321600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f876c1648b0 0x7f876c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f876a7fc700 1 -- 172.21.15.49:0/1516321600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f876c1648b0 msgr2=0x7f876c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f876a7fc700 1 --2- 172.21.15.49:0/1516321600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f876c1648b0 0x7f876c0cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f876a7fc700 1 -- 172.21.15.49:0/1516321600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c160010 msgr2=0x7f876c0b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f876a7fc700 1 --2- 172.21.15.49:0/1516321600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c160010 0x7f876c0b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f876a7fc700 1 -- 172.21.15.49:0/1516321600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8764009a70 con 0x7f876c1603e0 2023-07-21T22:12:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f876a7fc700 1 --2- 172.21.15.49:0/1516321600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f876c1603e0 0x7f876c0b3b30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f876c071ec0 tx=0x7f8760004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f87537fe700 1 -- 172.21.15.49:0/1516321600 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760004450 con 0x7f876c1603e0 2023-07-21T22:12:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f87537fe700 1 -- 172.21.15.49:0/1516321600 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87600045d0 con 0x7f876c1603e0 2023-07-21T22:12:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f876bfff700 1 -- 172.21.15.49:0/1516321600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8760009570 con 0x7f876c1603e0 2023-07-21T22:12:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f87537fe700 1 -- 172.21.15.49:0/1516321600 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760003900 con 0x7f876c1603e0 2023-07-21T22:12:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f876bfff700 1 -- 172.21.15.49:0/1516321600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c0b4070 con 0x7f876c1603e0 2023-07-21T22:12:41.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.087+0000 7f876bfff700 1 -- 172.21.15.49:0/1516321600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876c04dcb0 con 0x7f876c1603e0 2023-07-21T22:12:41.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.091+0000 7f87537fe700 1 -- 172.21.15.49:0/1516321600 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8760003a60 con 0x7f876c1603e0 2023-07-21T22:12:41.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.095+0000 7f87537fe700 1 --2- 172.21.15.49:0/1516321600 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f87580662f0 0x7f87580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.095+0000 7f87537fe700 1 -- 172.21.15.49:0/1516321600 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f8760021030 con 0x7f876c1603e0 2023-07-21T22:12:41.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.095+0000 7f876affd700 1 --2- 172.21.15.49:0/1516321600 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f87580662f0 0x7f87580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.095+0000 7f876affd700 1 --2- 172.21.15.49:0/1516321600 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f87580662f0 0x7f87580687a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f875c000f60 tx=0x7f875c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:41.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.099+0000 7f87537fe700 1 -- 172.21.15.49:0/1516321600 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8760052730 con 0x7f876c1603e0 2023-07-21T22:12:41.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.275+0000 7f876bfff700 1 -- 172.21.15.49:0/1516321600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f876c0af3d0 con 0x7f876c1603e0 2023-07-21T22:12:41.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.279+0000 7f87537fe700 1 -- 172.21.15.49:0/1516321600 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8760055d50 con 0x7f876c1603e0 2023-07-21T22:12:41.323 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:12:41.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.279+0000 7f876bfff700 1 -- 172.21.15.49:0/1516321600 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f87580662f0 msgr2=0x7f87580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.283+0000 7f876bfff700 1 --2- 172.21.15.49:0/1516321600 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f87580662f0 0x7f87580687a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f875c000f60 tx=0x7f875c009040 comp rx=0 tx=0).stop 2023-07-21T22:12:41.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.283+0000 7f876bfff700 1 -- 172.21.15.49:0/1516321600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f876c1603e0 msgr2=0x7f876c0b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.283+0000 7f876bfff700 1 --2- 172.21.15.49:0/1516321600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f876c1603e0 0x7f876c0b3b30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f876c071ec0 tx=0x7f8760004770 comp rx=0 tx=0).stop 2023-07-21T22:12:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.283+0000 7f876bfff700 1 -- 172.21.15.49:0/1516321600 shutdown_connections 2023-07-21T22:12:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.283+0000 7f876bfff700 1 --2- 172.21.15.49:0/1516321600 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f87580662f0 0x7f87580687a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.283+0000 7f876bfff700 1 --2- 172.21.15.49:0/1516321600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f876c1603e0 0x7f876c0b3b30 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.283+0000 7f876bfff700 1 --2- 172.21.15.49:0/1516321600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f876c1648b0 0x7f876c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.283+0000 7f876bfff700 1 --2- 172.21.15.49:0/1516321600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c160010 0x7f876c0b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.283+0000 7f876bfff700 1 -- 172.21.15.49:0/1516321600 >> 172.21.15.49:0/1516321600 conn(0x7f876c0ce0d0 msgr2=0x7f876c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.283+0000 7f876bfff700 1 -- 172.21.15.49:0/1516321600 shutdown_connections 2023-07-21T22:12:41.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.283+0000 7f876bfff700 1 -- 172.21.15.49:0/1516321600 wait complete. 2023-07-21T22:12:41.349 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:12:41.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.491+0000 7f2d494ee700 1 Processor -- start 2023-07-21T22:12:41.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.491+0000 7f2d494ee700 1 -- start start 2023-07-21T22:12:41.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.495+0000 7f2d494ee700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d4415bf20 0x7f2d440ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.495+0000 7f2d494ee700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d441607a0 con 0x7f2d440b19b0 2023-07-21T22:12:41.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.495+0000 7f2d494ee700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4415f8b0 con 0x7f2d440b4630 2023-07-21T22:12:41.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.495+0000 7f2d494ee700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d440ceda0 con 0x7f2d4415bf20 2023-07-21T22:12:41.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.495+0000 7f2d42ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d4415bf20 0x7f2d440ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.495+0000 7f2d427fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2d440b19b0 0x7f2d440b3f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34516/0 (socket says 172.21.15.49:34516) 2023-07-21T22:12:41.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.495+0000 7f2d427fc700 1 -- 172.21.15.49:0/1149187041 learned_addr learned my addr 172.21.15.49:0/1149187041 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:41.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d42ffd700 1 -- 172.21.15.49:0/1149187041 >> v1:172.21.15.150:6789/0 conn(0x7f2d440b4630 legacy=0x7f2d440d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d41ffb700 1 -- 172.21.15.49:0/1149187041 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597041746 0 0) 0x7f2d441607a0 con 0x7f2d440b19b0 2023-07-21T22:12:41.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d42ffd700 1 -- 172.21.15.49:0/1149187041 >> v1:172.21.15.49:6789/0 conn(0x7f2d440b19b0 legacy=0x7f2d440b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d42ffd700 1 -- 172.21.15.49:0/1149187041 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4415fb90 con 0x7f2d4415bf20 2023-07-21T22:12:41.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d42ffd700 1 --2- 172.21.15.49:0/1149187041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d4415bf20 0x7f2d440ce860 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2d34009850 tx=0x7f2d34009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586c1080dbb2ba2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:41.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d41ffb700 1 -- 172.21.15.49:0/1149187041 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d34011830 con 0x7f2d4415bf20 2023-07-21T22:12:41.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d41ffb700 1 -- 172.21.15.49:0/1149187041 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d34011990 con 0x7f2d4415bf20 2023-07-21T22:12:41.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d41ffb700 1 -- 172.21.15.49:0/1149187041 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d34011d20 con 0x7f2d4415bf20 2023-07-21T22:12:41.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d494ee700 1 -- 172.21.15.49:0/1149187041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d4415bf20 msgr2=0x7f2d440ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d494ee700 1 --2- 172.21.15.49:0/1149187041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d4415bf20 0x7f2d440ce860 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2d34009850 tx=0x7f2d34009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:41.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d494ee700 1 -- 172.21.15.49:0/1149187041 shutdown_connections 2023-07-21T22:12:41.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d494ee700 1 --2- 172.21.15.49:0/1149187041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d4415bf20 0x7f2d440ce860 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d494ee700 1 -- 172.21.15.49:0/1149187041 >> 172.21.15.49:0/1149187041 conn(0x7f2d440cef20 msgr2=0x7f2d440cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:41.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d494ee700 1 -- 172.21.15.49:0/1149187041 shutdown_connections 2023-07-21T22:12:41.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.499+0000 7f2d494ee700 1 -- 172.21.15.49:0/1149187041 wait complete. 2023-07-21T22:12:41.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.503+0000 7f2d494ee700 1 Processor -- start 2023-07-21T22:12:41.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.503+0000 7f2d494ee700 1 -- start start 2023-07-21T22:12:41.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.503+0000 7f2d494ee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d440b19b0 0x7f2d440c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.503+0000 7f2d494ee700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d440b4630 0x7f2d440c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.503+0000 7f2d494ee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d4415bf20 0x7f2d44155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.503+0000 7f2d494ee700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440cc110 con 0x7f2d440b19b0 2023-07-21T22:12:41.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.503+0000 7f2d494ee700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440c6a80 con 0x7f2d4415bf20 2023-07-21T22:12:41.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.503+0000 7f2d494ee700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440c6d60 con 0x7f2d440b4630 2023-07-21T22:12:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.503+0000 7f2d42ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d440b19b0 0x7f2d440c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d42ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d440b19b0 0x7f2d440c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39596/0 (socket says 172.21.15.49:39596) 2023-07-21T22:12:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d42ffd700 1 -- 172.21.15.49:0/1286633159 learned_addr learned my addr 172.21.15.49:0/1286633159 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:41.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d437fe700 1 --2- 172.21.15.49:0/1286633159 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d4415bf20 0x7f2d44155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d427fc700 1 --2- 172.21.15.49:0/1286633159 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d440b4630 0x7f2d440c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d42ffd700 1 -- 172.21.15.49:0/1286633159 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d440b4630 msgr2=0x7f2d440c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d42ffd700 1 --2- 172.21.15.49:0/1286633159 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d440b4630 0x7f2d440c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d42ffd700 1 -- 172.21.15.49:0/1286633159 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d4415bf20 msgr2=0x7f2d44155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d42ffd700 1 --2- 172.21.15.49:0/1286633159 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d4415bf20 0x7f2d44155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d42ffd700 1 -- 172.21.15.49:0/1286633159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d340094b0 con 0x7f2d440b19b0 2023-07-21T22:12:41.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d42ffd700 1 --2- 172.21.15.49:0/1286633159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d440b19b0 0x7f2d440c8a60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2d340090b0 tx=0x7f2d34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:41.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d2b7fe700 1 -- 172.21.15.49:0/1286633159 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3400bbd0 con 0x7f2d440b19b0 2023-07-21T22:12:41.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d2b7fe700 1 -- 172.21.15.49:0/1286633159 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3401f070 con 0x7f2d440b19b0 2023-07-21T22:12:41.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d2b7fe700 1 -- 172.21.15.49:0/1286633159 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3401a430 con 0x7f2d440b19b0 2023-07-21T22:12:41.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d494ee700 1 -- 172.21.15.49:0/1286633159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d440c7040 con 0x7f2d440b19b0 2023-07-21T22:12:41.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.507+0000 7f2d494ee700 1 -- 172.21.15.49:0/1286633159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d440ca790 con 0x7f2d440b19b0 2023-07-21T22:12:41.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.511+0000 7f2d494ee700 1 -- 172.21.15.49:0/1286633159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d440cc5d0 con 0x7f2d440b19b0 2023-07-21T22:12:41.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.511+0000 7f2d2b7fe700 1 -- 172.21.15.49:0/1286633159 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d3401a590 con 0x7f2d440b19b0 2023-07-21T22:12:41.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.511+0000 7f2d2b7fe700 1 --2- 172.21.15.49:0/1286633159 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2d300662f0 0x7f2d300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.511+0000 7f2d2b7fe700 1 -- 172.21.15.49:0/1286633159 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f2d34021070 con 0x7f2d440b19b0 2023-07-21T22:12:41.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.511+0000 7f2d427fc700 1 --2- 172.21.15.49:0/1286633159 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2d300662f0 0x7f2d300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.515+0000 7f2d427fc700 1 --2- 172.21.15.49:0/1286633159 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2d300662f0 0x7f2d300687a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d4415b420 tx=0x7f2d38007db0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:41.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.515+0000 7f2d2b7fe700 1 -- 172.21.15.49:0/1286633159 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d34052a30 con 0x7f2d440b19b0 2023-07-21T22:12:41.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.687+0000 7f2d494ee700 1 -- 172.21.15.49:0/1286633159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d44160400 con 0x7f2d440b19b0 2023-07-21T22:12:41.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.691+0000 7f2d2b7fe700 1 -- 172.21.15.49:0/1286633159 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d34056050 con 0x7f2d440b19b0 2023-07-21T22:12:41.735 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:12:41.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.695+0000 7f2d494ee700 1 -- 172.21.15.49:0/1286633159 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2d300662f0 msgr2=0x7f2d300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.695+0000 7f2d494ee700 1 --2- 172.21.15.49:0/1286633159 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2d300662f0 0x7f2d300687a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d4415b420 tx=0x7f2d38007db0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.695+0000 7f2d494ee700 1 -- 172.21.15.49:0/1286633159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d440b19b0 msgr2=0x7f2d440c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.695+0000 7f2d494ee700 1 --2- 172.21.15.49:0/1286633159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d440b19b0 0x7f2d440c8a60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2d340090b0 tx=0x7f2d34004770 comp rx=0 tx=0).stop 2023-07-21T22:12:41.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.695+0000 7f2d494ee700 1 -- 172.21.15.49:0/1286633159 shutdown_connections 2023-07-21T22:12:41.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.695+0000 7f2d494ee700 1 --2- 172.21.15.49:0/1286633159 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2d300662f0 0x7f2d300687a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.695+0000 7f2d494ee700 1 --2- 172.21.15.49:0/1286633159 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d4415bf20 0x7f2d44155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.695+0000 7f2d494ee700 1 --2- 172.21.15.49:0/1286633159 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d440b4630 0x7f2d440c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.695+0000 7f2d494ee700 1 --2- 172.21.15.49:0/1286633159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d440b19b0 0x7f2d440c8a60 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.695+0000 7f2d494ee700 1 -- 172.21.15.49:0/1286633159 >> 172.21.15.49:0/1286633159 conn(0x7f2d440cef20 msgr2=0x7f2d4415e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:41.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.695+0000 7f2d494ee700 1 -- 172.21.15.49:0/1286633159 shutdown_connections 2023-07-21T22:12:41.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.695+0000 7f2d494ee700 1 -- 172.21.15.49:0/1286633159 wait complete. 2023-07-21T22:12:41.764 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-07-21T22:12:41.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.895+0000 7f9f07fff700 1 Processor -- start 2023-07-21T22:12:41.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.895+0000 7f9f07fff700 1 -- start start 2023-07-21T22:12:41.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f07fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f080cdcb0 0x7f9f0806d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f07fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9f0815a1e0 0x7f9f0815a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f07fff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f08159fc0 con 0x7f9f080b0c00 2023-07-21T22:12:41.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f07fff700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f08159a00 con 0x7f9f080cdcb0 2023-07-21T22:12:41.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f07fff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f08159ce0 con 0x7f9f0815a1e0 2023-07-21T22:12:41.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f067fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f080cdcb0 0x7f9f0806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f067fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f080cdcb0 0x7f9f0806d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39600/0 (socket says 172.21.15.49:39600) 2023-07-21T22:12:41.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f067fc700 1 -- 172.21.15.49:0/3659059026 learned_addr learned my addr 172.21.15.49:0/3659059026 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:41.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f077fe700 1 --2- 172.21.15.49:0/3659059026 >> v2:172.21.15.150:3300/0 conn(0x7f9f0815a1e0 0x7f9f0815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f067fc700 1 -- 172.21.15.49:0/3659059026 >> v2:172.21.15.150:3300/0 conn(0x7f9f0815a1e0 msgr2=0x7f9f0815a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:41.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f067fc700 1 --2- 172.21.15.49:0/3659059026 >> v2:172.21.15.150:3300/0 conn(0x7f9f0815a1e0 0x7f9f0815a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f067fc700 1 -- 172.21.15.49:0/3659059026 >> v1:172.21.15.150:6789/0 conn(0x7f9f080b0c00 legacy=0x7f9f080b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f067fc700 1 -- 172.21.15.49:0/3659059026 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0806cf50 con 0x7f9f080cdcb0 2023-07-21T22:12:41.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f077fe700 1 --2- 172.21.15.49:0/3659059026 >> v2:172.21.15.150:3300/0 conn(0x7f9f0815a1e0 0x7f9f0815a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:41.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f05ffb700 1 -- 172.21.15.49:0/3659059026 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433792573 0 0) 0x7f9f08159fc0 con 0x7f9f080b0c00 2023-07-21T22:12:41.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f067fc700 1 --2- 172.21.15.49:0/3659059026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f080cdcb0 0x7f9f0806d750 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9f080ccbc0 tx=0x7f9efc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed7dab21f5266b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:41.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f05ffb700 1 -- 172.21.15.49:0/3659059026 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00b8a0 con 0x7f9f080cdcb0 2023-07-21T22:12:41.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f05ffb700 1 -- 172.21.15.49:0/3659059026 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc00ba00 con 0x7f9f080cdcb0 2023-07-21T22:12:41.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.899+0000 7f9f05ffb700 1 -- 172.21.15.49:0/3659059026 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00bd90 con 0x7f9f080cdcb0 2023-07-21T22:12:41.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.903+0000 7f9f07fff700 1 -- 172.21.15.49:0/3659059026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f080cdcb0 msgr2=0x7f9f0806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.903+0000 7f9f07fff700 1 --2- 172.21.15.49:0/3659059026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f080cdcb0 0x7f9f0806d750 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9f080ccbc0 tx=0x7f9efc009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.903+0000 7f9f07fff700 1 -- 172.21.15.49:0/3659059026 shutdown_connections 2023-07-21T22:12:41.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.903+0000 7f9f07fff700 1 --2- 172.21.15.49:0/3659059026 >> v2:172.21.15.150:3300/0 conn(0x7f9f0815a1e0 0x7f9f0815a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.903+0000 7f9f07fff700 1 --2- 172.21.15.49:0/3659059026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f080cdcb0 0x7f9f0806d750 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.903+0000 7f9f07fff700 1 -- 172.21.15.49:0/3659059026 >> 172.21.15.49:0/3659059026 conn(0x7f9f0806fa70 msgr2=0x7f9f0806fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:41.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.903+0000 7f9f07fff700 1 -- 172.21.15.49:0/3659059026 shutdown_connections 2023-07-21T22:12:41.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.903+0000 7f9f07fff700 1 -- 172.21.15.49:0/3659059026 wait complete. 2023-07-21T22:12:41.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.903+0000 7f9f07fff700 1 Processor -- start 2023-07-21T22:12:41.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f07fff700 1 -- start start 2023-07-21T22:12:41.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f07fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f080b0c00 0x7f9f08139430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f07fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f080cdcb0 0x7f9f080cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f07fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0815a1e0 0x7f9f080c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f07fff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f080cbea0 con 0x7f9f080cdcb0 2023-07-21T22:12:41.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f07fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f081f2370 con 0x7f9f0815a1e0 2023-07-21T22:12:41.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f07fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f081f2650 con 0x7f9f080b0c00 2023-07-21T22:12:41.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f067fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f080cdcb0 0x7f9f080cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f067fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f080cdcb0 0x7f9f080cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39612/0 (socket says 172.21.15.49:39612) 2023-07-21T22:12:41.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f067fc700 1 -- 172.21.15.49:0/2157272948 learned_addr learned my addr 172.21.15.49:0/2157272948 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:41.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f06ffd700 1 --2- 172.21.15.49:0/2157272948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f080b0c00 0x7f9f08139430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f077fe700 1 --2- 172.21.15.49:0/2157272948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0815a1e0 0x7f9f080c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f067fc700 1 -- 172.21.15.49:0/2157272948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f080b0c00 msgr2=0x7f9f08139430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f067fc700 1 --2- 172.21.15.49:0/2157272948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f080b0c00 0x7f9f08139430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f067fc700 1 -- 172.21.15.49:0/2157272948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0815a1e0 msgr2=0x7f9f080c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:41.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f067fc700 1 --2- 172.21.15.49:0/2157272948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0815a1e0 0x7f9f080c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:41.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f067fc700 1 -- 172.21.15.49:0/2157272948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc009570 con 0x7f9f080cdcb0 2023-07-21T22:12:41.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.907+0000 7f9f067fc700 1 --2- 172.21.15.49:0/2157272948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f080cdcb0 0x7f9f080cc180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9f0806c7b0 tx=0x7f9efc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:41.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.911+0000 7f9eef7fe700 1 -- 172.21.15.49:0/2157272948 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0038c0 con 0x7f9f080cdcb0 2023-07-21T22:12:41.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.911+0000 7f9eef7fe700 1 -- 172.21.15.49:0/2157272948 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc01f070 con 0x7f9f080cdcb0 2023-07-21T22:12:41.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.911+0000 7f9f07fff700 1 -- 172.21.15.49:0/2157272948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f081f2930 con 0x7f9f080cdcb0 2023-07-21T22:12:41.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.911+0000 7f9eef7fe700 1 -- 172.21.15.49:0/2157272948 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc003c60 con 0x7f9f080cdcb0 2023-07-21T22:12:41.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.911+0000 7f9f07fff700 1 -- 172.21.15.49:0/2157272948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f081f2ef0 con 0x7f9f080cdcb0 2023-07-21T22:12:41.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.911+0000 7f9f07fff700 1 -- 172.21.15.49:0/2157272948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f08072a50 con 0x7f9f080cdcb0 2023-07-21T22:12:41.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.911+0000 7f9eef7fe700 1 -- 172.21.15.49:0/2157272948 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9efc01a430 con 0x7f9f080cdcb0 2023-07-21T22:12:41.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.915+0000 7f9eef7fe700 1 --2- 172.21.15.49:0/2157272948 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ef40662f0 0x7f9ef40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:41.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.915+0000 7f9eef7fe700 1 -- 172.21.15.49:0/2157272948 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f9efc021070 con 0x7f9f080cdcb0 2023-07-21T22:12:41.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.915+0000 7f9f06ffd700 1 --2- 172.21.15.49:0/2157272948 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ef40662f0 0x7f9ef40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:41.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.915+0000 7f9f06ffd700 1 --2- 172.21.15.49:0/2157272948 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ef40662f0 0x7f9ef40687a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8000f60 tx=0x7f9ef8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:41.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:41.919+0000 7f9eef7fe700 1 -- 172.21.15.49:0/2157272948 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9efc052900 con 0x7f9f080cdcb0 2023-07-21T22:12:42.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.095+0000 7f9f07fff700 1 -- 172.21.15.49:0/2157272948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f9f0804dcb0 con 0x7f9f080cdcb0 2023-07-21T22:12:42.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.099+0000 7f9eef7fe700 1 -- 172.21.15.49:0/2157272948 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v47) v1 ==== 97+0+11 (secure 0 0 0) 0x7f9efc055f20 con 0x7f9f080cdcb0 2023-07-21T22:12:42.143 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:12:42.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.103+0000 7f9f07fff700 1 -- 172.21.15.49:0/2157272948 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ef40662f0 msgr2=0x7f9ef40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:42.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.103+0000 7f9f07fff700 1 --2- 172.21.15.49:0/2157272948 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ef40662f0 0x7f9ef40687a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8000f60 tx=0x7f9ef8009040 comp rx=0 tx=0).stop 2023-07-21T22:12:42.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.103+0000 7f9f07fff700 1 -- 172.21.15.49:0/2157272948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f080cdcb0 msgr2=0x7f9f080cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:42.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.103+0000 7f9f07fff700 1 --2- 172.21.15.49:0/2157272948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f080cdcb0 0x7f9f080cc180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9f0806c7b0 tx=0x7f9efc004770 comp rx=0 tx=0).stop 2023-07-21T22:12:42.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.103+0000 7f9f07fff700 1 -- 172.21.15.49:0/2157272948 shutdown_connections 2023-07-21T22:12:42.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.103+0000 7f9f07fff700 1 --2- 172.21.15.49:0/2157272948 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ef40662f0 0x7f9ef40687a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.103+0000 7f9f07fff700 1 --2- 172.21.15.49:0/2157272948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f080cdcb0 0x7f9f080cc180 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.103+0000 7f9f07fff700 1 --2- 172.21.15.49:0/2157272948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0815a1e0 0x7f9f080c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.103+0000 7f9f07fff700 1 --2- 172.21.15.49:0/2157272948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f080b0c00 0x7f9f08139430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.103+0000 7f9f07fff700 1 -- 172.21.15.49:0/2157272948 >> 172.21.15.49:0/2157272948 conn(0x7f9f0806fa70 msgr2=0x7f9f080b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:42.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.103+0000 7f9f07fff700 1 -- 172.21.15.49:0/2157272948 shutdown_connections 2023-07-21T22:12:42.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.103+0000 7f9f07fff700 1 -- 172.21.15.49:0/2157272948 wait complete. 2023-07-21T22:12:42.170 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:12:42.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.303+0000 7f170c620700 1 Processor -- start 2023-07-21T22:12:42.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.303+0000 7f170c620700 1 -- start start 2023-07-21T22:12:42.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.303+0000 7f170c620700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17040cdd50 0x7f17040ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:42.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.303+0000 7f170c620700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f17040ce790 0x7f17040d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:42.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.303+0000 7f170c620700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17040b8680 con 0x7f17040ce240 2023-07-21T22:12:42.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.303+0000 7f170c620700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17040d3500 con 0x7f17040ce790 2023-07-21T22:12:42.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.303+0000 7f170c620700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17040d2fa0 con 0x7f17040cdd50 2023-07-21T22:12:42.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.303+0000 7f170abbd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f17040ce240 0x7f17040cf330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34530/0 (socket says 172.21.15.49:34530) 2023-07-21T22:12:42.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.303+0000 7f170abbd700 1 -- 172.21.15.49:0/726166500 learned_addr learned my addr 172.21.15.49:0/726166500 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:42.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.303+0000 7f1709bbb700 1 --2- 172.21.15.49:0/726166500 >> v2:172.21.15.150:3300/0 conn(0x7f17040ce790 0x7f17040d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:42.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.303+0000 7f170a3bc700 1 --2- 172.21.15.49:0/726166500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17040cdd50 0x7f17040ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:42.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f17093ba700 1 -- 172.21.15.49:0/726166500 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484345740 0 0) 0x7f17040b8680 con 0x7f17040ce240 2023-07-21T22:12:42.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f17093ba700 1 -- 172.21.15.49:0/726166500 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16f00035d0 con 0x7f17040ce240 2023-07-21T22:12:42.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f1709bbb700 1 -- 172.21.15.49:0/726166500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17040cdd50 msgr2=0x7f17040ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:42.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f1709bbb700 1 --2- 172.21.15.49:0/726166500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17040cdd50 0x7f17040ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f1709bbb700 1 -- 172.21.15.49:0/726166500 >> v1:172.21.15.49:6789/0 conn(0x7f17040ce240 legacy=0x7f17040cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:42.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f1709bbb700 1 -- 172.21.15.49:0/726166500 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17040b6290 con 0x7f17040ce790 2023-07-21T22:12:42.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f170a3bc700 1 --2- 172.21.15.49:0/726166500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17040cdd50 0x7f17040ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:42.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f1709bbb700 1 --2- 172.21.15.49:0/726166500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17040ce790 0x7f17040d0470 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009850 tx=0x7f16f4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0e6577ee160cc2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:42.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f17093ba700 1 -- 172.21.15.49:0/726166500 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4011830 con 0x7f17040ce790 2023-07-21T22:12:42.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f17093ba700 1 -- 172.21.15.49:0/726166500 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f4011990 con 0x7f17040ce790 2023-07-21T22:12:42.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f17093ba700 1 -- 172.21.15.49:0/726166500 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4011d40 con 0x7f17040ce790 2023-07-21T22:12:42.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f170c620700 1 -- 172.21.15.49:0/726166500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17040ce790 msgr2=0x7f17040d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:42.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f170c620700 1 --2- 172.21.15.49:0/726166500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17040ce790 0x7f17040d0470 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009850 tx=0x7f16f4009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:42.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f170c620700 1 -- 172.21.15.49:0/726166500 shutdown_connections 2023-07-21T22:12:42.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f170c620700 1 --2- 172.21.15.49:0/726166500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17040ce790 0x7f17040d0470 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f170c620700 1 --2- 172.21.15.49:0/726166500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17040cdd50 0x7f17040ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f170c620700 1 -- 172.21.15.49:0/726166500 >> 172.21.15.49:0/726166500 conn(0x7f17040b55e0 msgr2=0x7f17040b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:42.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f170c620700 1 -- 172.21.15.49:0/726166500 shutdown_connections 2023-07-21T22:12:42.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.307+0000 7f170c620700 1 -- 172.21.15.49:0/726166500 wait complete. 2023-07-21T22:12:42.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.311+0000 7f170c620700 1 Processor -- start 2023-07-21T22:12:42.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.311+0000 7f170c620700 1 -- start start 2023-07-21T22:12:42.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170c620700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17040cdd50 0x7f1704153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:42.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170c620700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17040ce240 0x7f17041f1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:42.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170c620700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17040ce790 0x7f1704158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:42.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170c620700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170415ca60 con 0x7f17040cdd50 2023-07-21T22:12:42.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170c620700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1704154300 con 0x7f17040ce790 2023-07-21T22:12:42.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170c620700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170415c710 con 0x7f17040ce240 2023-07-21T22:12:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170a3bc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17040cdd50 0x7f1704153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170a3bc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17040cdd50 0x7f1704153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39628/0 (socket says 172.21.15.49:39628) 2023-07-21T22:12:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170a3bc700 1 -- 172.21.15.49:0/953771096 learned_addr learned my addr 172.21.15.49:0/953771096 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f1709bbb700 1 --2- 172.21.15.49:0/953771096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17040ce240 0x7f17041f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170abbd700 1 --2- 172.21.15.49:0/953771096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17040ce790 0x7f1704158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:42.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170a3bc700 1 -- 172.21.15.49:0/953771096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17040ce240 msgr2=0x7f17041f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:42.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170a3bc700 1 --2- 172.21.15.49:0/953771096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17040ce240 0x7f17041f1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170a3bc700 1 -- 172.21.15.49:0/953771096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17040ce790 msgr2=0x7f1704158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:42.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170a3bc700 1 --2- 172.21.15.49:0/953771096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17040ce790 0x7f1704158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170a3bc700 1 -- 172.21.15.49:0/953771096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700009450 con 0x7f17040cdd50 2023-07-21T22:12:42.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170a3bc700 1 --2- 172.21.15.49:0/953771096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17040cdd50 0x7f1704153dc0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f170000ec10 tx=0x7f1700009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:42.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f16faffd700 1 -- 172.21.15.49:0/953771096 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700005a40 con 0x7f17040cdd50 2023-07-21T22:12:42.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f16faffd700 1 -- 172.21.15.49:0/953771096 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1700005ba0 con 0x7f17040cdd50 2023-07-21T22:12:42.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170c620700 1 -- 172.21.15.49:0/953771096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f40094b0 con 0x7f17040cdd50 2023-07-21T22:12:42.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f16faffd700 1 -- 172.21.15.49:0/953771096 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170000c940 con 0x7f17040cdd50 2023-07-21T22:12:42.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.315+0000 7f170c620700 1 -- 172.21.15.49:0/953771096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17041f1ff0 con 0x7f17040cdd50 2023-07-21T22:12:42.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.319+0000 7f170c620700 1 -- 172.21.15.49:0/953771096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170404dcb0 con 0x7f17040cdd50 2023-07-21T22:12:42.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.319+0000 7f16faffd700 1 -- 172.21.15.49:0/953771096 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f170000caa0 con 0x7f17040cdd50 2023-07-21T22:12:42.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.323+0000 7f16faffd700 1 --2- 172.21.15.49:0/953771096 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f16e80662f0 0x7f16e80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:42.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.323+0000 7f16faffd700 1 -- 172.21.15.49:0/953771096 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f1700084400 con 0x7f17040cdd50 2023-07-21T22:12:42.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.323+0000 7f1709bbb700 1 --2- 172.21.15.49:0/953771096 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f16e80662f0 0x7f16e80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:42.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.323+0000 7f1709bbb700 1 --2- 172.21.15.49:0/953771096 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f16e80662f0 0x7f16e80687a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f16f40090b0 tx=0x7f16f4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:42.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.327+0000 7f16faffd700 1 -- 172.21.15.49:0/953771096 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1700054fa0 con 0x7f17040cdd50 2023-07-21T22:12:42.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.515+0000 7f170c620700 1 -- 172.21.15.49:0/953771096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f17040b8090 con 0x7f17040cdd50 2023-07-21T22:12:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.515+0000 7f16faffd700 1 -- 172.21.15.49:0/953771096 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1700054b30 con 0x7f17040cdd50 2023-07-21T22:12:42.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.519+0000 7f170c620700 1 -- 172.21.15.49:0/953771096 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f16e80662f0 msgr2=0x7f16e80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:42.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.519+0000 7f170c620700 1 --2- 172.21.15.49:0/953771096 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f16e80662f0 0x7f16e80687a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f16f40090b0 tx=0x7f16f4008030 comp rx=0 tx=0).stop 2023-07-21T22:12:42.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.519+0000 7f170c620700 1 -- 172.21.15.49:0/953771096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17040cdd50 msgr2=0x7f1704153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:42.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.519+0000 7f170c620700 1 --2- 172.21.15.49:0/953771096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17040cdd50 0x7f1704153dc0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f170000ec10 tx=0x7f1700009ec0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.519+0000 7f170c620700 1 -- 172.21.15.49:0/953771096 shutdown_connections 2023-07-21T22:12:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.519+0000 7f170c620700 1 --2- 172.21.15.49:0/953771096 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f16e80662f0 0x7f16e80687a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.519+0000 7f170c620700 1 --2- 172.21.15.49:0/953771096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17040ce790 0x7f1704158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.519+0000 7f170c620700 1 --2- 172.21.15.49:0/953771096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17040ce240 0x7f17041f1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.519+0000 7f170c620700 1 --2- 172.21.15.49:0/953771096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17040cdd50 0x7f1704153dc0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.519+0000 7f170c620700 1 -- 172.21.15.49:0/953771096 >> 172.21.15.49:0/953771096 conn(0x7f17040b55e0 msgr2=0x7f17040b6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.519+0000 7f170c620700 1 -- 172.21.15.49:0/953771096 shutdown_connections 2023-07-21T22:12:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.519+0000 7f170c620700 1 -- 172.21.15.49:0/953771096 wait complete. 2023-07-21T22:12:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:12:42.584 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:12:42.585 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:12:42.605 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:12:42.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.775+0000 7f697359e700 1 Processor -- start 2023-07-21T22:12:42.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.775+0000 7f697359e700 1 -- start start 2023-07-21T22:12:42.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f697359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69740cafb0 0x7f69740cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:42.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f697359e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69740cab20 con 0x7f697406d380 2023-07-21T22:12:42.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f697359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69740ca1f0 con 0x7f6974071c70 2023-07-21T22:12:42.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f697359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69740c9e80 con 0x7f69740cafb0 2023-07-21T22:12:42.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f697259c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f697406d380 0x7f697406d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34536/0 (socket says 172.21.15.49:34536) 2023-07-21T22:12:42.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f697259c700 1 -- 172.21.15.49:0/2917134876 learned_addr learned my addr 172.21.15.49:0/2917134876 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:42.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f6972d9d700 1 --2- 172.21.15.49:0/2917134876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69740cafb0 0x7f69740cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:42.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f6971d9b700 1 -- 172.21.15.49:0/2917134876 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750117218 0 0) 0x7f69740cab20 con 0x7f697406d380 2023-07-21T22:12:42.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f6971d9b700 1 -- 172.21.15.49:0/2917134876 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69540035d0 con 0x7f697406d380 2023-07-21T22:12:42.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f6971d9b700 1 -- 172.21.15.49:0/2917134876 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076003147 0 0) 0x7f69740ca1f0 con 0x7f6974071c70 2023-07-21T22:12:42.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f6971d9b700 1 -- 172.21.15.49:0/2917134876 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69740cab20 con 0x7f6974071c70 2023-07-21T22:12:42.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f6972d9d700 1 -- 172.21.15.49:0/2917134876 >> v1:172.21.15.150:6789/0 conn(0x7f6974071c70 legacy=0x7f69740b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:42.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f6972d9d700 1 -- 172.21.15.49:0/2917134876 >> v1:172.21.15.49:6789/0 conn(0x7f697406d380 legacy=0x7f697406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:42.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f6972d9d700 1 -- 172.21.15.49:0/2917134876 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69740ca4d0 con 0x7f69740cafb0 2023-07-21T22:12:42.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f6972d9d700 1 --2- 172.21.15.49:0/2917134876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69740cafb0 0x7f69740cb430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f696c009dc0 tx=0x7f696c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7037c52dfa0744a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:42.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.779+0000 7f6971d9b700 1 -- 172.21.15.49:0/2917134876 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c00e070 con 0x7f69740cafb0 2023-07-21T22:12:42.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.783+0000 7f6971d9b700 1 -- 172.21.15.49:0/2917134876 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c00bb20 con 0x7f69740cafb0 2023-07-21T22:12:42.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.783+0000 7f6971d9b700 1 -- 172.21.15.49:0/2917134876 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c012430 con 0x7f69740cafb0 2023-07-21T22:12:42.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.783+0000 7f697359e700 1 -- 172.21.15.49:0/2917134876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69740cafb0 msgr2=0x7f69740cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:42.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.783+0000 7f697359e700 1 --2- 172.21.15.49:0/2917134876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69740cafb0 0x7f69740cb430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f696c009dc0 tx=0x7f696c00b330 comp rx=0 tx=0).stop 2023-07-21T22:12:42.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.783+0000 7f697359e700 1 -- 172.21.15.49:0/2917134876 shutdown_connections 2023-07-21T22:12:42.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.783+0000 7f697359e700 1 --2- 172.21.15.49:0/2917134876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69740cafb0 0x7f69740cb430 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.783+0000 7f697359e700 1 -- 172.21.15.49:0/2917134876 >> 172.21.15.49:0/2917134876 conn(0x7f6974070450 msgr2=0x7f6974070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:42.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.783+0000 7f697359e700 1 -- 172.21.15.49:0/2917134876 shutdown_connections 2023-07-21T22:12:42.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.783+0000 7f697359e700 1 -- 172.21.15.49:0/2917134876 wait complete. 2023-07-21T22:12:42.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f697359e700 1 Processor -- start 2023-07-21T22:12:42.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f697359e700 1 -- start start 2023-07-21T22:12:42.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f697359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f697406d380 0x7f6974155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:42.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f697359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6974071c70 0x7f6974155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:42.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f697359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69740cafb0 0x7f69740afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:42.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f697359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69741eeda0 con 0x7f6974071c70 2023-07-21T22:12:42.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f697359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697415c360 con 0x7f697406d380 2023-07-21T22:12:42.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f697359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697415c640 con 0x7f69740cafb0 2023-07-21T22:12:42.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f6969d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6974071c70 0x7f6974155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:42.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f6969d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6974071c70 0x7f6974155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39634/0 (socket says 172.21.15.49:39634) 2023-07-21T22:12:42.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f6969d9b700 1 -- 172.21.15.49:0/959730006 learned_addr learned my addr 172.21.15.49:0/959730006 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:42.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f697259c700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f697406d380 0x7f6974155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:42.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f6972d9d700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69740cafb0 0x7f69740afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:42.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f6969d9b700 1 -- 172.21.15.49:0/959730006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69740cafb0 msgr2=0x7f69740afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:42.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f6969d9b700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69740cafb0 0x7f69740afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f6969d9b700 1 -- 172.21.15.49:0/959730006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f697406d380 msgr2=0x7f6974155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:42.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f6969d9b700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f697406d380 0x7f6974155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:42.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f6969d9b700 1 -- 172.21.15.49:0/959730006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c009a70 con 0x7f6974071c70 2023-07-21T22:12:42.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f6972d9d700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69740cafb0 0x7f69740afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:42.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.787+0000 7f697259c700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f697406d380 0x7f6974155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:42.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.791+0000 7f6969d9b700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6974071c70 0x7f6974155b30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f695c00c730 tx=0x7f695c00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:42.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.791+0000 7f696b7fe700 1 -- 172.21.15.49:0/959730006 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0052d0 con 0x7f6974071c70 2023-07-21T22:12:42.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.791+0000 7f696b7fe700 1 -- 172.21.15.49:0/959730006 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c005430 con 0x7f6974071c70 2023-07-21T22:12:42.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.791+0000 7f696b7fe700 1 -- 172.21.15.49:0/959730006 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0055a0 con 0x7f6974071c70 2023-07-21T22:12:42.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.791+0000 7f697359e700 1 -- 172.21.15.49:0/959730006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697415c920 con 0x7f6974071c70 2023-07-21T22:12:42.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.791+0000 7f697359e700 1 -- 172.21.15.49:0/959730006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6974155770 con 0x7f6974071c70 2023-07-21T22:12:42.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.791+0000 7f697359e700 1 -- 172.21.15.49:0/959730006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69740c5520 con 0x7f6974071c70 2023-07-21T22:12:42.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.795+0000 7f696b7fe700 1 -- 172.21.15.49:0/959730006 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f695c0038e0 con 0x7f6974071c70 2023-07-21T22:12:42.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.795+0000 7f696b7fe700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f69580662f0 0x7f69580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:42.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.795+0000 7f696b7fe700 1 -- 172.21.15.49:0/959730006 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f695c083550 con 0x7f6974071c70 2023-07-21T22:12:42.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.795+0000 7f697259c700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f69580662f0 0x7f69580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:42.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.799+0000 7f697259c700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f69580662f0 0x7f69580687a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f69640011e0 tx=0x7f6964009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:42.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.803+0000 7f696b7fe700 1 -- 172.21.15.49:0/959730006 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69740c5520 con 0x7f6974071c70 2023-07-21T22:12:43.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.979+0000 7f697359e700 1 -- 172.21.15.49:0/959730006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69740c5520 con 0x7f6974071c70 2023-07-21T22:12:43.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.983+0000 7f696b7fe700 1 -- 172.21.15.49:0/959730006 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+20239 (secure 0 0 0) 0x7f69740c5520 con 0x7f6974071c70 2023-07-21T22:12:43.028 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:43.028 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":47,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:12:39.024259+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:12:20.014383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T22:12:21.059436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"data_new","create_time":"2023-07-21T22:12:36.491357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:12:43.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.983+0000 7f697359e700 1 -- 172.21.15.49:0/959730006 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f69580662f0 msgr2=0x7f69580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.983+0000 7f697359e700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f69580662f0 0x7f69580687a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f69640011e0 tx=0x7f6964009040 comp rx=0 tx=0).stop 2023-07-21T22:12:43.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.983+0000 7f697359e700 1 -- 172.21.15.49:0/959730006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6974071c70 msgr2=0x7f6974155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.983+0000 7f697359e700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6974071c70 0x7f6974155b30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f695c00c730 tx=0x7f695c00caf0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.983+0000 7f697359e700 1 -- 172.21.15.49:0/959730006 shutdown_connections 2023-07-21T22:12:43.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.983+0000 7f697359e700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f69580662f0 0x7f69580687a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.987+0000 7f697359e700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6974071c70 0x7f6974155b30 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.987+0000 7f697359e700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69740cafb0 0x7f69740afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.987+0000 7f697359e700 1 --2- 172.21.15.49:0/959730006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f697406d380 0x7f6974155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.987+0000 7f697359e700 1 -- 172.21.15.49:0/959730006 >> 172.21.15.49:0/959730006 conn(0x7f6974070450 msgr2=0x7f69740b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:43.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.987+0000 7f697359e700 1 -- 172.21.15.49:0/959730006 shutdown_connections 2023-07-21T22:12:43.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:42.987+0000 7f697359e700 1 -- 172.21.15.49:0/959730006 wait complete. 2023-07-21T22:12:43.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:12:20.014383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:12:21.059436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'data_new', 'create_time': '2023-07-21T22:12:36.491357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:12:43.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:12:43.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.195+0000 7fec30e3b700 1 Processor -- start 2023-07-21T22:12:43.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.195+0000 7fec30e3b700 1 -- start start 2023-07-21T22:12:43.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.195+0000 7fec30e3b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec2c159e50 0x7fec2c0ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:43.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.195+0000 7fec30e3b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fec2c0ce550 0x7fec2c15e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:43.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.195+0000 7fec30e3b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c08a5a0 con 0x7fec2c0af410 2023-07-21T22:12:43.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.195+0000 7fec30e3b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2c0ce9d0 con 0x7fec2c159e50 2023-07-21T22:12:43.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec30e3b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2c0adfc0 con 0x7fec2c0ce550 2023-07-21T22:12:43.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec2a59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec2c159e50 0x7fec2c0ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:43.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec2a59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec2c159e50 0x7fec2c0ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39650/0 (socket says 172.21.15.49:39650) 2023-07-21T22:12:43.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec2a59c700 1 -- 172.21.15.49:0/884307522 learned_addr learned my addr 172.21.15.49:0/884307522 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:43.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec2ad9d700 1 --2- 172.21.15.49:0/884307522 >> v2:172.21.15.150:3300/0 conn(0x7fec2c0ce550 0x7fec2c15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:43.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec2a59c700 1 -- 172.21.15.49:0/884307522 >> v2:172.21.15.150:3300/0 conn(0x7fec2c0ce550 msgr2=0x7fec2c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:43.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec2a59c700 1 --2- 172.21.15.49:0/884307522 >> v2:172.21.15.150:3300/0 conn(0x7fec2c0ce550 0x7fec2c15e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec2a59c700 1 -- 172.21.15.49:0/884307522 >> v1:172.21.15.150:6789/0 conn(0x7fec2c0af410 legacy=0x7fec2c15d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec2a59c700 1 -- 172.21.15.49:0/884307522 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c15a220 con 0x7fec2c159e50 2023-07-21T22:12:43.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec2a59c700 1 --2- 172.21.15.49:0/884307522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec2c159e50 0x7fec2c0ce010 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fec2c06d410 tx=0x7fec1c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbffb209300827df server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:43.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec2959a700 1 -- 172.21.15.49:0/884307522 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c005e50 con 0x7fec2c159e50 2023-07-21T22:12:43.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec2959a700 1 -- 172.21.15.49:0/884307522 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c006030 con 0x7fec2c159e50 2023-07-21T22:12:43.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec2959a700 1 -- 172.21.15.49:0/884307522 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c0063c0 con 0x7fec2c159e50 2023-07-21T22:12:43.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec30e3b700 1 -- 172.21.15.49:0/884307522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec2c159e50 msgr2=0x7fec2c0ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec30e3b700 1 --2- 172.21.15.49:0/884307522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec2c159e50 0x7fec2c0ce010 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fec2c06d410 tx=0x7fec1c009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec30e3b700 1 -- 172.21.15.49:0/884307522 shutdown_connections 2023-07-21T22:12:43.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec30e3b700 1 --2- 172.21.15.49:0/884307522 >> v2:172.21.15.150:3300/0 conn(0x7fec2c0ce550 0x7fec2c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec30e3b700 1 --2- 172.21.15.49:0/884307522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec2c159e50 0x7fec2c0ce010 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec30e3b700 1 -- 172.21.15.49:0/884307522 >> 172.21.15.49:0/884307522 conn(0x7fec2c089fe0 msgr2=0x7fec2c0d0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:43.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec30e3b700 1 -- 172.21.15.49:0/884307522 shutdown_connections 2023-07-21T22:12:43.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.199+0000 7fec30e3b700 1 -- 172.21.15.49:0/884307522 wait complete. 2023-07-21T22:12:43.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.203+0000 7fec30e3b700 1 Processor -- start 2023-07-21T22:12:43.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.203+0000 7fec30e3b700 1 -- start start 2023-07-21T22:12:43.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec30e3b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec2c0af410 0x7fec2c1552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:43.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec30e3b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec2c0ce550 0x7fec2c0c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:43.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec30e3b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec2c159e50 0x7fec2c0c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:43.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec30e3b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0cdab0 con 0x7fec2c0ce550 2023-07-21T22:12:43.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec30e3b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0b38e0 con 0x7fec2c159e50 2023-07-21T22:12:43.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec30e3b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0c8cc0 con 0x7fec2c0af410 2023-07-21T22:12:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec29d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec2c0ce550 0x7fec2c0c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec29d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec2c0ce550 0x7fec2c0c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39652/0 (socket says 172.21.15.49:39652) 2023-07-21T22:12:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec29d9b700 1 -- 172.21.15.49:0/3321447464 learned_addr learned my addr 172.21.15.49:0/3321447464 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec2ad9d700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec2c159e50 0x7fec2c0c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec2a59c700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec2c0af410 0x7fec2c1552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec29d9b700 1 -- 172.21.15.49:0/3321447464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec2c0af410 msgr2=0x7fec2c1552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec29d9b700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec2c0af410 0x7fec2c1552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec29d9b700 1 -- 172.21.15.49:0/3321447464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec2c159e50 msgr2=0x7fec2c0c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec29d9b700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec2c159e50 0x7fec2c0c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec29d9b700 1 -- 172.21.15.49:0/3321447464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c009520 con 0x7fec2c0ce550 2023-07-21T22:12:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec2ad9d700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec2c159e50 0x7fec2c0c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec29d9b700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec2c0ce550 0x7fec2c0c9470 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fec2000c4f0 tx=0x7fec2000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec1affd700 1 -- 172.21.15.49:0/3321447464 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec200052d0 con 0x7fec2c0ce550 2023-07-21T22:12:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec1affd700 1 -- 172.21.15.49:0/3321447464 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec20005430 con 0x7fec2c0ce550 2023-07-21T22:12:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec30e3b700 1 -- 172.21.15.49:0/3321447464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c0c8fa0 con 0x7fec2c0ce550 2023-07-21T22:12:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec1affd700 1 -- 172.21.15.49:0/3321447464 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec20003930 con 0x7fec2c0ce550 2023-07-21T22:12:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.207+0000 7fec30e3b700 1 -- 172.21.15.49:0/3321447464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c0b3570 con 0x7fec2c0ce550 2023-07-21T22:12:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.211+0000 7fec30e3b700 1 -- 172.21.15.49:0/3321447464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2c04dd50 con 0x7fec2c0ce550 2023-07-21T22:12:43.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.211+0000 7fec1affd700 1 -- 172.21.15.49:0/3321447464 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec20003a90 con 0x7fec2c0ce550 2023-07-21T22:12:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.215+0000 7fec1affd700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec0c066320 0x7fec0c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.215+0000 7fec1affd700 1 -- 172.21.15.49:0/3321447464 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fec20083420 con 0x7fec2c0ce550 2023-07-21T22:12:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.215+0000 7fec2a59c700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec0c066320 0x7fec0c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.215+0000 7fec2a59c700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec0c066320 0x7fec0c0687d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fec1c013040 tx=0x7fec1c008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.219+0000 7fec1affd700 1 -- 172.21.15.49:0/3321447464 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec20050530 con 0x7fec2c0ce550 2023-07-21T22:12:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.391+0000 7fec30e3b700 1 -- 172.21.15.49:0/3321447464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec2c08a5a0 con 0x7fec2c0ce550 2023-07-21T22:12:43.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.395+0000 7fec1affd700 1 -- 172.21.15.49:0/3321447464 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec2c08a5a0 con 0x7fec2c0ce550 2023-07-21T22:12:43.440 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:12:43.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.395+0000 7fec30e3b700 1 -- 172.21.15.49:0/3321447464 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec0c066320 msgr2=0x7fec0c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.395+0000 7fec30e3b700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec0c066320 0x7fec0c0687d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fec1c013040 tx=0x7fec1c008070 comp rx=0 tx=0).stop 2023-07-21T22:12:43.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.395+0000 7fec30e3b700 1 -- 172.21.15.49:0/3321447464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec2c0ce550 msgr2=0x7fec2c0c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.395+0000 7fec30e3b700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec2c0ce550 0x7fec2c0c9470 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fec2000c4f0 tx=0x7fec2000c8b0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.395+0000 7fec30e3b700 1 -- 172.21.15.49:0/3321447464 shutdown_connections 2023-07-21T22:12:43.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.395+0000 7fec30e3b700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec0c066320 0x7fec0c0687d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.395+0000 7fec30e3b700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec2c0ce550 0x7fec2c0c9470 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.395+0000 7fec30e3b700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec2c159e50 0x7fec2c0c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.395+0000 7fec30e3b700 1 --2- 172.21.15.49:0/3321447464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec2c0af410 0x7fec2c1552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.395+0000 7fec30e3b700 1 -- 172.21.15.49:0/3321447464 >> 172.21.15.49:0/3321447464 conn(0x7fec2c089fe0 msgr2=0x7fec2c0b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:43.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.395+0000 7fec30e3b700 1 -- 172.21.15.49:0/3321447464 shutdown_connections 2023-07-21T22:12:43.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.395+0000 7fec30e3b700 1 -- 172.21.15.49:0/3321447464 wait complete. 2023-07-21T22:12:43.467 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:12:43.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.611+0000 7fa3c5434700 1 Processor -- start 2023-07-21T22:12:43.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.611+0000 7fa3c5434700 1 -- start start 2023-07-21T22:12:43.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3c5434700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3c00b4b20 0x7fa3c00cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:43.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3c5434700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c00b8170 con 0x7fa3c00b4040 2023-07-21T22:12:43.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3c5434700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c00d2350 con 0x7fa3c00d0810 2023-07-21T22:12:43.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3c5434700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c00cfa20 con 0x7fa3c00b4b20 2023-07-21T22:12:43.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3be7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3c00b4b20 0x7fa3c00cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:43.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3beffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa3c00b4040 0x7fa3c00b4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34542/0 (socket says 172.21.15.49:34542) 2023-07-21T22:12:43.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3beffd700 1 -- 172.21.15.49:0/1323172623 learned_addr learned my addr 172.21.15.49:0/1323172623 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:43.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3be7fc700 1 -- 172.21.15.49:0/1323172623 >> v1:172.21.15.150:6789/0 conn(0x7fa3c00d0810 legacy=0x7fa3c00d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3be7fc700 1 -- 172.21.15.49:0/1323172623 >> v1:172.21.15.49:6789/0 conn(0x7fa3c00b4040 legacy=0x7fa3c00b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3be7fc700 1 -- 172.21.15.49:0/1323172623 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c00cd370 con 0x7fa3c00b4b20 2023-07-21T22:12:43.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3be7fc700 1 --2- 172.21.15.49:0/1323172623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3c00b4b20 0x7fa3c00cf320 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009850 tx=0x7fa3b4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c157c58ccd7956ec server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:43.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3bdffb700 1 -- 172.21.15.49:0/1323172623 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4011830 con 0x7fa3c00b4b20 2023-07-21T22:12:43.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3bdffb700 1 -- 172.21.15.49:0/1323172623 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b4011990 con 0x7fa3c00b4b20 2023-07-21T22:12:43.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3bdffb700 1 -- 172.21.15.49:0/1323172623 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4011d20 con 0x7fa3c00b4b20 2023-07-21T22:12:43.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3c5434700 1 -- 172.21.15.49:0/1323172623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3c00b4b20 msgr2=0x7fa3c00cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3c5434700 1 --2- 172.21.15.49:0/1323172623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3c00b4b20 0x7fa3c00cf320 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009850 tx=0x7fa3b4009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:43.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3c5434700 1 -- 172.21.15.49:0/1323172623 shutdown_connections 2023-07-21T22:12:43.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3c5434700 1 --2- 172.21.15.49:0/1323172623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3c00b4b20 0x7fa3c00cf320 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3c5434700 1 -- 172.21.15.49:0/1323172623 >> 172.21.15.49:0/1323172623 conn(0x7fa3c00658e0 msgr2=0x7fa3c006fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:43.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3c5434700 1 -- 172.21.15.49:0/1323172623 shutdown_connections 2023-07-21T22:12:43.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.615+0000 7fa3c5434700 1 -- 172.21.15.49:0/1323172623 wait complete. 2023-07-21T22:12:43.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.619+0000 7fa3c5434700 1 Processor -- start 2023-07-21T22:12:43.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.619+0000 7fa3c5434700 1 -- start start 2023-07-21T22:12:43.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.619+0000 7fa3c5434700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3c00b4040 0x7fa3c0153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:43.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.619+0000 7fa3c5434700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3c00b4b20 0x7fa3c015eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:43.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.619+0000 7fa3c5434700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3c00d0810 0x7fa3c015eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:43.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.619+0000 7fa3c5434700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c015f650 con 0x7fa3c00d0810 2023-07-21T22:12:43.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.619+0000 7fa3c5434700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01f22c0 con 0x7fa3c00b4b20 2023-07-21T22:12:43.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.619+0000 7fa3c5434700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01f1500 con 0x7fa3c00b4040 2023-07-21T22:12:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.619+0000 7fa3bf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3c00d0810 0x7fa3c015eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.619+0000 7fa3bf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3c00d0810 0x7fa3c015eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39666/0 (socket says 172.21.15.49:39666) 2023-07-21T22:12:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.619+0000 7fa3bf7fe700 1 -- 172.21.15.49:0/3458203709 learned_addr learned my addr 172.21.15.49:0/3458203709 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.623+0000 7fa3be7fc700 1 --2- 172.21.15.49:0/3458203709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3c00b4b20 0x7fa3c015eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.623+0000 7fa3beffd700 1 --2- 172.21.15.49:0/3458203709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3c00b4040 0x7fa3c0153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.623+0000 7fa3bf7fe700 1 -- 172.21.15.49:0/3458203709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3c00b4040 msgr2=0x7fa3c0153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.623+0000 7fa3bf7fe700 1 --2- 172.21.15.49:0/3458203709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3c00b4040 0x7fa3c0153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.623+0000 7fa3bf7fe700 1 -- 172.21.15.49:0/3458203709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3c00b4b20 msgr2=0x7fa3c015eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.623+0000 7fa3bf7fe700 1 --2- 172.21.15.49:0/3458203709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3c00b4b20 0x7fa3c015eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.623+0000 7fa3bf7fe700 1 -- 172.21.15.49:0/3458203709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b40094b0 con 0x7fa3c00d0810 2023-07-21T22:12:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.623+0000 7fa3bf7fe700 1 --2- 172.21.15.49:0/3458203709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3c00d0810 0x7fa3c015eff0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800cbc0 tx=0x7fa3b800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.623+0000 7fa3a77fe700 1 -- 172.21.15.49:0/3458203709 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8003c20 con 0x7fa3c00d0810 2023-07-21T22:12:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.623+0000 7fa3a77fe700 1 -- 172.21.15.49:0/3458203709 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b8003d80 con 0x7fa3c00d0810 2023-07-21T22:12:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.623+0000 7fa3c5434700 1 -- 172.21.15.49:0/3458203709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c01f17e0 con 0x7fa3c00d0810 2023-07-21T22:12:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.623+0000 7fa3a77fe700 1 -- 172.21.15.49:0/3458203709 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800aa20 con 0x7fa3c00d0810 2023-07-21T22:12:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.623+0000 7fa3c5434700 1 -- 172.21.15.49:0/3458203709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c01f1da0 con 0x7fa3c00d0810 2023-07-21T22:12:43.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.623+0000 7fa3c5434700 1 -- 172.21.15.49:0/3458203709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c004dd50 con 0x7fa3c00d0810 2023-07-21T22:12:43.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.627+0000 7fa3a77fe700 1 -- 172.21.15.49:0/3458203709 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa3b800ab80 con 0x7fa3c00d0810 2023-07-21T22:12:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.627+0000 7fa3a77fe700 1 --2- 172.21.15.49:0/3458203709 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3ac0662f0 0x7fa3ac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.627+0000 7fa3a77fe700 1 -- 172.21.15.49:0/3458203709 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fa3b8083e90 con 0x7fa3c00d0810 2023-07-21T22:12:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.627+0000 7fa3beffd700 1 --2- 172.21.15.49:0/3458203709 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3ac0662f0 0x7fa3ac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.627+0000 7fa3beffd700 1 --2- 172.21.15.49:0/3458203709 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3ac0662f0 0x7fa3ac0687a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0005930 tx=0x7fa3b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:43.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.635+0000 7fa3a77fe700 1 -- 172.21.15.49:0/3458203709 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3b8051040 con 0x7fa3c00d0810 2023-07-21T22:12:43.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.811+0000 7fa3c5434700 1 -- 172.21.15.49:0/3458203709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa3c0153fe0 con 0x7fa3c00d0810 2023-07-21T22:12:43.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.811+0000 7fa3a77fe700 1 -- 172.21.15.49:0/3458203709 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa3b8054660 con 0x7fa3c00d0810 2023-07-21T22:12:43.857 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:12:43.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.815+0000 7fa3c5434700 1 -- 172.21.15.49:0/3458203709 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3ac0662f0 msgr2=0x7fa3ac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.815+0000 7fa3c5434700 1 --2- 172.21.15.49:0/3458203709 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3ac0662f0 0x7fa3ac0687a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0005930 tx=0x7fa3b0009040 comp rx=0 tx=0).stop 2023-07-21T22:12:43.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.815+0000 7fa3c5434700 1 -- 172.21.15.49:0/3458203709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3c00d0810 msgr2=0x7fa3c015eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:43.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.815+0000 7fa3c5434700 1 --2- 172.21.15.49:0/3458203709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3c00d0810 0x7fa3c015eff0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800cbc0 tx=0x7fa3b800ced0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.815+0000 7fa3c5434700 1 -- 172.21.15.49:0/3458203709 shutdown_connections 2023-07-21T22:12:43.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.815+0000 7fa3c5434700 1 --2- 172.21.15.49:0/3458203709 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3ac0662f0 0x7fa3ac0687a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.815+0000 7fa3c5434700 1 --2- 172.21.15.49:0/3458203709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3c00d0810 0x7fa3c015eff0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.815+0000 7fa3c5434700 1 --2- 172.21.15.49:0/3458203709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3c00b4b20 0x7fa3c015eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.815+0000 7fa3c5434700 1 --2- 172.21.15.49:0/3458203709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3c00b4040 0x7fa3c0153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:43.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.815+0000 7fa3c5434700 1 -- 172.21.15.49:0/3458203709 >> 172.21.15.49:0/3458203709 conn(0x7fa3c00658e0 msgr2=0x7fa3c006fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:43.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.815+0000 7fa3c5434700 1 -- 172.21.15.49:0/3458203709 shutdown_connections 2023-07-21T22:12:43.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:43.815+0000 7fa3c5434700 1 -- 172.21.15.49:0/3458203709 wait complete. 2023-07-21T22:12:43.882 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:12:44.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.027+0000 7f1c929dc700 1 Processor -- start 2023-07-21T22:12:44.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.027+0000 7f1c929dc700 1 -- start start 2023-07-21T22:12:44.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c929dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c8c15e380 0x7f1c8c0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c929dc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1c8c0b3a50 0x7f1c8c0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c929dc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1c8c0c9cd0 0x7f1c8c0c8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c929dc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8c0ca190 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c929dc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8c159fd0 con 0x7f1c8c0c9cd0 2023-07-21T22:12:44.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c929dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c15d6e0 con 0x7f1c8c15e380 2023-07-21T22:12:44.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c837fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1c8c0b3a50 0x7f1c8c0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c837fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1c8c0b3a50 0x7f1c8c0cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39682/0 (socket says 172.21.15.49:39682) 2023-07-21T22:12:44.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c837fe700 1 -- 172.21.15.49:0/3104982946 learned_addr learned my addr 172.21.15.49:0/3104982946 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:44.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c8bfff700 1 --2- 172.21.15.49:0/3104982946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c8c15e380 0x7f1c8c0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c90f79700 1 --2- 172.21.15.49:0/3104982946 >> v2:172.21.15.150:3300/0 conn(0x7f1c8c0c9cd0 0x7f1c8c0c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c837fe700 1 -- 172.21.15.49:0/3104982946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c8c15e380 msgr2=0x7f1c8c0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:44.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c837fe700 1 --2- 172.21.15.49:0/3104982946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c8c15e380 0x7f1c8c0cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c837fe700 1 -- 172.21.15.49:0/3104982946 >> v2:172.21.15.150:3300/0 conn(0x7f1c8c0c9cd0 msgr2=0x7f1c8c0c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:44.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c837fe700 1 --2- 172.21.15.49:0/3104982946 >> v2:172.21.15.150:3300/0 conn(0x7f1c8c0c9cd0 0x7f1c8c0c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c837fe700 1 -- 172.21.15.49:0/3104982946 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c0ca900 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c90f79700 1 --2- 172.21.15.49:0/3104982946 >> v2:172.21.15.150:3300/0 conn(0x7f1c8c0c9cd0 0x7f1c8c0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:44.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c837fe700 1 --2- 172.21.15.49:0/3104982946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c8c0b3a50 0x7f1c8c0cb120 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0ce020 tx=0x7f1c74009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ba0755418a5f73 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:44.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c8b7fe700 1 -- 172.21.15.49:0/3104982946 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74005e50 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c8b7fe700 1 -- 172.21.15.49:0/3104982946 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c74006030 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c8b7fe700 1 -- 172.21.15.49:0/3104982946 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c740063c0 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c929dc700 1 -- 172.21.15.49:0/3104982946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c8c0b3a50 msgr2=0x7f1c8c0cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c929dc700 1 --2- 172.21.15.49:0/3104982946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c8c0b3a50 0x7f1c8c0cb120 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0ce020 tx=0x7f1c74009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.031+0000 7f1c929dc700 1 -- 172.21.15.49:0/3104982946 shutdown_connections 2023-07-21T22:12:44.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.035+0000 7f1c929dc700 1 --2- 172.21.15.49:0/3104982946 >> v2:172.21.15.150:3300/0 conn(0x7f1c8c0c9cd0 0x7f1c8c0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.035+0000 7f1c929dc700 1 --2- 172.21.15.49:0/3104982946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c8c0b3a50 0x7f1c8c0cb120 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.035+0000 7f1c929dc700 1 --2- 172.21.15.49:0/3104982946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c8c15e380 0x7f1c8c0cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.035+0000 7f1c929dc700 1 -- 172.21.15.49:0/3104982946 >> 172.21.15.49:0/3104982946 conn(0x7f1c8c06e960 msgr2=0x7f1c8c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:44.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.035+0000 7f1c929dc700 1 -- 172.21.15.49:0/3104982946 shutdown_connections 2023-07-21T22:12:44.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.035+0000 7f1c929dc700 1 -- 172.21.15.49:0/3104982946 wait complete. 2023-07-21T22:12:44.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.035+0000 7f1c929dc700 1 Processor -- start 2023-07-21T22:12:44.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.035+0000 7f1c929dc700 1 -- start start 2023-07-21T22:12:44.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c929dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c8c0b3a50 0x7f1c8c1542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c929dc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c8c0c9cd0 0x7f1c8c14e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c929dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c8c15e380 0x7f1c8c1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c929dc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c153e50 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c929dc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c153240 con 0x7f1c8c0c9cd0 2023-07-21T22:12:44.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c929dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c153520 con 0x7f1c8c15e380 2023-07-21T22:12:44.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c8c0b3a50 0x7f1c8c1542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c8c0b3a50 0x7f1c8c1542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39696/0 (socket says 172.21.15.49:39696) 2023-07-21T22:12:44.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c8bfff700 1 -- 172.21.15.49:0/3841379084 learned_addr learned my addr 172.21.15.49:0/3841379084 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c837fe700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c8c0c9cd0 0x7f1c8c14e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c90f79700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c8c15e380 0x7f1c8c1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c8bfff700 1 -- 172.21.15.49:0/3841379084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c8c15e380 msgr2=0x7f1c8c1570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c8bfff700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c8c15e380 0x7f1c8c1570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c8bfff700 1 -- 172.21.15.49:0/3841379084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c8c0c9cd0 msgr2=0x7f1c8c14e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c8bfff700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c8c0c9cd0 0x7f1c8c14e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c8bfff700 1 -- 172.21.15.49:0/3841379084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c74009520 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c837fe700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c8c0c9cd0 0x7f1c8c14e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:44.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c8bfff700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c8c0b3a50 0x7f1c8c1542e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00e760 tx=0x7f1c7c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:44.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c897fa700 1 -- 172.21.15.49:0/3841379084 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c013610 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c929dc700 1 -- 172.21.15.49:0/3841379084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8c153800 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c897fa700 1 -- 172.21.15.49:0/3841379084 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c013770 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c897fa700 1 -- 172.21.15.49:0/3841379084 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c013ae0 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.039+0000 7f1c929dc700 1 -- 172.21.15.49:0/3841379084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8c1575e0 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.043+0000 7f1c929dc700 1 -- 172.21.15.49:0/3841379084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8c154820 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.043+0000 7f1c897fa700 1 -- 172.21.15.49:0/3841379084 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1c7c013c40 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.047+0000 7f1c897fa700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1c6c0662f0 0x7f1c6c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.047+0000 7f1c897fa700 1 -- 172.21.15.49:0/3841379084 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f1c7c083c90 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.047+0000 7f1c837fe700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1c6c0662f0 0x7f1c6c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.047+0000 7f1c837fe700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1c6c0662f0 0x7f1c6c0687a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0b3e80 tx=0x7f1c74008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.051+0000 7f1c897fa700 1 -- 172.21.15.49:0/3841379084 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1c7c054850 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.227+0000 7f1c929dc700 1 -- 172.21.15.49:0/3841379084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1c8c04dd50 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.227+0000 7f1c897fa700 1 -- 172.21.15.49:0/3841379084 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1c7c0543e0 con 0x7f1c8c0b3a50 2023-07-21T22:12:44.273 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:12:44.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.231+0000 7f1c929dc700 1 -- 172.21.15.49:0/3841379084 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1c6c0662f0 msgr2=0x7f1c6c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.231+0000 7f1c929dc700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1c6c0662f0 0x7f1c6c0687a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0b3e80 tx=0x7f1c74008070 comp rx=0 tx=0).stop 2023-07-21T22:12:44.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.231+0000 7f1c929dc700 1 -- 172.21.15.49:0/3841379084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c8c0b3a50 msgr2=0x7f1c8c1542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.231+0000 7f1c929dc700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c8c0b3a50 0x7f1c8c1542e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00e760 tx=0x7f1c7c00eb20 comp rx=0 tx=0).stop 2023-07-21T22:12:44.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.231+0000 7f1c929dc700 1 -- 172.21.15.49:0/3841379084 shutdown_connections 2023-07-21T22:12:44.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.231+0000 7f1c929dc700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1c6c0662f0 0x7f1c6c0687a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.231+0000 7f1c929dc700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c8c15e380 0x7f1c8c1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.231+0000 7f1c929dc700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c8c0c9cd0 0x7f1c8c14e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.231+0000 7f1c929dc700 1 --2- 172.21.15.49:0/3841379084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c8c0b3a50 0x7f1c8c1542e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.231+0000 7f1c929dc700 1 -- 172.21.15.49:0/3841379084 >> 172.21.15.49:0/3841379084 conn(0x7f1c8c06e960 msgr2=0x7f1c8c0c4620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:44.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.231+0000 7f1c929dc700 1 -- 172.21.15.49:0/3841379084 shutdown_connections 2023-07-21T22:12:44.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.231+0000 7f1c929dc700 1 -- 172.21.15.49:0/3841379084 wait complete. 2023-07-21T22:12:44.298 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:12:44.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.439+0000 7f7c1359e700 1 Processor -- start 2023-07-21T22:12:44.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.439+0000 7f7c1359e700 1 -- start start 2023-07-21T22:12:44.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c1359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c140cf520 0x7f7c140b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c1359e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c140b3e80 con 0x7f7c140b7af0 2023-07-21T22:12:44.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c1359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1415fd40 con 0x7f7c140d1e40 2023-07-21T22:12:44.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c1359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140cea00 con 0x7f7c140cf520 2023-07-21T22:12:44.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c1259c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7c140b7af0 0x7f7c1415f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34550/0 (socket says 172.21.15.49:34550) 2023-07-21T22:12:44.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c1259c700 1 -- 172.21.15.49:0/1165766957 learned_addr learned my addr 172.21.15.49:0/1165766957 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:44.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c12d9d700 1 --2- 172.21.15.49:0/1165766957 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c140cf520 0x7f7c140b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c1159a700 1 -- 172.21.15.49:0/1165766957 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301316348 0 0) 0x7f7c140b3e80 con 0x7f7c140b7af0 2023-07-21T22:12:44.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c1159a700 1 -- 172.21.15.49:0/1165766957 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bfc0035d0 con 0x7f7c140b7af0 2023-07-21T22:12:44.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c1159a700 1 -- 172.21.15.49:0/1165766957 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617157941 0 0) 0x7f7c1415fd40 con 0x7f7c140d1e40 2023-07-21T22:12:44.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c1159a700 1 -- 172.21.15.49:0/1165766957 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c140b3e80 con 0x7f7c140d1e40 2023-07-21T22:12:44.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c12d9d700 1 -- 172.21.15.49:0/1165766957 >> v1:172.21.15.150:6789/0 conn(0x7f7c140d1e40 legacy=0x7f7c140cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c12d9d700 1 -- 172.21.15.49:0/1165766957 >> v1:172.21.15.49:6789/0 conn(0x7f7c140b7af0 legacy=0x7f7c1415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c12d9d700 1 -- 172.21.15.49:0/1165766957 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c140ccbf0 con 0x7f7c140cf520 2023-07-21T22:12:44.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.443+0000 7f7c12d9d700 1 --2- 172.21.15.49:0/1165766957 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c140cf520 0x7f7c140b1630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009dc0 tx=0x7f7c0c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eeb34fecc1d36ac server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:44.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.447+0000 7f7c1159a700 1 -- 172.21.15.49:0/1165766957 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c00e070 con 0x7f7c140cf520 2023-07-21T22:12:44.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.447+0000 7f7c1159a700 1 -- 172.21.15.49:0/1165766957 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c00bb20 con 0x7f7c140cf520 2023-07-21T22:12:44.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.447+0000 7f7c1159a700 1 -- 172.21.15.49:0/1165766957 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c012430 con 0x7f7c140cf520 2023-07-21T22:12:44.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.447+0000 7f7c1359e700 1 -- 172.21.15.49:0/1165766957 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c140cf520 msgr2=0x7f7c140b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.447+0000 7f7c1359e700 1 --2- 172.21.15.49:0/1165766957 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c140cf520 0x7f7c140b1630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009dc0 tx=0x7f7c0c00b330 comp rx=0 tx=0).stop 2023-07-21T22:12:44.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.447+0000 7f7c1359e700 1 -- 172.21.15.49:0/1165766957 shutdown_connections 2023-07-21T22:12:44.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.447+0000 7f7c1359e700 1 --2- 172.21.15.49:0/1165766957 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c140cf520 0x7f7c140b1630 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.447+0000 7f7c1359e700 1 -- 172.21.15.49:0/1165766957 >> 172.21.15.49:0/1165766957 conn(0x7f7c1406e960 msgr2=0x7f7c1406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:44.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.447+0000 7f7c1359e700 1 -- 172.21.15.49:0/1165766957 shutdown_connections 2023-07-21T22:12:44.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.447+0000 7f7c1359e700 1 -- 172.21.15.49:0/1165766957 wait complete. 2023-07-21T22:12:44.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1359e700 1 Processor -- start 2023-07-21T22:12:44.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1359e700 1 -- start start 2023-07-21T22:12:44.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c140b7af0 0x7f7c140cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c140cf520 0x7f7c140c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c140d1e40 0x7f7c140b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140b2df0 con 0x7f7c140b7af0 2023-07-21T22:12:44.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c14157eb0 con 0x7f7c140d1e40 2023-07-21T22:12:44.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140b2420 con 0x7f7c140cf520 2023-07-21T22:12:44.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c140b7af0 0x7f7c140cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c140b7af0 0x7f7c140cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39704/0 (socket says 172.21.15.49:39704) 2023-07-21T22:12:44.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1259c700 1 -- 172.21.15.49:0/3907579923 learned_addr learned my addr 172.21.15.49:0/3907579923 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:44.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c12d9d700 1 --2- 172.21.15.49:0/3907579923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c140d1e40 0x7f7c140b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c11d9b700 1 --2- 172.21.15.49:0/3907579923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c140cf520 0x7f7c140c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1259c700 1 -- 172.21.15.49:0/3907579923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c140cf520 msgr2=0x7f7c140c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1259c700 1 --2- 172.21.15.49:0/3907579923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c140cf520 0x7f7c140c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1259c700 1 -- 172.21.15.49:0/3907579923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c140d1e40 msgr2=0x7f7c140b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1259c700 1 --2- 172.21.15.49:0/3907579923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c140d1e40 0x7f7c140b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1259c700 1 -- 172.21.15.49:0/3907579923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c009a70 con 0x7f7c140b7af0 2023-07-21T22:12:44.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.451+0000 7f7c1259c700 1 --2- 172.21.15.49:0/3907579923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c140b7af0 0x7f7c140cbeb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400c500 tx=0x7f7c0400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:44.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.455+0000 7f7c02ffd700 1 -- 172.21.15.49:0/3907579923 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04005d90 con 0x7f7c140b7af0 2023-07-21T22:12:44.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.455+0000 7f7c02ffd700 1 -- 172.21.15.49:0/3907579923 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c040070d0 con 0x7f7c140b7af0 2023-07-21T22:12:44.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.455+0000 7f7c1359e700 1 -- 172.21.15.49:0/3907579923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c140c5fd0 con 0x7f7c140b7af0 2023-07-21T22:12:44.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.455+0000 7f7c02ffd700 1 -- 172.21.15.49:0/3907579923 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04007460 con 0x7f7c140b7af0 2023-07-21T22:12:44.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.455+0000 7f7c1359e700 1 -- 172.21.15.49:0/3907579923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c140c6590 con 0x7f7c140b7af0 2023-07-21T22:12:44.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.455+0000 7f7c1359e700 1 -- 172.21.15.49:0/3907579923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1404dcb0 con 0x7f7c140b7af0 2023-07-21T22:12:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.455+0000 7f7c02ffd700 1 -- 172.21.15.49:0/3907579923 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7c040075c0 con 0x7f7c140b7af0 2023-07-21T22:12:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.459+0000 7f7c02ffd700 1 --2- 172.21.15.49:0/3907579923 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7bf40662f0 0x7f7bf40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.459+0000 7f7c02ffd700 1 -- 172.21.15.49:0/3907579923 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f7c04083490 con 0x7f7c140b7af0 2023-07-21T22:12:44.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.459+0000 7f7c11d9b700 1 --2- 172.21.15.49:0/3907579923 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7bf40662f0 0x7f7bf40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.459+0000 7f7c11d9b700 1 --2- 172.21.15.49:0/3907579923 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7bf40662f0 0x7f7bf40687a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7c08007fd0 tx=0x7f7c08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:44.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.463+0000 7f7c02ffd700 1 -- 172.21.15.49:0/3907579923 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7c04050630 con 0x7f7c140b7af0 2023-07-21T22:12:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.635+0000 7f7c1359e700 1 -- 172.21.15.49:0/3907579923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7c140cf150 con 0x7f7c140b7af0 2023-07-21T22:12:44.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.635+0000 7f7c02ffd700 1 -- 172.21.15.49:0/3907579923 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7c04053c50 con 0x7f7c140b7af0 2023-07-21T22:12:44.681 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:12:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.639+0000 7f7c1359e700 1 -- 172.21.15.49:0/3907579923 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7bf40662f0 msgr2=0x7f7bf40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.639+0000 7f7c1359e700 1 --2- 172.21.15.49:0/3907579923 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7bf40662f0 0x7f7bf40687a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7c08007fd0 tx=0x7f7c08009040 comp rx=0 tx=0).stop 2023-07-21T22:12:44.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.639+0000 7f7c1359e700 1 -- 172.21.15.49:0/3907579923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c140b7af0 msgr2=0x7f7c140cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.639+0000 7f7c1359e700 1 --2- 172.21.15.49:0/3907579923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c140b7af0 0x7f7c140cbeb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400c500 tx=0x7f7c0400c810 comp rx=0 tx=0).stop 2023-07-21T22:12:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.639+0000 7f7c1359e700 1 -- 172.21.15.49:0/3907579923 shutdown_connections 2023-07-21T22:12:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.639+0000 7f7c1359e700 1 --2- 172.21.15.49:0/3907579923 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7bf40662f0 0x7f7bf40687a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.639+0000 7f7c1359e700 1 --2- 172.21.15.49:0/3907579923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c140d1e40 0x7f7c140b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.639+0000 7f7c1359e700 1 --2- 172.21.15.49:0/3907579923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c140cf520 0x7f7c140c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.639+0000 7f7c1359e700 1 --2- 172.21.15.49:0/3907579923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c140b7af0 0x7f7c140cbeb0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.639+0000 7f7c1359e700 1 -- 172.21.15.49:0/3907579923 >> 172.21.15.49:0/3907579923 conn(0x7f7c1406e960 msgr2=0x7f7c14072490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:44.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.639+0000 7f7c1359e700 1 -- 172.21.15.49:0/3907579923 shutdown_connections 2023-07-21T22:12:44.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.639+0000 7f7c1359e700 1 -- 172.21.15.49:0/3907579923 wait complete. 2023-07-21T22:12:44.705 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-07-21T22:12:44.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.839+0000 7ff278dbf700 1 Processor -- start 2023-07-21T22:12:44.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.843+0000 7ff278dbf700 1 -- start start 2023-07-21T22:12:44.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.843+0000 7ff278dbf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2740cabe0 0x7ff2740cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.843+0000 7ff278dbf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff2740c9610 0x7ff2740c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.843+0000 7ff278dbf700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2740c88c0 con 0x7ff27415f9d0 2023-07-21T22:12:44.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.843+0000 7ff278dbf700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27415c220 con 0x7ff2740cabe0 2023-07-21T22:12:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.843+0000 7ff278dbf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff274160530 con 0x7ff2740c9610 2023-07-21T22:12:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.843+0000 7ff271d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff27415f9d0 0x7ff27415fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44348/0 (socket says 172.21.15.49:44348) 2023-07-21T22:12:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.843+0000 7ff271d9b700 1 -- 172.21.15.49:0/3063853515 learned_addr learned my addr 172.21.15.49:0/3063853515 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.843+0000 7ff27259c700 1 --2- 172.21.15.49:0/3063853515 >> v2:172.21.15.49:3300/0 conn(0x7ff2740cabe0 0x7ff2740cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.843+0000 7ff272d9d700 1 --2- 172.21.15.49:0/3063853515 >> v2:172.21.15.150:3300/0 conn(0x7ff2740c9610 0x7ff2740c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.843+0000 7ff27159a700 1 -- 172.21.15.49:0/3063853515 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174090948 0 0) 0x7ff2740c88c0 con 0x7ff27415f9d0 2023-07-21T22:12:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.843+0000 7ff27159a700 1 -- 172.21.15.49:0/3063853515 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff25c0035d0 con 0x7ff27415f9d0 2023-07-21T22:12:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.843+0000 7ff27259c700 1 -- 172.21.15.49:0/3063853515 >> v2:172.21.15.150:3300/0 conn(0x7ff2740c9610 msgr2=0x7ff2740c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.843+0000 7ff27259c700 1 --2- 172.21.15.49:0/3063853515 >> v2:172.21.15.150:3300/0 conn(0x7ff2740c9610 0x7ff2740c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.847+0000 7ff27259c700 1 -- 172.21.15.49:0/3063853515 >> v1:172.21.15.49:6789/0 conn(0x7ff27415f9d0 legacy=0x7ff27415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.847+0000 7ff27259c700 1 -- 172.21.15.49:0/3063853515 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2740cb4f0 con 0x7ff2740cabe0 2023-07-21T22:12:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.847+0000 7ff27259c700 1 --2- 172.21.15.49:0/3063853515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2740cabe0 0x7ff2740cafb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff27406f890 tx=0x7ff264009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13313f603fab08bc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.847+0000 7ff27159a700 1 -- 172.21.15.49:0/3063853515 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264011830 con 0x7ff2740cabe0 2023-07-21T22:12:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.847+0000 7ff27159a700 1 -- 172.21.15.49:0/3063853515 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff264011990 con 0x7ff2740cabe0 2023-07-21T22:12:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.847+0000 7ff27159a700 1 -- 172.21.15.49:0/3063853515 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264011d20 con 0x7ff2740cabe0 2023-07-21T22:12:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.847+0000 7ff278dbf700 1 -- 172.21.15.49:0/3063853515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2740cabe0 msgr2=0x7ff2740cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.847+0000 7ff278dbf700 1 --2- 172.21.15.49:0/3063853515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2740cabe0 0x7ff2740cafb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff27406f890 tx=0x7ff264009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.847+0000 7ff278dbf700 1 -- 172.21.15.49:0/3063853515 shutdown_connections 2023-07-21T22:12:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.847+0000 7ff278dbf700 1 --2- 172.21.15.49:0/3063853515 >> v2:172.21.15.150:3300/0 conn(0x7ff2740c9610 0x7ff2740c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.847+0000 7ff278dbf700 1 --2- 172.21.15.49:0/3063853515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2740cabe0 0x7ff2740cafb0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.847+0000 7ff278dbf700 1 -- 172.21.15.49:0/3063853515 >> 172.21.15.49:0/3063853515 conn(0x7ff27406e960 msgr2=0x7ff27406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.847+0000 7ff278dbf700 1 -- 172.21.15.49:0/3063853515 shutdown_connections 2023-07-21T22:12:44.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.847+0000 7ff278dbf700 1 -- 172.21.15.49:0/3063853515 wait complete. 2023-07-21T22:12:44.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.851+0000 7ff278dbf700 1 Processor -- start 2023-07-21T22:12:44.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.851+0000 7ff278dbf700 1 -- start start 2023-07-21T22:12:44.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.851+0000 7ff278dbf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2740c9610 0x7ff2741590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.851+0000 7ff278dbf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2740cabe0 0x7ff2740c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.851+0000 7ff278dbf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff27415f9d0 0x7ff2740c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.851+0000 7ff278dbf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2741595e0 con 0x7ff27415f9d0 2023-07-21T22:12:44.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.851+0000 7ff278dbf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2740c7780 con 0x7ff2740cabe0 2023-07-21T22:12:44.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.851+0000 7ff278dbf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27415c370 con 0x7ff2740c9610 2023-07-21T22:12:44.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.851+0000 7ff272d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff27415f9d0 0x7ff2740c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.851+0000 7ff272d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff27415f9d0 0x7ff2740c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44922/0 (socket says 172.21.15.49:44922) 2023-07-21T22:12:44.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.851+0000 7ff272d9d700 1 -- 172.21.15.49:0/151876088 learned_addr learned my addr 172.21.15.49:0/151876088 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:44.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.851+0000 7ff271d9b700 1 --2- 172.21.15.49:0/151876088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2740cabe0 0x7ff2740c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.851+0000 7ff27259c700 1 --2- 172.21.15.49:0/151876088 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2740c9610 0x7ff2741590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.855+0000 7ff272d9d700 1 -- 172.21.15.49:0/151876088 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2740c9610 msgr2=0x7ff2741590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.855+0000 7ff272d9d700 1 --2- 172.21.15.49:0/151876088 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2740c9610 0x7ff2741590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.855+0000 7ff272d9d700 1 -- 172.21.15.49:0/151876088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2740cabe0 msgr2=0x7ff2740c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.855+0000 7ff272d9d700 1 --2- 172.21.15.49:0/151876088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2740cabe0 0x7ff2740c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.855+0000 7ff272d9d700 1 -- 172.21.15.49:0/151876088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2640094b0 con 0x7ff27415f9d0 2023-07-21T22:12:44.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.855+0000 7ff272d9d700 1 --2- 172.21.15.49:0/151876088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff27415f9d0 0x7ff2740c57e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00efc0 tx=0x7ff26c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:44.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.855+0000 7ff262ffd700 1 -- 172.21.15.49:0/151876088 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c00cb80 con 0x7ff27415f9d0 2023-07-21T22:12:44.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.855+0000 7ff262ffd700 1 -- 172.21.15.49:0/151876088 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c00f040 con 0x7ff27415f9d0 2023-07-21T22:12:44.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.855+0000 7ff262ffd700 1 -- 172.21.15.49:0/151876088 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c014480 con 0x7ff27415f9d0 2023-07-21T22:12:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.855+0000 7ff278dbf700 1 -- 172.21.15.49:0/151876088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2740c6550 con 0x7ff27415f9d0 2023-07-21T22:12:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.855+0000 7ff278dbf700 1 -- 172.21.15.49:0/151876088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2740c7cf0 con 0x7ff27415f9d0 2023-07-21T22:12:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.855+0000 7ff278dbf700 1 -- 172.21.15.49:0/151876088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27415c560 con 0x7ff27415f9d0 2023-07-21T22:12:44.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.859+0000 7ff262ffd700 1 -- 172.21.15.49:0/151876088 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff26c0145e0 con 0x7ff27415f9d0 2023-07-21T22:12:44.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.859+0000 7ff262ffd700 1 --2- 172.21.15.49:0/151876088 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff254066320 0x7ff2540687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.859+0000 7ff262ffd700 1 -- 172.21.15.49:0/151876088 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7ff26c084a30 con 0x7ff27415f9d0 2023-07-21T22:12:44.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.859+0000 7ff27259c700 1 --2- 172.21.15.49:0/151876088 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff254066320 0x7ff2540687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.863+0000 7ff27259c700 1 --2- 172.21.15.49:0/151876088 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff254066320 0x7ff2540687d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff2640090b0 tx=0x7ff264008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:44.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:44.867+0000 7ff262ffd700 1 -- 172.21.15.49:0/151876088 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff26c051bd0 con 0x7ff27415f9d0 2023-07-21T22:12:45.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.035+0000 7ff278dbf700 1 -- 172.21.15.49:0/151876088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7ff27404dd50 con 0x7ff27415f9d0 2023-07-21T22:12:45.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.035+0000 7ff262ffd700 1 -- 172.21.15.49:0/151876088 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v47) v1 ==== 97+0+11 (secure 0 0 0) 0x7ff26c0551f0 con 0x7ff27415f9d0 2023-07-21T22:12:45.082 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:12:45.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.039+0000 7ff278dbf700 1 -- 172.21.15.49:0/151876088 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff254066320 msgr2=0x7ff2540687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:45.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.039+0000 7ff278dbf700 1 --2- 172.21.15.49:0/151876088 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff254066320 0x7ff2540687d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff2640090b0 tx=0x7ff264008030 comp rx=0 tx=0).stop 2023-07-21T22:12:45.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.039+0000 7ff278dbf700 1 -- 172.21.15.49:0/151876088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff27415f9d0 msgr2=0x7ff2740c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:45.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.039+0000 7ff278dbf700 1 --2- 172.21.15.49:0/151876088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff27415f9d0 0x7ff2740c57e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00efc0 tx=0x7ff26c00c0c0 comp rx=0 tx=0).stop 2023-07-21T22:12:45.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.039+0000 7ff278dbf700 1 -- 172.21.15.49:0/151876088 shutdown_connections 2023-07-21T22:12:45.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.039+0000 7ff278dbf700 1 --2- 172.21.15.49:0/151876088 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff254066320 0x7ff2540687d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:45.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.039+0000 7ff278dbf700 1 --2- 172.21.15.49:0/151876088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff27415f9d0 0x7ff2740c57e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:45.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.039+0000 7ff278dbf700 1 --2- 172.21.15.49:0/151876088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2740cabe0 0x7ff2740c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:45.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.039+0000 7ff278dbf700 1 --2- 172.21.15.49:0/151876088 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2740c9610 0x7ff2741590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:45.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.039+0000 7ff278dbf700 1 -- 172.21.15.49:0/151876088 >> 172.21.15.49:0/151876088 conn(0x7ff27406e960 msgr2=0x7ff2740ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:45.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.039+0000 7ff278dbf700 1 -- 172.21.15.49:0/151876088 shutdown_connections 2023-07-21T22:12:45.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.039+0000 7ff278dbf700 1 -- 172.21.15.49:0/151876088 wait complete. 2023-07-21T22:12:45.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:12:45.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.239+0000 7fa8bf59e700 1 Processor -- start 2023-07-21T22:12:45.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.239+0000 7fa8bf59e700 1 -- start start 2023-07-21T22:12:45.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bf59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8c00b7af0 0x7fa8c00b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:45.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bf59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa8c00cee10 0x7fa8c00cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bf59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c00b3e80 con 0x7fa8c00d1e40 2023-07-21T22:12:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bf59e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c00cf790 con 0x7fa8c00cee10 2023-07-21T22:12:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bf59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c015fd40 con 0x7fa8c00b7af0 2023-07-21T22:12:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bed9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa8c00cee10 0x7fa8c00cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:45.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bed9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa8c00cee10 0x7fa8c00cf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44924/0 (socket says 172.21.15.49:44924) 2023-07-21T22:12:45.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bed9d700 1 -- 172.21.15.49:0/1684401958 learned_addr learned my addr 172.21.15.49:0/1684401958 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:45.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8b5d9b700 1 --1- 172.21.15.49:0/1684401958 >> v1:172.21.15.49:6789/0 conn(0x7fa8c00d1e40 0x7fa8c015f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44358/0 (socket says 172.21.15.49:44358) 2023-07-21T22:12:45.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8be59c700 1 --2- 172.21.15.49:0/1684401958 >> v2:172.21.15.150:3300/0 conn(0x7fa8c00b7af0 0x7fa8c00b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:45.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bed9d700 1 -- 172.21.15.49:0/1684401958 >> v2:172.21.15.150:3300/0 conn(0x7fa8c00b7af0 msgr2=0x7fa8c00b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:45.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bed9d700 1 --2- 172.21.15.49:0/1684401958 >> v2:172.21.15.150:3300/0 conn(0x7fa8c00b7af0 0x7fa8c00b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:45.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bed9d700 1 -- 172.21.15.49:0/1684401958 >> v1:172.21.15.49:6789/0 conn(0x7fa8c00d1e40 legacy=0x7fa8c015f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:45.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bed9d700 1 -- 172.21.15.49:0/1684401958 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c00cea00 con 0x7fa8c00cee10 2023-07-21T22:12:45.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bed9d700 1 --2- 172.21.15.49:0/1684401958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c00cee10 0x7fa8c00cf250 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00cede0 tx=0x7fa8b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc87264aa7ac4141 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:45.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bdd9b700 1 -- 172.21.15.49:0/1684401958 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800e070 con 0x7fa8c00cee10 2023-07-21T22:12:45.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bdd9b700 1 -- 172.21.15.49:0/1684401958 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b800b9c0 con 0x7fa8c00cee10 2023-07-21T22:12:45.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.243+0000 7fa8bdd9b700 1 -- 172.21.15.49:0/1684401958 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800bd70 con 0x7fa8c00cee10 2023-07-21T22:12:45.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.247+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1684401958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c00cee10 msgr2=0x7fa8c00cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:45.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.247+0000 7fa8bf59e700 1 --2- 172.21.15.49:0/1684401958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c00cee10 0x7fa8c00cf250 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00cede0 tx=0x7fa8b800b330 comp rx=0 tx=0).stop 2023-07-21T22:12:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.247+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1684401958 shutdown_connections 2023-07-21T22:12:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.247+0000 7fa8bf59e700 1 --2- 172.21.15.49:0/1684401958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c00cee10 0x7fa8c00cf250 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.247+0000 7fa8bf59e700 1 --2- 172.21.15.49:0/1684401958 >> v2:172.21.15.150:3300/0 conn(0x7fa8c00b7af0 0x7fa8c00b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.247+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1684401958 >> 172.21.15.49:0/1684401958 conn(0x7fa8c006e960 msgr2=0x7fa8c006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.247+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1684401958 shutdown_connections 2023-07-21T22:12:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.247+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1684401958 wait complete. 2023-07-21T22:12:45.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.247+0000 7fa8bf59e700 1 Processor -- start 2023-07-21T22:12:45.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.247+0000 7fa8bf59e700 1 -- start start 2023-07-21T22:12:45.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bf59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8c00b7af0 0x7fa8c0154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:45.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bf59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c00cee10 0x7fa8c00ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bf59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c00d1e40 0x7fa8c00c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bf59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00c94d0 con 0x7fa8c00d1e40 2023-07-21T22:12:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bf59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00c97b0 con 0x7fa8c00cee10 2023-07-21T22:12:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bf59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00c9a90 con 0x7fa8c00b7af0 2023-07-21T22:12:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c00d1e40 0x7fa8c00c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c00d1e40 0x7fa8c00c7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44936/0 (socket says 172.21.15.49:44936) 2023-07-21T22:12:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bed9d700 1 -- 172.21.15.49:0/1389213397 learned_addr learned my addr 172.21.15.49:0/1389213397 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8be59c700 1 --2- 172.21.15.49:0/1389213397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8c00b7af0 0x7fa8c0154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8b5d9b700 1 --2- 172.21.15.49:0/1389213397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c00cee10 0x7fa8c00ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bed9d700 1 -- 172.21.15.49:0/1389213397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8c00b7af0 msgr2=0x7fa8c0154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bed9d700 1 --2- 172.21.15.49:0/1389213397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8c00b7af0 0x7fa8c0154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bed9d700 1 -- 172.21.15.49:0/1389213397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c00cee10 msgr2=0x7fa8c00ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bed9d700 1 --2- 172.21.15.49:0/1389213397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c00cee10 0x7fa8c00ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bed9d700 1 -- 172.21.15.49:0/1389213397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8009b30 con 0x7fa8c00d1e40 2023-07-21T22:12:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bed9d700 1 --2- 172.21.15.49:0/1389213397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c00d1e40 0x7fa8c00c7950 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009fd0 tx=0x7fa8b8004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:45.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8b77fe700 1 -- 172.21.15.49:0/1389213397 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8004880 con 0x7fa8c00d1e40 2023-07-21T22:12:45.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8b77fe700 1 -- 172.21.15.49:0/1389213397 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b80092e0 con 0x7fa8c00d1e40 2023-07-21T22:12:45.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8b77fe700 1 -- 172.21.15.49:0/1389213397 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80049e0 con 0x7fa8c00d1e40 2023-07-21T22:12:45.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1389213397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c00c9d70 con 0x7fa8c00d1e40 2023-07-21T22:12:45.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.251+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1389213397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c00ca330 con 0x7fa8c00d1e40 2023-07-21T22:12:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.255+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1389213397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c004dcb0 con 0x7fa8c00d1e40 2023-07-21T22:12:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.255+0000 7fa8b77fe700 1 -- 172.21.15.49:0/1389213397 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa8b801c680 con 0x7fa8c00d1e40 2023-07-21T22:12:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.259+0000 7fa8b77fe700 1 --2- 172.21.15.49:0/1389213397 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa8a00662f0 0x7fa8a00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.259+0000 7fa8b77fe700 1 -- 172.21.15.49:0/1389213397 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fa8b8006e40 con 0x7fa8c00d1e40 2023-07-21T22:12:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.259+0000 7fa8be59c700 1 --2- 172.21.15.49:0/1389213397 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa8a00662f0 0x7fa8a00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.259+0000 7fa8be59c700 1 --2- 172.21.15.49:0/1389213397 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa8a00662f0 0x7fa8a00687a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009a00 tx=0x7fa8b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:45.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.263+0000 7fa8b77fe700 1 -- 172.21.15.49:0/1389213397 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8b8052b00 con 0x7fa8c00d1e40 2023-07-21T22:12:45.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.451+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1389213397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa8c0070400 con 0x7fa8c00d1e40 2023-07-21T22:12:45.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.451+0000 7fa8b77fe700 1 -- 172.21.15.49:0/1389213397 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa8b8056120 con 0x7fa8c00d1e40 2023-07-21T22:12:45.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.451+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1389213397 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa8a00662f0 msgr2=0x7fa8a00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:45.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.451+0000 7fa8bf59e700 1 --2- 172.21.15.49:0/1389213397 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa8a00662f0 0x7fa8a00687a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009a00 tx=0x7fa8b0008040 comp rx=0 tx=0).stop 2023-07-21T22:12:45.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.451+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1389213397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c00d1e40 msgr2=0x7fa8c00c7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:45.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.451+0000 7fa8bf59e700 1 --2- 172.21.15.49:0/1389213397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c00d1e40 0x7fa8c00c7950 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009fd0 tx=0x7fa8b8004b40 comp rx=0 tx=0).stop 2023-07-21T22:12:45.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.451+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1389213397 shutdown_connections 2023-07-21T22:12:45.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.451+0000 7fa8bf59e700 1 --2- 172.21.15.49:0/1389213397 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa8a00662f0 0x7fa8a00687a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:45.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.451+0000 7fa8bf59e700 1 --2- 172.21.15.49:0/1389213397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c00d1e40 0x7fa8c00c7950 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:45.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.451+0000 7fa8bf59e700 1 --2- 172.21.15.49:0/1389213397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c00cee10 0x7fa8c00ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:45.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.451+0000 7fa8bf59e700 1 --2- 172.21.15.49:0/1389213397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8c00b7af0 0x7fa8c0154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:45.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.451+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1389213397 >> 172.21.15.49:0/1389213397 conn(0x7fa8c006e960 msgr2=0x7fa8c00b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:45.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.451+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1389213397 shutdown_connections 2023-07-21T22:12:45.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:45.451+0000 7fa8bf59e700 1 -- 172.21.15.49:0/1389213397 wait complete. 2023-07-21T22:12:45.501 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:12:45.519 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2023-07-21T22:12:45.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:45.520 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-21T22:12:45.548 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[45329]: fuse finished with error 0 and tester_r 0 2023-07-21T22:12:45.551 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:12:51.653 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:12:51.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:51.654 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:12:51.675 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:12:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.858+0000 7f05b8c93700 1 Processor -- start 2023-07-21T22:12:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.858+0000 7f05b8c93700 1 -- start start 2023-07-21T22:12:51.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05b8c93700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05b406e960 0x7f05b406ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:51.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05b8c93700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f05b40ce740 0x7f05b40cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:51.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05b8c93700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b40698a0 con 0x7f05b40ce2d0 2023-07-21T22:12:51.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05b8c93700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b415cb40 con 0x7f05b40ce740 2023-07-21T22:12:51.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05b8c93700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40cebc0 con 0x7f05b406e960 2023-07-21T22:12:51.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05aaffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f05b40ce2d0 0x7f05b40cbb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44368/0 (socket says 172.21.15.49:44368) 2023-07-21T22:12:51.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05aaffd700 1 -- 172.21.15.49:0/685119810 learned_addr learned my addr 172.21.15.49:0/685119810 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:51.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05b37fe700 1 --2- 172.21.15.49:0/685119810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05b406e960 0x7f05b406ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:51.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05b3fff700 1 --2- 172.21.15.49:0/685119810 >> v2:172.21.15.150:3300/0 conn(0x7f05b40ce740 0x7f05b40cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:51.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05b2ffd700 1 -- 172.21.15.49:0/685119810 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680990407 0 0) 0x7f05b40698a0 con 0x7f05b40ce2d0 2023-07-21T22:12:51.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05b2ffd700 1 -- 172.21.15.49:0/685119810 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05a00035d0 con 0x7f05b40ce2d0 2023-07-21T22:12:51.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05b3fff700 1 -- 172.21.15.49:0/685119810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05b406e960 msgr2=0x7f05b406ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:51.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05b3fff700 1 --2- 172.21.15.49:0/685119810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05b406e960 0x7f05b406ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:51.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05b3fff700 1 -- 172.21.15.49:0/685119810 >> v1:172.21.15.49:6789/0 conn(0x7f05b40ce2d0 legacy=0x7f05b40cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:51.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05b3fff700 1 -- 172.21.15.49:0/685119810 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b406f270 con 0x7f05b40ce740 2023-07-21T22:12:51.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.862+0000 7f05b3fff700 1 --2- 172.21.15.49:0/685119810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b40ce740 0x7f05b40cc260 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009d90 tx=0x7f05ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4dc7494f765aef6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:51.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.866+0000 7f05b2ffd700 1 -- 172.21.15.49:0/685119810 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00e070 con 0x7f05b40ce740 2023-07-21T22:12:51.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.866+0000 7f05b2ffd700 1 -- 172.21.15.49:0/685119810 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac00bb20 con 0x7f05b40ce740 2023-07-21T22:12:51.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.866+0000 7f05b2ffd700 1 -- 172.21.15.49:0/685119810 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00be90 con 0x7f05b40ce740 2023-07-21T22:12:51.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.866+0000 7f05b8c93700 1 -- 172.21.15.49:0/685119810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b40ce740 msgr2=0x7f05b40cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:51.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.866+0000 7f05b8c93700 1 --2- 172.21.15.49:0/685119810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b40ce740 0x7f05b40cc260 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009d90 tx=0x7f05ac00b330 comp rx=0 tx=0).stop 2023-07-21T22:12:51.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.866+0000 7f05b8c93700 1 -- 172.21.15.49:0/685119810 shutdown_connections 2023-07-21T22:12:51.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.866+0000 7f05b8c93700 1 --2- 172.21.15.49:0/685119810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b40ce740 0x7f05b40cc260 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:51.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.866+0000 7f05b8c93700 1 --2- 172.21.15.49:0/685119810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05b406e960 0x7f05b406ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:51.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.866+0000 7f05b8c93700 1 -- 172.21.15.49:0/685119810 >> 172.21.15.49:0/685119810 conn(0x7f05b406fa70 msgr2=0x7f05b406fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:51.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.866+0000 7f05b8c93700 1 -- 172.21.15.49:0/685119810 shutdown_connections 2023-07-21T22:12:51.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.866+0000 7f05b8c93700 1 -- 172.21.15.49:0/685119810 wait complete. 2023-07-21T22:12:51.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.870+0000 7f05b8c93700 1 Processor -- start 2023-07-21T22:12:51.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.870+0000 7f05b8c93700 1 -- start start 2023-07-21T22:12:51.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.870+0000 7f05b8c93700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b406e960 0x7f05b40c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:51.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.870+0000 7f05b8c93700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05b40ce2d0 0x7f05b414c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:51.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.870+0000 7f05b8c93700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b40ce740 0x7f05b40c3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:51.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.870+0000 7f05b8c93700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40b2830 con 0x7f05b406e960 2023-07-21T22:12:51.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.870+0000 7f05b8c93700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b414c9f0 con 0x7f05b40ce740 2023-07-21T22:12:51.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.870+0000 7f05b8c93700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40c4170 con 0x7f05b40ce2d0 2023-07-21T22:12:51.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b406e960 0x7f05b40c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:51.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b406e960 0x7f05b40c4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44952/0 (socket says 172.21.15.49:44952) 2023-07-21T22:12:51.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b37fe700 1 -- 172.21.15.49:0/4245150082 learned_addr learned my addr 172.21.15.49:0/4245150082 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:51.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b3fff700 1 --2- 172.21.15.49:0/4245150082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b40ce740 0x7f05b40c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:51.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05aaffd700 1 --2- 172.21.15.49:0/4245150082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05b40ce2d0 0x7f05b414c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:51.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b37fe700 1 -- 172.21.15.49:0/4245150082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05b40ce2d0 msgr2=0x7f05b414c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:51.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b37fe700 1 --2- 172.21.15.49:0/4245150082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05b40ce2d0 0x7f05b414c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:51.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b37fe700 1 -- 172.21.15.49:0/4245150082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b40ce740 msgr2=0x7f05b40c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:51.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b37fe700 1 --2- 172.21.15.49:0/4245150082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b40ce740 0x7f05b40c3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:51.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b37fe700 1 -- 172.21.15.49:0/4245150082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac009a70 con 0x7f05b406e960 2023-07-21T22:12:51.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b37fe700 1 --2- 172.21.15.49:0/4245150082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b406e960 0x7f05b40c4cb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f05a400e840 tx=0x7f05a400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:51.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b0ff9700 1 -- 172.21.15.49:0/4245150082 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a40095a0 con 0x7f05b406e960 2023-07-21T22:12:51.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b0ff9700 1 -- 172.21.15.49:0/4245150082 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a4013680 con 0x7f05b406e960 2023-07-21T22:12:51.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b0ff9700 1 -- 172.21.15.49:0/4245150082 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a40139f0 con 0x7f05b406e960 2023-07-21T22:12:51.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b8c93700 1 -- 172.21.15.49:0/4245150082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b40c3e90 con 0x7f05b406e960 2023-07-21T22:12:51.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b8c93700 1 -- 172.21.15.49:0/4245150082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b40acca0 con 0x7f05b406e960 2023-07-21T22:12:51.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.874+0000 7f05b8c93700 1 -- 172.21.15.49:0/4245150082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b404dcb0 con 0x7f05b406e960 2023-07-21T22:12:51.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.878+0000 7f05b0ff9700 1 -- 172.21.15.49:0/4245150082 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05a4013b50 con 0x7f05b406e960 2023-07-21T22:12:51.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.878+0000 7f05b0ff9700 1 --2- 172.21.15.49:0/4245150082 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f05940662f0 0x7f05940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:51.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.878+0000 7f05b0ff9700 1 -- 172.21.15.49:0/4245150082 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f05a4083e80 con 0x7f05b406e960 2023-07-21T22:12:51.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.882+0000 7f05aaffd700 1 --2- 172.21.15.49:0/4245150082 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f05940662f0 0x7f05940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.882+0000 7f05aaffd700 1 --2- 172.21.15.49:0/4245150082 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f05940662f0 0x7f05940687a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f05b40d0280 tx=0x7f059c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:51.886+0000 7f05b0ff9700 1 -- 172.21.15.49:0/4245150082 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05a4054b50 con 0x7f05b406e960 2023-07-21T22:12:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:52.090+0000 7f05b8c93700 1 -- 172.21.15.49:0/4245150082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f05b406c7f0 con 0x7f05b406e960 2023-07-21T22:12:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:52.094+0000 7f05b0ff9700 1 -- 172.21.15.49:0/4245150082 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+82 (secure 0 0 0) 0x7f05a4017070 con 0x7f05b406e960 2023-07-21T22:12:52.140 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2023-07-21T22:12:52.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:52.098+0000 7f05b8c93700 1 -- 172.21.15.49:0/4245150082 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f05940662f0 msgr2=0x7f05940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:52.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:52.098+0000 7f05b8c93700 1 --2- 172.21.15.49:0/4245150082 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f05940662f0 0x7f05940687a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f05b40d0280 tx=0x7f059c009040 comp rx=0 tx=0).stop 2023-07-21T22:12:52.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:52.098+0000 7f05b8c93700 1 -- 172.21.15.49:0/4245150082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b406e960 msgr2=0x7f05b40c4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:52.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:52.098+0000 7f05b8c93700 1 --2- 172.21.15.49:0/4245150082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b406e960 0x7f05b40c4cb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f05a400e840 tx=0x7f05a400eb50 comp rx=0 tx=0).stop 2023-07-21T22:12:52.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:52.098+0000 7f05b8c93700 1 -- 172.21.15.49:0/4245150082 shutdown_connections 2023-07-21T22:12:52.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:52.098+0000 7f05b8c93700 1 --2- 172.21.15.49:0/4245150082 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f05940662f0 0x7f05940687a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:52.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:52.098+0000 7f05b8c93700 1 --2- 172.21.15.49:0/4245150082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b40ce740 0x7f05b40c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:52.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:52.098+0000 7f05b8c93700 1 --2- 172.21.15.49:0/4245150082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05b40ce2d0 0x7f05b414c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:52.098+0000 7f05b8c93700 1 --2- 172.21.15.49:0/4245150082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b406e960 0x7f05b40c4cb0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:52.098+0000 7f05b8c93700 1 -- 172.21.15.49:0/4245150082 >> 172.21.15.49:0/4245150082 conn(0x7f05b406fa70 msgr2=0x7f05b40cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:52.098+0000 7f05b8c93700 1 -- 172.21.15.49:0/4245150082 shutdown_connections 2023-07-21T22:12:52.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:52.098+0000 7f05b8c93700 1 -- 172.21.15.49:0/4245150082 wait complete. 2023-07-21T22:12:52.166 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:12:52.166 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:12:52.167 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-07-21T22:12:52.167 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:12:52.168 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:12:52.168 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:12:52.169 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:12:52.170 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:12:52.170 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:12:52.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:52.171 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-07-21T22:12:52.191 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:12:52.191 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:12:52.192 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:12:52.192 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:52.192 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-07-21T22:12:52.192 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:52.192 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:12:52.192 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:12:52.192 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-07-21T22:12:52.193 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:12:52.193 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:12:52.193 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-07-21T22:12:52.193 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:12:52.193 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:12:52.193 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-07-21T22:12:52.193 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:12:52.194 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42182sec preferred_lft 42182sec 2023-07-21T22:12:52.194 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-07-21T22:12:52.194 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:52.194 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:12:52.194 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:12:52.194 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-07-21T22:12:52.194 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:12:52.194 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:19:e1:20:16 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:12:52.195 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:12:52.195 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:52.195 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:12:52.195 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether aa:11:6f:e1:a1:5e brd ff:ff:ff:ff:ff:ff 2023-07-21T22:12:52.195 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:12:52.195 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:52.195 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec43:77ff:fe1f:6f26/64 scope link 2023-07-21T22:12:52.196 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:52.196 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:12:52.196 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether aa:11:6f:e1:a1:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:12:52.196 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a811:6fff:fee1:a15e/64 scope link 2023-07-21T22:12:52.196 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:52.196 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:12:52.196 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether da:09:9c:11:2a:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:12:52.196 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::d809:9cff:fe11:2aa0/64 scope link 2023-07-21T22:12:52.197 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:12:52.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:52.198 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:12:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-07-21T22:12:52.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:52.281 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-07-21T22:12:52.346 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-07-21T22:12:52.346 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:12:52.347 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:12:52.347 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:12:52.347 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:12:52.347 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:12:52.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:52.350 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:12:52.350 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:12:52.351 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:12:52.352 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:12:52.352 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:12:52.353 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:12:52.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:52.486 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-07-21T22:12:52.504 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:12:52.505 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:12:52.505 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:12:52.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:52.506 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-07-21T22:12:52.581 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-21T22:12:52.582 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:12:52.582 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:12:52.641 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:12:52.641 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:12:52.642 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:12:52.699 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:12:52.782 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:12:52.783 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:12:52.859 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:12:52.861 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:12:52.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:52.862 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:12:52.921 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-21T22:12:52.921 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-21T22:12:52.970 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:12:53.008 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:12:53.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:12:53.082 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:12:53.084 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:12:53.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:53.086 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:12:53.121 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2023-07-21T22:12:53.074+0000 7fbcde2ee640 -1 init, newargv = 0x55d36016eb70 newargc=15 2023-07-21T22:12:53.121 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[45959]: starting ceph client 2023-07-21T22:12:53.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[45959]: starting fuse 2023-07-21T22:12:53.136 INFO:teuthology.orchestra.run.smithi049.stdout:49 2023-07-21T22:12:53.137 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-07-21T22:12:53.137 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T22:12:53.137 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2023-07-21T22:12:53.138 DEBUG:teuthology.orchestra.run.smithi049:> import re 2023-07-21T22:12:53.138 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-07-21T22:12:53.138 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-07-21T22:12:53.139 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:12:53.139 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2023-07-21T22:12:53.139 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-21T22:12:53.140 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2023-07-21T22:12:53.140 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-21T22:12:53.140 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:12:53.141 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2023-07-21T22:12:53.141 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2023-07-21T22:12:53.141 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2023-07-21T22:12:53.141 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2023-07-21T22:12:53.142 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:12:53.142 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2023-07-21T22:12:53.142 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T22:12:53.143 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T22:12:53.143 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T22:12:53.143 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2023-07-21T22:12:53.144 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2023-07-21T22:12:53.144 DEBUG:teuthology.orchestra.run.smithi049:> return f 2023-07-21T22:12:53.144 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T22:12:53.145 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:12:53.145 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2023-07-21T22:12:53.145 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-07-21T22:12:53.300 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.45959.asok 2023-07-21T22:12:53.485 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45959.asok 2023-07-21T22:12:53.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:53.486 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45959.asok status 2023-07-21T22:12:53.686 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:12:53.687 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2023-07-21T22:12:53.687 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea", 2023-07-21T22:12:53.687 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:12:53.687 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2023-07-21T22:12:53.688 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2023-07-21T22:12:53.688 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-21T22:12:53.688 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "45959", 2023-07-21T22:12:53.689 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2023-07-21T22:12:53.689 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:53.689 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2023-07-21T22:12:53.690 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2023-07-21T22:12:53.690 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6009, 2023-07-21T22:12:53.690 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2023-07-21T22:12:53.690 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2023-07-21T22:12:53.690 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2023-07-21T22:12:53.690 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 6009 2023-07-21T22:12:53.691 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:53.691 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:12:53.691 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:12:53.691 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:12:53.691 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2919954606 2023-07-21T22:12:53.691 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:12:53.692 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:53.692 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:12:53.692 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:12:53.692 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:12:53.693 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2919954606 2023-07-21T22:12:53.693 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:12:53.693 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.6009 192.168.0.1:0/2919954606", 2023-07-21T22:12:53.693 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/2919954606", 2023-07-21T22:12:53.693 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2023-07-21T22:12:53.693 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 18, 2023-07-21T22:12:53.694 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 47, 2023-07-21T22:12:53.694 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2023-07-21T22:12:53.694 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2023-07-21T22:12:53.694 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2023-07-21T22:12:53.695 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:12:53.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:53.701 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2023-07-21T22:12:53.702 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-21T22:12:53.720 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2023-07-21T22:12:53.720 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-21T22:12:53.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:53.722 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:12:53.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:53.798 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-07-21T22:12:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:setfattr: layoutfile: Permission denied 2023-07-21T22:12:53.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:12:53.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:53.869 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-07-21T22:12:53.938 INFO:teuthology.orchestra.run.smithi049.stderr:setfattr: layoutdir: Permission denied 2023-07-21T22:12:53.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:12:53.940 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:12:53.940 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:12:54.000 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:12:54.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.186+0000 7f2fc9ed6700 1 Processor -- start 2023-07-21T22:12:54.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.186+0000 7f2fc9ed6700 1 -- start start 2023-07-21T22:12:54.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.186+0000 7f2fc9ed6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2fc41561a0 0x7f2fc40cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:54.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.186+0000 7f2fc9ed6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2fc40afc20 0x7f2fc40b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:54.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.186+0000 7f2fc9ed6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc40b0580 con 0x7f2fc4155dd0 2023-07-21T22:12:54.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.186+0000 7f2fc9ed6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc415bf50 con 0x7f2fc41561a0 2023-07-21T22:12:54.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.186+0000 7f2fc9ed6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc415c230 con 0x7f2fc40afc20 2023-07-21T22:12:54.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.186+0000 7f2fbbfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2fc41561a0 0x7f2fc40cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.186+0000 7f2fbbfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2fc41561a0 0x7f2fc40cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44964/0 (socket says 172.21.15.49:44964) 2023-07-21T22:12:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.186+0000 7f2fbbfff700 1 -- 172.21.15.49:0/2535242430 learned_addr learned my addr 172.21.15.49:0/2535242430 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fc3fff700 1 --2- 172.21.15.49:0/2535242430 >> v2:172.21.15.150:3300/0 conn(0x7f2fc40afc20 0x7f2fc40b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fbbfff700 1 -- 172.21.15.49:0/2535242430 >> v2:172.21.15.150:3300/0 conn(0x7f2fc40afc20 msgr2=0x7f2fc40b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fbbfff700 1 --2- 172.21.15.49:0/2535242430 >> v2:172.21.15.150:3300/0 conn(0x7f2fc40afc20 0x7f2fc40b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fbbfff700 1 -- 172.21.15.49:0/2535242430 >> v1:172.21.15.49:6789/0 conn(0x7f2fc4155dd0 legacy=0x7f2fc40cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fbbfff700 1 -- 172.21.15.49:0/2535242430 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc415c510 con 0x7f2fc41561a0 2023-07-21T22:12:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fbbfff700 1 --2- 172.21.15.49:0/2535242430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc41561a0 0x7f2fc40cc570 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2fc406b900 tx=0x7f2fac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4544184fde210320 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fc2ffd700 1 -- 172.21.15.49:0/2535242430 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac00b8a0 con 0x7f2fc41561a0 2023-07-21T22:12:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fc2ffd700 1 -- 172.21.15.49:0/2535242430 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac00ba00 con 0x7f2fc41561a0 2023-07-21T22:12:54.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fc2ffd700 1 -- 172.21.15.49:0/2535242430 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac00bd90 con 0x7f2fc41561a0 2023-07-21T22:12:54.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/2535242430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc41561a0 msgr2=0x7f2fc40cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:54.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fc9ed6700 1 --2- 172.21.15.49:0/2535242430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc41561a0 0x7f2fc40cc570 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2fc406b900 tx=0x7f2fac009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/2535242430 shutdown_connections 2023-07-21T22:12:54.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fc9ed6700 1 --2- 172.21.15.49:0/2535242430 >> v2:172.21.15.150:3300/0 conn(0x7f2fc40afc20 0x7f2fc40b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fc9ed6700 1 --2- 172.21.15.49:0/2535242430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc41561a0 0x7f2fc40cc570 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/2535242430 >> 172.21.15.49:0/2535242430 conn(0x7f2fc406f5a0 msgr2=0x7f2fc40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:54.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/2535242430 shutdown_connections 2023-07-21T22:12:54.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.190+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/2535242430 wait complete. 2023-07-21T22:12:54.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc9ed6700 1 Processor -- start 2023-07-21T22:12:54.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc9ed6700 1 -- start start 2023-07-21T22:12:54.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc9ed6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc40afc20 0x7f2fc414c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:54.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc9ed6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc4155dd0 0x7f2fc40c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:54.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc9ed6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc40c1cd0 0x7f2fc40b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:54.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc9ed6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc414cbf0 con 0x7f2fc4155dd0 2023-07-21T22:12:54.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc9ed6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40b24a0 con 0x7f2fc40c1cd0 2023-07-21T22:12:54.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc9ed6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40b2780 con 0x7f2fc40afc20 2023-07-21T22:12:54.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fbbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc4155dd0 0x7f2fc40c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:54.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fbbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc4155dd0 0x7f2fc40c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44966/0 (socket says 172.21.15.49:44966) 2023-07-21T22:12:54.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fbbfff700 1 -- 172.21.15.49:0/3498330413 learned_addr learned my addr 172.21.15.49:0/3498330413 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:54.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc3fff700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc40c1cd0 0x7f2fc40b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:54.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc37fe700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc40afc20 0x7f2fc414c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:54.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fbbfff700 1 -- 172.21.15.49:0/3498330413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc40afc20 msgr2=0x7f2fc414c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:54.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fbbfff700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc40afc20 0x7f2fc414c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fbbfff700 1 -- 172.21.15.49:0/3498330413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc40c1cd0 msgr2=0x7f2fc40b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:54.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fbbfff700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc40c1cd0 0x7f2fc40b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fbbfff700 1 -- 172.21.15.49:0/3498330413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac009570 con 0x7f2fc4155dd0 2023-07-21T22:12:54.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc3fff700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc40c1cd0 0x7f2fc40b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:54.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fbbfff700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc4155dd0 0x7f2fc40c7a10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4066cd0 tx=0x7f2fac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:54.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc0ff9700 1 -- 172.21.15.49:0/3498330413 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0038c0 con 0x7f2fc4155dd0 2023-07-21T22:12:54.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc0ff9700 1 -- 172.21.15.49:0/3498330413 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac01f070 con 0x7f2fc4155dd0 2023-07-21T22:12:54.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/3498330413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc40b2a60 con 0x7f2fc4155dd0 2023-07-21T22:12:54.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.194+0000 7f2fc0ff9700 1 -- 172.21.15.49:0/3498330413 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac003c60 con 0x7f2fc4155dd0 2023-07-21T22:12:54.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.198+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/3498330413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc40b3020 con 0x7f2fc4155dd0 2023-07-21T22:12:54.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.198+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/3498330413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc4073130 con 0x7f2fc4155dd0 2023-07-21T22:12:54.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.198+0000 7f2fc0ff9700 1 -- 172.21.15.49:0/3498330413 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2fac026480 con 0x7f2fc4155dd0 2023-07-21T22:12:54.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.202+0000 7f2fc0ff9700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2fa4066320 0x7f2fa40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:54.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.202+0000 7f2fc0ff9700 1 -- 172.21.15.49:0/3498330413 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f2fac021070 con 0x7f2fc4155dd0 2023-07-21T22:12:54.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.202+0000 7f2fc37fe700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2fa4066320 0x7f2fa40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:54.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.202+0000 7f2fc37fe700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2fa4066320 0x7f2fa40687d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40016e0 tx=0x7f2fb4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:54.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.210+0000 7f2fc0ff9700 1 -- 172.21.15.49:0/3498330413 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2fac052960 con 0x7f2fc4155dd0 2023-07-21T22:12:54.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.390+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/3498330413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fc40b3240 con 0x7f2fc4155dd0 2023-07-21T22:12:54.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.394+0000 7f2fc0ff9700 1 -- 172.21.15.49:0/3498330413 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+20239 (secure 0 0 0) 0x7f2fac055f80 con 0x7f2fc4155dd0 2023-07-21T22:12:54.441 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:54.441 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":47,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:12:39.024259+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:12:20.014383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T22:12:21.059436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"data_new","create_time":"2023-07-21T22:12:36.491357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:12:54.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.398+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/3498330413 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2fa4066320 msgr2=0x7f2fa40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:54.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.398+0000 7f2fc9ed6700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2fa4066320 0x7f2fa40687d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40016e0 tx=0x7f2fb4009040 comp rx=0 tx=0).stop 2023-07-21T22:12:54.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.398+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/3498330413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc4155dd0 msgr2=0x7f2fc40c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:54.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.398+0000 7f2fc9ed6700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc4155dd0 0x7f2fc40c7a10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4066cd0 tx=0x7f2fac004770 comp rx=0 tx=0).stop 2023-07-21T22:12:54.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.398+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/3498330413 shutdown_connections 2023-07-21T22:12:54.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.398+0000 7f2fc9ed6700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2fa4066320 0x7f2fa40687d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.398+0000 7f2fc9ed6700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc4155dd0 0x7f2fc40c7a10 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.398+0000 7f2fc9ed6700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc40c1cd0 0x7f2fc40b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.398+0000 7f2fc9ed6700 1 --2- 172.21.15.49:0/3498330413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc40afc20 0x7f2fc414c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.398+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/3498330413 >> 172.21.15.49:0/3498330413 conn(0x7f2fc406f5a0 msgr2=0x7f2fc4157b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:54.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.398+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/3498330413 shutdown_connections 2023-07-21T22:12:54.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.398+0000 7f2fc9ed6700 1 -- 172.21.15.49:0/3498330413 wait complete. 2023-07-21T22:12:54.468 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:12:20.014383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:12:21.059436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'data_new', 'create_time': '2023-07-21T22:12:36.491357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:12:54.469 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:12:54.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.610+0000 7f53fb59e700 1 Processor -- start 2023-07-21T22:12:54.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.614+0000 7f53fb59e700 1 -- start start 2023-07-21T22:12:54.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.614+0000 7f53fb59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53fc1589a0 0x7f53fc06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:54.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.614+0000 7f53fb59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53fc158d70 con 0x7f53fc06c6d0 2023-07-21T22:12:54.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.614+0000 7f53fb59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53fc0cc990 con 0x7f53fc069fb0 2023-07-21T22:12:54.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.614+0000 7f53fb59e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc15c800 con 0x7f53fc1589a0 2023-07-21T22:12:54.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53fa59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53fc1589a0 0x7f53fc06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:54.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53f9d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f53fc06c6d0 0x7f53fc0698a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38784/0 (socket says 172.21.15.49:38784) 2023-07-21T22:12:54.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53f9d9b700 1 -- 172.21.15.49:0/2847050593 learned_addr learned my addr 172.21.15.49:0/2847050593 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:54.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53f959a700 1 -- 172.21.15.49:0/2847050593 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512315063 0 0) 0x7f53f0001110 con 0x7f53fc06c6d0 2023-07-21T22:12:54.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53f959a700 1 -- 172.21.15.49:0/2847050593 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53e40057e0 con 0x7f53fc06c6d0 2023-07-21T22:12:54.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53fa59c700 1 -- 172.21.15.49:0/2847050593 >> v1:172.21.15.150:6789/0 conn(0x7f53fc069fb0 legacy=0x7f53fc0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:54.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53fa59c700 1 -- 172.21.15.49:0/2847050593 >> v1:172.21.15.49:6789/0 conn(0x7f53fc06c6d0 legacy=0x7f53fc0698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:54.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53fa59c700 1 -- 172.21.15.49:0/2847050593 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc0c95d0 con 0x7f53fc1589a0 2023-07-21T22:12:54.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53fa59c700 1 --2- 172.21.15.49:0/2847050593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53fc1589a0 0x7f53fc06c190 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009850 tx=0x7f53ec009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3bef4a54c7b03e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:54.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53f959a700 1 -- 172.21.15.49:0/2847050593 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec011830 con 0x7f53fc1589a0 2023-07-21T22:12:54.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53f959a700 1 -- 172.21.15.49:0/2847050593 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec011990 con 0x7f53fc1589a0 2023-07-21T22:12:54.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53f959a700 1 -- 172.21.15.49:0/2847050593 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec011d40 con 0x7f53fc1589a0 2023-07-21T22:12:54.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53fb59e700 1 -- 172.21.15.49:0/2847050593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53fc1589a0 msgr2=0x7f53fc06c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:54.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53fb59e700 1 --2- 172.21.15.49:0/2847050593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53fc1589a0 0x7f53fc06c190 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009850 tx=0x7f53ec009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:54.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53fb59e700 1 -- 172.21.15.49:0/2847050593 shutdown_connections 2023-07-21T22:12:54.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53fb59e700 1 --2- 172.21.15.49:0/2847050593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53fc1589a0 0x7f53fc06c190 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53fb59e700 1 -- 172.21.15.49:0/2847050593 >> 172.21.15.49:0/2847050593 conn(0x7f53fc0ce0d0 msgr2=0x7f53fc0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:54.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53fb59e700 1 -- 172.21.15.49:0/2847050593 shutdown_connections 2023-07-21T22:12:54.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.618+0000 7f53fb59e700 1 -- 172.21.15.49:0/2847050593 wait complete. 2023-07-21T22:12:54.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53fb59e700 1 Processor -- start 2023-07-21T22:12:54.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53fb59e700 1 -- start start 2023-07-21T22:12:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53fb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc069fb0 0x7f53fc0c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53fb59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53fc06c6d0 0x7f53fc1552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53fb59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53fc1589a0 0x7f53fc1494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:54.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53fb59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc1557f0 con 0x7f53fc06c6d0 2023-07-21T22:12:54.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53fb59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc149a20 con 0x7f53fc1589a0 2023-07-21T22:12:54.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53fb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc0c6740 con 0x7f53fc069fb0 2023-07-21T22:12:54.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53f9d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53fc06c6d0 0x7f53fc1552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53f9d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53fc06c6d0 0x7f53fc1552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52296/0 (socket says 172.21.15.49:52296) 2023-07-21T22:12:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53fa59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc069fb0 0x7f53fc0c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53f9d9b700 1 -- 172.21.15.49:0/3402650990 learned_addr learned my addr 172.21.15.49:0/3402650990 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53fad9d700 1 --2- 172.21.15.49:0/3402650990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53fc1589a0 0x7f53fc1494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:54.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53f9d9b700 1 -- 172.21.15.49:0/3402650990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc069fb0 msgr2=0x7f53fc0c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:54.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53f9d9b700 1 --2- 172.21.15.49:0/3402650990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc069fb0 0x7f53fc0c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53f9d9b700 1 -- 172.21.15.49:0/3402650990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53fc1589a0 msgr2=0x7f53fc1494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:54.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53f9d9b700 1 --2- 172.21.15.49:0/3402650990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53fc1589a0 0x7f53fc1494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.622+0000 7f53f9d9b700 1 -- 172.21.15.49:0/3402650990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec0094b0 con 0x7f53fc06c6d0 2023-07-21T22:12:54.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.626+0000 7f53f9d9b700 1 --2- 172.21.15.49:0/3402650990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53fc06c6d0 0x7f53fc1552b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c730 tx=0x7f53f000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:54.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.626+0000 7f53eaffd700 1 -- 172.21.15.49:0/3402650990 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0005d90 con 0x7f53fc06c6d0 2023-07-21T22:12:54.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.626+0000 7f53eaffd700 1 -- 172.21.15.49:0/3402650990 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f00070d0 con 0x7f53fc06c6d0 2023-07-21T22:12:54.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.626+0000 7f53fb59e700 1 -- 172.21.15.49:0/3402650990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc0c6a20 con 0x7f53fc06c6d0 2023-07-21T22:12:54.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.626+0000 7f53eaffd700 1 -- 172.21.15.49:0/3402650990 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0007460 con 0x7f53fc06c6d0 2023-07-21T22:12:54.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.626+0000 7f53fb59e700 1 -- 172.21.15.49:0/3402650990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc0c6fe0 con 0x7f53fc06c6d0 2023-07-21T22:12:54.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.626+0000 7f53fb59e700 1 -- 172.21.15.49:0/3402650990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc04dcb0 con 0x7f53fc06c6d0 2023-07-21T22:12:54.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.630+0000 7f53eaffd700 1 -- 172.21.15.49:0/3402650990 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f53f00075c0 con 0x7f53fc06c6d0 2023-07-21T22:12:54.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.630+0000 7f53eaffd700 1 --2- 172.21.15.49:0/3402650990 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f53dc066320 0x7f53dc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:54.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.630+0000 7f53eaffd700 1 -- 172.21.15.49:0/3402650990 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f53f00833e0 con 0x7f53fc06c6d0 2023-07-21T22:12:54.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.630+0000 7f53fa59c700 1 --2- 172.21.15.49:0/3402650990 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f53dc066320 0x7f53dc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:54.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.630+0000 7f53fa59c700 1 --2- 172.21.15.49:0/3402650990 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f53dc066320 0x7f53dc0687d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0090b0 tx=0x7f53ec008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:54.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.638+0000 7f53eaffd700 1 -- 172.21.15.49:0/3402650990 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f53f0050500 con 0x7f53fc06c6d0 2023-07-21T22:12:54.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.814+0000 7f53fb59e700 1 -- 172.21.15.49:0/3402650990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53fc159540 con 0x7f53fc06c6d0 2023-07-21T22:12:54.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.814+0000 7f53eaffd700 1 -- 172.21.15.49:0/3402650990 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53fc159540 con 0x7f53fc06c6d0 2023-07-21T22:12:54.862 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:12:54.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.818+0000 7f53fb59e700 1 -- 172.21.15.49:0/3402650990 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f53dc066320 msgr2=0x7f53dc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:54.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.818+0000 7f53fb59e700 1 --2- 172.21.15.49:0/3402650990 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f53dc066320 0x7f53dc0687d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0090b0 tx=0x7f53ec008030 comp rx=0 tx=0).stop 2023-07-21T22:12:54.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.818+0000 7f53fb59e700 1 -- 172.21.15.49:0/3402650990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53fc06c6d0 msgr2=0x7f53fc1552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:54.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.818+0000 7f53fb59e700 1 --2- 172.21.15.49:0/3402650990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53fc06c6d0 0x7f53fc1552b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c730 tx=0x7f53f000ca40 comp rx=0 tx=0).stop 2023-07-21T22:12:54.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.818+0000 7f53fb59e700 1 -- 172.21.15.49:0/3402650990 shutdown_connections 2023-07-21T22:12:54.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.818+0000 7f53fb59e700 1 --2- 172.21.15.49:0/3402650990 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f53dc066320 0x7f53dc0687d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.818+0000 7f53fb59e700 1 --2- 172.21.15.49:0/3402650990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53fc06c6d0 0x7f53fc1552b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.818+0000 7f53fb59e700 1 --2- 172.21.15.49:0/3402650990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53fc1589a0 0x7f53fc1494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.818+0000 7f53fb59e700 1 --2- 172.21.15.49:0/3402650990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc069fb0 0x7f53fc0c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:54.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.818+0000 7f53fb59e700 1 -- 172.21.15.49:0/3402650990 >> 172.21.15.49:0/3402650990 conn(0x7f53fc0ce0d0 msgr2=0x7f53fc0698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:54.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.818+0000 7f53fb59e700 1 -- 172.21.15.49:0/3402650990 shutdown_connections 2023-07-21T22:12:54.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:54.818+0000 7f53fb59e700 1 -- 172.21.15.49:0/3402650990 wait complete. 2023-07-21T22:12:54.884 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:12:55.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.022+0000 7fe31a2f2700 1 Processor -- start 2023-07-21T22:12:55.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.022+0000 7fe31a2f2700 1 -- start start 2023-07-21T22:12:55.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe31a2f2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3140b7af0 0x7fe3140b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe31a2f2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe3140d1e40 0x7fe31415f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe31a2f2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3140b3e80 con 0x7fe3140cee10 2023-07-21T22:12:55.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe31a2f2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3140cea00 con 0x7fe3140b7af0 2023-07-21T22:12:55.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe31a2f2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3140ccbf0 con 0x7fe3140d1e40 2023-07-21T22:12:55.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe3192f0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3140b7af0 0x7fe3140b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe3192f0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3140b7af0 0x7fe3140b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52300/0 (socket says 172.21.15.49:52300) 2023-07-21T22:12:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe3192f0700 1 -- 172.21.15.49:0/2989909461 learned_addr learned my addr 172.21.15.49:0/2989909461 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe319af1700 1 --1- 172.21.15.49:0/2989909461 >> v1:172.21.15.49:6789/0 conn(0x7fe3140cee10 0x7fe3140b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38786/0 (socket says 172.21.15.49:38786) 2023-07-21T22:12:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe318aef700 1 --2- 172.21.15.49:0/2989909461 >> v2:172.21.15.150:3300/0 conn(0x7fe3140d1e40 0x7fe31415f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe3192f0700 1 -- 172.21.15.49:0/2989909461 >> v2:172.21.15.150:3300/0 conn(0x7fe3140d1e40 msgr2=0x7fe31415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe3192f0700 1 --2- 172.21.15.49:0/2989909461 >> v2:172.21.15.150:3300/0 conn(0x7fe3140d1e40 0x7fe31415f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe3192f0700 1 -- 172.21.15.49:0/2989909461 >> v1:172.21.15.49:6789/0 conn(0x7fe3140cee10 legacy=0x7fe3140b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe3192f0700 1 -- 172.21.15.49:0/2989909461 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3140cced0 con 0x7fe3140b7af0 2023-07-21T22:12:55.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.026+0000 7fe30bfff700 1 -- 172.21.15.49:0/2989909461 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690620467 0 0) 0x7fe3140b3e80 con 0x7fe3140cee10 2023-07-21T22:12:55.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.030+0000 7fe3192f0700 1 --2- 172.21.15.49:0/2989909461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3140b7af0 0x7fe3140b1630 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe3140d1200 tx=0x7fe310009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55802d4cce3cdd8f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:55.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.030+0000 7fe30bfff700 1 -- 172.21.15.49:0/2989909461 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310011830 con 0x7fe3140b7af0 2023-07-21T22:12:55.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.030+0000 7fe30bfff700 1 -- 172.21.15.49:0/2989909461 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe310011990 con 0x7fe3140b7af0 2023-07-21T22:12:55.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.030+0000 7fe30bfff700 1 -- 172.21.15.49:0/2989909461 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310011d20 con 0x7fe3140b7af0 2023-07-21T22:12:55.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.030+0000 7fe31a2f2700 1 -- 172.21.15.49:0/2989909461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3140b7af0 msgr2=0x7fe3140b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.030+0000 7fe31a2f2700 1 --2- 172.21.15.49:0/2989909461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3140b7af0 0x7fe3140b1630 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe3140d1200 tx=0x7fe310009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.030+0000 7fe31a2f2700 1 -- 172.21.15.49:0/2989909461 shutdown_connections 2023-07-21T22:12:55.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.030+0000 7fe31a2f2700 1 --2- 172.21.15.49:0/2989909461 >> v2:172.21.15.150:3300/0 conn(0x7fe3140d1e40 0x7fe31415f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.030+0000 7fe31a2f2700 1 --2- 172.21.15.49:0/2989909461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3140b7af0 0x7fe3140b1630 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.030+0000 7fe31a2f2700 1 -- 172.21.15.49:0/2989909461 >> 172.21.15.49:0/2989909461 conn(0x7fe31406e960 msgr2=0x7fe31406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:55.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.030+0000 7fe31a2f2700 1 -- 172.21.15.49:0/2989909461 shutdown_connections 2023-07-21T22:12:55.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.030+0000 7fe31a2f2700 1 -- 172.21.15.49:0/2989909461 wait complete. 2023-07-21T22:12:55.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe31a2f2700 1 Processor -- start 2023-07-21T22:12:55.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe31a2f2700 1 -- start start 2023-07-21T22:12:55.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe31a2f2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140b7af0 0x7fe3141578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe31a2f2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3140cee10 0x7fe3140b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe31a2f2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3140d1e40 0x7fe3140cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe31a2f2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3141f1320 con 0x7fe3140cee10 2023-07-21T22:12:55.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe31a2f2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140c63c0 con 0x7fe3140d1e40 2023-07-21T22:12:55.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe31a2f2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140c66a0 con 0x7fe3140b7af0 2023-07-21T22:12:55.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe318aef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3140cee10 0x7fe3140b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe318aef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3140cee10 0x7fe3140b37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52304/0 (socket says 172.21.15.49:52304) 2023-07-21T22:12:55.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe318aef700 1 -- 172.21.15.49:0/218340020 learned_addr learned my addr 172.21.15.49:0/218340020 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:55.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe3192f0700 1 --2- 172.21.15.49:0/218340020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140b7af0 0x7fe3141578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe319af1700 1 --2- 172.21.15.49:0/218340020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3140d1e40 0x7fe3140cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe318aef700 1 -- 172.21.15.49:0/218340020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140b7af0 msgr2=0x7fe3141578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe318aef700 1 --2- 172.21.15.49:0/218340020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140b7af0 0x7fe3141578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe318aef700 1 -- 172.21.15.49:0/218340020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3140d1e40 msgr2=0x7fe3140cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe318aef700 1 --2- 172.21.15.49:0/218340020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3140d1e40 0x7fe3140cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe318aef700 1 -- 172.21.15.49:0/218340020 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310009570 con 0x7fe3140cee10 2023-07-21T22:12:55.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe318aef700 1 --2- 172.21.15.49:0/218340020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3140cee10 0x7fe3140b37b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe30400e870 tx=0x7fe30400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:55.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe309ffb700 1 -- 172.21.15.49:0/218340020 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3040095c0 con 0x7fe3140cee10 2023-07-21T22:12:55.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.034+0000 7fe309ffb700 1 -- 172.21.15.49:0/218340020 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30400ee70 con 0x7fe3140cee10 2023-07-21T22:12:55.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.038+0000 7fe31a2f2700 1 -- 172.21.15.49:0/218340020 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3140c6980 con 0x7fe3140cee10 2023-07-21T22:12:55.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.038+0000 7fe309ffb700 1 -- 172.21.15.49:0/218340020 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30400ca70 con 0x7fe3140cee10 2023-07-21T22:12:55.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.038+0000 7fe31a2f2700 1 -- 172.21.15.49:0/218340020 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe314157e30 con 0x7fe3140cee10 2023-07-21T22:12:55.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.038+0000 7fe31a2f2700 1 -- 172.21.15.49:0/218340020 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3141f1460 con 0x7fe3140cee10 2023-07-21T22:12:55.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.038+0000 7fe309ffb700 1 -- 172.21.15.49:0/218340020 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe30400cbd0 con 0x7fe3140cee10 2023-07-21T22:12:55.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.042+0000 7fe309ffb700 1 --2- 172.21.15.49:0/218340020 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe2f80662f0 0x7fe2f80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.042+0000 7fe309ffb700 1 -- 172.21.15.49:0/218340020 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fe304083ff0 con 0x7fe3140cee10 2023-07-21T22:12:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.042+0000 7fe3192f0700 1 --2- 172.21.15.49:0/218340020 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe2f80662f0 0x7fe2f80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.042+0000 7fe3192f0700 1 --2- 172.21.15.49:0/218340020 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe2f80662f0 0x7fe2f80687a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe310000c00 tx=0x7fe310008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:55.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.046+0000 7fe309ffb700 1 -- 172.21.15.49:0/218340020 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3141f1460 con 0x7fe3140cee10 2023-07-21T22:12:55.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.218+0000 7fe31a2f2700 1 -- 172.21.15.49:0/218340020 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe3141f1460 con 0x7fe3140cee10 2023-07-21T22:12:55.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.218+0000 7fe309ffb700 1 -- 172.21.15.49:0/218340020 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe3141f1460 con 0x7fe3140cee10 2023-07-21T22:12:55.267 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:12:55.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.226+0000 7fe31a2f2700 1 -- 172.21.15.49:0/218340020 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe2f80662f0 msgr2=0x7fe2f80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.226+0000 7fe31a2f2700 1 --2- 172.21.15.49:0/218340020 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe2f80662f0 0x7fe2f80687a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe310000c00 tx=0x7fe310008030 comp rx=0 tx=0).stop 2023-07-21T22:12:55.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.226+0000 7fe31a2f2700 1 -- 172.21.15.49:0/218340020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3140cee10 msgr2=0x7fe3140b37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.226+0000 7fe31a2f2700 1 --2- 172.21.15.49:0/218340020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3140cee10 0x7fe3140b37b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe30400e870 tx=0x7fe30400ec30 comp rx=0 tx=0).stop 2023-07-21T22:12:55.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.226+0000 7fe31a2f2700 1 -- 172.21.15.49:0/218340020 shutdown_connections 2023-07-21T22:12:55.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.226+0000 7fe31a2f2700 1 --2- 172.21.15.49:0/218340020 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe2f80662f0 0x7fe2f80687a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.226+0000 7fe31a2f2700 1 --2- 172.21.15.49:0/218340020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3140cee10 0x7fe3140b37b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.226+0000 7fe31a2f2700 1 --2- 172.21.15.49:0/218340020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3140d1e40 0x7fe3140cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.226+0000 7fe31a2f2700 1 --2- 172.21.15.49:0/218340020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140b7af0 0x7fe3141578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.226+0000 7fe31a2f2700 1 -- 172.21.15.49:0/218340020 >> 172.21.15.49:0/218340020 conn(0x7fe31406e960 msgr2=0x7fe3140b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:55.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.226+0000 7fe31a2f2700 1 -- 172.21.15.49:0/218340020 shutdown_connections 2023-07-21T22:12:55.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.226+0000 7fe31a2f2700 1 -- 172.21.15.49:0/218340020 wait complete. 2023-07-21T22:12:55.294 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:12:55.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.438+0000 7f02be034700 1 Processor -- start 2023-07-21T22:12:55.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.442+0000 7f02be034700 1 -- start start 2023-07-21T22:12:55.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.442+0000 7f02be034700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f02b81564c0 0x7f02b80cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.442+0000 7f02be034700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f02b815cfa0 0x7f02b80ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.442+0000 7f02be034700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b815d3e0 con 0x7f02b80c9990 2023-07-21T22:12:55.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.442+0000 7f02be034700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b80c9570 con 0x7f02b81564c0 2023-07-21T22:12:55.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.442+0000 7f02be034700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b80c8bd0 con 0x7f02b815cfa0 2023-07-21T22:12:55.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.442+0000 7f02b6ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f02b80c9990 0x7f02b815c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38798/0 (socket says 172.21.15.49:38798) 2023-07-21T22:12:55.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.442+0000 7f02b6ffd700 1 -- 172.21.15.49:0/587688173 learned_addr learned my addr 172.21.15.49:0/587688173 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:55.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.442+0000 7f02b77fe700 1 --2- 172.21.15.49:0/587688173 >> v2:172.21.15.49:3300/0 conn(0x7f02b81564c0 0x7f02b80cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02b7fff700 1 --2- 172.21.15.49:0/587688173 >> v2:172.21.15.150:3300/0 conn(0x7f02b815cfa0 0x7f02b80ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02b67fc700 1 -- 172.21.15.49:0/587688173 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620142870 0 0) 0x7f02b815d3e0 con 0x7f02b80c9990 2023-07-21T22:12:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02b67fc700 1 -- 172.21.15.49:0/587688173 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a00057e0 con 0x7f02b80c9990 2023-07-21T22:12:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02b77fe700 1 -- 172.21.15.49:0/587688173 >> v2:172.21.15.150:3300/0 conn(0x7f02b815cfa0 msgr2=0x7f02b80ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02b77fe700 1 --2- 172.21.15.49:0/587688173 >> v2:172.21.15.150:3300/0 conn(0x7f02b815cfa0 0x7f02b80ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02b77fe700 1 -- 172.21.15.49:0/587688173 >> v1:172.21.15.49:6789/0 conn(0x7f02b80c9990 legacy=0x7f02b815c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02b77fe700 1 -- 172.21.15.49:0/587688173 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b80c8eb0 con 0x7f02b81564c0 2023-07-21T22:12:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02b77fe700 1 --2- 172.21.15.49:0/587688173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b81564c0 0x7f02b80cdf40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f02b806a2b0 tx=0x7f02a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c35e9f37e70dc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02b67fc700 1 -- 172.21.15.49:0/587688173 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800e070 con 0x7f02b81564c0 2023-07-21T22:12:55.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02b67fc700 1 -- 172.21.15.49:0/587688173 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a800bb20 con 0x7f02b81564c0 2023-07-21T22:12:55.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02b67fc700 1 -- 172.21.15.49:0/587688173 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a8012430 con 0x7f02b81564c0 2023-07-21T22:12:55.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02be034700 1 -- 172.21.15.49:0/587688173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b81564c0 msgr2=0x7f02b80cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02be034700 1 --2- 172.21.15.49:0/587688173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b81564c0 0x7f02b80cdf40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f02b806a2b0 tx=0x7f02a800b330 comp rx=0 tx=0).stop 2023-07-21T22:12:55.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02be034700 1 -- 172.21.15.49:0/587688173 shutdown_connections 2023-07-21T22:12:55.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02be034700 1 --2- 172.21.15.49:0/587688173 >> v2:172.21.15.150:3300/0 conn(0x7f02b815cfa0 0x7f02b80ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02be034700 1 --2- 172.21.15.49:0/587688173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b81564c0 0x7f02b80cdf40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02be034700 1 -- 172.21.15.49:0/587688173 >> 172.21.15.49:0/587688173 conn(0x7f02b806e960 msgr2=0x7f02b806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:55.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02be034700 1 -- 172.21.15.49:0/587688173 shutdown_connections 2023-07-21T22:12:55.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.446+0000 7f02be034700 1 -- 172.21.15.49:0/587688173 wait complete. 2023-07-21T22:12:55.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.450+0000 7f02be034700 1 Processor -- start 2023-07-21T22:12:55.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.450+0000 7f02be034700 1 -- start start 2023-07-21T22:12:55.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.450+0000 7f02be034700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b80c9990 0x7f02b80c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.450+0000 7f02be034700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b81564c0 0x7f02b81585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.450+0000 7f02be034700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02b815cfa0 0x7f02b80c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.450+0000 7f02be034700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b81f03c0 con 0x7f02b81564c0 2023-07-21T22:12:55.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.450+0000 7f02be034700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b81f06a0 con 0x7f02b80c9990 2023-07-21T22:12:55.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.450+0000 7f02be034700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b8158b00 con 0x7f02b815cfa0 2023-07-21T22:12:55.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f02b6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b81564c0 0x7f02b81585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f02b6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b81564c0 0x7f02b81585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52328/0 (socket says 172.21.15.49:52328) 2023-07-21T22:12:55.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f02b6ffd700 1 -- 172.21.15.49:0/92469496 learned_addr learned my addr 172.21.15.49:0/92469496 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:55.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f02b77fe700 1 --2- 172.21.15.49:0/92469496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b80c9990 0x7f02b80c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f02b7fff700 1 --2- 172.21.15.49:0/92469496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02b815cfa0 0x7f02b80c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f02b6ffd700 1 -- 172.21.15.49:0/92469496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02b815cfa0 msgr2=0x7f02b80c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f02b6ffd700 1 --2- 172.21.15.49:0/92469496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02b815cfa0 0x7f02b80c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f02b6ffd700 1 -- 172.21.15.49:0/92469496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b80c9990 msgr2=0x7f02b80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f02b6ffd700 1 --2- 172.21.15.49:0/92469496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b80c9990 0x7f02b80c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f02b6ffd700 1 -- 172.21.15.49:0/92469496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a8009a70 con 0x7f02b81564c0 2023-07-21T22:12:55.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f02b6ffd700 1 --2- 172.21.15.49:0/92469496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b81564c0 0x7f02b81585c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f02ac001260 tx=0x7f02ac00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:55.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f029ffff700 1 -- 172.21.15.49:0/92469496 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0074e0 con 0x7f02b81564c0 2023-07-21T22:12:55.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f02be034700 1 -- 172.21.15.49:0/92469496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b80c5880 con 0x7f02b81564c0 2023-07-21T22:12:55.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f029ffff700 1 -- 172.21.15.49:0/92469496 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac007640 con 0x7f02b81564c0 2023-07-21T22:12:55.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f029ffff700 1 -- 172.21.15.49:0/92469496 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac005a50 con 0x7f02b81564c0 2023-07-21T22:12:55.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f02be034700 1 -- 172.21.15.49:0/92469496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b80c5e40 con 0x7f02b81564c0 2023-07-21T22:12:55.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.454+0000 7f02be034700 1 -- 172.21.15.49:0/92469496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b81f07e0 con 0x7f02b81564c0 2023-07-21T22:12:55.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.458+0000 7f029ffff700 1 -- 172.21.15.49:0/92469496 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f02ac005bb0 con 0x7f02b81564c0 2023-07-21T22:12:55.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.458+0000 7f029ffff700 1 --2- 172.21.15.49:0/92469496 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f02a40662f0 0x7f02a40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.458+0000 7f029ffff700 1 -- 172.21.15.49:0/92469496 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f02ac083410 con 0x7f02b81564c0 2023-07-21T22:12:55.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.458+0000 7f02b77fe700 1 --2- 172.21.15.49:0/92469496 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f02a40662f0 0x7f02a40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.458+0000 7f02b77fe700 1 --2- 172.21.15.49:0/92469496 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f02a40662f0 0x7f02a40687a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f02a8014040 tx=0x7f02a8011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:55.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.462+0000 7f029ffff700 1 -- 172.21.15.49:0/92469496 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02b81f07e0 con 0x7f02b81564c0 2023-07-21T22:12:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.642+0000 7f02be034700 1 -- 172.21.15.49:0/92469496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02b81f07e0 con 0x7f02b81564c0 2023-07-21T22:12:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.642+0000 7f029ffff700 1 -- 172.21.15.49:0/92469496 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f02b81f07e0 con 0x7f02b81564c0 2023-07-21T22:12:55.690 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:12:55.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.646+0000 7f02be034700 1 -- 172.21.15.49:0/92469496 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f02a40662f0 msgr2=0x7f02a40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.646+0000 7f02be034700 1 --2- 172.21.15.49:0/92469496 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f02a40662f0 0x7f02a40687a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f02a8014040 tx=0x7f02a8011000 comp rx=0 tx=0).stop 2023-07-21T22:12:55.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.646+0000 7f02be034700 1 -- 172.21.15.49:0/92469496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b81564c0 msgr2=0x7f02b81585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.646+0000 7f02be034700 1 --2- 172.21.15.49:0/92469496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b81564c0 0x7f02b81585c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f02ac001260 tx=0x7f02ac00ca90 comp rx=0 tx=0).stop 2023-07-21T22:12:55.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.646+0000 7f02be034700 1 -- 172.21.15.49:0/92469496 shutdown_connections 2023-07-21T22:12:55.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.646+0000 7f02be034700 1 --2- 172.21.15.49:0/92469496 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f02a40662f0 0x7f02a40687a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.646+0000 7f02be034700 1 --2- 172.21.15.49:0/92469496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b81564c0 0x7f02b81585c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.646+0000 7f02be034700 1 --2- 172.21.15.49:0/92469496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02b815cfa0 0x7f02b80c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.646+0000 7f02be034700 1 --2- 172.21.15.49:0/92469496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b80c9990 0x7f02b80c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.646+0000 7f02be034700 1 -- 172.21.15.49:0/92469496 >> 172.21.15.49:0/92469496 conn(0x7f02b806e960 msgr2=0x7f02b8154000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:55.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.646+0000 7f02be034700 1 -- 172.21.15.49:0/92469496 shutdown_connections 2023-07-21T22:12:55.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.646+0000 7f02be034700 1 -- 172.21.15.49:0/92469496 wait complete. 2023-07-21T22:12:55.712 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:12:55.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.854+0000 7f8ed8f01700 1 Processor -- start 2023-07-21T22:12:55.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.854+0000 7f8ed8f01700 1 -- start start 2023-07-21T22:12:55.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.854+0000 7f8ed8f01700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ed415f9d0 0x7f8ed415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.854+0000 7f8ed8f01700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ed40c9610 0x7f8ed40c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.854+0000 7f8ed8f01700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed40c88c0 con 0x7f8ed40cabe0 2023-07-21T22:12:55.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.854+0000 7f8ed8f01700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed415c220 con 0x7f8ed415f9d0 2023-07-21T22:12:55.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.854+0000 7f8ed8f01700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed40c8b30 con 0x7f8ed40c9610 2023-07-21T22:12:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ecbfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ed415f9d0 0x7f8ed415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed259c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8ed40cabe0 0x7f8ed40cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38810/0 (socket says 172.21.15.49:38810) 2023-07-21T22:12:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed259c700 1 -- 172.21.15.49:0/1022031961 learned_addr learned my addr 172.21.15.49:0/1022031961 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed2d9d700 1 --2- 172.21.15.49:0/1022031961 >> v2:172.21.15.150:3300/0 conn(0x7f8ed40c9610 0x7f8ed40c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ecbfff700 1 -- 172.21.15.49:0/1022031961 >> v2:172.21.15.150:3300/0 conn(0x7f8ed40c9610 msgr2=0x7f8ed40c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:55.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ecbfff700 1 --2- 172.21.15.49:0/1022031961 >> v2:172.21.15.150:3300/0 conn(0x7f8ed40c9610 0x7f8ed40c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ecbfff700 1 -- 172.21.15.49:0/1022031961 >> v1:172.21.15.49:6789/0 conn(0x7f8ed40cabe0 legacy=0x7f8ed40cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ecbfff700 1 -- 172.21.15.49:0/1022031961 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed40c8e10 con 0x7f8ed415f9d0 2023-07-21T22:12:55.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed1d9b700 1 -- 172.21.15.49:0/1022031961 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150387390 0 0) 0x7f8ed40c88c0 con 0x7f8ed40cabe0 2023-07-21T22:12:55.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ecbfff700 1 --2- 172.21.15.49:0/1022031961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ed415f9d0 0x7f8ed415fe20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40cb6c0 tx=0x7f8ebc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb74b654c9275a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:55.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed1d9b700 1 -- 172.21.15.49:0/1022031961 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc005e50 con 0x7f8ed415f9d0 2023-07-21T22:12:55.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed1d9b700 1 -- 172.21.15.49:0/1022031961 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc006030 con 0x7f8ed415f9d0 2023-07-21T22:12:55.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed1d9b700 1 -- 172.21.15.49:0/1022031961 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0063c0 con 0x7f8ed415f9d0 2023-07-21T22:12:55.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1022031961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ed415f9d0 msgr2=0x7f8ed415fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed8f01700 1 --2- 172.21.15.49:0/1022031961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ed415f9d0 0x7f8ed415fe20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40cb6c0 tx=0x7f8ebc009b20 comp rx=0 tx=0).stop 2023-07-21T22:12:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1022031961 shutdown_connections 2023-07-21T22:12:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed8f01700 1 --2- 172.21.15.49:0/1022031961 >> v2:172.21.15.150:3300/0 conn(0x7f8ed40c9610 0x7f8ed40c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed8f01700 1 --2- 172.21.15.49:0/1022031961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ed415f9d0 0x7f8ed415fe20 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1022031961 >> 172.21.15.49:0/1022031961 conn(0x7f8ed406e960 msgr2=0x7f8ed406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:55.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1022031961 shutdown_connections 2023-07-21T22:12:55.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.858+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1022031961 wait complete. 2023-07-21T22:12:55.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.862+0000 7f8ed8f01700 1 Processor -- start 2023-07-21T22:12:55.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.862+0000 7f8ed8f01700 1 -- start start 2023-07-21T22:12:55.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed8f01700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed40c9610 0x7f8ed4149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed8f01700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ed40cabe0 0x7f8ed40b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed8f01700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ed415f9d0 0x7f8ed41561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed8f01700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed40b2c60 con 0x7f8ed415f9d0 2023-07-21T22:12:55.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed8f01700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed40b2f40 con 0x7f8ed40c9610 2023-07-21T22:12:55.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed8f01700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed40b3220 con 0x7f8ed40cabe0 2023-07-21T22:12:55.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed2d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ed415f9d0 0x7f8ed41561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed2d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ed415f9d0 0x7f8ed41561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52338/0 (socket says 172.21.15.49:52338) 2023-07-21T22:12:55.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed2d9d700 1 -- 172.21.15.49:0/1398859473 learned_addr learned my addr 172.21.15.49:0/1398859473 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:55.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed259c700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed40c9610 0x7f8ed4149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ecbfff700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ed40cabe0 0x7f8ed40b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed2d9d700 1 -- 172.21.15.49:0/1398859473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ed40cabe0 msgr2=0x7f8ed40b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed2d9d700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ed40cabe0 0x7f8ed40b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed2d9d700 1 -- 172.21.15.49:0/1398859473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed40c9610 msgr2=0x7f8ed4149100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:55.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed2d9d700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed40c9610 0x7f8ed4149100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:55.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed2d9d700 1 -- 172.21.15.49:0/1398859473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ebc009450 con 0x7f8ed415f9d0 2023-07-21T22:12:55.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed259c700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed40c9610 0x7f8ed4149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:55.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed2d9d700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ed415f9d0 0x7f8ed41561b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00efc0 tx=0x7f8ecc00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:55.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ecaffd700 1 -- 172.21.15.49:0/1398859473 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00cb80 con 0x7f8ed415f9d0 2023-07-21T22:12:55.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ecaffd700 1 -- 172.21.15.49:0/1398859473 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc00f040 con 0x7f8ed415f9d0 2023-07-21T22:12:55.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1398859473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed40b3500 con 0x7f8ed415f9d0 2023-07-21T22:12:55.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ecaffd700 1 -- 172.21.15.49:0/1398859473 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc014480 con 0x7f8ed415f9d0 2023-07-21T22:12:55.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.866+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1398859473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed40b1580 con 0x7f8ed415f9d0 2023-07-21T22:12:55.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.870+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1398859473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed40b3a20 con 0x7f8ed415f9d0 2023-07-21T22:12:55.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.870+0000 7f8ecaffd700 1 -- 172.21.15.49:0/1398859473 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ecc0145e0 con 0x7f8ed415f9d0 2023-07-21T22:12:55.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.870+0000 7f8ecaffd700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8eb40662f0 0x7f8eb40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:55.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.870+0000 7f8ecaffd700 1 -- 172.21.15.49:0/1398859473 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f8ecc084880 con 0x7f8ed415f9d0 2023-07-21T22:12:55.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.874+0000 7f8ed259c700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8eb40662f0 0x7f8eb40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:55.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.874+0000 7f8ed259c700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8eb40662f0 0x7f8eb40687a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4000f60 tx=0x7f8ec4007d50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:55.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:55.878+0000 7f8ecaffd700 1 -- 172.21.15.49:0/1398859473 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ecc051990 con 0x7f8ed415f9d0 2023-07-21T22:12:56.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.054+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1398859473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ed404dd50 con 0x7f8ed415f9d0 2023-07-21T22:12:56.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.054+0000 7f8ecaffd700 1 -- 172.21.15.49:0/1398859473 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ecc054fb0 con 0x7f8ed415f9d0 2023-07-21T22:12:56.100 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:12:56.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.058+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1398859473 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8eb40662f0 msgr2=0x7f8eb40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.058+0000 7f8ed8f01700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8eb40662f0 0x7f8eb40687a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4000f60 tx=0x7f8ec4007d50 comp rx=0 tx=0).stop 2023-07-21T22:12:56.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.058+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1398859473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ed415f9d0 msgr2=0x7f8ed41561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.058+0000 7f8ed8f01700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ed415f9d0 0x7f8ed41561b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00efc0 tx=0x7f8ecc00c0c0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.058+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1398859473 shutdown_connections 2023-07-21T22:12:56.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.058+0000 7f8ed8f01700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8eb40662f0 0x7f8eb40687a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.058+0000 7f8ed8f01700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ed415f9d0 0x7f8ed41561b0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.058+0000 7f8ed8f01700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ed40cabe0 0x7f8ed40b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.058+0000 7f8ed8f01700 1 --2- 172.21.15.49:0/1398859473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed40c9610 0x7f8ed4149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.058+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1398859473 >> 172.21.15.49:0/1398859473 conn(0x7f8ed406e960 msgr2=0x7f8ed40adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:56.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.058+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1398859473 shutdown_connections 2023-07-21T22:12:56.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.058+0000 7f8ed8f01700 1 -- 172.21.15.49:0/1398859473 wait complete. 2023-07-21T22:12:56.127 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-07-21T22:12:56.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.266+0000 7f7201bcd700 1 Processor -- start 2023-07-21T22:12:56.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.266+0000 7f7201bcd700 1 -- start start 2023-07-21T22:12:56.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.270+0000 7f7201bcd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f71fc1564c0 0x7f71fc0cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:56.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.270+0000 7f7201bcd700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71fc15d3e0 con 0x7f71fc0c9990 2023-07-21T22:12:56.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.270+0000 7f7201bcd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71fc0c8bd0 con 0x7f71fc15cfa0 2023-07-21T22:12:56.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.270+0000 7f7201bcd700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71fc0c9570 con 0x7f71fc1564c0 2023-07-21T22:12:56.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.270+0000 7f71fb7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f71fc1564c0 0x7f71fc0cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:56.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.270+0000 7f71faffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f71fc0c9990 0x7f71fc15c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38814/0 (socket says 172.21.15.49:38814) 2023-07-21T22:12:56.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.270+0000 7f71faffd700 1 -- 172.21.15.49:0/1601557059 learned_addr learned my addr 172.21.15.49:0/1601557059 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:56.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.270+0000 7f71fa7fc700 1 -- 172.21.15.49:0/1601557059 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174887472 0 0) 0x7f71fc15d3e0 con 0x7f71fc0c9990 2023-07-21T22:12:56.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.270+0000 7f71fb7fe700 1 -- 172.21.15.49:0/1601557059 >> v1:172.21.15.150:6789/0 conn(0x7f71fc15cfa0 legacy=0x7f71fc06d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.270+0000 7f71fb7fe700 1 -- 172.21.15.49:0/1601557059 >> v1:172.21.15.49:6789/0 conn(0x7f71fc0c9990 legacy=0x7f71fc15c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.270+0000 7f71fb7fe700 1 -- 172.21.15.49:0/1601557059 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc0c8eb0 con 0x7f71fc1564c0 2023-07-21T22:12:56.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.270+0000 7f71fb7fe700 1 --2- 172.21.15.49:0/1601557059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc1564c0 0x7f71fc0cdf40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009850 tx=0x7f71ec009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e315bdfbc4845844 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:56.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.274+0000 7f71fa7fc700 1 -- 172.21.15.49:0/1601557059 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00f8a0 con 0x7f71fc1564c0 2023-07-21T22:12:56.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.274+0000 7f71fa7fc700 1 -- 172.21.15.49:0/1601557059 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec00fa00 con 0x7f71fc1564c0 2023-07-21T22:12:56.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.274+0000 7f71fa7fc700 1 -- 172.21.15.49:0/1601557059 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00fd90 con 0x7f71fc1564c0 2023-07-21T22:12:56.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.274+0000 7f7201bcd700 1 -- 172.21.15.49:0/1601557059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc1564c0 msgr2=0x7f71fc0cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.274+0000 7f7201bcd700 1 --2- 172.21.15.49:0/1601557059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc1564c0 0x7f71fc0cdf40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009850 tx=0x7f71ec009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.274+0000 7f7201bcd700 1 -- 172.21.15.49:0/1601557059 shutdown_connections 2023-07-21T22:12:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.274+0000 7f7201bcd700 1 --2- 172.21.15.49:0/1601557059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc1564c0 0x7f71fc0cdf40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.274+0000 7f7201bcd700 1 -- 172.21.15.49:0/1601557059 >> 172.21.15.49:0/1601557059 conn(0x7f71fc06e960 msgr2=0x7f71fc06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.274+0000 7f7201bcd700 1 -- 172.21.15.49:0/1601557059 shutdown_connections 2023-07-21T22:12:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.274+0000 7f7201bcd700 1 -- 172.21.15.49:0/1601557059 wait complete. 2023-07-21T22:12:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f7201bcd700 1 Processor -- start 2023-07-21T22:12:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f7201bcd700 1 -- start start 2023-07-21T22:12:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f7201bcd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0c9990 0x7f71fc1ecb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f7201bcd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71fc1564c0 0x7f71fc157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f7201bcd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71fc15cfa0 0x7f71fc0c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f7201bcd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc1ed050 con 0x7f71fc0c9990 2023-07-21T22:12:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f7201bcd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc15a680 con 0x7f71fc15cfa0 2023-07-21T22:12:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f7201bcd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc15a960 con 0x7f71fc1564c0 2023-07-21T22:12:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f71fb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0c9990 0x7f71fc1ecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f71fb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0c9990 0x7f71fc1ecb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52352/0 (socket says 172.21.15.49:52352) 2023-07-21T22:12:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f71fb7fe700 1 -- 172.21.15.49:0/526874404 learned_addr learned my addr 172.21.15.49:0/526874404 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f71faffd700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71fc1564c0 0x7f71fc157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f71fbfff700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71fc15cfa0 0x7f71fc0c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f71fb7fe700 1 -- 172.21.15.49:0/526874404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71fc1564c0 msgr2=0x7f71fc157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f71fb7fe700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71fc1564c0 0x7f71fc157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f71fb7fe700 1 -- 172.21.15.49:0/526874404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71fc15cfa0 msgr2=0x7f71fc0c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f71fb7fe700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71fc15cfa0 0x7f71fc0c1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f71fb7fe700 1 -- 172.21.15.49:0/526874404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec0094b0 con 0x7f71fc0c9990 2023-07-21T22:12:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.278+0000 7f71fbfff700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71fc15cfa0 0x7f71fc0c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.282+0000 7f71fb7fe700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0c9990 0x7f71fc1ecb10 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0090b0 tx=0x7f71ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.282+0000 7f71e3fff700 1 -- 172.21.15.49:0/526874404 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec01e070 con 0x7f71fc0c9990 2023-07-21T22:12:56.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.282+0000 7f71e3fff700 1 -- 172.21.15.49:0/526874404 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec010b10 con 0x7f71fc0c9990 2023-07-21T22:12:56.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.282+0000 7f7201bcd700 1 -- 172.21.15.49:0/526874404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71fc15ac40 con 0x7f71fc0c9990 2023-07-21T22:12:56.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.282+0000 7f71e3fff700 1 -- 172.21.15.49:0/526874404 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec024420 con 0x7f71fc0c9990 2023-07-21T22:12:56.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.282+0000 7f7201bcd700 1 -- 172.21.15.49:0/526874404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71fc15b200 con 0x7f71fc0c9990 2023-07-21T22:12:56.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.282+0000 7f7201bcd700 1 -- 172.21.15.49:0/526874404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71fc04dd50 con 0x7f71fc0c9990 2023-07-21T22:12:56.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.282+0000 7f71e3fff700 1 -- 172.21.15.49:0/526874404 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f71ec022070 con 0x7f71fc0c9990 2023-07-21T22:12:56.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.286+0000 7f71e3fff700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71e80662f0 0x7f71e80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:56.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.286+0000 7f71e3fff700 1 -- 172.21.15.49:0/526874404 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f71ec0870b0 con 0x7f71fc0c9990 2023-07-21T22:12:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.286+0000 7f71faffd700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71e80662f0 0x7f71e80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.286+0000 7f71faffd700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71e80662f0 0x7f71e80687a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0c4240 tx=0x7f71f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:56.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.294+0000 7f71e3fff700 1 -- 172.21.15.49:0/526874404 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f71ec054250 con 0x7f71fc0c9990 2023-07-21T22:12:56.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.466+0000 7f7201bcd700 1 -- 172.21.15.49:0/526874404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f71fc0b4100 con 0x7f71fc0c9990 2023-07-21T22:12:56.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.466+0000 7f71e3fff700 1 -- 172.21.15.49:0/526874404 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v47) v1 ==== 97+0+11 (secure 0 0 0) 0x7f71ec057870 con 0x7f71fc0c9990 2023-07-21T22:12:56.514 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:12:56.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.470+0000 7f7201bcd700 1 -- 172.21.15.49:0/526874404 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71e80662f0 msgr2=0x7f71e80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.470+0000 7f7201bcd700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71e80662f0 0x7f71e80687a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0c4240 tx=0x7f71f0009040 comp rx=0 tx=0).stop 2023-07-21T22:12:56.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.470+0000 7f7201bcd700 1 -- 172.21.15.49:0/526874404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0c9990 msgr2=0x7f71fc1ecb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.470+0000 7f7201bcd700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0c9990 0x7f71fc1ecb10 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0090b0 tx=0x7f71ec004770 comp rx=0 tx=0).stop 2023-07-21T22:12:56.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.470+0000 7f7201bcd700 1 -- 172.21.15.49:0/526874404 shutdown_connections 2023-07-21T22:12:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.470+0000 7f7201bcd700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71e80662f0 0x7f71e80687a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.470+0000 7f7201bcd700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71fc15cfa0 0x7f71fc0c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.470+0000 7f7201bcd700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71fc1564c0 0x7f71fc157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.470+0000 7f7201bcd700 1 --2- 172.21.15.49:0/526874404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0c9990 0x7f71fc1ecb10 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.470+0000 7f7201bcd700 1 -- 172.21.15.49:0/526874404 >> 172.21.15.49:0/526874404 conn(0x7f71fc06e960 msgr2=0x7f71fc0cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.474+0000 7f7201bcd700 1 -- 172.21.15.49:0/526874404 shutdown_connections 2023-07-21T22:12:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.474+0000 7f7201bcd700 1 -- 172.21.15.49:0/526874404 wait complete. 2023-07-21T22:12:56.540 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:12:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.674+0000 7f1ac4b5f700 1 Processor -- start 2023-07-21T22:12:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.674+0000 7f1ac4b5f700 1 -- start start 2023-07-21T22:12:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.678+0000 7f1ac4b5f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1ac015bf30 0x7f1ac00ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:56.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.678+0000 7f1ac4b5f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1ac00cbc40 0x7f1ac00afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:56.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.678+0000 7f1ac4b5f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac00cb270 con 0x7f1ac00b0030 2023-07-21T22:12:56.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.678+0000 7f1ac4b5f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac00ac8e0 con 0x7f1ac015bf30 2023-07-21T22:12:56.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.678+0000 7f1ac4b5f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac015c300 con 0x7f1ac00cbc40 2023-07-21T22:12:56.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.678+0000 7f1abf7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1ac015bf30 0x7f1ac00ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:56.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.678+0000 7f1abf7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1ac015bf30 0x7f1ac00ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52362/0 (socket says 172.21.15.49:52362) 2023-07-21T22:12:56.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.678+0000 7f1abf7fe700 1 -- 172.21.15.49:0/2747561742 learned_addr learned my addr 172.21.15.49:0/2747561742 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:56.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.678+0000 7f1abeffd700 1 --2- 172.21.15.49:0/2747561742 >> v2:172.21.15.150:3300/0 conn(0x7f1ac00cbc40 0x7f1ac00afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:56.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.678+0000 7f1abf7fe700 1 -- 172.21.15.49:0/2747561742 >> v2:172.21.15.150:3300/0 conn(0x7f1ac00cbc40 msgr2=0x7f1ac00afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:56.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.678+0000 7f1abf7fe700 1 --2- 172.21.15.49:0/2747561742 >> v2:172.21.15.150:3300/0 conn(0x7f1ac00cbc40 0x7f1ac00afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.678+0000 7f1abf7fe700 1 -- 172.21.15.49:0/2747561742 >> v1:172.21.15.150:6789/0 conn(0x7f1ac00b0030 legacy=0x7f1ac015f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.678+0000 7f1abf7fe700 1 -- 172.21.15.49:0/2747561742 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac00acac0 con 0x7f1ac015bf30 2023-07-21T22:12:56.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.678+0000 7f1abf7fe700 1 --2- 172.21.15.49:0/2747561742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac015bf30 0x7f1ac00ad350 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00c1940 tx=0x7f1ab0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acb961b4cab8eb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:56.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.682+0000 7f1abe7fc700 1 -- 172.21.15.49:0/2747561742 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0011830 con 0x7f1ac015bf30 2023-07-21T22:12:56.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.682+0000 7f1abe7fc700 1 -- 172.21.15.49:0/2747561742 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab0011990 con 0x7f1ac015bf30 2023-07-21T22:12:56.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.682+0000 7f1abe7fc700 1 -- 172.21.15.49:0/2747561742 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0011d20 con 0x7f1ac015bf30 2023-07-21T22:12:56.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.682+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/2747561742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac015bf30 msgr2=0x7f1ac00ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.682+0000 7f1ac4b5f700 1 --2- 172.21.15.49:0/2747561742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac015bf30 0x7f1ac00ad350 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00c1940 tx=0x7f1ab0009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.682+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/2747561742 shutdown_connections 2023-07-21T22:12:56.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.682+0000 7f1ac4b5f700 1 --2- 172.21.15.49:0/2747561742 >> v2:172.21.15.150:3300/0 conn(0x7f1ac00cbc40 0x7f1ac00afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.682+0000 7f1ac4b5f700 1 --2- 172.21.15.49:0/2747561742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac015bf30 0x7f1ac00ad350 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.682+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/2747561742 >> 172.21.15.49:0/2747561742 conn(0x7f1ac0070450 msgr2=0x7f1ac0070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:56.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.682+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/2747561742 shutdown_connections 2023-07-21T22:12:56.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.682+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/2747561742 wait complete. 2023-07-21T22:12:56.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1ac4b5f700 1 Processor -- start 2023-07-21T22:12:56.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1ac4b5f700 1 -- start start 2023-07-21T22:12:56.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1ac4b5f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac00b0030 0x7f1ac00af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:56.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1ac4b5f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ac00cbc40 0x7f1ac015d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:56.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1ac4b5f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ac015bf30 0x7f1ac00c2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:56.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1ac4b5f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac00c3b30 con 0x7f1ac00b0030 2023-07-21T22:12:56.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1ac4b5f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac00c3850 con 0x7f1ac015bf30 2023-07-21T22:12:56.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1ac4b5f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac00b0fd0 con 0x7f1ac00cbc40 2023-07-21T22:12:56.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1abf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac00b0030 0x7f1ac00af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:56.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1abf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac00b0030 0x7f1ac00af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52376/0 (socket says 172.21.15.49:52376) 2023-07-21T22:12:56.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1abf7fe700 1 -- 172.21.15.49:0/1629088701 learned_addr learned my addr 172.21.15.49:0/1629088701 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1abf7fe700 1 -- 172.21.15.49:0/1629088701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ac00cbc40 msgr2=0x7f1ac015d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1abf7fe700 1 --2- 172.21.15.49:0/1629088701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ac00cbc40 0x7f1ac015d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1abf7fe700 1 -- 172.21.15.49:0/1629088701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ac015bf30 msgr2=0x7f1ac00c2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1abffff700 1 --2- 172.21.15.49:0/1629088701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ac015bf30 0x7f1ac00c2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1abf7fe700 1 --2- 172.21.15.49:0/1629088701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ac015bf30 0x7f1ac00c2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1abf7fe700 1 -- 172.21.15.49:0/1629088701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab0009570 con 0x7f1ac00b0030 2023-07-21T22:12:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.686+0000 7f1abffff700 1 --2- 172.21.15.49:0/1629088701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ac015bf30 0x7f1ac00c2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.690+0000 7f1abf7fe700 1 --2- 172.21.15.49:0/1629088701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac00b0030 0x7f1ac00af4c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00cbbf0 tx=0x7f1ab0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.690+0000 7f1aa7fff700 1 -- 172.21.15.49:0/1629088701 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0004550 con 0x7f1ac00b0030 2023-07-21T22:12:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.690+0000 7f1aa7fff700 1 -- 172.21.15.49:0/1629088701 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab001f070 con 0x7f1ac00b0030 2023-07-21T22:12:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.690+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/1629088701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac00b12b0 con 0x7f1ac00b0030 2023-07-21T22:12:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.690+0000 7f1aa7fff700 1 -- 172.21.15.49:0/1629088701 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0003900 con 0x7f1ac00b0030 2023-07-21T22:12:56.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.690+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/1629088701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac00afa00 con 0x7f1ac00b0030 2023-07-21T22:12:56.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.690+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/1629088701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac004dcb0 con 0x7f1ac00b0030 2023-07-21T22:12:56.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.694+0000 7f1aa7fff700 1 -- 172.21.15.49:0/1629088701 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1ab0003a60 con 0x7f1ac00b0030 2023-07-21T22:12:56.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.694+0000 7f1aa7fff700 1 --2- 172.21.15.49:0/1629088701 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1aac0662f0 0x7f1aac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:56.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.694+0000 7f1aa7fff700 1 -- 172.21.15.49:0/1629088701 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f1ab0021070 con 0x7f1ac00b0030 2023-07-21T22:12:56.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.694+0000 7f1abeffd700 1 --2- 172.21.15.49:0/1629088701 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1aac0662f0 0x7f1aac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:56.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.694+0000 7f1abeffd700 1 --2- 172.21.15.49:0/1629088701 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1aac0662f0 0x7f1aac0687a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4006b40 tx=0x7f1ab4006ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:56.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.702+0000 7f1aa7fff700 1 -- 172.21.15.49:0/1629088701 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1ab0052720 con 0x7f1ac00b0030 2023-07-21T22:12:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.890+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/1629088701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1ac00ca400 con 0x7f1ac00b0030 2023-07-21T22:12:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.890+0000 7f1aa7fff700 1 -- 172.21.15.49:0/1629088701 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1ab0055d40 con 0x7f1ac00b0030 2023-07-21T22:12:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.894+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/1629088701 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1aac0662f0 msgr2=0x7f1aac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.894+0000 7f1ac4b5f700 1 --2- 172.21.15.49:0/1629088701 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1aac0662f0 0x7f1aac0687a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4006b40 tx=0x7f1ab4006ad0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.894+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/1629088701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac00b0030 msgr2=0x7f1ac00af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.894+0000 7f1ac4b5f700 1 --2- 172.21.15.49:0/1629088701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac00b0030 0x7f1ac00af4c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00cbbf0 tx=0x7f1ab0004770 comp rx=0 tx=0).stop 2023-07-21T22:12:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.894+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/1629088701 shutdown_connections 2023-07-21T22:12:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.894+0000 7f1ac4b5f700 1 --2- 172.21.15.49:0/1629088701 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1aac0662f0 0x7f1aac0687a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.894+0000 7f1ac4b5f700 1 --2- 172.21.15.49:0/1629088701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ac015bf30 0x7f1ac00c2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.894+0000 7f1ac4b5f700 1 --2- 172.21.15.49:0/1629088701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ac00cbc40 0x7f1ac015d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.894+0000 7f1ac4b5f700 1 --2- 172.21.15.49:0/1629088701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac00b0030 0x7f1ac00af4c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.894+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/1629088701 >> 172.21.15.49:0/1629088701 conn(0x7f1ac0070450 msgr2=0x7f1ac00ad9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.894+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/1629088701 shutdown_connections 2023-07-21T22:12:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:56.894+0000 7f1ac4b5f700 1 -- 172.21.15.49:0/1629088701 wait complete. 2023-07-21T22:12:56.943 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:12:56.962 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:12:56.962 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:12:56.980 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:12:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.158+0000 7f78a30aa700 1 Processor -- start 2023-07-21T22:12:57.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.158+0000 7f78a30aa700 1 -- start start 2023-07-21T22:12:57.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.158+0000 7f78a30aa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f789c06d5d0 0x7f789c06d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:57.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.158+0000 7f78a30aa700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f789c159f60 0x7f789c0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:57.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.158+0000 7f78a30aa700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789c06dee0 con 0x7f789c0b0160 2023-07-21T22:12:57.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.158+0000 7f78a30aa700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f789c0b0600 con 0x7f789c159f60 2023-07-21T22:12:57.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.158+0000 7f78a30aa700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f789c15a470 con 0x7f789c06d5d0 2023-07-21T22:12:57.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f7893fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f789c159f60 0x7f789c0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:57.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f7893fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f789c159f60 0x7f789c0afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52378/0 (socket says 172.21.15.49:52378) 2023-07-21T22:12:57.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f7893fff700 1 -- 172.21.15.49:0/632132612 learned_addr learned my addr 172.21.15.49:0/632132612 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:57.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f78a0e46700 1 --2- 172.21.15.49:0/632132612 >> v2:172.21.15.150:3300/0 conn(0x7f789c06d5d0 0x7f789c06d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:57.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f7893fff700 1 -- 172.21.15.49:0/632132612 >> v2:172.21.15.150:3300/0 conn(0x7f789c06d5d0 msgr2=0x7f789c06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:57.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f7893fff700 1 --2- 172.21.15.49:0/632132612 >> v2:172.21.15.150:3300/0 conn(0x7f789c06d5d0 0x7f789c06d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f7893fff700 1 -- 172.21.15.49:0/632132612 >> v1:172.21.15.49:6789/0 conn(0x7f789c0b0160 legacy=0x7f789c070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:57.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f7893fff700 1 -- 172.21.15.49:0/632132612 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c15a750 con 0x7f789c159f60 2023-07-21T22:12:57.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f78a0e46700 1 --2- 172.21.15.49:0/632132612 >> v2:172.21.15.150:3300/0 conn(0x7f789c06d5d0 0x7f789c06d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:57.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f7893fff700 1 --2- 172.21.15.49:0/632132612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f789c159f60 0x7f789c0afc20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f789c06d2e0 tx=0x7f788c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336be2979223be56 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:57.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f78937fe700 1 -- 172.21.15.49:0/632132612 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c00b8a0 con 0x7f789c159f60 2023-07-21T22:12:57.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f78937fe700 1 -- 172.21.15.49:0/632132612 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c00ba00 con 0x7f789c159f60 2023-07-21T22:12:57.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f78937fe700 1 -- 172.21.15.49:0/632132612 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c00bd90 con 0x7f789c159f60 2023-07-21T22:12:57.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f78a30aa700 1 -- 172.21.15.49:0/632132612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f789c159f60 msgr2=0x7f789c0afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:57.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f78a30aa700 1 --2- 172.21.15.49:0/632132612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f789c159f60 0x7f789c0afc20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f789c06d2e0 tx=0x7f788c009bf0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f78a30aa700 1 -- 172.21.15.49:0/632132612 shutdown_connections 2023-07-21T22:12:57.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f78a30aa700 1 --2- 172.21.15.49:0/632132612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f789c159f60 0x7f789c0afc20 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f78a30aa700 1 --2- 172.21.15.49:0/632132612 >> v2:172.21.15.150:3300/0 conn(0x7f789c06d5d0 0x7f789c06d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f78a30aa700 1 -- 172.21.15.49:0/632132612 >> 172.21.15.49:0/632132612 conn(0x7f789c06f5a0 msgr2=0x7f789c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:57.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f78a30aa700 1 -- 172.21.15.49:0/632132612 shutdown_connections 2023-07-21T22:12:57.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.162+0000 7f78a30aa700 1 -- 172.21.15.49:0/632132612 wait complete. 2023-07-21T22:12:57.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.166+0000 7f78a30aa700 1 Processor -- start 2023-07-21T22:12:57.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.166+0000 7f78a30aa700 1 -- start start 2023-07-21T22:12:57.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.166+0000 7f78a30aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f789c06d5d0 0x7f789c0c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:57.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.166+0000 7f78a30aa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f789c0b0160 0x7f789c0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:57.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.166+0000 7f78a30aa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f789c159f60 0x7f789c0c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:57.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.166+0000 7f78a30aa700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c0c7070 con 0x7f789c159f60 2023-07-21T22:12:57.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.166+0000 7f78a30aa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c159510 con 0x7f789c0b0160 2023-07-21T22:12:57.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.166+0000 7f78a30aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789c0b0fd0 con 0x7f789c06d5d0 2023-07-21T22:12:57.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.166+0000 7f78a1647700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f789c159f60 0x7f789c0c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:57.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.166+0000 7f78a1647700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f789c159f60 0x7f789c0c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52380/0 (socket says 172.21.15.49:52380) 2023-07-21T22:12:57.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.170+0000 7f78a1647700 1 -- 172.21.15.49:0/3063634532 learned_addr learned my addr 172.21.15.49:0/3063634532 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:57.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.170+0000 7f78a0e46700 1 --2- 172.21.15.49:0/3063634532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f789c06d5d0 0x7f789c0c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:57.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.170+0000 7f7893fff700 1 --2- 172.21.15.49:0/3063634532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f789c0b0160 0x7f789c0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:57.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.170+0000 7f78a1647700 1 -- 172.21.15.49:0/3063634532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f789c06d5d0 msgr2=0x7f789c0c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:57.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.170+0000 7f78a1647700 1 --2- 172.21.15.49:0/3063634532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f789c06d5d0 0x7f789c0c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.170+0000 7f78a1647700 1 -- 172.21.15.49:0/3063634532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f789c0b0160 msgr2=0x7f789c0c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:57.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.170+0000 7f78a1647700 1 --2- 172.21.15.49:0/3063634532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f789c0b0160 0x7f789c0c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.170+0000 7f78a1647700 1 -- 172.21.15.49:0/3063634532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c009570 con 0x7f789c159f60 2023-07-21T22:12:57.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.170+0000 7f78a1647700 1 --2- 172.21.15.49:0/3063634532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f789c159f60 0x7f789c0c8d30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f789400cbc0 tx=0x7f789400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:57.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.170+0000 7f78917fa700 1 -- 172.21.15.49:0/3063634532 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894003c20 con 0x7f789c159f60 2023-07-21T22:12:57.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.170+0000 7f78917fa700 1 -- 172.21.15.49:0/3063634532 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7894003d80 con 0x7f789c159f60 2023-07-21T22:12:57.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.170+0000 7f78917fa700 1 -- 172.21.15.49:0/3063634532 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789400aa20 con 0x7f789c159f60 2023-07-21T22:12:57.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.170+0000 7f78a30aa700 1 -- 172.21.15.49:0/3063634532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f789c0c63f0 con 0x7f789c159f60 2023-07-21T22:12:57.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.170+0000 7f78a30aa700 1 -- 172.21.15.49:0/3063634532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789c0c69b0 con 0x7f789c159f60 2023-07-21T22:12:57.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.174+0000 7f78a30aa700 1 -- 172.21.15.49:0/3063634532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789c073130 con 0x7f789c159f60 2023-07-21T22:12:57.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.174+0000 7f78917fa700 1 -- 172.21.15.49:0/3063634532 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f789400ab80 con 0x7f789c159f60 2023-07-21T22:12:57.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.174+0000 7f78917fa700 1 --2- 172.21.15.49:0/3063634532 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f78880662f0 0x7f78880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:57.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.174+0000 7f78917fa700 1 -- 172.21.15.49:0/3063634532 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f7894083f50 con 0x7f789c159f60 2023-07-21T22:12:57.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.174+0000 7f78a0e46700 1 --2- 172.21.15.49:0/3063634532 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f78880662f0 0x7f78880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:57.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.174+0000 7f78a0e46700 1 --2- 172.21.15.49:0/3063634532 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f78880662f0 0x7f78880687a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f78980044b0 tx=0x7f7898008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:57.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.182+0000 7f78917fa700 1 -- 172.21.15.49:0/3063634532 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7894051070 con 0x7f789c159f60 2023-07-21T22:12:57.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.362+0000 7f78a30aa700 1 -- 172.21.15.49:0/3063634532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f789c0c71b0 con 0x7f789c159f60 2023-07-21T22:12:57.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.362+0000 7f78917fa700 1 -- 172.21.15.49:0/3063634532 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+20239 (secure 0 0 0) 0x7f789c0c71b0 con 0x7f789c159f60 2023-07-21T22:12:57.411 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:12:57.412 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":47,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:12:39.024259+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:12:20.014383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T22:12:21.059436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"data_new","create_time":"2023-07-21T22:12:36.491357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:12:57.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.370+0000 7f78a30aa700 1 -- 172.21.15.49:0/3063634532 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f78880662f0 msgr2=0x7f78880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:57.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.370+0000 7f78a30aa700 1 --2- 172.21.15.49:0/3063634532 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f78880662f0 0x7f78880687a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f78980044b0 tx=0x7f7898008040 comp rx=0 tx=0).stop 2023-07-21T22:12:57.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.370+0000 7f78a30aa700 1 -- 172.21.15.49:0/3063634532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f789c159f60 msgr2=0x7f789c0c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:57.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.370+0000 7f78a30aa700 1 --2- 172.21.15.49:0/3063634532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f789c159f60 0x7f789c0c8d30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f789400cbc0 tx=0x7f789400ced0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.370+0000 7f78a30aa700 1 -- 172.21.15.49:0/3063634532 shutdown_connections 2023-07-21T22:12:57.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.370+0000 7f78a30aa700 1 --2- 172.21.15.49:0/3063634532 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f78880662f0 0x7f78880687a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.370+0000 7f78a30aa700 1 --2- 172.21.15.49:0/3063634532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f789c159f60 0x7f789c0c8d30 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.370+0000 7f78a30aa700 1 --2- 172.21.15.49:0/3063634532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f789c0b0160 0x7f789c0c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.370+0000 7f78a30aa700 1 --2- 172.21.15.49:0/3063634532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f789c06d5d0 0x7f789c0c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.370+0000 7f78a30aa700 1 -- 172.21.15.49:0/3063634532 >> 172.21.15.49:0/3063634532 conn(0x7f789c06f5a0 msgr2=0x7f789c15b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:57.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.370+0000 7f78a30aa700 1 -- 172.21.15.49:0/3063634532 shutdown_connections 2023-07-21T22:12:57.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.370+0000 7f78a30aa700 1 -- 172.21.15.49:0/3063634532 wait complete. 2023-07-21T22:12:57.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:12:20.014383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:12:21.059436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'data_new', 'create_time': '2023-07-21T22:12:36.491357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:12:57.440 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:12:57.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.578+0000 7f9b3759e700 1 Processor -- start 2023-07-21T22:12:57.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.578+0000 7f9b3759e700 1 -- start start 2023-07-21T22:12:57.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b3759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b381603e0 0x7f9b38164370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:57.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b3759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b381648b0 0x7f9b380cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:57.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b3759e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b38163ee0 con 0x7f9b38160010 2023-07-21T22:12:57.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b3759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b380cdf70 con 0x7f9b381603e0 2023-07-21T22:12:57.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b3759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380cd6d0 con 0x7f9b381648b0 2023-07-21T22:12:57.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b35d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b381603e0 0x7f9b38164370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:57.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b35d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b381603e0 0x7f9b38164370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:34586/0 (socket says 172.21.15.49:34586) 2023-07-21T22:12:57.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b35d9b700 1 -- 172.21.15.49:0/2799565724 learned_addr learned my addr 172.21.15.49:0/2799565724 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:57.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b36d9d700 1 --2- 172.21.15.49:0/2799565724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b381648b0 0x7f9b380cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:57.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b35d9b700 1 -- 172.21.15.49:0/2799565724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b381648b0 msgr2=0x7f9b380cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:57.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b35d9b700 1 --2- 172.21.15.49:0/2799565724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b381648b0 0x7f9b380cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b35d9b700 1 -- 172.21.15.49:0/2799565724 >> v1:172.21.15.150:6789/0 conn(0x7f9b38160010 legacy=0x7f9b380ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:57.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b35d9b700 1 -- 172.21.15.49:0/2799565724 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b380cd9b0 con 0x7f9b381603e0 2023-07-21T22:12:57.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b36d9d700 1 --2- 172.21.15.49:0/2799565724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b381648b0 0x7f9b380cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:57.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b35d9b700 1 --2- 172.21.15.49:0/2799565724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b381603e0 0x7f9b38164370 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009910 tx=0x7f9b2c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5090c58d5f29826 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:57.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.582+0000 7f9b3559a700 1 -- 172.21.15.49:0/2799565724 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c00ba60 con 0x7f9b381603e0 2023-07-21T22:12:57.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.586+0000 7f9b3559a700 1 -- 172.21.15.49:0/2799565724 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c00bbc0 con 0x7f9b381603e0 2023-07-21T22:12:57.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.586+0000 7f9b3559a700 1 -- 172.21.15.49:0/2799565724 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c009e60 con 0x7f9b381603e0 2023-07-21T22:12:57.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.586+0000 7f9b3759e700 1 -- 172.21.15.49:0/2799565724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b381603e0 msgr2=0x7f9b38164370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:57.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.586+0000 7f9b3759e700 1 --2- 172.21.15.49:0/2799565724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b381603e0 0x7f9b38164370 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009910 tx=0x7f9b2c009c20 comp rx=0 tx=0).stop 2023-07-21T22:12:57.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.586+0000 7f9b3759e700 1 -- 172.21.15.49:0/2799565724 shutdown_connections 2023-07-21T22:12:57.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.586+0000 7f9b3759e700 1 --2- 172.21.15.49:0/2799565724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b381648b0 0x7f9b380cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.586+0000 7f9b3759e700 1 --2- 172.21.15.49:0/2799565724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b381603e0 0x7f9b38164370 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.586+0000 7f9b3759e700 1 -- 172.21.15.49:0/2799565724 >> 172.21.15.49:0/2799565724 conn(0x7f9b380ce0d0 msgr2=0x7f9b380ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:57.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.586+0000 7f9b3759e700 1 -- 172.21.15.49:0/2799565724 shutdown_connections 2023-07-21T22:12:57.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.586+0000 7f9b3759e700 1 -- 172.21.15.49:0/2799565724 wait complete. 2023-07-21T22:12:57.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.590+0000 7f9b3759e700 1 Processor -- start 2023-07-21T22:12:57.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.590+0000 7f9b3759e700 1 -- start start 2023-07-21T22:12:57.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.590+0000 7f9b3759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b38160010 0x7f9b3806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:57.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.590+0000 7f9b3759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b381603e0 0x7f9b3814c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:57.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.590+0000 7f9b3759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b381648b0 0x7f9b3806be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:57.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.590+0000 7f9b3759e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3806d210 con 0x7f9b381603e0 2023-07-21T22:12:57.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.590+0000 7f9b3759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3814c6f0 con 0x7f9b38160010 2023-07-21T22:12:57.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.590+0000 7f9b3759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b381f9b60 con 0x7f9b381648b0 2023-07-21T22:12:57.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.590+0000 7f9b35d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b381603e0 0x7f9b3814c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:57.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.590+0000 7f9b35d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b381603e0 0x7f9b3814c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52382/0 (socket says 172.21.15.49:52382) 2023-07-21T22:12:57.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.590+0000 7f9b35d9b700 1 -- 172.21.15.49:0/3484024856 learned_addr learned my addr 172.21.15.49:0/3484024856 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:57.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.590+0000 7f9b3659c700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b38160010 0x7f9b3806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:57.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.590+0000 7f9b36d9d700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b381648b0 0x7f9b3806be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:57.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.594+0000 7f9b35d9b700 1 -- 172.21.15.49:0/3484024856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b381648b0 msgr2=0x7f9b3806be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:57.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.594+0000 7f9b35d9b700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b381648b0 0x7f9b3806be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.594+0000 7f9b35d9b700 1 -- 172.21.15.49:0/3484024856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b38160010 msgr2=0x7f9b3806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.594+0000 7f9b35d9b700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b38160010 0x7f9b3806ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.594+0000 7f9b35d9b700 1 -- 172.21.15.49:0/3484024856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c009570 con 0x7f9b381603e0 2023-07-21T22:12:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.594+0000 7f9b3659c700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b38160010 0x7f9b3806ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.594+0000 7f9b35d9b700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b381603e0 0x7f9b3814c1b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00b3c0 tx=0x7f9b2c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:57.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.594+0000 7f9b26ffd700 1 -- 172.21.15.49:0/3484024856 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c004610 con 0x7f9b381603e0 2023-07-21T22:12:57.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.594+0000 7f9b26ffd700 1 -- 172.21.15.49:0/3484024856 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c01f070 con 0x7f9b381603e0 2023-07-21T22:12:57.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.594+0000 7f9b3759e700 1 -- 172.21.15.49:0/3484024856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b381f8fe0 con 0x7f9b381603e0 2023-07-21T22:12:57.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.594+0000 7f9b26ffd700 1 -- 172.21.15.49:0/3484024856 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c003900 con 0x7f9b381603e0 2023-07-21T22:12:57.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.594+0000 7f9b3759e700 1 -- 172.21.15.49:0/3484024856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b381f95a0 con 0x7f9b381603e0 2023-07-21T22:12:57.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.594+0000 7f9b3759e700 1 -- 172.21.15.49:0/3484024856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3814e2b0 con 0x7f9b381603e0 2023-07-21T22:12:57.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.598+0000 7f9b26ffd700 1 -- 172.21.15.49:0/3484024856 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b2c003a60 con 0x7f9b381603e0 2023-07-21T22:12:57.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.598+0000 7f9b26ffd700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9b180662f0 0x7f9b180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:57.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.598+0000 7f9b26ffd700 1 -- 172.21.15.49:0/3484024856 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f9b2c021070 con 0x7f9b381603e0 2023-07-21T22:12:57.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.602+0000 7f9b3659c700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9b180662f0 0x7f9b180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:57.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.602+0000 7f9b3659c700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9b180662f0 0x7f9b180687a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9b28000f60 tx=0x7f9b28009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:57.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.606+0000 7f9b26ffd700 1 -- 172.21.15.49:0/3484024856 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b3814e2b0 con 0x7f9b381603e0 2023-07-21T22:12:57.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.782+0000 7f9b3759e700 1 -- 172.21.15.49:0/3484024856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b3814e2b0 con 0x7f9b381603e0 2023-07-21T22:12:57.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.782+0000 7f9b26ffd700 1 -- 172.21.15.49:0/3484024856 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b3814e2b0 con 0x7f9b381603e0 2023-07-21T22:12:57.830 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:12:57.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.786+0000 7f9b3759e700 1 -- 172.21.15.49:0/3484024856 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9b180662f0 msgr2=0x7f9b180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:57.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.786+0000 7f9b3759e700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9b180662f0 0x7f9b180687a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9b28000f60 tx=0x7f9b28009040 comp rx=0 tx=0).stop 2023-07-21T22:12:57.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.786+0000 7f9b3759e700 1 -- 172.21.15.49:0/3484024856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b381603e0 msgr2=0x7f9b3814c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:57.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.786+0000 7f9b3759e700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b381603e0 0x7f9b3814c1b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00b3c0 tx=0x7f9b2c004770 comp rx=0 tx=0).stop 2023-07-21T22:12:57.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.786+0000 7f9b3759e700 1 -- 172.21.15.49:0/3484024856 shutdown_connections 2023-07-21T22:12:57.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.786+0000 7f9b3759e700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9b180662f0 0x7f9b180687a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.786+0000 7f9b3759e700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b381603e0 0x7f9b3814c1b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.786+0000 7f9b3759e700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b381648b0 0x7f9b3806be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.786+0000 7f9b3759e700 1 --2- 172.21.15.49:0/3484024856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b38160010 0x7f9b3806ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:57.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.786+0000 7f9b3759e700 1 -- 172.21.15.49:0/3484024856 >> 172.21.15.49:0/3484024856 conn(0x7f9b380ce0d0 msgr2=0x7f9b38160960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:57.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.786+0000 7f9b3759e700 1 -- 172.21.15.49:0/3484024856 shutdown_connections 2023-07-21T22:12:57.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.786+0000 7f9b3759e700 1 -- 172.21.15.49:0/3484024856 wait complete. 2023-07-21T22:12:57.855 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:12:58.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.990+0000 7f02e4f15700 1 Processor -- start 2023-07-21T22:12:58.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.990+0000 7f02e4f15700 1 -- start start 2023-07-21T22:12:58.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02e4f15700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f02e00b7af0 0x7f02e00b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02e4f15700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f02e00cee10 0x7f02e00cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02e4f15700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e00b3e80 con 0x7f02e00d1e40 2023-07-21T22:12:58.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02e4f15700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e00cf790 con 0x7f02e00cee10 2023-07-21T22:12:58.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02e4f15700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e015fd40 con 0x7f02e00b7af0 2023-07-21T22:12:58.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02dffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f02e00cee10 0x7f02e00cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02deffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f02e00d1e40 0x7f02e015f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38834/0 (socket says 172.21.15.49:38834) 2023-07-21T22:12:58.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02deffd700 1 -- 172.21.15.49:0/3294811138 learned_addr learned my addr 172.21.15.49:0/3294811138 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:58.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02df7fe700 1 --2- 172.21.15.49:0/3294811138 >> v2:172.21.15.150:3300/0 conn(0x7f02e00b7af0 0x7f02e00b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02dffff700 1 -- 172.21.15.49:0/3294811138 >> v2:172.21.15.150:3300/0 conn(0x7f02e00b7af0 msgr2=0x7f02e00b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:58.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02dffff700 1 --2- 172.21.15.49:0/3294811138 >> v2:172.21.15.150:3300/0 conn(0x7f02e00b7af0 0x7f02e00b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02dffff700 1 -- 172.21.15.49:0/3294811138 >> v1:172.21.15.49:6789/0 conn(0x7f02e00d1e40 legacy=0x7f02e015f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02dffff700 1 -- 172.21.15.49:0/3294811138 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e00cea00 con 0x7f02e00cee10 2023-07-21T22:12:58.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02dffff700 1 --2- 172.21.15.49:0/3294811138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cee10 0x7f02e00cf250 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f02e00cede0 tx=0x7f02d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7aeec52fbb9699 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:58.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02de7fc700 1 -- 172.21.15.49:0/3294811138 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d800e070 con 0x7f02e00cee10 2023-07-21T22:12:58.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02de7fc700 1 -- 172.21.15.49:0/3294811138 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d800bb20 con 0x7f02e00cee10 2023-07-21T22:12:58.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.994+0000 7f02de7fc700 1 -- 172.21.15.49:0/3294811138 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8012430 con 0x7f02e00cee10 2023-07-21T22:12:58.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.998+0000 7f02e4f15700 1 -- 172.21.15.49:0/3294811138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cee10 msgr2=0x7f02e00cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.998+0000 7f02e4f15700 1 --2- 172.21.15.49:0/3294811138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cee10 0x7f02e00cf250 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f02e00cede0 tx=0x7f02d800b330 comp rx=0 tx=0).stop 2023-07-21T22:12:58.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.998+0000 7f02e4f15700 1 -- 172.21.15.49:0/3294811138 shutdown_connections 2023-07-21T22:12:58.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.998+0000 7f02e4f15700 1 --2- 172.21.15.49:0/3294811138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cee10 0x7f02e00cf250 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.998+0000 7f02e4f15700 1 --2- 172.21.15.49:0/3294811138 >> v2:172.21.15.150:3300/0 conn(0x7f02e00b7af0 0x7f02e00b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.998+0000 7f02e4f15700 1 -- 172.21.15.49:0/3294811138 >> 172.21.15.49:0/3294811138 conn(0x7f02e006e960 msgr2=0x7f02e006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:58.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.998+0000 7f02e4f15700 1 -- 172.21.15.49:0/3294811138 shutdown_connections 2023-07-21T22:12:58.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:57.998+0000 7f02e4f15700 1 -- 172.21.15.49:0/3294811138 wait complete. 2023-07-21T22:12:58.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.002+0000 7f02e4f15700 1 Processor -- start 2023-07-21T22:12:58.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.002+0000 7f02e4f15700 1 -- start start 2023-07-21T22:12:58.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.002+0000 7f02e4f15700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02e00b7af0 0x7f02e014da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.002+0000 7f02e4f15700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cee10 0x7f02e00c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.002+0000 7f02e4f15700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02e00d1e40 0x7f02e014cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.002+0000 7f02e4f15700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00c9a10 con 0x7f02e00cee10 2023-07-21T22:12:58.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.002+0000 7f02e4f15700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00ca7c0 con 0x7f02e00b7af0 2023-07-21T22:12:58.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.002+0000 7f02e4f15700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00c9c40 con 0x7f02e00d1e40 2023-07-21T22:12:58.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.002+0000 7f02deffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cee10 0x7f02e00c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.002+0000 7f02deffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cee10 0x7f02e00c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52400/0 (socket says 172.21.15.49:52400) 2023-07-21T22:12:58.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.002+0000 7f02deffd700 1 -- 172.21.15.49:0/2552936578 learned_addr learned my addr 172.21.15.49:0/2552936578 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:58.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.002+0000 7f02df7fe700 1 --2- 172.21.15.49:0/2552936578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02e00b7af0 0x7f02e014da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.002+0000 7f02dffff700 1 --2- 172.21.15.49:0/2552936578 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02e00d1e40 0x7f02e014cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.006+0000 7f02deffd700 1 -- 172.21.15.49:0/2552936578 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02e00d1e40 msgr2=0x7f02e014cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.006+0000 7f02deffd700 1 --2- 172.21.15.49:0/2552936578 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02e00d1e40 0x7f02e014cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.006+0000 7f02deffd700 1 -- 172.21.15.49:0/2552936578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02e00b7af0 msgr2=0x7f02e014da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.006+0000 7f02deffd700 1 --2- 172.21.15.49:0/2552936578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02e00b7af0 0x7f02e014da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.006+0000 7f02deffd700 1 -- 172.21.15.49:0/2552936578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d8009a70 con 0x7f02e00cee10 2023-07-21T22:12:58.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.006+0000 7f02deffd700 1 --2- 172.21.15.49:0/2552936578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cee10 0x7f02e00c94d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f02d4001eb0 tx=0x7f02d400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:58.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.006+0000 7f02c7fff700 1 -- 172.21.15.49:0/2552936578 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4005d90 con 0x7f02e00cee10 2023-07-21T22:12:58.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.006+0000 7f02c7fff700 1 -- 172.21.15.49:0/2552936578 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d40070d0 con 0x7f02e00cee10 2023-07-21T22:12:58.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.006+0000 7f02e4f15700 1 -- 172.21.15.49:0/2552936578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e00c9f20 con 0x7f02e00cee10 2023-07-21T22:12:58.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.006+0000 7f02c7fff700 1 -- 172.21.15.49:0/2552936578 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4007440 con 0x7f02e00cee10 2023-07-21T22:12:58.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.006+0000 7f02e4f15700 1 -- 172.21.15.49:0/2552936578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e00ca4e0 con 0x7f02e00cee10 2023-07-21T22:12:58.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.006+0000 7f02e4f15700 1 -- 172.21.15.49:0/2552936578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e00c5fc0 con 0x7f02e00cee10 2023-07-21T22:12:58.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.010+0000 7f02c7fff700 1 -- 172.21.15.49:0/2552936578 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f02d40075a0 con 0x7f02e00cee10 2023-07-21T22:12:58.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.010+0000 7f02c7fff700 1 --2- 172.21.15.49:0/2552936578 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f02cc0662f0 0x7f02cc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.014+0000 7f02c7fff700 1 -- 172.21.15.49:0/2552936578 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f02d4083210 con 0x7f02e00cee10 2023-07-21T22:12:58.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.014+0000 7f02df7fe700 1 --2- 172.21.15.49:0/2552936578 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f02cc0662f0 0x7f02cc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.014+0000 7f02df7fe700 1 --2- 172.21.15.49:0/2552936578 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f02cc0662f0 0x7f02cc0687a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f02e00c81d0 tx=0x7f02d0009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:58.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.018+0000 7f02c7fff700 1 -- 172.21.15.49:0/2552936578 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02e00c5fc0 con 0x7f02e00cee10 2023-07-21T22:12:58.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.194+0000 7f02e4f15700 1 -- 172.21.15.49:0/2552936578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f02e00c5fc0 con 0x7f02e00cee10 2023-07-21T22:12:58.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.194+0000 7f02c7fff700 1 -- 172.21.15.49:0/2552936578 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f02e00c5fc0 con 0x7f02e00cee10 2023-07-21T22:12:58.242 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:12:58.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.198+0000 7f02e4f15700 1 -- 172.21.15.49:0/2552936578 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f02cc0662f0 msgr2=0x7f02cc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.198+0000 7f02e4f15700 1 --2- 172.21.15.49:0/2552936578 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f02cc0662f0 0x7f02cc0687a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f02e00c81d0 tx=0x7f02d0009240 comp rx=0 tx=0).stop 2023-07-21T22:12:58.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.198+0000 7f02e4f15700 1 -- 172.21.15.49:0/2552936578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cee10 msgr2=0x7f02e00c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.198+0000 7f02e4f15700 1 --2- 172.21.15.49:0/2552936578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cee10 0x7f02e00c94d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f02d4001eb0 tx=0x7f02d400c7b0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.198+0000 7f02e4f15700 1 -- 172.21.15.49:0/2552936578 shutdown_connections 2023-07-21T22:12:58.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.198+0000 7f02e4f15700 1 --2- 172.21.15.49:0/2552936578 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f02cc0662f0 0x7f02cc0687a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.198+0000 7f02e4f15700 1 --2- 172.21.15.49:0/2552936578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cee10 0x7f02e00c94d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.198+0000 7f02e4f15700 1 --2- 172.21.15.49:0/2552936578 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02e00d1e40 0x7f02e014cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.198+0000 7f02e4f15700 1 --2- 172.21.15.49:0/2552936578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02e00b7af0 0x7f02e014da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.198+0000 7f02e4f15700 1 -- 172.21.15.49:0/2552936578 >> 172.21.15.49:0/2552936578 conn(0x7f02e006e960 msgr2=0x7f02e00d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:58.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.198+0000 7f02e4f15700 1 -- 172.21.15.49:0/2552936578 shutdown_connections 2023-07-21T22:12:58.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.198+0000 7f02e4f15700 1 -- 172.21.15.49:0/2552936578 wait complete. 2023-07-21T22:12:58.267 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:12:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.398+0000 7f7d87858700 1 Processor -- start 2023-07-21T22:12:58.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.398+0000 7f7d87858700 1 -- start start 2023-07-21T22:12:58.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d87858700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7d8015e380 0x7f7d800cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d87858700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d800b3a50 0x7f7d800cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d87858700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d800ca190 con 0x7f7d800c9cd0 2023-07-21T22:12:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d87858700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d80159fd0 con 0x7f7d8015e380 2023-07-21T22:12:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d87858700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8015d6e0 con 0x7f7d800b3a50 2023-07-21T22:12:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d85df5700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7d800c9cd0 0x7f7d800c8820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38846/0 (socket says 172.21.15.49:38846) 2023-07-21T22:12:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d85df5700 1 -- 172.21.15.49:0/3316625758 learned_addr learned my addr 172.21.15.49:0/3316625758 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d855f4700 1 --2- 172.21.15.49:0/3316625758 >> v2:172.21.15.150:3300/0 conn(0x7f7d8015e380 0x7f7d800cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d84df3700 1 --2- 172.21.15.49:0/3316625758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d800b3a50 0x7f7d800cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d77fff700 1 -- 172.21.15.49:0/3316625758 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762700666 0 0) 0x7f7d800ca190 con 0x7f7d800c9cd0 2023-07-21T22:12:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d77fff700 1 -- 172.21.15.49:0/3316625758 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d6c0035d0 con 0x7f7d800c9cd0 2023-07-21T22:12:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d84df3700 1 -- 172.21.15.49:0/3316625758 >> v2:172.21.15.150:3300/0 conn(0x7f7d8015e380 msgr2=0x7f7d800cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d84df3700 1 --2- 172.21.15.49:0/3316625758 >> v2:172.21.15.150:3300/0 conn(0x7f7d8015e380 0x7f7d800cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d84df3700 1 -- 172.21.15.49:0/3316625758 >> v1:172.21.15.49:6789/0 conn(0x7f7d800c9cd0 legacy=0x7f7d800c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d77fff700 1 -- 172.21.15.49:0/3316625758 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1720916999 0 0) 0x7f7d6c0035d0 con 0x7f7d800c9cd0 2023-07-21T22:12:58.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d84df3700 1 -- 172.21.15.49:0/3316625758 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d800ca900 con 0x7f7d800b3a50 2023-07-21T22:12:58.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d84df3700 1 --2- 172.21.15.49:0/3316625758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d800b3a50 0x7f7d800cb120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009840 tx=0x7f7d70009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ca0bbd206942650 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:58.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d77fff700 1 -- 172.21.15.49:0/3316625758 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d780019f0 con 0x7f7d800b3a50 2023-07-21T22:12:58.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d77fff700 1 -- 172.21.15.49:0/3316625758 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d70004030 con 0x7f7d800b3a50 2023-07-21T22:12:58.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.402+0000 7f7d77fff700 1 -- 172.21.15.49:0/3316625758 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d700043c0 con 0x7f7d800b3a50 2023-07-21T22:12:58.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.406+0000 7f7d87858700 1 -- 172.21.15.49:0/3316625758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d800b3a50 msgr2=0x7f7d800cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.406+0000 7f7d87858700 1 --2- 172.21.15.49:0/3316625758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d800b3a50 0x7f7d800cb120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009840 tx=0x7f7d70009b50 comp rx=0 tx=0).stop 2023-07-21T22:12:58.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.406+0000 7f7d87858700 1 -- 172.21.15.49:0/3316625758 shutdown_connections 2023-07-21T22:12:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.406+0000 7f7d87858700 1 --2- 172.21.15.49:0/3316625758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d800b3a50 0x7f7d800cb120 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.406+0000 7f7d87858700 1 --2- 172.21.15.49:0/3316625758 >> v2:172.21.15.150:3300/0 conn(0x7f7d8015e380 0x7f7d800cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.406+0000 7f7d87858700 1 -- 172.21.15.49:0/3316625758 >> 172.21.15.49:0/3316625758 conn(0x7f7d8006e960 msgr2=0x7f7d8006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.406+0000 7f7d87858700 1 -- 172.21.15.49:0/3316625758 shutdown_connections 2023-07-21T22:12:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.406+0000 7f7d87858700 1 -- 172.21.15.49:0/3316625758 wait complete. 2023-07-21T22:12:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d87858700 1 Processor -- start 2023-07-21T22:12:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d87858700 1 -- start start 2023-07-21T22:12:58.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d87858700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d800b3a50 0x7f7d8015c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d87858700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d800c9cd0 0x7f7d800c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d87858700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d8015e380 0x7f7d800c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d87858700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d801f0290 con 0x7f7d800c9cd0 2023-07-21T22:12:58.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d87858700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d801f0b30 con 0x7f7d800b3a50 2023-07-21T22:12:58.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d87858700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800c9110 con 0x7f7d8015e380 2023-07-21T22:12:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d84df3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d800c9cd0 0x7f7d800c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d84df3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d800c9cd0 0x7f7d800c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52406/0 (socket says 172.21.15.49:52406) 2023-07-21T22:12:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d84df3700 1 -- 172.21.15.49:0/2972656707 learned_addr learned my addr 172.21.15.49:0/2972656707 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d855f4700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d800b3a50 0x7f7d8015c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d85df5700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d8015e380 0x7f7d800c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d84df3700 1 -- 172.21.15.49:0/2972656707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d8015e380 msgr2=0x7f7d800c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d84df3700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d8015e380 0x7f7d800c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d84df3700 1 -- 172.21.15.49:0/2972656707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d800b3a50 msgr2=0x7f7d8015c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d84df3700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d800b3a50 0x7f7d8015c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d84df3700 1 -- 172.21.15.49:0/2972656707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d70009450 con 0x7f7d800c9cd0 2023-07-21T22:12:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d855f4700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d800b3a50 0x7f7d8015c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:12:58.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.410+0000 7f7d84df3700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d800c9cd0 0x7f7d800c8690 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7d800b3a00 tx=0x7f7d70004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:58.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.414+0000 7f7d75ffb700 1 -- 172.21.15.49:0/2972656707 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d700039c0 con 0x7f7d800c9cd0 2023-07-21T22:12:58.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.414+0000 7f7d75ffb700 1 -- 172.21.15.49:0/2972656707 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d70020070 con 0x7f7d800c9cd0 2023-07-21T22:12:58.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.414+0000 7f7d87858700 1 -- 172.21.15.49:0/2972656707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d801eff20 con 0x7f7d800c9cd0 2023-07-21T22:12:58.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.414+0000 7f7d75ffb700 1 -- 172.21.15.49:0/2972656707 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70003d40 con 0x7f7d800c9cd0 2023-07-21T22:12:58.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.414+0000 7f7d87858700 1 -- 172.21.15.49:0/2972656707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d801f07c0 con 0x7f7d800c9cd0 2023-07-21T22:12:58.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.414+0000 7f7d87858700 1 -- 172.21.15.49:0/2972656707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d801f0ce0 con 0x7f7d800c9cd0 2023-07-21T22:12:58.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.418+0000 7f7d75ffb700 1 -- 172.21.15.49:0/2972656707 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d70022030 con 0x7f7d800c9cd0 2023-07-21T22:12:58.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.418+0000 7f7d75ffb700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7d64066320 0x7f7d640687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.418+0000 7f7d75ffb700 1 -- 172.21.15.49:0/2972656707 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f7d70085740 con 0x7f7d800c9cd0 2023-07-21T22:12:58.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.418+0000 7f7d855f4700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7d64066320 0x7f7d640687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.418+0000 7f7d855f4700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7d64066320 0x7f7d640687d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009f40 tx=0x7f7d7c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:58.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.426+0000 7f7d75ffb700 1 -- 172.21.15.49:0/2972656707 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d801f0ce0 con 0x7f7d800c9cd0 2023-07-21T22:12:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.602+0000 7f7d87858700 1 -- 172.21.15.49:0/2972656707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d801f0ca0 con 0x7f7d800c9cd0 2023-07-21T22:12:58.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.606+0000 7f7d75ffb700 1 -- 172.21.15.49:0/2972656707 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7d700528e0 con 0x7f7d800c9cd0 2023-07-21T22:12:58.651 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:12:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.606+0000 7f7d87858700 1 -- 172.21.15.49:0/2972656707 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7d64066320 msgr2=0x7f7d640687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.606+0000 7f7d87858700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7d64066320 0x7f7d640687d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009f40 tx=0x7f7d7c009240 comp rx=0 tx=0).stop 2023-07-21T22:12:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.606+0000 7f7d87858700 1 -- 172.21.15.49:0/2972656707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d800c9cd0 msgr2=0x7f7d800c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.606+0000 7f7d87858700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d800c9cd0 0x7f7d800c8690 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7d800b3a00 tx=0x7f7d70004770 comp rx=0 tx=0).stop 2023-07-21T22:12:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.606+0000 7f7d87858700 1 -- 172.21.15.49:0/2972656707 shutdown_connections 2023-07-21T22:12:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.606+0000 7f7d87858700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7d64066320 0x7f7d640687d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.606+0000 7f7d87858700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d800c9cd0 0x7f7d800c8690 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.606+0000 7f7d87858700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d8015e380 0x7f7d800c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.606+0000 7f7d87858700 1 --2- 172.21.15.49:0/2972656707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d800b3a50 0x7f7d8015c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.606+0000 7f7d87858700 1 -- 172.21.15.49:0/2972656707 >> 172.21.15.49:0/2972656707 conn(0x7f7d8006e960 msgr2=0x7f7d80158c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:58.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.610+0000 7f7d87858700 1 -- 172.21.15.49:0/2972656707 shutdown_connections 2023-07-21T22:12:58.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.610+0000 7f7d87858700 1 -- 172.21.15.49:0/2972656707 wait complete. 2023-07-21T22:12:58.676 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:12:58.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.814+0000 7f2dcdd03700 1 Processor -- start 2023-07-21T22:12:58.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.814+0000 7f2dcdd03700 1 -- start start 2023-07-21T22:12:58.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.814+0000 7f2dcdd03700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2dc8159be0 0x7f2dc80c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.814+0000 7f2dcdd03700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc80c8b80 con 0x7f2dc80ca550 2023-07-21T22:12:58.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.814+0000 7f2dcdd03700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc806db90 con 0x7f2dc80698a0 2023-07-21T22:12:58.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.814+0000 7f2dcdd03700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc806de70 con 0x7f2dc8159be0 2023-07-21T22:12:58.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.814+0000 7f2dc7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2dc80ca550 0x7f2dc806d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38852/0 (socket says 172.21.15.49:38852) 2023-07-21T22:12:58.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.814+0000 7f2dc7fff700 1 -- 172.21.15.49:0/2907858899 learned_addr learned my addr 172.21.15.49:0/2907858899 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:58.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dccd01700 1 --2- 172.21.15.49:0/2907858899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2dc8159be0 0x7f2dc80c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dc77fe700 1 -- 172.21.15.49:0/2907858899 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536859820 0 0) 0x7f2dc80c8b80 con 0x7f2dc80ca550 2023-07-21T22:12:58.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dc77fe700 1 -- 172.21.15.49:0/2907858899 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db80035d0 con 0x7f2dc80ca550 2023-07-21T22:12:58.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dc77fe700 1 -- 172.21.15.49:0/2907858899 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295059787 0 0) 0x7f2dc806db90 con 0x7f2dc80698a0 2023-07-21T22:12:58.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dc77fe700 1 -- 172.21.15.49:0/2907858899 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc80c8b80 con 0x7f2dc80698a0 2023-07-21T22:12:58.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dccd01700 1 -- 172.21.15.49:0/2907858899 >> v1:172.21.15.150:6789/0 conn(0x7f2dc80698a0 legacy=0x7f2dc80c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dc77fe700 1 -- 172.21.15.49:0/2907858899 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3991215849 0 0) 0x7f2db80035d0 con 0x7f2dc80ca550 2023-07-21T22:12:58.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dccd01700 1 -- 172.21.15.49:0/2907858899 >> v1:172.21.15.49:6789/0 conn(0x7f2dc80ca550 legacy=0x7f2dc806d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dccd01700 1 -- 172.21.15.49:0/2907858899 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc80c8810 con 0x7f2dc8159be0 2023-07-21T22:12:58.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dccd01700 1 --2- 172.21.15.49:0/2907858899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2dc8159be0 0x7f2dc80c9010 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009880 tx=0x7f2dbc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e96645b84d4110bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:58.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dc77fe700 1 -- 172.21.15.49:0/2907858899 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4001670 con 0x7f2dc8159be0 2023-07-21T22:12:58.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dc77fe700 1 -- 172.21.15.49:0/2907858899 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc004030 con 0x7f2dc8159be0 2023-07-21T22:12:58.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dc77fe700 1 -- 172.21.15.49:0/2907858899 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0043a0 con 0x7f2dc8159be0 2023-07-21T22:12:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dcdd03700 1 -- 172.21.15.49:0/2907858899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2dc8159be0 msgr2=0x7f2dc80c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dcdd03700 1 --2- 172.21.15.49:0/2907858899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2dc8159be0 0x7f2dc80c9010 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009880 tx=0x7f2dbc009b90 comp rx=0 tx=0).stop 2023-07-21T22:12:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dcdd03700 1 -- 172.21.15.49:0/2907858899 shutdown_connections 2023-07-21T22:12:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dcdd03700 1 --2- 172.21.15.49:0/2907858899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2dc8159be0 0x7f2dc80c9010 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dcdd03700 1 -- 172.21.15.49:0/2907858899 >> 172.21.15.49:0/2907858899 conn(0x7f2dc80ce0d0 msgr2=0x7f2dc80ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dcdd03700 1 -- 172.21.15.49:0/2907858899 shutdown_connections 2023-07-21T22:12:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.818+0000 7f2dcdd03700 1 -- 172.21.15.49:0/2907858899 wait complete. 2023-07-21T22:12:58.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.822+0000 7f2dcdd03700 1 Processor -- start 2023-07-21T22:12:58.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.822+0000 7f2dcdd03700 1 -- start start 2023-07-21T22:12:58.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.822+0000 7f2dcdd03700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2dc80698a0 0x7f2dc80c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.822+0000 7f2dcdd03700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dc80ca550 0x7f2dc81f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.822+0000 7f2dcdd03700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2dc8159be0 0x7f2dc81f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.822+0000 7f2dcdd03700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc81f20f0 con 0x7f2dc80ca550 2023-07-21T22:12:58.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.822+0000 7f2dcdd03700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc80c6370 con 0x7f2dc80698a0 2023-07-21T22:12:58.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.822+0000 7f2dcdd03700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc80c6650 con 0x7f2dc8159be0 2023-07-21T22:12:58.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.822+0000 7f2dc7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dc80ca550 0x7f2dc81f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.822+0000 7f2dc7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dc80ca550 0x7f2dc81f4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52416/0 (socket says 172.21.15.49:52416) 2023-07-21T22:12:58.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.822+0000 7f2dc7fff700 1 -- 172.21.15.49:0/1168622780 learned_addr learned my addr 172.21.15.49:0/1168622780 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:58.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dccd01700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2dc80698a0 0x7f2dc80c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dcd502700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2dc8159be0 0x7f2dc81f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dc7fff700 1 -- 172.21.15.49:0/1168622780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2dc8159be0 msgr2=0x7f2dc81f4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dc7fff700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2dc8159be0 0x7f2dc81f4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dc7fff700 1 -- 172.21.15.49:0/1168622780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2dc80698a0 msgr2=0x7f2dc80c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:58.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dc7fff700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2dc80698a0 0x7f2dc80c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:58.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dc7fff700 1 -- 172.21.15.49:0/1168622780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc0094b0 con 0x7f2dc80ca550 2023-07-21T22:12:58.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dcd502700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2dc8159be0 0x7f2dc81f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:58.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dccd01700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2dc80698a0 0x7f2dc80c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:58.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dc7fff700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dc80ca550 0x7f2dc81f4520 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c730 tx=0x7f2db400caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:58.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dc57fa700 1 -- 172.21.15.49:0/1168622780 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4004ca0 con 0x7f2dc80ca550 2023-07-21T22:12:58.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dcdd03700 1 -- 172.21.15.49:0/1168622780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc80c6930 con 0x7f2dc80ca550 2023-07-21T22:12:58.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dc57fa700 1 -- 172.21.15.49:0/1168622780 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db4004e20 con 0x7f2dc80ca550 2023-07-21T22:12:58.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dc57fa700 1 -- 172.21.15.49:0/1168622780 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4007310 con 0x7f2dc80ca550 2023-07-21T22:12:58.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dcdd03700 1 -- 172.21.15.49:0/1168622780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc80c6010 con 0x7f2dc80ca550 2023-07-21T22:12:58.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.826+0000 7f2dcdd03700 1 -- 172.21.15.49:0/1168622780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc81f2260 con 0x7f2dc80ca550 2023-07-21T22:12:58.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.830+0000 7f2dc57fa700 1 -- 172.21.15.49:0/1168622780 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2db4007470 con 0x7f2dc80ca550 2023-07-21T22:12:58.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.830+0000 7f2dc57fa700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2dac0662f0 0x7f2dac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:58.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.830+0000 7f2dc57fa700 1 -- 172.21.15.49:0/1168622780 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f2db4083330 con 0x7f2dc80ca550 2023-07-21T22:12:58.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.830+0000 7f2dccd01700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2dac0662f0 0x7f2dac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:58.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.834+0000 7f2dccd01700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2dac0662f0 0x7f2dac0687a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc000c00 tx=0x7f2dbc010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:58.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:58.838+0000 7f2dc57fa700 1 -- 172.21.15.49:0/1168622780 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2db4050460 con 0x7f2dc80ca550 2023-07-21T22:12:59.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.014+0000 7f2dcdd03700 1 -- 172.21.15.49:0/1168622780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2dc804dcb0 con 0x7f2dc80ca550 2023-07-21T22:12:59.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.014+0000 7f2dc57fa700 1 -- 172.21.15.49:0/1168622780 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2db4007720 con 0x7f2dc80ca550 2023-07-21T22:12:59.061 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:12:59.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.018+0000 7f2dcdd03700 1 -- 172.21.15.49:0/1168622780 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2dac0662f0 msgr2=0x7f2dac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:59.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.018+0000 7f2dcdd03700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2dac0662f0 0x7f2dac0687a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc000c00 tx=0x7f2dbc010000 comp rx=0 tx=0).stop 2023-07-21T22:12:59.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.018+0000 7f2dcdd03700 1 -- 172.21.15.49:0/1168622780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dc80ca550 msgr2=0x7f2dc81f4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:59.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.018+0000 7f2dcdd03700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dc80ca550 0x7f2dc81f4520 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c730 tx=0x7f2db400caf0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.018+0000 7f2dcdd03700 1 -- 172.21.15.49:0/1168622780 shutdown_connections 2023-07-21T22:12:59.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.018+0000 7f2dcdd03700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2dac0662f0 0x7f2dac0687a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.018+0000 7f2dcdd03700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dc80ca550 0x7f2dc81f4520 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.018+0000 7f2dcdd03700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2dc8159be0 0x7f2dc81f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.018+0000 7f2dcdd03700 1 --2- 172.21.15.49:0/1168622780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2dc80698a0 0x7f2dc80c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.018+0000 7f2dcdd03700 1 -- 172.21.15.49:0/1168622780 >> 172.21.15.49:0/1168622780 conn(0x7f2dc80ce0d0 msgr2=0x7f2dc80706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:59.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.018+0000 7f2dcdd03700 1 -- 172.21.15.49:0/1168622780 shutdown_connections 2023-07-21T22:12:59.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.018+0000 7f2dcdd03700 1 -- 172.21.15.49:0/1168622780 wait complete. 2023-07-21T22:12:59.087 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-07-21T22:12:59.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.222+0000 7f41be51f700 1 Processor -- start 2023-07-21T22:12:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.222+0000 7f41be51f700 1 -- start start 2023-07-21T22:12:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41be51f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f41b806e960 0x7f41b806ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41be51f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41b80ce2f0 0x7f41b80ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:59.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41be51f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b8159da0 con 0x7f41b80698a0 2023-07-21T22:12:59.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41be51f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b8160930 con 0x7f41b806e960 2023-07-21T22:12:59.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41be51f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b806f270 con 0x7f41b80ce2f0 2023-07-21T22:12:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41bdd1e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f41b80698a0 0x7f41b8069d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38868/0 (socket says 172.21.15.49:38868) 2023-07-21T22:12:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41bdd1e700 1 -- 172.21.15.49:0/4288409417 learned_addr learned my addr 172.21.15.49:0/4288409417 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41bd51d700 1 --2- 172.21.15.49:0/4288409417 >> v2:172.21.15.150:3300/0 conn(0x7f41b806e960 0x7f41b806ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41bcd1c700 1 --2- 172.21.15.49:0/4288409417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41b80ce2f0 0x7f41b80ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41affff700 1 -- 172.21.15.49:0/4288409417 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504401337 0 0) 0x7f41b8159da0 con 0x7f41b80698a0 2023-07-21T22:12:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41affff700 1 -- 172.21.15.49:0/4288409417 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41a40035d0 con 0x7f41b80698a0 2023-07-21T22:12:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41bd51d700 1 -- 172.21.15.49:0/4288409417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41b80ce2f0 msgr2=0x7f41b80ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41bd51d700 1 --2- 172.21.15.49:0/4288409417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41b80ce2f0 0x7f41b80ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41bd51d700 1 -- 172.21.15.49:0/4288409417 >> v1:172.21.15.49:6789/0 conn(0x7f41b80698a0 legacy=0x7f41b8069d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.226+0000 7f41bd51d700 1 -- 172.21.15.49:0/4288409417 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b80cee70 con 0x7f41b806e960 2023-07-21T22:12:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.230+0000 7f41bd51d700 1 --2- 172.21.15.49:0/4288409417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41b806e960 0x7f41b806ed30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009850 tx=0x7f41b4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aea73bce101234 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.230+0000 7f41affff700 1 -- 172.21.15.49:0/4288409417 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4011830 con 0x7f41b806e960 2023-07-21T22:12:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.230+0000 7f41affff700 1 -- 172.21.15.49:0/4288409417 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b4011990 con 0x7f41b806e960 2023-07-21T22:12:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.230+0000 7f41affff700 1 -- 172.21.15.49:0/4288409417 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4011d40 con 0x7f41b806e960 2023-07-21T22:12:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.230+0000 7f41be51f700 1 -- 172.21.15.49:0/4288409417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41b806e960 msgr2=0x7f41b806ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.230+0000 7f41be51f700 1 --2- 172.21.15.49:0/4288409417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41b806e960 0x7f41b806ed30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009850 tx=0x7f41b4009b60 comp rx=0 tx=0).stop 2023-07-21T22:12:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.230+0000 7f41be51f700 1 -- 172.21.15.49:0/4288409417 shutdown_connections 2023-07-21T22:12:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.230+0000 7f41be51f700 1 --2- 172.21.15.49:0/4288409417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41b80ce2f0 0x7f41b80ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.230+0000 7f41be51f700 1 --2- 172.21.15.49:0/4288409417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41b806e960 0x7f41b806ed30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.230+0000 7f41be51f700 1 -- 172.21.15.49:0/4288409417 >> 172.21.15.49:0/4288409417 conn(0x7f41b806fa70 msgr2=0x7f41b806fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:59.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.230+0000 7f41be51f700 1 -- 172.21.15.49:0/4288409417 shutdown_connections 2023-07-21T22:12:59.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.230+0000 7f41be51f700 1 -- 172.21.15.49:0/4288409417 wait complete. 2023-07-21T22:12:59.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.234+0000 7f41be51f700 1 Processor -- start 2023-07-21T22:12:59.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.234+0000 7f41be51f700 1 -- start start 2023-07-21T22:12:59.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.234+0000 7f41be51f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41b80698a0 0x7f41b80ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:59.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.234+0000 7f41be51f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41b806e960 0x7f41b80af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:59.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41be51f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41b80ce2f0 0x7f41b80afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:59.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41be51f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b81464d0 con 0x7f41b80698a0 2023-07-21T22:12:59.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41be51f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b81467b0 con 0x7f41b80ce2f0 2023-07-21T22:12:59.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41be51f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b8146a90 con 0x7f41b806e960 2023-07-21T22:12:59.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41bd51d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41b80698a0 0x7f41b80ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:59.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41bd51d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41b80698a0 0x7f41b80ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52420/0 (socket says 172.21.15.49:52420) 2023-07-21T22:12:59.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41bd51d700 1 -- 172.21.15.49:0/2559063976 learned_addr learned my addr 172.21.15.49:0/2559063976 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:59.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41bcd1c700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41b806e960 0x7f41b80af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:59.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41bdd1e700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41b80ce2f0 0x7f41b80afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:59.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41bd51d700 1 -- 172.21.15.49:0/2559063976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41b806e960 msgr2=0x7f41b80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:59.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41bd51d700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41b806e960 0x7f41b80af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41bd51d700 1 -- 172.21.15.49:0/2559063976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41b80ce2f0 msgr2=0x7f41b80afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:59.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41bd51d700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41b80ce2f0 0x7f41b80afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41bd51d700 1 -- 172.21.15.49:0/2559063976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b40094b0 con 0x7f41b80698a0 2023-07-21T22:12:59.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41bcd1c700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41b806e960 0x7f41b80af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:12:59.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41bd51d700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41b80698a0 0x7f41b80ae2c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f41b806c7b0 tx=0x7f41b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41adffb700 1 -- 172.21.15.49:0/2559063976 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4004480 con 0x7f41b80698a0 2023-07-21T22:12:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41adffb700 1 -- 172.21.15.49:0/2559063976 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b401f070 con 0x7f41b80698a0 2023-07-21T22:12:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41be51f700 1 -- 172.21.15.49:0/2559063976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b8146d70 con 0x7f41b80698a0 2023-07-21T22:12:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41adffb700 1 -- 172.21.15.49:0/2559063976 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4003900 con 0x7f41b80698a0 2023-07-21T22:12:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.238+0000 7f41be51f700 1 -- 172.21.15.49:0/2559063976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b8146100 con 0x7f41b80698a0 2023-07-21T22:12:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.242+0000 7f41be51f700 1 -- 172.21.15.49:0/2559063976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b804dcb0 con 0x7f41b80698a0 2023-07-21T22:12:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.242+0000 7f41adffb700 1 -- 172.21.15.49:0/2559063976 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f41b4021030 con 0x7f41b80698a0 2023-07-21T22:12:59.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.242+0000 7f41adffb700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f419c0662f0 0x7f419c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:59.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.242+0000 7f41adffb700 1 -- 172.21.15.49:0/2559063976 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f41b40854e0 con 0x7f41b80698a0 2023-07-21T22:12:59.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.246+0000 7f41bcd1c700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f419c0662f0 0x7f419c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:59.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.246+0000 7f41bcd1c700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f419c0662f0 0x7f419c0687a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f41b80cda00 tx=0x7f41a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.254+0000 7f41adffb700 1 -- 172.21.15.49:0/2559063976 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f41b40527a0 con 0x7f41b80698a0 2023-07-21T22:12:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.422+0000 7f41be51f700 1 -- 172.21.15.49:0/2559063976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f41b8146610 con 0x7f41b80698a0 2023-07-21T22:12:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.422+0000 7f41adffb700 1 -- 172.21.15.49:0/2559063976 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v47) v1 ==== 97+0+11 (secure 0 0 0) 0x7f41b8146610 con 0x7f41b80698a0 2023-07-21T22:12:59.469 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:12:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.426+0000 7f41be51f700 1 -- 172.21.15.49:0/2559063976 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f419c0662f0 msgr2=0x7f419c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.426+0000 7f41be51f700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f419c0662f0 0x7f419c0687a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f41b80cda00 tx=0x7f41a8008040 comp rx=0 tx=0).stop 2023-07-21T22:12:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.426+0000 7f41be51f700 1 -- 172.21.15.49:0/2559063976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41b80698a0 msgr2=0x7f41b80ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.426+0000 7f41be51f700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41b80698a0 0x7f41b80ae2c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f41b806c7b0 tx=0x7f41b4004770 comp rx=0 tx=0).stop 2023-07-21T22:12:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.426+0000 7f41be51f700 1 -- 172.21.15.49:0/2559063976 shutdown_connections 2023-07-21T22:12:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.426+0000 7f41be51f700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f419c0662f0 0x7f419c0687a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.426+0000 7f41be51f700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41b80ce2f0 0x7f41b80afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.426+0000 7f41be51f700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41b806e960 0x7f41b80af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.426+0000 7f41be51f700 1 --2- 172.21.15.49:0/2559063976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41b80698a0 0x7f41b80ae2c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.426+0000 7f41be51f700 1 -- 172.21.15.49:0/2559063976 >> 172.21.15.49:0/2559063976 conn(0x7f41b806fa70 msgr2=0x7f41b8069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:59.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.426+0000 7f41be51f700 1 -- 172.21.15.49:0/2559063976 shutdown_connections 2023-07-21T22:12:59.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.426+0000 7f41be51f700 1 -- 172.21.15.49:0/2559063976 wait complete. 2023-07-21T22:12:59.493 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:12:59.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.630+0000 7fcc80282700 1 Processor -- start 2023-07-21T22:12:59.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.630+0000 7fcc80282700 1 -- start start 2023-07-21T22:12:59.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc80282700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc78159ba0 0x7fcc7806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:59.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc80282700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc7806f070 0x7fcc7815fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:59.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc80282700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc780b0dc0 con 0x7fcc7806dfe0 2023-07-21T22:12:59.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc80282700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc7815c460 con 0x7fcc7806f070 2023-07-21T22:12:59.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc80282700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7806b880 con 0x7fcc78159ba0 2023-07-21T22:12:59.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7d81d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcc7806dfe0 0x7fcc7806e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38874/0 (socket says 172.21.15.49:38874) 2023-07-21T22:12:59.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7d81d700 1 -- 172.21.15.49:0/2629177731 learned_addr learned my addr 172.21.15.49:0/2629177731 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:12:59.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7e01e700 1 --2- 172.21.15.49:0/2629177731 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc78159ba0 0x7fcc7806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:59.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7e81f700 1 --2- 172.21.15.49:0/2629177731 >> v2:172.21.15.150:3300/0 conn(0x7fcc7806f070 0x7fcc7815fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:59.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7d01c700 1 -- 172.21.15.49:0/2629177731 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918941651 0 0) 0x7fcc780b0dc0 con 0x7fcc7806dfe0 2023-07-21T22:12:59.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7d01c700 1 -- 172.21.15.49:0/2629177731 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc640035d0 con 0x7fcc7806dfe0 2023-07-21T22:12:59.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7d01c700 1 -- 172.21.15.49:0/2629177731 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2313144633 0 0) 0x7fcc640035d0 con 0x7fcc7806dfe0 2023-07-21T22:12:59.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7e81f700 1 -- 172.21.15.49:0/2629177731 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc78159ba0 msgr2=0x7fcc7806af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:12:59.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7e81f700 1 --2- 172.21.15.49:0/2629177731 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc78159ba0 0x7fcc7806af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7e81f700 1 -- 172.21.15.49:0/2629177731 >> v1:172.21.15.49:6789/0 conn(0x7fcc7806dfe0 legacy=0x7fcc7806e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:59.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7e81f700 1 -- 172.21.15.49:0/2629177731 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc780b1060 con 0x7fcc7806f070 2023-07-21T22:12:59.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7e81f700 1 --2- 172.21.15.49:0/2629177731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc7806f070 0x7fcc7815fa50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcc70009d90 tx=0x7fcc7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=994e79eef916f4e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:59.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7d01c700 1 -- 172.21.15.49:0/2629177731 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000e070 con 0x7fcc7806f070 2023-07-21T22:12:59.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7d01c700 1 -- 172.21.15.49:0/2629177731 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc70003a40 con 0x7fcc7806f070 2023-07-21T22:12:59.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc7d01c700 1 -- 172.21.15.49:0/2629177731 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68001670 con 0x7fcc7806f070 2023-07-21T22:12:59.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc80282700 1 -- 172.21.15.49:0/2629177731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc7806f070 msgr2=0x7fcc7815fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:59.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc80282700 1 --2- 172.21.15.49:0/2629177731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc7806f070 0x7fcc7815fa50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcc70009d90 tx=0x7fcc7000b330 comp rx=0 tx=0).stop 2023-07-21T22:12:59.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc80282700 1 -- 172.21.15.49:0/2629177731 shutdown_connections 2023-07-21T22:12:59.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc80282700 1 --2- 172.21.15.49:0/2629177731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc7806f070 0x7fcc7815fa50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc80282700 1 --2- 172.21.15.49:0/2629177731 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc78159ba0 0x7fcc7806af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc80282700 1 -- 172.21.15.49:0/2629177731 >> 172.21.15.49:0/2629177731 conn(0x7fcc780cf340 msgr2=0x7fcc780cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:59.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc80282700 1 -- 172.21.15.49:0/2629177731 shutdown_connections 2023-07-21T22:12:59.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.634+0000 7fcc80282700 1 -- 172.21.15.49:0/2629177731 wait complete. 2023-07-21T22:12:59.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.638+0000 7fcc80282700 1 Processor -- start 2023-07-21T22:12:59.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.638+0000 7fcc80282700 1 -- start start 2023-07-21T22:12:59.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.638+0000 7fcc80282700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc7806dfe0 0x7fcc780c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:59.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.638+0000 7fcc80282700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc7806f070 0x7fcc781f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:59.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.638+0000 7fcc80282700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc78159ba0 0x7fcc7815b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:59.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.638+0000 7fcc80282700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc781fa0b0 con 0x7fcc7806dfe0 2023-07-21T22:12:59.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.638+0000 7fcc80282700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780c4da0 con 0x7fcc7806f070 2023-07-21T22:12:59.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.638+0000 7fcc80282700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780c5080 con 0x7fcc78159ba0 2023-07-21T22:12:59.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.638+0000 7fcc7e01e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc7806dfe0 0x7fcc780c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:59.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.638+0000 7fcc7e01e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc7806dfe0 0x7fcc780c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52426/0 (socket says 172.21.15.49:52426) 2023-07-21T22:12:59.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.638+0000 7fcc7e01e700 1 -- 172.21.15.49:0/2617534143 learned_addr learned my addr 172.21.15.49:0/2617534143 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:12:59.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.638+0000 7fcc7d81d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc7806f070 0x7fcc781f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:59.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.638+0000 7fcc7e81f700 1 --2- 172.21.15.49:0/2617534143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc78159ba0 0x7fcc7815b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:59.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.642+0000 7fcc7e01e700 1 -- 172.21.15.49:0/2617534143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc78159ba0 msgr2=0x7fcc7815b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:59.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.642+0000 7fcc7e01e700 1 --2- 172.21.15.49:0/2617534143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc78159ba0 0x7fcc7815b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.642+0000 7fcc7e01e700 1 -- 172.21.15.49:0/2617534143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc7806f070 msgr2=0x7fcc781f9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:59.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.642+0000 7fcc7e01e700 1 --2- 172.21.15.49:0/2617534143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc7806f070 0x7fcc781f9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.642+0000 7fcc7e01e700 1 -- 172.21.15.49:0/2617534143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc70009a70 con 0x7fcc7806dfe0 2023-07-21T22:12:59.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.642+0000 7fcc7e01e700 1 --2- 172.21.15.49:0/2617534143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc7806dfe0 0x7fcc780c6380 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400e840 tx=0x7fcc7400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:59.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.642+0000 7fcc6effd700 1 -- 172.21.15.49:0/2617534143 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc740095a0 con 0x7fcc7806dfe0 2023-07-21T22:12:59.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.642+0000 7fcc6effd700 1 -- 172.21.15.49:0/2617534143 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc74013680 con 0x7fcc7806dfe0 2023-07-21T22:12:59.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.642+0000 7fcc80282700 1 -- 172.21.15.49:0/2617534143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc780c5360 con 0x7fcc7806dfe0 2023-07-21T22:12:59.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.642+0000 7fcc6effd700 1 -- 172.21.15.49:0/2617534143 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc740139f0 con 0x7fcc7806dfe0 2023-07-21T22:12:59.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.642+0000 7fcc80282700 1 -- 172.21.15.49:0/2617534143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc780c5920 con 0x7fcc7806dfe0 2023-07-21T22:12:59.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.642+0000 7fcc80282700 1 -- 172.21.15.49:0/2617534143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7804dcb0 con 0x7fcc7806dfe0 2023-07-21T22:12:59.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.646+0000 7fcc6effd700 1 -- 172.21.15.49:0/2617534143 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc74013b50 con 0x7fcc7806dfe0 2023-07-21T22:12:59.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.646+0000 7fcc6effd700 1 --2- 172.21.15.49:0/2617534143 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcc5c0662f0 0x7fcc5c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:59.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.646+0000 7fcc6effd700 1 -- 172.21.15.49:0/2617534143 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fcc74083ef0 con 0x7fcc7806dfe0 2023-07-21T22:12:59.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.646+0000 7fcc7d81d700 1 --2- 172.21.15.49:0/2617534143 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcc5c0662f0 0x7fcc5c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:59.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.650+0000 7fcc7d81d700 1 --2- 172.21.15.49:0/2617534143 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcc5c0662f0 0x7fcc5c0687a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcc780ce950 tx=0x7fcc68001e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:59.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.654+0000 7fcc6effd700 1 -- 172.21.15.49:0/2617534143 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc74054a90 con 0x7fcc7806dfe0 2023-07-21T22:12:59.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.842+0000 7fcc80282700 1 -- 172.21.15.49:0/2617534143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcc780cbb30 con 0x7fcc7806dfe0 2023-07-21T22:12:59.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.842+0000 7fcc6effd700 1 -- 172.21.15.49:0/2617534143 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcc74054620 con 0x7fcc7806dfe0 2023-07-21T22:12:59.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.846+0000 7fcc80282700 1 -- 172.21.15.49:0/2617534143 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcc5c0662f0 msgr2=0x7fcc5c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:59.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.846+0000 7fcc80282700 1 --2- 172.21.15.49:0/2617534143 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcc5c0662f0 0x7fcc5c0687a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcc780ce950 tx=0x7fcc68001e40 comp rx=0 tx=0).stop 2023-07-21T22:12:59.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.846+0000 7fcc80282700 1 -- 172.21.15.49:0/2617534143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc7806dfe0 msgr2=0x7fcc780c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:59.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.846+0000 7fcc80282700 1 --2- 172.21.15.49:0/2617534143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc7806dfe0 0x7fcc780c6380 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400e840 tx=0x7fcc7400eb50 comp rx=0 tx=0).stop 2023-07-21T22:12:59.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.846+0000 7fcc80282700 1 -- 172.21.15.49:0/2617534143 shutdown_connections 2023-07-21T22:12:59.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.846+0000 7fcc80282700 1 --2- 172.21.15.49:0/2617534143 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcc5c0662f0 0x7fcc5c0687a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.846+0000 7fcc80282700 1 --2- 172.21.15.49:0/2617534143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc78159ba0 0x7fcc7815b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.846+0000 7fcc80282700 1 --2- 172.21.15.49:0/2617534143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc7806f070 0x7fcc781f9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.846+0000 7fcc80282700 1 --2- 172.21.15.49:0/2617534143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc7806dfe0 0x7fcc780c6380 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.846+0000 7fcc80282700 1 -- 172.21.15.49:0/2617534143 >> 172.21.15.49:0/2617534143 conn(0x7fcc780cf340 msgr2=0x7fcc780cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.846+0000 7fcc80282700 1 -- 172.21.15.49:0/2617534143 shutdown_connections 2023-07-21T22:12:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:12:59.846+0000 7fcc80282700 1 -- 172.21.15.49:0/2617534143 wait complete. 2023-07-21T22:12:59.897 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:12:59.917 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2023-07-21T22:12:59.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:12:59.917 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-21T22:12:59.947 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[45959]: fuse finished with error 0 and tester_r 0 2023-07-21T22:12:59.950 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:13:00.195 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:13:00.201 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:13:06.053 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:13:06.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:06.054 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:13:06.077 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2023-07-21T22:13:06.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.266+0000 7f3c28977700 1 Processor -- start 2023-07-21T22:13:06.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.266+0000 7f3c28977700 1 -- start start 2023-07-21T22:13:06.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.270+0000 7f3c28977700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c240b4b20 0x7f3c240cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:06.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.270+0000 7f3c28977700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3c240d0810 0x7f3c240d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:06.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.270+0000 7f3c28977700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c240b8170 con 0x7f3c240b4040 2023-07-21T22:13:06.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.270+0000 7f3c28977700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c240cfa20 con 0x7f3c240b4b20 2023-07-21T22:13:06.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.270+0000 7f3c28977700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c240d03c0 con 0x7f3c240d0810 2023-07-21T22:13:06.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.270+0000 7f3c21d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c240b4b20 0x7f3c240cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.270+0000 7f3c21d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c240b4b20 0x7f3c240cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33662/0 (socket says 172.21.15.49:33662) 2023-07-21T22:13:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.270+0000 7f3c21d9b700 1 -- 172.21.15.49:0/3903891851 learned_addr learned my addr 172.21.15.49:0/3903891851 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.270+0000 7f3c22d9d700 1 --2- 172.21.15.49:0/3903891851 >> v2:172.21.15.150:3300/0 conn(0x7f3c240d0810 0x7f3c240d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.270+0000 7f3c21d9b700 1 -- 172.21.15.49:0/3903891851 >> v2:172.21.15.150:3300/0 conn(0x7f3c240d0810 msgr2=0x7f3c240d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.270+0000 7f3c21d9b700 1 --2- 172.21.15.49:0/3903891851 >> v2:172.21.15.150:3300/0 conn(0x7f3c240d0810 0x7f3c240d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.270+0000 7f3c21d9b700 1 -- 172.21.15.49:0/3903891851 >> v1:172.21.15.150:6789/0 conn(0x7f3c240b4040 legacy=0x7f3c240b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.270+0000 7f3c21d9b700 1 -- 172.21.15.49:0/3903891851 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240d2350 con 0x7f3c240b4b20 2023-07-21T22:13:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.270+0000 7f3c21d9b700 1 --2- 172.21.15.49:0/3903891851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c240b4b20 0x7f3c240cf320 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3c24070ac0 tx=0x7f3c18009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31caaff49ca1b08c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.274+0000 7f3c2159a700 1 -- 172.21.15.49:0/3903891851 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18004230 con 0x7f3c240b4b20 2023-07-21T22:13:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.274+0000 7f3c2159a700 1 -- 172.21.15.49:0/3903891851 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c18004390 con 0x7f3c240b4b20 2023-07-21T22:13:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.274+0000 7f3c2159a700 1 -- 172.21.15.49:0/3903891851 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c180036c0 con 0x7f3c240b4b20 2023-07-21T22:13:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.274+0000 7f3c28977700 1 -- 172.21.15.49:0/3903891851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c240b4b20 msgr2=0x7f3c240cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.274+0000 7f3c28977700 1 --2- 172.21.15.49:0/3903891851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c240b4b20 0x7f3c240cf320 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3c24070ac0 tx=0x7f3c18009bf0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.274+0000 7f3c28977700 1 -- 172.21.15.49:0/3903891851 shutdown_connections 2023-07-21T22:13:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.274+0000 7f3c28977700 1 --2- 172.21.15.49:0/3903891851 >> v2:172.21.15.150:3300/0 conn(0x7f3c240d0810 0x7f3c240d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.274+0000 7f3c28977700 1 --2- 172.21.15.49:0/3903891851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c240b4b20 0x7f3c240cf320 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.274+0000 7f3c28977700 1 -- 172.21.15.49:0/3903891851 >> 172.21.15.49:0/3903891851 conn(0x7f3c240658e0 msgr2=0x7f3c2406fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.274+0000 7f3c28977700 1 -- 172.21.15.49:0/3903891851 shutdown_connections 2023-07-21T22:13:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.274+0000 7f3c28977700 1 -- 172.21.15.49:0/3903891851 wait complete. 2023-07-21T22:13:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.278+0000 7f3c28977700 1 Processor -- start 2023-07-21T22:13:06.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.278+0000 7f3c28977700 1 -- start start 2023-07-21T22:13:06.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.278+0000 7f3c28977700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240b4040 0x7f3c240c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:06.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.278+0000 7f3c28977700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c240b4b20 0x7f3c241f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:06.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.278+0000 7f3c28977700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c240d0810 0x7f3c241420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:06.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.278+0000 7f3c28977700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240cc000 con 0x7f3c240b4b20 2023-07-21T22:13:06.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.278+0000 7f3c28977700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240cc520 con 0x7f3c240d0810 2023-07-21T22:13:06.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.278+0000 7f3c28977700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c241f1230 con 0x7f3c240b4040 2023-07-21T22:13:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.278+0000 7f3c21d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c240b4b20 0x7f3c241f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c21d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c240b4b20 0x7f3c241f0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33678/0 (socket says 172.21.15.49:33678) 2023-07-21T22:13:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c21d9b700 1 -- 172.21.15.49:0/715898950 learned_addr learned my addr 172.21.15.49:0/715898950 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c22d9d700 1 --2- 172.21.15.49:0/715898950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c240d0810 0x7f3c241420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c2259c700 1 --2- 172.21.15.49:0/715898950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240b4040 0x7f3c240c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c21d9b700 1 -- 172.21.15.49:0/715898950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240b4040 msgr2=0x7f3c240c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c21d9b700 1 --2- 172.21.15.49:0/715898950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240b4040 0x7f3c240c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c21d9b700 1 -- 172.21.15.49:0/715898950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c240d0810 msgr2=0x7f3c241420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c21d9b700 1 --2- 172.21.15.49:0/715898950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c240d0810 0x7f3c241420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c21d9b700 1 -- 172.21.15.49:0/715898950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c18009570 con 0x7f3c240b4b20 2023-07-21T22:13:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c21d9b700 1 --2- 172.21.15.49:0/715898950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c240b4b20 0x7f3c241f0cf0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3c240b51b0 tx=0x7f3c18004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:06.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c12ffd700 1 -- 172.21.15.49:0/715898950 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18003d00 con 0x7f3c240b4b20 2023-07-21T22:13:06.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c12ffd700 1 -- 172.21.15.49:0/715898950 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1801f070 con 0x7f3c240b4b20 2023-07-21T22:13:06.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c12ffd700 1 -- 172.21.15.49:0/715898950 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800b8a0 con 0x7f3c240b4b20 2023-07-21T22:13:06.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c28977700 1 -- 172.21.15.49:0/715898950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c24142620 con 0x7f3c240b4b20 2023-07-21T22:13:06.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c28977700 1 -- 172.21.15.49:0/715898950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c240c84d0 con 0x7f3c240b4b20 2023-07-21T22:13:06.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.282+0000 7f3c28977700 1 -- 172.21.15.49:0/715898950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2404dd50 con 0x7f3c240b4b20 2023-07-21T22:13:06.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.286+0000 7f3c12ffd700 1 -- 172.21.15.49:0/715898950 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3c18021030 con 0x7f3c240b4b20 2023-07-21T22:13:06.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.286+0000 7f3c12ffd700 1 --2- 172.21.15.49:0/715898950 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3c040662f0 0x7f3c040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:06.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.286+0000 7f3c12ffd700 1 -- 172.21.15.49:0/715898950 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f3c18085440 con 0x7f3c240b4b20 2023-07-21T22:13:06.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.286+0000 7f3c2259c700 1 --2- 172.21.15.49:0/715898950 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3c040662f0 0x7f3c040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:06.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.286+0000 7f3c2259c700 1 --2- 172.21.15.49:0/715898950 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3c040662f0 0x7f3c040687a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009980 tx=0x7f3c140090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:06.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.294+0000 7f3c12ffd700 1 -- 172.21.15.49:0/715898950 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3c180525e0 con 0x7f3c240b4b20 2023-07-21T22:13:06.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.526+0000 7f3c28977700 1 -- 172.21.15.49:0/715898950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f3c2404dd50 con 0x7f3c240b4b20 2023-07-21T22:13:06.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.534+0000 7f3c12ffd700 1 -- 172.21.15.49:0/715898950 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v15) v1 ==== 211+0+168 (secure 0 0 0) 0x7f3c18055c00 con 0x7f3c240b4b20 2023-07-21T22:13:06.576 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2023-07-21T22:13:06.577 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtkU5ZaIRAAchCJhuM71+rGOBHBlX77wA== 2023-07-21T22:13:06.577 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow rwp" 2023-07-21T22:13:06.577 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2023-07-21T22:13:06.577 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2023-07-21T22:13:06.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.538+0000 7f3c28977700 1 -- 172.21.15.49:0/715898950 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3c040662f0 msgr2=0x7f3c040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:06.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.538+0000 7f3c28977700 1 --2- 172.21.15.49:0/715898950 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3c040662f0 0x7f3c040687a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009980 tx=0x7f3c140090e0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.538+0000 7f3c28977700 1 -- 172.21.15.49:0/715898950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c240b4b20 msgr2=0x7f3c241f0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:06.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.538+0000 7f3c28977700 1 --2- 172.21.15.49:0/715898950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c240b4b20 0x7f3c241f0cf0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3c240b51b0 tx=0x7f3c18004770 comp rx=0 tx=0).stop 2023-07-21T22:13:06.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.538+0000 7f3c28977700 1 -- 172.21.15.49:0/715898950 shutdown_connections 2023-07-21T22:13:06.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.538+0000 7f3c28977700 1 --2- 172.21.15.49:0/715898950 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3c040662f0 0x7f3c040687a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.538+0000 7f3c28977700 1 --2- 172.21.15.49:0/715898950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c240b4b20 0x7f3c241f0cf0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.538+0000 7f3c28977700 1 --2- 172.21.15.49:0/715898950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c240d0810 0x7f3c241420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.538+0000 7f3c28977700 1 --2- 172.21.15.49:0/715898950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240b4040 0x7f3c240c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.538+0000 7f3c28977700 1 -- 172.21.15.49:0/715898950 >> 172.21.15.49:0/715898950 conn(0x7f3c240658e0 msgr2=0x7f3c2406fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:06.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.538+0000 7f3c28977700 1 -- 172.21.15.49:0/715898950 shutdown_connections 2023-07-21T22:13:06.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.538+0000 7f3c28977700 1 -- 172.21.15.49:0/715898950 wait complete. 2023-07-21T22:13:06.584 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-07-21T22:13:06.603 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:13:06.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.738+0000 7f6f1d75d700 1 Processor -- start 2023-07-21T22:13:06.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.738+0000 7f6f1d75d700 1 -- start start 2023-07-21T22:13:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.742+0000 7f6f1d75d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f181582f0 0x7f6f180cb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.742+0000 7f6f1d75d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6f1815c870 0x7f6f180c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.742+0000 7f6f1d75d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f180cdab0 con 0x7f6f180c8c00 2023-07-21T22:13:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.742+0000 7f6f1d75d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f180cbad0 con 0x7f6f1815c870 2023-07-21T22:13:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.742+0000 7f6f1d75d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180c9080 con 0x7f6f181582f0 2023-07-21T22:13:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.742+0000 7f6f0f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6f1815c870 0x7f6f180c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.742+0000 7f6f17fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f181582f0 0x7f6f180cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.742+0000 7f6f0f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6f1815c870 0x7f6f180c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:39044/0 (socket says 172.21.15.49:39044) 2023-07-21T22:13:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.742+0000 7f6f17fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f181582f0 0x7f6f180cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:49930/0 (socket says 172.21.15.49:49930) 2023-07-21T22:13:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.742+0000 7f6f0f7fe700 1 -- 172.21.15.49:0/2370122151 learned_addr learned my addr 172.21.15.49:0/2370122151 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.742+0000 7f6f17fff700 1 -- 172.21.15.49:0/2370122151 >> v2:172.21.15.150:3300/0 conn(0x7f6f1815c870 msgr2=0x7f6f180c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.742+0000 7f6f17fff700 1 --2- 172.21.15.49:0/2370122151 >> v2:172.21.15.150:3300/0 conn(0x7f6f1815c870 0x7f6f180c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.742+0000 7f6f17fff700 1 -- 172.21.15.49:0/2370122151 >> v1:172.21.15.150:6789/0 conn(0x7f6f180c8c00 legacy=0x7f6f180afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.742+0000 7f6f17fff700 1 -- 172.21.15.49:0/2370122151 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f181586c0 con 0x7f6f181582f0 2023-07-21T22:13:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.746+0000 7f6f17fff700 1 --2- 172.21.15.49:0/2370122151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f181582f0 0x7f6f180cb590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800baf0 tx=0x7f6f0800be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fb0a83b0f29c4c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.746+0000 7f6f177fe700 1 -- 172.21.15.49:0/2370122151 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0800dc70 con 0x7f6f181582f0 2023-07-21T22:13:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.746+0000 7f6f177fe700 1 -- 172.21.15.49:0/2370122151 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0800ddd0 con 0x7f6f181582f0 2023-07-21T22:13:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.746+0000 7f6f177fe700 1 -- 172.21.15.49:0/2370122151 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08010690 con 0x7f6f181582f0 2023-07-21T22:13:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.746+0000 7f6f1d75d700 1 -- 172.21.15.49:0/2370122151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f181582f0 msgr2=0x7f6f180cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.746+0000 7f6f1d75d700 1 --2- 172.21.15.49:0/2370122151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f181582f0 0x7f6f180cb590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800baf0 tx=0x7f6f0800be00 comp rx=0 tx=0).stop 2023-07-21T22:13:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.746+0000 7f6f1d75d700 1 -- 172.21.15.49:0/2370122151 shutdown_connections 2023-07-21T22:13:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.746+0000 7f6f1d75d700 1 --2- 172.21.15.49:0/2370122151 >> v2:172.21.15.150:3300/0 conn(0x7f6f1815c870 0x7f6f180c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.746+0000 7f6f1d75d700 1 --2- 172.21.15.49:0/2370122151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f181582f0 0x7f6f180cb590 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.746+0000 7f6f1d75d700 1 -- 172.21.15.49:0/2370122151 >> 172.21.15.49:0/2370122151 conn(0x7f6f18070450 msgr2=0x7f6f18070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.746+0000 7f6f1d75d700 1 -- 172.21.15.49:0/2370122151 shutdown_connections 2023-07-21T22:13:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.746+0000 7f6f1d75d700 1 -- 172.21.15.49:0/2370122151 wait complete. 2023-07-21T22:13:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f1d75d700 1 Processor -- start 2023-07-21T22:13:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f1d75d700 1 -- start start 2023-07-21T22:13:06.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f1d75d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f180c8c00 0x7f6f181ee570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:06.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f1d75d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f181582f0 0x7f6f18159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:06.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f1d75d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f1815c870 0x7f6f180c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:06.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f1d75d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f181eeab0 con 0x7f6f180c8c00 2023-07-21T22:13:06.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f1d75d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f181f1bd0 con 0x7f6f181582f0 2023-07-21T22:13:06.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f1d75d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f181f1eb0 con 0x7f6f1815c870 2023-07-21T22:13:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f17fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f180c8c00 0x7f6f181ee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f17fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f180c8c00 0x7f6f181ee570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33680/0 (socket says 172.21.15.49:33680) 2023-07-21T22:13:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f17fff700 1 -- 172.21.15.49:0/1387134903 learned_addr learned my addr 172.21.15.49:0/1387134903 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f0f7fe700 1 --2- 172.21.15.49:0/1387134903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f181582f0 0x7f6f18159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f1cf5c700 1 --2- 172.21.15.49:0/1387134903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f1815c870 0x7f6f180c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f17fff700 1 -- 172.21.15.49:0/1387134903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f1815c870 msgr2=0x7f6f180c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f17fff700 1 --2- 172.21.15.49:0/1387134903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f1815c870 0x7f6f180c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f17fff700 1 -- 172.21.15.49:0/1387134903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f181582f0 msgr2=0x7f6f18159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.750+0000 7f6f17fff700 1 --2- 172.21.15.49:0/1387134903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f181582f0 0x7f6f18159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:06.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.754+0000 7f6f17fff700 1 -- 172.21.15.49:0/1387134903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0800b750 con 0x7f6f180c8c00 2023-07-21T22:13:06.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.754+0000 7f6f17fff700 1 --2- 172.21.15.49:0/1387134903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f180c8c00 0x7f6f181ee570 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6f08000c00 tx=0x7f6f08004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:06.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.754+0000 7f6f157fa700 1 -- 172.21.15.49:0/1387134903 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0801d070 con 0x7f6f180c8c00 2023-07-21T22:13:06.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.754+0000 7f6f157fa700 1 -- 172.21.15.49:0/1387134903 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f08003a10 con 0x7f6f180c8c00 2023-07-21T22:13:06.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.754+0000 7f6f157fa700 1 -- 172.21.15.49:0/1387134903 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08003da0 con 0x7f6f180c8c00 2023-07-21T22:13:06.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.754+0000 7f6f1d75d700 1 -- 172.21.15.49:0/1387134903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f18158fb0 con 0x7f6f180c8c00 2023-07-21T22:13:06.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.754+0000 7f6f1d75d700 1 -- 172.21.15.49:0/1387134903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f18159570 con 0x7f6f180c8c00 2023-07-21T22:13:06.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.754+0000 7f6f1d75d700 1 -- 172.21.15.49:0/1387134903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f18159750 con 0x7f6f180c8c00 2023-07-21T22:13:06.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.758+0000 7f6f157fa700 1 -- 172.21.15.49:0/1387134903 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6f0802b430 con 0x7f6f180c8c00 2023-07-21T22:13:06.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.758+0000 7f6f157fa700 1 --2- 172.21.15.49:0/1387134903 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6ef80662f0 0x7f6ef80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:06.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.758+0000 7f6f157fa700 1 -- 172.21.15.49:0/1387134903 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f6f08085120 con 0x7f6f180c8c00 2023-07-21T22:13:06.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.758+0000 7f6f0f7fe700 1 --2- 172.21.15.49:0/1387134903 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6ef80662f0 0x7f6ef80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:06.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.758+0000 7f6f0f7fe700 1 --2- 172.21.15.49:0/1387134903 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6ef80662f0 0x7f6ef80687a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6f180ad6f0 tx=0x7f6f000092e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:06.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.766+0000 7f6f157fa700 1 -- 172.21.15.49:0/1387134903 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f080522c0 con 0x7f6f180c8c00 2023-07-21T22:13:07.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.974+0000 7f6f1d75d700 1 -- 172.21.15.49:0/1387134903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6f1804dcb0 con 0x7f6f180c8c00 2023-07-21T22:13:07.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.974+0000 7f6f157fa700 1 -- 172.21.15.49:0/1387134903 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+82 (secure 0 0 0) 0x7f6f080558e0 con 0x7f6f180c8c00 2023-07-21T22:13:07.017 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2023-07-21T22:13:07.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.978+0000 7f6f1d75d700 1 -- 172.21.15.49:0/1387134903 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6ef80662f0 msgr2=0x7f6ef80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:07.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.978+0000 7f6f1d75d700 1 --2- 172.21.15.49:0/1387134903 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6ef80662f0 0x7f6ef80687a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6f180ad6f0 tx=0x7f6f000092e0 comp rx=0 tx=0).stop 2023-07-21T22:13:07.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.978+0000 7f6f1d75d700 1 -- 172.21.15.49:0/1387134903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f180c8c00 msgr2=0x7f6f181ee570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:07.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.978+0000 7f6f1d75d700 1 --2- 172.21.15.49:0/1387134903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f180c8c00 0x7f6f181ee570 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6f08000c00 tx=0x7f6f08004770 comp rx=0 tx=0).stop 2023-07-21T22:13:07.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.978+0000 7f6f1d75d700 1 -- 172.21.15.49:0/1387134903 shutdown_connections 2023-07-21T22:13:07.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.978+0000 7f6f1d75d700 1 --2- 172.21.15.49:0/1387134903 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f6ef80662f0 0x7f6ef80687a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:07.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.978+0000 7f6f1d75d700 1 --2- 172.21.15.49:0/1387134903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f1815c870 0x7f6f180c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:07.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.978+0000 7f6f1d75d700 1 --2- 172.21.15.49:0/1387134903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f181582f0 0x7f6f18159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:07.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.978+0000 7f6f1d75d700 1 --2- 172.21.15.49:0/1387134903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f180c8c00 0x7f6f181ee570 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:07.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.978+0000 7f6f1d75d700 1 -- 172.21.15.49:0/1387134903 >> 172.21.15.49:0/1387134903 conn(0x7f6f18070450 msgr2=0x7f6f1815b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:07.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.978+0000 7f6f1d75d700 1 -- 172.21.15.49:0/1387134903 shutdown_connections 2023-07-21T22:13:07.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:06.978+0000 7f6f1d75d700 1 -- 172.21.15.49:0/1387134903 wait complete. 2023-07-21T22:13:07.044 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:13:07.045 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:13:07.045 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-07-21T22:13:07.045 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:13:07.045 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:13:07.046 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:13:07.046 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:13:07.046 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:13:07.047 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:13:07.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:07.047 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-07-21T22:13:07.065 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:13:07.065 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:13:07.065 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:13:07.066 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:07.066 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-07-21T22:13:07.066 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:07.066 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:13:07.066 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:13:07.066 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-07-21T22:13:07.066 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:13:07.067 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:13:07.067 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-07-21T22:13:07.067 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:13:07.067 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:13:07.067 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-07-21T22:13:07.067 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:13:07.068 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42167sec preferred_lft 42167sec 2023-07-21T22:13:07.068 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-07-21T22:13:07.068 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:07.068 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:13:07.068 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:13:07.068 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-07-21T22:13:07.069 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:13:07.069 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:19:e1:20:16 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:13:07.069 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:13:07.069 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:07.069 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:13:07.069 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether aa:11:6f:e1:a1:5e brd ff:ff:ff:ff:ff:ff 2023-07-21T22:13:07.069 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:13:07.070 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:07.070 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec43:77ff:fe1f:6f26/64 scope link 2023-07-21T22:13:07.070 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:07.070 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:13:07.070 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether aa:11:6f:e1:a1:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:13:07.070 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a811:6fff:fee1:a15e/64 scope link 2023-07-21T22:13:07.070 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:07.071 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:13:07.071 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether da:09:9c:11:2a:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:13:07.071 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::d809:9cff:fe11:2aa0/64 scope link 2023-07-21T22:13:07.071 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:07.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:07.072 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:13:07.143 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-07-21T22:13:07.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:07.146 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-07-21T22:13:07.211 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-07-21T22:13:07.211 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:13:07.211 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:13:07.212 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:13:07.212 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:13:07.212 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:13:07.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:07.213 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:13:07.214 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:13:07.214 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:13:07.214 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:13:07.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:13:07.215 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:13:07.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:07.360 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-07-21T22:13:07.377 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:13:07.378 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:13:07.378 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:13:07.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:07.379 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-07-21T22:13:07.458 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-21T22:13:07.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:13:07.459 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:13:07.521 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:13:07.521 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:13:07.522 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:13:07.578 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:13:07.661 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:13:07.662 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:13:07.741 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:13:07.743 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:13:07.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:07.744 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:13:07.809 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-21T22:13:07.810 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-21T22:13:07.862 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:13:07.899 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:13:07.900 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:13:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:13:07.983 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:13:07.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:07.984 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:13:07.996 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2023-07-21T22:13:07.954+0000 7fbe161cd640 -1 init, newargv = 0x564c6d139d70 newargc=15 2023-07-21T22:13:07.997 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[46482]: starting ceph client 2023-07-21T22:13:08.008 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[46482]: starting fuse 2023-07-21T22:13:08.013 INFO:teuthology.orchestra.run.smithi049.stdout:49 2023-07-21T22:13:08.014 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-07-21T22:13:08.015 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T22:13:08.016 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2023-07-21T22:13:08.016 DEBUG:teuthology.orchestra.run.smithi049:> import re 2023-07-21T22:13:08.017 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-07-21T22:13:08.018 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-07-21T22:13:08.018 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:13:08.018 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2023-07-21T22:13:08.019 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-21T22:13:08.019 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2023-07-21T22:13:08.019 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-21T22:13:08.020 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:13:08.020 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2023-07-21T22:13:08.020 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2023-07-21T22:13:08.021 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2023-07-21T22:13:08.021 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2023-07-21T22:13:08.021 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:13:08.022 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2023-07-21T22:13:08.023 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T22:13:08.023 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T22:13:08.023 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T22:13:08.024 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2023-07-21T22:13:08.024 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2023-07-21T22:13:08.024 DEBUG:teuthology.orchestra.run.smithi049:> return f 2023-07-21T22:13:08.025 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T22:13:08.025 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:13:08.025 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2023-07-21T22:13:08.026 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-07-21T22:13:08.172 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.46482.asok 2023-07-21T22:13:08.354 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46482.asok 2023-07-21T22:13:08.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:08.355 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46482.asok status 2023-07-21T22:13:08.550 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:13:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2023-07-21T22:13:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea", 2023-07-21T22:13:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:13:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2023-07-21T22:13:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2023-07-21T22:13:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-21T22:13:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "46482", 2023-07-21T22:13:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2023-07-21T22:13:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2023-07-21T22:13:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2023-07-21T22:13:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6129, 2023-07-21T22:13:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2023-07-21T22:13:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2023-07-21T22:13:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2023-07-21T22:13:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 6129 2023-07-21T22:13:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:13:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:13:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:13:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2442027611 2023-07-21T22:13:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:13:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:13:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:13:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2442027611 2023-07-21T22:13:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.6129 192.168.0.1:0/2442027611", 2023-07-21T22:13:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/2442027611", 2023-07-21T22:13:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2023-07-21T22:13:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 18, 2023-07-21T22:13:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 47, 2023-07-21T22:13:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2023-07-21T22:13:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2023-07-21T22:13:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2023-07-21T22:13:08.555 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:13:08.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:08.566 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2023-07-21T22:13:08.567 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-21T22:13:08.586 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2023-07-21T22:13:08.586 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-21T22:13:08.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:08.587 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:13:08.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:08.660 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-07-21T22:13:08.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:08.731 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-07-21T22:13:08.804 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:13:08.805 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:13:08.865 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:13:09.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.046+0000 7feb2a36b700 1 Processor -- start 2023-07-21T22:13:09.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.046+0000 7feb2a36b700 1 -- start start 2023-07-21T22:13:09.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb2a36b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb240c1470 0x7feb240c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb2a36b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb240ca2c0 0x7feb24163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb2a36b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2406e010 con 0x7feb24160370 2023-07-21T22:13:09.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb2a36b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb24160740 con 0x7feb240ca2c0 2023-07-21T22:13:09.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb2a36b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb240ccc50 con 0x7feb240c1470 2023-07-21T22:13:09.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb29369700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feb24160370 0x7feb2406d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47934/0 (socket says 172.21.15.49:47934) 2023-07-21T22:13:09.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb29369700 1 -- 172.21.15.49:0/2182220849 learned_addr learned my addr 172.21.15.49:0/2182220849 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:09.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb29b6a700 1 --2- 172.21.15.49:0/2182220849 >> v2:172.21.15.49:3300/0 conn(0x7feb240ca2c0 0x7feb24163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb28b68700 1 --2- 172.21.15.49:0/2182220849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb240c1470 0x7feb240c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb1bfff700 1 -- 172.21.15.49:0/2182220849 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235949524 0 0) 0x7feb2406e010 con 0x7feb24160370 2023-07-21T22:13:09.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb1bfff700 1 -- 172.21.15.49:0/2182220849 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb100035d0 con 0x7feb24160370 2023-07-21T22:13:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb29b6a700 1 -- 172.21.15.49:0/2182220849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb240c1470 msgr2=0x7feb240c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb29b6a700 1 --2- 172.21.15.49:0/2182220849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb240c1470 0x7feb240c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb29b6a700 1 -- 172.21.15.49:0/2182220849 >> v1:172.21.15.49:6789/0 conn(0x7feb24160370 legacy=0x7feb2406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb29b6a700 1 -- 172.21.15.49:0/2182220849 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb240afc90 con 0x7feb240ca2c0 2023-07-21T22:13:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb29b6a700 1 --2- 172.21.15.49:0/2182220849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb240ca2c0 0x7feb24163ef0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7feb1c009d90 tx=0x7feb1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6507403dea25d5b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb1bfff700 1 -- 172.21.15.49:0/2182220849 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c00e070 con 0x7feb240ca2c0 2023-07-21T22:13:09.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb1bfff700 1 -- 172.21.15.49:0/2182220849 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c00bb20 con 0x7feb240ca2c0 2023-07-21T22:13:09.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb1bfff700 1 -- 172.21.15.49:0/2182220849 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c012430 con 0x7feb240ca2c0 2023-07-21T22:13:09.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb2a36b700 1 -- 172.21.15.49:0/2182220849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb240ca2c0 msgr2=0x7feb24163ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.050+0000 7feb2a36b700 1 --2- 172.21.15.49:0/2182220849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb240ca2c0 0x7feb24163ef0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7feb1c009d90 tx=0x7feb1c00b330 comp rx=0 tx=0).stop 2023-07-21T22:13:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.054+0000 7feb2a36b700 1 -- 172.21.15.49:0/2182220849 shutdown_connections 2023-07-21T22:13:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.054+0000 7feb2a36b700 1 --2- 172.21.15.49:0/2182220849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb240ca2c0 0x7feb24163ef0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.054+0000 7feb2a36b700 1 --2- 172.21.15.49:0/2182220849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb240c1470 0x7feb240c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.054+0000 7feb2a36b700 1 -- 172.21.15.49:0/2182220849 >> 172.21.15.49:0/2182220849 conn(0x7feb24070450 msgr2=0x7feb24070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:09.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.054+0000 7feb2a36b700 1 -- 172.21.15.49:0/2182220849 shutdown_connections 2023-07-21T22:13:09.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.054+0000 7feb2a36b700 1 -- 172.21.15.49:0/2182220849 wait complete. 2023-07-21T22:13:09.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.054+0000 7feb2a36b700 1 Processor -- start 2023-07-21T22:13:09.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.054+0000 7feb2a36b700 1 -- start start 2023-07-21T22:13:09.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb2a36b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb240c1470 0x7feb240c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb2a36b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb240ca2c0 0x7feb2415a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb2a36b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb24160370 0x7feb240c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb2a36b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240c6d40 con 0x7feb240c1470 2023-07-21T22:13:09.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb2a36b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240c6130 con 0x7feb240ca2c0 2023-07-21T22:13:09.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb2a36b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb240c6410 con 0x7feb24160370 2023-07-21T22:13:09.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb29369700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb240c1470 0x7feb240c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb29369700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb240c1470 0x7feb240c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33696/0 (socket says 172.21.15.49:33696) 2023-07-21T22:13:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb29369700 1 -- 172.21.15.49:0/2476715944 learned_addr learned my addr 172.21.15.49:0/2476715944 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb29b6a700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb24160370 0x7feb240c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb28b68700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb240ca2c0 0x7feb2415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb29369700 1 -- 172.21.15.49:0/2476715944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb24160370 msgr2=0x7feb240c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb29369700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb24160370 0x7feb240c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb29369700 1 -- 172.21.15.49:0/2476715944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb240ca2c0 msgr2=0x7feb2415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb29369700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb240ca2c0 0x7feb2415a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb29369700 1 -- 172.21.15.49:0/2476715944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c009a70 con 0x7feb240c1470 2023-07-21T22:13:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb28b68700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb240ca2c0 0x7feb2415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb29369700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb240c1470 0x7feb240c5b50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7feb2000c4d0 tx=0x7feb2000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.058+0000 7feb19ffb700 1 -- 172.21.15.49:0/2476715944 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20005d90 con 0x7feb240c1470 2023-07-21T22:13:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.062+0000 7feb19ffb700 1 -- 172.21.15.49:0/2476715944 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb200070d0 con 0x7feb240c1470 2023-07-21T22:13:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.062+0000 7feb2a36b700 1 -- 172.21.15.49:0/2476715944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb240c66f0 con 0x7feb240c1470 2023-07-21T22:13:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.062+0000 7feb19ffb700 1 -- 172.21.15.49:0/2476715944 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20007480 con 0x7feb240c1470 2023-07-21T22:13:09.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.062+0000 7feb2a36b700 1 -- 172.21.15.49:0/2476715944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb240c7ef0 con 0x7feb240c1470 2023-07-21T22:13:09.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.062+0000 7feb2a36b700 1 -- 172.21.15.49:0/2476715944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb240b1e20 con 0x7feb240c1470 2023-07-21T22:13:09.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.062+0000 7feb19ffb700 1 -- 172.21.15.49:0/2476715944 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feb200075e0 con 0x7feb240c1470 2023-07-21T22:13:09.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.066+0000 7feb19ffb700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb080662f0 0x7feb080687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.066+0000 7feb19ffb700 1 -- 172.21.15.49:0/2476715944 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7feb200834e0 con 0x7feb240c1470 2023-07-21T22:13:09.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.066+0000 7feb28b68700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb080662f0 0x7feb080687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.066+0000 7feb28b68700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb080662f0 0x7feb080687a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feb240cd4d0 tx=0x7feb14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:09.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.074+0000 7feb19ffb700 1 -- 172.21.15.49:0/2476715944 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb20050690 con 0x7feb240c1470 2023-07-21T22:13:09.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.246+0000 7feb2a36b700 1 -- 172.21.15.49:0/2476715944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb2404dcb0 con 0x7feb240c1470 2023-07-21T22:13:09.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.250+0000 7feb19ffb700 1 -- 172.21.15.49:0/2476715944 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+20239 (secure 0 0 0) 0x7feb20053cb0 con 0x7feb240c1470 2023-07-21T22:13:09.293 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:09.294 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":47,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:12:39.024259+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:12:20.014383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T22:12:21.059436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"data_new","create_time":"2023-07-21T22:12:36.491357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:13:09.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.254+0000 7feb2a36b700 1 -- 172.21.15.49:0/2476715944 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb080662f0 msgr2=0x7feb080687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.254+0000 7feb2a36b700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb080662f0 0x7feb080687a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feb240cd4d0 tx=0x7feb14008040 comp rx=0 tx=0).stop 2023-07-21T22:13:09.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.254+0000 7feb2a36b700 1 -- 172.21.15.49:0/2476715944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb240c1470 msgr2=0x7feb240c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.254+0000 7feb2a36b700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb240c1470 0x7feb240c5b50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7feb2000c4d0 tx=0x7feb2000c7e0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.254+0000 7feb2a36b700 1 -- 172.21.15.49:0/2476715944 shutdown_connections 2023-07-21T22:13:09.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.254+0000 7feb2a36b700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb080662f0 0x7feb080687a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.254+0000 7feb2a36b700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb24160370 0x7feb240c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.254+0000 7feb2a36b700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb240ca2c0 0x7feb2415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.254+0000 7feb2a36b700 1 --2- 172.21.15.49:0/2476715944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb240c1470 0x7feb240c5b50 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.254+0000 7feb2a36b700 1 -- 172.21.15.49:0/2476715944 >> 172.21.15.49:0/2476715944 conn(0x7feb24070450 msgr2=0x7feb240adab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:09.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.254+0000 7feb2a36b700 1 -- 172.21.15.49:0/2476715944 shutdown_connections 2023-07-21T22:13:09.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.254+0000 7feb2a36b700 1 -- 172.21.15.49:0/2476715944 wait complete. 2023-07-21T22:13:09.321 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:12:20.014383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:12:21.059436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'data_new', 'create_time': '2023-07-21T22:12:36.491357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:13:09.322 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:13:09.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.462+0000 7ff13b59e700 1 Processor -- start 2023-07-21T22:13:09.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.462+0000 7ff13b59e700 1 -- start start 2023-07-21T22:13:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.466+0000 7ff13b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff13c15bbd0 0x7ff13c0cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.466+0000 7ff13b59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c15c120 con 0x7ff13c0cbc10 2023-07-21T22:13:09.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.466+0000 7ff13b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c15c400 con 0x7ff13c0ccc00 2023-07-21T22:13:09.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.466+0000 7ff13b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c069fb0 con 0x7ff13c15bbd0 2023-07-21T22:13:09.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.466+0000 7ff13ad9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff13c0cbc10 0x7ff13c0afbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47948/0 (socket says 172.21.15.49:47948) 2023-07-21T22:13:09.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.466+0000 7ff13ad9d700 1 -- 172.21.15.49:0/3729309128 learned_addr learned my addr 172.21.15.49:0/3729309128 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:09.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.466+0000 7ff13a59c700 1 --2- 172.21.15.49:0/3729309128 >> v2:172.21.15.150:3300/0 conn(0x7ff13c15bbd0 0x7ff13c0cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13959a700 1 -- 172.21.15.49:0/3729309128 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195495431 0 0) 0x7ff13c15c120 con 0x7ff13c0cbc10 2023-07-21T22:13:09.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13959a700 1 -- 172.21.15.49:0/3729309128 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1240035d0 con 0x7ff13c0cbc10 2023-07-21T22:13:09.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13959a700 1 -- 172.21.15.49:0/3729309128 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304587626 0 0) 0x7ff13c15c400 con 0x7ff13c0ccc00 2023-07-21T22:13:09.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13a59c700 1 -- 172.21.15.49:0/3729309128 >> v1:172.21.15.150:6789/0 conn(0x7ff13c0ccc00 legacy=0x7ff13c0698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13a59c700 1 -- 172.21.15.49:0/3729309128 >> v1:172.21.15.49:6789/0 conn(0x7ff13c0cbc10 legacy=0x7ff13c0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13a59c700 1 -- 172.21.15.49:0/3729309128 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c15c6e0 con 0x7ff13c15bbd0 2023-07-21T22:13:09.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13a59c700 1 --2- 172.21.15.49:0/3729309128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff13c15bbd0 0x7ff13c0cd790 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff12c009850 tx=0x7ff12c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a1fb89668a10d83 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:09.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13959a700 1 -- 172.21.15.49:0/3729309128 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c011830 con 0x7ff13c15bbd0 2023-07-21T22:13:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13959a700 1 -- 172.21.15.49:0/3729309128 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c011990 con 0x7ff13c15bbd0 2023-07-21T22:13:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13959a700 1 -- 172.21.15.49:0/3729309128 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c011d40 con 0x7ff13c15bbd0 2023-07-21T22:13:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13b59e700 1 -- 172.21.15.49:0/3729309128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff13c15bbd0 msgr2=0x7ff13c0cd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13b59e700 1 --2- 172.21.15.49:0/3729309128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff13c15bbd0 0x7ff13c0cd790 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff12c009850 tx=0x7ff12c009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:09.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13b59e700 1 -- 172.21.15.49:0/3729309128 shutdown_connections 2023-07-21T22:13:09.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13b59e700 1 --2- 172.21.15.49:0/3729309128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff13c15bbd0 0x7ff13c0cd790 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13b59e700 1 -- 172.21.15.49:0/3729309128 >> 172.21.15.49:0/3729309128 conn(0x7ff13c0ce0d0 msgr2=0x7ff13c0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:09.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13b59e700 1 -- 172.21.15.49:0/3729309128 shutdown_connections 2023-07-21T22:13:09.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.470+0000 7ff13b59e700 1 -- 172.21.15.49:0/3729309128 wait complete. 2023-07-21T22:13:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13b59e700 1 Processor -- start 2023-07-21T22:13:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13b59e700 1 -- start start 2023-07-21T22:13:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff13c0cbc10 0x7ff13c149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff13c0ccc00 0x7ff13c0c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c15bbd0 0x7ff13c0c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13b59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c15a590 con 0x7ff13c15bbd0 2023-07-21T22:13:09.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c159910 con 0x7ff13c0cbc10 2023-07-21T22:13:09.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c159bf0 con 0x7ff13c0ccc00 2023-07-21T22:13:09.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c15bbd0 0x7ff13c0c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c15bbd0 0x7ff13c0c3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33712/0 (socket says 172.21.15.49:33712) 2023-07-21T22:13:09.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13ad9d700 1 -- 172.21.15.49:0/3253462001 learned_addr learned my addr 172.21.15.49:0/3253462001 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:09.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff139d9b700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff13c0ccc00 0x7ff13c0c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13ad9d700 1 -- 172.21.15.49:0/3253462001 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff13c0ccc00 msgr2=0x7ff13c0c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13ad9d700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff13c0ccc00 0x7ff13c0c30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13ad9d700 1 -- 172.21.15.49:0/3253462001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff13c0cbc10 msgr2=0x7ff13c149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13a59c700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff13c0cbc10 0x7ff13c149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13ad9d700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff13c0cbc10 0x7ff13c149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13ad9d700 1 -- 172.21.15.49:0/3253462001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c0094b0 con 0x7ff13c15bbd0 2023-07-21T22:13:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff139d9b700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff13c0ccc00 0x7ff13c0c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.474+0000 7ff13a59c700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff13c0cbc10 0x7ff13c149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:09.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.478+0000 7ff13ad9d700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c15bbd0 0x7ff13c0c3610 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff13400cb40 tx=0x7ff13400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:09.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.478+0000 7ff12affd700 1 -- 172.21.15.49:0/3253462001 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400a9e0 con 0x7ff13c15bbd0 2023-07-21T22:13:09.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.478+0000 7ff12affd700 1 -- 172.21.15.49:0/3253462001 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13400ab40 con 0x7ff13c15bbd0 2023-07-21T22:13:09.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.478+0000 7ff13b59e700 1 -- 172.21.15.49:0/3253462001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c159ed0 con 0x7ff13c15bbd0 2023-07-21T22:13:09.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.478+0000 7ff12affd700 1 -- 172.21.15.49:0/3253462001 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400ce60 con 0x7ff13c15bbd0 2023-07-21T22:13:09.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.478+0000 7ff13b59e700 1 -- 172.21.15.49:0/3253462001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c14a3b0 con 0x7ff13c15bbd0 2023-07-21T22:13:09.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.478+0000 7ff13b59e700 1 -- 172.21.15.49:0/3253462001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c15a6d0 con 0x7ff13c15bbd0 2023-07-21T22:13:09.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.478+0000 7ff12affd700 1 -- 172.21.15.49:0/3253462001 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff13401b3b0 con 0x7ff13c15bbd0 2023-07-21T22:13:09.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.482+0000 7ff12affd700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff11c0662f0 0x7ff11c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.482+0000 7ff12affd700 1 -- 172.21.15.49:0/3253462001 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7ff134083b20 con 0x7ff13c15bbd0 2023-07-21T22:13:09.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.482+0000 7ff13a59c700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff11c0662f0 0x7ff11c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.482+0000 7ff13a59c700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff11c0662f0 0x7ff11c0687a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0cc2c0 tx=0x7ff12c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:09.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.490+0000 7ff12affd700 1 -- 172.21.15.49:0/3253462001 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff13c15a6d0 con 0x7ff13c15bbd0 2023-07-21T22:13:09.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.666+0000 7ff13b59e700 1 -- 172.21.15.49:0/3253462001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff13c15a6d0 con 0x7ff13c15bbd0 2023-07-21T22:13:09.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.666+0000 7ff12affd700 1 -- 172.21.15.49:0/3253462001 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff13c15a6d0 con 0x7ff13c15bbd0 2023-07-21T22:13:09.711 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:13:09.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.670+0000 7ff13b59e700 1 -- 172.21.15.49:0/3253462001 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff11c0662f0 msgr2=0x7ff11c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.670+0000 7ff13b59e700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff11c0662f0 0x7ff11c0687a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0cc2c0 tx=0x7ff12c008030 comp rx=0 tx=0).stop 2023-07-21T22:13:09.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.670+0000 7ff13b59e700 1 -- 172.21.15.49:0/3253462001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c15bbd0 msgr2=0x7ff13c0c3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.670+0000 7ff13b59e700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c15bbd0 0x7ff13c0c3610 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff13400cb40 tx=0x7ff13400cc20 comp rx=0 tx=0).stop 2023-07-21T22:13:09.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.670+0000 7ff13b59e700 1 -- 172.21.15.49:0/3253462001 shutdown_connections 2023-07-21T22:13:09.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.670+0000 7ff13b59e700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff11c0662f0 0x7ff11c0687a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.670+0000 7ff13b59e700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c15bbd0 0x7ff13c0c3610 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.670+0000 7ff13b59e700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff13c0ccc00 0x7ff13c0c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.670+0000 7ff13b59e700 1 --2- 172.21.15.49:0/3253462001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff13c0cbc10 0x7ff13c149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.670+0000 7ff13b59e700 1 -- 172.21.15.49:0/3253462001 >> 172.21.15.49:0/3253462001 conn(0x7ff13c0ce0d0 msgr2=0x7ff13c14e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:09.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.670+0000 7ff13b59e700 1 -- 172.21.15.49:0/3253462001 shutdown_connections 2023-07-21T22:13:09.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.670+0000 7ff13b59e700 1 -- 172.21.15.49:0/3253462001 wait complete. 2023-07-21T22:13:09.736 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:13:09.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.882+0000 7fba9f59e700 1 Processor -- start 2023-07-21T22:13:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.882+0000 7fba9f59e700 1 -- start start 2023-07-21T22:13:09.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa00d1c30 0x7fbaa00b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9f59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa00b4820 con 0x7fbaa00d17e0 2023-07-21T22:13:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9f59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa006eb00 con 0x7fbaa0160380 2023-07-21T22:13:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00b4b00 con 0x7fbaa00d1c30 2023-07-21T22:13:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9dd9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbaa00d17e0 0x7fbaa00b52f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47950/0 (socket says 172.21.15.49:47950) 2023-07-21T22:13:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9dd9b700 1 -- 172.21.15.49:0/3556510349 learned_addr learned my addr 172.21.15.49:0/3556510349 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9ed9d700 1 --2- 172.21.15.49:0/3556510349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa00d1c30 0x7fbaa00b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9d59a700 1 -- 172.21.15.49:0/3556510349 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567535603 0 0) 0x7fbaa00b4820 con 0x7fbaa00d17e0 2023-07-21T22:13:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9d59a700 1 -- 172.21.15.49:0/3556510349 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba880035d0 con 0x7fbaa00d17e0 2023-07-21T22:13:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9d59a700 1 -- 172.21.15.49:0/3556510349 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693690406 0 0) 0x7fbaa006eb00 con 0x7fbaa0160380 2023-07-21T22:13:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9d59a700 1 -- 172.21.15.49:0/3556510349 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaa00b4820 con 0x7fbaa0160380 2023-07-21T22:13:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9d59a700 1 -- 172.21.15.49:0/3556510349 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 580270730 0 0) 0x7fba880035d0 con 0x7fbaa00d17e0 2023-07-21T22:13:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9ed9d700 1 -- 172.21.15.49:0/3556510349 >> v1:172.21.15.150:6789/0 conn(0x7fbaa0160380 legacy=0x7fbaa00b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9ed9d700 1 -- 172.21.15.49:0/3556510349 >> v1:172.21.15.49:6789/0 conn(0x7fbaa00d17e0 legacy=0x7fbaa00b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9ed9d700 1 -- 172.21.15.49:0/3556510349 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa006ede0 con 0x7fbaa00d1c30 2023-07-21T22:13:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9ed9d700 1 --2- 172.21.15.49:0/3556510349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa00d1c30 0x7fbaa00b5a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba98009dc0 tx=0x7fba9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7415386aea02cf3f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:09.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9d59a700 1 -- 172.21.15.49:0/3556510349 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800e070 con 0x7fbaa00d1c30 2023-07-21T22:13:09.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.886+0000 7fba9d59a700 1 -- 172.21.15.49:0/3556510349 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba98003a40 con 0x7fbaa00d1c30 2023-07-21T22:13:09.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.890+0000 7fba9d59a700 1 -- 172.21.15.49:0/3556510349 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94001670 con 0x7fbaa00d1c30 2023-07-21T22:13:09.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.890+0000 7fba9f59e700 1 -- 172.21.15.49:0/3556510349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa00d1c30 msgr2=0x7fbaa00b5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.890+0000 7fba9f59e700 1 --2- 172.21.15.49:0/3556510349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa00d1c30 0x7fbaa00b5a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba98009dc0 tx=0x7fba9800b330 comp rx=0 tx=0).stop 2023-07-21T22:13:09.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.890+0000 7fba9f59e700 1 -- 172.21.15.49:0/3556510349 shutdown_connections 2023-07-21T22:13:09.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.890+0000 7fba9f59e700 1 --2- 172.21.15.49:0/3556510349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa00d1c30 0x7fbaa00b5a00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.890+0000 7fba9f59e700 1 -- 172.21.15.49:0/3556510349 >> 172.21.15.49:0/3556510349 conn(0x7fbaa00cef20 msgr2=0x7fbaa00cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:09.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.890+0000 7fba9f59e700 1 -- 172.21.15.49:0/3556510349 shutdown_connections 2023-07-21T22:13:09.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.890+0000 7fba9f59e700 1 -- 172.21.15.49:0/3556510349 wait complete. 2023-07-21T22:13:09.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.890+0000 7fba9f59e700 1 Processor -- start 2023-07-21T22:13:09.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.890+0000 7fba9f59e700 1 -- start start 2023-07-21T22:13:09.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9f59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbaa00d17e0 0x7fbaa015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa00d1c30 0x7fbaa00c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa0160380 0x7fbaa00d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9f59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00c75a0 con 0x7fbaa00d1c30 2023-07-21T22:13:09.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9f59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00c6990 con 0x7fbaa00d17e0 2023-07-21T22:13:09.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00c6c70 con 0x7fbaa0160380 2023-07-21T22:13:09.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa00d1c30 0x7fbaa00c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa00d1c30 0x7fbaa00c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33726/0 (socket says 172.21.15.49:33726) 2023-07-21T22:13:09.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9dd9b700 1 -- 172.21.15.49:0/2364964680 learned_addr learned my addr 172.21.15.49:0/2364964680 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:09.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9e59c700 1 --2- 172.21.15.49:0/2364964680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbaa00d17e0 0x7fbaa015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9ed9d700 1 --2- 172.21.15.49:0/2364964680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa0160380 0x7fbaa00d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9dd9b700 1 -- 172.21.15.49:0/2364964680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa0160380 msgr2=0x7fbaa00d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9dd9b700 1 --2- 172.21.15.49:0/2364964680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa0160380 0x7fbaa00d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9dd9b700 1 -- 172.21.15.49:0/2364964680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbaa00d17e0 msgr2=0x7fbaa015a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:09.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9dd9b700 1 --2- 172.21.15.49:0/2364964680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbaa00d17e0 0x7fbaa015a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:09.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9dd9b700 1 -- 172.21.15.49:0/2364964680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba98009a70 con 0x7fbaa00d1c30 2023-07-21T22:13:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9dd9b700 1 --2- 172.21.15.49:0/2364964680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa00d1c30 0x7fbaa00c5f40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fba9400c750 tx=0x7fba9400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba8effd700 1 -- 172.21.15.49:0/2364964680 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94004ca0 con 0x7fbaa00d1c30 2023-07-21T22:13:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba8effd700 1 -- 172.21.15.49:0/2364964680 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba94004e20 con 0x7fbaa00d1c30 2023-07-21T22:13:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba8effd700 1 -- 172.21.15.49:0/2364964680 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94007310 con 0x7fbaa00d1c30 2023-07-21T22:13:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9f59e700 1 -- 172.21.15.49:0/2364964680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa00c6f50 con 0x7fbaa00d1c30 2023-07-21T22:13:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.894+0000 7fba9f59e700 1 -- 172.21.15.49:0/2364964680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa015aa40 con 0x7fbaa00d1c30 2023-07-21T22:13:09.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.898+0000 7fba9f59e700 1 -- 172.21.15.49:0/2364964680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa00c7710 con 0x7fbaa00d1c30 2023-07-21T22:13:09.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.898+0000 7fba8effd700 1 -- 172.21.15.49:0/2364964680 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fba94007470 con 0x7fbaa00d1c30 2023-07-21T22:13:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.902+0000 7fba8effd700 1 --2- 172.21.15.49:0/2364964680 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fba80066320 0x7fba800687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:09.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.902+0000 7fba8effd700 1 -- 172.21.15.49:0/2364964680 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fba94083dd0 con 0x7fbaa00d1c30 2023-07-21T22:13:09.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.902+0000 7fba9e59c700 1 --2- 172.21.15.49:0/2364964680 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fba80066320 0x7fba800687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.902+0000 7fba9e59c700 1 --2- 172.21.15.49:0/2364964680 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fba80066320 0x7fba800687d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fba900011e0 tx=0x7fba90009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:09.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:09.906+0000 7fba8effd700 1 -- 172.21.15.49:0/2364964680 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fba94050e60 con 0x7fbaa00d1c30 2023-07-21T22:13:10.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.086+0000 7fba9f59e700 1 -- 172.21.15.49:0/2364964680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbaa004dcb0 con 0x7fbaa00d1c30 2023-07-21T22:13:10.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.086+0000 7fba8effd700 1 -- 172.21.15.49:0/2364964680 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7fba94007720 con 0x7fbaa00d1c30 2023-07-21T22:13:10.129 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:13:10.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.090+0000 7fba9f59e700 1 -- 172.21.15.49:0/2364964680 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fba80066320 msgr2=0x7fba800687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:10.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.090+0000 7fba9f59e700 1 --2- 172.21.15.49:0/2364964680 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fba80066320 0x7fba800687d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fba900011e0 tx=0x7fba90009040 comp rx=0 tx=0).stop 2023-07-21T22:13:10.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.090+0000 7fba9f59e700 1 -- 172.21.15.49:0/2364964680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa00d1c30 msgr2=0x7fbaa00c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:10.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.090+0000 7fba9f59e700 1 --2- 172.21.15.49:0/2364964680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa00d1c30 0x7fbaa00c5f40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fba9400c750 tx=0x7fba9400ca60 comp rx=0 tx=0).stop 2023-07-21T22:13:10.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.090+0000 7fba9f59e700 1 -- 172.21.15.49:0/2364964680 shutdown_connections 2023-07-21T22:13:10.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.090+0000 7fba9f59e700 1 --2- 172.21.15.49:0/2364964680 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fba80066320 0x7fba800687d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.090+0000 7fba9f59e700 1 --2- 172.21.15.49:0/2364964680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa00d1c30 0x7fbaa00c5f40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.090+0000 7fba9f59e700 1 --2- 172.21.15.49:0/2364964680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa0160380 0x7fbaa00d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.090+0000 7fba9f59e700 1 --2- 172.21.15.49:0/2364964680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbaa00d17e0 0x7fbaa015a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.090+0000 7fba9f59e700 1 -- 172.21.15.49:0/2364964680 >> 172.21.15.49:0/2364964680 conn(0x7fbaa00cef20 msgr2=0x7fbaa015e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:10.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.090+0000 7fba9f59e700 1 -- 172.21.15.49:0/2364964680 shutdown_connections 2023-07-21T22:13:10.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.090+0000 7fba9f59e700 1 -- 172.21.15.49:0/2364964680 wait complete. 2023-07-21T22:13:10.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:13:10.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.294+0000 7f7fa88bb700 1 Processor -- start 2023-07-21T22:13:10.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.294+0000 7f7fa88bb700 1 -- start start 2023-07-21T22:13:10.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.294+0000 7f7fa88bb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa4160150 0x7f7fa40d2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:10.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.294+0000 7f7fa88bb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7fa40d2680 0x7f7fa40d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:10.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.294+0000 7f7fa88bb700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa40d0760 con 0x7f7fa40b1890 2023-07-21T22:13:10.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.294+0000 7f7fa88bb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa40d2aa0 con 0x7f7fa40d2680 2023-07-21T22:13:10.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.294+0000 7f7fa88bb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa40b1c60 con 0x7f7fa4160150 2023-07-21T22:13:10.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.294+0000 7f7fa2d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7fa40b1890 0x7f7fa40b5310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47956/0 (socket says 172.21.15.49:47956) 2023-07-21T22:13:10.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa2d9d700 1 -- 172.21.15.49:0/1481067687 learned_addr learned my addr 172.21.15.49:0/1481067687 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:10.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa259c700 1 --2- 172.21.15.49:0/1481067687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa4160150 0x7f7fa40d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:10.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa359e700 1 --2- 172.21.15.49:0/1481067687 >> v2:172.21.15.150:3300/0 conn(0x7f7fa40d2680 0x7f7fa40d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:10.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa1d9b700 1 -- 172.21.15.49:0/1481067687 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501150123 0 0) 0x7f7fa40d0760 con 0x7f7fa40b1890 2023-07-21T22:13:10.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa1d9b700 1 -- 172.21.15.49:0/1481067687 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f8c0035d0 con 0x7f7fa40b1890 2023-07-21T22:13:10.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa259c700 1 -- 172.21.15.49:0/1481067687 >> v2:172.21.15.150:3300/0 conn(0x7f7fa40d2680 msgr2=0x7f7fa40d0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:10.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa259c700 1 --2- 172.21.15.49:0/1481067687 >> v2:172.21.15.150:3300/0 conn(0x7f7fa40d2680 0x7f7fa40d0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa259c700 1 -- 172.21.15.49:0/1481067687 >> v1:172.21.15.49:6789/0 conn(0x7f7fa40b1890 legacy=0x7f7fa40b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:10.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa259c700 1 -- 172.21.15.49:0/1481067687 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa40b5a20 con 0x7f7fa4160150 2023-07-21T22:13:10.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa259c700 1 --2- 172.21.15.49:0/1481067687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa4160150 0x7f7fa40d2140 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009850 tx=0x7f7f98009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccc97fa04e916872 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:10.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa1d9b700 1 -- 172.21.15.49:0/1481067687 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98011830 con 0x7f7fa4160150 2023-07-21T22:13:10.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa1d9b700 1 -- 172.21.15.49:0/1481067687 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f98011990 con 0x7f7fa4160150 2023-07-21T22:13:10.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa1d9b700 1 -- 172.21.15.49:0/1481067687 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98011d40 con 0x7f7fa4160150 2023-07-21T22:13:10.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa88bb700 1 -- 172.21.15.49:0/1481067687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa4160150 msgr2=0x7f7fa40d2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:10.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa88bb700 1 --2- 172.21.15.49:0/1481067687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa4160150 0x7f7fa40d2140 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009850 tx=0x7f7f98009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:10.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa88bb700 1 -- 172.21.15.49:0/1481067687 shutdown_connections 2023-07-21T22:13:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa88bb700 1 --2- 172.21.15.49:0/1481067687 >> v2:172.21.15.150:3300/0 conn(0x7f7fa40d2680 0x7f7fa40d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa88bb700 1 --2- 172.21.15.49:0/1481067687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa4160150 0x7f7fa40d2140 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa88bb700 1 -- 172.21.15.49:0/1481067687 >> 172.21.15.49:0/1481067687 conn(0x7f7fa406fdc0 msgr2=0x7f7fa4070190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.298+0000 7f7fa88bb700 1 -- 172.21.15.49:0/1481067687 shutdown_connections 2023-07-21T22:13:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.302+0000 7f7fa88bb700 1 -- 172.21.15.49:0/1481067687 wait complete. 2023-07-21T22:13:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.302+0000 7f7fa88bb700 1 Processor -- start 2023-07-21T22:13:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.302+0000 7f7fa88bb700 1 -- start start 2023-07-21T22:13:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.302+0000 7f7fa88bb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fa40b1890 0x7f7fa40c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.302+0000 7f7fa88bb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fa40d2680 0x7f7fa4159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.302+0000 7f7fa88bb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa4160150 0x7f7fa4159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.302+0000 7f7fa88bb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa414d500 con 0x7f7fa40b1890 2023-07-21T22:13:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.302+0000 7f7fa88bb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa40c58d0 con 0x7f7fa40d2680 2023-07-21T22:13:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.302+0000 7f7fa88bb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa4147b70 con 0x7f7fa4160150 2023-07-21T22:13:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.302+0000 7f7fa2d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fa40b1890 0x7f7fa40c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7fa2d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fa40b1890 0x7f7fa40c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33738/0 (socket says 172.21.15.49:33738) 2023-07-21T22:13:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7fa2d9d700 1 -- 172.21.15.49:0/2216015813 learned_addr learned my addr 172.21.15.49:0/2216015813 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7fa359e700 1 --2- 172.21.15.49:0/2216015813 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa4160150 0x7f7fa4159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7fa259c700 1 --2- 172.21.15.49:0/2216015813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fa40d2680 0x7f7fa4159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7fa2d9d700 1 -- 172.21.15.49:0/2216015813 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa4160150 msgr2=0x7f7fa4159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7fa2d9d700 1 --2- 172.21.15.49:0/2216015813 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa4160150 0x7f7fa4159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7fa2d9d700 1 -- 172.21.15.49:0/2216015813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fa40d2680 msgr2=0x7f7fa4159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7fa2d9d700 1 --2- 172.21.15.49:0/2216015813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fa40d2680 0x7f7fa4159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7fa2d9d700 1 -- 172.21.15.49:0/2216015813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f980094b0 con 0x7f7fa40b1890 2023-07-21T22:13:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7fa2d9d700 1 --2- 172.21.15.49:0/2216015813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fa40b1890 0x7f7fa40c5390 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400c700 tx=0x7f7f9400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7f8b7fe700 1 -- 172.21.15.49:0/2216015813 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94005d90 con 0x7f7fa40b1890 2023-07-21T22:13:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7f8b7fe700 1 -- 172.21.15.49:0/2216015813 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f940070d0 con 0x7f7fa40b1890 2023-07-21T22:13:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7fa88bb700 1 -- 172.21.15.49:0/2216015813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa4147240 con 0x7f7fa40b1890 2023-07-21T22:13:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7f8b7fe700 1 -- 172.21.15.49:0/2216015813 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94007480 con 0x7f7fa40b1890 2023-07-21T22:13:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7fa88bb700 1 -- 172.21.15.49:0/2216015813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa4147800 con 0x7f7fa40b1890 2023-07-21T22:13:10.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.306+0000 7f7fa88bb700 1 -- 172.21.15.49:0/2216015813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa404dcb0 con 0x7f7fa40b1890 2023-07-21T22:13:10.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.310+0000 7f7f8b7fe700 1 -- 172.21.15.49:0/2216015813 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f940075e0 con 0x7f7fa40b1890 2023-07-21T22:13:10.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.310+0000 7f7f8b7fe700 1 --2- 172.21.15.49:0/2216015813 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7f900662f0 0x7f7f900687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:10.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.310+0000 7f7f8b7fe700 1 -- 172.21.15.49:0/2216015813 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f7f94083500 con 0x7f7fa40b1890 2023-07-21T22:13:10.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.310+0000 7f7fa259c700 1 --2- 172.21.15.49:0/2216015813 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7f900662f0 0x7f7f900687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:10.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.314+0000 7f7fa259c700 1 --2- 172.21.15.49:0/2216015813 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7f900662f0 0x7f7f900687a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7f980090b0 tx=0x7f7f98008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:10.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.314+0000 7f7f8b7fe700 1 -- 172.21.15.49:0/2216015813 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f940506a0 con 0x7f7fa40b1890 2023-07-21T22:13:10.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.490+0000 7f7fa88bb700 1 -- 172.21.15.49:0/2216015813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7fa406f470 con 0x7f7fa40b1890 2023-07-21T22:13:10.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.490+0000 7f7f8b7fe700 1 -- 172.21.15.49:0/2216015813 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f94053cc0 con 0x7f7fa40b1890 2023-07-21T22:13:10.535 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:13:10.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.494+0000 7f7fa88bb700 1 -- 172.21.15.49:0/2216015813 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7f900662f0 msgr2=0x7f7f900687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:10.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.494+0000 7f7fa88bb700 1 --2- 172.21.15.49:0/2216015813 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7f900662f0 0x7f7f900687a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7f980090b0 tx=0x7f7f98008030 comp rx=0 tx=0).stop 2023-07-21T22:13:10.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.494+0000 7f7fa88bb700 1 -- 172.21.15.49:0/2216015813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fa40b1890 msgr2=0x7f7fa40c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:10.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.494+0000 7f7fa88bb700 1 --2- 172.21.15.49:0/2216015813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fa40b1890 0x7f7fa40c5390 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400c700 tx=0x7f7f9400ca10 comp rx=0 tx=0).stop 2023-07-21T22:13:10.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.494+0000 7f7fa88bb700 1 -- 172.21.15.49:0/2216015813 shutdown_connections 2023-07-21T22:13:10.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.494+0000 7f7fa88bb700 1 --2- 172.21.15.49:0/2216015813 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7f900662f0 0x7f7f900687a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.494+0000 7f7fa88bb700 1 --2- 172.21.15.49:0/2216015813 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa4160150 0x7f7fa4159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.494+0000 7f7fa88bb700 1 --2- 172.21.15.49:0/2216015813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fa40d2680 0x7f7fa4159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.494+0000 7f7fa88bb700 1 --2- 172.21.15.49:0/2216015813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fa40b1890 0x7f7fa40c5390 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.494+0000 7f7fa88bb700 1 -- 172.21.15.49:0/2216015813 >> 172.21.15.49:0/2216015813 conn(0x7f7fa406fdc0 msgr2=0x7f7fa415b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:10.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.494+0000 7f7fa88bb700 1 -- 172.21.15.49:0/2216015813 shutdown_connections 2023-07-21T22:13:10.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.494+0000 7f7fa88bb700 1 -- 172.21.15.49:0/2216015813 wait complete. 2023-07-21T22:13:10.559 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:13:10.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.698+0000 7f290f595700 1 Processor -- start 2023-07-21T22:13:10.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.698+0000 7f290f595700 1 -- start start 2023-07-21T22:13:10.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290f595700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2908160010 0x7f29080ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:10.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290f595700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f29080ca680 0x7f29080cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:10.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290f595700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2908163ee0 con 0x7f29081603e0 2023-07-21T22:13:10.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290f595700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29080cdf70 con 0x7f29080ca680 2023-07-21T22:13:10.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290f595700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29080cd6d0 con 0x7f2908160010 2023-07-21T22:13:10.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290e593700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2908160010 0x7f29080ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:10.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290ed94700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f29080ca680 0x7f29080cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:10.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290e593700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2908160010 0x7f29080ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:50022/0 (socket says 172.21.15.49:50022) 2023-07-21T22:13:10.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290e593700 1 -- 172.21.15.49:0/1461818230 learned_addr learned my addr 172.21.15.49:0/1461818230 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290e593700 1 -- 172.21.15.49:0/1461818230 >> v2:172.21.15.49:3300/0 conn(0x7f29080ca680 msgr2=0x7f29080cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290e593700 1 --2- 172.21.15.49:0/1461818230 >> v2:172.21.15.49:3300/0 conn(0x7f29080ca680 0x7f29080cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290e593700 1 -- 172.21.15.49:0/1461818230 >> v1:172.21.15.150:6789/0 conn(0x7f29081603e0 legacy=0x7f2908164370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290e593700 1 -- 172.21.15.49:0/1461818230 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29080cd9b0 con 0x7f2908160010 2023-07-21T22:13:10.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290e593700 1 --2- 172.21.15.49:0/1461818230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2908160010 0x7f29080ca140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2904009910 tx=0x7f2904009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b33f4b7933edc2ad server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:10.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290d591700 1 -- 172.21.15.49:0/1461818230 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904011830 con 0x7f2908160010 2023-07-21T22:13:10.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290d591700 1 -- 172.21.15.49:0/1461818230 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2904011990 con 0x7f2908160010 2023-07-21T22:13:10.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.702+0000 7f290d591700 1 -- 172.21.15.49:0/1461818230 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904011d40 con 0x7f2908160010 2023-07-21T22:13:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.706+0000 7f290f595700 1 -- 172.21.15.49:0/1461818230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2908160010 msgr2=0x7f29080ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.706+0000 7f290f595700 1 --2- 172.21.15.49:0/1461818230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2908160010 0x7f29080ca140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2904009910 tx=0x7f2904009c20 comp rx=0 tx=0).stop 2023-07-21T22:13:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.706+0000 7f290f595700 1 -- 172.21.15.49:0/1461818230 shutdown_connections 2023-07-21T22:13:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.706+0000 7f290f595700 1 --2- 172.21.15.49:0/1461818230 >> v2:172.21.15.49:3300/0 conn(0x7f29080ca680 0x7f29080cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.706+0000 7f290f595700 1 --2- 172.21.15.49:0/1461818230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2908160010 0x7f29080ca140 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.706+0000 7f290f595700 1 -- 172.21.15.49:0/1461818230 >> 172.21.15.49:0/1461818230 conn(0x7f29080ce0d0 msgr2=0x7f29080ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:10.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.706+0000 7f290f595700 1 -- 172.21.15.49:0/1461818230 shutdown_connections 2023-07-21T22:13:10.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.706+0000 7f290f595700 1 -- 172.21.15.49:0/1461818230 wait complete. 2023-07-21T22:13:10.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290f595700 1 Processor -- start 2023-07-21T22:13:10.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290f595700 1 -- start start 2023-07-21T22:13:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290f595700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29080ca680 0x7f29080b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290f595700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2908160010 0x7f29081f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290f595700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29081603e0 0x7f29081f9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:10.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290f595700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29081f58c0 con 0x7f2908160010 2023-07-21T22:13:10.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290f595700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29081f9ea0 con 0x7f29081603e0 2023-07-21T22:13:10.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290f595700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29080adc50 con 0x7f29080ca680 2023-07-21T22:13:10.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290dd92700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2908160010 0x7f29081f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:10.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290dd92700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2908160010 0x7f29081f5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33748/0 (socket says 172.21.15.49:33748) 2023-07-21T22:13:10.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290dd92700 1 -- 172.21.15.49:0/2916421627 learned_addr learned my addr 172.21.15.49:0/2916421627 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:10.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290e593700 1 --2- 172.21.15.49:0/2916421627 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29080ca680 0x7f29080b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:10.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290ed94700 1 --2- 172.21.15.49:0/2916421627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29081603e0 0x7f29081f9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:10.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290dd92700 1 -- 172.21.15.49:0/2916421627 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29080ca680 msgr2=0x7f29080b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:10.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290dd92700 1 --2- 172.21.15.49:0/2916421627 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29080ca680 0x7f29080b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290dd92700 1 -- 172.21.15.49:0/2916421627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29081603e0 msgr2=0x7f29081f9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:10.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290dd92700 1 --2- 172.21.15.49:0/2916421627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29081603e0 0x7f29081f9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.710+0000 7f290dd92700 1 -- 172.21.15.49:0/2916421627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2904009570 con 0x7f2908160010 2023-07-21T22:13:10.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.714+0000 7f290dd92700 1 --2- 172.21.15.49:0/2916421627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2908160010 0x7f29081f5380 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f28f800c530 tx=0x7f28f800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.714+0000 7f28feffd700 1 -- 172.21.15.49:0/2916421627 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f80052d0 con 0x7f2908160010 2023-07-21T22:13:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.714+0000 7f28feffd700 1 -- 172.21.15.49:0/2916421627 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f8005430 con 0x7f2908160010 2023-07-21T22:13:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.714+0000 7f290f595700 1 -- 172.21.15.49:0/2916421627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29080adf30 con 0x7f2908160010 2023-07-21T22:13:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.714+0000 7f28feffd700 1 -- 172.21.15.49:0/2916421627 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f80055a0 con 0x7f2908160010 2023-07-21T22:13:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.714+0000 7f290f595700 1 -- 172.21.15.49:0/2916421627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29080ae4f0 con 0x7f2908160010 2023-07-21T22:13:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.714+0000 7f290f595700 1 -- 172.21.15.49:0/2916421627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290806dae0 con 0x7f2908160010 2023-07-21T22:13:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.718+0000 7f28feffd700 1 -- 172.21.15.49:0/2916421627 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28f80038e0 con 0x7f2908160010 2023-07-21T22:13:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.718+0000 7f28feffd700 1 --2- 172.21.15.49:0/2916421627 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f28ec0662f0 0x7f28ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.718+0000 7f28feffd700 1 -- 172.21.15.49:0/2916421627 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f28f8083380 con 0x7f2908160010 2023-07-21T22:13:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.718+0000 7f290e593700 1 --2- 172.21.15.49:0/2916421627 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f28ec0662f0 0x7f28ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.718+0000 7f290e593700 1 --2- 172.21.15.49:0/2916421627 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f28ec0662f0 0x7f28ec0687a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2904000c00 tx=0x7f2904008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:10.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.726+0000 7f28feffd700 1 -- 172.21.15.49:0/2916421627 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28f8050520 con 0x7f2908160010 2023-07-21T22:13:10.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.906+0000 7f290f595700 1 -- 172.21.15.49:0/2916421627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29080ae6e0 con 0x7f2908160010 2023-07-21T22:13:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.906+0000 7f28feffd700 1 -- 172.21.15.49:0/2916421627 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28f8053b40 con 0x7f2908160010 2023-07-21T22:13:10.950 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:13:10.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.910+0000 7f290f595700 1 -- 172.21.15.49:0/2916421627 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f28ec0662f0 msgr2=0x7f28ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:10.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.910+0000 7f290f595700 1 --2- 172.21.15.49:0/2916421627 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f28ec0662f0 0x7f28ec0687a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2904000c00 tx=0x7f2904008030 comp rx=0 tx=0).stop 2023-07-21T22:13:10.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.910+0000 7f290f595700 1 -- 172.21.15.49:0/2916421627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2908160010 msgr2=0x7f29081f5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:10.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.910+0000 7f290f595700 1 --2- 172.21.15.49:0/2916421627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2908160010 0x7f29081f5380 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f28f800c530 tx=0x7f28f800c840 comp rx=0 tx=0).stop 2023-07-21T22:13:10.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.910+0000 7f290f595700 1 -- 172.21.15.49:0/2916421627 shutdown_connections 2023-07-21T22:13:10.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.910+0000 7f290f595700 1 --2- 172.21.15.49:0/2916421627 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f28ec0662f0 0x7f28ec0687a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.910+0000 7f290f595700 1 --2- 172.21.15.49:0/2916421627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2908160010 0x7f29081f5380 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.910+0000 7f290f595700 1 --2- 172.21.15.49:0/2916421627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29081603e0 0x7f29081f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.910+0000 7f290f595700 1 --2- 172.21.15.49:0/2916421627 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29080ca680 0x7f29080b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.910+0000 7f290f595700 1 -- 172.21.15.49:0/2916421627 >> 172.21.15.49:0/2916421627 conn(0x7f29080ce0d0 msgr2=0x7f2908070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:10.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.914+0000 7f290f595700 1 -- 172.21.15.49:0/2916421627 shutdown_connections 2023-07-21T22:13:10.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:10.914+0000 7f290f595700 1 -- 172.21.15.49:0/2916421627 wait complete. 2023-07-21T22:13:10.974 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-07-21T22:13:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.110+0000 7fc696c2f700 1 Processor -- start 2023-07-21T22:13:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.110+0000 7fc696c2f700 1 -- start start 2023-07-21T22:13:11.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.114+0000 7fc696c2f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc690159be0 0x7fc6900c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.114+0000 7fc696c2f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900c8b80 con 0x7fc6900ca550 2023-07-21T22:13:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.114+0000 7fc696c2f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69006db90 con 0x7fc6900698a0 2023-07-21T22:13:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.114+0000 7fc696c2f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69006de70 con 0x7fc690159be0 2023-07-21T22:13:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.114+0000 7fc69542c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc6900ca550 0x7fc69006d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47966/0 (socket says 172.21.15.49:47966) 2023-07-21T22:13:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.114+0000 7fc69542c700 1 -- 172.21.15.49:0/3257949489 learned_addr learned my addr 172.21.15.49:0/3257949489 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.114+0000 7fc695c2d700 1 --2- 172.21.15.49:0/3257949489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc690159be0 0x7fc6900c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc694c2b700 1 -- 172.21.15.49:0/3257949489 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411150110 0 0) 0x7fc6900c8b80 con 0x7fc6900ca550 2023-07-21T22:13:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc694c2b700 1 -- 172.21.15.49:0/3257949489 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc67c0035d0 con 0x7fc6900ca550 2023-07-21T22:13:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc694c2b700 1 -- 172.21.15.49:0/3257949489 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787216423 0 0) 0x7fc69006db90 con 0x7fc6900698a0 2023-07-21T22:13:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc694c2b700 1 -- 172.21.15.49:0/3257949489 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6900c8b80 con 0x7fc6900698a0 2023-07-21T22:13:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc695c2d700 1 -- 172.21.15.49:0/3257949489 >> v1:172.21.15.150:6789/0 conn(0x7fc6900698a0 legacy=0x7fc6900c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc694c2b700 1 -- 172.21.15.49:0/3257949489 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 719548095 0 0) 0x7fc67c0035d0 con 0x7fc6900ca550 2023-07-21T22:13:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc695c2d700 1 -- 172.21.15.49:0/3257949489 >> v1:172.21.15.49:6789/0 conn(0x7fc6900ca550 legacy=0x7fc69006d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc695c2d700 1 -- 172.21.15.49:0/3257949489 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900c8810 con 0x7fc690159be0 2023-07-21T22:13:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc695c2d700 1 --2- 172.21.15.49:0/3257949489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc690159be0 0x7fc6900c9010 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009880 tx=0x7fc68c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=968f1f55426a3532 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc694c2b700 1 -- 172.21.15.49:0/3257949489 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc680001670 con 0x7fc690159be0 2023-07-21T22:13:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc694c2b700 1 -- 172.21.15.49:0/3257949489 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c004030 con 0x7fc690159be0 2023-07-21T22:13:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc694c2b700 1 -- 172.21.15.49:0/3257949489 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0043c0 con 0x7fc690159be0 2023-07-21T22:13:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc696c2f700 1 -- 172.21.15.49:0/3257949489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc690159be0 msgr2=0x7fc6900c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc696c2f700 1 --2- 172.21.15.49:0/3257949489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc690159be0 0x7fc6900c9010 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009880 tx=0x7fc68c009b90 comp rx=0 tx=0).stop 2023-07-21T22:13:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc696c2f700 1 -- 172.21.15.49:0/3257949489 shutdown_connections 2023-07-21T22:13:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc696c2f700 1 --2- 172.21.15.49:0/3257949489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc690159be0 0x7fc6900c9010 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.118+0000 7fc696c2f700 1 -- 172.21.15.49:0/3257949489 >> 172.21.15.49:0/3257949489 conn(0x7fc6900ce0d0 msgr2=0x7fc6900ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.122+0000 7fc696c2f700 1 -- 172.21.15.49:0/3257949489 shutdown_connections 2023-07-21T22:13:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.122+0000 7fc696c2f700 1 -- 172.21.15.49:0/3257949489 wait complete. 2023-07-21T22:13:11.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.122+0000 7fc696c2f700 1 Processor -- start 2023-07-21T22:13:11.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.122+0000 7fc696c2f700 1 -- start start 2023-07-21T22:13:11.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc696c2f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6900698a0 0x7fc690156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:11.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc696c2f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900ca550 0x7fc6900ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:11.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc696c2f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc690159be0 0x7fc6901535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:11.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc696c2f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900aeee0 con 0x7fc6900698a0 2023-07-21T22:13:11.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc696c2f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900af3b0 con 0x7fc690159be0 2023-07-21T22:13:11.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc696c2f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900b28a0 con 0x7fc6900ca550 2023-07-21T22:13:11.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc695c2d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6900698a0 0x7fc690156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:11.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc695c2d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6900698a0 0x7fc690156830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33760/0 (socket says 172.21.15.49:33760) 2023-07-21T22:13:11.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc695c2d700 1 -- 172.21.15.49:0/2761978114 learned_addr learned my addr 172.21.15.49:0/2761978114 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:11.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc69542c700 1 --2- 172.21.15.49:0/2761978114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900ca550 0x7fc6900ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:11.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc69642e700 1 --2- 172.21.15.49:0/2761978114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc690159be0 0x7fc6901535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:11.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc695c2d700 1 -- 172.21.15.49:0/2761978114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900ca550 msgr2=0x7fc6900ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc695c2d700 1 --2- 172.21.15.49:0/2761978114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900ca550 0x7fc6900ae9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc695c2d700 1 -- 172.21.15.49:0/2761978114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc690159be0 msgr2=0x7fc6901535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc695c2d700 1 --2- 172.21.15.49:0/2761978114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc690159be0 0x7fc6901535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc695c2d700 1 -- 172.21.15.49:0/2761978114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0094b0 con 0x7fc6900698a0 2023-07-21T22:13:11.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc695c2d700 1 --2- 172.21.15.49:0/2761978114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6900698a0 0x7fc690156830 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc68c014040 tx=0x7fc68c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:11.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc6867fc700 1 -- 172.21.15.49:0/2761978114 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c003bd0 con 0x7fc6900698a0 2023-07-21T22:13:11.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc6867fc700 1 -- 172.21.15.49:0/2761978114 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c003d30 con 0x7fc6900698a0 2023-07-21T22:13:11.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc696c2f700 1 -- 172.21.15.49:0/2761978114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6900af0d0 con 0x7fc6900698a0 2023-07-21T22:13:11.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc6867fc700 1 -- 172.21.15.49:0/2761978114 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c003ea0 con 0x7fc6900698a0 2023-07-21T22:13:11.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.126+0000 7fc696c2f700 1 -- 172.21.15.49:0/2761978114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6900b2e20 con 0x7fc6900698a0 2023-07-21T22:13:11.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.130+0000 7fc696c2f700 1 -- 172.21.15.49:0/2761978114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6900b26e0 con 0x7fc6900698a0 2023-07-21T22:13:11.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.130+0000 7fc6867fc700 1 -- 172.21.15.49:0/2761978114 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc68c018050 con 0x7fc6900698a0 2023-07-21T22:13:11.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.134+0000 7fc6867fc700 1 --2- 172.21.15.49:0/2761978114 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc6740662f0 0x7fc6740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:11.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.134+0000 7fc6867fc700 1 -- 172.21.15.49:0/2761978114 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fc68c084970 con 0x7fc6900698a0 2023-07-21T22:13:11.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.134+0000 7fc69542c700 1 --2- 172.21.15.49:0/2761978114 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc6740662f0 0x7fc6740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:11.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.134+0000 7fc69542c700 1 --2- 172.21.15.49:0/2761978114 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc6740662f0 0x7fc6740687a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc69006c420 tx=0x7fc680000f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:11.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.138+0000 7fc6867fc700 1 -- 172.21.15.49:0/2761978114 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc68c0556c0 con 0x7fc6900698a0 2023-07-21T22:13:11.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.314+0000 7fc696c2f700 1 -- 172.21.15.49:0/2761978114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fc69004dcb0 con 0x7fc6900698a0 2023-07-21T22:13:11.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.314+0000 7fc6867fc700 1 -- 172.21.15.49:0/2761978114 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v47) v1 ==== 97+0+11 (secure 0 0 0) 0x7fc68c055250 con 0x7fc6900698a0 2023-07-21T22:13:11.358 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:13:11.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.318+0000 7fc696c2f700 1 -- 172.21.15.49:0/2761978114 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc6740662f0 msgr2=0x7fc6740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.318+0000 7fc696c2f700 1 --2- 172.21.15.49:0/2761978114 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc6740662f0 0x7fc6740687a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc69006c420 tx=0x7fc680000f10 comp rx=0 tx=0).stop 2023-07-21T22:13:11.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.318+0000 7fc696c2f700 1 -- 172.21.15.49:0/2761978114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6900698a0 msgr2=0x7fc690156830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.318+0000 7fc696c2f700 1 --2- 172.21.15.49:0/2761978114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6900698a0 0x7fc690156830 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc68c014040 tx=0x7fc68c004770 comp rx=0 tx=0).stop 2023-07-21T22:13:11.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.318+0000 7fc696c2f700 1 -- 172.21.15.49:0/2761978114 shutdown_connections 2023-07-21T22:13:11.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.318+0000 7fc696c2f700 1 --2- 172.21.15.49:0/2761978114 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc6740662f0 0x7fc6740687a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.318+0000 7fc696c2f700 1 --2- 172.21.15.49:0/2761978114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc690159be0 0x7fc6901535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.318+0000 7fc696c2f700 1 --2- 172.21.15.49:0/2761978114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900ca550 0x7fc6900ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.318+0000 7fc696c2f700 1 --2- 172.21.15.49:0/2761978114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6900698a0 0x7fc690156830 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.318+0000 7fc696c2f700 1 -- 172.21.15.49:0/2761978114 >> 172.21.15.49:0/2761978114 conn(0x7fc6900ce0d0 msgr2=0x7fc69015a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:11.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.318+0000 7fc696c2f700 1 -- 172.21.15.49:0/2761978114 shutdown_connections 2023-07-21T22:13:11.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.318+0000 7fc696c2f700 1 -- 172.21.15.49:0/2761978114 wait complete. 2023-07-21T22:13:11.384 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:13:11.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.522+0000 7fa63ae89700 1 Processor -- start 2023-07-21T22:13:11.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.522+0000 7fa63ae89700 1 -- start start 2023-07-21T22:13:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.526+0000 7fa63ae89700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa6340b14d0 0x7fa634163970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:11.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.526+0000 7fa63ae89700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6340cb1b0 con 0x7fa63415d110 2023-07-21T22:13:11.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.526+0000 7fa63ae89700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6340ca630 con 0x7fa634158970 2023-07-21T22:13:11.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.526+0000 7fa63ae89700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6340ca910 con 0x7fa6340b14d0 2023-07-21T22:13:11.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.526+0000 7fa639426700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa6340b14d0 0x7fa634163970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:11.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.526+0000 7fa639426700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa6340b14d0 0x7fa634163970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33772/0 (socket says 172.21.15.49:33772) 2023-07-21T22:13:11.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.526+0000 7fa639426700 1 -- 172.21.15.49:0/4151610796 learned_addr learned my addr 172.21.15.49:0/4151610796 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:11.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.526+0000 7fa639426700 1 -- 172.21.15.49:0/4151610796 >> v1:172.21.15.150:6789/0 conn(0x7fa634158970 legacy=0x7fa6340c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:11.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.526+0000 7fa639426700 1 -- 172.21.15.49:0/4151610796 >> v1:172.21.15.49:6789/0 conn(0x7fa63415d110 legacy=0x7fa6340b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.526+0000 7fa639426700 1 -- 172.21.15.49:0/4151610796 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6340cabf0 con 0x7fa6340b14d0 2023-07-21T22:13:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.530+0000 7fa639426700 1 --2- 172.21.15.49:0/4151610796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6340b14d0 0x7fa634163970 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa62c009e50 tx=0x7fa62c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3603a7ab7c1318 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.530+0000 7fa6337fe700 1 -- 172.21.15.49:0/4151610796 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c00e070 con 0x7fa6340b14d0 2023-07-21T22:13:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.530+0000 7fa6337fe700 1 -- 172.21.15.49:0/4151610796 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c003a40 con 0x7fa6340b14d0 2023-07-21T22:13:11.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.530+0000 7fa6337fe700 1 -- 172.21.15.49:0/4151610796 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c003df0 con 0x7fa6340b14d0 2023-07-21T22:13:11.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.530+0000 7fa63ae89700 1 -- 172.21.15.49:0/4151610796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6340b14d0 msgr2=0x7fa634163970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.530+0000 7fa63ae89700 1 --2- 172.21.15.49:0/4151610796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6340b14d0 0x7fa634163970 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa62c009e50 tx=0x7fa62c00b330 comp rx=0 tx=0).stop 2023-07-21T22:13:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.530+0000 7fa63ae89700 1 -- 172.21.15.49:0/4151610796 shutdown_connections 2023-07-21T22:13:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.530+0000 7fa63ae89700 1 --2- 172.21.15.49:0/4151610796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6340b14d0 0x7fa634163970 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.530+0000 7fa63ae89700 1 -- 172.21.15.49:0/4151610796 >> 172.21.15.49:0/4151610796 conn(0x7fa6340cf340 msgr2=0x7fa6340cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.530+0000 7fa63ae89700 1 -- 172.21.15.49:0/4151610796 shutdown_connections 2023-07-21T22:13:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.530+0000 7fa63ae89700 1 -- 172.21.15.49:0/4151610796 wait complete. 2023-07-21T22:13:11.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.534+0000 7fa63ae89700 1 Processor -- start 2023-07-21T22:13:11.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.534+0000 7fa63ae89700 1 -- start start 2023-07-21T22:13:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.534+0000 7fa63ae89700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6340b14d0 0x7fa634150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.534+0000 7fa63ae89700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634158970 0x7fa6340ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.534+0000 7fa63ae89700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa63415d110 0x7fa6340ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.534+0000 7fa63ae89700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340abe20 con 0x7fa634158970 2023-07-21T22:13:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.534+0000 7fa63ae89700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340ac100 con 0x7fa63415d110 2023-07-21T22:13:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.534+0000 7fa63ae89700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340ac3e0 con 0x7fa6340b14d0 2023-07-21T22:13:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.534+0000 7fa633fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634158970 0x7fa6340ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.534+0000 7fa633fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634158970 0x7fa6340ad510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33778/0 (socket says 172.21.15.49:33778) 2023-07-21T22:13:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.534+0000 7fa633fff700 1 -- 172.21.15.49:0/1730610981 learned_addr learned my addr 172.21.15.49:0/1730610981 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.534+0000 7fa639426700 1 --2- 172.21.15.49:0/1730610981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa63415d110 0x7fa6340ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.534+0000 7fa638c25700 1 --2- 172.21.15.49:0/1730610981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6340b14d0 0x7fa634150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.538+0000 7fa633fff700 1 -- 172.21.15.49:0/1730610981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6340b14d0 msgr2=0x7fa634150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.538+0000 7fa633fff700 1 --2- 172.21.15.49:0/1730610981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6340b14d0 0x7fa634150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.538+0000 7fa633fff700 1 -- 172.21.15.49:0/1730610981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa63415d110 msgr2=0x7fa6340ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.538+0000 7fa633fff700 1 --2- 172.21.15.49:0/1730610981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa63415d110 0x7fa6340ada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.538+0000 7fa633fff700 1 -- 172.21.15.49:0/1730610981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c009b30 con 0x7fa634158970 2023-07-21T22:13:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.538+0000 7fa633fff700 1 --2- 172.21.15.49:0/1730610981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634158970 0x7fa6340ad510 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa62000c500 tx=0x7fa62000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.538+0000 7fa6317fa700 1 -- 172.21.15.49:0/1730610981 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200052d0 con 0x7fa634158970 2023-07-21T22:13:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.538+0000 7fa6317fa700 1 -- 172.21.15.49:0/1730610981 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa620005430 con 0x7fa634158970 2023-07-21T22:13:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.538+0000 7fa6317fa700 1 -- 172.21.15.49:0/1730610981 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200055a0 con 0x7fa634158970 2023-07-21T22:13:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.538+0000 7fa63ae89700 1 -- 172.21.15.49:0/1730610981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6340ac6c0 con 0x7fa634158970 2023-07-21T22:13:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.538+0000 7fa63ae89700 1 -- 172.21.15.49:0/1730610981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa634151450 con 0x7fa634158970 2023-07-21T22:13:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.538+0000 7fa63ae89700 1 -- 172.21.15.49:0/1730610981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6340acbe0 con 0x7fa634158970 2023-07-21T22:13:11.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.542+0000 7fa6317fa700 1 -- 172.21.15.49:0/1730610981 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6200036a0 con 0x7fa634158970 2023-07-21T22:13:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.542+0000 7fa6317fa700 1 --2- 172.21.15.49:0/1730610981 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6180662f0 0x7fa6180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.542+0000 7fa6317fa700 1 -- 172.21.15.49:0/1730610981 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fa6200832b0 con 0x7fa634158970 2023-07-21T22:13:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.542+0000 7fa638c25700 1 --2- 172.21.15.49:0/1730610981 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6180662f0 0x7fa6180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.542+0000 7fa638c25700 1 --2- 172.21.15.49:0/1730610981 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6180662f0 0x7fa6180687a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa628004f70 tx=0x7fa628009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:11.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.550+0000 7fa6317fa700 1 -- 172.21.15.49:0/1730610981 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6340acbe0 con 0x7fa634158970 2023-07-21T22:13:11.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.734+0000 7fa63ae89700 1 -- 172.21.15.49:0/1730610981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa6340acbe0 con 0x7fa634158970 2023-07-21T22:13:11.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.734+0000 7fa6317fa700 1 -- 172.21.15.49:0/1730610981 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa6340acbe0 con 0x7fa634158970 2023-07-21T22:13:11.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.738+0000 7fa63ae89700 1 -- 172.21.15.49:0/1730610981 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6180662f0 msgr2=0x7fa6180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.738+0000 7fa63ae89700 1 --2- 172.21.15.49:0/1730610981 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6180662f0 0x7fa6180687a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa628004f70 tx=0x7fa628009040 comp rx=0 tx=0).stop 2023-07-21T22:13:11.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.738+0000 7fa63ae89700 1 -- 172.21.15.49:0/1730610981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634158970 msgr2=0x7fa6340ad510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.738+0000 7fa63ae89700 1 --2- 172.21.15.49:0/1730610981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634158970 0x7fa6340ad510 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa62000c500 tx=0x7fa62000c810 comp rx=0 tx=0).stop 2023-07-21T22:13:11.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.738+0000 7fa63ae89700 1 -- 172.21.15.49:0/1730610981 shutdown_connections 2023-07-21T22:13:11.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.738+0000 7fa63ae89700 1 --2- 172.21.15.49:0/1730610981 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6180662f0 0x7fa6180687a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.738+0000 7fa63ae89700 1 --2- 172.21.15.49:0/1730610981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634158970 0x7fa6340ad510 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.738+0000 7fa63ae89700 1 --2- 172.21.15.49:0/1730610981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa63415d110 0x7fa6340ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.738+0000 7fa63ae89700 1 --2- 172.21.15.49:0/1730610981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6340b14d0 0x7fa634150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.738+0000 7fa63ae89700 1 -- 172.21.15.49:0/1730610981 >> 172.21.15.49:0/1730610981 conn(0x7fa6340cf340 msgr2=0x7fa6340cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:11.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.738+0000 7fa63ae89700 1 -- 172.21.15.49:0/1730610981 shutdown_connections 2023-07-21T22:13:11.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:11.738+0000 7fa63ae89700 1 -- 172.21.15.49:0/1730610981 wait complete. 2023-07-21T22:13:11.783 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:13:11.802 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:13:11.802 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:13:11.820 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:13:12.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.002+0000 7fcb5da11700 1 Processor -- start 2023-07-21T22:13:12.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.002+0000 7fcb5da11700 1 -- start start 2023-07-21T22:13:12.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.002+0000 7fcb5da11700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb580d1e40 0x7fcb580b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.002+0000 7fcb5da11700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb580b3e80 con 0x7fcb580cee10 2023-07-21T22:13:12.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb5da11700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5815fd40 con 0x7fcb580b7af0 2023-07-21T22:13:12.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb5da11700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb580cea00 con 0x7fcb580d1e40 2023-07-21T22:13:12.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb577fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcb580cee10 0x7fcb580b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47986/0 (socket says 172.21.15.49:47986) 2023-07-21T22:13:12.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb577fe700 1 -- 172.21.15.49:0/1377911837 learned_addr learned my addr 172.21.15.49:0/1377911837 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:12.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb567fc700 1 --2- 172.21.15.49:0/1377911837 >> v2:172.21.15.49:3300/0 conn(0x7fcb580d1e40 0x7fcb580b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb55ffb700 1 -- 172.21.15.49:0/1377911837 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120993492 0 0) 0x7fcb580b3e80 con 0x7fcb580cee10 2023-07-21T22:13:12.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb55ffb700 1 -- 172.21.15.49:0/1377911837 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb400035d0 con 0x7fcb580cee10 2023-07-21T22:13:12.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb55ffb700 1 -- 172.21.15.49:0/1377911837 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043335615 0 0) 0x7fcb5815fd40 con 0x7fcb580b7af0 2023-07-21T22:13:12.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb567fc700 1 -- 172.21.15.49:0/1377911837 >> v1:172.21.15.150:6789/0 conn(0x7fcb580b7af0 legacy=0x7fcb5815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb567fc700 1 -- 172.21.15.49:0/1377911837 >> v1:172.21.15.49:6789/0 conn(0x7fcb580cee10 legacy=0x7fcb580b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb567fc700 1 -- 172.21.15.49:0/1377911837 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb580ccbf0 con 0x7fcb580d1e40 2023-07-21T22:13:12.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb567fc700 1 --2- 172.21.15.49:0/1377911837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb580d1e40 0x7fcb580b1630 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009850 tx=0x7fcb4c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7dd463d610fbf2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:12.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb55ffb700 1 -- 172.21.15.49:0/1377911837 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50001a40 con 0x7fcb580d1e40 2023-07-21T22:13:12.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb55ffb700 1 -- 172.21.15.49:0/1377911837 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c010590 con 0x7fcb580d1e40 2023-07-21T22:13:12.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.006+0000 7fcb55ffb700 1 -- 172.21.15.49:0/1377911837 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c010940 con 0x7fcb580d1e40 2023-07-21T22:13:12.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.010+0000 7fcb5da11700 1 -- 172.21.15.49:0/1377911837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb580d1e40 msgr2=0x7fcb580b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.010+0000 7fcb5da11700 1 --2- 172.21.15.49:0/1377911837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb580d1e40 0x7fcb580b1630 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009850 tx=0x7fcb4c009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:12.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.010+0000 7fcb5da11700 1 -- 172.21.15.49:0/1377911837 shutdown_connections 2023-07-21T22:13:12.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.010+0000 7fcb5da11700 1 --2- 172.21.15.49:0/1377911837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb580d1e40 0x7fcb580b1630 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.010+0000 7fcb5da11700 1 -- 172.21.15.49:0/1377911837 >> 172.21.15.49:0/1377911837 conn(0x7fcb5806e960 msgr2=0x7fcb5806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:12.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.010+0000 7fcb5da11700 1 -- 172.21.15.49:0/1377911837 shutdown_connections 2023-07-21T22:13:12.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.010+0000 7fcb5da11700 1 -- 172.21.15.49:0/1377911837 wait complete. 2023-07-21T22:13:12.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.010+0000 7fcb5da11700 1 Processor -- start 2023-07-21T22:13:12.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb5da11700 1 -- start start 2023-07-21T22:13:12.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb5da11700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb580b7af0 0x7fcb58153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb5da11700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb580cee10 0x7fcb580c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb5da11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb580d1e40 0x7fcb580c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb5da11700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb580cc3a0 con 0x7fcb580d1e40 2023-07-21T22:13:12.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb5da11700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb580c6ad0 con 0x7fcb580cee10 2023-07-21T22:13:12.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb5da11700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb58157ae0 con 0x7fcb580b7af0 2023-07-21T22:13:12.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb577fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb580d1e40 0x7fcb580c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb577fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb580d1e40 0x7fcb580c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33802/0 (socket says 172.21.15.49:33802) 2023-07-21T22:13:12.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb577fe700 1 -- 172.21.15.49:0/1615524483 learned_addr learned my addr 172.21.15.49:0/1615524483 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:12.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb56ffd700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb580b7af0 0x7fcb58153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb567fc700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb580cee10 0x7fcb580c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb577fe700 1 -- 172.21.15.49:0/1615524483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb580b7af0 msgr2=0x7fcb58153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb577fe700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb580b7af0 0x7fcb58153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb577fe700 1 -- 172.21.15.49:0/1615524483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb580cee10 msgr2=0x7fcb580c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb577fe700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb580cee10 0x7fcb580c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb577fe700 1 -- 172.21.15.49:0/1615524483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c0094b0 con 0x7fcb580d1e40 2023-07-21T22:13:12.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb56ffd700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb580b7af0 0x7fcb58153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:12.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb567fc700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb580cee10 0x7fcb580c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:12.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb577fe700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb580d1e40 0x7fcb580c8880 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcb50002080 tx=0x7fcb5000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:12.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.014+0000 7fcb3ffff700 1 -- 172.21.15.49:0/1615524483 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5000ad80 con 0x7fcb580d1e40 2023-07-21T22:13:12.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.018+0000 7fcb3ffff700 1 -- 172.21.15.49:0/1615524483 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb500070d0 con 0x7fcb580d1e40 2023-07-21T22:13:12.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.018+0000 7fcb5da11700 1 -- 172.21.15.49:0/1615524483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb580cbb20 con 0x7fcb580d1e40 2023-07-21T22:13:12.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.018+0000 7fcb3ffff700 1 -- 172.21.15.49:0/1615524483 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50007480 con 0x7fcb580d1e40 2023-07-21T22:13:12.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.018+0000 7fcb5da11700 1 -- 172.21.15.49:0/1615524483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb580cc0c0 con 0x7fcb580d1e40 2023-07-21T22:13:12.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.018+0000 7fcb5da11700 1 -- 172.21.15.49:0/1615524483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb580c68a0 con 0x7fcb580d1e40 2023-07-21T22:13:12.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.018+0000 7fcb3ffff700 1 -- 172.21.15.49:0/1615524483 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcb500075e0 con 0x7fcb580d1e40 2023-07-21T22:13:12.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.022+0000 7fcb3ffff700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb44066320 0x7fcb440687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.022+0000 7fcb3ffff700 1 -- 172.21.15.49:0/1615524483 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fcb50084090 con 0x7fcb580d1e40 2023-07-21T22:13:12.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.022+0000 7fcb56ffd700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb44066320 0x7fcb440687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.022+0000 7fcb56ffd700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb44066320 0x7fcb440687d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcb48000f60 tx=0x7fcb48009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:12.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.026+0000 7fcb3ffff700 1 -- 172.21.15.49:0/1615524483 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb580c68a0 con 0x7fcb580d1e40 2023-07-21T22:13:12.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.202+0000 7fcb5da11700 1 -- 172.21.15.49:0/1615524483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb580c68a0 con 0x7fcb580d1e40 2023-07-21T22:13:12.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.206+0000 7fcb3ffff700 1 -- 172.21.15.49:0/1615524483 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+20239 (secure 0 0 0) 0x7fcb580c68a0 con 0x7fcb580d1e40 2023-07-21T22:13:12.248 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:12.248 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":47,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:12:39.024259+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:12:20.014383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T22:12:21.059436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"data_new","create_time":"2023-07-21T22:12:36.491357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:13:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.206+0000 7fcb5da11700 1 -- 172.21.15.49:0/1615524483 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb44066320 msgr2=0x7fcb440687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.206+0000 7fcb5da11700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb44066320 0x7fcb440687d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcb48000f60 tx=0x7fcb48009040 comp rx=0 tx=0).stop 2023-07-21T22:13:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.206+0000 7fcb5da11700 1 -- 172.21.15.49:0/1615524483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb580d1e40 msgr2=0x7fcb580c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.206+0000 7fcb5da11700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb580d1e40 0x7fcb580c8880 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcb50002080 tx=0x7fcb5000a340 comp rx=0 tx=0).stop 2023-07-21T22:13:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.206+0000 7fcb5da11700 1 -- 172.21.15.49:0/1615524483 shutdown_connections 2023-07-21T22:13:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.206+0000 7fcb5da11700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcb44066320 0x7fcb440687d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.206+0000 7fcb5da11700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb580d1e40 0x7fcb580c8880 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.206+0000 7fcb5da11700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb580cee10 0x7fcb580c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.206+0000 7fcb5da11700 1 --2- 172.21.15.49:0/1615524483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb580b7af0 0x7fcb58153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.206+0000 7fcb5da11700 1 -- 172.21.15.49:0/1615524483 >> 172.21.15.49:0/1615524483 conn(0x7fcb5806e960 msgr2=0x7fcb5815b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.210+0000 7fcb5da11700 1 -- 172.21.15.49:0/1615524483 shutdown_connections 2023-07-21T22:13:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.210+0000 7fcb5da11700 1 -- 172.21.15.49:0/1615524483 wait complete. 2023-07-21T22:13:12.274 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:12:20.014383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:12:21.059436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'data_new', 'create_time': '2023-07-21T22:12:36.491357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:13:12.275 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:13:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.414+0000 7ff83c9ae700 1 Processor -- start 2023-07-21T22:13:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.414+0000 7ff83c9ae700 1 -- start start 2023-07-21T22:13:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff83c9ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff83815e380 0x7ff8380cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff83c9ae700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8380b3a50 0x7ff8380cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff83c9ae700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8380c9cd0 0x7ff8380c8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff83c9ae700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8380ca190 con 0x7ff8380c9cd0 2023-07-21T22:13:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff83c9ae700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838159fd0 con 0x7ff8380b3a50 2023-07-21T22:13:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff83c9ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83815d6e0 con 0x7ff83815e380 2023-07-21T22:13:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff836d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8380c9cd0 0x7ff8380c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff836d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8380c9cd0 0x7ff8380c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33812/0 (socket says 172.21.15.49:33812) 2023-07-21T22:13:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff836d9d700 1 -- 172.21.15.49:0/532101708 learned_addr learned my addr 172.21.15.49:0/532101708 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff835d9b700 1 --2- 172.21.15.49:0/532101708 >> v2:172.21.15.150:3300/0 conn(0x7ff8380b3a50 0x7ff8380cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff83659c700 1 --2- 172.21.15.49:0/532101708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff83815e380 0x7ff8380cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff836d9d700 1 -- 172.21.15.49:0/532101708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff83815e380 msgr2=0x7ff8380cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff836d9d700 1 --2- 172.21.15.49:0/532101708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff83815e380 0x7ff8380cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff836d9d700 1 -- 172.21.15.49:0/532101708 >> v2:172.21.15.150:3300/0 conn(0x7ff8380b3a50 msgr2=0x7ff8380cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff836d9d700 1 --2- 172.21.15.49:0/532101708 >> v2:172.21.15.150:3300/0 conn(0x7ff8380b3a50 0x7ff8380cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff836d9d700 1 -- 172.21.15.49:0/532101708 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8380ca900 con 0x7ff8380c9cd0 2023-07-21T22:13:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff836d9d700 1 --2- 172.21.15.49:0/532101708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8380c9cd0 0x7ff8380c8820 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff83806f940 tx=0x7ff83000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8601645d748a10 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff83559a700 1 -- 172.21.15.49:0/532101708 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83000e070 con 0x7ff8380c9cd0 2023-07-21T22:13:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff83559a700 1 -- 172.21.15.49:0/532101708 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83000b910 con 0x7ff8380c9cd0 2023-07-21T22:13:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.418+0000 7ff83559a700 1 -- 172.21.15.49:0/532101708 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83000bcc0 con 0x7ff8380c9cd0 2023-07-21T22:13:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.422+0000 7ff83c9ae700 1 -- 172.21.15.49:0/532101708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8380c9cd0 msgr2=0x7ff8380c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.422+0000 7ff83c9ae700 1 --2- 172.21.15.49:0/532101708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8380c9cd0 0x7ff8380c8820 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff83806f940 tx=0x7ff83000b330 comp rx=0 tx=0).stop 2023-07-21T22:13:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.422+0000 7ff83c9ae700 1 -- 172.21.15.49:0/532101708 shutdown_connections 2023-07-21T22:13:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.422+0000 7ff83c9ae700 1 --2- 172.21.15.49:0/532101708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8380c9cd0 0x7ff8380c8820 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.422+0000 7ff83c9ae700 1 --2- 172.21.15.49:0/532101708 >> v2:172.21.15.150:3300/0 conn(0x7ff8380b3a50 0x7ff8380cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.422+0000 7ff83c9ae700 1 --2- 172.21.15.49:0/532101708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff83815e380 0x7ff8380cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.422+0000 7ff83c9ae700 1 -- 172.21.15.49:0/532101708 >> 172.21.15.49:0/532101708 conn(0x7ff83806e960 msgr2=0x7ff83806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.422+0000 7ff83c9ae700 1 -- 172.21.15.49:0/532101708 shutdown_connections 2023-07-21T22:13:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.422+0000 7ff83c9ae700 1 -- 172.21.15.49:0/532101708 wait complete. 2023-07-21T22:13:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.426+0000 7ff83c9ae700 1 Processor -- start 2023-07-21T22:13:12.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.426+0000 7ff83c9ae700 1 -- start start 2023-07-21T22:13:12.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.426+0000 7ff83c9ae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8380b3a50 0x7ff8380c2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.426+0000 7ff83c9ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8380c9cd0 0x7ff83815b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.426+0000 7ff83c9ae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff83815e380 0x7ff8380b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.426+0000 7ff83c9ae700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8380c35e0 con 0x7ff83815e380 2023-07-21T22:13:12.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.426+0000 7ff83c9ae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83815b730 con 0x7ff8380b3a50 2023-07-21T22:13:12.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.426+0000 7ff83c9ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8380c3a00 con 0x7ff8380c9cd0 2023-07-21T22:13:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.426+0000 7ff836d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff83815e380 0x7ff8380b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.426+0000 7ff836d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff83815e380 0x7ff8380b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33820/0 (socket says 172.21.15.49:33820) 2023-07-21T22:13:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.426+0000 7ff836d9d700 1 -- 172.21.15.49:0/1580206259 learned_addr learned my addr 172.21.15.49:0/1580206259 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.426+0000 7ff83659c700 1 --2- 172.21.15.49:0/1580206259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8380b3a50 0x7ff8380c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.426+0000 7ff835d9b700 1 --2- 172.21.15.49:0/1580206259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8380c9cd0 0x7ff83815b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.430+0000 7ff836d9d700 1 -- 172.21.15.49:0/1580206259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8380c9cd0 msgr2=0x7ff83815b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.430+0000 7ff836d9d700 1 --2- 172.21.15.49:0/1580206259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8380c9cd0 0x7ff83815b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.430+0000 7ff836d9d700 1 -- 172.21.15.49:0/1580206259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8380b3a50 msgr2=0x7ff8380c2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.430+0000 7ff836d9d700 1 --2- 172.21.15.49:0/1580206259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8380b3a50 0x7ff8380c2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.430+0000 7ff836d9d700 1 -- 172.21.15.49:0/1580206259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff830009b30 con 0x7ff83815e380 2023-07-21T22:13:12.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.430+0000 7ff836d9d700 1 --2- 172.21.15.49:0/1580206259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff83815e380 0x7ff8380b1f60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff830012000 tx=0x7ff830004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:12.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.430+0000 7ff826ffd700 1 -- 172.21.15.49:0/1580206259 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8300092e0 con 0x7ff83815e380 2023-07-21T22:13:12.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.430+0000 7ff826ffd700 1 -- 172.21.15.49:0/1580206259 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83000ce80 con 0x7ff83815e380 2023-07-21T22:13:12.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.430+0000 7ff826ffd700 1 -- 172.21.15.49:0/1580206259 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830004490 con 0x7ff83815e380 2023-07-21T22:13:12.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.430+0000 7ff83c9ae700 1 -- 172.21.15.49:0/1580206259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8380c2960 con 0x7ff83815e380 2023-07-21T22:13:12.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.430+0000 7ff83c9ae700 1 -- 172.21.15.49:0/1580206259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8380c2f20 con 0x7ff83815e380 2023-07-21T22:13:12.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.430+0000 7ff83c9ae700 1 -- 172.21.15.49:0/1580206259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83804dd50 con 0x7ff83815e380 2023-07-21T22:13:12.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.434+0000 7ff826ffd700 1 -- 172.21.15.49:0/1580206259 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8300045f0 con 0x7ff83815e380 2023-07-21T22:13:12.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.434+0000 7ff826ffd700 1 --2- 172.21.15.49:0/1580206259 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff8180662f0 0x7ff8180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.434+0000 7ff826ffd700 1 -- 172.21.15.49:0/1580206259 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7ff8300853a0 con 0x7ff83815e380 2023-07-21T22:13:12.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.434+0000 7ff83659c700 1 --2- 172.21.15.49:0/1580206259 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff8180662f0 0x7ff8180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.438+0000 7ff83659c700 1 --2- 172.21.15.49:0/1580206259 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff8180662f0 0x7ff8180687a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff828009b70 tx=0x7ff828009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:12.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.442+0000 7ff826ffd700 1 -- 172.21.15.49:0/1580206259 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff830052690 con 0x7ff83815e380 2023-07-21T22:13:12.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.614+0000 7ff83c9ae700 1 -- 172.21.15.49:0/1580206259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff838070e70 con 0x7ff83815e380 2023-07-21T22:13:12.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.614+0000 7ff826ffd700 1 -- 172.21.15.49:0/1580206259 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8300048a0 con 0x7ff83815e380 2023-07-21T22:13:12.657 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:13:12.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.618+0000 7ff83c9ae700 1 -- 172.21.15.49:0/1580206259 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff8180662f0 msgr2=0x7ff8180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.618+0000 7ff83c9ae700 1 --2- 172.21.15.49:0/1580206259 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff8180662f0 0x7ff8180687a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff828009b70 tx=0x7ff828009240 comp rx=0 tx=0).stop 2023-07-21T22:13:12.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.618+0000 7ff83c9ae700 1 -- 172.21.15.49:0/1580206259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff83815e380 msgr2=0x7ff8380b1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.618+0000 7ff83c9ae700 1 --2- 172.21.15.49:0/1580206259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff83815e380 0x7ff8380b1f60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff830012000 tx=0x7ff830004af0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.618+0000 7ff83c9ae700 1 -- 172.21.15.49:0/1580206259 shutdown_connections 2023-07-21T22:13:12.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.618+0000 7ff83c9ae700 1 --2- 172.21.15.49:0/1580206259 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff8180662f0 0x7ff8180687a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.618+0000 7ff83c9ae700 1 --2- 172.21.15.49:0/1580206259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff83815e380 0x7ff8380b1f60 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.618+0000 7ff83c9ae700 1 --2- 172.21.15.49:0/1580206259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8380c9cd0 0x7ff83815b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.618+0000 7ff83c9ae700 1 --2- 172.21.15.49:0/1580206259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8380b3a50 0x7ff8380c2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.618+0000 7ff83c9ae700 1 -- 172.21.15.49:0/1580206259 >> 172.21.15.49:0/1580206259 conn(0x7ff83806e960 msgr2=0x7ff8380b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:12.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.618+0000 7ff83c9ae700 1 -- 172.21.15.49:0/1580206259 shutdown_connections 2023-07-21T22:13:12.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.618+0000 7ff83c9ae700 1 -- 172.21.15.49:0/1580206259 wait complete. 2023-07-21T22:13:12.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:13:12.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.818+0000 7feb32636700 1 Processor -- start 2023-07-21T22:13:12.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.818+0000 7feb32636700 1 -- start start 2023-07-21T22:13:12.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb32636700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb2c0ca550 0x7feb2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb32636700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feb2c06d6d0 0x7feb2c0698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb32636700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2c0c8b80 con 0x7feb2c159be0 2023-07-21T22:13:12.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb32636700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2c0c9720 con 0x7feb2c06d6d0 2023-07-21T22:13:12.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb32636700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c06db90 con 0x7feb2c0ca550 2023-07-21T22:13:12.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb31634700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feb2c159be0 0x7feb2c0c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48000/0 (socket says 172.21.15.49:48000) 2023-07-21T22:13:12.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb31634700 1 -- 172.21.15.49:0/644016993 learned_addr learned my addr 172.21.15.49:0/644016993 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:12.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb31e35700 1 --2- 172.21.15.49:0/644016993 >> v2:172.21.15.150:3300/0 conn(0x7feb2c06d6d0 0x7feb2c0698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb30e33700 1 --2- 172.21.15.49:0/644016993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb2c0ca550 0x7feb2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb23fff700 1 -- 172.21.15.49:0/644016993 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808622019 0 0) 0x7feb2c0c8b80 con 0x7feb2c159be0 2023-07-21T22:13:12.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb23fff700 1 -- 172.21.15.49:0/644016993 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb180035d0 con 0x7feb2c159be0 2023-07-21T22:13:12.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb31e35700 1 -- 172.21.15.49:0/644016993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb2c0ca550 msgr2=0x7feb2c06d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:12.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb31e35700 1 --2- 172.21.15.49:0/644016993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb2c0ca550 0x7feb2c06d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb31e35700 1 -- 172.21.15.49:0/644016993 >> v1:172.21.15.49:6789/0 conn(0x7feb2c159be0 legacy=0x7feb2c0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb31e35700 1 -- 172.21.15.49:0/644016993 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c06de70 con 0x7feb2c06d6d0 2023-07-21T22:13:12.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.822+0000 7feb31e35700 1 --2- 172.21.15.49:0/644016993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb2c06d6d0 0x7feb2c0698a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7feb24009d90 tx=0x7feb2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e789bd2869a64e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:12.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.826+0000 7feb23fff700 1 -- 172.21.15.49:0/644016993 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2400e070 con 0x7feb2c06d6d0 2023-07-21T22:13:12.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.826+0000 7feb23fff700 1 -- 172.21.15.49:0/644016993 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2400bb20 con 0x7feb2c06d6d0 2023-07-21T22:13:12.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.826+0000 7feb23fff700 1 -- 172.21.15.49:0/644016993 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24012430 con 0x7feb2c06d6d0 2023-07-21T22:13:12.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.826+0000 7feb32636700 1 -- 172.21.15.49:0/644016993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb2c06d6d0 msgr2=0x7feb2c0698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.826+0000 7feb32636700 1 --2- 172.21.15.49:0/644016993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb2c06d6d0 0x7feb2c0698a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7feb24009d90 tx=0x7feb2400b330 comp rx=0 tx=0).stop 2023-07-21T22:13:12.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.826+0000 7feb32636700 1 -- 172.21.15.49:0/644016993 shutdown_connections 2023-07-21T22:13:12.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.826+0000 7feb32636700 1 --2- 172.21.15.49:0/644016993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb2c06d6d0 0x7feb2c0698a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.826+0000 7feb32636700 1 --2- 172.21.15.49:0/644016993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb2c0ca550 0x7feb2c06d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.826+0000 7feb32636700 1 -- 172.21.15.49:0/644016993 >> 172.21.15.49:0/644016993 conn(0x7feb2c0ce0d0 msgr2=0x7feb2c0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:12.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.826+0000 7feb32636700 1 -- 172.21.15.49:0/644016993 shutdown_connections 2023-07-21T22:13:12.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.826+0000 7feb32636700 1 -- 172.21.15.49:0/644016993 wait complete. 2023-07-21T22:13:12.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb32636700 1 Processor -- start 2023-07-21T22:13:12.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb32636700 1 -- start start 2023-07-21T22:13:12.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb32636700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb2c06d6d0 0x7feb2c0ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb32636700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb2c0ca550 0x7feb2c1573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb32636700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb2c159be0 0x7feb2c0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb32636700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0cd0b0 con 0x7feb2c06d6d0 2023-07-21T22:13:12.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb32636700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0cbdb0 con 0x7feb2c159be0 2023-07-21T22:13:12.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb32636700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0cc090 con 0x7feb2c0ca550 2023-07-21T22:13:12.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb31634700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb2c06d6d0 0x7feb2c0ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb31634700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb2c06d6d0 0x7feb2c0ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33836/0 (socket says 172.21.15.49:33836) 2023-07-21T22:13:12.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb31634700 1 -- 172.21.15.49:0/2112331095 learned_addr learned my addr 172.21.15.49:0/2112331095 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:12.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb30e33700 1 --2- 172.21.15.49:0/2112331095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb2c0ca550 0x7feb2c1573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb31e35700 1 --2- 172.21.15.49:0/2112331095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb2c159be0 0x7feb2c0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb31634700 1 -- 172.21.15.49:0/2112331095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb2c0ca550 msgr2=0x7feb2c1573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb31634700 1 --2- 172.21.15.49:0/2112331095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb2c0ca550 0x7feb2c1573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb31634700 1 -- 172.21.15.49:0/2112331095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb2c159be0 msgr2=0x7feb2c0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:12.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb31634700 1 --2- 172.21.15.49:0/2112331095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb2c159be0 0x7feb2c0cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:12.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb31634700 1 -- 172.21.15.49:0/2112331095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb24009a70 con 0x7feb2c06d6d0 2023-07-21T22:13:12.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.830+0000 7feb31634700 1 --2- 172.21.15.49:0/2112331095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb2c06d6d0 0x7feb2c0ccb70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7feb2800c4d0 tx=0x7feb2800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:12.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.834+0000 7feb21ffb700 1 -- 172.21.15.49:0/2112331095 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28005d90 con 0x7feb2c06d6d0 2023-07-21T22:13:12.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.834+0000 7feb21ffb700 1 -- 172.21.15.49:0/2112331095 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb280070d0 con 0x7feb2c06d6d0 2023-07-21T22:13:12.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.834+0000 7feb21ffb700 1 -- 172.21.15.49:0/2112331095 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28007480 con 0x7feb2c06d6d0 2023-07-21T22:13:12.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.834+0000 7feb32636700 1 -- 172.21.15.49:0/2112331095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2c0cc370 con 0x7feb2c06d6d0 2023-07-21T22:13:12.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.834+0000 7feb32636700 1 -- 172.21.15.49:0/2112331095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2c157920 con 0x7feb2c06d6d0 2023-07-21T22:13:12.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.834+0000 7feb32636700 1 -- 172.21.15.49:0/2112331095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2c0cc890 con 0x7feb2c06d6d0 2023-07-21T22:13:12.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.834+0000 7feb21ffb700 1 -- 172.21.15.49:0/2112331095 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feb280075e0 con 0x7feb2c06d6d0 2023-07-21T22:13:12.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.838+0000 7feb21ffb700 1 --2- 172.21.15.49:0/2112331095 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb100662f0 0x7feb100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:12.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.838+0000 7feb21ffb700 1 -- 172.21.15.49:0/2112331095 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7feb28083540 con 0x7feb2c06d6d0 2023-07-21T22:13:12.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.838+0000 7feb30e33700 1 --2- 172.21.15.49:0/2112331095 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb100662f0 0x7feb100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:12.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.838+0000 7feb30e33700 1 --2- 172.21.15.49:0/2112331095 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb100662f0 0x7feb100687a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0b0a30 tx=0x7feb1c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:12.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:12.842+0000 7feb21ffb700 1 -- 172.21.15.49:0/2112331095 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb2c0cc890 con 0x7feb2c06d6d0 2023-07-21T22:13:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.014+0000 7feb32636700 1 -- 172.21.15.49:0/2112331095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feb2c0cc890 con 0x7feb2c06d6d0 2023-07-21T22:13:13.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.014+0000 7feb21ffb700 1 -- 172.21.15.49:0/2112331095 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7feb2c0cc890 con 0x7feb2c06d6d0 2023-07-21T22:13:13.059 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:13:13.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.022+0000 7feb32636700 1 -- 172.21.15.49:0/2112331095 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb100662f0 msgr2=0x7feb100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.022+0000 7feb32636700 1 --2- 172.21.15.49:0/2112331095 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb100662f0 0x7feb100687a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0b0a30 tx=0x7feb1c009240 comp rx=0 tx=0).stop 2023-07-21T22:13:13.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.022+0000 7feb32636700 1 -- 172.21.15.49:0/2112331095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb2c06d6d0 msgr2=0x7feb2c0ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.022+0000 7feb32636700 1 --2- 172.21.15.49:0/2112331095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb2c06d6d0 0x7feb2c0ccb70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7feb2800c4d0 tx=0x7feb2800c7e0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.022+0000 7feb32636700 1 -- 172.21.15.49:0/2112331095 shutdown_connections 2023-07-21T22:13:13.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.022+0000 7feb32636700 1 --2- 172.21.15.49:0/2112331095 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7feb100662f0 0x7feb100687a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.022+0000 7feb32636700 1 --2- 172.21.15.49:0/2112331095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb2c159be0 0x7feb2c0cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.022+0000 7feb32636700 1 --2- 172.21.15.49:0/2112331095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb2c0ca550 0x7feb2c1573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.022+0000 7feb32636700 1 --2- 172.21.15.49:0/2112331095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb2c06d6d0 0x7feb2c0ccb70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.022+0000 7feb32636700 1 -- 172.21.15.49:0/2112331095 >> 172.21.15.49:0/2112331095 conn(0x7feb2c0ce0d0 msgr2=0x7feb2c1587a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:13.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.022+0000 7feb32636700 1 -- 172.21.15.49:0/2112331095 shutdown_connections 2023-07-21T22:13:13.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.022+0000 7feb32636700 1 -- 172.21.15.49:0/2112331095 wait complete. 2023-07-21T22:13:13.086 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:13:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.222+0000 7f2a00d03700 1 Processor -- start 2023-07-21T22:13:13.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.222+0000 7f2a00d03700 1 -- start start 2023-07-21T22:13:13.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.226+0000 7f2a00d03700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29fc0b7af0 0x7f29fc0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.226+0000 7f2a00d03700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc0b3e80 con 0x7f29fc0d1e40 2023-07-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.226+0000 7f2a00d03700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc15fd40 con 0x7f29fc0cee10 2023-07-21T22:13:13.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.226+0000 7f2a00d03700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc0cea00 con 0x7f29fc0b7af0 2023-07-21T22:13:13.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.226+0000 7f29faffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f29fc0d1e40 0x7f29fc15f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48008/0 (socket says 172.21.15.49:48008) 2023-07-21T22:13:13.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.226+0000 7f29faffd700 1 -- 172.21.15.49:0/124586873 learned_addr learned my addr 172.21.15.49:0/124586873 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:13.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.226+0000 7f29fb7fe700 1 --2- 172.21.15.49:0/124586873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29fc0b7af0 0x7f29fc0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:13.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f29fa7fc700 1 -- 172.21.15.49:0/124586873 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310046724 0 0) 0x7f29fc0b3e80 con 0x7f29fc0d1e40 2023-07-21T22:13:13.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f29fa7fc700 1 -- 172.21.15.49:0/124586873 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29e40035d0 con 0x7f29fc0d1e40 2023-07-21T22:13:13.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f29fb7fe700 1 -- 172.21.15.49:0/124586873 >> v1:172.21.15.150:6789/0 conn(0x7f29fc0cee10 legacy=0x7f29fc0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f29fa7fc700 1 -- 172.21.15.49:0/124586873 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3638037010 0 0) 0x7f29e40035d0 con 0x7f29fc0d1e40 2023-07-21T22:13:13.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f29fb7fe700 1 -- 172.21.15.49:0/124586873 >> v1:172.21.15.49:6789/0 conn(0x7f29fc0d1e40 legacy=0x7f29fc15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f29fb7fe700 1 -- 172.21.15.49:0/124586873 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc0ccbf0 con 0x7f29fc0b7af0 2023-07-21T22:13:13.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f29fb7fe700 1 --2- 172.21.15.49:0/124586873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29fc0b7af0 0x7f29fc0b1630 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009880 tx=0x7f29ec009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eac23902bf548529 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:13.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f29fa7fc700 1 -- 172.21.15.49:0/124586873 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0001670 con 0x7f29fc0b7af0 2023-07-21T22:13:13.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f29fa7fc700 1 -- 172.21.15.49:0/124586873 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec010590 con 0x7f29fc0b7af0 2023-07-21T22:13:13.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f29fa7fc700 1 -- 172.21.15.49:0/124586873 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec010940 con 0x7f29fc0b7af0 2023-07-21T22:13:13.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f2a00d03700 1 -- 172.21.15.49:0/124586873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29fc0b7af0 msgr2=0x7f29fc0b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f2a00d03700 1 --2- 172.21.15.49:0/124586873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29fc0b7af0 0x7f29fc0b1630 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009880 tx=0x7f29ec009b90 comp rx=0 tx=0).stop 2023-07-21T22:13:13.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f2a00d03700 1 -- 172.21.15.49:0/124586873 shutdown_connections 2023-07-21T22:13:13.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f2a00d03700 1 --2- 172.21.15.49:0/124586873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29fc0b7af0 0x7f29fc0b1630 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f2a00d03700 1 -- 172.21.15.49:0/124586873 >> 172.21.15.49:0/124586873 conn(0x7f29fc06e960 msgr2=0x7f29fc06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:13.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f2a00d03700 1 -- 172.21.15.49:0/124586873 shutdown_connections 2023-07-21T22:13:13.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.230+0000 7f2a00d03700 1 -- 172.21.15.49:0/124586873 wait complete. 2023-07-21T22:13:13.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.234+0000 7f2a00d03700 1 Processor -- start 2023-07-21T22:13:13.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.234+0000 7f2a00d03700 1 -- start start 2023-07-21T22:13:13.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f2a00d03700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29fc0b7af0 0x7f29fc0c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:13.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f2a00d03700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc0cee10 0x7f29fc150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:13.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f2a00d03700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29fc0d1e40 0x7f29fc0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:13.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f2a00d03700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc0cc300 con 0x7f29fc0d1e40 2023-07-21T22:13:13.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f2a00d03700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc0caa40 con 0x7f29fc0cee10 2023-07-21T22:13:13.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f2a00d03700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc0cad20 con 0x7f29fc0b7af0 2023-07-21T22:13:13.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f29fbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29fc0d1e40 0x7f29fc0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:13.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f29fb7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29fc0b7af0 0x7f29fc0c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:13.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f29fbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29fc0d1e40 0x7f29fc0cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33838/0 (socket says 172.21.15.49:33838) 2023-07-21T22:13:13.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f29fbfff700 1 -- 172.21.15.49:0/2620051790 learned_addr learned my addr 172.21.15.49:0/2620051790 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:13.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f29faffd700 1 --2- 172.21.15.49:0/2620051790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc0cee10 0x7f29fc150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:13.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f29fb7fe700 1 -- 172.21.15.49:0/2620051790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc0cee10 msgr2=0x7f29fc150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f29fb7fe700 1 --2- 172.21.15.49:0/2620051790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc0cee10 0x7f29fc150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f29fb7fe700 1 -- 172.21.15.49:0/2620051790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29fc0d1e40 msgr2=0x7f29fc0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f29fb7fe700 1 --2- 172.21.15.49:0/2620051790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29fc0d1e40 0x7f29fc0cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f29fb7fe700 1 -- 172.21.15.49:0/2620051790 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec0094b0 con 0x7f29fc0b7af0 2023-07-21T22:13:13.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f29fb7fe700 1 --2- 172.21.15.49:0/2620051790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29fc0b7af0 0x7f29fc0c6780 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f29ec015000 tx=0x7f29ec004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:13.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f29e3fff700 1 -- 172.21.15.49:0/2620051790 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec003dc0 con 0x7f29fc0b7af0 2023-07-21T22:13:13.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f29e3fff700 1 -- 172.21.15.49:0/2620051790 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec010700 con 0x7f29fc0b7af0 2023-07-21T22:13:13.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f2a00d03700 1 -- 172.21.15.49:0/2620051790 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc0cb000 con 0x7f29fc0b7af0 2023-07-21T22:13:13.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f29e3fff700 1 -- 172.21.15.49:0/2620051790 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec010ab0 con 0x7f29fc0b7af0 2023-07-21T22:13:13.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.238+0000 7f2a00d03700 1 -- 172.21.15.49:0/2620051790 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29fc0cb5c0 con 0x7f29fc0b7af0 2023-07-21T22:13:13.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.242+0000 7f2a00d03700 1 -- 172.21.15.49:0/2620051790 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29fc04dcb0 con 0x7f29fc0b7af0 2023-07-21T22:13:13.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.242+0000 7f29e3fff700 1 -- 172.21.15.49:0/2620051790 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f29ec010c10 con 0x7f29fc0b7af0 2023-07-21T22:13:13.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.242+0000 7f29e3fff700 1 --2- 172.21.15.49:0/2620051790 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29e80662f0 0x7f29e80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:13.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.242+0000 7f29e3fff700 1 -- 172.21.15.49:0/2620051790 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f29ec085460 con 0x7f29fc0b7af0 2023-07-21T22:13:13.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.242+0000 7f29faffd700 1 --2- 172.21.15.49:0/2620051790 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29e80662f0 0x7f29e80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:13.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.246+0000 7f29faffd700 1 --2- 172.21.15.49:0/2620051790 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29e80662f0 0x7f29e80687a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f29fc1f8c30 tx=0x7f29f00014f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:13.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.254+0000 7f29e3fff700 1 -- 172.21.15.49:0/2620051790 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29ec052600 con 0x7f29fc0b7af0 2023-07-21T22:13:13.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.434+0000 7f2a00d03700 1 -- 172.21.15.49:0/2620051790 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29fc15efd0 con 0x7f29fc0b7af0 2023-07-21T22:13:13.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.434+0000 7f29e3fff700 1 -- 172.21.15.49:0/2620051790 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29ec055c20 con 0x7f29fc0b7af0 2023-07-21T22:13:13.478 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:13:13.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.438+0000 7f2a00d03700 1 -- 172.21.15.49:0/2620051790 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29e80662f0 msgr2=0x7f29e80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.438+0000 7f2a00d03700 1 --2- 172.21.15.49:0/2620051790 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29e80662f0 0x7f29e80687a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f29fc1f8c30 tx=0x7f29f00014f0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.438+0000 7f2a00d03700 1 -- 172.21.15.49:0/2620051790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29fc0b7af0 msgr2=0x7f29fc0c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.438+0000 7f2a00d03700 1 --2- 172.21.15.49:0/2620051790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29fc0b7af0 0x7f29fc0c6780 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f29ec015000 tx=0x7f29ec004770 comp rx=0 tx=0).stop 2023-07-21T22:13:13.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.438+0000 7f2a00d03700 1 -- 172.21.15.49:0/2620051790 shutdown_connections 2023-07-21T22:13:13.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.438+0000 7f2a00d03700 1 --2- 172.21.15.49:0/2620051790 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f29e80662f0 0x7f29e80687a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.438+0000 7f2a00d03700 1 --2- 172.21.15.49:0/2620051790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29fc0d1e40 0x7f29fc0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.438+0000 7f2a00d03700 1 --2- 172.21.15.49:0/2620051790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29fc0cee10 0x7f29fc150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.438+0000 7f2a00d03700 1 --2- 172.21.15.49:0/2620051790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29fc0b7af0 0x7f29fc0c6780 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.438+0000 7f2a00d03700 1 -- 172.21.15.49:0/2620051790 >> 172.21.15.49:0/2620051790 conn(0x7f29fc06e960 msgr2=0x7f29fc0b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:13.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.442+0000 7f2a00d03700 1 -- 172.21.15.49:0/2620051790 shutdown_connections 2023-07-21T22:13:13.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.442+0000 7f2a00d03700 1 -- 172.21.15.49:0/2620051790 wait complete. 2023-07-21T22:13:13.504 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:13:13.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.646+0000 7fa69f478700 1 Processor -- start 2023-07-21T22:13:13.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.646+0000 7fa69f478700 1 -- start start 2023-07-21T22:13:13.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.646+0000 7fa69f478700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa698160110 0x7fa6980cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:13.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.646+0000 7fa69f478700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa698071220 0x7fa6980cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:13.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.646+0000 7fa69f478700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6980cdf00 con 0x7fa698071670 2023-07-21T22:13:13.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.646+0000 7fa69f478700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6980cd730 con 0x7fa698071220 2023-07-21T22:13:13.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.646+0000 7fa69f478700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980ce600 con 0x7fa698160110 2023-07-21T22:13:13.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69ca13700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa698071220 0x7fa6980cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:13.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69ca13700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa698071220 0x7fa6980cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33850/0 (socket says 172.21.15.49:33850) 2023-07-21T22:13:13.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69ca13700 1 -- 172.21.15.49:0/4061274905 learned_addr learned my addr 172.21.15.49:0/4061274905 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:13.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69d214700 1 --2- 172.21.15.49:0/4061274905 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa698160110 0x7fa6980cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:13.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69ca13700 1 -- 172.21.15.49:0/4061274905 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa698160110 msgr2=0x7fa6980cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:13.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69ca13700 1 --2- 172.21.15.49:0/4061274905 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa698160110 0x7fa6980cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69ca13700 1 -- 172.21.15.49:0/4061274905 >> v1:172.21.15.150:6789/0 conn(0x7fa698071670 legacy=0x7fa698163d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69ca13700 1 -- 172.21.15.49:0/4061274905 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6980cefd0 con 0x7fa698071220 2023-07-21T22:13:13.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69ca13700 1 --2- 172.21.15.49:0/4061274905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa698071220 0x7fa6980cabe0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa688009910 tx=0x7fa688009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb7ad132aaa15c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:13.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa68ffff700 1 -- 172.21.15.49:0/4061274905 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688005e50 con 0x7fa698071220 2023-07-21T22:13:13.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa68ffff700 1 -- 172.21.15.49:0/4061274905 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa688006030 con 0x7fa698071220 2023-07-21T22:13:13.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa68ffff700 1 -- 172.21.15.49:0/4061274905 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6880063e0 con 0x7fa698071220 2023-07-21T22:13:13.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69f478700 1 -- 172.21.15.49:0/4061274905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa698071220 msgr2=0x7fa6980cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69f478700 1 --2- 172.21.15.49:0/4061274905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa698071220 0x7fa6980cabe0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa688009910 tx=0x7fa688009c20 comp rx=0 tx=0).stop 2023-07-21T22:13:13.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69f478700 1 -- 172.21.15.49:0/4061274905 shutdown_connections 2023-07-21T22:13:13.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69f478700 1 --2- 172.21.15.49:0/4061274905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa698071220 0x7fa6980cabe0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69f478700 1 --2- 172.21.15.49:0/4061274905 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa698160110 0x7fa6980cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69f478700 1 -- 172.21.15.49:0/4061274905 >> 172.21.15.49:0/4061274905 conn(0x7fa69806e960 msgr2=0x7fa69806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:13.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69f478700 1 -- 172.21.15.49:0/4061274905 shutdown_connections 2023-07-21T22:13:13.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.650+0000 7fa69f478700 1 -- 172.21.15.49:0/4061274905 wait complete. 2023-07-21T22:13:13.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.654+0000 7fa69f478700 1 Processor -- start 2023-07-21T22:13:13.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.654+0000 7fa69f478700 1 -- start start 2023-07-21T22:13:13.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.654+0000 7fa69f478700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa698071220 0x7fa6981f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:13.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.654+0000 7fa69f478700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa698071670 0x7fa6980c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:13.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.654+0000 7fa69f478700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa698160110 0x7fa69815a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:13.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.654+0000 7fa69f478700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980c68a0 con 0x7fa698071670 2023-07-21T22:13:13.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.654+0000 7fa69f478700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6981f6910 con 0x7fa698071220 2023-07-21T22:13:13.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.654+0000 7fa69f478700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980c5820 con 0x7fa698160110 2023-07-21T22:13:13.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.654+0000 7fa69ca13700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa698071670 0x7fa6980c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:13.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.654+0000 7fa69ca13700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa698071670 0x7fa6980c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33856/0 (socket says 172.21.15.49:33856) 2023-07-21T22:13:13.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.654+0000 7fa69ca13700 1 -- 172.21.15.49:0/1954034640 learned_addr learned my addr 172.21.15.49:0/1954034640 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:13.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.654+0000 7fa69d214700 1 --2- 172.21.15.49:0/1954034640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa698071220 0x7fa6981f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:13.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.654+0000 7fa69da15700 1 --2- 172.21.15.49:0/1954034640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa698160110 0x7fa69815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:13.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.658+0000 7fa69ca13700 1 -- 172.21.15.49:0/1954034640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa698160110 msgr2=0x7fa69815a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.658+0000 7fa69ca13700 1 --2- 172.21.15.49:0/1954034640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa698160110 0x7fa69815a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.658+0000 7fa69ca13700 1 -- 172.21.15.49:0/1954034640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa698071220 msgr2=0x7fa6981f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.658+0000 7fa69ca13700 1 --2- 172.21.15.49:0/1954034640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa698071220 0x7fa6981f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.658+0000 7fa69ca13700 1 -- 172.21.15.49:0/1954034640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa688009520 con 0x7fa698071670 2023-07-21T22:13:13.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.658+0000 7fa69ca13700 1 --2- 172.21.15.49:0/1954034640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa698071670 0x7fa6980c7650 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa688000c00 tx=0x7fa688004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:13.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.658+0000 7fa68dffb700 1 -- 172.21.15.49:0/1954034640 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688006970 con 0x7fa698071670 2023-07-21T22:13:13.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.658+0000 7fa68dffb700 1 -- 172.21.15.49:0/1954034640 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa688020070 con 0x7fa698071670 2023-07-21T22:13:13.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.658+0000 7fa68dffb700 1 -- 172.21.15.49:0/1954034640 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688025670 con 0x7fa698071670 2023-07-21T22:13:13.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.658+0000 7fa69f478700 1 -- 172.21.15.49:0/1954034640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6980c5b00 con 0x7fa698071670 2023-07-21T22:13:13.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.658+0000 7fa69f478700 1 -- 172.21.15.49:0/1954034640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6980c60c0 con 0x7fa698071670 2023-07-21T22:13:13.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.658+0000 7fa69f478700 1 -- 172.21.15.49:0/1954034640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69804dd50 con 0x7fa698071670 2023-07-21T22:13:13.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.662+0000 7fa68dffb700 1 -- 172.21.15.49:0/1954034640 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa688022030 con 0x7fa698071670 2023-07-21T22:13:13.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.662+0000 7fa68dffb700 1 --2- 172.21.15.49:0/1954034640 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa67c066340 0x7fa67c0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:13.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.662+0000 7fa68dffb700 1 -- 172.21.15.49:0/1954034640 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fa688085590 con 0x7fa698071670 2023-07-21T22:13:13.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.662+0000 7fa69d214700 1 --2- 172.21.15.49:0/1954034640 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa67c066340 0x7fa67c0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:13.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.662+0000 7fa69d214700 1 --2- 172.21.15.49:0/1954034640 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa67c066340 0x7fa67c0687f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa694009ae0 tx=0x7fa694008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:13.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.670+0000 7fa68dffb700 1 -- 172.21.15.49:0/1954034640 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6880527b0 con 0x7fa698071670 2023-07-21T22:13:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.838+0000 7fa69f478700 1 -- 172.21.15.49:0/1954034640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa69815ef30 con 0x7fa698071670 2023-07-21T22:13:13.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.842+0000 7fa68dffb700 1 -- 172.21.15.49:0/1954034640 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa688055dd0 con 0x7fa698071670 2023-07-21T22:13:13.884 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:13:13.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.846+0000 7fa69f478700 1 -- 172.21.15.49:0/1954034640 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa67c066340 msgr2=0x7fa67c0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.846+0000 7fa69f478700 1 --2- 172.21.15.49:0/1954034640 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa67c066340 0x7fa67c0687f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa694009ae0 tx=0x7fa694008040 comp rx=0 tx=0).stop 2023-07-21T22:13:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.846+0000 7fa69f478700 1 -- 172.21.15.49:0/1954034640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa698071670 msgr2=0x7fa6980c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.846+0000 7fa69f478700 1 --2- 172.21.15.49:0/1954034640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa698071670 0x7fa6980c7650 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa688000c00 tx=0x7fa688004770 comp rx=0 tx=0).stop 2023-07-21T22:13:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.846+0000 7fa69f478700 1 -- 172.21.15.49:0/1954034640 shutdown_connections 2023-07-21T22:13:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.846+0000 7fa69f478700 1 --2- 172.21.15.49:0/1954034640 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa67c066340 0x7fa67c0687f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.846+0000 7fa69f478700 1 --2- 172.21.15.49:0/1954034640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa698071670 0x7fa6980c7650 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.846+0000 7fa69f478700 1 --2- 172.21.15.49:0/1954034640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa698160110 0x7fa69815a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.846+0000 7fa69f478700 1 --2- 172.21.15.49:0/1954034640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa698071220 0x7fa6981f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.846+0000 7fa69f478700 1 -- 172.21.15.49:0/1954034640 >> 172.21.15.49:0/1954034640 conn(0x7fa69806e960 msgr2=0x7fa69815e120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.846+0000 7fa69f478700 1 -- 172.21.15.49:0/1954034640 shutdown_connections 2023-07-21T22:13:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:13.846+0000 7fa69f478700 1 -- 172.21.15.49:0/1954034640 wait complete. 2023-07-21T22:13:13.911 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-07-21T22:13:14.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.054+0000 7fe11c381700 1 Processor -- start 2023-07-21T22:13:14.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.054+0000 7fe11c381700 1 -- start start 2023-07-21T22:13:14.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11c381700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe11415e380 0x7fe1140cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:14.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11c381700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1140b3a50 0x7fe1140cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11c381700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1140ca190 con 0x7fe1140c9cd0 2023-07-21T22:13:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11c381700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe114159fd0 con 0x7fe1140b3a50 2023-07-21T22:13:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11c381700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11415d6e0 con 0x7fe11415e380 2023-07-21T22:13:14.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11a91e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe1140c9cd0 0x7fe1140c8820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48024/0 (socket says 172.21.15.49:48024) 2023-07-21T22:13:14.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11a91e700 1 -- 172.21.15.49:0/628435274 learned_addr learned my addr 172.21.15.49:0/628435274 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:14.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11991c700 1 --2- 172.21.15.49:0/628435274 >> v2:172.21.15.49:3300/0 conn(0x7fe1140b3a50 0x7fe1140cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:14.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11a11d700 1 --2- 172.21.15.49:0/628435274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe11415e380 0x7fe1140cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:14.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11911b700 1 -- 172.21.15.49:0/628435274 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215587865 0 0) 0x7fe1140ca190 con 0x7fe1140c9cd0 2023-07-21T22:13:14.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11911b700 1 -- 172.21.15.49:0/628435274 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1000035d0 con 0x7fe1140c9cd0 2023-07-21T22:13:14.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11a11d700 1 -- 172.21.15.49:0/628435274 >> v2:172.21.15.49:3300/0 conn(0x7fe1140b3a50 msgr2=0x7fe1140cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:14.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11a11d700 1 --2- 172.21.15.49:0/628435274 >> v2:172.21.15.49:3300/0 conn(0x7fe1140b3a50 0x7fe1140cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11a11d700 1 -- 172.21.15.49:0/628435274 >> v1:172.21.15.49:6789/0 conn(0x7fe1140c9cd0 legacy=0x7fe1140c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:14.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11a11d700 1 -- 172.21.15.49:0/628435274 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1140ca900 con 0x7fe11415e380 2023-07-21T22:13:14.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11991c700 1 --2- 172.21.15.49:0/628435274 >> v2:172.21.15.49:3300/0 conn(0x7fe1140b3a50 0x7fe1140cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.058+0000 7fe11a11d700 1 --2- 172.21.15.49:0/628435274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe11415e380 0x7fe1140cabe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe110009850 tx=0x7fe110009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1955d96ec11502ba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.062+0000 7fe11911b700 1 -- 172.21.15.49:0/628435274 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110011830 con 0x7fe11415e380 2023-07-21T22:13:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.062+0000 7fe11911b700 1 -- 172.21.15.49:0/628435274 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe110011990 con 0x7fe11415e380 2023-07-21T22:13:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.062+0000 7fe11911b700 1 -- 172.21.15.49:0/628435274 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110011d40 con 0x7fe11415e380 2023-07-21T22:13:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.062+0000 7fe11c381700 1 -- 172.21.15.49:0/628435274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe11415e380 msgr2=0x7fe1140cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.062+0000 7fe11c381700 1 --2- 172.21.15.49:0/628435274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe11415e380 0x7fe1140cabe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe110009850 tx=0x7fe110009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.062+0000 7fe11c381700 1 -- 172.21.15.49:0/628435274 shutdown_connections 2023-07-21T22:13:14.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.062+0000 7fe11c381700 1 --2- 172.21.15.49:0/628435274 >> v2:172.21.15.49:3300/0 conn(0x7fe1140b3a50 0x7fe1140cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.062+0000 7fe11c381700 1 --2- 172.21.15.49:0/628435274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe11415e380 0x7fe1140cabe0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.062+0000 7fe11c381700 1 -- 172.21.15.49:0/628435274 >> 172.21.15.49:0/628435274 conn(0x7fe11406e960 msgr2=0x7fe11406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:14.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.062+0000 7fe11c381700 1 -- 172.21.15.49:0/628435274 shutdown_connections 2023-07-21T22:13:14.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.062+0000 7fe11c381700 1 -- 172.21.15.49:0/628435274 wait complete. 2023-07-21T22:13:14.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11c381700 1 Processor -- start 2023-07-21T22:13:14.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11c381700 1 -- start start 2023-07-21T22:13:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11c381700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1140b3a50 0x7fe1141f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:14.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11c381700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1140c9cd0 0x7fe1140cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:14.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11c381700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe11415e380 0x7fe11415a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:14.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11c381700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1140cd0b0 con 0x7fe1140b3a50 2023-07-21T22:13:14.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11c381700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1140cd390 con 0x7fe1140c9cd0 2023-07-21T22:13:14.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11c381700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1140cd670 con 0x7fe11415e380 2023-07-21T22:13:14.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11a11d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1140b3a50 0x7fe1141f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:14.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11a11d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1140b3a50 0x7fe1141f11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33878/0 (socket says 172.21.15.49:33878) 2023-07-21T22:13:14.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11a11d700 1 -- 172.21.15.49:0/2204251260 learned_addr learned my addr 172.21.15.49:0/2204251260 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:14.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11a91e700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe11415e380 0x7fe11415a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:14.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11991c700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1140c9cd0 0x7fe1140cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:14.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11a11d700 1 -- 172.21.15.49:0/2204251260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe11415e380 msgr2=0x7fe11415a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:14.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11a11d700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe11415e380 0x7fe11415a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11a11d700 1 -- 172.21.15.49:0/2204251260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1140c9cd0 msgr2=0x7fe1140cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:14.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11a11d700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1140c9cd0 0x7fe1140cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11a11d700 1 -- 172.21.15.49:0/2204251260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe104009450 con 0x7fe1140b3a50 2023-07-21T22:13:14.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11a91e700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe11415e380 0x7fe11415a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11991c700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1140c9cd0 0x7fe1140cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe11a11d700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1140b3a50 0x7fe1141f11b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe1140b3a00 tx=0x7fe110004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe10affd700 1 -- 172.21.15.49:0/2204251260 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110004520 con 0x7fe1140b3a50 2023-07-21T22:13:14.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.066+0000 7fe10affd700 1 -- 172.21.15.49:0/2204251260 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11001f070 con 0x7fe1140b3a50 2023-07-21T22:13:14.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.070+0000 7fe11c381700 1 -- 172.21.15.49:0/2204251260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1100094b0 con 0x7fe1140b3a50 2023-07-21T22:13:14.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.070+0000 7fe10affd700 1 -- 172.21.15.49:0/2204251260 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110003900 con 0x7fe1140b3a50 2023-07-21T22:13:14.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.070+0000 7fe11c381700 1 -- 172.21.15.49:0/2204251260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1141e4010 con 0x7fe1140b3a50 2023-07-21T22:13:14.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.070+0000 7fe11c381700 1 -- 172.21.15.49:0/2204251260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11406c4f0 con 0x7fe1140b3a50 2023-07-21T22:13:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.070+0000 7fe10affd700 1 -- 172.21.15.49:0/2204251260 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe110003a60 con 0x7fe1140b3a50 2023-07-21T22:13:14.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.074+0000 7fe10affd700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe0f80662f0 0x7fe0f80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:14.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.074+0000 7fe10affd700 1 -- 172.21.15.49:0/2204251260 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fe110021070 con 0x7fe1140b3a50 2023-07-21T22:13:14.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.074+0000 7fe11991c700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe0f80662f0 0x7fe0f80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:14.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.074+0000 7fe11991c700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe0f80662f0 0x7fe0f80687a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe1140b0db0 tx=0x7fe104008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:14.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.082+0000 7fe10affd700 1 -- 172.21.15.49:0/2204251260 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe110052710 con 0x7fe1140b3a50 2023-07-21T22:13:14.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.254+0000 7fe11c381700 1 -- 172.21.15.49:0/2204251260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fe11404dd50 con 0x7fe1140b3a50 2023-07-21T22:13:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.254+0000 7fe10affd700 1 -- 172.21.15.49:0/2204251260 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v47) v1 ==== 97+0+11 (secure 0 0 0) 0x7fe110006ce0 con 0x7fe1140b3a50 2023-07-21T22:13:14.297 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:13:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.258+0000 7fe11c381700 1 -- 172.21.15.49:0/2204251260 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe0f80662f0 msgr2=0x7fe0f80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.258+0000 7fe11c381700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe0f80662f0 0x7fe0f80687a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe1140b0db0 tx=0x7fe104008040 comp rx=0 tx=0).stop 2023-07-21T22:13:14.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.258+0000 7fe11c381700 1 -- 172.21.15.49:0/2204251260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1140b3a50 msgr2=0x7fe1141f11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:14.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.258+0000 7fe11c381700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1140b3a50 0x7fe1141f11b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe1140b3a00 tx=0x7fe110004770 comp rx=0 tx=0).stop 2023-07-21T22:13:14.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.258+0000 7fe11c381700 1 -- 172.21.15.49:0/2204251260 shutdown_connections 2023-07-21T22:13:14.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.258+0000 7fe11c381700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe0f80662f0 0x7fe0f80687a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.258+0000 7fe11c381700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe11415e380 0x7fe11415a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.258+0000 7fe11c381700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1140c9cd0 0x7fe1140cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.258+0000 7fe11c381700 1 --2- 172.21.15.49:0/2204251260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1140b3a50 0x7fe1141f11b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.258+0000 7fe11c381700 1 -- 172.21.15.49:0/2204251260 >> 172.21.15.49:0/2204251260 conn(0x7fe11406e960 msgr2=0x7fe114159760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:14.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.258+0000 7fe11c381700 1 -- 172.21.15.49:0/2204251260 shutdown_connections 2023-07-21T22:13:14.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.258+0000 7fe11c381700 1 -- 172.21.15.49:0/2204251260 wait complete. 2023-07-21T22:13:14.322 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:13:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.462+0000 7fd9ecfe3700 1 Processor -- start 2023-07-21T22:13:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.462+0000 7fd9ecfe3700 1 -- start start 2023-07-21T22:13:14.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9ecfe3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9e815bc60 0x7fd9e80d1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:14.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9ecfe3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9e81600c0 0x7fd9e80ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:14.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9ecfe3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e80ccd70 con 0x7fd9e80ceff0 2023-07-21T22:13:14.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9ecfe3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e8160630 con 0x7fd9e815bc60 2023-07-21T22:13:14.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9ecfe3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e815c030 con 0x7fd9e81600c0 2023-07-21T22:13:14.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9e77fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9e815bc60 0x7fd9e80d1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9e77fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9e815bc60 0x7fd9e80d1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33890/0 (socket says 172.21.15.49:33890) 2023-07-21T22:13:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9e7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd9e80ceff0 0x7fd9e80b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48036/0 (socket says 172.21.15.49:48036) 2023-07-21T22:13:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9e77fe700 1 -- 172.21.15.49:0/4290871236 learned_addr learned my addr 172.21.15.49:0/4290871236 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9e6ffd700 1 --2- 172.21.15.49:0/4290871236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9e81600c0 0x7fd9e80ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9e77fe700 1 -- 172.21.15.49:0/4290871236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9e81600c0 msgr2=0x7fd9e80ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9e77fe700 1 --2- 172.21.15.49:0/4290871236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9e81600c0 0x7fd9e80ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9e77fe700 1 -- 172.21.15.49:0/4290871236 >> v1:172.21.15.49:6789/0 conn(0x7fd9e80ceff0 legacy=0x7fd9e80b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9e77fe700 1 -- 172.21.15.49:0/4290871236 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e80cca70 con 0x7fd9e815bc60 2023-07-21T22:13:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9e6ffd700 1 --2- 172.21.15.49:0/4290871236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9e81600c0 0x7fd9e80ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9e77fe700 1 --2- 172.21.15.49:0/4290871236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e815bc60 0x7fd9e80d1e30 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009940 tx=0x7fd9d8009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30af2115b0bb267 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.466+0000 7fd9e67fc700 1 -- 172.21.15.49:0/4290871236 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8004230 con 0x7fd9e815bc60 2023-07-21T22:13:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.470+0000 7fd9e67fc700 1 -- 172.21.15.49:0/4290871236 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d8004390 con 0x7fd9e815bc60 2023-07-21T22:13:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.470+0000 7fd9e67fc700 1 -- 172.21.15.49:0/4290871236 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d80036c0 con 0x7fd9e815bc60 2023-07-21T22:13:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.470+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/4290871236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e815bc60 msgr2=0x7fd9e80d1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.470+0000 7fd9ecfe3700 1 --2- 172.21.15.49:0/4290871236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e815bc60 0x7fd9e80d1e30 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009940 tx=0x7fd9d8009c50 comp rx=0 tx=0).stop 2023-07-21T22:13:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.470+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/4290871236 shutdown_connections 2023-07-21T22:13:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.470+0000 7fd9ecfe3700 1 --2- 172.21.15.49:0/4290871236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9e81600c0 0x7fd9e80ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.470+0000 7fd9ecfe3700 1 --2- 172.21.15.49:0/4290871236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e815bc60 0x7fd9e80d1e30 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.470+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/4290871236 >> 172.21.15.49:0/4290871236 conn(0x7fd9e80658e0 msgr2=0x7fd9e806e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.470+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/4290871236 shutdown_connections 2023-07-21T22:13:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.470+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/4290871236 wait complete. 2023-07-21T22:13:14.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9ecfe3700 1 Processor -- start 2023-07-21T22:13:14.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9ecfe3700 1 -- start start 2023-07-21T22:13:14.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9ecfe3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9e80ceff0 0x7fd9e814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:14.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9ecfe3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e815bc60 0x7fd9e80c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:14.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9ecfe3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e81600c0 0x7fd9e80c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:14.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9ecfe3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e814b320 con 0x7fd9e81600c0 2023-07-21T22:13:14.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9ecfe3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e8148b40 con 0x7fd9e815bc60 2023-07-21T22:13:14.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9ecfe3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e80cbe20 con 0x7fd9e80ceff0 2023-07-21T22:13:14.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e81600c0 0x7fd9e80c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:14.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9e6ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e815bc60 0x7fd9e80c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:14.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e81600c0 0x7fd9e80c8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33904/0 (socket says 172.21.15.49:33904) 2023-07-21T22:13:14.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9e7fff700 1 -- 172.21.15.49:0/1616538017 learned_addr learned my addr 172.21.15.49:0/1616538017 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:14.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9e77fe700 1 --2- 172.21.15.49:0/1616538017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9e80ceff0 0x7fd9e814ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:14.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9e7fff700 1 -- 172.21.15.49:0/1616538017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9e80ceff0 msgr2=0x7fd9e814ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:14.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9e7fff700 1 --2- 172.21.15.49:0/1616538017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9e80ceff0 0x7fd9e814ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9e7fff700 1 -- 172.21.15.49:0/1616538017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e815bc60 msgr2=0x7fd9e80c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:14.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9e7fff700 1 --2- 172.21.15.49:0/1616538017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e815bc60 0x7fd9e80c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.474+0000 7fd9e7fff700 1 -- 172.21.15.49:0/1616538017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc0094b0 con 0x7fd9e81600c0 2023-07-21T22:13:14.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.478+0000 7fd9e7fff700 1 --2- 172.21.15.49:0/1616538017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e81600c0 0x7fd9e80c8640 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000cca0 tx=0x7fd9e000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:14.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.478+0000 7fd9cffff700 1 -- 172.21.15.49:0/1616538017 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000ab30 con 0x7fd9e81600c0 2023-07-21T22:13:14.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.478+0000 7fd9cffff700 1 -- 172.21.15.49:0/1616538017 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e000ac90 con 0x7fd9e81600c0 2023-07-21T22:13:14.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.478+0000 7fd9cffff700 1 -- 172.21.15.49:0/1616538017 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00070d0 con 0x7fd9e81600c0 2023-07-21T22:13:14.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.478+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/1616538017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d8009570 con 0x7fd9e81600c0 2023-07-21T22:13:14.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.478+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/1616538017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e81484f0 con 0x7fd9e81600c0 2023-07-21T22:13:14.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.478+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/1616538017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e804e500 con 0x7fd9e81600c0 2023-07-21T22:13:14.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.482+0000 7fd9cffff700 1 -- 172.21.15.49:0/1616538017 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd9e0007250 con 0x7fd9e81600c0 2023-07-21T22:13:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.482+0000 7fd9cffff700 1 --2- 172.21.15.49:0/1616538017 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd9d40662f0 0x7fd9d40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.482+0000 7fd9cffff700 1 -- 172.21.15.49:0/1616538017 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fd9e0083a70 con 0x7fd9e81600c0 2023-07-21T22:13:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.482+0000 7fd9e77fe700 1 --2- 172.21.15.49:0/1616538017 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd9d40662f0 0x7fd9d40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:14.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.486+0000 7fd9e77fe700 1 --2- 172.21.15.49:0/1616538017 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd9d40662f0 0x7fd9d40687a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009940 tx=0x7fd9d8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:14.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.490+0000 7fd9cffff700 1 -- 172.21.15.49:0/1616538017 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9e0050b80 con 0x7fd9e81600c0 2023-07-21T22:13:14.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.682+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/1616538017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd9e8148c80 con 0x7fd9e81600c0 2023-07-21T22:13:14.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.682+0000 7fd9cffff700 1 -- 172.21.15.49:0/1616538017 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd9e00541a0 con 0x7fd9e81600c0 2023-07-21T22:13:14.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.686+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/1616538017 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd9d40662f0 msgr2=0x7fd9d40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:14.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.686+0000 7fd9ecfe3700 1 --2- 172.21.15.49:0/1616538017 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd9d40662f0 0x7fd9d40687a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009940 tx=0x7fd9d8008030 comp rx=0 tx=0).stop 2023-07-21T22:13:14.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.686+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/1616538017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e81600c0 msgr2=0x7fd9e80c8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:14.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.686+0000 7fd9ecfe3700 1 --2- 172.21.15.49:0/1616538017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e81600c0 0x7fd9e80c8640 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000cca0 tx=0x7fd9e000a060 comp rx=0 tx=0).stop 2023-07-21T22:13:14.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.686+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/1616538017 shutdown_connections 2023-07-21T22:13:14.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.686+0000 7fd9ecfe3700 1 --2- 172.21.15.49:0/1616538017 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd9d40662f0 0x7fd9d40687a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.686+0000 7fd9ecfe3700 1 --2- 172.21.15.49:0/1616538017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e81600c0 0x7fd9e80c8640 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.686+0000 7fd9ecfe3700 1 --2- 172.21.15.49:0/1616538017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9e815bc60 0x7fd9e80c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.686+0000 7fd9ecfe3700 1 --2- 172.21.15.49:0/1616538017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9e80ceff0 0x7fd9e814ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:14.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.686+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/1616538017 >> 172.21.15.49:0/1616538017 conn(0x7fd9e80658e0 msgr2=0x7fd9e815e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:14.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.686+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/1616538017 shutdown_connections 2023-07-21T22:13:14.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:14.686+0000 7fd9ecfe3700 1 -- 172.21.15.49:0/1616538017 wait complete. 2023-07-21T22:13:14.730 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:13:14.749 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2023-07-21T22:13:14.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:14.750 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-21T22:13:14.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[46482]: fuse finished with error 0 and tester_r 0 2023-07-21T22:13:14.787 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:13:20.889 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:13:20.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:20.890 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:13:20.913 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2023-07-21T22:13:21.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.110+0000 7f720a485700 1 Processor -- start 2023-07-21T22:13:21.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.110+0000 7f720a485700 1 -- start start 2023-07-21T22:13:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.110+0000 7f720a485700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72040b6be0 0x7f72040d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.110+0000 7f720a485700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72040b5460 con 0x7f72040cf100 2023-07-21T22:13:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.110+0000 7f720a485700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72040d1030 con 0x7f720415bed0 2023-07-21T22:13:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.110+0000 7f720a485700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72040d1310 con 0x7f72040b6be0 2023-07-21T22:13:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f7208c82700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f72040cf100 0x7f72040d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35346/0 (socket says 172.21.15.49:35346) 2023-07-21T22:13:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f7208c82700 1 -- 172.21.15.49:0/831533723 learned_addr learned my addr 172.21.15.49:0/831533723 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:21.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f7209c84700 1 --2- 172.21.15.49:0/831533723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72040b6be0 0x7f72040d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:21.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437741334 0 0) 0x7f72040b5460 con 0x7f72040cf100 2023-07-21T22:13:21.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71f00035d0 con 0x7f72040cf100 2023-07-21T22:13:21.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512903461 0 0) 0x7f72040d1030 con 0x7f720415bed0 2023-07-21T22:13:21.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72040b5460 con 0x7f720415bed0 2023-07-21T22:13:21.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 876456135 0 0) 0x7f71f00035d0 con 0x7f72040cf100 2023-07-21T22:13:21.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72040b6be0 msgr2=0x7f72040d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:21.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 --2- 172.21.15.49:0/831533723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72040b6be0 0x7f72040d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:21.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 >> v1:172.21.15.150:6789/0 conn(0x7f720415bed0 legacy=0x7f72040ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:21.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72040d15f0 con 0x7f72040cf100 2023-07-21T22:13:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f71f4001670 con 0x7f72040cf100 2023-07-21T22:13:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 >> v1:172.21.15.49:6789/0 conn(0x7f72040cf100 legacy=0x7f72040d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 --2- 172.21.15.49:0/831533723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f0003be0 0x7f71f0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 --2- 172.21.15.49:0/831533723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72040b6be0 0x7f71f0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 --2- 172.21.15.49:0/831533723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71f0004db0 0x7f71f0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72040d1310 con 0x7f71f0004db0 2023-07-21T22:13:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f000bae0 con 0x7f71f0003be0 2023-07-21T22:13:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f000bc20 con 0x7f72040b6be0 2023-07-21T22:13:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f7209c84700 1 --2- 172.21.15.49:0/831533723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71f0004db0 0x7f71f0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f7208c82700 1 --2- 172.21.15.49:0/831533723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72040b6be0 0x7f71f0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:21.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f7209483700 1 --2- 172.21.15.49:0/831533723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f0003be0 0x7f71f0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:21.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f7209c84700 1 -- 172.21.15.49:0/831533723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72040b6be0 msgr2=0x7f71f0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:21.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f7209c84700 1 --2- 172.21.15.49:0/831533723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72040b6be0 0x7f71f0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:21.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f7209c84700 1 -- 172.21.15.49:0/831533723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f0003be0 msgr2=0x7f71f0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:21.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f7209c84700 1 --2- 172.21.15.49:0/831533723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f0003be0 0x7f71f0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:21.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f7209c84700 1 -- 172.21.15.49:0/831533723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f00035d0 con 0x7f71f0004db0 2023-07-21T22:13:21.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f7209c84700 1 --2- 172.21.15.49:0/831533723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71f0004db0 0x7f71f0005220 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009fc0 tx=0x7f71f00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23df1a0788d004c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:21.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.114+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc00ec30 con 0x7f71f0004db0 2023-07-21T22:13:21.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.118+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc00f040 con 0x7f71f0004db0 2023-07-21T22:13:21.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.118+0000 7f71fbfff700 1 -- 172.21.15.49:0/831533723 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc014480 con 0x7f71f0004db0 2023-07-21T22:13:21.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.118+0000 7f720a485700 1 -- 172.21.15.49:0/831533723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71f0004db0 msgr2=0x7f71f0005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:21.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.118+0000 7f720a485700 1 --2- 172.21.15.49:0/831533723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71f0004db0 0x7f71f0005220 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009fc0 tx=0x7f71f00058a0 comp rx=0 tx=0).stop 2023-07-21T22:13:21.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.118+0000 7f7209c84700 1 -- 172.21.15.49:0/831533723 reap_dead start 2023-07-21T22:13:21.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.118+0000 7f720a485700 1 -- 172.21.15.49:0/831533723 shutdown_connections 2023-07-21T22:13:21.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.118+0000 7f720a485700 1 -- 172.21.15.49:0/831533723 >> 172.21.15.49:0/831533723 conn(0x7f7204065af0 msgr2=0x7f720406fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:21.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.118+0000 7f720a485700 1 -- 172.21.15.49:0/831533723 shutdown_connections 2023-07-21T22:13:21.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.118+0000 7f720a485700 1 -- 172.21.15.49:0/831533723 wait complete. 2023-07-21T22:13:21.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.118+0000 7f720a485700 1 Processor -- start 2023-07-21T22:13:21.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f720a485700 1 -- start start 2023-07-21T22:13:21.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f720a485700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f0004db0 0x7f720414ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:21.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f720a485700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7204152b60 0x7f72040ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:21.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f720a485700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72040ca590 0x7f72040c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:21.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f720a485700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720414f3b0 con 0x7f72040ca590 2023-07-21T22:13:21.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f720a485700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72040caa80 con 0x7f71f0004db0 2023-07-21T22:13:21.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f720a485700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720415d870 con 0x7f7204152b60 2023-07-21T22:13:21.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f7209c84700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72040ca590 0x7f72040c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:21.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f7209c84700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72040ca590 0x7f72040c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41648/0 (socket says 172.21.15.49:41648) 2023-07-21T22:13:21.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f7209c84700 1 -- 172.21.15.49:0/2340958147 learned_addr learned my addr 172.21.15.49:0/2340958147 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:21.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f7208c82700 1 --2- 172.21.15.49:0/2340958147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7204152b60 0x7f72040ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:21.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f7209483700 1 --2- 172.21.15.49:0/2340958147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f0004db0 0x7f720414ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:21.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f7209c84700 1 -- 172.21.15.49:0/2340958147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7204152b60 msgr2=0x7f72040ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:21.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f7209c84700 1 --2- 172.21.15.49:0/2340958147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7204152b60 0x7f72040ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:21.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f7209c84700 1 -- 172.21.15.49:0/2340958147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f0004db0 msgr2=0x7f720414ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:21.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f7209c84700 1 --2- 172.21.15.49:0/2340958147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f0004db0 0x7f720414ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:21.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f7209c84700 1 -- 172.21.15.49:0/2340958147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720415db50 con 0x7f72040ca590 2023-07-21T22:13:21.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f7209c84700 1 --2- 172.21.15.49:0/2340958147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72040ca590 0x7f72040c8660 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009f60 tx=0x7f71fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:21.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f71f9ffb700 1 -- 172.21.15.49:0/2340958147 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc007000 con 0x7f72040ca590 2023-07-21T22:13:21.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f71f9ffb700 1 -- 172.21.15.49:0/2340958147 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc003e50 con 0x7f72040ca590 2023-07-21T22:13:21.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f71f9ffb700 1 -- 172.21.15.49:0/2340958147 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0159e0 con 0x7f72040ca590 2023-07-21T22:13:21.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.122+0000 7f720a485700 1 -- 172.21.15.49:0/2340958147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720415de30 con 0x7f72040ca590 2023-07-21T22:13:21.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.126+0000 7f720a485700 1 -- 172.21.15.49:0/2340958147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72040c98a0 con 0x7f72040ca590 2023-07-21T22:13:21.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.126+0000 7f720a485700 1 -- 172.21.15.49:0/2340958147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720415e350 con 0x7f72040ca590 2023-07-21T22:13:21.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.126+0000 7f71f9ffb700 1 -- 172.21.15.49:0/2340958147 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f71fc024070 con 0x7f72040ca590 2023-07-21T22:13:21.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.130+0000 7f71f9ffb700 1 --2- 172.21.15.49:0/2340958147 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71e8066320 0x7f71e80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:21.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.130+0000 7f71f9ffb700 1 -- 172.21.15.49:0/2340958147 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f71fc085590 con 0x7f72040ca590 2023-07-21T22:13:21.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.130+0000 7f7209483700 1 --2- 172.21.15.49:0/2340958147 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71e8066320 0x7f71e80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:21.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.130+0000 7f7209483700 1 --2- 172.21.15.49:0/2340958147 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71e8066320 0x7f71e80687d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7200007fd0 tx=0x7f7200009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:21.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.134+0000 7f71f9ffb700 1 -- 172.21.15.49:0/2340958147 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f720415e350 con 0x7f72040ca590 2023-07-21T22:13:21.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.374+0000 7f720a485700 1 -- 172.21.15.49:0/2340958147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f720415e350 con 0x7f72040ca590 2023-07-21T22:13:21.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.382+0000 7f71f9ffb700 1 -- 172.21.15.49:0/2340958147 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v16) v1 ==== 184+0+141 (secure 0 0 0) 0x7f720415e350 con 0x7f72040ca590 2023-07-21T22:13:21.427 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2023-07-21T22:13:21.427 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtkU5ZaIRAAchCJhuM71+rGOBHBlX77wA== 2023-07-21T22:13:21.427 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow" 2023-07-21T22:13:21.428 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2023-07-21T22:13:21.428 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw pool=cephfs_data" 2023-07-21T22:13:21.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.386+0000 7f720a485700 1 -- 172.21.15.49:0/2340958147 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71e8066320 msgr2=0x7f71e80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:21.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.386+0000 7f720a485700 1 --2- 172.21.15.49:0/2340958147 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71e8066320 0x7f71e80687d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7200007fd0 tx=0x7f7200009040 comp rx=0 tx=0).stop 2023-07-21T22:13:21.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.386+0000 7f720a485700 1 -- 172.21.15.49:0/2340958147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72040ca590 msgr2=0x7f72040c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:21.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.386+0000 7f720a485700 1 --2- 172.21.15.49:0/2340958147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72040ca590 0x7f72040c8660 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009f60 tx=0x7f71fc009750 comp rx=0 tx=0).stop 2023-07-21T22:13:21.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.386+0000 7f720a485700 1 -- 172.21.15.49:0/2340958147 shutdown_connections 2023-07-21T22:13:21.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.386+0000 7f720a485700 1 --2- 172.21.15.49:0/2340958147 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f71e8066320 0x7f71e80687d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:21.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.386+0000 7f720a485700 1 --2- 172.21.15.49:0/2340958147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72040ca590 0x7f72040c8660 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:21.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.386+0000 7f720a485700 1 --2- 172.21.15.49:0/2340958147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7204152b60 0x7f72040ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:21.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.386+0000 7f720a485700 1 --2- 172.21.15.49:0/2340958147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f0004db0 0x7f720414ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:21.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.386+0000 7f720a485700 1 -- 172.21.15.49:0/2340958147 >> 172.21.15.49:0/2340958147 conn(0x7f7204065af0 msgr2=0x7f7204157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:21.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.390+0000 7f720a485700 1 -- 172.21.15.49:0/2340958147 shutdown_connections 2023-07-21T22:13:21.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:21.390+0000 7f720a485700 1 -- 172.21.15.49:0/2340958147 wait complete. 2023-07-21T22:13:21.436 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-07-21T22:13:21.455 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:13:21.458 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:13:21.497 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:13:21.542 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:13:21.543 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:13:21.543 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:13:21.562 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352276k,nr_inodes=4088069,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13711 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:13:21.562 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:13:21.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:21.563 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:13:21.623 INFO:teuthology.orchestra.run.smithi049.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-07-21T22:13:21.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:13:21.624 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:13:21.624 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:13:21.641 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352340k,nr_inodes=4088085,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2732 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:13:21.641 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:13:21.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:21.642 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-21T22:13:21.701 INFO:teuthology.orchestra.run.smithi150.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-21T22:13:21.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:13:21.704 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:13:21.704 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:13:21.722 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352276k,nr_inodes=4088069,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13711 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:13:21.723 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:13:21.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:21.723 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-21T22:13:21.782 INFO:teuthology.orchestra.run.smithi049.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-21T22:13:21.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:13:21.784 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:13:21.784 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:13:21.800 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352340k,nr_inodes=4088085,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2732 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:13:21.801 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:13:21.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:21.801 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-21T22:13:21.866 INFO:teuthology.orchestra.run.smithi150.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-21T22:13:21.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:13:21.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:13:22.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.010+0000 7f5fe95be700 1 Processor -- start 2023-07-21T22:13:22.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.010+0000 7f5fe95be700 1 -- start start 2023-07-21T22:13:22.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe95be700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5fe4160370 0x7f5fe406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe95be700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fe40c1470 0x7f5fe40c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe95be700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5fe40ca2c0 0x7f5fe40caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe95be700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe406e010 con 0x7f5fe40ca2c0 2023-07-21T22:13:22.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe95be700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe4160740 con 0x7f5fe4160370 2023-07-21T22:13:22.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe95be700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40afc90 con 0x7f5fe40c1470 2023-07-21T22:13:22.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe8dbd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5fe40ca2c0 0x7f5fe40caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe37fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fe40c1470 0x7f5fe40c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe3fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5fe4160370 0x7f5fe406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe37fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fe40c1470 0x7f5fe40c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:45342/0 (socket says 172.21.15.49:45342) 2023-07-21T22:13:22.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe37fe700 1 -- 172.21.15.49:0/24686458 learned_addr learned my addr 172.21.15.49:0/24686458 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:22.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe37fe700 1 -- 172.21.15.49:0/24686458 >> v2:172.21.15.150:3300/0 conn(0x7f5fe4160370 msgr2=0x7f5fe406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:22.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe37fe700 1 --2- 172.21.15.49:0/24686458 >> v2:172.21.15.150:3300/0 conn(0x7f5fe4160370 0x7f5fe406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe37fe700 1 -- 172.21.15.49:0/24686458 >> v2:172.21.15.49:3300/0 conn(0x7f5fe40ca2c0 msgr2=0x7f5fe40caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:22.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe37fe700 1 --2- 172.21.15.49:0/24686458 >> v2:172.21.15.49:3300/0 conn(0x7f5fe40ca2c0 0x7f5fe40caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe37fe700 1 -- 172.21.15.49:0/24686458 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe40aff70 con 0x7f5fe40c1470 2023-07-21T22:13:22.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe37fe700 1 --2- 172.21.15.49:0/24686458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fe40c1470 0x7f5fe40c9d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40cbbc0 tx=0x7f5fd8009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=873cb4d628181e1f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:22.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe2ffd700 1 -- 172.21.15.49:0/24686458 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8011830 con 0x7f5fe40c1470 2023-07-21T22:13:22.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe2ffd700 1 -- 172.21.15.49:0/24686458 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd8011990 con 0x7f5fe40c1470 2023-07-21T22:13:22.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.014+0000 7f5fe2ffd700 1 -- 172.21.15.49:0/24686458 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8011d20 con 0x7f5fe40c1470 2023-07-21T22:13:22.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.018+0000 7f5fe95be700 1 -- 172.21.15.49:0/24686458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fe40c1470 msgr2=0x7f5fe40c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.018+0000 7f5fe95be700 1 --2- 172.21.15.49:0/24686458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fe40c1470 0x7f5fe40c9d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40cbbc0 tx=0x7f5fd8009bf0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.018+0000 7f5fe95be700 1 -- 172.21.15.49:0/24686458 shutdown_connections 2023-07-21T22:13:22.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.018+0000 7f5fe95be700 1 --2- 172.21.15.49:0/24686458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fe40c1470 0x7f5fe40c9d80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.018+0000 7f5fe95be700 1 --2- 172.21.15.49:0/24686458 >> v2:172.21.15.49:3300/0 conn(0x7f5fe40ca2c0 0x7f5fe40caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.018+0000 7f5fe95be700 1 --2- 172.21.15.49:0/24686458 >> v2:172.21.15.150:3300/0 conn(0x7f5fe4160370 0x7f5fe406d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.018+0000 7f5fe95be700 1 -- 172.21.15.49:0/24686458 >> 172.21.15.49:0/24686458 conn(0x7f5fe4070450 msgr2=0x7f5fe4070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:22.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.018+0000 7f5fe95be700 1 -- 172.21.15.49:0/24686458 shutdown_connections 2023-07-21T22:13:22.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.018+0000 7f5fe95be700 1 -- 172.21.15.49:0/24686458 wait complete. 2023-07-21T22:13:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.022+0000 7f5fe95be700 1 Processor -- start 2023-07-21T22:13:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.022+0000 7f5fe95be700 1 -- start start 2023-07-21T22:13:22.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.022+0000 7f5fe95be700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fe40c1470 0x7f5fe415f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.022+0000 7f5fe95be700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fe40ca2c0 0x7f5fe40c0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.022+0000 7f5fe95be700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fe4160370 0x7f5fe40b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.022+0000 7f5fe95be700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40c2890 con 0x7f5fe4160370 2023-07-21T22:13:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.022+0000 7f5fe95be700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40c2b70 con 0x7f5fe40ca2c0 2023-07-21T22:13:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.022+0000 7f5fe95be700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40c2e50 con 0x7f5fe40c1470 2023-07-21T22:13:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.022+0000 7f5fe8dbd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fe4160370 0x7f5fe40b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.022+0000 7f5fe8dbd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fe4160370 0x7f5fe40b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41666/0 (socket says 172.21.15.49:41666) 2023-07-21T22:13:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.022+0000 7f5fe8dbd700 1 -- 172.21.15.49:0/1110919548 learned_addr learned my addr 172.21.15.49:0/1110919548 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.026+0000 7f5fe3fff700 1 --2- 172.21.15.49:0/1110919548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fe40c1470 0x7f5fe415f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.026+0000 7f5fe37fe700 1 --2- 172.21.15.49:0/1110919548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fe40ca2c0 0x7f5fe40c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.026+0000 7f5fe8dbd700 1 -- 172.21.15.49:0/1110919548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fe40c1470 msgr2=0x7f5fe415f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.026+0000 7f5fe8dbd700 1 --2- 172.21.15.49:0/1110919548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fe40c1470 0x7f5fe415f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.026+0000 7f5fe8dbd700 1 -- 172.21.15.49:0/1110919548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fe40ca2c0 msgr2=0x7f5fe40c0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.026+0000 7f5fe8dbd700 1 --2- 172.21.15.49:0/1110919548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fe40ca2c0 0x7f5fe40c0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.026+0000 7f5fe8dbd700 1 -- 172.21.15.49:0/1110919548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd8009570 con 0x7f5fe4160370 2023-07-21T22:13:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.026+0000 7f5fe8dbd700 1 --2- 172.21.15.49:0/1110919548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fe4160370 0x7f5fe40b1b10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00eed0 tx=0x7f5fdc00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.026+0000 7f5fe0ff9700 1 -- 172.21.15.49:0/1110919548 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc010040 con 0x7f5fe4160370 2023-07-21T22:13:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.026+0000 7f5fe0ff9700 1 -- 172.21.15.49:0/1110919548 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fdc00bd30 con 0x7f5fe4160370 2023-07-21T22:13:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.026+0000 7f5fe95be700 1 -- 172.21.15.49:0/1110919548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe40c3130 con 0x7f5fe4160370 2023-07-21T22:13:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.026+0000 7f5fe0ff9700 1 -- 172.21.15.49:0/1110919548 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc009ea0 con 0x7f5fe4160370 2023-07-21T22:13:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.026+0000 7f5fe95be700 1 -- 172.21.15.49:0/1110919548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe40c0950 con 0x7f5fe4160370 2023-07-21T22:13:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.026+0000 7f5fe95be700 1 -- 172.21.15.49:0/1110919548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe40c3650 con 0x7f5fe4160370 2023-07-21T22:13:22.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.030+0000 7f5fe0ff9700 1 -- 172.21.15.49:0/1110919548 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5fdc014640 con 0x7f5fe4160370 2023-07-21T22:13:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.030+0000 7f5fe0ff9700 1 --2- 172.21.15.49:0/1110919548 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5fd0066320 0x7f5fd00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.030+0000 7f5fe0ff9700 1 -- 172.21.15.49:0/1110919548 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f5fdc084700 con 0x7f5fe4160370 2023-07-21T22:13:22.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.034+0000 7f5fe3fff700 1 --2- 172.21.15.49:0/1110919548 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5fd0066320 0x7f5fd00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.034+0000 7f5fe3fff700 1 --2- 172.21.15.49:0/1110919548 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5fd0066320 0x7f5fd00687d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009b80 tx=0x7f5fd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:22.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.038+0000 7f5fe0ff9700 1 -- 172.21.15.49:0/1110919548 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5fe40c3650 con 0x7f5fe4160370 2023-07-21T22:13:22.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.250+0000 7f5fe95be700 1 -- 172.21.15.49:0/1110919548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fe40c3650 con 0x7f5fe4160370 2023-07-21T22:13:22.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.250+0000 7f5fe0ff9700 1 -- 172.21.15.49:0/1110919548 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f5fe40c3650 con 0x7f5fe4160370 2023-07-21T22:13:22.293 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:22.293 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2563650108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2563650108},{"type":"v1","addr":"172.21.15.49:6835","nonce":2563650108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2639704311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2639704311},{"type":"v1","addr":"172.21.15.150:6833","nonce":2639704311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1930443415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1930443415},{"type":"v1","addr":"172.21.15.150:6835","nonce":1930443415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:12:22.057988+0000","modified":"2023-07-21T22:12:38.083444+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5631":{"gid":5631,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/3511065368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3511065368},{"type":"v1","addr":"172.21.15.49:6837","nonce":3511065368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T22:13:22.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.254+0000 7f5fe95be700 1 -- 172.21.15.49:0/1110919548 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5fd0066320 msgr2=0x7f5fd00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.254+0000 7f5fe95be700 1 --2- 172.21.15.49:0/1110919548 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5fd0066320 0x7f5fd00687d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009b80 tx=0x7f5fd4008040 comp rx=0 tx=0).stop 2023-07-21T22:13:22.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.254+0000 7f5fe95be700 1 -- 172.21.15.49:0/1110919548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fe4160370 msgr2=0x7f5fe40b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.254+0000 7f5fe95be700 1 --2- 172.21.15.49:0/1110919548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fe4160370 0x7f5fe40b1b10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00eed0 tx=0x7f5fdc00b390 comp rx=0 tx=0).stop 2023-07-21T22:13:22.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.254+0000 7f5fe95be700 1 -- 172.21.15.49:0/1110919548 shutdown_connections 2023-07-21T22:13:22.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.254+0000 7f5fe95be700 1 --2- 172.21.15.49:0/1110919548 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5fd0066320 0x7f5fd00687d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.254+0000 7f5fe95be700 1 --2- 172.21.15.49:0/1110919548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fe4160370 0x7f5fe40b1b10 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.254+0000 7f5fe95be700 1 --2- 172.21.15.49:0/1110919548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fe40ca2c0 0x7f5fe40c0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.254+0000 7f5fe95be700 1 --2- 172.21.15.49:0/1110919548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fe40c1470 0x7f5fe415f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.254+0000 7f5fe95be700 1 -- 172.21.15.49:0/1110919548 >> 172.21.15.49:0/1110919548 conn(0x7f5fe4070450 msgr2=0x7f5fe40adab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:22.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.254+0000 7f5fe95be700 1 -- 172.21.15.49:0/1110919548 shutdown_connections 2023-07-21T22:13:22.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.254+0000 7f5fe95be700 1 -- 172.21.15.49:0/1110919548 wait complete. 2023-07-21T22:13:22.298 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 18 2023-07-21T22:13:22.319 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:13:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.454+0000 7f682b34a700 1 Processor -- start 2023-07-21T22:13:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.458+0000 7f682b34a700 1 -- start start 2023-07-21T22:13:22.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.458+0000 7f682b34a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f68240c1470 0x7f68240c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.458+0000 7f682b34a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682406e010 con 0x7f68240ca2c0 2023-07-21T22:13:22.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.458+0000 7f682b34a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6824160740 con 0x7f6824160370 2023-07-21T22:13:22.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.458+0000 7f682b34a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68240ccc50 con 0x7f68240c1470 2023-07-21T22:13:22.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.458+0000 7f682ab49700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f68240ca2c0 0x7f6824163ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35354/0 (socket says 172.21.15.49:35354) 2023-07-21T22:13:22.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.458+0000 7f682ab49700 1 -- 172.21.15.49:0/2997734338 learned_addr learned my addr 172.21.15.49:0/2997734338 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:22.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.458+0000 7f6829b47700 1 --2- 172.21.15.49:0/2997734338 >> v2:172.21.15.150:3300/0 conn(0x7f68240c1470 0x7f68240c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f6829346700 1 -- 172.21.15.49:0/2997734338 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663396952 0 0) 0x7f682406e010 con 0x7f68240ca2c0 2023-07-21T22:13:22.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f6829346700 1 -- 172.21.15.49:0/2997734338 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68100035d0 con 0x7f68240ca2c0 2023-07-21T22:13:22.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f6829b47700 1 -- 172.21.15.49:0/2997734338 >> v1:172.21.15.150:6789/0 conn(0x7f6824160370 legacy=0x7f682406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f6829346700 1 -- 172.21.15.49:0/2997734338 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245360415 0 0) 0x7f6824160740 con 0x7f6824160370 2023-07-21T22:13:22.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f6829b47700 1 -- 172.21.15.49:0/2997734338 >> v1:172.21.15.49:6789/0 conn(0x7f68240ca2c0 legacy=0x7f6824163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f6829b47700 1 -- 172.21.15.49:0/2997734338 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68240afc90 con 0x7f68240c1470 2023-07-21T22:13:22.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f6829b47700 1 --2- 172.21.15.49:0/2997734338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68240c1470 0x7f68240c9d80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6814009850 tx=0x7f6814009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2646479b86f5f002 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:22.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f6829346700 1 -- 172.21.15.49:0/2997734338 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814011830 con 0x7f68240c1470 2023-07-21T22:13:22.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f6829346700 1 -- 172.21.15.49:0/2997734338 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6814011990 con 0x7f68240c1470 2023-07-21T22:13:22.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f6829346700 1 -- 172.21.15.49:0/2997734338 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814011d40 con 0x7f68240c1470 2023-07-21T22:13:22.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f682b34a700 1 -- 172.21.15.49:0/2997734338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68240c1470 msgr2=0x7f68240c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f682b34a700 1 --2- 172.21.15.49:0/2997734338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68240c1470 0x7f68240c9d80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6814009850 tx=0x7f6814009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:22.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f682b34a700 1 -- 172.21.15.49:0/2997734338 shutdown_connections 2023-07-21T22:13:22.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f682b34a700 1 --2- 172.21.15.49:0/2997734338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68240c1470 0x7f68240c9d80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f682b34a700 1 -- 172.21.15.49:0/2997734338 >> 172.21.15.49:0/2997734338 conn(0x7f6824070450 msgr2=0x7f6824070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:22.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f682b34a700 1 -- 172.21.15.49:0/2997734338 shutdown_connections 2023-07-21T22:13:22.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.462+0000 7f682b34a700 1 -- 172.21.15.49:0/2997734338 wait complete. 2023-07-21T22:13:22.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.466+0000 7f682b34a700 1 Processor -- start 2023-07-21T22:13:22.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.466+0000 7f682b34a700 1 -- start start 2023-07-21T22:13:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682b34a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68240c1470 0x7f6824159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682b34a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68240ca2c0 0x7f682415a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682b34a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6824160370 0x7f68241f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682b34a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68240c6460 con 0x7f6824160370 2023-07-21T22:13:22.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682b34a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68240c5b50 con 0x7f68240c1470 2023-07-21T22:13:22.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682b34a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682415d5b0 con 0x7f68240ca2c0 2023-07-21T22:13:22.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682ab49700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6824160370 0x7f68241f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682a348700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68240c1470 0x7f6824159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682ab49700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6824160370 0x7f68241f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41674/0 (socket says 172.21.15.49:41674) 2023-07-21T22:13:22.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682a348700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68240c1470 0x7f6824159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:60330/0 (socket says 172.21.15.49:60330) 2023-07-21T22:13:22.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682ab49700 1 -- 172.21.15.49:0/2689381342 learned_addr learned my addr 172.21.15.49:0/2689381342 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:22.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f6829b47700 1 --2- 172.21.15.49:0/2689381342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68240ca2c0 0x7f682415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682ab49700 1 -- 172.21.15.49:0/2689381342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68240ca2c0 msgr2=0x7f682415a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682ab49700 1 --2- 172.21.15.49:0/2689381342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68240ca2c0 0x7f682415a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682ab49700 1 -- 172.21.15.49:0/2689381342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68240c1470 msgr2=0x7f6824159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682ab49700 1 --2- 172.21.15.49:0/2689381342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68240c1470 0x7f6824159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682ab49700 1 -- 172.21.15.49:0/2689381342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68140094b0 con 0x7f6824160370 2023-07-21T22:13:22.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682ab49700 1 --2- 172.21.15.49:0/2689381342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6824160370 0x7f68241f4c30 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f681c00cb40 tx=0x7f681c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:22.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f681affd700 1 -- 172.21.15.49:0/2689381342 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c007500 con 0x7f6824160370 2023-07-21T22:13:22.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f681affd700 1 -- 172.21.15.49:0/2689381342 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c007660 con 0x7f6824160370 2023-07-21T22:13:22.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f681affd700 1 -- 172.21.15.49:0/2689381342 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c0079f0 con 0x7f6824160370 2023-07-21T22:13:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682b34a700 1 -- 172.21.15.49:0/2689381342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68240c5e00 con 0x7f6824160370 2023-07-21T22:13:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.470+0000 7f682b34a700 1 -- 172.21.15.49:0/2689381342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682415a760 con 0x7f6824160370 2023-07-21T22:13:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.474+0000 7f682b34a700 1 -- 172.21.15.49:0/2689381342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682404dcb0 con 0x7f6824160370 2023-07-21T22:13:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.474+0000 7f681affd700 1 -- 172.21.15.49:0/2689381342 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f681c01b3b0 con 0x7f6824160370 2023-07-21T22:13:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.474+0000 7f681affd700 1 --2- 172.21.15.49:0/2689381342 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f68080662f0 0x7f68080687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.474+0000 7f681affd700 1 -- 172.21.15.49:0/2689381342 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f681c083a80 con 0x7f6824160370 2023-07-21T22:13:22.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.478+0000 7f682a348700 1 --2- 172.21.15.49:0/2689381342 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f68080662f0 0x7f68080687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.478+0000 7f682a348700 1 --2- 172.21.15.49:0/2689381342 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f68080662f0 0x7f68080687a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6820000f60 tx=0x7f6820009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.482+0000 7f681affd700 1 -- 172.21.15.49:0/2689381342 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f681c050be0 con 0x7f6824160370 2023-07-21T22:13:22.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.658+0000 7f682b34a700 1 -- 172.21.15.49:0/2689381342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f682406d3b0 con 0x7f6824160370 2023-07-21T22:13:22.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.662+0000 7f681affd700 1 -- 172.21.15.49:0/2689381342 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+20391 (secure 0 0 0) 0x7f681c054200 con 0x7f6824160370 2023-07-21T22:13:22.704 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:22.704 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":49,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:13:17.333567+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:12:20.014383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T22:12:21.059436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"data_new","create_time":"2023-07-21T22:12:36.491357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.38","mappings":[{"from":0,"to":4}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:13:22.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.662+0000 7f682b34a700 1 -- 172.21.15.49:0/2689381342 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f68080662f0 msgr2=0x7f68080687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.662+0000 7f682b34a700 1 --2- 172.21.15.49:0/2689381342 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f68080662f0 0x7f68080687a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6820000f60 tx=0x7f6820009040 comp rx=0 tx=0).stop 2023-07-21T22:13:22.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.662+0000 7f682b34a700 1 -- 172.21.15.49:0/2689381342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6824160370 msgr2=0x7f68241f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.662+0000 7f682b34a700 1 --2- 172.21.15.49:0/2689381342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6824160370 0x7f68241f4c30 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f681c00cb40 tx=0x7f681c00cb70 comp rx=0 tx=0).stop 2023-07-21T22:13:22.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.662+0000 7f682b34a700 1 -- 172.21.15.49:0/2689381342 shutdown_connections 2023-07-21T22:13:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.662+0000 7f682b34a700 1 --2- 172.21.15.49:0/2689381342 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f68080662f0 0x7f68080687a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.662+0000 7f682b34a700 1 --2- 172.21.15.49:0/2689381342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6824160370 0x7f68241f4c30 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.662+0000 7f682b34a700 1 --2- 172.21.15.49:0/2689381342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68240ca2c0 0x7f682415a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.662+0000 7f682b34a700 1 --2- 172.21.15.49:0/2689381342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68240c1470 0x7f6824159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.662+0000 7f682b34a700 1 -- 172.21.15.49:0/2689381342 >> 172.21.15.49:0/2689381342 conn(0x7f6824070450 msgr2=0x7f68240adb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.662+0000 7f682b34a700 1 -- 172.21.15.49:0/2689381342 shutdown_connections 2023-07-21T22:13:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.662+0000 7f682b34a700 1 -- 172.21.15.49:0/2689381342 wait complete. 2023-07-21T22:13:22.730 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:12:20.014383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:12:21.059436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'data_new', 'create_time': '2023-07-21T22:12:36.491357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:13:22.731 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:13:22.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc53e5a0700 1 Processor -- start 2023-07-21T22:13:22.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc53e5a0700 1 -- start start 2023-07-21T22:13:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc53e5a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53815e380 0x7fc5380cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc53e5a0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5380c9cd0 0x7fc5380cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc53e5a0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5380ca190 con 0x7fc5380b3a50 2023-07-21T22:13:22.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc53e5a0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc538159fd0 con 0x7fc5380c9cd0 2023-07-21T22:13:22.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc53e5a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53815d6e0 con 0x7fc53815e380 2023-07-21T22:13:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc52f7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc5380b3a50 0x7fc5380c8820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35362/0 (socket says 172.21.15.49:35362) 2023-07-21T22:13:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc52f7fe700 1 -- 172.21.15.49:0/4257112254 learned_addr learned my addr 172.21.15.49:0/4257112254 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc53cb3d700 1 --2- 172.21.15.49:0/4257112254 >> v2:172.21.15.49:3300/0 conn(0x7fc5380c9cd0 0x7fc5380cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc537fff700 1 --2- 172.21.15.49:0/4257112254 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53815e380 0x7fc5380cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc5377fe700 1 -- 172.21.15.49:0/4257112254 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710899253 0 0) 0x7fc5380ca190 con 0x7fc5380b3a50 2023-07-21T22:13:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc5377fe700 1 -- 172.21.15.49:0/4257112254 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5240035d0 con 0x7fc5380b3a50 2023-07-21T22:13:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc53cb3d700 1 -- 172.21.15.49:0/4257112254 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53815e380 msgr2=0x7fc5380cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc53cb3d700 1 --2- 172.21.15.49:0/4257112254 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53815e380 0x7fc5380cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc53cb3d700 1 -- 172.21.15.49:0/4257112254 >> v1:172.21.15.49:6789/0 conn(0x7fc5380b3a50 legacy=0x7fc5380c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc53cb3d700 1 -- 172.21.15.49:0/4257112254 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5380ca900 con 0x7fc5380c9cd0 2023-07-21T22:13:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.870+0000 7fc537fff700 1 --2- 172.21.15.49:0/4257112254 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53815e380 0x7fc5380cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.874+0000 7fc53cb3d700 1 --2- 172.21.15.49:0/4257112254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5380c9cd0 0x7fc5380cb120 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc530009d90 tx=0x7fc53000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5730b6bd21c5888 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.874+0000 7fc5377fe700 1 -- 172.21.15.49:0/4257112254 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53000e070 con 0x7fc5380c9cd0 2023-07-21T22:13:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.874+0000 7fc5377fe700 1 -- 172.21.15.49:0/4257112254 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53000bb20 con 0x7fc5380c9cd0 2023-07-21T22:13:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.874+0000 7fc5377fe700 1 -- 172.21.15.49:0/4257112254 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530012430 con 0x7fc5380c9cd0 2023-07-21T22:13:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.874+0000 7fc53e5a0700 1 -- 172.21.15.49:0/4257112254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5380c9cd0 msgr2=0x7fc5380cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.874+0000 7fc53e5a0700 1 --2- 172.21.15.49:0/4257112254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5380c9cd0 0x7fc5380cb120 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc530009d90 tx=0x7fc53000b330 comp rx=0 tx=0).stop 2023-07-21T22:13:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.874+0000 7fc53e5a0700 1 -- 172.21.15.49:0/4257112254 shutdown_connections 2023-07-21T22:13:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.874+0000 7fc53e5a0700 1 --2- 172.21.15.49:0/4257112254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5380c9cd0 0x7fc5380cb120 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.874+0000 7fc53e5a0700 1 --2- 172.21.15.49:0/4257112254 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53815e380 0x7fc5380cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.874+0000 7fc53e5a0700 1 -- 172.21.15.49:0/4257112254 >> 172.21.15.49:0/4257112254 conn(0x7fc53806e960 msgr2=0x7fc53806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.874+0000 7fc53e5a0700 1 -- 172.21.15.49:0/4257112254 shutdown_connections 2023-07-21T22:13:22.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.874+0000 7fc53e5a0700 1 -- 172.21.15.49:0/4257112254 wait complete. 2023-07-21T22:13:22.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.874+0000 7fc53e5a0700 1 Processor -- start 2023-07-21T22:13:22.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc53e5a0700 1 -- start start 2023-07-21T22:13:22.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc53e5a0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5380b3a50 0x7fc53814f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc53e5a0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5380c9cd0 0x7fc5380c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc53e5a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53815e380 0x7fc5380c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc53e5a0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5380c6890 con 0x7fc5380b3a50 2023-07-21T22:13:22.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc53e5a0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5380c5c80 con 0x7fc5380c9cd0 2023-07-21T22:13:22.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc53e5a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5380c5f60 con 0x7fc53815e380 2023-07-21T22:13:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc537fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5380b3a50 0x7fc53814f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc537fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5380b3a50 0x7fc53814f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41684/0 (socket says 172.21.15.49:41684) 2023-07-21T22:13:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc537fff700 1 -- 172.21.15.49:0/31904904 learned_addr learned my addr 172.21.15.49:0/31904904 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc52f7fe700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5380c9cd0 0x7fc5380c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc53cb3d700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53815e380 0x7fc5380c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc537fff700 1 -- 172.21.15.49:0/31904904 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53815e380 msgr2=0x7fc5380c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc537fff700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53815e380 0x7fc5380c3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc537fff700 1 -- 172.21.15.49:0/31904904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5380c9cd0 msgr2=0x7fc5380c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc537fff700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5380c9cd0 0x7fc5380c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc537fff700 1 -- 172.21.15.49:0/31904904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc530009a70 con 0x7fc5380b3a50 2023-07-21T22:13:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc52f7fe700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5380c9cd0 0x7fc5380c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc537fff700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5380b3a50 0x7fc53814f2c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc52800e810 tx=0x7fc52800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc5357fa700 1 -- 172.21.15.49:0/31904904 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528013610 con 0x7fc5380b3a50 2023-07-21T22:13:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc5357fa700 1 -- 172.21.15.49:0/31904904 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc528013770 con 0x7fc5380b3a50 2023-07-21T22:13:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc53e5a0700 1 -- 172.21.15.49:0/31904904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5380c6240 con 0x7fc5380b3a50 2023-07-21T22:13:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc5357fa700 1 -- 172.21.15.49:0/31904904 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528013b00 con 0x7fc5380b3a50 2023-07-21T22:13:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.878+0000 7fc53e5a0700 1 -- 172.21.15.49:0/31904904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5380c6d20 con 0x7fc5380b3a50 2023-07-21T22:13:22.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.882+0000 7fc53e5a0700 1 -- 172.21.15.49:0/31904904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53804dd50 con 0x7fc5380b3a50 2023-07-21T22:13:22.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.882+0000 7fc5357fa700 1 -- 172.21.15.49:0/31904904 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc528013c60 con 0x7fc5380b3a50 2023-07-21T22:13:22.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.882+0000 7fc5357fa700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc518066320 0x7fc5180687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:22.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.882+0000 7fc5357fa700 1 -- 172.21.15.49:0/31904904 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fc528083ca0 con 0x7fc5380b3a50 2023-07-21T22:13:22.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.886+0000 7fc52f7fe700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc518066320 0x7fc5180687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:22.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.886+0000 7fc52f7fe700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc518066320 0x7fc5180687d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc5380b0da0 tx=0x7fc520009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:22.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:22.890+0000 7fc5357fa700 1 -- 172.21.15.49:0/31904904 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc528050d80 con 0x7fc5380b3a50 2023-07-21T22:13:23.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.066+0000 7fc53e5a0700 1 -- 172.21.15.49:0/31904904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5380cdd90 con 0x7fc5380b3a50 2023-07-21T22:13:23.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.066+0000 7fc5357fa700 1 -- 172.21.15.49:0/31904904 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5280543a0 con 0x7fc5380b3a50 2023-07-21T22:13:23.109 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:13:23.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.070+0000 7fc53e5a0700 1 -- 172.21.15.49:0/31904904 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc518066320 msgr2=0x7fc5180687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:23.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.070+0000 7fc53e5a0700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc518066320 0x7fc5180687d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc5380b0da0 tx=0x7fc520009040 comp rx=0 tx=0).stop 2023-07-21T22:13:23.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.070+0000 7fc53e5a0700 1 -- 172.21.15.49:0/31904904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5380b3a50 msgr2=0x7fc53814f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:23.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.070+0000 7fc53e5a0700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5380b3a50 0x7fc53814f2c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc52800e810 tx=0x7fc52800ebd0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.070+0000 7fc53e5a0700 1 -- 172.21.15.49:0/31904904 shutdown_connections 2023-07-21T22:13:23.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.070+0000 7fc53e5a0700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc518066320 0x7fc5180687d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.070+0000 7fc53e5a0700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53815e380 0x7fc5380c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.070+0000 7fc53e5a0700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5380c9cd0 0x7fc5380c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.070+0000 7fc53e5a0700 1 --2- 172.21.15.49:0/31904904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5380b3a50 0x7fc53814f2c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.070+0000 7fc53e5a0700 1 -- 172.21.15.49:0/31904904 >> 172.21.15.49:0/31904904 conn(0x7fc53806e960 msgr2=0x7fc5380c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:23.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.070+0000 7fc53e5a0700 1 -- 172.21.15.49:0/31904904 shutdown_connections 2023-07-21T22:13:23.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.070+0000 7fc53e5a0700 1 -- 172.21.15.49:0/31904904 wait complete. 2023-07-21T22:13:23.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:13:23.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.266+0000 7f850885a700 1 Processor -- start 2023-07-21T22:13:23.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.266+0000 7f850885a700 1 -- start start 2023-07-21T22:13:23.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.270+0000 7f850885a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85040b7af0 0x7f85040b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:23.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.270+0000 7f850885a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85040cee10 0x7f85040cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:23.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.270+0000 7f850885a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85040b3e80 con 0x7f85040d1e40 2023-07-21T22:13:23.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.270+0000 7f850885a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85040cf7d0 con 0x7f85040b7af0 2023-07-21T22:13:23.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.270+0000 7f850885a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850415fd40 con 0x7f85040cee10 2023-07-21T22:13:23.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.270+0000 7f85037fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85040b7af0 0x7f85040b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:23.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.270+0000 7f85037fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85040b7af0 0x7f85040b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:60354/0 (socket says 172.21.15.49:60354) 2023-07-21T22:13:23.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.270+0000 7f85037fe700 1 -- 172.21.15.49:0/298152742 learned_addr learned my addr 172.21.15.49:0/298152742 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:23.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.270+0000 7f8502ffd700 1 --1- 172.21.15.49:0/298152742 >> v1:172.21.15.150:6789/0 conn(0x7f85040d1e40 0x7f850415f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:58952/0 (socket says 172.21.15.49:58952) 2023-07-21T22:13:23.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.270+0000 7f8503fff700 1 --2- 172.21.15.49:0/298152742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85040cee10 0x7f85040cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:23.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f8503fff700 1 -- 172.21.15.49:0/298152742 >> v2:172.21.15.150:3300/0 conn(0x7f85040b7af0 msgr2=0x7f85040b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:23.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f8503fff700 1 --2- 172.21.15.49:0/298152742 >> v2:172.21.15.150:3300/0 conn(0x7f85040b7af0 0x7f85040b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f8503fff700 1 -- 172.21.15.49:0/298152742 >> v1:172.21.15.150:6789/0 conn(0x7f85040d1e40 legacy=0x7f850415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:23.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f8503fff700 1 -- 172.21.15.49:0/298152742 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85040cea00 con 0x7f85040cee10 2023-07-21T22:13:23.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f85037fe700 1 --2- 172.21.15.49:0/298152742 >> v2:172.21.15.150:3300/0 conn(0x7f85040b7af0 0x7f85040b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:23.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f8503fff700 1 --2- 172.21.15.49:0/298152742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85040cee10 0x7f85040cf290 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009d90 tx=0x7f84fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f0499e9b219583d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:23.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f85027fc700 1 -- 172.21.15.49:0/298152742 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc00e070 con 0x7f85040cee10 2023-07-21T22:13:23.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f85027fc700 1 -- 172.21.15.49:0/298152742 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc00bb20 con 0x7f85040cee10 2023-07-21T22:13:23.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f85027fc700 1 -- 172.21.15.49:0/298152742 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc012430 con 0x7f85040cee10 2023-07-21T22:13:23.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f850885a700 1 -- 172.21.15.49:0/298152742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85040cee10 msgr2=0x7f85040cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:23.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f850885a700 1 --2- 172.21.15.49:0/298152742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85040cee10 0x7f85040cf290 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009d90 tx=0x7f84fc00b330 comp rx=0 tx=0).stop 2023-07-21T22:13:23.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f850885a700 1 -- 172.21.15.49:0/298152742 shutdown_connections 2023-07-21T22:13:23.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f850885a700 1 --2- 172.21.15.49:0/298152742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85040cee10 0x7f85040cf290 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f850885a700 1 --2- 172.21.15.49:0/298152742 >> v2:172.21.15.150:3300/0 conn(0x7f85040b7af0 0x7f85040b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f850885a700 1 -- 172.21.15.49:0/298152742 >> 172.21.15.49:0/298152742 conn(0x7f850406e960 msgr2=0x7f850406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:23.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f850885a700 1 -- 172.21.15.49:0/298152742 shutdown_connections 2023-07-21T22:13:23.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.274+0000 7f850885a700 1 -- 172.21.15.49:0/298152742 wait complete. 2023-07-21T22:13:23.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.278+0000 7f850885a700 1 Processor -- start 2023-07-21T22:13:23.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.278+0000 7f850885a700 1 -- start start 2023-07-21T22:13:23.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.278+0000 7f850885a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85040b7af0 0x7f8504150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:23.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f850885a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85040cee10 0x7f8504159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:23.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f850885a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85040d1e40 0x7f85041599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:23.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f850885a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85040c8930 con 0x7f85040b7af0 2023-07-21T22:13:23.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f850885a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85040c7d20 con 0x7f85040d1e40 2023-07-21T22:13:23.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f850885a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85040c8000 con 0x7f85040cee10 2023-07-21T22:13:23.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f85037fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85040b7af0 0x7f8504150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:23.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f85037fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85040b7af0 0x7f8504150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41698/0 (socket says 172.21.15.49:41698) 2023-07-21T22:13:23.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f85037fe700 1 -- 172.21.15.49:0/1845490384 learned_addr learned my addr 172.21.15.49:0/1845490384 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:23.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f8502ffd700 1 --2- 172.21.15.49:0/1845490384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85040cee10 0x7f8504159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:23.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f8503fff700 1 --2- 172.21.15.49:0/1845490384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85040d1e40 0x7f85041599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:23.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f85037fe700 1 -- 172.21.15.49:0/1845490384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85040cee10 msgr2=0x7f8504159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:23.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f85037fe700 1 --2- 172.21.15.49:0/1845490384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85040cee10 0x7f8504159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f85037fe700 1 -- 172.21.15.49:0/1845490384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85040d1e40 msgr2=0x7f85041599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:23.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f85037fe700 1 --2- 172.21.15.49:0/1845490384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85040d1e40 0x7f85041599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f85037fe700 1 -- 172.21.15.49:0/1845490384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f4009570 con 0x7f85040b7af0 2023-07-21T22:13:23.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f85037fe700 1 --2- 172.21.15.49:0/1845490384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85040b7af0 0x7f8504150fa0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f84f400e9d0 tx=0x7f84f400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:23.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f84ebfff700 1 -- 172.21.15.49:0/1845490384 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400ee70 con 0x7f85040b7af0 2023-07-21T22:13:23.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f84ebfff700 1 -- 172.21.15.49:0/1845490384 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f400c850 con 0x7f85040b7af0 2023-07-21T22:13:23.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f850885a700 1 -- 172.21.15.49:0/1845490384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84fc009a70 con 0x7f85040b7af0 2023-07-21T22:13:23.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f84ebfff700 1 -- 172.21.15.49:0/1845490384 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400cbc0 con 0x7f85040b7af0 2023-07-21T22:13:23.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f850885a700 1 -- 172.21.15.49:0/1845490384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85040c85c0 con 0x7f85040b7af0 2023-07-21T22:13:23.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.282+0000 7f850885a700 1 -- 172.21.15.49:0/1845490384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850404dcb0 con 0x7f85040b7af0 2023-07-21T22:13:23.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.286+0000 7f84ebfff700 1 -- 172.21.15.49:0/1845490384 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84f400cd20 con 0x7f85040b7af0 2023-07-21T22:13:23.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.290+0000 7f84ebfff700 1 --2- 172.21.15.49:0/1845490384 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f84f00662f0 0x7f84f00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:23.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.290+0000 7f84ebfff700 1 -- 172.21.15.49:0/1845490384 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f84f4084430 con 0x7f85040b7af0 2023-07-21T22:13:23.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.290+0000 7f8502ffd700 1 --2- 172.21.15.49:0/1845490384 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f84f00662f0 0x7f84f00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:23.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.290+0000 7f8502ffd700 1 --2- 172.21.15.49:0/1845490384 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f84f00662f0 0x7f84f00687a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f85040b1a70 tx=0x7f84f8007f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:23.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.294+0000 7f84ebfff700 1 -- 172.21.15.49:0/1845490384 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84f4051580 con 0x7f85040b7af0 2023-07-21T22:13:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.466+0000 7f850885a700 1 -- 172.21.15.49:0/1845490384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8504160160 con 0x7f85040b7af0 2023-07-21T22:13:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.470+0000 7f84ebfff700 1 -- 172.21.15.49:0/1845490384 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v49) v1 ==== 92+0+10 (secure 0 0 0) 0x7f84f4054ba0 con 0x7f85040b7af0 2023-07-21T22:13:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:13:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.470+0000 7f850885a700 1 -- 172.21.15.49:0/1845490384 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f84f00662f0 msgr2=0x7f84f00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.470+0000 7f850885a700 1 --2- 172.21.15.49:0/1845490384 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f84f00662f0 0x7f84f00687a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f85040b1a70 tx=0x7f84f8007f30 comp rx=0 tx=0).stop 2023-07-21T22:13:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.470+0000 7f850885a700 1 -- 172.21.15.49:0/1845490384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85040b7af0 msgr2=0x7f8504150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.470+0000 7f850885a700 1 --2- 172.21.15.49:0/1845490384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85040b7af0 0x7f8504150fa0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f84f400e9d0 tx=0x7f84f400ece0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.470+0000 7f850885a700 1 -- 172.21.15.49:0/1845490384 shutdown_connections 2023-07-21T22:13:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.470+0000 7f850885a700 1 --2- 172.21.15.49:0/1845490384 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f84f00662f0 0x7f84f00687a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.470+0000 7f850885a700 1 --2- 172.21.15.49:0/1845490384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85040d1e40 0x7f85041599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.470+0000 7f850885a700 1 --2- 172.21.15.49:0/1845490384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85040cee10 0x7f8504159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.470+0000 7f850885a700 1 --2- 172.21.15.49:0/1845490384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85040b7af0 0x7f8504150fa0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.470+0000 7f850885a700 1 -- 172.21.15.49:0/1845490384 >> 172.21.15.49:0/1845490384 conn(0x7f850406e960 msgr2=0x7f85040d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.470+0000 7f850885a700 1 -- 172.21.15.49:0/1845490384 shutdown_connections 2023-07-21T22:13:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.470+0000 7f850885a700 1 -- 172.21.15.49:0/1845490384 wait complete. 2023-07-21T22:13:23.534 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:13:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.674+0000 7fa362448700 1 Processor -- start 2023-07-21T22:13:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.674+0000 7fa362448700 1 -- start start 2023-07-21T22:13:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa362448700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa35c159d10 0x7fa35c0698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa362448700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa35c06f070 0x7fa35c0cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa362448700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa35c0cb000 con 0x7fa35c0b1440 2023-07-21T22:13:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa362448700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35c06a0f0 con 0x7fa35c159d10 2023-07-21T22:13:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa362448700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c06a3d0 con 0x7fa35c06f070 2023-07-21T22:13:23.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa361c47700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa35c06f070 0x7fa35c0cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:23.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa361446700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa35c159d10 0x7fa35c0698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:23.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa361c47700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa35c06f070 0x7fa35c0cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:45410/0 (socket says 172.21.15.49:45410) 2023-07-21T22:13:23.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa361c47700 1 -- 172.21.15.49:0/3408618343 learned_addr learned my addr 172.21.15.49:0/3408618343 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:23.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa353fff700 1 -- 172.21.15.49:0/3408618343 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153403563 0 0) 0x7fa35c0cb000 con 0x7fa35c0b1440 2023-07-21T22:13:23.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa353fff700 1 -- 172.21.15.49:0/3408618343 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3480035d0 con 0x7fa35c0b1440 2023-07-21T22:13:23.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa361c47700 1 -- 172.21.15.49:0/3408618343 >> v2:172.21.15.150:3300/0 conn(0x7fa35c159d10 msgr2=0x7fa35c0698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:23.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa361c47700 1 --2- 172.21.15.49:0/3408618343 >> v2:172.21.15.150:3300/0 conn(0x7fa35c159d10 0x7fa35c0698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa361c47700 1 -- 172.21.15.49:0/3408618343 >> v1:172.21.15.150:6789/0 conn(0x7fa35c0b1440 legacy=0x7fa35c06e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:23.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa361c47700 1 -- 172.21.15.49:0/3408618343 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c06a6b0 con 0x7fa35c06f070 2023-07-21T22:13:23.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa361446700 1 --2- 172.21.15.49:0/3408618343 >> v2:172.21.15.150:3300/0 conn(0x7fa35c159d10 0x7fa35c0698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:23.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.678+0000 7fa361c47700 1 --2- 172.21.15.49:0/3408618343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa35c06f070 0x7fa35c0cb490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa354009e50 tx=0x7fa35400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d44d931e10b84aee server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:23.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.682+0000 7fa353fff700 1 -- 172.21.15.49:0/3408618343 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35400e070 con 0x7fa35c06f070 2023-07-21T22:13:23.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.682+0000 7fa353fff700 1 -- 172.21.15.49:0/3408618343 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35400b910 con 0x7fa35c06f070 2023-07-21T22:13:23.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.682+0000 7fa353fff700 1 -- 172.21.15.49:0/3408618343 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35400bcc0 con 0x7fa35c06f070 2023-07-21T22:13:23.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.682+0000 7fa362448700 1 -- 172.21.15.49:0/3408618343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa35c06f070 msgr2=0x7fa35c0cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:23.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.682+0000 7fa362448700 1 --2- 172.21.15.49:0/3408618343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa35c06f070 0x7fa35c0cb490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa354009e50 tx=0x7fa35400b330 comp rx=0 tx=0).stop 2023-07-21T22:13:23.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.682+0000 7fa362448700 1 -- 172.21.15.49:0/3408618343 shutdown_connections 2023-07-21T22:13:23.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.682+0000 7fa362448700 1 --2- 172.21.15.49:0/3408618343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa35c06f070 0x7fa35c0cb490 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.682+0000 7fa362448700 1 --2- 172.21.15.49:0/3408618343 >> v2:172.21.15.150:3300/0 conn(0x7fa35c159d10 0x7fa35c0698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.682+0000 7fa362448700 1 -- 172.21.15.49:0/3408618343 >> 172.21.15.49:0/3408618343 conn(0x7fa35c06fa70 msgr2=0x7fa35c06fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:23.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.682+0000 7fa362448700 1 -- 172.21.15.49:0/3408618343 shutdown_connections 2023-07-21T22:13:23.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.682+0000 7fa362448700 1 -- 172.21.15.49:0/3408618343 wait complete. 2023-07-21T22:13:23.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.682+0000 7fa362448700 1 Processor -- start 2023-07-21T22:13:23.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.682+0000 7fa362448700 1 -- start start 2023-07-21T22:13:23.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa362448700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa35c06f070 0x7fa35c0c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:23.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa362448700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa35c0b1440 0x7fa35c0c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:23.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa362448700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c159d10 0x7fa35c1e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:23.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa362448700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c0c7600 con 0x7fa35c159d10 2023-07-21T22:13:23.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa362448700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c1529a0 con 0x7fa35c06f070 2023-07-21T22:13:23.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa362448700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c1e3f50 con 0x7fa35c0b1440 2023-07-21T22:13:23.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa361c47700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c159d10 0x7fa35c1e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:23.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa361c47700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c159d10 0x7fa35c1e3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41714/0 (socket says 172.21.15.49:41714) 2023-07-21T22:13:23.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa361c47700 1 -- 172.21.15.49:0/2079484544 learned_addr learned my addr 172.21.15.49:0/2079484544 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:23.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa360c45700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa35c0b1440 0x7fa35c0c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:23.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa361446700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa35c06f070 0x7fa35c0c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:23.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa361c47700 1 -- 172.21.15.49:0/2079484544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa35c0b1440 msgr2=0x7fa35c0c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:23.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa361c47700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa35c0b1440 0x7fa35c0c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa361c47700 1 -- 172.21.15.49:0/2079484544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa35c06f070 msgr2=0x7fa35c0c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa361c47700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa35c06f070 0x7fa35c0c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa361c47700 1 -- 172.21.15.49:0/2079484544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3580094b0 con 0x7fa35c159d10 2023-07-21T22:13:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa361446700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa35c06f070 0x7fa35c0c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa361c47700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c159d10 0x7fa35c1e3a10 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa35c06a510 tx=0x7fa354004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa351ffb700 1 -- 172.21.15.49:0/2079484544 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35400ce80 con 0x7fa35c159d10 2023-07-21T22:13:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa362448700 1 -- 172.21.15.49:0/2079484544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa354009b30 con 0x7fa35c159d10 2023-07-21T22:13:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa351ffb700 1 -- 172.21.15.49:0/2079484544 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa354004250 con 0x7fa35c159d10 2023-07-21T22:13:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa351ffb700 1 -- 172.21.15.49:0/2079484544 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa354004600 con 0x7fa35c159d10 2023-07-21T22:13:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.686+0000 7fa362448700 1 -- 172.21.15.49:0/2079484544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35c0c6c60 con 0x7fa35c159d10 2023-07-21T22:13:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.690+0000 7fa362448700 1 -- 172.21.15.49:0/2079484544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35c0c7740 con 0x7fa35c159d10 2023-07-21T22:13:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.690+0000 7fa351ffb700 1 -- 172.21.15.49:0/2079484544 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa354004760 con 0x7fa35c159d10 2023-07-21T22:13:23.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.694+0000 7fa351ffb700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3400662f0 0x7fa3400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:23.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.694+0000 7fa351ffb700 1 -- 172.21.15.49:0/2079484544 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fa3540854b0 con 0x7fa35c159d10 2023-07-21T22:13:23.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.694+0000 7fa361446700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3400662f0 0x7fa3400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:23.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.694+0000 7fa361446700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3400662f0 0x7fa3400687a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa358009d00 tx=0x7fa358008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.698+0000 7fa351ffb700 1 -- 172.21.15.49:0/2079484544 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa35c0c7740 con 0x7fa35c159d10 2023-07-21T22:13:23.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.870+0000 7fa362448700 1 -- 172.21.15.49:0/2079484544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa35c0c7740 con 0x7fa35c159d10 2023-07-21T22:13:23.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.870+0000 7fa351ffb700 1 -- 172.21.15.49:0/2079484544 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa35c0c7740 con 0x7fa35c159d10 2023-07-21T22:13:23.917 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:13:23.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.874+0000 7fa362448700 1 -- 172.21.15.49:0/2079484544 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3400662f0 msgr2=0x7fa3400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:23.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.874+0000 7fa362448700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3400662f0 0x7fa3400687a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa358009d00 tx=0x7fa358008040 comp rx=0 tx=0).stop 2023-07-21T22:13:23.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.874+0000 7fa362448700 1 -- 172.21.15.49:0/2079484544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c159d10 msgr2=0x7fa35c1e3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:23.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.874+0000 7fa362448700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c159d10 0x7fa35c1e3a10 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa35c06a510 tx=0x7fa354004af0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.874+0000 7fa362448700 1 -- 172.21.15.49:0/2079484544 shutdown_connections 2023-07-21T22:13:23.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.874+0000 7fa362448700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3400662f0 0x7fa3400687a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.874+0000 7fa362448700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c159d10 0x7fa35c1e3a10 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.874+0000 7fa362448700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa35c0b1440 0x7fa35c0c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.874+0000 7fa362448700 1 --2- 172.21.15.49:0/2079484544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa35c06f070 0x7fa35c0c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:23.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.874+0000 7fa362448700 1 -- 172.21.15.49:0/2079484544 >> 172.21.15.49:0/2079484544 conn(0x7fa35c06fa70 msgr2=0x7fa35c06e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:23.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.874+0000 7fa362448700 1 -- 172.21.15.49:0/2079484544 shutdown_connections 2023-07-21T22:13:23.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:23.874+0000 7fa362448700 1 -- 172.21.15.49:0/2079484544 wait complete. 2023-07-21T22:13:23.939 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:13:24.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.074+0000 7f31fb33e700 1 Processor -- start 2023-07-21T22:13:24.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.074+0000 7f31fb33e700 1 -- start start 2023-07-21T22:13:24.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.074+0000 7f31fb33e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31f40d1e40 0x7f31f40b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.074+0000 7f31fb33e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f31f40cee10 0x7f31f40cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31fb33e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f40b3e80 con 0x7f31f40b7af0 2023-07-21T22:13:24.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31fb33e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f40cf790 con 0x7f31f40cee10 2023-07-21T22:13:24.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31fb33e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f415fd40 con 0x7f31f40d1e40 2023-07-21T22:13:24.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31fa33c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f31f40b7af0 0x7f31f415f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35376/0 (socket says 172.21.15.49:35376) 2023-07-21T22:13:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31fa33c700 1 -- 172.21.15.49:0/3519471117 learned_addr learned my addr 172.21.15.49:0/3519471117 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31fab3d700 1 --2- 172.21.15.49:0/3519471117 >> v2:172.21.15.49:3300/0 conn(0x7f31f40cee10 0x7f31f40cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31f9b3b700 1 --2- 172.21.15.49:0/3519471117 >> v2:172.21.15.150:3300/0 conn(0x7f31f40d1e40 0x7f31f40b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31f933a700 1 -- 172.21.15.49:0/3519471117 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075024191 0 0) 0x7f31f40b3e80 con 0x7f31f40b7af0 2023-07-21T22:13:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31f933a700 1 -- 172.21.15.49:0/3519471117 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e00035d0 con 0x7f31f40b7af0 2023-07-21T22:13:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31fab3d700 1 -- 172.21.15.49:0/3519471117 >> v2:172.21.15.150:3300/0 conn(0x7f31f40d1e40 msgr2=0x7f31f40b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31fab3d700 1 --2- 172.21.15.49:0/3519471117 >> v2:172.21.15.150:3300/0 conn(0x7f31f40d1e40 0x7f31f40b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31fab3d700 1 -- 172.21.15.49:0/3519471117 >> v1:172.21.15.49:6789/0 conn(0x7f31f40b7af0 legacy=0x7f31f415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31fab3d700 1 -- 172.21.15.49:0/3519471117 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f40cea00 con 0x7f31f40cee10 2023-07-21T22:13:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31f9b3b700 1 --2- 172.21.15.49:0/3519471117 >> v2:172.21.15.150:3300/0 conn(0x7f31f40d1e40 0x7f31f40b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31fab3d700 1 --2- 172.21.15.49:0/3519471117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40cee10 0x7f31f40cf250 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f31f40d1200 tx=0x7f31ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc10ef2c475bff3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31f933a700 1 -- 172.21.15.49:0/3519471117 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec00e070 con 0x7f31f40cee10 2023-07-21T22:13:24.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31f933a700 1 -- 172.21.15.49:0/3519471117 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec00bb20 con 0x7f31f40cee10 2023-07-21T22:13:24.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.078+0000 7f31f933a700 1 -- 172.21.15.49:0/3519471117 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec012430 con 0x7f31f40cee10 2023-07-21T22:13:24.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.082+0000 7f31fb33e700 1 -- 172.21.15.49:0/3519471117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40cee10 msgr2=0x7f31f40cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.082+0000 7f31fb33e700 1 --2- 172.21.15.49:0/3519471117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40cee10 0x7f31f40cf250 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f31f40d1200 tx=0x7f31ec00b330 comp rx=0 tx=0).stop 2023-07-21T22:13:24.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.082+0000 7f31fb33e700 1 -- 172.21.15.49:0/3519471117 shutdown_connections 2023-07-21T22:13:24.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.082+0000 7f31fb33e700 1 --2- 172.21.15.49:0/3519471117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40cee10 0x7f31f40cf250 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.082+0000 7f31fb33e700 1 --2- 172.21.15.49:0/3519471117 >> v2:172.21.15.150:3300/0 conn(0x7f31f40d1e40 0x7f31f40b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.082+0000 7f31fb33e700 1 -- 172.21.15.49:0/3519471117 >> 172.21.15.49:0/3519471117 conn(0x7f31f406e960 msgr2=0x7f31f406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:24.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.082+0000 7f31fb33e700 1 -- 172.21.15.49:0/3519471117 shutdown_connections 2023-07-21T22:13:24.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.082+0000 7f31fb33e700 1 -- 172.21.15.49:0/3519471117 wait complete. 2023-07-21T22:13:24.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.082+0000 7f31fb33e700 1 Processor -- start 2023-07-21T22:13:24.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.082+0000 7f31fb33e700 1 -- start start 2023-07-21T22:13:24.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fb33e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40b7af0 0x7f31f40c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fb33e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31f40cee10 0x7f31f40cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fb33e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31f40d1e40 0x7f31f415c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fb33e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f414b0f0 con 0x7f31f40b7af0 2023-07-21T22:13:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fb33e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40ca3e0 con 0x7f31f40cee10 2023-07-21T22:13:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fb33e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40cc400 con 0x7f31f40d1e40 2023-07-21T22:13:24.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fa33c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40b7af0 0x7f31f40c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fa33c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40b7af0 0x7f31f40c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41732/0 (socket says 172.21.15.49:41732) 2023-07-21T22:13:24.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fa33c700 1 -- 172.21.15.49:0/2206885690 learned_addr learned my addr 172.21.15.49:0/2206885690 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:24.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31f9b3b700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31f40cee10 0x7f31f40cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fab3d700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31f40d1e40 0x7f31f415c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fa33c700 1 -- 172.21.15.49:0/2206885690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31f40d1e40 msgr2=0x7f31f415c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fa33c700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31f40d1e40 0x7f31f415c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fa33c700 1 -- 172.21.15.49:0/2206885690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31f40cee10 msgr2=0x7f31f40cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fa33c700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31f40cee10 0x7f31f40cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fa33c700 1 -- 172.21.15.49:0/2206885690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e40094b0 con 0x7f31f40b7af0 2023-07-21T22:13:24.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31f9b3b700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31f40cee10 0x7f31f40cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:24.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fa33c700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40b7af0 0x7f31f40c94d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f31f000c700 tx=0x7f31f000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:24.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31eaffd700 1 -- 172.21.15.49:0/2206885690 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0005d90 con 0x7f31f40b7af0 2023-07-21T22:13:24.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31eaffd700 1 -- 172.21.15.49:0/2206885690 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f00070d0 con 0x7f31f40b7af0 2023-07-21T22:13:24.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fb33e700 1 -- 172.21.15.49:0/2206885690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ec009a70 con 0x7f31f40b7af0 2023-07-21T22:13:24.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31eaffd700 1 -- 172.21.15.49:0/2206885690 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0007480 con 0x7f31f40b7af0 2023-07-21T22:13:24.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.086+0000 7f31fb33e700 1 -- 172.21.15.49:0/2206885690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f40ca100 con 0x7f31f40b7af0 2023-07-21T22:13:24.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.090+0000 7f31fb33e700 1 -- 172.21.15.49:0/2206885690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f404dcb0 con 0x7f31f40b7af0 2023-07-21T22:13:24.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.090+0000 7f31eaffd700 1 -- 172.21.15.49:0/2206885690 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f31f00075e0 con 0x7f31f40b7af0 2023-07-21T22:13:24.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.094+0000 7f31eaffd700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f31d80662f0 0x7f31d80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.094+0000 7f31eaffd700 1 -- 172.21.15.49:0/2206885690 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f31f00836f0 con 0x7f31f40b7af0 2023-07-21T22:13:24.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.094+0000 7f31f9b3b700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f31d80662f0 0x7f31d80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.094+0000 7f31f9b3b700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f31d80662f0 0x7f31d80687a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f31f415ab30 tx=0x7f31e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:24.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.098+0000 7f31eaffd700 1 -- 172.21.15.49:0/2206885690 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f31f00507d0 con 0x7f31f40b7af0 2023-07-21T22:13:24.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.274+0000 7f31fb33e700 1 -- 172.21.15.49:0/2206885690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31f40cd330 con 0x7f31f40b7af0 2023-07-21T22:13:24.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.274+0000 7f31eaffd700 1 -- 172.21.15.49:0/2206885690 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f31f0053df0 con 0x7f31f40b7af0 2023-07-21T22:13:24.317 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:13:24.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.278+0000 7f31fb33e700 1 -- 172.21.15.49:0/2206885690 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f31d80662f0 msgr2=0x7f31d80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.278+0000 7f31fb33e700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f31d80662f0 0x7f31d80687a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f31f415ab30 tx=0x7f31e4008040 comp rx=0 tx=0).stop 2023-07-21T22:13:24.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.278+0000 7f31fb33e700 1 -- 172.21.15.49:0/2206885690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40b7af0 msgr2=0x7f31f40c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.278+0000 7f31fb33e700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40b7af0 0x7f31f40c94d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f31f000c700 tx=0x7f31f000cac0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.278+0000 7f31fb33e700 1 -- 172.21.15.49:0/2206885690 shutdown_connections 2023-07-21T22:13:24.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.278+0000 7f31fb33e700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f31d80662f0 0x7f31d80687a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.278+0000 7f31fb33e700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31f40d1e40 0x7f31f415c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.278+0000 7f31fb33e700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31f40cee10 0x7f31f40cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.278+0000 7f31fb33e700 1 --2- 172.21.15.49:0/2206885690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40b7af0 0x7f31f40c94d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.278+0000 7f31fb33e700 1 -- 172.21.15.49:0/2206885690 >> 172.21.15.49:0/2206885690 conn(0x7f31f406e960 msgr2=0x7f31f40d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:24.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.278+0000 7f31fb33e700 1 -- 172.21.15.49:0/2206885690 shutdown_connections 2023-07-21T22:13:24.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.278+0000 7f31fb33e700 1 -- 172.21.15.49:0/2206885690 wait complete. 2023-07-21T22:13:24.340 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-07-21T22:13:24.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.482+0000 7fa33ee11700 1 Processor -- start 2023-07-21T22:13:24.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.482+0000 7fa33ee11700 1 -- start start 2023-07-21T22:13:24.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.486+0000 7fa33ee11700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3380b4b20 0x7fa3380cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.486+0000 7fa33ee11700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3380b8170 con 0x7fa3380d0810 2023-07-21T22:13:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.486+0000 7fa33ee11700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3380d2350 con 0x7fa3380b4040 2023-07-21T22:13:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.486+0000 7fa33ee11700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380cfa20 con 0x7fa3380b4b20 2023-07-21T22:13:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.486+0000 7fa33d3ae700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa3380d0810 0x7fa3380d0c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35382/0 (socket says 172.21.15.49:35382) 2023-07-21T22:13:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.486+0000 7fa33d3ae700 1 -- 172.21.15.49:0/1743697500 learned_addr learned my addr 172.21.15.49:0/1743697500 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.486+0000 7fa337fff700 1 --2- 172.21.15.49:0/1743697500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3380b4b20 0x7fa3380cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.486+0000 7fa3377fe700 1 -- 172.21.15.49:0/1743697500 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745756 0 0) 0x7fa3380b8170 con 0x7fa3380d0810 2023-07-21T22:13:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.486+0000 7fa3377fe700 1 -- 172.21.15.49:0/1743697500 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3280035d0 con 0x7fa3380d0810 2023-07-21T22:13:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.486+0000 7fa3377fe700 1 -- 172.21.15.49:0/1743697500 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326795826 0 0) 0x7fa3380d2350 con 0x7fa3380b4040 2023-07-21T22:13:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.486+0000 7fa3377fe700 1 -- 172.21.15.49:0/1743697500 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3380b8170 con 0x7fa3380b4040 2023-07-21T22:13:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.486+0000 7fa337fff700 1 -- 172.21.15.49:0/1743697500 >> v1:172.21.15.150:6789/0 conn(0x7fa3380b4040 legacy=0x7fa3380b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.486+0000 7fa337fff700 1 -- 172.21.15.49:0/1743697500 >> v1:172.21.15.49:6789/0 conn(0x7fa3380d0810 legacy=0x7fa3380d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.486+0000 7fa337fff700 1 -- 172.21.15.49:0/1743697500 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3380cd370 con 0x7fa3380b4b20 2023-07-21T22:13:24.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.490+0000 7fa337fff700 1 --2- 172.21.15.49:0/1743697500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3380b4b20 0x7fa3380cf320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa324009880 tx=0x7fa324009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46159b22d0a2cdf5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:24.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.490+0000 7fa3377fe700 1 -- 172.21.15.49:0/1743697500 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324011830 con 0x7fa3380b4b20 2023-07-21T22:13:24.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.490+0000 7fa3377fe700 1 -- 172.21.15.49:0/1743697500 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa324011990 con 0x7fa3380b4b20 2023-07-21T22:13:24.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.490+0000 7fa3377fe700 1 -- 172.21.15.49:0/1743697500 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324011d20 con 0x7fa3380b4b20 2023-07-21T22:13:24.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.490+0000 7fa33ee11700 1 -- 172.21.15.49:0/1743697500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3380b4b20 msgr2=0x7fa3380cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.490+0000 7fa33ee11700 1 --2- 172.21.15.49:0/1743697500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3380b4b20 0x7fa3380cf320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa324009880 tx=0x7fa324009b90 comp rx=0 tx=0).stop 2023-07-21T22:13:24.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.490+0000 7fa33ee11700 1 -- 172.21.15.49:0/1743697500 shutdown_connections 2023-07-21T22:13:24.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.490+0000 7fa33ee11700 1 --2- 172.21.15.49:0/1743697500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3380b4b20 0x7fa3380cf320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.490+0000 7fa33ee11700 1 -- 172.21.15.49:0/1743697500 >> 172.21.15.49:0/1743697500 conn(0x7fa3380658e0 msgr2=0x7fa33806fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:24.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.490+0000 7fa33ee11700 1 -- 172.21.15.49:0/1743697500 shutdown_connections 2023-07-21T22:13:24.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.490+0000 7fa33ee11700 1 -- 172.21.15.49:0/1743697500 wait complete. 2023-07-21T22:13:24.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.494+0000 7fa33ee11700 1 Processor -- start 2023-07-21T22:13:24.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.494+0000 7fa33ee11700 1 -- start start 2023-07-21T22:13:24.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.494+0000 7fa33ee11700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3380b4040 0x7fa3381567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.494+0000 7fa33ee11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380b4b20 0x7fa3380ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.494+0000 7fa33ee11700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3380d0810 0x7fa3380ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.494+0000 7fa33ee11700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380c9690 con 0x7fa3380b4b20 2023-07-21T22:13:24.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.494+0000 7fa33ee11700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815c440 con 0x7fa3380b4040 2023-07-21T22:13:24.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.494+0000 7fa33ee11700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815c720 con 0x7fa3380d0810 2023-07-21T22:13:24.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.494+0000 7fa337fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380b4b20 0x7fa3380ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.494+0000 7fa337fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380b4b20 0x7fa3380ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41746/0 (socket says 172.21.15.49:41746) 2023-07-21T22:13:24.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.494+0000 7fa337fff700 1 -- 172.21.15.49:0/4217860002 learned_addr learned my addr 172.21.15.49:0/4217860002 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:24.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa33d3ae700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3380d0810 0x7fa3380ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa337fff700 1 -- 172.21.15.49:0/4217860002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3380d0810 msgr2=0x7fa3380ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa33cbad700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3380b4040 0x7fa3381567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa337fff700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3380d0810 0x7fa3380ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa337fff700 1 -- 172.21.15.49:0/4217860002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3380b4040 msgr2=0x7fa3381567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa337fff700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3380b4040 0x7fa3381567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa337fff700 1 -- 172.21.15.49:0/4217860002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3240094b0 con 0x7fa3380b4b20 2023-07-21T22:13:24.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa33d3ae700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3380d0810 0x7fa3380ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:24.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa33cbad700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3380b4040 0x7fa3381567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:24.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa337fff700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380b4b20 0x7fa3380ce810 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa324013040 tx=0x7fa324004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:24.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa3357fa700 1 -- 172.21.15.49:0/4217860002 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3240198d0 con 0x7fa3380b4b20 2023-07-21T22:13:24.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa3357fa700 1 -- 172.21.15.49:0/4217860002 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32401e070 con 0x7fa3380b4b20 2023-07-21T22:13:24.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa33ee11700 1 -- 172.21.15.49:0/4217860002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33815ca00 con 0x7fa3380b4b20 2023-07-21T22:13:24.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa3357fa700 1 -- 172.21.15.49:0/4217860002 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324019c50 con 0x7fa3380b4b20 2023-07-21T22:13:24.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa33ee11700 1 -- 172.21.15.49:0/4217860002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33815cfc0 con 0x7fa3380b4b20 2023-07-21T22:13:24.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa33ee11700 1 -- 172.21.15.49:0/4217860002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33804dd50 con 0x7fa3380b4b20 2023-07-21T22:13:24.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.498+0000 7fa3357fa700 1 -- 172.21.15.49:0/4217860002 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa32402d450 con 0x7fa3380b4b20 2023-07-21T22:13:24.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.502+0000 7fa3357fa700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa31c066320 0x7fa31c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.502+0000 7fa3357fa700 1 -- 172.21.15.49:0/4217860002 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fa324085090 con 0x7fa3380b4b20 2023-07-21T22:13:24.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.502+0000 7fa33cbad700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa31c066320 0x7fa31c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.502+0000 7fa33cbad700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa31c066320 0x7fa31c0687d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0011e0 tx=0x7fa32c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:24.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.510+0000 7fa3357fa700 1 -- 172.21.15.49:0/4217860002 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa324052220 con 0x7fa3380b4b20 2023-07-21T22:13:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.678+0000 7fa33ee11700 1 -- 172.21.15.49:0/4217860002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fa3380b1d00 con 0x7fa3380b4b20 2023-07-21T22:13:24.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.678+0000 7fa3357fa700 1 -- 172.21.15.49:0/4217860002 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v49) v1 ==== 97+0+11 (secure 0 0 0) 0x7fa3240200a0 con 0x7fa3380b4b20 2023-07-21T22:13:24.722 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:13:24.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.682+0000 7fa33ee11700 1 -- 172.21.15.49:0/4217860002 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa31c066320 msgr2=0x7fa31c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.682+0000 7fa33ee11700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa31c066320 0x7fa31c0687d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0011e0 tx=0x7fa32c009040 comp rx=0 tx=0).stop 2023-07-21T22:13:24.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.682+0000 7fa33ee11700 1 -- 172.21.15.49:0/4217860002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380b4b20 msgr2=0x7fa3380ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.682+0000 7fa33ee11700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380b4b20 0x7fa3380ce810 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa324013040 tx=0x7fa324004770 comp rx=0 tx=0).stop 2023-07-21T22:13:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.682+0000 7fa33ee11700 1 -- 172.21.15.49:0/4217860002 shutdown_connections 2023-07-21T22:13:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.682+0000 7fa33ee11700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa31c066320 0x7fa31c0687d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.682+0000 7fa33ee11700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380b4b20 0x7fa3380ce810 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.682+0000 7fa33ee11700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3380d0810 0x7fa3380ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.682+0000 7fa33ee11700 1 --2- 172.21.15.49:0/4217860002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3380b4040 0x7fa3381567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.682+0000 7fa33ee11700 1 -- 172.21.15.49:0/4217860002 >> 172.21.15.49:0/4217860002 conn(0x7fa3380658e0 msgr2=0x7fa3380d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:24.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.682+0000 7fa33ee11700 1 -- 172.21.15.49:0/4217860002 shutdown_connections 2023-07-21T22:13:24.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.682+0000 7fa33ee11700 1 -- 172.21.15.49:0/4217860002 wait complete. 2023-07-21T22:13:24.748 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:13:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.886+0000 7fa681dae700 1 Processor -- start 2023-07-21T22:13:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.886+0000 7fa681dae700 1 -- start start 2023-07-21T22:13:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.886+0000 7fa681dae700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa67c15c0a0 0x7fa67c0ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.886+0000 7fa681dae700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa67c0ab8d0 0x7fa67c0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.886+0000 7fa681dae700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67c0cdd70 con 0x7fa67c0cb800 2023-07-21T22:13:24.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.886+0000 7fa681dae700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa67c0abdd0 con 0x7fa67c0ab8d0 2023-07-21T22:13:24.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.886+0000 7fa681dae700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa67c0ccab0 con 0x7fa67c15c0a0 2023-07-21T22:13:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.886+0000 7fa67bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa67c0cb800 0x7fa67c070600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53216/0 (socket says 172.21.15.49:53216) 2023-07-21T22:13:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.886+0000 7fa67bfff700 1 -- 172.21.15.49:0/3731753873 learned_addr learned my addr 172.21.15.49:0/3731753873 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.886+0000 7fa67affd700 1 --2- 172.21.15.49:0/3731753873 >> v2:172.21.15.49:3300/0 conn(0x7fa67c0ab8d0 0x7fa67c0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.886+0000 7fa67b7fe700 1 --2- 172.21.15.49:0/3731753873 >> v2:172.21.15.150:3300/0 conn(0x7fa67c15c0a0 0x7fa67c0ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa67a7fc700 1 -- 172.21.15.49:0/3731753873 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147635859 0 0) 0x7fa67c0cdd70 con 0x7fa67c0cb800 2023-07-21T22:13:24.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa67a7fc700 1 -- 172.21.15.49:0/3731753873 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6640035d0 con 0x7fa67c0cb800 2023-07-21T22:13:24.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa67b7fe700 1 -- 172.21.15.49:0/3731753873 >> v2:172.21.15.49:3300/0 conn(0x7fa67c0ab8d0 msgr2=0x7fa67c0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:24.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa67b7fe700 1 --2- 172.21.15.49:0/3731753873 >> v2:172.21.15.49:3300/0 conn(0x7fa67c0ab8d0 0x7fa67c0afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa67b7fe700 1 -- 172.21.15.49:0/3731753873 >> v1:172.21.15.49:6789/0 conn(0x7fa67c0cb800 legacy=0x7fa67c070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa67b7fe700 1 -- 172.21.15.49:0/3731753873 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c0ad890 con 0x7fa67c15c0a0 2023-07-21T22:13:24.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa67affd700 1 --2- 172.21.15.49:0/3731753873 >> v2:172.21.15.49:3300/0 conn(0x7fa67c0ab8d0 0x7fa67c0afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:24.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa67b7fe700 1 --2- 172.21.15.49:0/3731753873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa67c15c0a0 0x7fa67c0ad350 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa67c06e670 tx=0x7fa66c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c24cb2bde9a5fb11 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:24.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa67a7fc700 1 -- 172.21.15.49:0/3731753873 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c011830 con 0x7fa67c15c0a0 2023-07-21T22:13:24.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa67a7fc700 1 -- 172.21.15.49:0/3731753873 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c011990 con 0x7fa67c15c0a0 2023-07-21T22:13:24.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa67a7fc700 1 -- 172.21.15.49:0/3731753873 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c011d20 con 0x7fa67c15c0a0 2023-07-21T22:13:24.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa681dae700 1 -- 172.21.15.49:0/3731753873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa67c15c0a0 msgr2=0x7fa67c0ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa681dae700 1 --2- 172.21.15.49:0/3731753873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa67c15c0a0 0x7fa67c0ad350 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa67c06e670 tx=0x7fa66c009b30 comp rx=0 tx=0).stop 2023-07-21T22:13:24.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa681dae700 1 -- 172.21.15.49:0/3731753873 shutdown_connections 2023-07-21T22:13:24.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa681dae700 1 --2- 172.21.15.49:0/3731753873 >> v2:172.21.15.49:3300/0 conn(0x7fa67c0ab8d0 0x7fa67c0afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa681dae700 1 --2- 172.21.15.49:0/3731753873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa67c15c0a0 0x7fa67c0ad350 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.890+0000 7fa681dae700 1 -- 172.21.15.49:0/3731753873 >> 172.21.15.49:0/3731753873 conn(0x7fa67c06f5a0 msgr2=0x7fa67c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:24.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.894+0000 7fa681dae700 1 -- 172.21.15.49:0/3731753873 shutdown_connections 2023-07-21T22:13:24.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.894+0000 7fa681dae700 1 -- 172.21.15.49:0/3731753873 wait complete. 2023-07-21T22:13:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.894+0000 7fa681dae700 1 Processor -- start 2023-07-21T22:13:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa681dae700 1 -- start start 2023-07-21T22:13:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa681dae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa67c0ab8d0 0x7fa67c153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa681dae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa67c0cb800 0x7fa67c0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa681dae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa67c15c0a0 0x7fa67c0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa681dae700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c0c7060 con 0x7fa67c0ab8d0 2023-07-21T22:13:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa681dae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c0c7340 con 0x7fa67c0cb800 2023-07-21T22:13:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa681dae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c0c7620 con 0x7fa67c15c0a0 2023-07-21T22:13:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa67b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa67c0ab8d0 0x7fa67c153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa67b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa67c0ab8d0 0x7fa67c153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50262/0 (socket says 172.21.15.49:50262) 2023-07-21T22:13:24.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa67b7fe700 1 -- 172.21.15.49:0/2778655174 learned_addr learned my addr 172.21.15.49:0/2778655174 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:24.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa67affd700 1 --2- 172.21.15.49:0/2778655174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa67c0cb800 0x7fa67c0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa67bfff700 1 --2- 172.21.15.49:0/2778655174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa67c15c0a0 0x7fa67c0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa67b7fe700 1 -- 172.21.15.49:0/2778655174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa67c15c0a0 msgr2=0x7fa67c0af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa67b7fe700 1 --2- 172.21.15.49:0/2778655174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa67c15c0a0 0x7fa67c0af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa67b7fe700 1 -- 172.21.15.49:0/2778655174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa67c0cb800 msgr2=0x7fa67c0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa67b7fe700 1 --2- 172.21.15.49:0/2778655174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa67c0cb800 0x7fa67c0aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa67b7fe700 1 -- 172.21.15.49:0/2778655174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6700094b0 con 0x7fa67c0ab8d0 2023-07-21T22:13:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.898+0000 7fa67b7fe700 1 --2- 172.21.15.49:0/2778655174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa67c0ab8d0 0x7fa67c153540 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0090b0 tx=0x7fa66c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.902+0000 7fa663fff700 1 -- 172.21.15.49:0/2778655174 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c004450 con 0x7fa67c0ab8d0 2023-07-21T22:13:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.902+0000 7fa663fff700 1 -- 172.21.15.49:0/2778655174 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c01f070 con 0x7fa67c0ab8d0 2023-07-21T22:13:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.902+0000 7fa681dae700 1 -- 172.21.15.49:0/2778655174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c0094b0 con 0x7fa67c0ab8d0 2023-07-21T22:13:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.902+0000 7fa663fff700 1 -- 172.21.15.49:0/2778655174 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c003900 con 0x7fa67c0ab8d0 2023-07-21T22:13:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.902+0000 7fa681dae700 1 -- 172.21.15.49:0/2778655174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67c0c7be0 con 0x7fa67c0ab8d0 2023-07-21T22:13:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.902+0000 7fa681dae700 1 -- 172.21.15.49:0/2778655174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67c0ac5b0 con 0x7fa67c0ab8d0 2023-07-21T22:13:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.906+0000 7fa663fff700 1 -- 172.21.15.49:0/2778655174 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa66c003a60 con 0x7fa67c0ab8d0 2023-07-21T22:13:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.906+0000 7fa663fff700 1 --2- 172.21.15.49:0/2778655174 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6680662f0 0x7fa6680687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.906+0000 7fa663fff700 1 -- 172.21.15.49:0/2778655174 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fa66c021070 con 0x7fa67c0ab8d0 2023-07-21T22:13:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.906+0000 7fa67affd700 1 --2- 172.21.15.49:0/2778655174 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6680662f0 0x7fa6680687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.906+0000 7fa67affd700 1 --2- 172.21.15.49:0/2778655174 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6680662f0 0x7fa6680687a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0ac9c0 tx=0x7fa670009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:24.910+0000 7fa663fff700 1 -- 172.21.15.49:0/2778655174 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa66c052790 con 0x7fa67c0ab8d0 2023-07-21T22:13:25.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.114+0000 7fa681dae700 1 -- 172.21.15.49:0/2778655174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa67c04dcb0 con 0x7fa67c0ab8d0 2023-07-21T22:13:25.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.118+0000 7fa663fff700 1 -- 172.21.15.49:0/2778655174 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fa66c0045d0 con 0x7fa67c0ab8d0 2023-07-21T22:13:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:25.160 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2563650108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2563650108},{"type":"v1","addr":"172.21.15.49:6835","nonce":2563650108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2639704311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2639704311},{"type":"v1","addr":"172.21.15.150:6833","nonce":2639704311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1930443415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1930443415},{"type":"v1","addr":"172.21.15.150:6835","nonce":1930443415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:12:22.057988+0000","modified":"2023-07-21T22:12:38.083444+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5631":{"gid":5631,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/3511065368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3511065368},{"type":"v1","addr":"172.21.15.49:6837","nonce":3511065368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T22:13:25.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.118+0000 7fa681dae700 1 -- 172.21.15.49:0/2778655174 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6680662f0 msgr2=0x7fa6680687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:25.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.118+0000 7fa681dae700 1 --2- 172.21.15.49:0/2778655174 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6680662f0 0x7fa6680687a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0ac9c0 tx=0x7fa670009240 comp rx=0 tx=0).stop 2023-07-21T22:13:25.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.118+0000 7fa681dae700 1 -- 172.21.15.49:0/2778655174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa67c0ab8d0 msgr2=0x7fa67c153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:25.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.118+0000 7fa681dae700 1 --2- 172.21.15.49:0/2778655174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa67c0ab8d0 0x7fa67c153540 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0090b0 tx=0x7fa66c004770 comp rx=0 tx=0).stop 2023-07-21T22:13:25.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.118+0000 7fa681dae700 1 -- 172.21.15.49:0/2778655174 shutdown_connections 2023-07-21T22:13:25.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.118+0000 7fa681dae700 1 --2- 172.21.15.49:0/2778655174 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6680662f0 0x7fa6680687a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.118+0000 7fa681dae700 1 --2- 172.21.15.49:0/2778655174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa67c15c0a0 0x7fa67c0af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.118+0000 7fa681dae700 1 --2- 172.21.15.49:0/2778655174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa67c0cb800 0x7fa67c0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.118+0000 7fa681dae700 1 --2- 172.21.15.49:0/2778655174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa67c0ab8d0 0x7fa67c153540 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.118+0000 7fa681dae700 1 -- 172.21.15.49:0/2778655174 >> 172.21.15.49:0/2778655174 conn(0x7fa67c06f5a0 msgr2=0x7fa67c15b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:25.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.122+0000 7fa681dae700 1 -- 172.21.15.49:0/2778655174 shutdown_connections 2023-07-21T22:13:25.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.122+0000 7fa681dae700 1 -- 172.21.15.49:0/2778655174 wait complete. 2023-07-21T22:13:25.166 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 18 2023-07-21T22:13:25.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:13:25.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.318+0000 7f54fb216700 1 Processor -- start 2023-07-21T22:13:25.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.318+0000 7f54fb216700 1 -- start start 2023-07-21T22:13:25.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.318+0000 7f54fb216700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54f40cf520 0x7f54f40b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:25.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.318+0000 7f54fb216700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f40b3e80 con 0x7f54f40b7af0 2023-07-21T22:13:25.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.318+0000 7f54fb216700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f415fd40 con 0x7f54f40d1e40 2023-07-21T22:13:25.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.318+0000 7f54fb216700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f40cea00 con 0x7f54f40cf520 2023-07-21T22:13:25.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.318+0000 7f54fa214700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f54f40b7af0 0x7f54f415f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53220/0 (socket says 172.21.15.49:53220) 2023-07-21T22:13:25.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.318+0000 7f54fa214700 1 -- 172.21.15.49:0/2639961229 learned_addr learned my addr 172.21.15.49:0/2639961229 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:25.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.318+0000 7f54faa15700 1 --2- 172.21.15.49:0/2639961229 >> v2:172.21.15.49:3300/0 conn(0x7f54f40cf520 0x7f54f40b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:25.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54f9212700 1 -- 172.21.15.49:0/2639961229 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118355930 0 0) 0x7f54f40b3e80 con 0x7f54f40b7af0 2023-07-21T22:13:25.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54f9212700 1 -- 172.21.15.49:0/2639961229 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54e00035d0 con 0x7f54f40b7af0 2023-07-21T22:13:25.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54faa15700 1 -- 172.21.15.49:0/2639961229 >> v1:172.21.15.150:6789/0 conn(0x7f54f40d1e40 legacy=0x7f54f40cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:25.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54f9212700 1 -- 172.21.15.49:0/2639961229 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691806001 0 0) 0x7f54f415fd40 con 0x7f54f40d1e40 2023-07-21T22:13:25.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54faa15700 1 -- 172.21.15.49:0/2639961229 >> v1:172.21.15.49:6789/0 conn(0x7f54f40b7af0 legacy=0x7f54f415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:25.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54faa15700 1 -- 172.21.15.49:0/2639961229 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f40ccbf0 con 0x7f54f40cf520 2023-07-21T22:13:25.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54faa15700 1 --2- 172.21.15.49:0/2639961229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f40cf520 0x7f54f40b1630 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009d90 tx=0x7f54ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ad77b73c68f27d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:25.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54f9212700 1 -- 172.21.15.49:0/2639961229 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec00e070 con 0x7f54f40cf520 2023-07-21T22:13:25.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54f9212700 1 -- 172.21.15.49:0/2639961229 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec00bb20 con 0x7f54f40cf520 2023-07-21T22:13:25.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54f9212700 1 -- 172.21.15.49:0/2639961229 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec00bed0 con 0x7f54f40cf520 2023-07-21T22:13:25.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54fb216700 1 -- 172.21.15.49:0/2639961229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f40cf520 msgr2=0x7f54f40b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:25.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54fb216700 1 --2- 172.21.15.49:0/2639961229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f40cf520 0x7f54f40b1630 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009d90 tx=0x7f54ec00b330 comp rx=0 tx=0).stop 2023-07-21T22:13:25.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54fb216700 1 -- 172.21.15.49:0/2639961229 shutdown_connections 2023-07-21T22:13:25.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54fb216700 1 --2- 172.21.15.49:0/2639961229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f40cf520 0x7f54f40b1630 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54fb216700 1 -- 172.21.15.49:0/2639961229 >> 172.21.15.49:0/2639961229 conn(0x7f54f406e960 msgr2=0x7f54f406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:25.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54fb216700 1 -- 172.21.15.49:0/2639961229 shutdown_connections 2023-07-21T22:13:25.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.322+0000 7f54fb216700 1 -- 172.21.15.49:0/2639961229 wait complete. 2023-07-21T22:13:25.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.326+0000 7f54fb216700 1 Processor -- start 2023-07-21T22:13:25.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.326+0000 7f54fb216700 1 -- start start 2023-07-21T22:13:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.326+0000 7f54fb216700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54f40b7af0 0x7f54f4153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:25.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.326+0000 7f54fb216700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f40cf520 0x7f54f40c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:25.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.326+0000 7f54fb216700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54f40d1e40 0x7f54f40c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:25.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.326+0000 7f54fb216700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f40c80c0 con 0x7f54f40cf520 2023-07-21T22:13:25.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.326+0000 7f54fb216700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f40c72b0 con 0x7f54f40d1e40 2023-07-21T22:13:25.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.326+0000 7f54fb216700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f40c7790 con 0x7f54f40b7af0 2023-07-21T22:13:25.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54f9a13700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f40cf520 0x7f54f40c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:25.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54f9a13700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f40cf520 0x7f54f40c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50272/0 (socket says 172.21.15.49:50272) 2023-07-21T22:13:25.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54f9a13700 1 -- 172.21.15.49:0/2405599109 learned_addr learned my addr 172.21.15.49:0/2405599109 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:25.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54fa214700 1 --2- 172.21.15.49:0/2405599109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54f40b7af0 0x7f54f4153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54faa15700 1 --2- 172.21.15.49:0/2405599109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54f40d1e40 0x7f54f40c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54f9a13700 1 -- 172.21.15.49:0/2405599109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54f40b7af0 msgr2=0x7f54f4153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54f9a13700 1 --2- 172.21.15.49:0/2405599109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54f40b7af0 0x7f54f4153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54f9a13700 1 -- 172.21.15.49:0/2405599109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54f40d1e40 msgr2=0x7f54f40c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54f9a13700 1 --2- 172.21.15.49:0/2405599109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54f40d1e40 0x7f54f40c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54f9a13700 1 -- 172.21.15.49:0/2405599109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec009a70 con 0x7f54f40cf520 2023-07-21T22:13:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54f9a13700 1 --2- 172.21.15.49:0/2405599109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f40cf520 0x7f54f40c68f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f54e400c520 tx=0x7f54e400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:25.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54eaffd700 1 -- 172.21.15.49:0/2405599109 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e40054e0 con 0x7f54f40cf520 2023-07-21T22:13:25.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54eaffd700 1 -- 172.21.15.49:0/2405599109 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e40036a0 con 0x7f54f40cf520 2023-07-21T22:13:25.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54fb216700 1 -- 172.21.15.49:0/2405599109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f40c7a70 con 0x7f54f40cf520 2023-07-21T22:13:25.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54eaffd700 1 -- 172.21.15.49:0/2405599109 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4003a50 con 0x7f54f40cf520 2023-07-21T22:13:25.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.330+0000 7f54fb216700 1 -- 172.21.15.49:0/2405599109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f40c6e30 con 0x7f54f40cf520 2023-07-21T22:13:25.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.334+0000 7f54fb216700 1 -- 172.21.15.49:0/2405599109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f404dcb0 con 0x7f54f40cf520 2023-07-21T22:13:25.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.334+0000 7f54eaffd700 1 -- 172.21.15.49:0/2405599109 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f54e4003bb0 con 0x7f54f40cf520 2023-07-21T22:13:25.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.338+0000 7f54eaffd700 1 --2- 172.21.15.49:0/2405599109 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f54d8066320 0x7f54d80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:25.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.338+0000 7f54eaffd700 1 -- 172.21.15.49:0/2405599109 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f54e4083460 con 0x7f54f40cf520 2023-07-21T22:13:25.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.338+0000 7f54fa214700 1 --2- 172.21.15.49:0/2405599109 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f54d8066320 0x7f54d80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:25.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.338+0000 7f54fa214700 1 --2- 172.21.15.49:0/2405599109 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f54d8066320 0x7f54d80687d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f54f0007fd0 tx=0x7f54f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.342+0000 7f54eaffd700 1 -- 172.21.15.49:0/2405599109 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54e4050530 con 0x7f54f40cf520 2023-07-21T22:13:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.518+0000 7f54fb216700 1 -- 172.21.15.49:0/2405599109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54f40b11e0 con 0x7f54f40cf520 2023-07-21T22:13:25.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.522+0000 7f54eaffd700 1 -- 172.21.15.49:0/2405599109 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+20391 (secure 0 0 0) 0x7f54e4003e60 con 0x7f54f40cf520 2023-07-21T22:13:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:25.566 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":49,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:13:17.333567+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:12:20.014383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T22:12:21.059436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"data_new","create_time":"2023-07-21T22:12:36.491357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.38","mappings":[{"from":0,"to":4}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:13:25.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.526+0000 7f54fb216700 1 -- 172.21.15.49:0/2405599109 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f54d8066320 msgr2=0x7f54d80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:25.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.526+0000 7f54fb216700 1 --2- 172.21.15.49:0/2405599109 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f54d8066320 0x7f54d80687d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f54f0007fd0 tx=0x7f54f0009040 comp rx=0 tx=0).stop 2023-07-21T22:13:25.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.526+0000 7f54fb216700 1 -- 172.21.15.49:0/2405599109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f40cf520 msgr2=0x7f54f40c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:25.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.526+0000 7f54fb216700 1 --2- 172.21.15.49:0/2405599109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f40cf520 0x7f54f40c68f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f54e400c520 tx=0x7f54e400c830 comp rx=0 tx=0).stop 2023-07-21T22:13:25.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.526+0000 7f54fb216700 1 -- 172.21.15.49:0/2405599109 shutdown_connections 2023-07-21T22:13:25.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.526+0000 7f54fb216700 1 --2- 172.21.15.49:0/2405599109 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f54d8066320 0x7f54d80687d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.526+0000 7f54fb216700 1 --2- 172.21.15.49:0/2405599109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f40cf520 0x7f54f40c68f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.526+0000 7f54fb216700 1 --2- 172.21.15.49:0/2405599109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54f40d1e40 0x7f54f40c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.526+0000 7f54fb216700 1 --2- 172.21.15.49:0/2405599109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54f40b7af0 0x7f54f4153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.526+0000 7f54fb216700 1 -- 172.21.15.49:0/2405599109 >> 172.21.15.49:0/2405599109 conn(0x7f54f406e960 msgr2=0x7f54f415e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:25.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.526+0000 7f54fb216700 1 -- 172.21.15.49:0/2405599109 shutdown_connections 2023-07-21T22:13:25.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.526+0000 7f54fb216700 1 -- 172.21.15.49:0/2405599109 wait complete. 2023-07-21T22:13:25.591 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:13:25.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:13:25.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.730+0000 7fcf79053700 1 Processor -- start 2023-07-21T22:13:25.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.730+0000 7fcf79053700 1 -- start start 2023-07-21T22:13:25.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.734+0000 7fcf79053700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf74158c00 0x7fcf7415d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:25.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.734+0000 7fcf79053700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf7406da70 0x7fcf7406c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:25.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.734+0000 7fcf79053700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf74158fd0 con 0x7fcf740c90d0 2023-07-21T22:13:25.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.734+0000 7fcf79053700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7406d650 con 0x7fcf7406da70 2023-07-21T22:13:25.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.734+0000 7fcf79053700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7406c9d0 con 0x7fcf74158c00 2023-07-21T22:13:25.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.734+0000 7fcf73fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf74158c00 0x7fcf7415d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:25.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.734+0000 7fcf6b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf7406da70 0x7fcf7406c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:25.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.734+0000 7fcf73fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf74158c00 0x7fcf7415d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:52068/0 (socket says 172.21.15.49:52068) 2023-07-21T22:13:25.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.734+0000 7fcf73fff700 1 -- 172.21.15.49:0/3088018378 learned_addr learned my addr 172.21.15.49:0/3088018378 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:25.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.734+0000 7fcf73fff700 1 -- 172.21.15.49:0/3088018378 >> v2:172.21.15.49:3300/0 conn(0x7fcf7406da70 msgr2=0x7fcf7406c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:25.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.734+0000 7fcf73fff700 1 --2- 172.21.15.49:0/3088018378 >> v2:172.21.15.49:3300/0 conn(0x7fcf7406da70 0x7fcf7406c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.734+0000 7fcf73fff700 1 -- 172.21.15.49:0/3088018378 >> v1:172.21.15.150:6789/0 conn(0x7fcf740c90d0 legacy=0x7fcf740c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:25.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.734+0000 7fcf73fff700 1 -- 172.21.15.49:0/3088018378 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7406ccb0 con 0x7fcf74158c00 2023-07-21T22:13:25.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.738+0000 7fcf73fff700 1 --2- 172.21.15.49:0/3088018378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf74158c00 0x7fcf7415d180 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcf7406e780 tx=0x7fcf64009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcc7447f09a9988a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:25.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.738+0000 7fcf737fe700 1 -- 172.21.15.49:0/3088018378 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64011830 con 0x7fcf74158c00 2023-07-21T22:13:25.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.738+0000 7fcf737fe700 1 -- 172.21.15.49:0/3088018378 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf64011990 con 0x7fcf74158c00 2023-07-21T22:13:25.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.738+0000 7fcf737fe700 1 -- 172.21.15.49:0/3088018378 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64011d20 con 0x7fcf74158c00 2023-07-21T22:13:25.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.738+0000 7fcf79053700 1 -- 172.21.15.49:0/3088018378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf74158c00 msgr2=0x7fcf7415d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:25.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.738+0000 7fcf79053700 1 --2- 172.21.15.49:0/3088018378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf74158c00 0x7fcf7415d180 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcf7406e780 tx=0x7fcf64009bf0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.738+0000 7fcf79053700 1 -- 172.21.15.49:0/3088018378 shutdown_connections 2023-07-21T22:13:25.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.738+0000 7fcf79053700 1 --2- 172.21.15.49:0/3088018378 >> v2:172.21.15.49:3300/0 conn(0x7fcf7406da70 0x7fcf7406c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.738+0000 7fcf79053700 1 --2- 172.21.15.49:0/3088018378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf74158c00 0x7fcf7415d180 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.738+0000 7fcf79053700 1 -- 172.21.15.49:0/3088018378 >> 172.21.15.49:0/3088018378 conn(0x7fcf74070450 msgr2=0x7fcf74070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:25.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.738+0000 7fcf79053700 1 -- 172.21.15.49:0/3088018378 shutdown_connections 2023-07-21T22:13:25.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.738+0000 7fcf79053700 1 -- 172.21.15.49:0/3088018378 wait complete. 2023-07-21T22:13:25.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.742+0000 7fcf79053700 1 Processor -- start 2023-07-21T22:13:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.742+0000 7fcf79053700 1 -- start start 2023-07-21T22:13:25.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.742+0000 7fcf79053700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf7406da70 0x7fcf740b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:25.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.742+0000 7fcf79053700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf740c90d0 0x7fcf740b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:25.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.742+0000 7fcf79053700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf74158c00 0x7fcf740c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:25.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.742+0000 7fcf79053700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74149fa0 con 0x7fcf74158c00 2023-07-21T22:13:25.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.742+0000 7fcf79053700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf740b3e10 con 0x7fcf7406da70 2023-07-21T22:13:25.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.742+0000 7fcf79053700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7414a480 con 0x7fcf740c90d0 2023-07-21T22:13:25.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.742+0000 7fcf78852700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf74158c00 0x7fcf740c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:25.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.742+0000 7fcf78852700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf74158c00 0x7fcf740c1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50288/0 (socket says 172.21.15.49:50288) 2023-07-21T22:13:25.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.742+0000 7fcf78852700 1 -- 172.21.15.49:0/2402591978 learned_addr learned my addr 172.21.15.49:0/2402591978 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.742+0000 7fcf6b7fe700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf740c90d0 0x7fcf740b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.742+0000 7fcf73fff700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf7406da70 0x7fcf740b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.746+0000 7fcf78852700 1 -- 172.21.15.49:0/2402591978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf740c90d0 msgr2=0x7fcf740b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.746+0000 7fcf78852700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf740c90d0 0x7fcf740b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.746+0000 7fcf78852700 1 -- 172.21.15.49:0/2402591978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf7406da70 msgr2=0x7fcf740b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.746+0000 7fcf78852700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf7406da70 0x7fcf740b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.746+0000 7fcf78852700 1 -- 172.21.15.49:0/2402591978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf64009570 con 0x7fcf74158c00 2023-07-21T22:13:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.746+0000 7fcf73fff700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf7406da70 0x7fcf740b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.746+0000 7fcf78852700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf74158c00 0x7fcf740c1ba0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00c430 tx=0x7fcf6c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.746+0000 7fcf717fa700 1 -- 172.21.15.49:0/2402591978 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0052d0 con 0x7fcf74158c00 2023-07-21T22:13:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.746+0000 7fcf717fa700 1 -- 172.21.15.49:0/2402591978 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c00ce90 con 0x7fcf74158c00 2023-07-21T22:13:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.746+0000 7fcf79053700 1 -- 172.21.15.49:0/2402591978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf740b0ea0 con 0x7fcf74158c00 2023-07-21T22:13:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.746+0000 7fcf717fa700 1 -- 172.21.15.49:0/2402591978 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0036a0 con 0x7fcf74158c00 2023-07-21T22:13:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.746+0000 7fcf79053700 1 -- 172.21.15.49:0/2402591978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7414f740 con 0x7fcf74158c00 2023-07-21T22:13:25.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.746+0000 7fcf79053700 1 -- 172.21.15.49:0/2402591978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7404dcb0 con 0x7fcf74158c00 2023-07-21T22:13:25.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.750+0000 7fcf717fa700 1 -- 172.21.15.49:0/2402591978 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf6c003800 con 0x7fcf74158c00 2023-07-21T22:13:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.750+0000 7fcf717fa700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcf540662f0 0x7fcf540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:25.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.754+0000 7fcf717fa700 1 -- 172.21.15.49:0/2402591978 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fcf6c083310 con 0x7fcf74158c00 2023-07-21T22:13:25.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.754+0000 7fcf73fff700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcf540662f0 0x7fcf540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:25.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.754+0000 7fcf73fff700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcf540662f0 0x7fcf540687a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcf64000c00 tx=0x7fcf64008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:25.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.758+0000 7fcf717fa700 1 -- 172.21.15.49:0/2402591978 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf6c050480 con 0x7fcf74158c00 2023-07-21T22:13:26.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.974+0000 7fcf79053700 1 -- 172.21.15.49:0/2402591978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf740b1030 con 0x7fcf74158c00 2023-07-21T22:13:26.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.978+0000 7fcf717fa700 1 -- 172.21.15.49:0/2402591978 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fcf6c053aa0 con 0x7fcf74158c00 2023-07-21T22:13:26.021 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:26.021 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2563650108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2563650108},{"type":"v1","addr":"172.21.15.49:6835","nonce":2563650108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2639704311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2639704311},{"type":"v1","addr":"172.21.15.150:6833","nonce":2639704311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1930443415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1930443415},{"type":"v1","addr":"172.21.15.150:6835","nonce":1930443415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:12:22.057988+0000","modified":"2023-07-21T22:12:38.083444+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5631":{"gid":5631,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/3511065368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3511065368},{"type":"v1","addr":"172.21.15.49:6837","nonce":3511065368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T22:13:26.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.982+0000 7fcf79053700 1 -- 172.21.15.49:0/2402591978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcf540662f0 msgr2=0x7fcf540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:26.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.982+0000 7fcf79053700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcf540662f0 0x7fcf540687a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcf64000c00 tx=0x7fcf64008030 comp rx=0 tx=0).stop 2023-07-21T22:13:26.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.982+0000 7fcf79053700 1 -- 172.21.15.49:0/2402591978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf74158c00 msgr2=0x7fcf740c1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:26.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.982+0000 7fcf79053700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf74158c00 0x7fcf740c1ba0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00c430 tx=0x7fcf6c00c740 comp rx=0 tx=0).stop 2023-07-21T22:13:26.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.982+0000 7fcf79053700 1 -- 172.21.15.49:0/2402591978 shutdown_connections 2023-07-21T22:13:26.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.982+0000 7fcf79053700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcf540662f0 0x7fcf540687a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.982+0000 7fcf79053700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf74158c00 0x7fcf740c1ba0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.982+0000 7fcf79053700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf740c90d0 0x7fcf740b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.982+0000 7fcf79053700 1 --2- 172.21.15.49:0/2402591978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf7406da70 0x7fcf740b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.982+0000 7fcf79053700 1 -- 172.21.15.49:0/2402591978 >> 172.21.15.49:0/2402591978 conn(0x7fcf74070450 msgr2=0x7fcf74150650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.982+0000 7fcf79053700 1 -- 172.21.15.49:0/2402591978 shutdown_connections 2023-07-21T22:13:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:25.982+0000 7fcf79053700 1 -- 172.21.15.49:0/2402591978 wait complete. 2023-07-21T22:13:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 18 2023-07-21T22:13:26.049 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:13:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.190+0000 7f3442503700 1 Processor -- start 2023-07-21T22:13:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.190+0000 7f3442503700 1 -- start start 2023-07-21T22:13:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.190+0000 7f3442503700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f343c0c1470 0x7f343c0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:26.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.190+0000 7f3442503700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f343c0ca2c0 0x7f343c163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:26.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.190+0000 7f3442503700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c06e010 con 0x7f343c160370 2023-07-21T22:13:26.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.190+0000 7f3442503700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343c160740 con 0x7f343c0c1470 2023-07-21T22:13:26.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.190+0000 7f3442503700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343c0ccc50 con 0x7f343c0ca2c0 2023-07-21T22:13:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.190+0000 7f3440d00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f343c0c1470 0x7f343c0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3440d00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f343c0c1470 0x7f343c0c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50292/0 (socket says 172.21.15.49:50292) 2023-07-21T22:13:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3440d00700 1 -- 172.21.15.49:0/863290641 learned_addr learned my addr 172.21.15.49:0/863290641 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3441501700 1 --1- 172.21.15.49:0/863290641 >> v1:172.21.15.150:6789/0 conn(0x7f343c160370 0x7f343c06d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:60244/0 (socket says 172.21.15.49:60244) 2023-07-21T22:13:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3441d02700 1 --2- 172.21.15.49:0/863290641 >> v2:172.21.15.150:3300/0 conn(0x7f343c0ca2c0 0x7f343c163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3440d00700 1 -- 172.21.15.49:0/863290641 >> v2:172.21.15.150:3300/0 conn(0x7f343c0ca2c0 msgr2=0x7f343c163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3440d00700 1 --2- 172.21.15.49:0/863290641 >> v2:172.21.15.150:3300/0 conn(0x7f343c0ca2c0 0x7f343c163ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3440d00700 1 -- 172.21.15.49:0/863290641 >> v1:172.21.15.150:6789/0 conn(0x7f343c160370 legacy=0x7f343c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3440d00700 1 -- 172.21.15.49:0/863290641 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c0afc90 con 0x7f343c0c1470 2023-07-21T22:13:26.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3441d02700 1 --2- 172.21.15.49:0/863290641 >> v2:172.21.15.150:3300/0 conn(0x7f343c0ca2c0 0x7f343c163ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:26.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3440d00700 1 --2- 172.21.15.49:0/863290641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0c1470 0x7f343c0c9d80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f343c06bc50 tx=0x7f342c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b2536b4e3c8bff server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:26.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3433fff700 1 -- 172.21.15.49:0/863290641 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c00b8a0 con 0x7f343c0c1470 2023-07-21T22:13:26.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3433fff700 1 -- 172.21.15.49:0/863290641 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c00ba00 con 0x7f343c0c1470 2023-07-21T22:13:26.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3433fff700 1 -- 172.21.15.49:0/863290641 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c00bd90 con 0x7f343c0c1470 2023-07-21T22:13:26.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3442503700 1 -- 172.21.15.49:0/863290641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0c1470 msgr2=0x7f343c0c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:26.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3442503700 1 --2- 172.21.15.49:0/863290641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0c1470 0x7f343c0c9d80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f343c06bc50 tx=0x7f342c009bf0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3442503700 1 -- 172.21.15.49:0/863290641 shutdown_connections 2023-07-21T22:13:26.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3442503700 1 --2- 172.21.15.49:0/863290641 >> v2:172.21.15.150:3300/0 conn(0x7f343c0ca2c0 0x7f343c163ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3442503700 1 --2- 172.21.15.49:0/863290641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0c1470 0x7f343c0c9d80 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3442503700 1 -- 172.21.15.49:0/863290641 >> 172.21.15.49:0/863290641 conn(0x7f343c070450 msgr2=0x7f343c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:26.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3442503700 1 -- 172.21.15.49:0/863290641 shutdown_connections 2023-07-21T22:13:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.194+0000 7f3442503700 1 -- 172.21.15.49:0/863290641 wait complete. 2023-07-21T22:13:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.198+0000 7f3442503700 1 Processor -- start 2023-07-21T22:13:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.198+0000 7f3442503700 1 -- start start 2023-07-21T22:13:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.198+0000 7f3442503700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f343c0c1470 0x7f343c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.198+0000 7f3442503700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0ca2c0 0x7f343c06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.198+0000 7f3442503700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f343c160370 0x7f343c06cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.198+0000 7f3442503700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c0b17d0 con 0x7f343c0ca2c0 2023-07-21T22:13:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.198+0000 7f3442503700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c15aa00 con 0x7f343c160370 2023-07-21T22:13:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.198+0000 7f3442503700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c0b34b0 con 0x7f343c0c1470 2023-07-21T22:13:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.198+0000 7f3440d00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0ca2c0 0x7f343c06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.198+0000 7f3440d00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0ca2c0 0x7f343c06c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50298/0 (socket says 172.21.15.49:50298) 2023-07-21T22:13:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.198+0000 7f3440d00700 1 -- 172.21.15.49:0/301321733 learned_addr learned my addr 172.21.15.49:0/301321733 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.198+0000 7f3441501700 1 --2- 172.21.15.49:0/301321733 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f343c0c1470 0x7f343c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.202+0000 7f3441d02700 1 --2- 172.21.15.49:0/301321733 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f343c160370 0x7f343c06cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.202+0000 7f3440d00700 1 -- 172.21.15.49:0/301321733 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f343c0c1470 msgr2=0x7f343c159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.202+0000 7f3440d00700 1 --2- 172.21.15.49:0/301321733 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f343c0c1470 0x7f343c159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.202+0000 7f3440d00700 1 -- 172.21.15.49:0/301321733 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f343c160370 msgr2=0x7f343c06cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.202+0000 7f3440d00700 1 --2- 172.21.15.49:0/301321733 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f343c160370 0x7f343c06cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.202+0000 7f3440d00700 1 -- 172.21.15.49:0/301321733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c009570 con 0x7f343c0ca2c0 2023-07-21T22:13:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.202+0000 7f3440d00700 1 --2- 172.21.15.49:0/301321733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0ca2c0 0x7f343c06c6b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f342c00b0e0 tx=0x7f342c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.202+0000 7f3431ffb700 1 -- 172.21.15.49:0/301321733 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c0038c0 con 0x7f343c0ca2c0 2023-07-21T22:13:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.202+0000 7f3431ffb700 1 -- 172.21.15.49:0/301321733 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c01f070 con 0x7f343c0ca2c0 2023-07-21T22:13:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.202+0000 7f3442503700 1 -- 172.21.15.49:0/301321733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c0b0ea0 con 0x7f343c0ca2c0 2023-07-21T22:13:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.202+0000 7f3431ffb700 1 -- 172.21.15.49:0/301321733 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c003c60 con 0x7f343c0ca2c0 2023-07-21T22:13:26.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.202+0000 7f3442503700 1 -- 172.21.15.49:0/301321733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343c0b1460 con 0x7f343c0ca2c0 2023-07-21T22:13:26.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.202+0000 7f3442503700 1 -- 172.21.15.49:0/301321733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343c0b1980 con 0x7f343c0ca2c0 2023-07-21T22:13:26.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.206+0000 7f3431ffb700 1 -- 172.21.15.49:0/301321733 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f342c026480 con 0x7f343c0ca2c0 2023-07-21T22:13:26.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.206+0000 7f3431ffb700 1 --2- 172.21.15.49:0/301321733 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f34200662f0 0x7f34200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:26.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.206+0000 7f3431ffb700 1 -- 172.21.15.49:0/301321733 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f342c021070 con 0x7f343c0ca2c0 2023-07-21T22:13:26.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.206+0000 7f3441501700 1 --2- 172.21.15.49:0/301321733 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f34200662f0 0x7f34200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:26.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.210+0000 7f3441501700 1 --2- 172.21.15.49:0/301321733 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f34200662f0 0x7f34200687a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3438000f60 tx=0x7f3438007d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:26.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.210+0000 7f3431ffb700 1 -- 172.21.15.49:0/301321733 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f342c052d60 con 0x7f343c0ca2c0 2023-07-21T22:13:26.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.422+0000 7f3442503700 1 -- 172.21.15.49:0/301321733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f343c04dcb0 con 0x7f343c0ca2c0 2023-07-21T22:13:26.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.426+0000 7f3431ffb700 1 -- 172.21.15.49:0/301321733 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f342c056380 con 0x7f343c0ca2c0 2023-07-21T22:13:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:26.468 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2563650108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2563650108},{"type":"v1","addr":"172.21.15.49:6835","nonce":2563650108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2639704311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2639704311},{"type":"v1","addr":"172.21.15.150:6833","nonce":2639704311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1930443415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1930443415},{"type":"v1","addr":"172.21.15.150:6835","nonce":1930443415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:12:22.057988+0000","modified":"2023-07-21T22:12:38.083444+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5631":{"gid":5631,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/3511065368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3511065368},{"type":"v1","addr":"172.21.15.49:6837","nonce":3511065368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T22:13:26.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.426+0000 7f3442503700 1 -- 172.21.15.49:0/301321733 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f34200662f0 msgr2=0x7f34200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:26.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.426+0000 7f3442503700 1 --2- 172.21.15.49:0/301321733 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f34200662f0 0x7f34200687a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3438000f60 tx=0x7f3438007d90 comp rx=0 tx=0).stop 2023-07-21T22:13:26.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.426+0000 7f3442503700 1 -- 172.21.15.49:0/301321733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0ca2c0 msgr2=0x7f343c06c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:26.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.426+0000 7f3442503700 1 --2- 172.21.15.49:0/301321733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0ca2c0 0x7f343c06c6b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f342c00b0e0 tx=0x7f342c004770 comp rx=0 tx=0).stop 2023-07-21T22:13:26.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.426+0000 7f3442503700 1 -- 172.21.15.49:0/301321733 shutdown_connections 2023-07-21T22:13:26.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.426+0000 7f3442503700 1 --2- 172.21.15.49:0/301321733 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f34200662f0 0x7f34200687a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.426+0000 7f3442503700 1 --2- 172.21.15.49:0/301321733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0ca2c0 0x7f343c06c6b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.426+0000 7f3442503700 1 --2- 172.21.15.49:0/301321733 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f343c160370 0x7f343c06cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.426+0000 7f3442503700 1 --2- 172.21.15.49:0/301321733 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f343c0c1470 0x7f343c159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.426+0000 7f3442503700 1 -- 172.21.15.49:0/301321733 >> 172.21.15.49:0/301321733 conn(0x7f343c070450 msgr2=0x7f343c162890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:26.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.426+0000 7f3442503700 1 -- 172.21.15.49:0/301321733 shutdown_connections 2023-07-21T22:13:26.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.426+0000 7f3442503700 1 -- 172.21.15.49:0/301321733 wait complete. 2023-07-21T22:13:26.473 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 18 2023-07-21T22:13:26.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:13:26.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.626+0000 7eff48cf2700 1 Processor -- start 2023-07-21T22:13:26.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.626+0000 7eff48cf2700 1 -- start start 2023-07-21T22:13:26.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff48cf2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff441582f0 0x7eff440cb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:26.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff48cf2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff440c8dd0 0x7eff440ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:26.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff48cf2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff441586c0 con 0x7eff4415c870 2023-07-21T22:13:26.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff48cf2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff440cbad0 con 0x7eff440c8dd0 2023-07-21T22:13:26.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff48cf2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4415cd50 con 0x7eff441582f0 2023-07-21T22:13:26.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff43fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff440c8dd0 0x7eff440ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:26.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff437fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff441582f0 0x7eff440cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:26.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff437fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff441582f0 0x7eff440cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:52086/0 (socket says 172.21.15.49:52086) 2023-07-21T22:13:26.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff437fe700 1 -- 172.21.15.49:0/2630633272 learned_addr learned my addr 172.21.15.49:0/2630633272 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:26.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff3affd700 1 --1- 172.21.15.49:0/2630633272 >> v1:172.21.15.150:6789/0 conn(0x7eff4415c870 0x7eff440c86c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:60254/0 (socket says 172.21.15.49:60254) 2023-07-21T22:13:26.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff437fe700 1 -- 172.21.15.49:0/2630633272 >> v2:172.21.15.49:3300/0 conn(0x7eff440c8dd0 msgr2=0x7eff440ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:26.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff437fe700 1 --2- 172.21.15.49:0/2630633272 >> v2:172.21.15.49:3300/0 conn(0x7eff440c8dd0 0x7eff440ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff437fe700 1 -- 172.21.15.49:0/2630633272 >> v1:172.21.15.150:6789/0 conn(0x7eff4415c870 legacy=0x7eff440c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:26.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff437fe700 1 -- 172.21.15.49:0/2630633272 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff440cbce0 con 0x7eff441582f0 2023-07-21T22:13:26.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.630+0000 7eff42ffd700 1 -- 172.21.15.49:0/2630633272 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293057477 0 0) 0x7eff441586c0 con 0x7eff4415c870 2023-07-21T22:13:26.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.634+0000 7eff437fe700 1 --2- 172.21.15.49:0/2630633272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff441582f0 0x7eff440cb590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7eff4406b3f0 tx=0x7eff3400be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb974c35c5bec949 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:26.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.634+0000 7eff42ffd700 1 -- 172.21.15.49:0/2630633272 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3400dd30 con 0x7eff441582f0 2023-07-21T22:13:26.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.634+0000 7eff42ffd700 1 -- 172.21.15.49:0/2630633272 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3400de90 con 0x7eff441582f0 2023-07-21T22:13:26.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.634+0000 7eff42ffd700 1 -- 172.21.15.49:0/2630633272 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34010690 con 0x7eff441582f0 2023-07-21T22:13:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.634+0000 7eff48cf2700 1 -- 172.21.15.49:0/2630633272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff441582f0 msgr2=0x7eff440cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.634+0000 7eff48cf2700 1 --2- 172.21.15.49:0/2630633272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff441582f0 0x7eff440cb590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7eff4406b3f0 tx=0x7eff3400be90 comp rx=0 tx=0).stop 2023-07-21T22:13:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.634+0000 7eff48cf2700 1 -- 172.21.15.49:0/2630633272 shutdown_connections 2023-07-21T22:13:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.634+0000 7eff48cf2700 1 --2- 172.21.15.49:0/2630633272 >> v2:172.21.15.49:3300/0 conn(0x7eff440c8dd0 0x7eff440ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.634+0000 7eff48cf2700 1 --2- 172.21.15.49:0/2630633272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff441582f0 0x7eff440cb590 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.634+0000 7eff48cf2700 1 -- 172.21.15.49:0/2630633272 >> 172.21.15.49:0/2630633272 conn(0x7eff44070450 msgr2=0x7eff44070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.634+0000 7eff48cf2700 1 -- 172.21.15.49:0/2630633272 shutdown_connections 2023-07-21T22:13:26.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.634+0000 7eff48cf2700 1 -- 172.21.15.49:0/2630633272 wait complete. 2023-07-21T22:13:26.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.638+0000 7eff48cf2700 1 Processor -- start 2023-07-21T22:13:26.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.638+0000 7eff48cf2700 1 -- start start 2023-07-21T22:13:26.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff48cf2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff440c8dd0 0x7eff44147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:26.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff48cf2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff441582f0 0x7eff440c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:26.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff48cf2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff4415c870 0x7eff4415bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:26.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff48cf2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff44147a70 con 0x7eff440c8dd0 2023-07-21T22:13:26.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff48cf2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff440c5140 con 0x7eff441582f0 2023-07-21T22:13:26.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff48cf2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff440c4060 con 0x7eff4415c870 2023-07-21T22:13:26.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff440c8dd0 0x7eff44147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:26.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff440c8dd0 0x7eff44147530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50330/0 (socket says 172.21.15.49:50330) 2023-07-21T22:13:26.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff437fe700 1 -- 172.21.15.49:0/3803992642 learned_addr learned my addr 172.21.15.49:0/3803992642 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:26.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff3affd700 1 --2- 172.21.15.49:0/3803992642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff441582f0 0x7eff440c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:26.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff43fff700 1 --2- 172.21.15.49:0/3803992642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff4415c870 0x7eff4415bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:26.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff437fe700 1 -- 172.21.15.49:0/3803992642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff4415c870 msgr2=0x7eff4415bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:26.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff437fe700 1 --2- 172.21.15.49:0/3803992642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff4415c870 0x7eff4415bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff437fe700 1 -- 172.21.15.49:0/3803992642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff441582f0 msgr2=0x7eff440c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:26.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff437fe700 1 --2- 172.21.15.49:0/3803992642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff441582f0 0x7eff440c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff437fe700 1 -- 172.21.15.49:0/3803992642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3400b810 con 0x7eff440c8dd0 2023-07-21T22:13:26.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff437fe700 1 --2- 172.21.15.49:0/3803992642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff440c8dd0 0x7eff44147530 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7eff34000c00 tx=0x7eff34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:26.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff40ff9700 1 -- 172.21.15.49:0/3803992642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34003c10 con 0x7eff440c8dd0 2023-07-21T22:13:26.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff40ff9700 1 -- 172.21.15.49:0/3803992642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff34003d70 con 0x7eff440c8dd0 2023-07-21T22:13:26.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff40ff9700 1 -- 172.21.15.49:0/3803992642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34010690 con 0x7eff440c8dd0 2023-07-21T22:13:26.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff48cf2700 1 -- 172.21.15.49:0/3803992642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff440c4340 con 0x7eff440c8dd0 2023-07-21T22:13:26.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.642+0000 7eff48cf2700 1 -- 172.21.15.49:0/3803992642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff440c4900 con 0x7eff440c8dd0 2023-07-21T22:13:26.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.646+0000 7eff48cf2700 1 -- 172.21.15.49:0/3803992642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff440c4b20 con 0x7eff440c8dd0 2023-07-21T22:13:26.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.646+0000 7eff40ff9700 1 -- 172.21.15.49:0/3803992642 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7eff3402c440 con 0x7eff440c8dd0 2023-07-21T22:13:26.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.650+0000 7eff40ff9700 1 --2- 172.21.15.49:0/3803992642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7eff240662f0 0x7eff240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:26.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.650+0000 7eff40ff9700 1 -- 172.21.15.49:0/3803992642 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6835+0+0 (secure 0 0 0) 0x7eff340856a0 con 0x7eff440c8dd0 2023-07-21T22:13:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.650+0000 7eff3affd700 1 --2- 172.21.15.49:0/3803992642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7eff240662f0 0x7eff240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.650+0000 7eff3affd700 1 --2- 172.21.15.49:0/3803992642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7eff240662f0 0x7eff240687a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7eff440c8970 tx=0x7eff2c001b70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.654+0000 7eff40ff9700 1 -- 172.21.15.49:0/3803992642 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff340528a0 con 0x7eff440c8dd0 2023-07-21T22:13:26.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.826+0000 7eff48cf2700 1 -- 172.21.15.49:0/3803992642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff440c52b0 con 0x7eff440c8dd0 2023-07-21T22:13:26.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.826+0000 7eff40ff9700 1 -- 172.21.15.49:0/3803992642 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+20391 (secure 0 0 0) 0x7eff3402a310 con 0x7eff440c8dd0 2023-07-21T22:13:26.871 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:26.872 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":49,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:13:17.333567+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:12:20.014383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T22:12:21.059436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"data_new","create_time":"2023-07-21T22:12:36.491357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.38","mappings":[{"from":0,"to":4}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:13:26.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.830+0000 7eff48cf2700 1 -- 172.21.15.49:0/3803992642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7eff240662f0 msgr2=0x7eff240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:26.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.830+0000 7eff48cf2700 1 --2- 172.21.15.49:0/3803992642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7eff240662f0 0x7eff240687a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7eff440c8970 tx=0x7eff2c001b70 comp rx=0 tx=0).stop 2023-07-21T22:13:26.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.830+0000 7eff48cf2700 1 -- 172.21.15.49:0/3803992642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff440c8dd0 msgr2=0x7eff44147530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:26.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.830+0000 7eff48cf2700 1 --2- 172.21.15.49:0/3803992642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff440c8dd0 0x7eff44147530 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7eff34000c00 tx=0x7eff34004770 comp rx=0 tx=0).stop 2023-07-21T22:13:26.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.830+0000 7eff48cf2700 1 -- 172.21.15.49:0/3803992642 shutdown_connections 2023-07-21T22:13:26.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.830+0000 7eff48cf2700 1 --2- 172.21.15.49:0/3803992642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7eff240662f0 0x7eff240687a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.830+0000 7eff48cf2700 1 --2- 172.21.15.49:0/3803992642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff4415c870 0x7eff4415bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.830+0000 7eff48cf2700 1 --2- 172.21.15.49:0/3803992642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff441582f0 0x7eff440c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.830+0000 7eff48cf2700 1 --2- 172.21.15.49:0/3803992642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff440c8dd0 0x7eff44147530 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:26.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.830+0000 7eff48cf2700 1 -- 172.21.15.49:0/3803992642 >> 172.21.15.49:0/3803992642 conn(0x7eff44070450 msgr2=0x7eff440cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:26.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.830+0000 7eff48cf2700 1 -- 172.21.15.49:0/3803992642 shutdown_connections 2023-07-21T22:13:26.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:26.830+0000 7eff48cf2700 1 -- 172.21.15.49:0/3803992642 wait complete. 2023-07-21T22:13:26.896 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T22:13:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.030+0000 7f52dca24700 1 Processor -- start 2023-07-21T22:13:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.030+0000 7f52dca24700 1 -- start start 2023-07-21T22:13:27.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.030+0000 7f52dca24700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52d806d380 0x7f52d806d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:27.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.030+0000 7f52dca24700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f52d8071c70 0x7f52d80b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:27.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.030+0000 7f52dca24700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d80cab20 con 0x7f52d80b1400 2023-07-21T22:13:27.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.030+0000 7f52dca24700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d80c9e80 con 0x7f52d8071c70 2023-07-21T22:13:27.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.030+0000 7f52dca24700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80afeb0 con 0x7f52d806d380 2023-07-21T22:13:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d659c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f52d8071c70 0x7f52d80b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d6d9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52d806d380 0x7f52d806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d759e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f52d80b1400 0x7f52d80cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:60262/0 (socket says 172.21.15.49:60262) 2023-07-21T22:13:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d759e700 1 -- 172.21.15.49:0/333164147 learned_addr learned my addr 172.21.15.49:0/333164147 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d5d9b700 1 -- 172.21.15.49:0/333164147 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394099202 0 0) 0x7f52d80cab20 con 0x7f52d80b1400 2023-07-21T22:13:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d5d9b700 1 -- 172.21.15.49:0/333164147 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c00035d0 con 0x7f52d80b1400 2023-07-21T22:13:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d6d9d700 1 -- 172.21.15.49:0/333164147 >> v2:172.21.15.150:3300/0 conn(0x7f52d8071c70 msgr2=0x7f52d80b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:27.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d6d9d700 1 --2- 172.21.15.49:0/333164147 >> v2:172.21.15.150:3300/0 conn(0x7f52d8071c70 0x7f52d80b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:27.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d6d9d700 1 -- 172.21.15.49:0/333164147 >> v1:172.21.15.150:6789/0 conn(0x7f52d80b1400 legacy=0x7f52d80cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:27.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d6d9d700 1 -- 172.21.15.49:0/333164147 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d806dc90 con 0x7f52d806d380 2023-07-21T22:13:27.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d659c700 1 --2- 172.21.15.49:0/333164147 >> v2:172.21.15.150:3300/0 conn(0x7f52d8071c70 0x7f52d80b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d6d9d700 1 --2- 172.21.15.49:0/333164147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52d806d380 0x7f52d806d750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009850 tx=0x7f52c8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b356a6432e28c1d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d5d9b700 1 -- 172.21.15.49:0/333164147 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8011830 con 0x7f52d806d380 2023-07-21T22:13:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d5d9b700 1 -- 172.21.15.49:0/333164147 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c8011990 con 0x7f52d806d380 2023-07-21T22:13:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.034+0000 7f52d5d9b700 1 -- 172.21.15.49:0/333164147 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8011d40 con 0x7f52d806d380 2023-07-21T22:13:27.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.038+0000 7f52dca24700 1 -- 172.21.15.49:0/333164147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52d806d380 msgr2=0x7f52d806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:27.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.038+0000 7f52dca24700 1 --2- 172.21.15.49:0/333164147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52d806d380 0x7f52d806d750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009850 tx=0x7f52c8009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:27.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.038+0000 7f52dca24700 1 -- 172.21.15.49:0/333164147 shutdown_connections 2023-07-21T22:13:27.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.038+0000 7f52dca24700 1 --2- 172.21.15.49:0/333164147 >> v2:172.21.15.150:3300/0 conn(0x7f52d8071c70 0x7f52d80b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:27.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.038+0000 7f52dca24700 1 --2- 172.21.15.49:0/333164147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52d806d380 0x7f52d806d750 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:27.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.038+0000 7f52dca24700 1 -- 172.21.15.49:0/333164147 >> 172.21.15.49:0/333164147 conn(0x7f52d8070450 msgr2=0x7f52d8070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:27.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.038+0000 7f52dca24700 1 -- 172.21.15.49:0/333164147 shutdown_connections 2023-07-21T22:13:27.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.038+0000 7f52dca24700 1 -- 172.21.15.49:0/333164147 wait complete. 2023-07-21T22:13:27.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.038+0000 7f52dca24700 1 Processor -- start 2023-07-21T22:13:27.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52dca24700 1 -- start start 2023-07-21T22:13:27.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52dca24700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52d806d380 0x7f52d8153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:27.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52dca24700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52d8071c70 0x7f52d80c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:27.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52dca24700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52d80b1400 0x7f52d80b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:27.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52dca24700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80c44f0 con 0x7f52d8071c70 2023-07-21T22:13:27.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52dca24700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d81f48f0 con 0x7f52d806d380 2023-07-21T22:13:27.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52dca24700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80c3360 con 0x7f52d80b1400 2023-07-21T22:13:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52d659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52d8071c70 0x7f52d80c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52d659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52d8071c70 0x7f52d80c2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50334/0 (socket says 172.21.15.49:50334) 2023-07-21T22:13:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52d659c700 1 -- 172.21.15.49:0/700315623 learned_addr learned my addr 172.21.15.49:0/700315623 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52d6d9d700 1 --2- 172.21.15.49:0/700315623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52d806d380 0x7f52d8153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52d759e700 1 --2- 172.21.15.49:0/700315623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52d80b1400 0x7f52d80b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52d659c700 1 -- 172.21.15.49:0/700315623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52d80b1400 msgr2=0x7f52d80b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52d659c700 1 --2- 172.21.15.49:0/700315623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52d80b1400 0x7f52d80b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52d659c700 1 -- 172.21.15.49:0/700315623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52d806d380 msgr2=0x7f52d8153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52d659c700 1 --2- 172.21.15.49:0/700315623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52d806d380 0x7f52d8153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52d659c700 1 -- 172.21.15.49:0/700315623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc0094b0 con 0x7f52d8071c70 2023-07-21T22:13:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.042+0000 7f52d659c700 1 --2- 172.21.15.49:0/700315623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52d8071c70 0x7f52d80c2980 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00ec10 tx=0x7f52cc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.046+0000 7f52bf7fe700 1 -- 172.21.15.49:0/700315623 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00c850 con 0x7f52d8071c70 2023-07-21T22:13:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.046+0000 7f52bf7fe700 1 -- 172.21.15.49:0/700315623 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc00c9b0 con 0x7f52d8071c70 2023-07-21T22:13:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.046+0000 7f52bf7fe700 1 -- 172.21.15.49:0/700315623 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00cd40 con 0x7f52d8071c70 2023-07-21T22:13:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.046+0000 7f52dca24700 1 -- 172.21.15.49:0/700315623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c80094b0 con 0x7f52d8071c70 2023-07-21T22:13:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.046+0000 7f52dca24700 1 -- 172.21.15.49:0/700315623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d81f4e20 con 0x7f52d8071c70 2023-07-21T22:13:27.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.046+0000 7f52dca24700 1 -- 172.21.15.49:0/700315623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d804dcb0 con 0x7f52d8071c70 2023-07-21T22:13:27.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.046+0000 7f52bf7fe700 1 -- 172.21.15.49:0/700315623 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52cc013470 con 0x7f52d8071c70 2023-07-21T22:13:27.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.050+0000 7f52bf7fe700 1 --2- 172.21.15.49:0/700315623 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f52c40662f0 0x7f52c40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:27.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.050+0000 7f52bf7fe700 1 -- 172.21.15.49:0/700315623 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f52cc084100 con 0x7f52d8071c70 2023-07-21T22:13:27.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.050+0000 7f52d6d9d700 1 --2- 172.21.15.49:0/700315623 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f52c40662f0 0x7f52c40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:27.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.050+0000 7f52d6d9d700 1 --2- 172.21.15.49:0/700315623 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f52c40662f0 0x7f52c40687a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f52c80090b0 tx=0x7f52c8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:27.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.054+0000 7f52bf7fe700 1 -- 172.21.15.49:0/700315623 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52cc0511f0 con 0x7f52d8071c70 2023-07-21T22:13:27.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.266+0000 7f52dca24700 1 -- 172.21.15.49:0/700315623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f52d80b3ff0 con 0x7f52d8071c70 2023-07-21T22:13:27.309 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-07-21T22:13:27.266+0000 7fcc7a5f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T22:13:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.278+0000 7f52bf7fe700 1 -- 172.21.15.49:0/700315623 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f52cc00cea0 con 0x7f52d8071c70 2023-07-21T22:13:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.282+0000 7f52dca24700 1 -- 172.21.15.49:0/700315623 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f52c40662f0 msgr2=0x7f52c40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.282+0000 7f52dca24700 1 --2- 172.21.15.49:0/700315623 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f52c40662f0 0x7f52c40687a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f52c80090b0 tx=0x7f52c8008030 comp rx=0 tx=0).stop 2023-07-21T22:13:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.282+0000 7f52dca24700 1 -- 172.21.15.49:0/700315623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52d8071c70 msgr2=0x7f52d80c2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.282+0000 7f52dca24700 1 --2- 172.21.15.49:0/700315623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52d8071c70 0x7f52d80c2980 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00ec10 tx=0x7f52cc00ef20 comp rx=0 tx=0).stop 2023-07-21T22:13:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.282+0000 7f52dca24700 1 -- 172.21.15.49:0/700315623 shutdown_connections 2023-07-21T22:13:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.282+0000 7f52dca24700 1 --2- 172.21.15.49:0/700315623 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f52c40662f0 0x7f52c40687a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.282+0000 7f52dca24700 1 --2- 172.21.15.49:0/700315623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52d8071c70 0x7f52d80c2980 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.282+0000 7f52dca24700 1 --2- 172.21.15.49:0/700315623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52d80b1400 0x7f52d80b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:27.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.282+0000 7f52dca24700 1 --2- 172.21.15.49:0/700315623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52d806d380 0x7f52d8153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:27.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.282+0000 7f52dca24700 1 -- 172.21.15.49:0/700315623 >> 172.21.15.49:0/700315623 conn(0x7f52d8070450 msgr2=0x7f52d8070820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:27.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.282+0000 7f52dca24700 1 -- 172.21.15.49:0/700315623 shutdown_connections 2023-07-21T22:13:27.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.282+0000 7f52dca24700 1 -- 172.21.15.49:0/700315623 wait complete. 2023-07-21T22:13:27.328 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T22:13:27.334 INFO:tasks.ceph.mds.a.smithi049.stderr: -4071> 2023-07-21T22:12:25.555+0000 7faab34c7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:13:27.353 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T22:13:27.402 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-07-21T22:13:27.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1ba18e4700 1 Processor -- start 2023-07-21T22:13:27.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1ba18e4700 1 -- start start 2023-07-21T22:13:27.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1ba18e4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1b9c0b7af0 0x7f1b9c0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1ba18e4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c0b3e80 con 0x7f1b9c0cee10 2023-07-21T22:13:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1ba18e4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c15fd40 con 0x7f1b9c0d1e40 2023-07-21T22:13:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1ba18e4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9c0cea00 con 0x7f1b9c0b7af0 2023-07-21T22:13:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1ba10e3700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1b9c0cee10 0x7f1b9c0b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53232/0 (socket says 172.21.15.49:53232) 2023-07-21T22:13:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1ba10e3700 1 -- 172.21.15.49:0/3086571087 learned_addr learned my addr 172.21.15.49:0/3086571087 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1ba08e2700 1 --2- 172.21.15.49:0/3086571087 >> v2:172.21.15.150:3300/0 conn(0x7f1b9c0b7af0 0x7f1b9c0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:27.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1b9b7fe700 1 -- 172.21.15.49:0/3086571087 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159017925 0 0) 0x7f1b9c0b3e80 con 0x7f1b9c0cee10 2023-07-21T22:13:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1b9b7fe700 1 -- 172.21.15.49:0/3086571087 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b8c0035d0 con 0x7f1b9c0cee10 2023-07-21T22:13:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1ba08e2700 1 -- 172.21.15.49:0/3086571087 >> v1:172.21.15.150:6789/0 conn(0x7f1b9c0d1e40 legacy=0x7f1b9c15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1b9b7fe700 1 -- 172.21.15.49:0/3086571087 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865105773 0 0) 0x7f1b9c15fd40 con 0x7f1b9c0d1e40 2023-07-21T22:13:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1ba08e2700 1 -- 172.21.15.49:0/3086571087 >> v1:172.21.15.49:6789/0 conn(0x7f1b9c0cee10 legacy=0x7f1b9c0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1ba08e2700 1 -- 172.21.15.49:0/3086571087 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c0ccbf0 con 0x7f1b9c0b7af0 2023-07-21T22:13:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1ba08e2700 1 --2- 172.21.15.49:0/3086571087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b9c0b7af0 0x7f1b9c0b1630 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009850 tx=0x7f1b90009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d79a0cec273cf51 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1b9b7fe700 1 -- 172.21.15.49:0/3086571087 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90011830 con 0x7f1b9c0b7af0 2023-07-21T22:13:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1b9b7fe700 1 -- 172.21.15.49:0/3086571087 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b90011990 con 0x7f1b9c0b7af0 2023-07-21T22:13:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.494+0000 7f1b9b7fe700 1 -- 172.21.15.49:0/3086571087 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90011d40 con 0x7f1b9c0b7af0 2023-07-21T22:13:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.498+0000 7f1ba18e4700 1 -- 172.21.15.49:0/3086571087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b9c0b7af0 msgr2=0x7f1b9c0b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.498+0000 7f1ba18e4700 1 --2- 172.21.15.49:0/3086571087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b9c0b7af0 0x7f1b9c0b1630 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009850 tx=0x7f1b90009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.498+0000 7f1ba18e4700 1 -- 172.21.15.49:0/3086571087 shutdown_connections 2023-07-21T22:13:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.498+0000 7f1ba18e4700 1 --2- 172.21.15.49:0/3086571087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b9c0b7af0 0x7f1b9c0b1630 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.498+0000 7f1ba18e4700 1 -- 172.21.15.49:0/3086571087 >> 172.21.15.49:0/3086571087 conn(0x7f1b9c06e960 msgr2=0x7f1b9c06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.498+0000 7f1ba18e4700 1 -- 172.21.15.49:0/3086571087 shutdown_connections 2023-07-21T22:13:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.498+0000 7f1ba18e4700 1 -- 172.21.15.49:0/3086571087 wait complete. 2023-07-21T22:13:27.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.498+0000 7f1ba18e4700 1 Processor -- start 2023-07-21T22:13:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.498+0000 7f1ba18e4700 1 -- start start 2023-07-21T22:13:27.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1ba18e4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b9c0b7af0 0x7f1b9c1f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:27.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1ba18e4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b9c0cee10 0x7f1b9c150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:27.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1ba18e4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b9c0d1e40 0x7f1b9c1f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:27.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1ba18e4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c1511e0 con 0x7f1b9c0cee10 2023-07-21T22:13:27.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1ba18e4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c1f54c0 con 0x7f1b9c0b7af0 2023-07-21T22:13:27.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1ba18e4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0caa10 con 0x7f1b9c0d1e40 2023-07-21T22:13:27.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1b9bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b9c0cee10 0x7f1b9c150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:27.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1b9bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b9c0cee10 0x7f1b9c150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50366/0 (socket says 172.21.15.49:50366) 2023-07-21T22:13:27.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1b9bfff700 1 -- 172.21.15.49:0/818774696 learned_addr learned my addr 172.21.15.49:0/818774696 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:27.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1ba08e2700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b9c0b7af0 0x7f1b9c1f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:27.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1ba10e3700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b9c0d1e40 0x7f1b9c1f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:27.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1b9bfff700 1 -- 172.21.15.49:0/818774696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b9c0d1e40 msgr2=0x7f1b9c1f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:27.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1b9bfff700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b9c0d1e40 0x7f1b9c1f4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:27.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1b9bfff700 1 -- 172.21.15.49:0/818774696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b9c0b7af0 msgr2=0x7f1b9c1f1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:27.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1b9bfff700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b9c0b7af0 0x7f1b9c1f1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:27.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1b9bfff700 1 -- 172.21.15.49:0/818774696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b900094b0 con 0x7f1b9c0cee10 2023-07-21T22:13:27.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1ba10e3700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b9c0d1e40 0x7f1b9c1f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:27.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1b9bfff700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b9c0cee10 0x7f1b9c150ca0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800c520 tx=0x7f1b8800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1b997fa700 1 -- 172.21.15.49:0/818774696 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b880054e0 con 0x7f1b9c0cee10 2023-07-21T22:13:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1b997fa700 1 -- 172.21.15.49:0/818774696 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b880036a0 con 0x7f1b9c0cee10 2023-07-21T22:13:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1b997fa700 1 -- 172.21.15.49:0/818774696 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88003a50 con 0x7f1b9c0cee10 2023-07-21T22:13:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1ba18e4700 1 -- 172.21.15.49:0/818774696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9c1f1090 con 0x7f1b9c0cee10 2023-07-21T22:13:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.502+0000 7f1ba18e4700 1 -- 172.21.15.49:0/818774696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c1f1650 con 0x7f1b9c0cee10 2023-07-21T22:13:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.506+0000 7f1ba18e4700 1 -- 172.21.15.49:0/818774696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c1f1870 con 0x7f1b9c0cee10 2023-07-21T22:13:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.506+0000 7f1b997fa700 1 -- 172.21.15.49:0/818774696 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1b88003bb0 con 0x7f1b9c0cee10 2023-07-21T22:13:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.510+0000 7f1b997fa700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b800662f0 0x7f1b800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.510+0000 7f1b997fa700 1 -- 172.21.15.49:0/818774696 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f1b880836b0 con 0x7f1b9c0cee10 2023-07-21T22:13:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.510+0000 7f1ba08e2700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b800662f0 0x7f1b800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.510+0000 7f1ba08e2700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b800662f0 0x7f1b800687a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1b900090b0 tx=0x7f1b90008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:27.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.514+0000 7f1b997fa700 1 -- 172.21.15.49:0/818774696 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b880506b0 con 0x7f1b9c0cee10 2023-07-21T22:13:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:27.734+0000 7f1ba18e4700 1 -- 172.21.15.49:0/818774696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1b9c04dcb0 con 0x7f1b9c0cee10 2023-07-21T22:13:28.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.278+0000 7f1b997fa700 1 -- 172.21.15.49:0/818774696 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1b88003e60 con 0x7f1b9c0cee10 2023-07-21T22:13:28.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.286+0000 7f1ba18e4700 1 -- 172.21.15.49:0/818774696 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b800662f0 msgr2=0x7f1b800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:28.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.286+0000 7f1ba18e4700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b800662f0 0x7f1b800687a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1b900090b0 tx=0x7f1b90008030 comp rx=0 tx=0).stop 2023-07-21T22:13:28.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.286+0000 7f1ba18e4700 1 -- 172.21.15.49:0/818774696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b9c0cee10 msgr2=0x7f1b9c150ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:28.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.286+0000 7f1ba18e4700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b9c0cee10 0x7f1b9c150ca0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800c520 tx=0x7f1b8800c8e0 comp rx=0 tx=0).stop 2023-07-21T22:13:28.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.286+0000 7f1ba18e4700 1 -- 172.21.15.49:0/818774696 shutdown_connections 2023-07-21T22:13:28.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.286+0000 7f1ba18e4700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1b800662f0 0x7f1b800687a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:28.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.286+0000 7f1ba18e4700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b9c0cee10 0x7f1b9c150ca0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:28.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.286+0000 7f1ba18e4700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b9c0d1e40 0x7f1b9c1f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:28.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.286+0000 7f1ba18e4700 1 --2- 172.21.15.49:0/818774696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b9c0b7af0 0x7f1b9c1f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:28.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.286+0000 7f1ba18e4700 1 -- 172.21.15.49:0/818774696 >> 172.21.15.49:0/818774696 conn(0x7f1b9c06e960 msgr2=0x7f1b9c072370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:28.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.286+0000 7f1ba18e4700 1 -- 172.21.15.49:0/818774696 shutdown_connections 2023-07-21T22:13:28.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.286+0000 7f1ba18e4700 1 -- 172.21.15.49:0/818774696 wait complete. 2023-07-21T22:13:28.352 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T22:13:28.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.542+0000 7ff848907700 1 Processor -- start 2023-07-21T22:13:28.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.542+0000 7ff848907700 1 -- start start 2023-07-21T22:13:28.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.546+0000 7ff848907700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8440caa90 0x7ff8440ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:28.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.546+0000 7ff848907700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8440afaf0 0x7ff8440aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:28.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.546+0000 7ff848907700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8440ce610 con 0x7ff844159c60 2023-07-21T22:13:28.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.546+0000 7ff848907700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8440ca240 con 0x7ff8440afaf0 2023-07-21T22:13:28.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.546+0000 7ff848907700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440b04d0 con 0x7ff8440caa90 2023-07-21T22:13:28.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.546+0000 7ff843fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8440afaf0 0x7ff8440aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:28.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.546+0000 7ff843fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8440afaf0 0x7ff8440aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50382/0 (socket says 172.21.15.49:50382) 2023-07-21T22:13:28.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.546+0000 7ff843fff700 1 -- 172.21.15.49:0/3788848554 learned_addr learned my addr 172.21.15.49:0/3788848554 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:28.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.546+0000 7ff842ffd700 1 --2- 172.21.15.49:0/3788848554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8440caa90 0x7ff8440ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:28.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.546+0000 7ff843fff700 1 -- 172.21.15.49:0/3788848554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8440caa90 msgr2=0x7ff8440ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:28.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.546+0000 7ff843fff700 1 --2- 172.21.15.49:0/3788848554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8440caa90 0x7ff8440ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:28.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.546+0000 7ff843fff700 1 -- 172.21.15.49:0/3788848554 >> v1:172.21.15.150:6789/0 conn(0x7ff844159c60 legacy=0x7ff8440c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:28.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.546+0000 7ff843fff700 1 -- 172.21.15.49:0/3788848554 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8440ca430 con 0x7ff8440afaf0 2023-07-21T22:13:28.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.546+0000 7ff843fff700 1 --2- 172.21.15.49:0/3788848554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8440afaf0 0x7ff8440aff90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009e50 tx=0x7ff83c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e973583b018173a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:28.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.550+0000 7ff8427fc700 1 -- 172.21.15.49:0/3788848554 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00e070 con 0x7ff8440afaf0 2023-07-21T22:13:28.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.550+0000 7ff8427fc700 1 -- 172.21.15.49:0/3788848554 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c00b910 con 0x7ff8440afaf0 2023-07-21T22:13:28.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.550+0000 7ff8427fc700 1 -- 172.21.15.49:0/3788848554 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00bcc0 con 0x7ff8440afaf0 2023-07-21T22:13:28.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.550+0000 7ff848907700 1 -- 172.21.15.49:0/3788848554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8440afaf0 msgr2=0x7ff8440aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:28.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.550+0000 7ff848907700 1 --2- 172.21.15.49:0/3788848554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8440afaf0 0x7ff8440aff90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009e50 tx=0x7ff83c00b330 comp rx=0 tx=0).stop 2023-07-21T22:13:28.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.550+0000 7ff848907700 1 -- 172.21.15.49:0/3788848554 shutdown_connections 2023-07-21T22:13:28.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.550+0000 7ff848907700 1 --2- 172.21.15.49:0/3788848554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8440caa90 0x7ff8440ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:28.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.550+0000 7ff848907700 1 --2- 172.21.15.49:0/3788848554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8440afaf0 0x7ff8440aff90 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:28.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.550+0000 7ff848907700 1 -- 172.21.15.49:0/3788848554 >> 172.21.15.49:0/3788848554 conn(0x7ff84406e960 msgr2=0x7ff84406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:28.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.550+0000 7ff848907700 1 -- 172.21.15.49:0/3788848554 shutdown_connections 2023-07-21T22:13:28.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.550+0000 7ff848907700 1 -- 172.21.15.49:0/3788848554 wait complete. 2023-07-21T22:13:28.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.554+0000 7ff848907700 1 Processor -- start 2023-07-21T22:13:28.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.554+0000 7ff848907700 1 -- start start 2023-07-21T22:13:28.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.554+0000 7ff848907700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8440afaf0 0x7ff8440cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:28.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.554+0000 7ff848907700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8440caa90 0x7ff8441f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:28.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.554+0000 7ff848907700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff844159c60 0x7ff8441f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:28.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.554+0000 7ff848907700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84414cd60 con 0x7ff8440caa90 2023-07-21T22:13:28.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.554+0000 7ff848907700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440cca80 con 0x7ff8440afaf0 2023-07-21T22:13:28.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.554+0000 7ff848907700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8441f4860 con 0x7ff844159c60 2023-07-21T22:13:28.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.554+0000 7ff842ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8440caa90 0x7ff8441f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:28.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.554+0000 7ff842ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8440caa90 0x7ff8441f10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50384/0 (socket says 172.21.15.49:50384) 2023-07-21T22:13:28.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.554+0000 7ff842ffd700 1 -- 172.21.15.49:0/175443424 learned_addr learned my addr 172.21.15.49:0/175443424 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff843fff700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff844159c60 0x7ff8441f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff8437fe700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8440afaf0 0x7ff8440cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff842ffd700 1 -- 172.21.15.49:0/175443424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff844159c60 msgr2=0x7ff8441f15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff842ffd700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff844159c60 0x7ff8441f15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff842ffd700 1 -- 172.21.15.49:0/175443424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8440afaf0 msgr2=0x7ff8440cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff842ffd700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8440afaf0 0x7ff8440cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff842ffd700 1 -- 172.21.15.49:0/175443424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c009b30 con 0x7ff8440caa90 2023-07-21T22:13:28.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff8437fe700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8440afaf0 0x7ff8440cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:28.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff842ffd700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8440caa90 0x7ff8441f10b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff83800e9d0 tx=0x7ff83800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:28.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff82bfff700 1 -- 172.21.15.49:0/175443424 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838009720 con 0x7ff8440caa90 2023-07-21T22:13:28.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff82bfff700 1 -- 172.21.15.49:0/175443424 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83800c850 con 0x7ff8440caa90 2023-07-21T22:13:28.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff848907700 1 -- 172.21.15.49:0/175443424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8440cd440 con 0x7ff8440caa90 2023-07-21T22:13:28.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff82bfff700 1 -- 172.21.15.49:0/175443424 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83800cbc0 con 0x7ff8440caa90 2023-07-21T22:13:28.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff848907700 1 -- 172.21.15.49:0/175443424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8440cc4c0 con 0x7ff8440caa90 2023-07-21T22:13:28.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.558+0000 7ff848907700 1 -- 172.21.15.49:0/175443424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84406a540 con 0x7ff8440caa90 2023-07-21T22:13:28.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.562+0000 7ff82bfff700 1 -- 172.21.15.49:0/175443424 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff83800cd20 con 0x7ff8440caa90 2023-07-21T22:13:28.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.566+0000 7ff82bfff700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff830066320 0x7ff8300687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:28.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.566+0000 7ff82bfff700 1 -- 172.21.15.49:0/175443424 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6921+0+0 (secure 0 0 0) 0x7ff838084880 con 0x7ff8440caa90 2023-07-21T22:13:28.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.566+0000 7ff8437fe700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff830066320 0x7ff8300687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:28.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.566+0000 7ff8437fe700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff830066320 0x7ff8300687d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff834000f60 tx=0x7ff834009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:28.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.570+0000 7ff82bfff700 1 -- 172.21.15.49:0/175443424 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff838051a10 con 0x7ff8440caa90 2023-07-21T22:13:28.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:28.742+0000 7ff848907700 1 -- 172.21.15.49:0/175443424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff8440ce270 con 0x7ff8440caa90 2023-07-21T22:13:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.494+0000 7ff82bfff700 1 -- 172.21.15.49:0/175443424 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff838055030 con 0x7ff8440caa90 2023-07-21T22:13:29.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.502+0000 7ff848907700 1 -- 172.21.15.49:0/175443424 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff830066320 msgr2=0x7ff8300687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:29.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.502+0000 7ff848907700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff830066320 0x7ff8300687d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff834000f60 tx=0x7ff834009040 comp rx=0 tx=0).stop 2023-07-21T22:13:29.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.502+0000 7ff848907700 1 -- 172.21.15.49:0/175443424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8440caa90 msgr2=0x7ff8441f10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:29.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.502+0000 7ff848907700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8440caa90 0x7ff8441f10b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff83800e9d0 tx=0x7ff83800ece0 comp rx=0 tx=0).stop 2023-07-21T22:13:29.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.502+0000 7ff848907700 1 -- 172.21.15.49:0/175443424 shutdown_connections 2023-07-21T22:13:29.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.502+0000 7ff848907700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff830066320 0x7ff8300687d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:29.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.502+0000 7ff848907700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8440caa90 0x7ff8441f10b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:29.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.502+0000 7ff848907700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff844159c60 0x7ff8441f15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:29.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.502+0000 7ff848907700 1 --2- 172.21.15.49:0/175443424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8440afaf0 0x7ff8440cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.502+0000 7ff848907700 1 -- 172.21.15.49:0/175443424 >> 172.21.15.49:0/175443424 conn(0x7ff84406e960 msgr2=0x7ff8441588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.502+0000 7ff848907700 1 -- 172.21.15.49:0/175443424 shutdown_connections 2023-07-21T22:13:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.502+0000 7ff848907700 1 -- 172.21.15.49:0/175443424 wait complete. 2023-07-21T22:13:29.547 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-07-21T22:13:29.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T22:13:29.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.718+0000 7fe05a570700 1 Processor -- start 2023-07-21T22:13:29.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.718+0000 7fe05a570700 1 -- start start 2023-07-21T22:13:29.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe05a570700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe054159ea0 0x7fe0540c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:29.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe05a570700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0540b03f0 0x7fe05415e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:29.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe05a570700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05415d8a0 con 0x7fe0540cb8a0 2023-07-21T22:13:29.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe05a570700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0540ca640 con 0x7fe0540b03f0 2023-07-21T22:13:29.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe05a570700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0540ca920 con 0x7fe054159ea0 2023-07-21T22:13:29.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe058b0d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0540b03f0 0x7fe05415e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:29.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe04b7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe0540cb8a0 0x7fe0540afce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53244/0 (socket says 172.21.15.49:53244) 2023-07-21T22:13:29.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe04b7fe700 1 -- 172.21.15.49:0/2952514159 learned_addr learned my addr 172.21.15.49:0/2952514159 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:29.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe053fff700 1 --2- 172.21.15.49:0/2952514159 >> v2:172.21.15.150:3300/0 conn(0x7fe054159ea0 0x7fe0540c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:29.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe0537fe700 1 -- 172.21.15.49:0/2952514159 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273314069 0 0) 0x7fe05415d8a0 con 0x7fe0540cb8a0 2023-07-21T22:13:29.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe0537fe700 1 -- 172.21.15.49:0/2952514159 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0400035d0 con 0x7fe0540cb8a0 2023-07-21T22:13:29.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe058b0d700 1 -- 172.21.15.49:0/2952514159 >> v2:172.21.15.150:3300/0 conn(0x7fe054159ea0 msgr2=0x7fe0540c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:29.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe058b0d700 1 --2- 172.21.15.49:0/2952514159 >> v2:172.21.15.150:3300/0 conn(0x7fe054159ea0 0x7fe0540c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:29.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe058b0d700 1 -- 172.21.15.49:0/2952514159 >> v1:172.21.15.49:6789/0 conn(0x7fe0540cb8a0 legacy=0x7fe0540afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:29.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe058b0d700 1 -- 172.21.15.49:0/2952514159 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05415db40 con 0x7fe0540b03f0 2023-07-21T22:13:29.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe058b0d700 1 --2- 172.21.15.49:0/2952514159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540b03f0 0x7fe05415e340 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe05406bce0 tx=0x7fe04c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6273580b7b67030e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:29.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe0537fe700 1 -- 172.21.15.49:0/2952514159 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00e070 con 0x7fe0540b03f0 2023-07-21T22:13:29.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe0537fe700 1 -- 172.21.15.49:0/2952514159 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c00bb20 con 0x7fe0540b03f0 2023-07-21T22:13:29.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe0537fe700 1 -- 172.21.15.49:0/2952514159 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c012430 con 0x7fe0540b03f0 2023-07-21T22:13:29.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe05a570700 1 -- 172.21.15.49:0/2952514159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540b03f0 msgr2=0x7fe05415e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:29.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.722+0000 7fe05a570700 1 --2- 172.21.15.49:0/2952514159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540b03f0 0x7fe05415e340 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe05406bce0 tx=0x7fe04c00b330 comp rx=0 tx=0).stop 2023-07-21T22:13:29.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.726+0000 7fe05a570700 1 -- 172.21.15.49:0/2952514159 shutdown_connections 2023-07-21T22:13:29.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.726+0000 7fe05a570700 1 --2- 172.21.15.49:0/2952514159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540b03f0 0x7fe05415e340 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:29.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.726+0000 7fe05a570700 1 --2- 172.21.15.49:0/2952514159 >> v2:172.21.15.150:3300/0 conn(0x7fe054159ea0 0x7fe0540c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:29.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.726+0000 7fe05a570700 1 -- 172.21.15.49:0/2952514159 >> 172.21.15.49:0/2952514159 conn(0x7fe0540cace0 msgr2=0x7fe0540cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:29.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.726+0000 7fe05a570700 1 -- 172.21.15.49:0/2952514159 shutdown_connections 2023-07-21T22:13:29.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.726+0000 7fe05a570700 1 -- 172.21.15.49:0/2952514159 wait complete. 2023-07-21T22:13:29.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.726+0000 7fe05a570700 1 Processor -- start 2023-07-21T22:13:29.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.726+0000 7fe05a570700 1 -- start start 2023-07-21T22:13:29.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe05a570700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540b03f0 0x7fe05415aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:29.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe05a570700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0540cb8a0 0x7fe0540c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:29.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe05a570700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe054159ea0 0x7fe0540c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:29.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe05a570700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05415af80 con 0x7fe0540b03f0 2023-07-21T22:13:29.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe05a570700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0541e36c0 con 0x7fe054159ea0 2023-07-21T22:13:29.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe05a570700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0541e4200 con 0x7fe0540cb8a0 2023-07-21T22:13:29.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe053fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540b03f0 0x7fe05415aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:29.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe053fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540b03f0 0x7fe05415aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50412/0 (socket says 172.21.15.49:50412) 2023-07-21T22:13:29.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe053fff700 1 -- 172.21.15.49:0/2426176768 learned_addr learned my addr 172.21.15.49:0/2426176768 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:29.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe058b0d700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe054159ea0 0x7fe0540c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:29.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe04b7fe700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0540cb8a0 0x7fe0540c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:29.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe053fff700 1 -- 172.21.15.49:0/2426176768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0540cb8a0 msgr2=0x7fe0540c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:29.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe053fff700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0540cb8a0 0x7fe0540c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:29.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe053fff700 1 -- 172.21.15.49:0/2426176768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe054159ea0 msgr2=0x7fe0540c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:29.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe053fff700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe054159ea0 0x7fe0540c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:29.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe053fff700 1 -- 172.21.15.49:0/2426176768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c009a70 con 0x7fe0540b03f0 2023-07-21T22:13:29.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe058b0d700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe054159ea0 0x7fe0540c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:29.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe04b7fe700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0540cb8a0 0x7fe0540c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:29.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe053fff700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540b03f0 0x7fe05415aa40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe04400e840 tx=0x7fe04400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:29.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe0517fa700 1 -- 172.21.15.49:0/2426176768 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0440095a0 con 0x7fe0540b03f0 2023-07-21T22:13:29.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe0517fa700 1 -- 172.21.15.49:0/2426176768 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400c690 con 0x7fe0540b03f0 2023-07-21T22:13:29.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe05a570700 1 -- 172.21.15.49:0/2426176768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0541e38d0 con 0x7fe0540b03f0 2023-07-21T22:13:29.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.730+0000 7fe0517fa700 1 -- 172.21.15.49:0/2426176768 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400ca00 con 0x7fe0540b03f0 2023-07-21T22:13:29.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.734+0000 7fe05a570700 1 -- 172.21.15.49:0/2426176768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0541e3e90 con 0x7fe0540b03f0 2023-07-21T22:13:29.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.734+0000 7fe05a570700 1 -- 172.21.15.49:0/2426176768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe054159650 con 0x7fe0540b03f0 2023-07-21T22:13:29.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.734+0000 7fe0517fa700 1 -- 172.21.15.49:0/2426176768 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe04400cb60 con 0x7fe0540b03f0 2023-07-21T22:13:29.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.738+0000 7fe0517fa700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe034066320 0x7fe0340687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:29.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.738+0000 7fe0517fa700 1 -- 172.21.15.49:0/2426176768 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fe044083e20 con 0x7fe0540b03f0 2023-07-21T22:13:29.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.738+0000 7fe04b7fe700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe034066320 0x7fe0340687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:29.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.738+0000 7fe04b7fe700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe034066320 0x7fe0340687d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe0540c1900 tx=0x7fe03c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:29.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.746+0000 7fe0517fa700 1 -- 172.21.15.49:0/2426176768 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0440510f0 con 0x7fe0540b03f0 2023-07-21T22:13:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:29.922+0000 7fe05a570700 1 -- 172.21.15.49:0/2426176768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe0540702c0 con 0x7fe0540b03f0 2023-07-21T22:13:30.277 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:13:30.285 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:13:30.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.506+0000 7fe0517fa700 1 -- 172.21.15.49:0/2426176768 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe044054710 con 0x7fe0540b03f0 2023-07-21T22:13:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.514+0000 7fe05a570700 1 -- 172.21.15.49:0/2426176768 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe034066320 msgr2=0x7fe0340687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.514+0000 7fe05a570700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe034066320 0x7fe0340687d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe0540c1900 tx=0x7fe03c009040 comp rx=0 tx=0).stop 2023-07-21T22:13:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.514+0000 7fe05a570700 1 -- 172.21.15.49:0/2426176768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540b03f0 msgr2=0x7fe05415aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:30.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.514+0000 7fe05a570700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540b03f0 0x7fe05415aa40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe04400e840 tx=0x7fe04400ec00 comp rx=0 tx=0).stop 2023-07-21T22:13:30.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.514+0000 7fe05a570700 1 -- 172.21.15.49:0/2426176768 shutdown_connections 2023-07-21T22:13:30.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.514+0000 7fe05a570700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe034066320 0x7fe0340687d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.514+0000 7fe05a570700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe054159ea0 0x7fe0540c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.514+0000 7fe05a570700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0540cb8a0 0x7fe0540c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.514+0000 7fe05a570700 1 --2- 172.21.15.49:0/2426176768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540b03f0 0x7fe05415aa40 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.514+0000 7fe05a570700 1 -- 172.21.15.49:0/2426176768 >> 172.21.15.49:0/2426176768 conn(0x7fe0540cace0 msgr2=0x7fe054155aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.514+0000 7fe05a570700 1 -- 172.21.15.49:0/2426176768 shutdown_connections 2023-07-21T22:13:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.514+0000 7fe05a570700 1 -- 172.21.15.49:0/2426176768 wait complete. 2023-07-21T22:13:30.559 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-07-21T22:13:30.579 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2023-07-21T22:13:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.734+0000 7fa712c91700 1 Processor -- start 2023-07-21T22:13:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.734+0000 7fa712c91700 1 -- start start 2023-07-21T22:13:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa712c91700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa70c0cb8a0 0x7fa70c0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa712c91700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa70c0b03f0 0x7fa70c15e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa712c91700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70c15d8a0 con 0x7fa70c159ea0 2023-07-21T22:13:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa712c91700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70c0ca640 con 0x7fa70c0b03f0 2023-07-21T22:13:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa712c91700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70c0ca920 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa710a2d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa70c159ea0 0x7fa70c0afce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53258/0 (socket says 172.21.15.49:53258) 2023-07-21T22:13:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa710a2d700 1 -- 172.21.15.49:0/426150524 learned_addr learned my addr 172.21.15.49:0/426150524 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa70bfff700 1 --2- 172.21.15.49:0/426150524 >> v2:172.21.15.150:3300/0 conn(0x7fa70c0cb8a0 0x7fa70c0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa71122e700 1 --2- 172.21.15.49:0/426150524 >> v2:172.21.15.49:3300/0 conn(0x7fa70c0b03f0 0x7fa70c15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa70b7fe700 1 -- 172.21.15.49:0/426150524 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917725386 0 0) 0x7fa70c15d8a0 con 0x7fa70c159ea0 2023-07-21T22:13:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa70b7fe700 1 -- 172.21.15.49:0/426150524 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6fc0035d0 con 0x7fa70c159ea0 2023-07-21T22:13:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa70bfff700 1 -- 172.21.15.49:0/426150524 >> v2:172.21.15.49:3300/0 conn(0x7fa70c0b03f0 msgr2=0x7fa70c15e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa70bfff700 1 --2- 172.21.15.49:0/426150524 >> v2:172.21.15.49:3300/0 conn(0x7fa70c0b03f0 0x7fa70c15e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa70bfff700 1 -- 172.21.15.49:0/426150524 >> v1:172.21.15.49:6789/0 conn(0x7fa70c159ea0 legacy=0x7fa70c0afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa70bfff700 1 -- 172.21.15.49:0/426150524 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c15db40 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.738+0000 7fa71122e700 1 --2- 172.21.15.49:0/426150524 >> v2:172.21.15.49:3300/0 conn(0x7fa70c0b03f0 0x7fa70c15e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:30.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.742+0000 7fa70bfff700 1 --2- 172.21.15.49:0/426150524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa70c0cb8a0 0x7fa70c0c9c60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa70c06bc90 tx=0x7fa6f8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef79eb011c833911 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:30.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.742+0000 7fa70b7fe700 1 -- 172.21.15.49:0/426150524 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8011830 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.742+0000 7fa70b7fe700 1 -- 172.21.15.49:0/426150524 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f8011990 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.742+0000 7fa70b7fe700 1 -- 172.21.15.49:0/426150524 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8011d20 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.742+0000 7fa712c91700 1 -- 172.21.15.49:0/426150524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa70c0cb8a0 msgr2=0x7fa70c0c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:30.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.742+0000 7fa712c91700 1 --2- 172.21.15.49:0/426150524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa70c0cb8a0 0x7fa70c0c9c60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa70c06bc90 tx=0x7fa6f8009b30 comp rx=0 tx=0).stop 2023-07-21T22:13:30.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.742+0000 7fa712c91700 1 -- 172.21.15.49:0/426150524 shutdown_connections 2023-07-21T22:13:30.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.742+0000 7fa712c91700 1 --2- 172.21.15.49:0/426150524 >> v2:172.21.15.49:3300/0 conn(0x7fa70c0b03f0 0x7fa70c15e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:30.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.742+0000 7fa712c91700 1 --2- 172.21.15.49:0/426150524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa70c0cb8a0 0x7fa70c0c9c60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:30.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.742+0000 7fa712c91700 1 -- 172.21.15.49:0/426150524 >> 172.21.15.49:0/426150524 conn(0x7fa70c0cace0 msgr2=0x7fa70c0cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.742+0000 7fa712c91700 1 -- 172.21.15.49:0/426150524 shutdown_connections 2023-07-21T22:13:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.742+0000 7fa712c91700 1 -- 172.21.15.49:0/426150524 wait complete. 2023-07-21T22:13:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.746+0000 7fa712c91700 1 Processor -- start 2023-07-21T22:13:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.746+0000 7fa712c91700 1 -- start start 2023-07-21T22:13:30.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa712c91700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa70c0b03f0 0x7fa70c0c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:30.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa712c91700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa70c0cb8a0 0x7fa70c15cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:30.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa712c91700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa70c159ea0 0x7fa70c15b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:30.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa712c91700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c15c990 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa712c91700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c15ba70 con 0x7fa70c159ea0 2023-07-21T22:13:30.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa712c91700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c15bd10 con 0x7fa70c0b03f0 2023-07-21T22:13:30.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa70bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa70c0cb8a0 0x7fa70c15cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:30.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa70bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa70c0cb8a0 0x7fa70c15cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50434/0 (socket says 172.21.15.49:50434) 2023-07-21T22:13:30.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa70bfff700 1 -- 172.21.15.49:0/981336266 learned_addr learned my addr 172.21.15.49:0/981336266 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:30.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa710a2d700 1 --2- 172.21.15.49:0/981336266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa70c0b03f0 0x7fa70c0c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa71122e700 1 --2- 172.21.15.49:0/981336266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa70c159ea0 0x7fa70c15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa70bfff700 1 -- 172.21.15.49:0/981336266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa70c0b03f0 msgr2=0x7fa70c0c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa70bfff700 1 --2- 172.21.15.49:0/981336266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa70c0b03f0 0x7fa70c0c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa70bfff700 1 -- 172.21.15.49:0/981336266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa70c159ea0 msgr2=0x7fa70c15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa70bfff700 1 --2- 172.21.15.49:0/981336266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa70c159ea0 0x7fa70c15b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa70bfff700 1 -- 172.21.15.49:0/981336266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa704009a70 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa70bfff700 1 --2- 172.21.15.49:0/981336266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa70c0cb8a0 0x7fa70c15cdb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009b70 tx=0x7fa6f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa7097fa700 1 -- 172.21.15.49:0/981336266 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8004480 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa712c91700 1 -- 172.21.15.49:0/981336266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f80094b0 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa7097fa700 1 -- 172.21.15.49:0/981336266 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f801f070 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa7097fa700 1 -- 172.21.15.49:0/981336266 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80038c0 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.750+0000 7fa712c91700 1 -- 172.21.15.49:0/981336266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70c15c2d0 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.754+0000 7fa712c91700 1 -- 172.21.15.49:0/981336266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70c15cad0 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.754+0000 7fa7097fa700 1 -- 172.21.15.49:0/981336266 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6f8021030 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.754+0000 7fa7097fa700 1 --2- 172.21.15.49:0/981336266 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6f00662f0 0x7fa6f00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.754+0000 7fa7097fa700 1 -- 172.21.15.49:0/981336266 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6011+0+0 (secure 0 0 0) 0x7fa6f8085300 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.754+0000 7fa710a2d700 1 --2- 172.21.15.49:0/981336266 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6f00662f0 0x7fa6f00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.758+0000 7fa710a2d700 1 --2- 172.21.15.49:0/981336266 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6f00662f0 0x7fa6f00687a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa7000011e0 tx=0x7fa700009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:30.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.762+0000 7fa7097fa700 1 -- 172.21.15.49:0/981336266 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa70c15cad0 con 0x7fa70c0cb8a0 2023-07-21T22:13:30.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:30.942+0000 7fa712c91700 1 -- 172.21.15.49:0/981336266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa70c15cad0 con 0x7fa70c0cb8a0 2023-07-21T22:13:31.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.522+0000 7fa7097fa700 1 -- 172.21.15.49:0/981336266 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v53) v1 ==== 160+0+0 (secure 0 0 0) 0x7fa70c15cad0 con 0x7fa70c0cb8a0 2023-07-21T22:13:31.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.526+0000 7fa712c91700 1 -- 172.21.15.49:0/981336266 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6f00662f0 msgr2=0x7fa6f00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:31.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.526+0000 7fa712c91700 1 --2- 172.21.15.49:0/981336266 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6f00662f0 0x7fa6f00687a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa7000011e0 tx=0x7fa700009040 comp rx=0 tx=0).stop 2023-07-21T22:13:31.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.526+0000 7fa712c91700 1 -- 172.21.15.49:0/981336266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa70c0cb8a0 msgr2=0x7fa70c15cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:31.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.526+0000 7fa712c91700 1 --2- 172.21.15.49:0/981336266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa70c0cb8a0 0x7fa70c15cdb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009b70 tx=0x7fa6f8004770 comp rx=0 tx=0).stop 2023-07-21T22:13:31.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.530+0000 7fa712c91700 1 -- 172.21.15.49:0/981336266 shutdown_connections 2023-07-21T22:13:31.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.530+0000 7fa712c91700 1 --2- 172.21.15.49:0/981336266 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa6f00662f0 0x7fa6f00687a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.530+0000 7fa712c91700 1 --2- 172.21.15.49:0/981336266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa70c0cb8a0 0x7fa70c15cdb0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.530+0000 7fa712c91700 1 --2- 172.21.15.49:0/981336266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa70c159ea0 0x7fa70c15b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.530+0000 7fa712c91700 1 --2- 172.21.15.49:0/981336266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa70c0b03f0 0x7fa70c0c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.530+0000 7fa712c91700 1 -- 172.21.15.49:0/981336266 >> 172.21.15.49:0/981336266 conn(0x7fa70c0cace0 msgr2=0x7fa70c0c4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:31.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.530+0000 7fa712c91700 1 -- 172.21.15.49:0/981336266 shutdown_connections 2023-07-21T22:13:31.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.530+0000 7fa712c91700 1 -- 172.21.15.49:0/981336266 wait complete. 2023-07-21T22:13:31.574 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'data_new' removed 2023-07-21T22:13:31.596 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-21T22:13:31.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.734+0000 7f4510a9f700 1 Processor -- start 2023-07-21T22:13:31.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.734+0000 7f4510a9f700 1 -- start start 2023-07-21T22:13:31.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.734+0000 7f4510a9f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f450c06d030 0x7f450c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:31.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.734+0000 7f4510a9f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450c0afaf0 con 0x7f450c15d590 2023-07-21T22:13:31.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.734+0000 7f4510a9f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450c0b0390 con 0x7f450c0cd370 2023-07-21T22:13:31.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.734+0000 7f4510a9f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450c06f350 con 0x7f450c06d030 2023-07-21T22:13:31.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.734+0000 7f450bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f450c15d590 0x7f450c15d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53266/0 (socket says 172.21.15.49:53266) 2023-07-21T22:13:31.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.734+0000 7f450bfff700 1 -- 172.21.15.49:0/3610900240 learned_addr learned my addr 172.21.15.49:0/3610900240 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:31.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.734+0000 7f4502ffd700 1 --2- 172.21.15.49:0/3610900240 >> v2:172.21.15.49:3300/0 conn(0x7f450c06d030 0x7f450c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:31.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.734+0000 7f450affd700 1 -- 172.21.15.49:0/3610900240 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311594168 0 0) 0x7f450c0afaf0 con 0x7f450c15d590 2023-07-21T22:13:31.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.734+0000 7f450affd700 1 -- 172.21.15.49:0/3610900240 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44f80035d0 con 0x7f450c15d590 2023-07-21T22:13:31.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.734+0000 7f4502ffd700 1 -- 172.21.15.49:0/3610900240 >> v1:172.21.15.150:6789/0 conn(0x7f450c0cd370 legacy=0x7f450c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:31.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.734+0000 7f4502ffd700 1 -- 172.21.15.49:0/3610900240 >> v1:172.21.15.49:6789/0 conn(0x7f450c15d590 legacy=0x7f450c15d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:31.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.734+0000 7f4502ffd700 1 -- 172.21.15.49:0/3610900240 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c06dd80 con 0x7f450c06d030 2023-07-21T22:13:31.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.738+0000 7f4502ffd700 1 --2- 172.21.15.49:0/3610900240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f450c06d030 0x7f450c06d4b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009850 tx=0x7f44f4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a019c92d7cfc5d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:31.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.738+0000 7f450affd700 1 -- 172.21.15.49:0/3610900240 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4011830 con 0x7f450c06d030 2023-07-21T22:13:31.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.738+0000 7f450affd700 1 -- 172.21.15.49:0/3610900240 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f4011990 con 0x7f450c06d030 2023-07-21T22:13:31.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.738+0000 7f450affd700 1 -- 172.21.15.49:0/3610900240 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4011d40 con 0x7f450c06d030 2023-07-21T22:13:31.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.738+0000 7f4510a9f700 1 -- 172.21.15.49:0/3610900240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f450c06d030 msgr2=0x7f450c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:31.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.738+0000 7f4510a9f700 1 --2- 172.21.15.49:0/3610900240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f450c06d030 0x7f450c06d4b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009850 tx=0x7f44f4009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:31.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.738+0000 7f4510a9f700 1 -- 172.21.15.49:0/3610900240 shutdown_connections 2023-07-21T22:13:31.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.738+0000 7f4510a9f700 1 --2- 172.21.15.49:0/3610900240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f450c06d030 0x7f450c06d4b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.738+0000 7f4510a9f700 1 -- 172.21.15.49:0/3610900240 >> 172.21.15.49:0/3610900240 conn(0x7f450c0cdff0 msgr2=0x7f450c0ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:31.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.738+0000 7f4510a9f700 1 -- 172.21.15.49:0/3610900240 shutdown_connections 2023-07-21T22:13:31.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.738+0000 7f4510a9f700 1 -- 172.21.15.49:0/3610900240 wait complete. 2023-07-21T22:13:31.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.742+0000 7f4510a9f700 1 Processor -- start 2023-07-21T22:13:31.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.742+0000 7f4510a9f700 1 -- start start 2023-07-21T22:13:31.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.742+0000 7f4510a9f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f450c06d030 0x7f450c152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:31.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.742+0000 7f4510a9f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f450c0cd370 0x7f450c15c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:31.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.742+0000 7f4510a9f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f450c15d590 0x7f450c1f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:31.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.742+0000 7f4510a9f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c15b0f0 con 0x7f450c06d030 2023-07-21T22:13:31.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.742+0000 7f4510a9f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c1f3a20 con 0x7f450c15d590 2023-07-21T22:13:31.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.742+0000 7f4510a9f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c15a050 con 0x7f450c0cd370 2023-07-21T22:13:31.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.742+0000 7f450b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f450c06d030 0x7f450c152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:31.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.742+0000 7f450b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f450c06d030 0x7f450c152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50450/0 (socket says 172.21.15.49:50450) 2023-07-21T22:13:31.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.742+0000 7f450b7fe700 1 -- 172.21.15.49:0/4134427818 learned_addr learned my addr 172.21.15.49:0/4134427818 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:31.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.746+0000 7f4502ffd700 1 --2- 172.21.15.49:0/4134427818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f450c0cd370 0x7f450c15c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:31.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.746+0000 7f450bfff700 1 --2- 172.21.15.49:0/4134427818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f450c15d590 0x7f450c1f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:31.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.746+0000 7f450b7fe700 1 -- 172.21.15.49:0/4134427818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f450c0cd370 msgr2=0x7f450c15c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:31.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.746+0000 7f450b7fe700 1 --2- 172.21.15.49:0/4134427818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f450c0cd370 0x7f450c15c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.746+0000 7f450b7fe700 1 -- 172.21.15.49:0/4134427818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f450c15d590 msgr2=0x7f450c1f2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:31.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.746+0000 7f450b7fe700 1 --2- 172.21.15.49:0/4134427818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f450c15d590 0x7f450c1f2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.746+0000 7f450b7fe700 1 -- 172.21.15.49:0/4134427818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f40094b0 con 0x7f450c06d030 2023-07-21T22:13:31.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.746+0000 7f450b7fe700 1 --2- 172.21.15.49:0/4134427818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f450c06d030 0x7f450c152440 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f44fc00c500 tx=0x7f44fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:31.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.746+0000 7f4508ff9700 1 -- 172.21.15.49:0/4134427818 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc0052d0 con 0x7f450c06d030 2023-07-21T22:13:31.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.746+0000 7f4508ff9700 1 -- 172.21.15.49:0/4134427818 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44fc005430 con 0x7f450c06d030 2023-07-21T22:13:31.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.746+0000 7f4508ff9700 1 -- 172.21.15.49:0/4134427818 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc0055a0 con 0x7f450c06d030 2023-07-21T22:13:31.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.746+0000 7f4510a9f700 1 -- 172.21.15.49:0/4134427818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450c15a330 con 0x7f450c06d030 2023-07-21T22:13:31.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.746+0000 7f4510a9f700 1 -- 172.21.15.49:0/4134427818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450c15a8f0 con 0x7f450c06d030 2023-07-21T22:13:31.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.746+0000 7f4510a9f700 1 -- 172.21.15.49:0/4134427818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450c04e500 con 0x7f450c06d030 2023-07-21T22:13:31.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.750+0000 7f4508ff9700 1 -- 172.21.15.49:0/4134427818 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f44fc0038e0 con 0x7f450c06d030 2023-07-21T22:13:31.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.750+0000 7f4508ff9700 1 --2- 172.21.15.49:0/4134427818 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f44ec06a700 0x7f44ec06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:31.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.750+0000 7f4508ff9700 1 -- 172.21.15.49:0/4134427818 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f44fc083000 con 0x7f450c06d030 2023-07-21T22:13:31.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.750+0000 7f4502ffd700 1 --2- 172.21.15.49:0/4134427818 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f44ec06a700 0x7f44ec06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:31.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.750+0000 7f4502ffd700 1 --2- 172.21.15.49:0/4134427818 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f44ec06a700 0x7f44ec06cbb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f44f40090b0 tx=0x7f44f4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.758+0000 7f4508ff9700 1 -- 172.21.15.49:0/4134427818 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44fc0b3700 con 0x7f450c06d030 2023-07-21T22:13:31.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.930+0000 7f4510a9f700 1 -- 172.21.15.49:0/4134427818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f450c0cd150 con 0x7f450c06d030 2023-07-21T22:13:31.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.942+0000 7f4508ff9700 1 -- 172.21.15.49:0/4134427818 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f44fc050640 con 0x7f450c06d030 2023-07-21T22:13:31.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.942+0000 7f4510a9f700 1 -- 172.21.15.49:0/4134427818 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f44ec06a700 msgr2=0x7f44ec06cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.946+0000 7f4510a9f700 1 --2- 172.21.15.49:0/4134427818 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f44ec06a700 0x7f44ec06cbb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f44f40090b0 tx=0x7f44f4008030 comp rx=0 tx=0).stop 2023-07-21T22:13:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.946+0000 7f4510a9f700 1 -- 172.21.15.49:0/4134427818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f450c06d030 msgr2=0x7f450c152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.946+0000 7f4510a9f700 1 --2- 172.21.15.49:0/4134427818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f450c06d030 0x7f450c152440 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f44fc00c500 tx=0x7f44fc00c8c0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.946+0000 7f4510a9f700 1 -- 172.21.15.49:0/4134427818 shutdown_connections 2023-07-21T22:13:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.946+0000 7f4510a9f700 1 --2- 172.21.15.49:0/4134427818 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f44ec06a700 0x7f44ec06cbb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.946+0000 7f4510a9f700 1 --2- 172.21.15.49:0/4134427818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f450c15d590 0x7f450c1f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.946+0000 7f4510a9f700 1 --2- 172.21.15.49:0/4134427818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f450c0cd370 0x7f450c15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.946+0000 7f4510a9f700 1 --2- 172.21.15.49:0/4134427818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f450c06d030 0x7f450c152440 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.946+0000 7f4510a9f700 1 -- 172.21.15.49:0/4134427818 >> 172.21.15.49:0/4134427818 conn(0x7f450c0cdff0 msgr2=0x7f450c0af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:31.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.946+0000 7f4510a9f700 1 -- 172.21.15.49:0/4134427818 shutdown_connections 2023-07-21T22:13:31.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:31.946+0000 7f4510a9f700 1 -- 172.21.15.49:0/4134427818 wait complete. 2023-07-21T22:13:32.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-07-21T22:13:32.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.142+0000 7f8eac365700 1 Processor -- start 2023-07-21T22:13:32.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.142+0000 7f8eac365700 1 -- start start 2023-07-21T22:13:32.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.146+0000 7f8eac365700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ea4070600 0x7f8ea406d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.146+0000 7f8eac365700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ea40cb5d0 0x7f8ea4159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.146+0000 7f8eac365700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea40cba20 con 0x7f8ea40709d0 2023-07-21T22:13:32.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.146+0000 7f8eac365700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea415a170 con 0x7f8ea40cb5d0 2023-07-21T22:13:32.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.146+0000 7f8eac365700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea406c780 con 0x7f8ea4070600 2023-07-21T22:13:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.146+0000 7f8eaa902700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8ea40709d0 0x7f8ea40c87f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53278/0 (socket says 172.21.15.49:53278) 2023-07-21T22:13:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.146+0000 7f8eaa902700 1 -- 172.21.15.49:0/1861568671 learned_addr learned my addr 172.21.15.49:0/1861568671 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:32.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.146+0000 7f8eaa101700 1 --2- 172.21.15.49:0/1861568671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ea4070600 0x7f8ea406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.146+0000 7f8ea9900700 1 --2- 172.21.15.49:0/1861568671 >> v2:172.21.15.150:3300/0 conn(0x7f8ea40cb5d0 0x7f8ea4159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.146+0000 7f8ea90ff700 1 -- 172.21.15.49:0/1861568671 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687768027 0 0) 0x7f8ea40cba20 con 0x7f8ea40709d0 2023-07-21T22:13:32.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 -- 172.21.15.49:0/1861568671 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e900057e0 con 0x7f8ea40709d0 2023-07-21T22:13:32.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 -- 172.21.15.49:0/1861568671 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 129553993 0 0) 0x7f8e900057e0 con 0x7f8ea40709d0 2023-07-21T22:13:32.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 -- 172.21.15.49:0/1861568671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ea4070600 msgr2=0x7f8ea406d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:32.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 --2- 172.21.15.49:0/1861568671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ea4070600 0x7f8ea406d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 -- 172.21.15.49:0/1861568671 >> v2:172.21.15.150:3300/0 conn(0x7f8ea40cb5d0 msgr2=0x7f8ea4159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:32.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 --2- 172.21.15.49:0/1861568671 >> v2:172.21.15.150:3300/0 conn(0x7f8ea40cb5d0 0x7f8ea4159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 -- 172.21.15.49:0/1861568671 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea406ca60 con 0x7f8ea40709d0 2023-07-21T22:13:32.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 -- 172.21.15.49:0/1861568671 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f8e9c0019f0 con 0x7f8ea40709d0 2023-07-21T22:13:32.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 -- 172.21.15.49:0/1861568671 >> v1:172.21.15.49:6789/0 conn(0x7f8ea40709d0 legacy=0x7f8ea40c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:32.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 --2- 172.21.15.49:0/1861568671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ea4070600 0x7f8e90005ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 --2- 172.21.15.49:0/1861568671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e90006270 0x7f8e90006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 --2- 172.21.15.49:0/1861568671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e90006fc0 0x7f8e90007430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 -- 172.21.15.49:0/1861568671 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea415a170 con 0x7f8e90006270 2023-07-21T22:13:32.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 -- 172.21.15.49:0/1861568671 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea406c780 con 0x7f8e90006fc0 2023-07-21T22:13:32.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 -- 172.21.15.49:0/1861568671 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9000dd40 con 0x7f8ea4070600 2023-07-21T22:13:32.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea9900700 1 --2- 172.21.15.49:0/1861568671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e90006270 0x7f8e90006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8eaa902700 1 --2- 172.21.15.49:0/1861568671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e90006fc0 0x7f8e90007430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8eaa101700 1 --2- 172.21.15.49:0/1861568671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ea4070600 0x7f8e90005ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea9900700 1 -- 172.21.15.49:0/1861568671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ea4070600 msgr2=0x7f8e90005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:32.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea9900700 1 --2- 172.21.15.49:0/1861568671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ea4070600 0x7f8e90005ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea9900700 1 -- 172.21.15.49:0/1861568671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e90006fc0 msgr2=0x7f8e90007430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:32.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea9900700 1 --2- 172.21.15.49:0/1861568671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e90006fc0 0x7f8e90007430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea9900700 1 -- 172.21.15.49:0/1861568671 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e900057e0 con 0x7f8e90006270 2023-07-21T22:13:32.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8eaa101700 1 --2- 172.21.15.49:0/1861568671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ea4070600 0x7f8e90005ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:32.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea9900700 1 --2- 172.21.15.49:0/1861568671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e90006270 0x7f8e90006a80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009b70 tx=0x7f8e90007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35530168e3ec2db server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:32.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 -- 172.21.15.49:0/1861568671 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9400e6c0 con 0x7f8e90006270 2023-07-21T22:13:32.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 -- 172.21.15.49:0/1861568671 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9400e820 con 0x7f8e90006270 2023-07-21T22:13:32.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.150+0000 7f8ea90ff700 1 -- 172.21.15.49:0/1861568671 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9400eb90 con 0x7f8e90006270 2023-07-21T22:13:32.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.154+0000 7f8eac365700 1 -- 172.21.15.49:0/1861568671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e90006270 msgr2=0x7f8e90006a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:32.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.154+0000 7f8eac365700 1 --2- 172.21.15.49:0/1861568671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e90006270 0x7f8e90006a80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009b70 tx=0x7f8e90007ab0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.154+0000 7f8eaa902700 1 -- 172.21.15.49:0/1861568671 reap_dead start 2023-07-21T22:13:32.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.154+0000 7f8eac365700 1 -- 172.21.15.49:0/1861568671 shutdown_connections 2023-07-21T22:13:32.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.154+0000 7f8eac365700 1 -- 172.21.15.49:0/1861568671 >> 172.21.15.49:0/1861568671 conn(0x7f8ea406f5a0 msgr2=0x7f8ea40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:32.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.154+0000 7f8eac365700 1 -- 172.21.15.49:0/1861568671 shutdown_connections 2023-07-21T22:13:32.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.154+0000 7f8eac365700 1 -- 172.21.15.49:0/1861568671 wait complete. 2023-07-21T22:13:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8eac365700 1 Processor -- start 2023-07-21T22:13:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8eac365700 1 -- start start 2023-07-21T22:13:32.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8eac365700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e90006270 0x7f8ea41465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8eac365700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea41514d0 0x7f8ea4151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8eac365700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ea40aed30 0x7f8ea40af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8eac365700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4151e80 con 0x7f8ea41514d0 2023-07-21T22:13:32.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8eac365700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40afa60 con 0x7f8ea40aed30 2023-07-21T22:13:32.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8eac365700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40b2520 con 0x7f8e90006270 2023-07-21T22:13:32.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8ea9900700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea41514d0 0x7f8ea4151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8ea9900700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea41514d0 0x7f8ea4151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50466/0 (socket says 172.21.15.49:50466) 2023-07-21T22:13:32.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8ea9900700 1 -- 172.21.15.49:0/273753197 learned_addr learned my addr 172.21.15.49:0/273753197 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:32.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8eaa902700 1 --2- 172.21.15.49:0/273753197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ea40aed30 0x7f8ea40af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8eaa101700 1 --2- 172.21.15.49:0/273753197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e90006270 0x7f8ea41465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8ea9900700 1 -- 172.21.15.49:0/273753197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e90006270 msgr2=0x7f8ea41465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:32.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8ea9900700 1 --2- 172.21.15.49:0/273753197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e90006270 0x7f8ea41465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8ea9900700 1 -- 172.21.15.49:0/273753197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ea40aed30 msgr2=0x7f8ea40af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:32.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8ea9900700 1 --2- 172.21.15.49:0/273753197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ea40aed30 0x7f8ea40af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8ea9900700 1 -- 172.21.15.49:0/273753197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40b2800 con 0x7f8ea41514d0 2023-07-21T22:13:32.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8ea9900700 1 --2- 172.21.15.49:0/273753197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea41514d0 0x7f8ea4151940 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8e900069c0 tx=0x7f8e940047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:32.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8e9affd700 1 -- 172.21.15.49:0/273753197 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9400e6c0 con 0x7f8ea41514d0 2023-07-21T22:13:32.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.162+0000 7f8eac365700 1 -- 172.21.15.49:0/273753197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea40b2ae0 con 0x7f8ea41514d0 2023-07-21T22:13:32.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.158+0000 7f8e9affd700 1 -- 172.21.15.49:0/273753197 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e94004050 con 0x7f8ea41514d0 2023-07-21T22:13:32.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.162+0000 7f8e9affd700 1 -- 172.21.15.49:0/273753197 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e94004400 con 0x7f8ea41514d0 2023-07-21T22:13:32.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.162+0000 7f8eac365700 1 -- 172.21.15.49:0/273753197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea4146b00 con 0x7f8ea41514d0 2023-07-21T22:13:32.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.162+0000 7f8eac365700 1 -- 172.21.15.49:0/273753197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea404dcb0 con 0x7f8ea41514d0 2023-07-21T22:13:32.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.162+0000 7f8e9affd700 1 -- 172.21.15.49:0/273753197 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8e940036c0 con 0x7f8ea41514d0 2023-07-21T22:13:32.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.166+0000 7f8e9affd700 1 --2- 172.21.15.49:0/273753197 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8e88066320 0x7f8e880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.166+0000 7f8e9affd700 1 -- 172.21.15.49:0/273753197 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f8e940850b0 con 0x7f8ea41514d0 2023-07-21T22:13:32.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.166+0000 7f8eaa101700 1 --2- 172.21.15.49:0/273753197 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8e88066320 0x7f8e880687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.166+0000 7f8eaa101700 1 --2- 172.21.15.49:0/273753197 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8e88066320 0x7f8e880687d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009a40 tx=0x7f8ea0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:32.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.170+0000 7f8e9affd700 1 -- 172.21.15.49:0/273753197 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e940528d0 con 0x7f8ea41514d0 2023-07-21T22:13:32.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.406+0000 7f8eac365700 1 -- 172.21.15.49:0/273753197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f8ea40ad7e0 con 0x7f8ea41514d0 2023-07-21T22:13:32.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.526+0000 7f8e9affd700 1 -- 172.21.15.49:0/273753197 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v185) v1 ==== 147+0+0 (secure 0 0 0) 0x7f8e94055ef0 con 0x7f8ea41514d0 2023-07-21T22:13:32.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.530+0000 7f8eac365700 1 -- 172.21.15.49:0/273753197 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8e88066320 msgr2=0x7f8e880687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:32.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.530+0000 7f8eac365700 1 --2- 172.21.15.49:0/273753197 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8e88066320 0x7f8e880687d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009a40 tx=0x7f8ea0008040 comp rx=0 tx=0).stop 2023-07-21T22:13:32.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.530+0000 7f8eac365700 1 -- 172.21.15.49:0/273753197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea41514d0 msgr2=0x7f8ea4151940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:32.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.530+0000 7f8eac365700 1 --2- 172.21.15.49:0/273753197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea41514d0 0x7f8ea4151940 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8e900069c0 tx=0x7f8e940047e0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.530+0000 7f8eac365700 1 -- 172.21.15.49:0/273753197 shutdown_connections 2023-07-21T22:13:32.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.530+0000 7f8eac365700 1 --2- 172.21.15.49:0/273753197 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8e88066320 0x7f8e880687d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.530+0000 7f8eac365700 1 --2- 172.21.15.49:0/273753197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea41514d0 0x7f8ea4151940 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.530+0000 7f8eac365700 1 --2- 172.21.15.49:0/273753197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ea40aed30 0x7f8ea40af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.530+0000 7f8eac365700 1 --2- 172.21.15.49:0/273753197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e90006270 0x7f8ea41465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.530+0000 7f8eac365700 1 -- 172.21.15.49:0/273753197 >> 172.21.15.49:0/273753197 conn(0x7f8ea406f5a0 msgr2=0x7f8ea40c9500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:32.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.530+0000 7f8eac365700 1 -- 172.21.15.49:0/273753197 shutdown_connections 2023-07-21T22:13:32.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.530+0000 7f8eac365700 1 -- 172.21.15.49:0/273753197 wait complete. 2023-07-21T22:13:32.595 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ok 2023-07-21T22:13:32.595 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-07-21T22:13:32.596 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-07-21T22:13:32.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.734+0000 7f2bbbb92700 1 Processor -- start 2023-07-21T22:13:32.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.734+0000 7f2bbbb92700 1 -- start start 2023-07-21T22:13:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.734+0000 7f2bbbb92700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2bb41604c0 0x7f2bb40afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.734+0000 7f2bbbb92700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2bb40c8860 0x7f2bb4070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.734+0000 7f2bbbb92700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb40b0530 con 0x7f2bb40afc20 2023-07-21T22:13:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.734+0000 7f2bbbb92700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb4163df0 con 0x7f2bb40c8860 2023-07-21T22:13:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.734+0000 7f2bbbb92700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb41640d0 con 0x7f2bb41604c0 2023-07-21T22:13:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bb992e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f2bb40afc20 0x7f2bb40cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:60304/0 (socket says 172.21.15.49:60304) 2023-07-21T22:13:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bb992e700 1 -- 172.21.15.49:0/106282086 learned_addr learned my addr 172.21.15.49:0/106282086 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bba12f700 1 --2- 172.21.15.49:0/106282086 >> v2:172.21.15.49:3300/0 conn(0x7f2bb40c8860 0x7f2bb4070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bb912d700 1 --2- 172.21.15.49:0/106282086 >> v2:172.21.15.150:3300/0 conn(0x7f2bb41604c0 0x7f2bb40afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bb892c700 1 -- 172.21.15.49:0/106282086 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234460887 0 0) 0x7f2bb40b0530 con 0x7f2bb40afc20 2023-07-21T22:13:32.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bb892c700 1 -- 172.21.15.49:0/106282086 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ba00035d0 con 0x7f2bb40afc20 2023-07-21T22:13:32.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bba12f700 1 -- 172.21.15.49:0/106282086 >> v2:172.21.15.150:3300/0 conn(0x7f2bb41604c0 msgr2=0x7f2bb40afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bba12f700 1 --2- 172.21.15.49:0/106282086 >> v2:172.21.15.150:3300/0 conn(0x7f2bb41604c0 0x7f2bb40afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bba12f700 1 -- 172.21.15.49:0/106282086 >> v1:172.21.15.150:6789/0 conn(0x7f2bb40afc20 legacy=0x7f2bb40cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bba12f700 1 -- 172.21.15.49:0/106282086 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb41643b0 con 0x7f2bb40c8860 2023-07-21T22:13:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bb912d700 1 --2- 172.21.15.49:0/106282086 >> v2:172.21.15.150:3300/0 conn(0x7f2bb41604c0 0x7f2bb40afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bba12f700 1 --2- 172.21.15.49:0/106282086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bb40c8860 0x7f2bb4070600 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2bb406b920 tx=0x7f2bac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a99e2ea2f9a56b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bb892c700 1 -- 172.21.15.49:0/106282086 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac00e070 con 0x7f2bb40c8860 2023-07-21T22:13:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bb892c700 1 -- 172.21.15.49:0/106282086 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac00bb20 con 0x7f2bb40c8860 2023-07-21T22:13:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bb892c700 1 -- 172.21.15.49:0/106282086 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac00be90 con 0x7f2bb40c8860 2023-07-21T22:13:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bbbb92700 1 -- 172.21.15.49:0/106282086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bb40c8860 msgr2=0x7f2bb4070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bbbb92700 1 --2- 172.21.15.49:0/106282086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bb40c8860 0x7f2bb4070600 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2bb406b920 tx=0x7f2bac00b330 comp rx=0 tx=0).stop 2023-07-21T22:13:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bbbb92700 1 -- 172.21.15.49:0/106282086 shutdown_connections 2023-07-21T22:13:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bbbb92700 1 --2- 172.21.15.49:0/106282086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bb40c8860 0x7f2bb4070600 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bbbb92700 1 --2- 172.21.15.49:0/106282086 >> v2:172.21.15.150:3300/0 conn(0x7f2bb41604c0 0x7f2bb40afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bbbb92700 1 -- 172.21.15.49:0/106282086 >> 172.21.15.49:0/106282086 conn(0x7f2bb406f5a0 msgr2=0x7f2bb40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bbbb92700 1 -- 172.21.15.49:0/106282086 shutdown_connections 2023-07-21T22:13:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.738+0000 7f2bbbb92700 1 -- 172.21.15.49:0/106282086 wait complete. 2023-07-21T22:13:32.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.742+0000 7f2bbbb92700 1 Processor -- start 2023-07-21T22:13:32.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.742+0000 7f2bbbb92700 1 -- start start 2023-07-21T22:13:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.742+0000 7f2bbbb92700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bb40afc20 0x7f2bb415b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.742+0000 7f2bbbb92700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb40c8860 0x7f2bb4154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.742+0000 7f2bbbb92700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bb41604c0 0x7f2bb406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.742+0000 7f2bbbb92700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb40c1cd0 con 0x7f2bb40afc20 2023-07-21T22:13:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.742+0000 7f2bbbb92700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb415a380 con 0x7f2bb41604c0 2023-07-21T22:13:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.742+0000 7f2bbbb92700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb415a660 con 0x7f2bb40c8860 2023-07-21T22:13:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bb992e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bb40afc20 0x7f2bb415b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bb912d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb40c8860 0x7f2bb4154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bb992e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bb40afc20 0x7f2bb415b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50488/0 (socket says 172.21.15.49:50488) 2023-07-21T22:13:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bb992e700 1 -- 172.21.15.49:0/696599862 learned_addr learned my addr 172.21.15.49:0/696599862 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bba12f700 1 --2- 172.21.15.49:0/696599862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bb41604c0 0x7f2bb406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bb992e700 1 -- 172.21.15.49:0/696599862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb40c8860 msgr2=0x7f2bb4154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bb992e700 1 --2- 172.21.15.49:0/696599862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb40c8860 0x7f2bb4154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bb992e700 1 -- 172.21.15.49:0/696599862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bb41604c0 msgr2=0x7f2bb406d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bb992e700 1 --2- 172.21.15.49:0/696599862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bb41604c0 0x7f2bb406d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bb992e700 1 -- 172.21.15.49:0/696599862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac009a70 con 0x7f2bb40afc20 2023-07-21T22:13:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bb912d700 1 --2- 172.21.15.49:0/696599862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb40c8860 0x7f2bb4154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bb992e700 1 --2- 172.21.15.49:0/696599862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bb40afc20 0x7f2bb415b140 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000c4f0 tx=0x7f2bb000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2baa7fc700 1 -- 172.21.15.49:0/696599862 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0005d90 con 0x7f2bb40afc20 2023-07-21T22:13:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2baa7fc700 1 -- 172.21.15.49:0/696599862 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb00070d0 con 0x7f2bb40afc20 2023-07-21T22:13:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2baa7fc700 1 -- 172.21.15.49:0/696599862 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0007440 con 0x7f2bb40afc20 2023-07-21T22:13:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bbbb92700 1 -- 172.21.15.49:0/696599862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb40c1f20 con 0x7f2bb40afc20 2023-07-21T22:13:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bbbb92700 1 -- 172.21.15.49:0/696599862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb415b680 con 0x7f2bb40afc20 2023-07-21T22:13:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.746+0000 7f2bbbb92700 1 -- 172.21.15.49:0/696599862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb40c2440 con 0x7f2bb40afc20 2023-07-21T22:13:32.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.750+0000 7f2baa7fc700 1 -- 172.21.15.49:0/696599862 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2bb00075a0 con 0x7f2bb40afc20 2023-07-21T22:13:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.750+0000 7f2baa7fc700 1 --2- 172.21.15.49:0/696599862 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2b980662f0 0x7f2b980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.750+0000 7f2baa7fc700 1 -- 172.21.15.49:0/696599862 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f2bb0082e00 con 0x7f2bb40afc20 2023-07-21T22:13:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.750+0000 7f2bb912d700 1 --2- 172.21.15.49:0/696599862 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2b980662f0 0x7f2b980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:32.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.754+0000 7f2bb912d700 1 --2- 172.21.15.49:0/696599862 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2b980662f0 0x7f2b980687a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2bb406e0c0 tx=0x7f2ba4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.758+0000 7f2baa7fc700 1 -- 172.21.15.49:0/696599862 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2bb40c2440 con 0x7f2bb40afc20 2023-07-21T22:13:33.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:32.990+0000 7f2bbbb92700 1 -- 172.21.15.49:0/696599862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7f2bb404dcb0 con 0x7f2bb40afc20 2023-07-21T22:13:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.530+0000 7f2baa7fc700 1 -- 172.21.15.49:0/696599862 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v186) v1 ==== 137+0+0 (secure 0 0 0) 0x7f2bb0017020 con 0x7f2bb40afc20 2023-07-21T22:13:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.534+0000 7f2bbbb92700 1 -- 172.21.15.49:0/696599862 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2b980662f0 msgr2=0x7f2b980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.534+0000 7f2bbbb92700 1 --2- 172.21.15.49:0/696599862 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2b980662f0 0x7f2b980687a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2bb406e0c0 tx=0x7f2ba4008040 comp rx=0 tx=0).stop 2023-07-21T22:13:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.534+0000 7f2bbbb92700 1 -- 172.21.15.49:0/696599862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bb40afc20 msgr2=0x7f2bb415b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.534+0000 7f2bbbb92700 1 --2- 172.21.15.49:0/696599862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bb40afc20 0x7f2bb415b140 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000c4f0 tx=0x7f2bb000c800 comp rx=0 tx=0).stop 2023-07-21T22:13:33.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.534+0000 7f2bbbb92700 1 -- 172.21.15.49:0/696599862 shutdown_connections 2023-07-21T22:13:33.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.534+0000 7f2bbbb92700 1 --2- 172.21.15.49:0/696599862 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2b980662f0 0x7f2b980687a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:33.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.534+0000 7f2bbbb92700 1 --2- 172.21.15.49:0/696599862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bb41604c0 0x7f2bb406d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:33.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.534+0000 7f2bbbb92700 1 --2- 172.21.15.49:0/696599862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb40c8860 0x7f2bb4154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:33.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.534+0000 7f2bbbb92700 1 --2- 172.21.15.49:0/696599862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bb40afc20 0x7f2bb415b140 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:33.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.534+0000 7f2bbbb92700 1 -- 172.21.15.49:0/696599862 >> 172.21.15.49:0/696599862 conn(0x7f2bb406f5a0 msgr2=0x7f2bb4070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:33.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.534+0000 7f2bbbb92700 1 -- 172.21.15.49:0/696599862 shutdown_connections 2023-07-21T22:13:33.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.534+0000 7f2bbbb92700 1 -- 172.21.15.49:0/696599862 wait complete. 2023-07-21T22:13:33.601 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T22:13:33.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.742+0000 7f73d236b700 1 Processor -- start 2023-07-21T22:13:33.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.742+0000 7f73d236b700 1 -- start start 2023-07-21T22:13:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.742+0000 7f73d236b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73cc0d1e40 0x7f73cc0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.742+0000 7f73d236b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc0b3e80 con 0x7f73cc0b7af0 2023-07-21T22:13:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.742+0000 7f73d236b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc15fd40 con 0x7f73cc0cee10 2023-07-21T22:13:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.742+0000 7f73d236b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73cc0cea00 con 0x7f73cc0d1e40 2023-07-21T22:13:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73d0b68700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73cc0d1e40 0x7f73cc0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73d0b68700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73cc0d1e40 0x7f73cc0b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50498/0 (socket says 172.21.15.49:50498) 2023-07-21T22:13:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73d0b68700 1 -- 172.21.15.49:0/2330448133 learned_addr learned my addr 172.21.15.49:0/2330448133 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73d0b68700 1 -- 172.21.15.49:0/2330448133 >> v1:172.21.15.150:6789/0 conn(0x7f73cc0cee10 legacy=0x7f73cc0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73d0b68700 1 -- 172.21.15.49:0/2330448133 >> v1:172.21.15.49:6789/0 conn(0x7f73cc0b7af0 legacy=0x7f73cc15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73d0b68700 1 -- 172.21.15.49:0/2330448133 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc0ccbf0 con 0x7f73cc0d1e40 2023-07-21T22:13:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73d0b68700 1 --2- 172.21.15.49:0/2330448133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc0d1e40 0x7f73cc0b1630 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f73bc009910 tx=0x7f73bc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9372ae004e6740c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73c3fff700 1 -- 172.21.15.49:0/2330448133 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc00ba60 con 0x7f73cc0d1e40 2023-07-21T22:13:33.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73c3fff700 1 -- 172.21.15.49:0/2330448133 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc00bbc0 con 0x7f73cc0d1e40 2023-07-21T22:13:33.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73c3fff700 1 -- 172.21.15.49:0/2330448133 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc009e60 con 0x7f73cc0d1e40 2023-07-21T22:13:33.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73d236b700 1 -- 172.21.15.49:0/2330448133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc0d1e40 msgr2=0x7f73cc0b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:33.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73d236b700 1 --2- 172.21.15.49:0/2330448133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc0d1e40 0x7f73cc0b1630 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f73bc009910 tx=0x7f73bc009c20 comp rx=0 tx=0).stop 2023-07-21T22:13:33.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73d236b700 1 -- 172.21.15.49:0/2330448133 shutdown_connections 2023-07-21T22:13:33.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73d236b700 1 --2- 172.21.15.49:0/2330448133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc0d1e40 0x7f73cc0b1630 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:33.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73d236b700 1 -- 172.21.15.49:0/2330448133 >> 172.21.15.49:0/2330448133 conn(0x7f73cc06e960 msgr2=0x7f73cc06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:33.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73d236b700 1 -- 172.21.15.49:0/2330448133 shutdown_connections 2023-07-21T22:13:33.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.746+0000 7f73d236b700 1 -- 172.21.15.49:0/2330448133 wait complete. 2023-07-21T22:13:33.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.750+0000 7f73d236b700 1 Processor -- start 2023-07-21T22:13:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.750+0000 7f73d236b700 1 -- start start 2023-07-21T22:13:33.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d236b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73cc0b7af0 0x7f73cc156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:33.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d236b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73cc0cee10 0x7f73cc14dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:33.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d236b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc0d1e40 0x7f73cc0caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:33.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d236b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc0cbc50 con 0x7f73cc0d1e40 2023-07-21T22:13:33.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d236b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc0cb970 con 0x7f73cc0b7af0 2023-07-21T22:13:33.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d236b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc155d40 con 0x7f73cc0cee10 2023-07-21T22:13:33.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d1b6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc0d1e40 0x7f73cc0caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:33.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d1b6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc0d1e40 0x7f73cc0caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50506/0 (socket says 172.21.15.49:50506) 2023-07-21T22:13:33.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d1b6a700 1 -- 172.21.15.49:0/2373058322 learned_addr learned my addr 172.21.15.49:0/2373058322 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:33.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d1369700 1 --2- 172.21.15.49:0/2373058322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73cc0b7af0 0x7f73cc156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:33.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d0b68700 1 --2- 172.21.15.49:0/2373058322 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73cc0cee10 0x7f73cc14dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:33.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d1b6a700 1 -- 172.21.15.49:0/2373058322 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73cc0cee10 msgr2=0x7f73cc14dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:33.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d1b6a700 1 --2- 172.21.15.49:0/2373058322 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73cc0cee10 0x7f73cc14dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d1b6a700 1 -- 172.21.15.49:0/2373058322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73cc0b7af0 msgr2=0x7f73cc156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d1b6a700 1 --2- 172.21.15.49:0/2373058322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73cc0b7af0 0x7f73cc156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.754+0000 7f73d1b6a700 1 -- 172.21.15.49:0/2373058322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc009570 con 0x7f73cc0d1e40 2023-07-21T22:13:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.758+0000 7f73d1b6a700 1 --2- 172.21.15.49:0/2373058322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc0d1e40 0x7f73cc0caed0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f73c400cb90 tx=0x7f73c400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.758+0000 7f73c1ffb700 1 -- 172.21.15.49:0/2373058322 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c4003c70 con 0x7f73cc0d1e40 2023-07-21T22:13:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.758+0000 7f73c1ffb700 1 -- 172.21.15.49:0/2373058322 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c4003df0 con 0x7f73cc0d1e40 2023-07-21T22:13:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.758+0000 7f73d236b700 1 -- 172.21.15.49:0/2373058322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73cc156020 con 0x7f73cc0d1e40 2023-07-21T22:13:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.758+0000 7f73c1ffb700 1 -- 172.21.15.49:0/2373058322 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c400aae0 con 0x7f73cc0d1e40 2023-07-21T22:13:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.758+0000 7f73d236b700 1 -- 172.21.15.49:0/2373058322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73cc14ece0 con 0x7f73cc0d1e40 2023-07-21T22:13:33.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.758+0000 7f73d236b700 1 -- 172.21.15.49:0/2373058322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73cc156540 con 0x7f73cc0d1e40 2023-07-21T22:13:33.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.762+0000 7f73c1ffb700 1 -- 172.21.15.49:0/2373058322 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f73c400ac40 con 0x7f73cc0d1e40 2023-07-21T22:13:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.766+0000 7f73c1ffb700 1 --2- 172.21.15.49:0/2373058322 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f73b00662f0 0x7f73b00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.766+0000 7f73c1ffb700 1 -- 172.21.15.49:0/2373058322 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f73c4083b80 con 0x7f73cc0d1e40 2023-07-21T22:13:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.766+0000 7f73d1369700 1 --2- 172.21.15.49:0/2373058322 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f73b00662f0 0x7f73b00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.766+0000 7f73d1369700 1 --2- 172.21.15.49:0/2373058322 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f73b00662f0 0x7f73b00687a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f73c8000f60 tx=0x7f73c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.770+0000 7f73c1ffb700 1 -- 172.21.15.49:0/2373058322 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73cc156540 con 0x7f73cc0d1e40 2023-07-21T22:13:33.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.945+0000 7f73d236b700 1 -- 172.21.15.49:0/2373058322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f73cc156540 con 0x7f73cc0d1e40 2023-07-21T22:13:34.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.957+0000 7f73c1ffb700 1 -- 172.21.15.49:0/2373058322 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f73cc156540 con 0x7f73cc0d1e40 2023-07-21T22:13:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.961+0000 7f73d236b700 1 -- 172.21.15.49:0/2373058322 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f73b00662f0 msgr2=0x7f73b00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.961+0000 7f73d236b700 1 --2- 172.21.15.49:0/2373058322 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f73b00662f0 0x7f73b00687a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f73c8000f60 tx=0x7f73c8009040 comp rx=0 tx=0).stop 2023-07-21T22:13:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.961+0000 7f73d236b700 1 -- 172.21.15.49:0/2373058322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc0d1e40 msgr2=0x7f73cc0caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.961+0000 7f73d236b700 1 --2- 172.21.15.49:0/2373058322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc0d1e40 0x7f73cc0caed0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f73c400cb90 tx=0x7f73c400cea0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.961+0000 7f73d236b700 1 -- 172.21.15.49:0/2373058322 shutdown_connections 2023-07-21T22:13:34.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.961+0000 7f73d236b700 1 --2- 172.21.15.49:0/2373058322 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f73b00662f0 0x7f73b00687a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.961+0000 7f73d236b700 1 --2- 172.21.15.49:0/2373058322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc0d1e40 0x7f73cc0caed0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.961+0000 7f73d236b700 1 --2- 172.21.15.49:0/2373058322 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73cc0cee10 0x7f73cc14dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.961+0000 7f73d236b700 1 --2- 172.21.15.49:0/2373058322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73cc0b7af0 0x7f73cc156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.961+0000 7f73d236b700 1 -- 172.21.15.49:0/2373058322 >> 172.21.15.49:0/2373058322 conn(0x7f73cc06e960 msgr2=0x7f73cc0b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:34.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.961+0000 7f73d236b700 1 -- 172.21.15.49:0/2373058322 shutdown_connections 2023-07-21T22:13:34.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:33.961+0000 7f73d236b700 1 -- 172.21.15.49:0/2373058322 wait complete. 2023-07-21T22:13:34.026 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:13:34.027 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:13:34.069 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:13:34.113 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:13:34.113 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:13:34.113 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:13:34.133 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352276k,nr_inodes=4088069,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13711 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:13:34.134 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:13:34.134 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:13:34.171 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352340k,nr_inodes=4088085,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2732 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:13:34.172 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:13:34.173 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:13:34.193 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352276k,nr_inodes=4088069,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13711 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:13:34.194 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:13:34.194 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:13:34.233 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352340k,nr_inodes=4088085,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2732 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:13:34.233 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-21T22:13:34.233 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:13:34.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f020759e700 1 Processor -- start 2023-07-21T22:13:34.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f020759e700 1 -- start start 2023-07-21T22:13:34.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f020759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f020806d380 0x7f020806d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:34.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f020759e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0208071c70 0x7f02080b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:34.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f020759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f02080b1400 0x7f02080cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:34.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f020759e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02080c9e80 con 0x7f0208071c70 2023-07-21T22:13:34.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f020759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02080afeb0 con 0x7f02080b1400 2023-07-21T22:13:34.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f020759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02080cab20 con 0x7f020806d380 2023-07-21T22:13:34.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f01fffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0208071c70 0x7f02080b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:34.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f0206d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f02080b1400 0x7f02080cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:34.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f020659c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f020806d380 0x7f020806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:34.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f0206d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f02080b1400 0x7f02080cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:52258/0 (socket says 172.21.15.49:52258) 2023-07-21T22:13:34.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f0206d9d700 1 -- 172.21.15.49:0/3142266163 learned_addr learned my addr 172.21.15.49:0/3142266163 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:34.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f0206d9d700 1 -- 172.21.15.49:0/3142266163 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f020806d380 msgr2=0x7f020806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:34.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f0206d9d700 1 --2- 172.21.15.49:0/3142266163 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f020806d380 0x7f020806d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f0206d9d700 1 -- 172.21.15.49:0/3142266163 >> v2:172.21.15.49:3300/0 conn(0x7f0208071c70 msgr2=0x7f02080b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:34.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f0206d9d700 1 --2- 172.21.15.49:0/3142266163 >> v2:172.21.15.49:3300/0 conn(0x7f0208071c70 0x7f02080b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.381+0000 7f0206d9d700 1 -- 172.21.15.49:0/3142266163 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020806dc90 con 0x7f02080b1400 2023-07-21T22:13:34.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.385+0000 7f01fffff700 1 --2- 172.21.15.49:0/3142266163 >> v2:172.21.15.49:3300/0 conn(0x7f0208071c70 0x7f02080b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:34.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.385+0000 7f0206d9d700 1 --2- 172.21.15.49:0/3142266163 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02080b1400 0x7f02080cafb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f02080c1940 tx=0x7f020000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40592207362eb3a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:34.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.385+0000 7f0205d9b700 1 -- 172.21.15.49:0/3142266163 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020000e070 con 0x7f02080b1400 2023-07-21T22:13:34.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.385+0000 7f0205d9b700 1 -- 172.21.15.49:0/3142266163 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020000b910 con 0x7f02080b1400 2023-07-21T22:13:34.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.385+0000 7f0205d9b700 1 -- 172.21.15.49:0/3142266163 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020000bcc0 con 0x7f02080b1400 2023-07-21T22:13:34.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.385+0000 7f020759e700 1 -- 172.21.15.49:0/3142266163 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02080b1400 msgr2=0x7f02080cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:34.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.385+0000 7f020759e700 1 --2- 172.21.15.49:0/3142266163 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02080b1400 0x7f02080cafb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f02080c1940 tx=0x7f020000b330 comp rx=0 tx=0).stop 2023-07-21T22:13:34.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.385+0000 7f020759e700 1 -- 172.21.15.49:0/3142266163 shutdown_connections 2023-07-21T22:13:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.385+0000 7f020759e700 1 --2- 172.21.15.49:0/3142266163 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02080b1400 0x7f02080cafb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.385+0000 7f020759e700 1 --2- 172.21.15.49:0/3142266163 >> v2:172.21.15.49:3300/0 conn(0x7f0208071c70 0x7f02080b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.385+0000 7f020759e700 1 --2- 172.21.15.49:0/3142266163 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f020806d380 0x7f020806d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.385+0000 7f020759e700 1 -- 172.21.15.49:0/3142266163 >> 172.21.15.49:0/3142266163 conn(0x7f0208070450 msgr2=0x7f0208070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.385+0000 7f020759e700 1 -- 172.21.15.49:0/3142266163 shutdown_connections 2023-07-21T22:13:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.385+0000 7f020759e700 1 -- 172.21.15.49:0/3142266163 wait complete. 2023-07-21T22:13:34.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.389+0000 7f020759e700 1 Processor -- start 2023-07-21T22:13:34.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.389+0000 7f020759e700 1 -- start start 2023-07-21T22:13:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f020759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f020806d380 0x7f02080c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f020759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0208071c70 0x7f02080c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f020759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02080b1400 0x7f020814c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f020759e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02080c4b10 con 0x7f0208071c70 2023-07-21T22:13:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f020759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020814ca30 con 0x7f020806d380 2023-07-21T22:13:34.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f020759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02080c5520 con 0x7f02080b1400 2023-07-21T22:13:34.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f01fffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0208071c70 0x7f02080c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f01fffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0208071c70 0x7f02080c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50538/0 (socket says 172.21.15.49:50538) 2023-07-21T22:13:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f01fffff700 1 -- 172.21.15.49:0/4161160360 learned_addr learned my addr 172.21.15.49:0/4161160360 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f020659c700 1 --2- 172.21.15.49:0/4161160360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f020806d380 0x7f02080c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f0206d9d700 1 --2- 172.21.15.49:0/4161160360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02080b1400 0x7f020814c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f01fffff700 1 -- 172.21.15.49:0/4161160360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02080b1400 msgr2=0x7f020814c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f01fffff700 1 --2- 172.21.15.49:0/4161160360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02080b1400 0x7f020814c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f01fffff700 1 -- 172.21.15.49:0/4161160360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f020806d380 msgr2=0x7f02080c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:34.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f01fffff700 1 --2- 172.21.15.49:0/4161160360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f020806d380 0x7f02080c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f01fffff700 1 -- 172.21.15.49:0/4161160360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f00094b0 con 0x7f0208071c70 2023-07-21T22:13:34.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f01fffff700 1 --2- 172.21.15.49:0/4161160360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0208071c70 0x7f02080c45d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f01f000ebe0 tx=0x7f01f000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:34.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f01feffd700 1 -- 172.21.15.49:0/4161160360 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f000c890 con 0x7f0208071c70 2023-07-21T22:13:34.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f01feffd700 1 -- 172.21.15.49:0/4161160360 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f000c9f0 con 0x7f0208071c70 2023-07-21T22:13:34.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f020759e700 1 -- 172.21.15.49:0/4161160360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0200009b30 con 0x7f0208071c70 2023-07-21T22:13:34.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f01feffd700 1 -- 172.21.15.49:0/4161160360 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f000cd80 con 0x7f0208071c70 2023-07-21T22:13:34.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.393+0000 7f020759e700 1 -- 172.21.15.49:0/4161160360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02080c5ae0 con 0x7f0208071c70 2023-07-21T22:13:34.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.397+0000 7f020759e700 1 -- 172.21.15.49:0/4161160360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020804dcb0 con 0x7f0208071c70 2023-07-21T22:13:34.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.397+0000 7f01feffd700 1 -- 172.21.15.49:0/4161160360 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01f0013470 con 0x7f0208071c70 2023-07-21T22:13:34.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.397+0000 7f01feffd700 1 --2- 172.21.15.49:0/4161160360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01e80662f0 0x7f01e80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:34.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.397+0000 7f01feffd700 1 -- 172.21.15.49:0/4161160360 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f01f0083c70 con 0x7f0208071c70 2023-07-21T22:13:34.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.397+0000 7f020659c700 1 --2- 172.21.15.49:0/4161160360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01e80662f0 0x7f01e80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:34.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.401+0000 7f020659c700 1 --2- 172.21.15.49:0/4161160360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01e80662f0 0x7f01e80687a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009ad0 tx=0x7f01f8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:34.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.401+0000 7f01feffd700 1 -- 172.21.15.49:0/4161160360 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01f0051220 con 0x7f0208071c70 2023-07-21T22:13:34.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.617+0000 7f020759e700 1 -- 172.21.15.49:0/4161160360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02080ca780 con 0x7f0208071c70 2023-07-21T22:13:34.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.617+0000 7f01feffd700 1 -- 172.21.15.49:0/4161160360 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f01f0021090 con 0x7f0208071c70 2023-07-21T22:13:34.661 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:34.661 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2563650108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2563650108},{"type":"v1","addr":"172.21.15.49:6835","nonce":2563650108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2639704311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2639704311},{"type":"v1","addr":"172.21.15.150:6833","nonce":2639704311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1930443415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1930443415},{"type":"v1","addr":"172.21.15.150:6835","nonce":1930443415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":6321,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/411350067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":411350067},{"type":"v1","addr":"172.21.15.49:6837","nonce":411350067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[]} 2023-07-21T22:13:34.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.621+0000 7f020759e700 1 -- 172.21.15.49:0/4161160360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01e80662f0 msgr2=0x7f01e80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:34.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.621+0000 7f020759e700 1 --2- 172.21.15.49:0/4161160360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01e80662f0 0x7f01e80687a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009ad0 tx=0x7f01f8009240 comp rx=0 tx=0).stop 2023-07-21T22:13:34.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.621+0000 7f020759e700 1 -- 172.21.15.49:0/4161160360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0208071c70 msgr2=0x7f02080c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:34.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.621+0000 7f020759e700 1 --2- 172.21.15.49:0/4161160360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0208071c70 0x7f02080c45d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f01f000ebe0 tx=0x7f01f000eef0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.621+0000 7f020759e700 1 -- 172.21.15.49:0/4161160360 shutdown_connections 2023-07-21T22:13:34.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.621+0000 7f020759e700 1 --2- 172.21.15.49:0/4161160360 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01e80662f0 0x7f01e80687a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.621+0000 7f020759e700 1 --2- 172.21.15.49:0/4161160360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0208071c70 0x7f02080c45d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.621+0000 7f020759e700 1 --2- 172.21.15.49:0/4161160360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02080b1400 0x7f020814c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.621+0000 7f020759e700 1 --2- 172.21.15.49:0/4161160360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f020806d380 0x7f02080c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.621+0000 7f020759e700 1 -- 172.21.15.49:0/4161160360 >> 172.21.15.49:0/4161160360 conn(0x7f0208070450 msgr2=0x7f02080b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:34.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.621+0000 7f020759e700 1 -- 172.21.15.49:0/4161160360 shutdown_connections 2023-07-21T22:13:34.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.621+0000 7f020759e700 1 -- 172.21.15.49:0/4161160360 wait complete. 2023-07-21T22:13:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 20 2023-07-21T22:13:34.686 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T22:13:34.686 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T22:13:34.686 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T22:13:34.686 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:13:34.687 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T22:13:34.687 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T22:13:34.687 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T22:13:34.687 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:13:34.687 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T22:13:34.688 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T22:13:34.688 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T22:13:34.688 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:13:34.688 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T22:13:34.689 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T22:13:34.689 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T22:13:34.689 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:13:34.706 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T22:13:34.706 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T22:13:34.707 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T22:13:34.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T22:13:34.710 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T22:13:34.710 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T22:13:34.711 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T22:13:34.711 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T22:13:34.753 INFO:tasks.ceph.mds.a:Started 2023-07-21T22:13:34.754 DEBUG:teuthology.parallel:result is None 2023-07-21T22:13:34.757 INFO:tasks.ceph.mds.d:Started 2023-07-21T22:13:34.757 DEBUG:teuthology.parallel:result is None 2023-07-21T22:13:34.759 INFO:tasks.ceph.mds.c:Started 2023-07-21T22:13:34.759 DEBUG:teuthology.parallel:result is None 2023-07-21T22:13:34.762 INFO:tasks.ceph.mds.b:Started 2023-07-21T22:13:34.762 DEBUG:teuthology.parallel:result is None 2023-07-21T22:13:34.763 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T22:13:34.869 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-07-21T22:13:34.870 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-07-21T22:13:34.878 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-07-21T22:13:34.879 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-07-21T22:13:34.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.897+0000 7f3f224dd700 1 Processor -- start 2023-07-21T22:13:34.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.897+0000 7f3f224dd700 1 -- start start 2023-07-21T22:13:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f224dd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3f1c06ded0 0x7f3f1c06cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f224dd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3f1c06f070 0x7f3f1c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f224dd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1c15e700 con 0x7f3f1c0b4b30 2023-07-21T22:13:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f224dd700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1c15db80 con 0x7f3f1c06f070 2023-07-21T22:13:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f224dd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1c15de60 con 0x7f3f1c06ded0 2023-07-21T22:13:34.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f20a7a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3f1c06f070 0x7f3f1c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f20a7a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3f1c06f070 0x7f3f1c0cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47354/0 (socket says 172.21.15.49:47354) 2023-07-21T22:13:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f20a7a700 1 -- 172.21.15.49:0/2604654592 learned_addr learned my addr 172.21.15.49:0/2604654592 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f1bfff700 1 --2- 172.21.15.49:0/2604654592 >> v2:172.21.15.150:3300/0 conn(0x7f3f1c06ded0 0x7f3f1c06cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f20a7a700 1 -- 172.21.15.49:0/2604654592 >> v2:172.21.15.150:3300/0 conn(0x7f3f1c06ded0 msgr2=0x7f3f1c06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f20a7a700 1 --2- 172.21.15.49:0/2604654592 >> v2:172.21.15.150:3300/0 conn(0x7f3f1c06ded0 0x7f3f1c06cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f20a7a700 1 -- 172.21.15.49:0/2604654592 >> v1:172.21.15.150:6789/0 conn(0x7f3f1c0b4b30 legacy=0x7f3f1c06e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f20a7a700 1 -- 172.21.15.49:0/2604654592 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c15e140 con 0x7f3f1c06f070 2023-07-21T22:13:34.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f1bfff700 1 --2- 172.21.15.49:0/2604654592 >> v2:172.21.15.150:3300/0 conn(0x7f3f1c06ded0 0x7f3f1c06cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:34.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f20a7a700 1 --2- 172.21.15.49:0/2604654592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f1c06f070 0x7f3f1c0cd1b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c073220 tx=0x7f3f1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20763249de10971 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:34.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f1b7fe700 1 -- 172.21.15.49:0/2604654592 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1400e070 con 0x7f3f1c06f070 2023-07-21T22:13:34.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f1b7fe700 1 -- 172.21.15.49:0/2604654592 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f14003a40 con 0x7f3f1c06f070 2023-07-21T22:13:34.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f1b7fe700 1 -- 172.21.15.49:0/2604654592 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14003df0 con 0x7f3f1c06f070 2023-07-21T22:13:34.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f224dd700 1 -- 172.21.15.49:0/2604654592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f1c06f070 msgr2=0x7f3f1c0cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:34.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.901+0000 7f3f224dd700 1 --2- 172.21.15.49:0/2604654592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f1c06f070 0x7f3f1c0cd1b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c073220 tx=0x7f3f1400b330 comp rx=0 tx=0).stop 2023-07-21T22:13:34.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.905+0000 7f3f224dd700 1 -- 172.21.15.49:0/2604654592 shutdown_connections 2023-07-21T22:13:34.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.905+0000 7f3f224dd700 1 --2- 172.21.15.49:0/2604654592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f1c06f070 0x7f3f1c0cd1b0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.905+0000 7f3f224dd700 1 --2- 172.21.15.49:0/2604654592 >> v2:172.21.15.150:3300/0 conn(0x7f3f1c06ded0 0x7f3f1c06cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.905+0000 7f3f224dd700 1 -- 172.21.15.49:0/2604654592 >> 172.21.15.49:0/2604654592 conn(0x7f3f1c0cffc0 msgr2=0x7f3f1c0cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:34.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.905+0000 7f3f224dd700 1 -- 172.21.15.49:0/2604654592 shutdown_connections 2023-07-21T22:13:34.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.905+0000 7f3f224dd700 1 -- 172.21.15.49:0/2604654592 wait complete. 2023-07-21T22:13:34.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.905+0000 7f3f224dd700 1 Processor -- start 2023-07-21T22:13:34.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f224dd700 1 -- start start 2023-07-21T22:13:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f224dd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f1c06ded0 0x7f3f1c15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f224dd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f1c06f070 0x7f3f1c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f224dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f1c0b4b30 0x7f3f1c0ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f224dd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c1f2400 con 0x7f3f1c06f070 2023-07-21T22:13:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f224dd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c1f1170 con 0x7f3f1c06ded0 2023-07-21T22:13:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f224dd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c15b050 con 0x7f3f1c0b4b30 2023-07-21T22:13:34.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f13fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f1c06f070 0x7f3f1c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:34.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f13fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f1c06f070 0x7f3f1c0c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47356/0 (socket says 172.21.15.49:47356) 2023-07-21T22:13:34.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f13fff700 1 -- 172.21.15.49:0/1468282193 learned_addr learned my addr 172.21.15.49:0/1468282193 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:34.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f20a7a700 1 --2- 172.21.15.49:0/1468282193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f1c0b4b30 0x7f3f1c0ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:34.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f1bfff700 1 --2- 172.21.15.49:0/1468282193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f1c06ded0 0x7f3f1c15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:34.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f13fff700 1 -- 172.21.15.49:0/1468282193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f1c0b4b30 msgr2=0x7f3f1c0ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:34.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f13fff700 1 --2- 172.21.15.49:0/1468282193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f1c0b4b30 0x7f3f1c0ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f13fff700 1 -- 172.21.15.49:0/1468282193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f1c06ded0 msgr2=0x7f3f1c15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:34.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f13fff700 1 --2- 172.21.15.49:0/1468282193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f1c06ded0 0x7f3f1c15a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:34.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f13fff700 1 -- 172.21.15.49:0/1468282193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f14009b30 con 0x7f3f1c06f070 2023-07-21T22:13:34.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.909+0000 7f3f13fff700 1 --2- 172.21.15.49:0/1468282193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f1c06f070 0x7f3f1c0c8840 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400b4a0 tx=0x7f3f0400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:34.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.913+0000 7f3f197fa700 1 -- 172.21.15.49:0/1468282193 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04011830 con 0x7f3f1c06f070 2023-07-21T22:13:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.913+0000 7f3f197fa700 1 -- 172.21.15.49:0/1468282193 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f04011990 con 0x7f3f1c06f070 2023-07-21T22:13:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.913+0000 7f3f197fa700 1 -- 172.21.15.49:0/1468282193 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04011d40 con 0x7f3f1c06f070 2023-07-21T22:13:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.913+0000 7f3f224dd700 1 -- 172.21.15.49:0/1468282193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1c15b330 con 0x7f3f1c06f070 2023-07-21T22:13:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.913+0000 7f3f224dd700 1 -- 172.21.15.49:0/1468282193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1c15b8f0 con 0x7f3f1c06f070 2023-07-21T22:13:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.913+0000 7f3f224dd700 1 -- 172.21.15.49:0/1468282193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c1f25d0 con 0x7f3f1c06f070 2023-07-21T22:13:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.913+0000 7f3f197fa700 1 -- 172.21.15.49:0/1468282193 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3f0401a400 con 0x7f3f1c06f070 2023-07-21T22:13:34.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.917+0000 7f3f197fa700 1 --2- 172.21.15.49:0/1468282193 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3efc0662f0 0x7f3efc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:34.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.917+0000 7f3f197fa700 1 -- 172.21.15.49:0/1468282193 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f3f04083740 con 0x7f3f1c06f070 2023-07-21T22:13:34.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.917+0000 7f3f1bfff700 1 --2- 172.21.15.49:0/1468282193 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3efc0662f0 0x7f3efc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:34.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.917+0000 7f3f1bfff700 1 --2- 172.21.15.49:0/1468282193 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3efc0662f0 0x7f3efc0687a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c006fd0 tx=0x7f3f0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:34.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:34.921+0000 7f3f197fa700 1 -- 172.21.15.49:0/1468282193 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f1c1f25d0 con 0x7f3f1c06f070 2023-07-21T22:13:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:35.109+0000 7f3f224dd700 1 -- 172.21.15.49:0/1468282193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3f1c1f25d0 con 0x7f3f1c06f070 2023-07-21T22:13:36.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:35.989+0000 7f3f197fa700 1 -- 172.21.15.49:0/1468282193 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v58) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3f1c1f25d0 con 0x7f3f1c06f070 2023-07-21T22:13:36.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:35.993+0000 7f3f224dd700 1 -- 172.21.15.49:0/1468282193 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3efc0662f0 msgr2=0x7f3efc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:35.993+0000 7f3f224dd700 1 --2- 172.21.15.49:0/1468282193 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3efc0662f0 0x7f3efc0687a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c006fd0 tx=0x7f3f0c008040 comp rx=0 tx=0).stop 2023-07-21T22:13:36.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:35.993+0000 7f3f224dd700 1 -- 172.21.15.49:0/1468282193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f1c06f070 msgr2=0x7f3f1c0c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:35.993+0000 7f3f224dd700 1 --2- 172.21.15.49:0/1468282193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f1c06f070 0x7f3f1c0c8840 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400b4a0 tx=0x7f3f0400b7b0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:35.993+0000 7f3f224dd700 1 -- 172.21.15.49:0/1468282193 shutdown_connections 2023-07-21T22:13:36.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:35.993+0000 7f3f224dd700 1 --2- 172.21.15.49:0/1468282193 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3efc0662f0 0x7f3efc0687a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:35.993+0000 7f3f224dd700 1 --2- 172.21.15.49:0/1468282193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f1c06f070 0x7f3f1c0c8840 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:35.993+0000 7f3f224dd700 1 --2- 172.21.15.49:0/1468282193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f1c0b4b30 0x7f3f1c0ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:35.993+0000 7f3f224dd700 1 --2- 172.21.15.49:0/1468282193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f1c06ded0 0x7f3f1c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:35.993+0000 7f3f224dd700 1 -- 172.21.15.49:0/1468282193 >> 172.21.15.49:0/1468282193 conn(0x7f3f1c0cffc0 msgr2=0x7f3f1c06e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:36.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:35.993+0000 7f3f224dd700 1 -- 172.21.15.49:0/1468282193 shutdown_connections 2023-07-21T22:13:36.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:35.993+0000 7f3f224dd700 1 -- 172.21.15.49:0/1468282193 wait complete. 2023-07-21T22:13:36.038 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-07-21T22:13:36.061 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T22:13:36.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.201+0000 7f2abb485700 1 Processor -- start 2023-07-21T22:13:36.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.201+0000 7f2abb485700 1 -- start start 2023-07-21T22:13:36.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2abb485700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ab406d380 0x7f2ab406d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:36.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2abb485700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab40cab20 con 0x7f2ab4071c70 2023-07-21T22:13:36.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2abb485700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab406dc90 con 0x7f2ab40cafb0 2023-07-21T22:13:36.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2abb485700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40c9e80 con 0x7f2ab406d380 2023-07-21T22:13:36.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9c82700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2ab4071c70 0x7f2ab40b0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58858/0 (socket says 172.21.15.49:58858) 2023-07-21T22:13:36.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9c82700 1 -- 172.21.15.49:0/2827531901 learned_addr learned my addr 172.21.15.49:0/2827531901 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:36.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2aba483700 1 --2- 172.21.15.49:0/2827531901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ab406d380 0x7f2ab406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:36.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 -- 172.21.15.49:0/2827531901 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018360234 0 0) 0x7f2ab40cab20 con 0x7f2ab4071c70 2023-07-21T22:13:36.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 -- 172.21.15.49:0/2827531901 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aa00035d0 con 0x7f2ab4071c70 2023-07-21T22:13:36.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 -- 172.21.15.49:0/2827531901 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3157712310 0 0) 0x7f2aa00035d0 con 0x7f2ab4071c70 2023-07-21T22:13:36.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 -- 172.21.15.49:0/2827531901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ab406d380 msgr2=0x7f2ab406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:36.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 --2- 172.21.15.49:0/2827531901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ab406d380 0x7f2ab406d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 -- 172.21.15.49:0/2827531901 >> v1:172.21.15.150:6789/0 conn(0x7f2ab40cafb0 legacy=0x7f2ab4164730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 -- 172.21.15.49:0/2827531901 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab40ca1f0 con 0x7f2ab4071c70 2023-07-21T22:13:36.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 -- 172.21.15.49:0/2827531901 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f2aa4001670 con 0x7f2ab4071c70 2023-07-21T22:13:36.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 -- 172.21.15.49:0/2827531901 >> v1:172.21.15.49:6789/0 conn(0x7f2ab4071c70 legacy=0x7f2ab40b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 --2- 172.21.15.49:0/2827531901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa0003a50 0x7f2aa0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:36.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 --2- 172.21.15.49:0/2827531901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa00043f0 0x7f2aa00048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:36.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 --2- 172.21.15.49:0/2827531901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ab406d380 0x7f2aa0005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:36.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 -- 172.21.15.49:0/2827531901 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa000ba30 con 0x7f2aa00043f0 2023-07-21T22:13:36.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 -- 172.21.15.49:0/2827531901 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa000bb70 con 0x7f2aa0003a50 2023-07-21T22:13:36.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.205+0000 7f2ab9481700 1 -- 172.21.15.49:0/2827531901 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa000bd00 con 0x7f2ab406d380 2023-07-21T22:13:36.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2ab9c82700 1 --2- 172.21.15.49:0/2827531901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa00043f0 0x7f2aa00048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:36.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2aba483700 1 --2- 172.21.15.49:0/2827531901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa0003a50 0x7f2aa0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:36.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2abac84700 1 --2- 172.21.15.49:0/2827531901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ab406d380 0x7f2aa0005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:36.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2ab9c82700 1 -- 172.21.15.49:0/2827531901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ab406d380 msgr2=0x7f2aa0005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:36.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2ab9c82700 1 --2- 172.21.15.49:0/2827531901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ab406d380 0x7f2aa0005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2ab9c82700 1 -- 172.21.15.49:0/2827531901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa0003a50 msgr2=0x7f2aa0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:36.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2ab9c82700 1 --2- 172.21.15.49:0/2827531901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa0003a50 0x7f2aa0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2ab9c82700 1 -- 172.21.15.49:0/2827531901 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00035d0 con 0x7f2aa00043f0 2023-07-21T22:13:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2aba483700 1 --2- 172.21.15.49:0/2827531901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa0003a50 0x7f2aa0003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2ab9c82700 1 --2- 172.21.15.49:0/2827531901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa00043f0 0x7f2aa00048b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c240 tx=0x7f2aa00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a839d296b77c9cc0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2ab9481700 1 -- 172.21.15.49:0/2827531901 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa400cde0 con 0x7f2aa00043f0 2023-07-21T22:13:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2ab9481700 1 -- 172.21.15.49:0/2827531901 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa4005980 con 0x7f2aa00043f0 2023-07-21T22:13:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2ab9481700 1 -- 172.21.15.49:0/2827531901 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4005d30 con 0x7f2aa00043f0 2023-07-21T22:13:36.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2abb485700 1 -- 172.21.15.49:0/2827531901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa00043f0 msgr2=0x7f2aa00048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2abb485700 1 --2- 172.21.15.49:0/2827531901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa00043f0 0x7f2aa00048b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c240 tx=0x7f2aa00058a0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2abac84700 1 -- 172.21.15.49:0/2827531901 reap_dead start 2023-07-21T22:13:36.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2abb485700 1 -- 172.21.15.49:0/2827531901 shutdown_connections 2023-07-21T22:13:36.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2abb485700 1 -- 172.21.15.49:0/2827531901 >> 172.21.15.49:0/2827531901 conn(0x7f2ab4070450 msgr2=0x7f2ab4070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:36.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2abb485700 1 -- 172.21.15.49:0/2827531901 shutdown_connections 2023-07-21T22:13:36.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.209+0000 7f2abb485700 1 -- 172.21.15.49:0/2827531901 wait complete. 2023-07-21T22:13:36.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.213+0000 7f2abb485700 1 Processor -- start 2023-07-21T22:13:36.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.213+0000 7f2abb485700 1 -- start start 2023-07-21T22:13:36.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abb485700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2aa00043f0 0x7f2ab40c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:36.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abb485700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab4154990 0x7f2ab40c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:36.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abb485700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ab40c95d0 0x7f2ab40c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:36.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abb485700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40c88f0 con 0x7f2ab40c95d0 2023-07-21T22:13:36.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abb485700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40c6ae0 con 0x7f2ab4154990 2023-07-21T22:13:36.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abb485700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40c5500 con 0x7f2aa00043f0 2023-07-21T22:13:36.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abac84700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ab40c95d0 0x7f2ab40c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:36.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abac84700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ab40c95d0 0x7f2ab40c6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47372/0 (socket says 172.21.15.49:47372) 2023-07-21T22:13:36.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abac84700 1 -- 172.21.15.49:0/1059493884 learned_addr learned my addr 172.21.15.49:0/1059493884 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:36.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2aba483700 1 --2- 172.21.15.49:0/1059493884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2aa00043f0 0x7f2ab40c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:36.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2ab9c82700 1 --2- 172.21.15.49:0/1059493884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab4154990 0x7f2ab40c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:36.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abac84700 1 -- 172.21.15.49:0/1059493884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2aa00043f0 msgr2=0x7f2ab40c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abac84700 1 --2- 172.21.15.49:0/1059493884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2aa00043f0 0x7f2ab40c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abac84700 1 -- 172.21.15.49:0/1059493884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab4154990 msgr2=0x7f2ab40c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abac84700 1 --2- 172.21.15.49:0/1059493884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab4154990 0x7f2ab40c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abac84700 1 -- 172.21.15.49:0/1059493884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab40c57e0 con 0x7f2ab40c95d0 2023-07-21T22:13:36.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abac84700 1 --2- 172.21.15.49:0/1059493884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ab40c95d0 0x7f2ab40c6dc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2ab406b110 tx=0x7f2aac00fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:36.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2aaaffd700 1 -- 172.21.15.49:0/1059493884 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac0052e0 con 0x7f2ab40c95d0 2023-07-21T22:13:36.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2aaaffd700 1 -- 172.21.15.49:0/1059493884 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac005440 con 0x7f2ab40c95d0 2023-07-21T22:13:36.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abb485700 1 -- 172.21.15.49:0/1059493884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab40c5ac0 con 0x7f2ab40c95d0 2023-07-21T22:13:36.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2aaaffd700 1 -- 172.21.15.49:0/1059493884 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac0038e0 con 0x7f2ab40c95d0 2023-07-21T22:13:36.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.217+0000 7f2abb485700 1 -- 172.21.15.49:0/1059493884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab40c6080 con 0x7f2ab40c95d0 2023-07-21T22:13:36.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.221+0000 7f2abb485700 1 -- 172.21.15.49:0/1059493884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab404dcb0 con 0x7f2ab40c95d0 2023-07-21T22:13:36.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.221+0000 7f2aaaffd700 1 -- 172.21.15.49:0/1059493884 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2aac003a40 con 0x7f2ab40c95d0 2023-07-21T22:13:36.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.225+0000 7f2aaaffd700 1 --2- 172.21.15.49:0/1059493884 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a980662f0 0x7f2a980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:36.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.225+0000 7f2aaaffd700 1 -- 172.21.15.49:0/1059493884 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2aac083550 con 0x7f2ab40c95d0 2023-07-21T22:13:36.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.225+0000 7f2aba483700 1 --2- 172.21.15.49:0/1059493884 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a980662f0 0x7f2a980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:36.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.225+0000 7f2aba483700 1 --2- 172.21.15.49:0/1059493884 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a980662f0 0x7f2a980687a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0014510 tx=0x7f2ab000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:36.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.229+0000 7f2aaaffd700 1 -- 172.21.15.49:0/1059493884 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2aac050bd0 con 0x7f2ab40c95d0 2023-07-21T22:13:36.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.457+0000 7f2abb485700 1 -- 172.21.15.49:0/1059493884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2ab40ca780 con 0x7f2ab40c95d0 2023-07-21T22:13:36.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.461+0000 7f2aaaffd700 1 -- 172.21.15.49:0/1059493884 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f2aac0541f0 con 0x7f2ab40c95d0 2023-07-21T22:13:36.503 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:36.503 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:13:36.504 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-07-21T22:13:36.504 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.504 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-07-21T22:13:36.504 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAcArtk9UDlNxAAfGvmHDNUYOtexEgfEkEmbw==", 2023-07-21T22:13:36.504 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.504 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:13:36.505 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-07-21T22:13:36.505 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-07-21T22:13:36.505 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.505 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.505 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.505 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.505 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-07-21T22:13:36.506 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdArtkQifxDxAANHRBlqFItDR5CjqajW6gvQ==", 2023-07-21T22:13:36.506 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.506 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:13:36.506 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-07-21T22:13:36.506 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-07-21T22:13:36.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.506 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.506 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.507 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.507 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-07-21T22:13:36.507 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdArtkBfhVBxAAWPmw5Kgh9IAwd3x6ONx/3Q==", 2023-07-21T22:13:36.507 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.507 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:13:36.507 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-07-21T22:13:36.507 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-07-21T22:13:36.508 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.508 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.508 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.508 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.508 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-07-21T22:13:36.508 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdArtkJYR+GhAAoQnle9Wp4nO/t7tXuW7QRg==", 2023-07-21T22:13:36.508 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.509 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:13:36.509 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-07-21T22:13:36.509 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-07-21T22:13:36.509 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.509 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.509 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.509 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.509 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-07-21T22:13:36.510 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAfArtkXyOTDRAA6+dWJD8HAjbKOVKNMmU47w==", 2023-07-21T22:13:36.510 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.510 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:13:36.510 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:13:36.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.510 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.510 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.511 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.511 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-07-21T22:13:36.511 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAiArtkK1XVHBAAfg3u9BuD16Nqvd4aSxkHrQ==", 2023-07-21T22:13:36.511 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.511 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:13:36.511 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:13:36.511 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.512 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.512 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.512 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.512 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-07-21T22:13:36.513 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAlArtkqCt+KRAAYL2UpqU5lgci033misJwCw==", 2023-07-21T22:13:36.513 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.513 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:13:36.513 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:13:36.513 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.513 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.513 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.514 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.514 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-07-21T22:13:36.514 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAoArtk3rxoNxAAcTy+TyE877c3ygcSSYR4Fw==", 2023-07-21T22:13:36.514 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.514 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:13:36.514 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:13:36.515 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.515 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.515 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.515 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.515 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-07-21T22:13:36.515 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAvArtkKVmkDxAAvnbiPrBm8CsqtltAiYvBLA==", 2023-07-21T22:13:36.516 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.516 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:13:36.516 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:13:36.516 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.516 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.516 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.516 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.517 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-07-21T22:13:36.517 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAyArtkVZZ4HxAAh/a+roCiNHjhfWBgQglK9w==", 2023-07-21T22:13:36.517 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.517 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:13:36.517 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:13:36.517 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.517 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.517 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.518 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.518 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-07-21T22:13:36.518 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA1ArtkqvL1LBAAyR54RZM2jeJkacFJYYSg4w==", 2023-07-21T22:13:36.518 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.518 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:13:36.518 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:13:36.518 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.519 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.519 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.519 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-07-21T22:13:36.519 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA4ArtkE0qJOhAAoVsMETcdMCOVJu1LeodZaQ==", 2023-07-21T22:13:36.519 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.520 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-07-21T22:13:36.520 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-07-21T22:13:36.520 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.520 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.520 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.520 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.521 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-07-21T22:13:36.521 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdArtkU5ZaIRAAchCJhuM71+rGOBHBlX77wA==", 2023-07-21T22:13:36.521 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.521 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:13:36.521 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-07-21T22:13:36.521 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw pool=cephfs_data" 2023-07-21T22:13:36.521 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.522 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.522 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-07-21T22:13:36.522 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdArtkehK+LRAALlZYibBiTgcHfl7suRYhcQ==", 2023-07-21T22:13:36.522 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.522 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:13:36.522 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-07-21T22:13:36.523 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-07-21T22:13:36.523 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-07-21T22:13:36.523 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.523 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.523 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.523 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-07-21T22:13:36.524 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdArtkyk2fJxAAnJF1MTnXB6u+gAzfn4Db3g==", 2023-07-21T22:13:36.524 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.524 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:13:36.524 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-07-21T22:13:36.524 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-07-21T22:13:36.524 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-07-21T22:13:36.524 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.525 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.525 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.525 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-07-21T22:13:36.525 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdArtks6bXMxAAcFY848luRxhQPSE+99Q5qg==", 2023-07-21T22:13:36.525 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.525 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-07-21T22:13:36.525 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-07-21T22:13:36.526 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-07-21T22:13:36.526 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-07-21T22:13:36.526 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.526 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.526 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.526 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-07-21T22:13:36.526 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAcArtkQ6UTDRAACZZjWYxDlkMYzWCGeU2qXA==", 2023-07-21T22:13:36.526 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.527 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-07-21T22:13:36.527 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-07-21T22:13:36.527 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-07-21T22:13:36.527 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.527 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.527 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.527 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.527 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-07-21T22:13:36.528 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAcArtkP5msMBAAmy/OTWL5IKQObiHS6qGHug==", 2023-07-21T22:13:36.528 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.528 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-07-21T22:13:36.528 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-07-21T22:13:36.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.528 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.528 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:36.529 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:36.529 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-07-21T22:13:36.529 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAcArtkbrpZKhAATgNLjLrjiq5kGV5kD5a61g==", 2023-07-21T22:13:36.529 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-07-21T22:13:36.529 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-07-21T22:13:36.529 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-07-21T22:13:36.529 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-07-21T22:13:36.530 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.530 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:36.530 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-07-21T22:13:36.530 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:13:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.461+0000 7f2abb485700 1 -- 172.21.15.49:0/1059493884 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a980662f0 msgr2=0x7f2a980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.461+0000 7f2abb485700 1 --2- 172.21.15.49:0/1059493884 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a980662f0 0x7f2a980687a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0014510 tx=0x7f2ab000b040 comp rx=0 tx=0).stop 2023-07-21T22:13:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.461+0000 7f2abb485700 1 -- 172.21.15.49:0/1059493884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ab40c95d0 msgr2=0x7f2ab40c6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.461+0000 7f2abb485700 1 --2- 172.21.15.49:0/1059493884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ab40c95d0 0x7f2ab40c6dc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2ab406b110 tx=0x7f2aac00fa90 comp rx=0 tx=0).stop 2023-07-21T22:13:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.461+0000 7f2abb485700 1 -- 172.21.15.49:0/1059493884 shutdown_connections 2023-07-21T22:13:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.461+0000 7f2abb485700 1 --2- 172.21.15.49:0/1059493884 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2a980662f0 0x7f2a980687a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.461+0000 7f2abb485700 1 --2- 172.21.15.49:0/1059493884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ab40c95d0 0x7f2ab40c6dc0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.461+0000 7f2abb485700 1 --2- 172.21.15.49:0/1059493884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab4154990 0x7f2ab40c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.461+0000 7f2abb485700 1 --2- 172.21.15.49:0/1059493884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2aa00043f0 0x7f2ab40c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.461+0000 7f2abb485700 1 -- 172.21.15.49:0/1059493884 >> 172.21.15.49:0/1059493884 conn(0x7f2ab4070450 msgr2=0x7f2ab4159160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:36.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.461+0000 7f2abb485700 1 -- 172.21.15.49:0/1059493884 shutdown_connections 2023-07-21T22:13:36.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.461+0000 7f2abb485700 1 -- 172.21.15.49:0/1059493884 wait complete. 2023-07-21T22:13:36.534 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:13:36.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.669+0000 7f37dd240700 1 Processor -- start 2023-07-21T22:13:36.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.669+0000 7f37dd240700 1 -- start start 2023-07-21T22:13:36.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37dd240700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f37d80b7af0 0x7f37d80b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:36.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37dd240700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d80d1e40 0x7f37d815f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:36.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37dd240700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d80b3e80 con 0x7f37d80cee10 2023-07-21T22:13:36.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37dd240700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d80cea00 con 0x7f37d80b7af0 2023-07-21T22:13:36.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37dd240700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d80ccbf0 con 0x7f37d80d1e40 2023-07-21T22:13:36.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37d7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f37d80b7af0 0x7f37d80b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:36.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37d7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f37d80b7af0 0x7f37d80b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47376/0 (socket says 172.21.15.49:47376) 2023-07-21T22:13:36.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37d7fff700 1 -- 172.21.15.49:0/3589337922 learned_addr learned my addr 172.21.15.49:0/3589337922 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:36.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37cf7fe700 1 --2- 172.21.15.49:0/3589337922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d80d1e40 0x7f37d815f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:36.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37d77fe700 1 -- 172.21.15.49:0/3589337922 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811488231 0 0) 0x7f37d80b3e80 con 0x7f37d80cee10 2023-07-21T22:13:36.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37d77fe700 1 -- 172.21.15.49:0/3589337922 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b80035d0 con 0x7f37d80cee10 2023-07-21T22:13:36.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37cf7fe700 1 -- 172.21.15.49:0/3589337922 >> v2:172.21.15.49:3300/0 conn(0x7f37d80b7af0 msgr2=0x7f37d80b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:36.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37cf7fe700 1 --2- 172.21.15.49:0/3589337922 >> v2:172.21.15.49:3300/0 conn(0x7f37d80b7af0 0x7f37d80b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37cf7fe700 1 -- 172.21.15.49:0/3589337922 >> v1:172.21.15.150:6789/0 conn(0x7f37d80cee10 legacy=0x7f37d80b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37cf7fe700 1 -- 172.21.15.49:0/3589337922 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d80cced0 con 0x7f37d80d1e40 2023-07-21T22:13:36.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37d7fff700 1 --2- 172.21.15.49:0/3589337922 >> v2:172.21.15.49:3300/0 conn(0x7f37d80b7af0 0x7f37d80b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:36.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37cf7fe700 1 --2- 172.21.15.49:0/3589337922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d80d1e40 0x7f37d815f630 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f37c0009850 tx=0x7f37c0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a6f7faf72937d10 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:36.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.673+0000 7f37d77fe700 1 -- 172.21.15.49:0/3589337922 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c0011830 con 0x7f37d80d1e40 2023-07-21T22:13:36.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.677+0000 7f37d77fe700 1 -- 172.21.15.49:0/3589337922 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c0011990 con 0x7f37d80d1e40 2023-07-21T22:13:36.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.677+0000 7f37d77fe700 1 -- 172.21.15.49:0/3589337922 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c0011d40 con 0x7f37d80d1e40 2023-07-21T22:13:36.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.677+0000 7f37dd240700 1 -- 172.21.15.49:0/3589337922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d80d1e40 msgr2=0x7f37d815f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.677+0000 7f37dd240700 1 --2- 172.21.15.49:0/3589337922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d80d1e40 0x7f37d815f630 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f37c0009850 tx=0x7f37c0009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.677+0000 7f37dd240700 1 -- 172.21.15.49:0/3589337922 shutdown_connections 2023-07-21T22:13:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.677+0000 7f37dd240700 1 --2- 172.21.15.49:0/3589337922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d80d1e40 0x7f37d815f630 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.677+0000 7f37dd240700 1 --2- 172.21.15.49:0/3589337922 >> v2:172.21.15.49:3300/0 conn(0x7f37d80b7af0 0x7f37d80b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.677+0000 7f37dd240700 1 -- 172.21.15.49:0/3589337922 >> 172.21.15.49:0/3589337922 conn(0x7f37d806e960 msgr2=0x7f37d806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.677+0000 7f37dd240700 1 -- 172.21.15.49:0/3589337922 shutdown_connections 2023-07-21T22:13:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.677+0000 7f37dd240700 1 -- 172.21.15.49:0/3589337922 wait complete. 2023-07-21T22:13:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37dd240700 1 Processor -- start 2023-07-21T22:13:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37dd240700 1 -- start start 2023-07-21T22:13:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37dd240700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37d80b7af0 0x7f37d815b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37dd240700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37d80cee10 0x7f37d8159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37dd240700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d80d1e40 0x7f37d815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37dd240700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d815ca00 con 0x7f37d80cee10 2023-07-21T22:13:36.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37dd240700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d815a170 con 0x7f37d80b7af0 2023-07-21T22:13:36.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37dd240700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d815efd0 con 0x7f37d80d1e40 2023-07-21T22:13:36.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37cf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37d80cee10 0x7f37d8159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:36.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37cf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37d80cee10 0x7f37d8159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47380/0 (socket says 172.21.15.49:47380) 2023-07-21T22:13:36.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37cf7fe700 1 -- 172.21.15.49:0/4144591660 learned_addr learned my addr 172.21.15.49:0/4144591660 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:36.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37dca3f700 1 --2- 172.21.15.49:0/4144591660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d80d1e40 0x7f37d815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:36.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37d7fff700 1 --2- 172.21.15.49:0/4144591660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37d80b7af0 0x7f37d815b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37cf7fe700 1 -- 172.21.15.49:0/4144591660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d80d1e40 msgr2=0x7f37d815ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37cf7fe700 1 --2- 172.21.15.49:0/4144591660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d80d1e40 0x7f37d815ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37cf7fe700 1 -- 172.21.15.49:0/4144591660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37d80b7af0 msgr2=0x7f37d815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37cf7fe700 1 --2- 172.21.15.49:0/4144591660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37d80b7af0 0x7f37d815b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.681+0000 7f37cf7fe700 1 -- 172.21.15.49:0/4144591660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c8009570 con 0x7f37d80cee10 2023-07-21T22:13:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.685+0000 7f37cf7fe700 1 --2- 172.21.15.49:0/4144591660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37d80cee10 0x7f37d8159c30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f37c0014040 tx=0x7f37c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.685+0000 7f37d57fa700 1 -- 172.21.15.49:0/4144591660 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c0004510 con 0x7f37d80cee10 2023-07-21T22:13:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.685+0000 7f37d57fa700 1 -- 172.21.15.49:0/4144591660 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c001e070 con 0x7f37d80cee10 2023-07-21T22:13:36.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.685+0000 7f37d57fa700 1 -- 172.21.15.49:0/4144591660 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c0003900 con 0x7f37d80cee10 2023-07-21T22:13:36.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.685+0000 7f37dd240700 1 -- 172.21.15.49:0/4144591660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c00094b0 con 0x7f37d80cee10 2023-07-21T22:13:36.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.685+0000 7f37dd240700 1 -- 172.21.15.49:0/4144591660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d815bc40 con 0x7f37d80cee10 2023-07-21T22:13:36.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.685+0000 7f37dd240700 1 -- 172.21.15.49:0/4144591660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d804dcb0 con 0x7f37d80cee10 2023-07-21T22:13:36.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.689+0000 7f37d57fa700 1 -- 172.21.15.49:0/4144591660 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f37c0003a60 con 0x7f37d80cee10 2023-07-21T22:13:36.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.689+0000 7f37d57fa700 1 --2- 172.21.15.49:0/4144591660 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37bc066320 0x7f37bc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:36.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.689+0000 7f37d57fa700 1 -- 172.21.15.49:0/4144591660 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f37c0020070 con 0x7f37d80cee10 2023-07-21T22:13:36.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.689+0000 7f37d7fff700 1 --2- 172.21.15.49:0/4144591660 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37bc066320 0x7f37bc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:36.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.689+0000 7f37d7fff700 1 --2- 172.21.15.49:0/4144591660 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37bc066320 0x7f37bc0687d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f37c8006d50 tx=0x7f37c80092e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:36.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.693+0000 7f37d57fa700 1 -- 172.21.15.49:0/4144591660 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f37c008a020 con 0x7f37d80cee10 2023-07-21T22:13:36.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.877+0000 7f37dd240700 1 -- 172.21.15.49:0/4144591660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37d80b71a0 con 0x7f37d80cee10 2023-07-21T22:13:36.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.877+0000 7f37d57fa700 1 -- 172.21.15.49:0/4144591660 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+14808 (secure 0 0 0) 0x7f37c0052550 con 0x7f37d80cee10 2023-07-21T22:13:36.922 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:36.923 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":58,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:13:35.981178+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:13:36.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.881+0000 7f37dd240700 1 -- 172.21.15.49:0/4144591660 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37bc066320 msgr2=0x7f37bc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.881+0000 7f37dd240700 1 --2- 172.21.15.49:0/4144591660 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37bc066320 0x7f37bc0687d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f37c8006d50 tx=0x7f37c80092e0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.881+0000 7f37dd240700 1 -- 172.21.15.49:0/4144591660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37d80cee10 msgr2=0x7f37d8159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.881+0000 7f37dd240700 1 --2- 172.21.15.49:0/4144591660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37d80cee10 0x7f37d8159c30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f37c0014040 tx=0x7f37c0004770 comp rx=0 tx=0).stop 2023-07-21T22:13:36.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.881+0000 7f37dd240700 1 -- 172.21.15.49:0/4144591660 shutdown_connections 2023-07-21T22:13:36.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.881+0000 7f37dd240700 1 --2- 172.21.15.49:0/4144591660 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f37bc066320 0x7f37bc0687d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.881+0000 7f37dd240700 1 --2- 172.21.15.49:0/4144591660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37d80cee10 0x7f37d8159c30 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.881+0000 7f37dd240700 1 --2- 172.21.15.49:0/4144591660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d80d1e40 0x7f37d815ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.881+0000 7f37dd240700 1 --2- 172.21.15.49:0/4144591660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37d80b7af0 0x7f37d815b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:36.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.881+0000 7f37dd240700 1 -- 172.21.15.49:0/4144591660 >> 172.21.15.49:0/4144591660 conn(0x7f37d806e960 msgr2=0x7f37d80b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:36.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.881+0000 7f37dd240700 1 -- 172.21.15.49:0/4144591660 shutdown_connections 2023-07-21T22:13:36.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:36.881+0000 7f37dd240700 1 -- 172.21.15.49:0/4144591660 wait complete. 2023-07-21T22:13:36.948 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:13:36.949 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:13:37.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.085+0000 7f0e73203700 1 Processor -- start 2023-07-21T22:13:37.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.085+0000 7f0e73203700 1 -- start start 2023-07-21T22:13:37.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.085+0000 7f0e73203700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0e6c0ca550 0x7f0e6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.085+0000 7f0e73203700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6c0c8b80 con 0x7f0e6c159be0 2023-07-21T22:13:37.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.085+0000 7f0e73203700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6c06db90 con 0x7f0e6c06d6d0 2023-07-21T22:13:37.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.085+0000 7f0e73203700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6c0c9720 con 0x7f0e6c0ca550 2023-07-21T22:13:37.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e71a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0e6c0ca550 0x7f0e6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e71a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0e6c0ca550 0x7f0e6c06d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47396/0 (socket says 172.21.15.49:47396) 2023-07-21T22:13:37.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e71a00700 1 -- 172.21.15.49:0/1103182385 learned_addr learned my addr 172.21.15.49:0/1103182385 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:37.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e71a00700 1 -- 172.21.15.49:0/1103182385 >> v1:172.21.15.150:6789/0 conn(0x7f0e6c06d6d0 legacy=0x7f0e6c0698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:37.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e71a00700 1 -- 172.21.15.49:0/1103182385 >> v1:172.21.15.49:6789/0 conn(0x7f0e6c159be0 legacy=0x7f0e6c0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:37.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e71a00700 1 -- 172.21.15.49:0/1103182385 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c06de70 con 0x7f0e6c0ca550 2023-07-21T22:13:37.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e71a00700 1 --2- 172.21.15.49:0/1103182385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e6c0ca550 0x7f0e6c06d190 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009910 tx=0x7f0e5c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f054747c3008e87f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:37.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e711ff700 1 -- 172.21.15.49:0/1103182385 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c004230 con 0x7f0e6c0ca550 2023-07-21T22:13:37.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e711ff700 1 -- 172.21.15.49:0/1103182385 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c004390 con 0x7f0e6c0ca550 2023-07-21T22:13:37.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e711ff700 1 -- 172.21.15.49:0/1103182385 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c009e60 con 0x7f0e6c0ca550 2023-07-21T22:13:37.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e73203700 1 -- 172.21.15.49:0/1103182385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e6c0ca550 msgr2=0x7f0e6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e73203700 1 --2- 172.21.15.49:0/1103182385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e6c0ca550 0x7f0e6c06d190 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009910 tx=0x7f0e5c009c20 comp rx=0 tx=0).stop 2023-07-21T22:13:37.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e73203700 1 -- 172.21.15.49:0/1103182385 shutdown_connections 2023-07-21T22:13:37.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e73203700 1 --2- 172.21.15.49:0/1103182385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e6c0ca550 0x7f0e6c06d190 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e73203700 1 -- 172.21.15.49:0/1103182385 >> 172.21.15.49:0/1103182385 conn(0x7f0e6c0ce0d0 msgr2=0x7f0e6c0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:37.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e73203700 1 -- 172.21.15.49:0/1103182385 shutdown_connections 2023-07-21T22:13:37.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.089+0000 7f0e73203700 1 -- 172.21.15.49:0/1103182385 wait complete. 2023-07-21T22:13:37.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.093+0000 7f0e73203700 1 Processor -- start 2023-07-21T22:13:37.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.093+0000 7f0e73203700 1 -- start start 2023-07-21T22:13:37.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.093+0000 7f0e73203700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e6c06d6d0 0x7f0e6c15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.093+0000 7f0e73203700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e6c0ca550 0x7f0e6c14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.093+0000 7f0e73203700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e6c159be0 0x7f0e6c151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.093+0000 7f0e73203700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c0adab0 con 0x7f0e6c06d6d0 2023-07-21T22:13:37.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.093+0000 7f0e73203700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c0add70 con 0x7f0e6c0ca550 2023-07-21T22:13:37.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.093+0000 7f0e73203700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c0ae050 con 0x7f0e6c159be0 2023-07-21T22:13:37.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e72201700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e6c06d6d0 0x7f0e6c15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e72201700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e6c06d6d0 0x7f0e6c15bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47402/0 (socket says 172.21.15.49:47402) 2023-07-21T22:13:37.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e72201700 1 -- 172.21.15.49:0/342473715 learned_addr learned my addr 172.21.15.49:0/342473715 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:37.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e71a00700 1 --2- 172.21.15.49:0/342473715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e6c0ca550 0x7f0e6c14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e72a02700 1 --2- 172.21.15.49:0/342473715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e6c159be0 0x7f0e6c151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e72201700 1 -- 172.21.15.49:0/342473715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e6c159be0 msgr2=0x7f0e6c151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e72201700 1 --2- 172.21.15.49:0/342473715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e6c159be0 0x7f0e6c151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e72201700 1 -- 172.21.15.49:0/342473715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e6c0ca550 msgr2=0x7f0e6c14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e72201700 1 --2- 172.21.15.49:0/342473715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e6c0ca550 0x7f0e6c14f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e72201700 1 -- 172.21.15.49:0/342473715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c009570 con 0x7f0e6c06d6d0 2023-07-21T22:13:37.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e72201700 1 --2- 172.21.15.49:0/342473715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e6c06d6d0 0x7f0e6c15bd90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0e6800c4e0 tx=0x7f0e6800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:37.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e62ffd700 1 -- 172.21.15.49:0/342473715 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68011790 con 0x7f0e6c06d6d0 2023-07-21T22:13:37.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e62ffd700 1 -- 172.21.15.49:0/342473715 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e68011910 con 0x7f0e6c06d6d0 2023-07-21T22:13:37.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e73203700 1 -- 172.21.15.49:0/342473715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6c0ae330 con 0x7f0e6c06d6d0 2023-07-21T22:13:37.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e62ffd700 1 -- 172.21.15.49:0/342473715 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68011cc0 con 0x7f0e6c06d6d0 2023-07-21T22:13:37.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.097+0000 7f0e73203700 1 -- 172.21.15.49:0/342473715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6c15c2d0 con 0x7f0e6c06d6d0 2023-07-21T22:13:37.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.101+0000 7f0e73203700 1 -- 172.21.15.49:0/342473715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6c0ae850 con 0x7f0e6c06d6d0 2023-07-21T22:13:37.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.101+0000 7f0e62ffd700 1 -- 172.21.15.49:0/342473715 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e6801c460 con 0x7f0e6c06d6d0 2023-07-21T22:13:37.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.101+0000 7f0e62ffd700 1 --2- 172.21.15.49:0/342473715 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0e500663c0 0x7f0e50068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.101+0000 7f0e62ffd700 1 -- 172.21.15.49:0/342473715 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0e680838c0 con 0x7f0e6c06d6d0 2023-07-21T22:13:37.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.101+0000 7f0e71a00700 1 --2- 172.21.15.49:0/342473715 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0e500663c0 0x7f0e50068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.105+0000 7f0e71a00700 1 --2- 172.21.15.49:0/342473715 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0e500663c0 0x7f0e50068870 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009910 tx=0x7f0e5c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:37.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.105+0000 7f0e62ffd700 1 -- 172.21.15.49:0/342473715 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0e6c0ae850 con 0x7f0e6c06d6d0 2023-07-21T22:13:37.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.273+0000 7f0e73203700 1 -- 172.21.15.49:0/342473715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e6c0ae850 con 0x7f0e6c06d6d0 2023-07-21T22:13:37.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.273+0000 7f0e62ffd700 1 -- 172.21.15.49:0/342473715 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e6c0ae850 con 0x7f0e6c06d6d0 2023-07-21T22:13:37.319 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:13:37.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.277+0000 7f0e73203700 1 -- 172.21.15.49:0/342473715 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0e500663c0 msgr2=0x7f0e50068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.277+0000 7f0e73203700 1 --2- 172.21.15.49:0/342473715 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0e500663c0 0x7f0e50068870 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009910 tx=0x7f0e5c008030 comp rx=0 tx=0).stop 2023-07-21T22:13:37.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.277+0000 7f0e73203700 1 -- 172.21.15.49:0/342473715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e6c06d6d0 msgr2=0x7f0e6c15bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.277+0000 7f0e73203700 1 --2- 172.21.15.49:0/342473715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e6c06d6d0 0x7f0e6c15bd90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0e6800c4e0 tx=0x7f0e6800c7f0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.277+0000 7f0e73203700 1 -- 172.21.15.49:0/342473715 shutdown_connections 2023-07-21T22:13:37.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.277+0000 7f0e73203700 1 --2- 172.21.15.49:0/342473715 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0e500663c0 0x7f0e50068870 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.277+0000 7f0e73203700 1 --2- 172.21.15.49:0/342473715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e6c159be0 0x7f0e6c151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.277+0000 7f0e73203700 1 --2- 172.21.15.49:0/342473715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e6c0ca550 0x7f0e6c14f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.277+0000 7f0e73203700 1 --2- 172.21.15.49:0/342473715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e6c06d6d0 0x7f0e6c15bd90 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.277+0000 7f0e73203700 1 -- 172.21.15.49:0/342473715 >> 172.21.15.49:0/342473715 conn(0x7f0e6c0ce0d0 msgr2=0x7f0e6c158690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:37.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.277+0000 7f0e73203700 1 -- 172.21.15.49:0/342473715 shutdown_connections 2023-07-21T22:13:37.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.277+0000 7f0e73203700 1 -- 172.21.15.49:0/342473715 wait complete. 2023-07-21T22:13:37.343 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:13:37.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.481+0000 7f5a05427700 1 Processor -- start 2023-07-21T22:13:37.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.481+0000 7f5a05427700 1 -- start start 2023-07-21T22:13:37.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.485+0000 7f5a05427700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5a000c90d0 0x7f5a00069d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.485+0000 7f5a05427700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a00158d70 con 0x7f5a000698a0 2023-07-21T22:13:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.485+0000 7f5a05427700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a000cc990 con 0x7f5a001589a0 2023-07-21T22:13:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.485+0000 7f5a05427700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0015c800 con 0x7f5a000c90d0 2023-07-21T22:13:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.485+0000 7f5a04c26700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5a000c90d0 0x7f5a00069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.485+0000 7f59f77fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5a000698a0 0x7f5a000c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58876/0 (socket says 172.21.15.49:58876) 2023-07-21T22:13:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.485+0000 7f59f77fe700 1 -- 172.21.15.49:0/2813451910 learned_addr learned my addr 172.21.15.49:0/2813451910 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.485+0000 7f5a04c26700 1 -- 172.21.15.49:0/2813451910 >> v1:172.21.15.150:6789/0 conn(0x7f5a001589a0 legacy=0x7f5a0006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.485+0000 7f5a04c26700 1 -- 172.21.15.49:0/2813451910 >> v1:172.21.15.49:6789/0 conn(0x7f5a000698a0 legacy=0x7f5a000c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.485+0000 7f5a04c26700 1 -- 172.21.15.49:0/2813451910 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a000c95d0 con 0x7f5a000c90d0 2023-07-21T22:13:37.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.485+0000 7f5a04c26700 1 --2- 172.21.15.49:0/2813451910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a000c90d0 0x7f5a00069d10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009d90 tx=0x7f59f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f4027a6bd0d1d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:37.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.485+0000 7f59ff7fe700 1 -- 172.21.15.49:0/2813451910 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f800e070 con 0x7f5a000c90d0 2023-07-21T22:13:37.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.485+0000 7f59ff7fe700 1 -- 172.21.15.49:0/2813451910 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f800bbd0 con 0x7f5a000c90d0 2023-07-21T22:13:37.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.485+0000 7f59ff7fe700 1 -- 172.21.15.49:0/2813451910 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8012430 con 0x7f5a000c90d0 2023-07-21T22:13:37.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.489+0000 7f5a05427700 1 -- 172.21.15.49:0/2813451910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a000c90d0 msgr2=0x7f5a00069d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.489+0000 7f5a05427700 1 --2- 172.21.15.49:0/2813451910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a000c90d0 0x7f5a00069d10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009d90 tx=0x7f59f800b330 comp rx=0 tx=0).stop 2023-07-21T22:13:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.489+0000 7f5a05427700 1 -- 172.21.15.49:0/2813451910 shutdown_connections 2023-07-21T22:13:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.489+0000 7f5a05427700 1 --2- 172.21.15.49:0/2813451910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a000c90d0 0x7f5a00069d10 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.489+0000 7f5a05427700 1 -- 172.21.15.49:0/2813451910 >> 172.21.15.49:0/2813451910 conn(0x7f5a000ce0d0 msgr2=0x7f5a000ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.489+0000 7f5a05427700 1 -- 172.21.15.49:0/2813451910 shutdown_connections 2023-07-21T22:13:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.489+0000 7f5a05427700 1 -- 172.21.15.49:0/2813451910 wait complete. 2023-07-21T22:13:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.489+0000 7f5a05427700 1 Processor -- start 2023-07-21T22:13:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f5a05427700 1 -- start start 2023-07-21T22:13:37.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f5a05427700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a000698a0 0x7f5a0015b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f5a05427700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a000c90d0 0x7f5a001420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f5a05427700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a001589a0 0x7f5a000b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f5a05427700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00165850 con 0x7f5a000c90d0 2023-07-21T22:13:37.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f5a05427700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00165570 con 0x7f5a001589a0 2023-07-21T22:13:37.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f5a05427700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0015ac50 con 0x7f5a000698a0 2023-07-21T22:13:37.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f59fffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a000698a0 0x7f5a0015b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f59f77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a000c90d0 0x7f5a001420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f59fffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a000698a0 0x7f5a0015b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:47802/0 (socket says 172.21.15.49:47802) 2023-07-21T22:13:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f59fffff700 1 -- 172.21.15.49:0/3487777772 learned_addr learned my addr 172.21.15.49:0/3487777772 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f5a04c26700 1 --2- 172.21.15.49:0/3487777772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a001589a0 0x7f5a000b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f59fffff700 1 -- 172.21.15.49:0/3487777772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a001589a0 msgr2=0x7f5a000b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f59fffff700 1 --2- 172.21.15.49:0/3487777772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a001589a0 0x7f5a000b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f59fffff700 1 -- 172.21.15.49:0/3487777772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a000c90d0 msgr2=0x7f5a001420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f59fffff700 1 --2- 172.21.15.49:0/3487777772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a000c90d0 0x7f5a001420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f59fffff700 1 -- 172.21.15.49:0/3487777772 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f8009a70 con 0x7f5a000698a0 2023-07-21T22:13:37.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.493+0000 7f59fffff700 1 --2- 172.21.15.49:0/3487777772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a000698a0 0x7f5a0015b730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f59f000c500 tx=0x7f59f000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:37.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.497+0000 7f59fd7fa700 1 -- 172.21.15.49:0/3487777772 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f00052d0 con 0x7f5a000698a0 2023-07-21T22:13:37.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.497+0000 7f59fd7fa700 1 -- 172.21.15.49:0/3487777772 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f0005430 con 0x7f5a000698a0 2023-07-21T22:13:37.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.497+0000 7f5a05427700 1 -- 172.21.15.49:0/3487777772 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0015af30 con 0x7f5a000698a0 2023-07-21T22:13:37.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.497+0000 7f59fd7fa700 1 -- 172.21.15.49:0/3487777772 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f00055a0 con 0x7f5a000698a0 2023-07-21T22:13:37.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.497+0000 7f5a05427700 1 -- 172.21.15.49:0/3487777772 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a00142610 con 0x7f5a000698a0 2023-07-21T22:13:37.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.497+0000 7f5a05427700 1 -- 172.21.15.49:0/3487777772 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0015b450 con 0x7f5a000698a0 2023-07-21T22:13:37.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.501+0000 7f59fd7fa700 1 -- 172.21.15.49:0/3487777772 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59f00038e0 con 0x7f5a000698a0 2023-07-21T22:13:37.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.501+0000 7f59fd7fa700 1 --2- 172.21.15.49:0/3487777772 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f59e00662f0 0x7f59e00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.501+0000 7f59fd7fa700 1 -- 172.21.15.49:0/3487777772 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f59f0082f00 con 0x7f5a000698a0 2023-07-21T22:13:37.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.501+0000 7f59f77fe700 1 --2- 172.21.15.49:0/3487777772 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f59e00662f0 0x7f59e00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.501+0000 7f59f77fe700 1 --2- 172.21.15.49:0/3487777772 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f59e00662f0 0x7f59e00687a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5a000b3d10 tx=0x7f59e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:37.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.509+0000 7f59fd7fa700 1 -- 172.21.15.49:0/3487777772 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f59f0050500 con 0x7f5a000698a0 2023-07-21T22:13:37.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.685+0000 7f5a05427700 1 -- 172.21.15.49:0/3487777772 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5a0004dcb0 con 0x7f5a000698a0 2023-07-21T22:13:37.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.685+0000 7f59fd7fa700 1 -- 172.21.15.49:0/3487777772 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59f0053b20 con 0x7f5a000698a0 2023-07-21T22:13:37.729 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:13:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.689+0000 7f5a05427700 1 -- 172.21.15.49:0/3487777772 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f59e00662f0 msgr2=0x7f59e00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.689+0000 7f5a05427700 1 --2- 172.21.15.49:0/3487777772 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f59e00662f0 0x7f59e00687a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5a000b3d10 tx=0x7f59e8009040 comp rx=0 tx=0).stop 2023-07-21T22:13:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.689+0000 7f5a05427700 1 -- 172.21.15.49:0/3487777772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a000698a0 msgr2=0x7f5a0015b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.689+0000 7f5a05427700 1 --2- 172.21.15.49:0/3487777772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a000698a0 0x7f5a0015b730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f59f000c500 tx=0x7f59f000c810 comp rx=0 tx=0).stop 2023-07-21T22:13:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.689+0000 7f5a05427700 1 -- 172.21.15.49:0/3487777772 shutdown_connections 2023-07-21T22:13:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.689+0000 7f5a05427700 1 --2- 172.21.15.49:0/3487777772 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f59e00662f0 0x7f59e00687a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.689+0000 7f5a05427700 1 --2- 172.21.15.49:0/3487777772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a000c90d0 0x7f5a001420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.689+0000 7f5a05427700 1 --2- 172.21.15.49:0/3487777772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a001589a0 0x7f5a000b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.689+0000 7f5a05427700 1 --2- 172.21.15.49:0/3487777772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a000698a0 0x7f5a0015b730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.689+0000 7f5a05427700 1 -- 172.21.15.49:0/3487777772 >> 172.21.15.49:0/3487777772 conn(0x7f5a000ce0d0 msgr2=0x7f5a000ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:37.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.689+0000 7f5a05427700 1 -- 172.21.15.49:0/3487777772 shutdown_connections 2023-07-21T22:13:37.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.689+0000 7f5a05427700 1 -- 172.21.15.49:0/3487777772 wait complete. 2023-07-21T22:13:37.757 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:13:37.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.885+0000 7fa693184700 1 Processor -- start 2023-07-21T22:13:37.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.885+0000 7fa693184700 1 -- start start 2023-07-21T22:13:37.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa693184700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa68c158c00 0x7fa68c15d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa693184700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa68c06da70 0x7fa68c06c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa693184700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c158fd0 con 0x7fa68c0c90d0 2023-07-21T22:13:37.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa693184700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68c06d650 con 0x7fa68c158c00 2023-07-21T22:13:37.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa693184700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c06c9d0 con 0x7fa68c06da70 2023-07-21T22:13:37.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa692983700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa68c0c90d0 0x7fa68c0cbc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58882/0 (socket says 172.21.15.49:58882) 2023-07-21T22:13:37.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa692983700 1 -- 172.21.15.49:0/2183034968 learned_addr learned my addr 172.21.15.49:0/2183034968 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:37.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa691981700 1 --2- 172.21.15.49:0/2183034968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa68c06da70 0x7fa68c06c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa692182700 1 --2- 172.21.15.49:0/2183034968 >> v2:172.21.15.150:3300/0 conn(0x7fa68c158c00 0x7fa68c15d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa691180700 1 -- 172.21.15.49:0/2183034968 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205680794 0 0) 0x7fa68c158fd0 con 0x7fa68c0c90d0 2023-07-21T22:13:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa691180700 1 -- 172.21.15.49:0/2183034968 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6780035d0 con 0x7fa68c0c90d0 2023-07-21T22:13:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa691981700 1 -- 172.21.15.49:0/2183034968 >> v2:172.21.15.150:3300/0 conn(0x7fa68c158c00 msgr2=0x7fa68c15d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa691981700 1 --2- 172.21.15.49:0/2183034968 >> v2:172.21.15.150:3300/0 conn(0x7fa68c158c00 0x7fa68c15d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa691180700 1 -- 172.21.15.49:0/2183034968 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3756761665 0 0) 0x7fa6780035d0 con 0x7fa68c0c90d0 2023-07-21T22:13:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa691981700 1 -- 172.21.15.49:0/2183034968 >> v1:172.21.15.49:6789/0 conn(0x7fa68c0c90d0 legacy=0x7fa68c0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa691981700 1 -- 172.21.15.49:0/2183034968 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c06ccb0 con 0x7fa68c06da70 2023-07-21T22:13:37.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.889+0000 7fa691981700 1 --2- 172.21.15.49:0/2183034968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa68c06da70 0x7fa68c06c180 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009850 tx=0x7fa67c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=780030c649057037 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:37.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.893+0000 7fa691180700 1 -- 172.21.15.49:0/2183034968 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6840019f0 con 0x7fa68c06da70 2023-07-21T22:13:37.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.893+0000 7fa691180700 1 -- 172.21.15.49:0/2183034968 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c004030 con 0x7fa68c06da70 2023-07-21T22:13:37.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.893+0000 7fa691180700 1 -- 172.21.15.49:0/2183034968 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0043e0 con 0x7fa68c06da70 2023-07-21T22:13:37.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.893+0000 7fa693184700 1 -- 172.21.15.49:0/2183034968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa68c06da70 msgr2=0x7fa68c06c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.893+0000 7fa693184700 1 --2- 172.21.15.49:0/2183034968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa68c06da70 0x7fa68c06c180 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009850 tx=0x7fa67c009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.893+0000 7fa693184700 1 -- 172.21.15.49:0/2183034968 shutdown_connections 2023-07-21T22:13:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.893+0000 7fa693184700 1 --2- 172.21.15.49:0/2183034968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa68c06da70 0x7fa68c06c180 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.893+0000 7fa693184700 1 --2- 172.21.15.49:0/2183034968 >> v2:172.21.15.150:3300/0 conn(0x7fa68c158c00 0x7fa68c15d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.893+0000 7fa693184700 1 -- 172.21.15.49:0/2183034968 >> 172.21.15.49:0/2183034968 conn(0x7fa68c070450 msgr2=0x7fa68c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.893+0000 7fa693184700 1 -- 172.21.15.49:0/2183034968 shutdown_connections 2023-07-21T22:13:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.893+0000 7fa693184700 1 -- 172.21.15.49:0/2183034968 wait complete. 2023-07-21T22:13:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.893+0000 7fa693184700 1 Processor -- start 2023-07-21T22:13:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa693184700 1 -- start start 2023-07-21T22:13:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa693184700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa68c06da70 0x7fa68c14f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa693184700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa68c0c90d0 0x7fa68c0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa693184700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa68c158c00 0x7fa68c0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa693184700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0c2d90 con 0x7fa68c158c00 2023-07-21T22:13:37.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa693184700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0c2180 con 0x7fa68c0c90d0 2023-07-21T22:13:37.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa693184700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0c2460 con 0x7fa68c06da70 2023-07-21T22:13:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa692983700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa68c158c00 0x7fa68c0ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa692983700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa68c158c00 0x7fa68c0ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47424/0 (socket says 172.21.15.49:47424) 2023-07-21T22:13:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa692983700 1 -- 172.21.15.49:0/1819892343 learned_addr learned my addr 172.21.15.49:0/1819892343 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa692182700 1 --2- 172.21.15.49:0/1819892343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa68c06da70 0x7fa68c14f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa691981700 1 --2- 172.21.15.49:0/1819892343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa68c0c90d0 0x7fa68c0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa692983700 1 -- 172.21.15.49:0/1819892343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa68c06da70 msgr2=0x7fa68c14f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa692983700 1 --2- 172.21.15.49:0/1819892343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa68c06da70 0x7fa68c14f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa692983700 1 -- 172.21.15.49:0/1819892343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa68c0c90d0 msgr2=0x7fa68c0ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa692983700 1 --2- 172.21.15.49:0/1819892343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa68c0c90d0 0x7fa68c0ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa692983700 1 -- 172.21.15.49:0/1819892343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c0094b0 con 0x7fa68c158c00 2023-07-21T22:13:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa692983700 1 --2- 172.21.15.49:0/1819892343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa68c158c00 0x7fa68c0ca990 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa68400cc00 tx=0x7fa68400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa682ffd700 1 -- 172.21.15.49:0/1819892343 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68400aad0 con 0x7fa68c158c00 2023-07-21T22:13:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa682ffd700 1 -- 172.21.15.49:0/1819892343 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68400ac50 con 0x7fa68c158c00 2023-07-21T22:13:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa693184700 1 -- 172.21.15.49:0/1819892343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c0c2740 con 0x7fa68c158c00 2023-07-21T22:13:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa682ffd700 1 -- 172.21.15.49:0/1819892343 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6840070d0 con 0x7fa68c158c00 2023-07-21T22:13:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.897+0000 7fa693184700 1 -- 172.21.15.49:0/1819892343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c14fbf0 con 0x7fa68c158c00 2023-07-21T22:13:37.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.901+0000 7fa693184700 1 -- 172.21.15.49:0/1819892343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68c0c2f40 con 0x7fa68c158c00 2023-07-21T22:13:37.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.901+0000 7fa682ffd700 1 -- 172.21.15.49:0/1819892343 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa684007230 con 0x7fa68c158c00 2023-07-21T22:13:37.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.905+0000 7fa682ffd700 1 --2- 172.21.15.49:0/1819892343 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa670066320 0x7fa6700687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.905+0000 7fa682ffd700 1 -- 172.21.15.49:0/1819892343 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa684083980 con 0x7fa68c158c00 2023-07-21T22:13:37.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.905+0000 7fa692182700 1 --2- 172.21.15.49:0/1819892343 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa670066320 0x7fa6700687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.905+0000 7fa692182700 1 --2- 172.21.15.49:0/1819892343 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa670066320 0x7fa6700687d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa688009b50 tx=0x7fa688009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:37.909+0000 7fa682ffd700 1 -- 172.21.15.49:0/1819892343 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa68c0c2f40 con 0x7fa68c158c00 2023-07-21T22:13:38.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.085+0000 7fa693184700 1 -- 172.21.15.49:0/1819892343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa68c0c2f40 con 0x7fa68c158c00 2023-07-21T22:13:38.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.085+0000 7fa682ffd700 1 -- 172.21.15.49:0/1819892343 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa68c0c2f40 con 0x7fa68c158c00 2023-07-21T22:13:38.131 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:38.131 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-07-21T22:13:38.131 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:38.131 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-07-21T22:13:38.132 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-07-21T22:13:38.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:38.132 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-07-21T22:13:38.132 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-07-21T22:13:38.132 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-07-21T22:13:38.132 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:38.132 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-07-21T22:13:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.089+0000 7fa693184700 1 -- 172.21.15.49:0/1819892343 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa670066320 msgr2=0x7fa6700687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.089+0000 7fa693184700 1 --2- 172.21.15.49:0/1819892343 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa670066320 0x7fa6700687d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa688009b50 tx=0x7fa688009240 comp rx=0 tx=0).stop 2023-07-21T22:13:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.089+0000 7fa693184700 1 -- 172.21.15.49:0/1819892343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa68c158c00 msgr2=0x7fa68c0ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.089+0000 7fa693184700 1 --2- 172.21.15.49:0/1819892343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa68c158c00 0x7fa68c0ca990 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa68400cc00 tx=0x7fa68400cf10 comp rx=0 tx=0).stop 2023-07-21T22:13:38.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.089+0000 7fa693184700 1 -- 172.21.15.49:0/1819892343 shutdown_connections 2023-07-21T22:13:38.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.089+0000 7fa693184700 1 --2- 172.21.15.49:0/1819892343 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa670066320 0x7fa6700687d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:38.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.089+0000 7fa693184700 1 --2- 172.21.15.49:0/1819892343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa68c158c00 0x7fa68c0ca990 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:38.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.089+0000 7fa693184700 1 --2- 172.21.15.49:0/1819892343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa68c0c90d0 0x7fa68c0ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:38.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.089+0000 7fa693184700 1 --2- 172.21.15.49:0/1819892343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa68c06da70 0x7fa68c14f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:38.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.089+0000 7fa693184700 1 -- 172.21.15.49:0/1819892343 >> 172.21.15.49:0/1819892343 conn(0x7fa68c070450 msgr2=0x7fa68c158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:38.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.089+0000 7fa693184700 1 -- 172.21.15.49:0/1819892343 shutdown_connections 2023-07-21T22:13:38.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.089+0000 7fa693184700 1 -- 172.21.15.49:0/1819892343 wait complete. 2023-07-21T22:13:38.155 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:13:38.156 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:13:38.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.297+0000 7f31a3c25700 1 Processor -- start 2023-07-21T22:13:38.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.297+0000 7f31a3c25700 1 -- start start 2023-07-21T22:13:38.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.301+0000 7f31a3c25700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f319c0d0b80 0x7f319c0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:38.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.301+0000 7f31a3c25700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f319c0ce790 0x7f319c0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:38.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.301+0000 7f31a3c25700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319c0b8680 con 0x7f319c0cdd50 2023-07-21T22:13:38.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.301+0000 7f31a3c25700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319c0d3500 con 0x7f319c0ce790 2023-07-21T22:13:38.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.301+0000 7f31a3c25700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0d2fa0 con 0x7f319c0d0b80 2023-07-21T22:13:38.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.301+0000 7f31a19c1700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f319c0cdd50 0x7f319c0d0470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58888/0 (socket says 172.21.15.49:58888) 2023-07-21T22:13:38.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.301+0000 7f31a19c1700 1 -- 172.21.15.49:0/3106789019 learned_addr learned my addr 172.21.15.49:0/3106789019 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:38.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.301+0000 7f31a21c2700 1 --2- 172.21.15.49:0/3106789019 >> v2:172.21.15.150:3300/0 conn(0x7f319c0ce790 0x7f319c0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:38.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.301+0000 7f31a11c0700 1 --2- 172.21.15.49:0/3106789019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f319c0d0b80 0x7f319c0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:38.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.301+0000 7f31a09bf700 1 -- 172.21.15.49:0/3106789019 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067763700 0 0) 0x7f319c0b8680 con 0x7f319c0cdd50 2023-07-21T22:13:38.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.301+0000 7f31a09bf700 1 -- 172.21.15.49:0/3106789019 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31880035d0 con 0x7f319c0cdd50 2023-07-21T22:13:38.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a21c2700 1 -- 172.21.15.49:0/3106789019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f319c0d0b80 msgr2=0x7f319c0ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:38.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a21c2700 1 --2- 172.21.15.49:0/3106789019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f319c0d0b80 0x7f319c0ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:38.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a21c2700 1 -- 172.21.15.49:0/3106789019 >> v1:172.21.15.49:6789/0 conn(0x7f319c0cdd50 legacy=0x7f319c0d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:38.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a21c2700 1 -- 172.21.15.49:0/3106789019 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c0b6290 con 0x7f319c0ce790 2023-07-21T22:13:38.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a21c2700 1 --2- 172.21.15.49:0/3106789019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f319c0ce790 0x7f319c0cf330 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3194009d90 tx=0x7f319400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c74e34532164f5eb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:38.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a09bf700 1 -- 172.21.15.49:0/3106789019 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319400e070 con 0x7f319c0ce790 2023-07-21T22:13:38.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a09bf700 1 -- 172.21.15.49:0/3106789019 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319400bb20 con 0x7f319c0ce790 2023-07-21T22:13:38.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a09bf700 1 -- 172.21.15.49:0/3106789019 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194012430 con 0x7f319c0ce790 2023-07-21T22:13:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a3c25700 1 -- 172.21.15.49:0/3106789019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f319c0ce790 msgr2=0x7f319c0cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a3c25700 1 --2- 172.21.15.49:0/3106789019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f319c0ce790 0x7f319c0cf330 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3194009d90 tx=0x7f319400b330 comp rx=0 tx=0).stop 2023-07-21T22:13:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a3c25700 1 -- 172.21.15.49:0/3106789019 shutdown_connections 2023-07-21T22:13:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a3c25700 1 --2- 172.21.15.49:0/3106789019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f319c0ce790 0x7f319c0cf330 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a3c25700 1 --2- 172.21.15.49:0/3106789019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f319c0d0b80 0x7f319c0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a3c25700 1 -- 172.21.15.49:0/3106789019 >> 172.21.15.49:0/3106789019 conn(0x7f319c0b55e0 msgr2=0x7f319c0b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a3c25700 1 -- 172.21.15.49:0/3106789019 shutdown_connections 2023-07-21T22:13:38.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.305+0000 7f31a3c25700 1 -- 172.21.15.49:0/3106789019 wait complete. 2023-07-21T22:13:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.309+0000 7f31a3c25700 1 Processor -- start 2023-07-21T22:13:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.309+0000 7f31a3c25700 1 -- start start 2023-07-21T22:13:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.309+0000 7f31a3c25700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f319c0cdd50 0x7f319c15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.309+0000 7f31a3c25700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f319c0ce790 0x7f319c0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.309+0000 7f31a3c25700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f319c0d0b80 0x7f319c0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.309+0000 7f31a3c25700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0cb690 con 0x7f319c0ce790 2023-07-21T22:13:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.309+0000 7f31a3c25700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c15afd0 con 0x7f319c0cdd50 2023-07-21T22:13:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.309+0000 7f31a3c25700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0c7fe0 con 0x7f319c0d0b80 2023-07-21T22:13:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.309+0000 7f31a11c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f319c0ce790 0x7f319c0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.309+0000 7f31a11c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f319c0ce790 0x7f319c0c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47436/0 (socket says 172.21.15.49:47436) 2023-07-21T22:13:38.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.309+0000 7f31a11c0700 1 -- 172.21.15.49:0/3015601666 learned_addr learned my addr 172.21.15.49:0/3015601666 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:38.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.309+0000 7f31a19c1700 1 --2- 172.21.15.49:0/3015601666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f319c0cdd50 0x7f319c15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:38.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.309+0000 7f31a21c2700 1 --2- 172.21.15.49:0/3015601666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f319c0d0b80 0x7f319c0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:38.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.313+0000 7f31a11c0700 1 -- 172.21.15.49:0/3015601666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f319c0d0b80 msgr2=0x7f319c0c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:38.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.313+0000 7f31a11c0700 1 --2- 172.21.15.49:0/3015601666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f319c0d0b80 0x7f319c0c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:38.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.313+0000 7f31a11c0700 1 -- 172.21.15.49:0/3015601666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f319c0cdd50 msgr2=0x7f319c15aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.313+0000 7f31a11c0700 1 --2- 172.21.15.49:0/3015601666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f319c0cdd50 0x7f319c15aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.313+0000 7f31a11c0700 1 -- 172.21.15.49:0/3015601666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3194009a70 con 0x7f319c0ce790 2023-07-21T22:13:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.313+0000 7f31a11c0700 1 --2- 172.21.15.49:0/3015601666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f319c0ce790 0x7f319c0c83e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f318c009fd0 tx=0x7f318c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.313+0000 7f31927fc700 1 -- 172.21.15.49:0/3015601666 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c0095a0 con 0x7f319c0ce790 2023-07-21T22:13:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.313+0000 7f31927fc700 1 -- 172.21.15.49:0/3015601666 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c013680 con 0x7f319c0ce790 2023-07-21T22:13:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.313+0000 7f31927fc700 1 -- 172.21.15.49:0/3015601666 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c013a30 con 0x7f319c0ce790 2023-07-21T22:13:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.313+0000 7f31a3c25700 1 -- 172.21.15.49:0/3015601666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319c0cb870 con 0x7f319c0ce790 2023-07-21T22:13:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.313+0000 7f31a3c25700 1 -- 172.21.15.49:0/3015601666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319c0cbe30 con 0x7f319c0ce790 2023-07-21T22:13:38.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.313+0000 7f31a3c25700 1 -- 172.21.15.49:0/3015601666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319c04dd20 con 0x7f319c0ce790 2023-07-21T22:13:38.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.317+0000 7f31927fc700 1 -- 172.21.15.49:0/3015601666 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f318c013b90 con 0x7f319c0ce790 2023-07-21T22:13:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.317+0000 7f31927fc700 1 --2- 172.21.15.49:0/3015601666 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3180066320 0x7f31800687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:38.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.317+0000 7f31927fc700 1 -- 172.21.15.49:0/3015601666 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f318c083940 con 0x7f319c0ce790 2023-07-21T22:13:38.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.321+0000 7f31a19c1700 1 --2- 172.21.15.49:0/3015601666 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3180066320 0x7f31800687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.321+0000 7f31a19c1700 1 --2- 172.21.15.49:0/3015601666 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3180066320 0x7f31800687d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f31980010e0 tx=0x7f3198007c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.325+0000 7f31927fc700 1 -- 172.21.15.49:0/3015601666 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f318c050fd0 con 0x7f319c0ce790 2023-07-21T22:13:38.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:38.497+0000 7f31a3c25700 1 -- 172.21.15.49:0/3015601666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f319c0b8090 con 0x7f319c0ce790 2023-07-21T22:13:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.061+0000 7f31927fc700 1 -- 172.21.15.49:0/3015601666 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f318c0170b0 con 0x7f319c0ce790 2023-07-21T22:13:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.065+0000 7f31a3c25700 1 -- 172.21.15.49:0/3015601666 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3180066320 msgr2=0x7f31800687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.065+0000 7f31a3c25700 1 --2- 172.21.15.49:0/3015601666 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3180066320 0x7f31800687d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f31980010e0 tx=0x7f3198007c90 comp rx=0 tx=0).stop 2023-07-21T22:13:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.065+0000 7f31a3c25700 1 -- 172.21.15.49:0/3015601666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f319c0ce790 msgr2=0x7f319c0c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.065+0000 7f31a3c25700 1 --2- 172.21.15.49:0/3015601666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f319c0ce790 0x7f319c0c83e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f318c009fd0 tx=0x7f318c00eb20 comp rx=0 tx=0).stop 2023-07-21T22:13:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.065+0000 7f31a3c25700 1 -- 172.21.15.49:0/3015601666 shutdown_connections 2023-07-21T22:13:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.065+0000 7f31a3c25700 1 --2- 172.21.15.49:0/3015601666 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3180066320 0x7f31800687d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.065+0000 7f31a3c25700 1 --2- 172.21.15.49:0/3015601666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f319c0ce790 0x7f319c0c83e0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.065+0000 7f31a3c25700 1 --2- 172.21.15.49:0/3015601666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f319c0d0b80 0x7f319c0c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.065+0000 7f31a3c25700 1 --2- 172.21.15.49:0/3015601666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f319c0cdd50 0x7f319c15aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.065+0000 7f31a3c25700 1 -- 172.21.15.49:0/3015601666 >> 172.21.15.49:0/3015601666 conn(0x7f319c0b55e0 msgr2=0x7f319c1e4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:39.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.065+0000 7f31a3c25700 1 -- 172.21.15.49:0/3015601666 shutdown_connections 2023-07-21T22:13:39.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.065+0000 7f31a3c25700 1 -- 172.21.15.49:0/3015601666 wait complete. 2023-07-21T22:13:39.110 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-07-21T22:13:39.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:13:39.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.277+0000 7f07708f4700 1 Processor -- start 2023-07-21T22:13:39.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.277+0000 7f07708f4700 1 -- start start 2023-07-21T22:13:39.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f07708f4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f076c0cf100 0x7f076c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:39.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f07708f4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076c0b5460 con 0x7f076c15bed0 2023-07-21T22:13:39.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f07708f4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076c0d1030 con 0x7f076c0d07b0 2023-07-21T22:13:39.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f07708f4700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c0d1310 con 0x7f076c0cf100 2023-07-21T22:13:39.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f076a59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f076c0cf100 0x7f076c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:39.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f076ad9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f076c15bed0 0x7f076c0ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58900/0 (socket says 172.21.15.49:58900) 2023-07-21T22:13:39.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f076ad9d700 1 -- 172.21.15.49:0/418618694 learned_addr learned my addr 172.21.15.49:0/418618694 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:39.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f0769d9b700 1 -- 172.21.15.49:0/418618694 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650162910 0 0) 0x7f076c0d1030 con 0x7f076c0d07b0 2023-07-21T22:13:39.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f076a59c700 1 -- 172.21.15.49:0/418618694 >> v1:172.21.15.150:6789/0 conn(0x7f076c0d07b0 legacy=0x7f076c0b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:39.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f076a59c700 1 -- 172.21.15.49:0/418618694 >> v1:172.21.15.49:6789/0 conn(0x7f076c15bed0 legacy=0x7f076c0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:39.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f076a59c700 1 -- 172.21.15.49:0/418618694 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c0d15f0 con 0x7f076c0cf100 2023-07-21T22:13:39.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f076a59c700 1 --2- 172.21.15.49:0/418618694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f076c0cf100 0x7f076c0d0270 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0760009850 tx=0x7f0760009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1384de2ea3aaea server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:39.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f0769d9b700 1 -- 172.21.15.49:0/418618694 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0760004230 con 0x7f076c0cf100 2023-07-21T22:13:39.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f0769d9b700 1 -- 172.21.15.49:0/418618694 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0760004390 con 0x7f076c0cf100 2023-07-21T22:13:39.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.281+0000 7f0769d9b700 1 -- 172.21.15.49:0/418618694 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07600036c0 con 0x7f076c0cf100 2023-07-21T22:13:39.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.285+0000 7f07708f4700 1 -- 172.21.15.49:0/418618694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f076c0cf100 msgr2=0x7f076c0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:39.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.285+0000 7f07708f4700 1 --2- 172.21.15.49:0/418618694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f076c0cf100 0x7f076c0d0270 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0760009850 tx=0x7f0760009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:39.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.285+0000 7f07708f4700 1 -- 172.21.15.49:0/418618694 shutdown_connections 2023-07-21T22:13:39.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.285+0000 7f07708f4700 1 --2- 172.21.15.49:0/418618694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f076c0cf100 0x7f076c0d0270 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:39.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.285+0000 7f07708f4700 1 -- 172.21.15.49:0/418618694 >> 172.21.15.49:0/418618694 conn(0x7f076c065af0 msgr2=0x7f076c06fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:39.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.285+0000 7f07708f4700 1 -- 172.21.15.49:0/418618694 shutdown_connections 2023-07-21T22:13:39.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.285+0000 7f07708f4700 1 -- 172.21.15.49:0/418618694 wait complete. 2023-07-21T22:13:39.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f07708f4700 1 Processor -- start 2023-07-21T22:13:39.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f07708f4700 1 -- start start 2023-07-21T22:13:39.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f07708f4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f076c0cf100 0x7f076c1580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:39.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f07708f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f076c0d07b0 0x7f076c1e5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:39.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f07708f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f076c15bed0 0x7f076c14b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:39.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f07708f4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c1f4ab0 con 0x7f076c0cf100 2023-07-21T22:13:39.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f07708f4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0cc7f0 con 0x7f076c15bed0 2023-07-21T22:13:39.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f07708f4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c1f4460 con 0x7f076c0d07b0 2023-07-21T22:13:39.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f076ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f076c0cf100 0x7f076c1580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:39.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f076ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f076c0cf100 0x7f076c1580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47452/0 (socket says 172.21.15.49:47452) 2023-07-21T22:13:39.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f076ad9d700 1 -- 172.21.15.49:0/1241802856 learned_addr learned my addr 172.21.15.49:0/1241802856 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:39.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f076a59c700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f076c0d07b0 0x7f076c1e5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:39.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f076b59e700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f076c15bed0 0x7f076c14b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:39.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f076ad9d700 1 -- 172.21.15.49:0/1241802856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f076c0d07b0 msgr2=0x7f076c1e5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:39.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f076ad9d700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f076c0d07b0 0x7f076c1e5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:39.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f076ad9d700 1 -- 172.21.15.49:0/1241802856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f076c15bed0 msgr2=0x7f076c14b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f076ad9d700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f076c15bed0 0x7f076c14b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f076ad9d700 1 -- 172.21.15.49:0/1241802856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07600094b0 con 0x7f076c0cf100 2023-07-21T22:13:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.289+0000 7f076b59e700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f076c15bed0 0x7f076c14b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.293+0000 7f076ad9d700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f076c0cf100 0x7f076c1580f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f075c00c780 tx=0x7f075c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:39.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.293+0000 7f07537fe700 1 -- 172.21.15.49:0/1241802856 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c004ca0 con 0x7f076c0cf100 2023-07-21T22:13:39.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.293+0000 7f07537fe700 1 -- 172.21.15.49:0/1241802856 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075c004e00 con 0x7f076c0cf100 2023-07-21T22:13:39.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.293+0000 7f07537fe700 1 -- 172.21.15.49:0/1241802856 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c0072f0 con 0x7f076c0cf100 2023-07-21T22:13:39.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.293+0000 7f07708f4700 1 -- 172.21.15.49:0/1241802856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076c1f4740 con 0x7f076c0cf100 2023-07-21T22:13:39.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.293+0000 7f07708f4700 1 -- 172.21.15.49:0/1241802856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076c1e5f90 con 0x7f076c0cf100 2023-07-21T22:13:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.293+0000 7f07708f4700 1 -- 172.21.15.49:0/1241802856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076c04dcb0 con 0x7f076c0cf100 2023-07-21T22:13:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.297+0000 7f07537fe700 1 -- 172.21.15.49:0/1241802856 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f075c007450 con 0x7f076c0cf100 2023-07-21T22:13:39.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.297+0000 7f07537fe700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f07580662f0 0x7f07580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:39.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.297+0000 7f07537fe700 1 -- 172.21.15.49:0/1241802856 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f075c0837d0 con 0x7f076c0cf100 2023-07-21T22:13:39.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.297+0000 7f076a59c700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f07580662f0 0x7f07580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:39.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.301+0000 7f076a59c700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f07580662f0 0x7f07580687a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0760009850 tx=0x7f0760010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.305+0000 7f07537fe700 1 -- 172.21.15.49:0/1241802856 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f075c050ce0 con 0x7f076c0cf100 2023-07-21T22:13:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:39.489+0000 7f07708f4700 1 -- 172.21.15.49:0/1241802856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f076c1e5f90 con 0x7f076c0cf100 2023-07-21T22:13:40.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.069+0000 7f07537fe700 1 -- 172.21.15.49:0/1241802856 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) v1 ==== 170+0+0 (secure 0 0 0) 0x7f075c054300 con 0x7f076c0cf100 2023-07-21T22:13:40.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.081+0000 7f07708f4700 1 -- 172.21.15.49:0/1241802856 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f07580662f0 msgr2=0x7f07580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:40.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.081+0000 7f07708f4700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f07580662f0 0x7f07580687a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0760009850 tx=0x7f0760010000 comp rx=0 tx=0).stop 2023-07-21T22:13:40.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.081+0000 7f07708f4700 1 -- 172.21.15.49:0/1241802856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f076c0cf100 msgr2=0x7f076c1580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:40.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.081+0000 7f07708f4700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f076c0cf100 0x7f076c1580f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f075c00c780 tx=0x7f075c00ca90 comp rx=0 tx=0).stop 2023-07-21T22:13:40.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.081+0000 7f07708f4700 1 -- 172.21.15.49:0/1241802856 shutdown_connections 2023-07-21T22:13:40.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.081+0000 7f07708f4700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f07580662f0 0x7f07580687a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:40.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.081+0000 7f07708f4700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f076c15bed0 0x7f076c14b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:40.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.081+0000 7f07708f4700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f076c0d07b0 0x7f076c1e5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:40.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.081+0000 7f07708f4700 1 --2- 172.21.15.49:0/1241802856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f076c0cf100 0x7f076c1580f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:40.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.081+0000 7f07708f4700 1 -- 172.21.15.49:0/1241802856 >> 172.21.15.49:0/1241802856 conn(0x7f076c065af0 msgr2=0x7f076c06fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:40.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.085+0000 7f07708f4700 1 -- 172.21.15.49:0/1241802856 shutdown_connections 2023-07-21T22:13:40.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.085+0000 7f07708f4700 1 -- 172.21.15.49:0/1241802856 wait complete. 2023-07-21T22:13:40.132 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-07-21T22:13:40.154 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:13:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.293+0000 7f7c7d4a2700 1 Processor -- start 2023-07-21T22:13:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.293+0000 7f7c7d4a2700 1 -- start start 2023-07-21T22:13:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c7d4a2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c780ce650 0x7f7c7815c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c7d4a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c780c9990 0x7f7c7815cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:40.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c7d4a2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c780c8bd0 con 0x7f7c781564c0 2023-07-21T22:13:40.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c7d4a2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c780c9570 con 0x7f7c780ce650 2023-07-21T22:13:40.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c7d4a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780c8eb0 con 0x7f7c780c9990 2023-07-21T22:13:40.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c767fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c780ce650 0x7f7c7815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:40.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c767fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c780ce650 0x7f7c7815c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47462/0 (socket says 172.21.15.49:47462) 2023-07-21T22:13:40.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c767fc700 1 -- 172.21.15.49:0/2512906634 learned_addr learned my addr 172.21.15.49:0/2512906634 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:40.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c777fe700 1 --2- 172.21.15.49:0/2512906634 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c780c9990 0x7f7c7815cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:40.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c767fc700 1 -- 172.21.15.49:0/2512906634 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c780c9990 msgr2=0x7f7c7815cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:40.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c767fc700 1 --2- 172.21.15.49:0/2512906634 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c780c9990 0x7f7c7815cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:40.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c767fc700 1 -- 172.21.15.49:0/2512906634 >> v1:172.21.15.150:6789/0 conn(0x7f7c781564c0 legacy=0x7f7c780cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:40.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c767fc700 1 -- 172.21.15.49:0/2512906634 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c780c9190 con 0x7f7c780ce650 2023-07-21T22:13:40.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c767fc700 1 --2- 172.21.15.49:0/2512906634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c780ce650 0x7f7c7815c890 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00bbb0 tx=0x7f7c6c00bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85336c8b516ad55a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:40.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c75ffb700 1 -- 172.21.15.49:0/2512906634 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c005e50 con 0x7f7c780ce650 2023-07-21T22:13:40.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c75ffb700 1 -- 172.21.15.49:0/2512906634 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c00d980 con 0x7f7c780ce650 2023-07-21T22:13:40.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.297+0000 7f7c75ffb700 1 -- 172.21.15.49:0/2512906634 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c00dd30 con 0x7f7c780ce650 2023-07-21T22:13:40.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.301+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/2512906634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c780ce650 msgr2=0x7f7c7815c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:40.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.301+0000 7f7c7d4a2700 1 --2- 172.21.15.49:0/2512906634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c780ce650 0x7f7c7815c890 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00bbb0 tx=0x7f7c6c00bec0 comp rx=0 tx=0).stop 2023-07-21T22:13:40.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.301+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/2512906634 shutdown_connections 2023-07-21T22:13:40.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.301+0000 7f7c7d4a2700 1 --2- 172.21.15.49:0/2512906634 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c780c9990 0x7f7c7815cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:40.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.301+0000 7f7c7d4a2700 1 --2- 172.21.15.49:0/2512906634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c780ce650 0x7f7c7815c890 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:40.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.301+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/2512906634 >> 172.21.15.49:0/2512906634 conn(0x7f7c7806e960 msgr2=0x7f7c7806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:40.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.301+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/2512906634 shutdown_connections 2023-07-21T22:13:40.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.301+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/2512906634 wait complete. 2023-07-21T22:13:40.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.301+0000 7f7c7d4a2700 1 Processor -- start 2023-07-21T22:13:40.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.301+0000 7f7c7d4a2700 1 -- start start 2023-07-21T22:13:40.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c7d4a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c780c9990 0x7f7c78149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:40.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c7d4a2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c780ce650 0x7f7c78158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:40.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c7d4a2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c781564c0 0x7f7c780ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:40.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c7d4a2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780ac2e0 con 0x7f7c781564c0 2023-07-21T22:13:40.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c7d4a2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7806c770 con 0x7f7c780ce650 2023-07-21T22:13:40.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c7d4a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780ac530 con 0x7f7c780c9990 2023-07-21T22:13:40.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c777fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c781564c0 0x7f7c780ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:40.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c777fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c781564c0 0x7f7c780ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47464/0 (socket says 172.21.15.49:47464) 2023-07-21T22:13:40.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c777fe700 1 -- 172.21.15.49:0/539301710 learned_addr learned my addr 172.21.15.49:0/539301710 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:40.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c767fc700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c780ce650 0x7f7c78158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:40.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c76ffd700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c780c9990 0x7f7c78149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:40.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c777fe700 1 -- 172.21.15.49:0/539301710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c780c9990 msgr2=0x7f7c78149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:40.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c777fe700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c780c9990 0x7f7c78149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:40.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c777fe700 1 -- 172.21.15.49:0/539301710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c780ce650 msgr2=0x7f7c78158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:40.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c777fe700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c780ce650 0x7f7c78158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:40.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c777fe700 1 -- 172.21.15.49:0/539301710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c00b7c0 con 0x7f7c781564c0 2023-07-21T22:13:40.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c767fc700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c780ce650 0x7f7c78158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:40.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c76ffd700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c780c9990 0x7f7c78149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:40.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c777fe700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c781564c0 0x7f7c780ca9a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7c70007e70 tx=0x7f7c7000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:40.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c5f7fe700 1 -- 172.21.15.49:0/539301710 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000ee50 con 0x7f7c781564c0 2023-07-21T22:13:40.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/539301710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c780ac810 con 0x7f7c781564c0 2023-07-21T22:13:40.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c5f7fe700 1 -- 172.21.15.49:0/539301710 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c70014420 con 0x7f7c781564c0 2023-07-21T22:13:40.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c5f7fe700 1 -- 172.21.15.49:0/539301710 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c700147d0 con 0x7f7c781564c0 2023-07-21T22:13:40.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/539301710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7806c400 con 0x7f7c781564c0 2023-07-21T22:13:40.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.305+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/539301710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7806c900 con 0x7f7c781564c0 2023-07-21T22:13:40.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.309+0000 7f7c5f7fe700 1 -- 172.21.15.49:0/539301710 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7c70014930 con 0x7f7c781564c0 2023-07-21T22:13:40.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.309+0000 7f7c5f7fe700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7c64066320 0x7f7c640687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:40.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.309+0000 7f7c5f7fe700 1 -- 172.21.15.49:0/539301710 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f7c70085480 con 0x7f7c781564c0 2023-07-21T22:13:40.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.313+0000 7f7c76ffd700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7c64066320 0x7f7c640687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:40.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.313+0000 7f7c76ffd700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7c64066320 0x7f7c640687d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7c68000f60 tx=0x7f7c68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:40.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.317+0000 7f7c5f7fe700 1 -- 172.21.15.49:0/539301710 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7c70052890 con 0x7f7c781564c0 2023-07-21T22:13:40.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:40.533+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/539301710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7c7804dd50 con 0x7f7c781564c0 2023-07-21T22:13:41.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.101+0000 7f7c5f7fe700 1 -- 172.21.15.49:0/539301710 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v22) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7c7001c360 con 0x7f7c781564c0 2023-07-21T22:13:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.109+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/539301710 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7c64066320 msgr2=0x7f7c640687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.109+0000 7f7c7d4a2700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7c64066320 0x7f7c640687d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7c68000f60 tx=0x7f7c68009040 comp rx=0 tx=0).stop 2023-07-21T22:13:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.109+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/539301710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c781564c0 msgr2=0x7f7c780ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:41.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.109+0000 7f7c7d4a2700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c781564c0 0x7f7c780ca9a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7c70007e70 tx=0x7f7c7000e3c0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.109+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/539301710 shutdown_connections 2023-07-21T22:13:41.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.109+0000 7f7c7d4a2700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7c64066320 0x7f7c640687d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.109+0000 7f7c7d4a2700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c781564c0 0x7f7c780ca9a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.109+0000 7f7c7d4a2700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c780ce650 0x7f7c78158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.109+0000 7f7c7d4a2700 1 --2- 172.21.15.49:0/539301710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c780c9990 0x7f7c78149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.109+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/539301710 >> 172.21.15.49:0/539301710 conn(0x7f7c7806e960 msgr2=0x7f7c781538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:41.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.113+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/539301710 shutdown_connections 2023-07-21T22:13:41.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.113+0000 7f7c7d4a2700 1 -- 172.21.15.49:0/539301710 wait complete. 2023-07-21T22:13:41.160 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 9 and data pool 10 2023-07-21T22:13:41.180 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:13:41.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.309+0000 7fc9c359e700 1 Processor -- start 2023-07-21T22:13:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.309+0000 7fc9c359e700 1 -- start start 2023-07-21T22:13:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.309+0000 7fc9c359e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc9c406d380 0x7fc9c406d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.309+0000 7fc9c359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c4071c70 0x7fc9c40b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c359e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c40cab20 con 0x7fc9c40b1400 2023-07-21T22:13:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c359e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c40c9e80 con 0x7fc9c406d380 2023-07-21T22:13:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40afeb0 con 0x7fc9c4071c70 2023-07-21T22:13:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc9c406d380 0x7fc9c406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c2d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc9c40b1400 0x7fc9c40cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58914/0 (socket says 172.21.15.49:58914) 2023-07-21T22:13:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c2d9d700 1 -- 172.21.15.49:0/3830369032 learned_addr learned my addr 172.21.15.49:0/3830369032 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9b9d9b700 1 --2- 172.21.15.49:0/3830369032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c4071c70 0x7fc9c40b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c259c700 1 -- 172.21.15.49:0/3830369032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c4071c70 msgr2=0x7fc9c40b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c259c700 1 --2- 172.21.15.49:0/3830369032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c4071c70 0x7fc9c40b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c259c700 1 -- 172.21.15.49:0/3830369032 >> v1:172.21.15.49:6789/0 conn(0x7fc9c40b1400 legacy=0x7fc9c40cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:41.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c259c700 1 -- 172.21.15.49:0/3830369032 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c406dc90 con 0x7fc9c406d380 2023-07-21T22:13:41.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c1d9b700 1 -- 172.21.15.49:0/3830369032 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504549632 0 0) 0x7fc9c40cab20 con 0x7fc9c40b1400 2023-07-21T22:13:41.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c259c700 1 --2- 172.21.15.49:0/3830369032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c406d380 0x7fc9c406d750 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009d90 tx=0x7fc9b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e22d7de4a8b0b72 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:41.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c1d9b700 1 -- 172.21.15.49:0/3830369032 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b400e070 con 0x7fc9c406d380 2023-07-21T22:13:41.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c1d9b700 1 -- 172.21.15.49:0/3830369032 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b400bb20 con 0x7fc9c406d380 2023-07-21T22:13:41.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c1d9b700 1 -- 172.21.15.49:0/3830369032 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4012430 con 0x7fc9c406d380 2023-07-21T22:13:41.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c359e700 1 -- 172.21.15.49:0/3830369032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c406d380 msgr2=0x7fc9c406d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:41.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c359e700 1 --2- 172.21.15.49:0/3830369032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c406d380 0x7fc9c406d750 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009d90 tx=0x7fc9b400b330 comp rx=0 tx=0).stop 2023-07-21T22:13:41.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c359e700 1 -- 172.21.15.49:0/3830369032 shutdown_connections 2023-07-21T22:13:41.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c359e700 1 --2- 172.21.15.49:0/3830369032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c4071c70 0x7fc9c40b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c359e700 1 --2- 172.21.15.49:0/3830369032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c406d380 0x7fc9c406d750 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c359e700 1 -- 172.21.15.49:0/3830369032 >> 172.21.15.49:0/3830369032 conn(0x7fc9c4070450 msgr2=0x7fc9c4070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:41.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c359e700 1 -- 172.21.15.49:0/3830369032 shutdown_connections 2023-07-21T22:13:41.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.313+0000 7fc9c359e700 1 -- 172.21.15.49:0/3830369032 wait complete. 2023-07-21T22:13:41.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.317+0000 7fc9c359e700 1 Processor -- start 2023-07-21T22:13:41.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.317+0000 7fc9c359e700 1 -- start start 2023-07-21T22:13:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9c359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c406d380 0x7fc9c41f1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9c359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c4071c70 0x7fc9c41535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9c359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40b1400 0x7fc9c41590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9c359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c41f1b20 con 0x7fc9c4071c70 2023-07-21T22:13:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9c359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c41f1e00 con 0x7fc9c40b1400 2023-07-21T22:13:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9c359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c41f20e0 con 0x7fc9c406d380 2023-07-21T22:13:41.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9b9d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c4071c70 0x7fc9c41535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:41.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9b9d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c4071c70 0x7fc9c41535f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47480/0 (socket says 172.21.15.49:47480) 2023-07-21T22:13:41.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9b9d9b700 1 -- 172.21.15.49:0/398630752 learned_addr learned my addr 172.21.15.49:0/398630752 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:41.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9c259c700 1 --2- 172.21.15.49:0/398630752 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c406d380 0x7fc9c41f1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:41.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9c2d9d700 1 --2- 172.21.15.49:0/398630752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40b1400 0x7fc9c41590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:41.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9b9d9b700 1 -- 172.21.15.49:0/398630752 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c406d380 msgr2=0x7fc9c41f1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:41.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9b9d9b700 1 --2- 172.21.15.49:0/398630752 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c406d380 0x7fc9c41f1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9b9d9b700 1 -- 172.21.15.49:0/398630752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40b1400 msgr2=0x7fc9c41590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:41.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9b9d9b700 1 --2- 172.21.15.49:0/398630752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40b1400 0x7fc9c41590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9b9d9b700 1 -- 172.21.15.49:0/398630752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b4009a70 con 0x7fc9c4071c70 2023-07-21T22:13:41.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9b9d9b700 1 --2- 172.21.15.49:0/398630752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c4071c70 0x7fc9c41535f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00e9d0 tx=0x7fc9ac00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:41.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9bb7fe700 1 -- 172.21.15.49:0/398630752 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac009720 con 0x7fc9c4071c70 2023-07-21T22:13:41.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9c359e700 1 -- 172.21.15.49:0/398630752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c41f23c0 con 0x7fc9c4071c70 2023-07-21T22:13:41.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9bb7fe700 1 -- 172.21.15.49:0/398630752 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac00ee70 con 0x7fc9c4071c70 2023-07-21T22:13:41.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9bb7fe700 1 -- 172.21.15.49:0/398630752 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac00ca50 con 0x7fc9c4071c70 2023-07-21T22:13:41.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.321+0000 7fc9c359e700 1 -- 172.21.15.49:0/398630752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c4153b30 con 0x7fc9c4071c70 2023-07-21T22:13:41.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.325+0000 7fc9c359e700 1 -- 172.21.15.49:0/398630752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c404dcb0 con 0x7fc9c4071c70 2023-07-21T22:13:41.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.325+0000 7fc9bb7fe700 1 -- 172.21.15.49:0/398630752 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc9ac00cbb0 con 0x7fc9c4071c70 2023-07-21T22:13:41.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.329+0000 7fc9bb7fe700 1 --2- 172.21.15.49:0/398630752 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc9a40662f0 0x7fc9a40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:41.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.329+0000 7fc9bb7fe700 1 -- 172.21.15.49:0/398630752 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc9ac083eb0 con 0x7fc9c4071c70 2023-07-21T22:13:41.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.329+0000 7fc9c259c700 1 --2- 172.21.15.49:0/398630752 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc9a40662f0 0x7fc9a40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:41.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.329+0000 7fc9c259c700 1 --2- 172.21.15.49:0/398630752 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc9a40662f0 0x7fc9a40687a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4014040 tx=0x7fc9b4011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:41.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.333+0000 7fc9bb7fe700 1 -- 172.21.15.49:0/398630752 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9ac054c00 con 0x7fc9c4071c70 2023-07-21T22:13:41.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.505+0000 7fc9c359e700 1 -- 172.21.15.49:0/398630752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9c40c1720 con 0x7fc9c4071c70 2023-07-21T22:13:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.509+0000 7fc9bb7fe700 1 -- 172.21.15.49:0/398630752 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+18475 (secure 0 0 0) 0x7fc9ac00ce60 con 0x7fc9c4071c70 2023-07-21T22:13:41.554 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:41.554 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":61,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:13:40.537462+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:13:38.569931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:13:39.558524+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:13:41.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.513+0000 7fc9c359e700 1 -- 172.21.15.49:0/398630752 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc9a40662f0 msgr2=0x7fc9a40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:41.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.513+0000 7fc9c359e700 1 --2- 172.21.15.49:0/398630752 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc9a40662f0 0x7fc9a40687a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4014040 tx=0x7fc9b4011000 comp rx=0 tx=0).stop 2023-07-21T22:13:41.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.513+0000 7fc9c359e700 1 -- 172.21.15.49:0/398630752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c4071c70 msgr2=0x7fc9c41535f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:41.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.513+0000 7fc9c359e700 1 --2- 172.21.15.49:0/398630752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c4071c70 0x7fc9c41535f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00e9d0 tx=0x7fc9ac00ece0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.513+0000 7fc9c359e700 1 -- 172.21.15.49:0/398630752 shutdown_connections 2023-07-21T22:13:41.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.513+0000 7fc9c359e700 1 --2- 172.21.15.49:0/398630752 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc9a40662f0 0x7fc9a40687a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.513+0000 7fc9c359e700 1 --2- 172.21.15.49:0/398630752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c4071c70 0x7fc9c41535f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.513+0000 7fc9c359e700 1 --2- 172.21.15.49:0/398630752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40b1400 0x7fc9c41590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.513+0000 7fc9c359e700 1 --2- 172.21.15.49:0/398630752 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c406d380 0x7fc9c41f1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.513+0000 7fc9c359e700 1 -- 172.21.15.49:0/398630752 >> 172.21.15.49:0/398630752 conn(0x7fc9c4070450 msgr2=0x7fc9c40b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:41.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.513+0000 7fc9c359e700 1 -- 172.21.15.49:0/398630752 shutdown_connections 2023-07-21T22:13:41.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.513+0000 7fc9c359e700 1 -- 172.21.15.49:0/398630752 wait complete. 2023-07-21T22:13:41.579 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:13:41.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.705+0000 7ff40efd2700 1 Processor -- start 2023-07-21T22:13:41.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.705+0000 7ff40efd2700 1 -- start start 2023-07-21T22:13:41.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40efd2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff40806d380 0x7ff40806d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:41.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40efd2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff408071c70 0x7ff4080b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:41.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40efd2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4080b1400 0x7ff4080cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:41.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40efd2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4080c9e80 con 0x7ff4080b1400 2023-07-21T22:13:41.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40efd2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4080afeb0 con 0x7ff408071c70 2023-07-21T22:13:41.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40efd2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080cab20 con 0x7ff40806d380 2023-07-21T22:13:41.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40e7d1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4080b1400 0x7ff4080cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:41.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40e7d1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4080b1400 0x7ff4080cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47496/0 (socket says 172.21.15.49:47496) 2023-07-21T22:13:41.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40e7d1700 1 -- 172.21.15.49:0/4142911232 learned_addr learned my addr 172.21.15.49:0/4142911232 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:41.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40d7cf700 1 --2- 172.21.15.49:0/4142911232 >> v2:172.21.15.150:3300/0 conn(0x7ff408071c70 0x7ff4080b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:41.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40dfd0700 1 --2- 172.21.15.49:0/4142911232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff40806d380 0x7ff40806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:41.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40e7d1700 1 -- 172.21.15.49:0/4142911232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff40806d380 msgr2=0x7ff40806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:41.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40e7d1700 1 --2- 172.21.15.49:0/4142911232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff40806d380 0x7ff40806d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40e7d1700 1 -- 172.21.15.49:0/4142911232 >> v2:172.21.15.150:3300/0 conn(0x7ff408071c70 msgr2=0x7ff4080b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:41.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40e7d1700 1 --2- 172.21.15.49:0/4142911232 >> v2:172.21.15.150:3300/0 conn(0x7ff408071c70 0x7ff4080b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.709+0000 7ff40e7d1700 1 -- 172.21.15.49:0/4142911232 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40806dc90 con 0x7ff4080b1400 2023-07-21T22:13:41.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.713+0000 7ff40e7d1700 1 --2- 172.21.15.49:0/4142911232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080b1400 0x7ff4080cafb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff4080cbb60 tx=0x7ff40000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e260b65ced49c694 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:41.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.713+0000 7ff40cfce700 1 -- 172.21.15.49:0/4142911232 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000e070 con 0x7ff4080b1400 2023-07-21T22:13:41.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.713+0000 7ff40cfce700 1 -- 172.21.15.49:0/4142911232 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40000b910 con 0x7ff4080b1400 2023-07-21T22:13:41.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.713+0000 7ff40cfce700 1 -- 172.21.15.49:0/4142911232 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000bcc0 con 0x7ff4080b1400 2023-07-21T22:13:41.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.713+0000 7ff40efd2700 1 -- 172.21.15.49:0/4142911232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080b1400 msgr2=0x7ff4080cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:41.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.713+0000 7ff40efd2700 1 --2- 172.21.15.49:0/4142911232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080b1400 0x7ff4080cafb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff4080cbb60 tx=0x7ff40000b330 comp rx=0 tx=0).stop 2023-07-21T22:13:41.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.713+0000 7ff40efd2700 1 -- 172.21.15.49:0/4142911232 shutdown_connections 2023-07-21T22:13:41.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.713+0000 7ff40efd2700 1 --2- 172.21.15.49:0/4142911232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080b1400 0x7ff4080cafb0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.713+0000 7ff40efd2700 1 --2- 172.21.15.49:0/4142911232 >> v2:172.21.15.150:3300/0 conn(0x7ff408071c70 0x7ff4080b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.713+0000 7ff40efd2700 1 --2- 172.21.15.49:0/4142911232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff40806d380 0x7ff40806d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.713+0000 7ff40efd2700 1 -- 172.21.15.49:0/4142911232 >> 172.21.15.49:0/4142911232 conn(0x7ff408070450 msgr2=0x7ff408070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:41.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.713+0000 7ff40efd2700 1 -- 172.21.15.49:0/4142911232 shutdown_connections 2023-07-21T22:13:41.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.713+0000 7ff40efd2700 1 -- 172.21.15.49:0/4142911232 wait complete. 2023-07-21T22:13:41.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.717+0000 7ff40efd2700 1 Processor -- start 2023-07-21T22:13:41.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.717+0000 7ff40efd2700 1 -- start start 2023-07-21T22:13:41.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.717+0000 7ff40efd2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff40806d380 0x7ff408144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:41.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.717+0000 7ff40efd2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff408071c70 0x7ff4080c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:41.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.717+0000 7ff40efd2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080b1400 0x7ff4080c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:41.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.717+0000 7ff40efd2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080c94c0 con 0x7ff4080b1400 2023-07-21T22:13:41.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.717+0000 7ff40efd2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40814b000 con 0x7ff40806d380 2023-07-21T22:13:41.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.717+0000 7ff40efd2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4081449b0 con 0x7ff408071c70 2023-07-21T22:13:41.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.717+0000 7ff40e7d1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080b1400 0x7ff4080c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:41.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.717+0000 7ff40e7d1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080b1400 0x7ff4080c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47512/0 (socket says 172.21.15.49:47512) 2023-07-21T22:13:41.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.717+0000 7ff40e7d1700 1 -- 172.21.15.49:0/2129326250 learned_addr learned my addr 172.21.15.49:0/2129326250 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:41.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.717+0000 7ff40dfd0700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff40806d380 0x7ff408144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:41.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.717+0000 7ff40d7cf700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff408071c70 0x7ff4080c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:41.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.717+0000 7ff40e7d1700 1 -- 172.21.15.49:0/2129326250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff408071c70 msgr2=0x7ff4080c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:41.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.721+0000 7ff40e7d1700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff408071c70 0x7ff4080c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.721+0000 7ff40e7d1700 1 -- 172.21.15.49:0/2129326250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff40806d380 msgr2=0x7ff408144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:41.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.721+0000 7ff40e7d1700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff40806d380 0x7ff408144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.721+0000 7ff40e7d1700 1 -- 172.21.15.49:0/2129326250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400009b30 con 0x7ff4080b1400 2023-07-21T22:13:41.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.721+0000 7ff40dfd0700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff40806d380 0x7ff408144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:41.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.721+0000 7ff40e7d1700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080b1400 0x7ff4080c6420 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff400003f70 tx=0x7ff400004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:41.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.721+0000 7ff3fe7fc700 1 -- 172.21.15.49:0/2129326250 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff400004450 con 0x7ff4080b1400 2023-07-21T22:13:41.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.721+0000 7ff3fe7fc700 1 -- 172.21.15.49:0/2129326250 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4000045d0 con 0x7ff4080b1400 2023-07-21T22:13:41.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.721+0000 7ff3fe7fc700 1 -- 172.21.15.49:0/2129326250 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff400004980 con 0x7ff4080b1400 2023-07-21T22:13:41.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.721+0000 7ff40efd2700 1 -- 172.21.15.49:0/2129326250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4081482b0 con 0x7ff4080b1400 2023-07-21T22:13:41.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.721+0000 7ff40efd2700 1 -- 172.21.15.49:0/2129326250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4080c8f00 con 0x7ff4080b1400 2023-07-21T22:13:41.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.721+0000 7ff40efd2700 1 -- 172.21.15.49:0/2129326250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff408148110 con 0x7ff4080b1400 2023-07-21T22:13:41.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.725+0000 7ff3fe7fc700 1 -- 172.21.15.49:0/2129326250 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff40001c410 con 0x7ff4080b1400 2023-07-21T22:13:41.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.725+0000 7ff3fe7fc700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff3ec0662f0 0x7ff3ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:41.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.725+0000 7ff3fe7fc700 1 -- 172.21.15.49:0/2129326250 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff400085890 con 0x7ff4080b1400 2023-07-21T22:13:41.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.725+0000 7ff40dfd0700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff3ec0662f0 0x7ff3ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:41.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.725+0000 7ff40dfd0700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff3ec0662f0 0x7ff3ec0687a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff404009ec0 tx=0x7ff404009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:41.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.733+0000 7ff3fe7fc700 1 -- 172.21.15.49:0/2129326250 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff408148110 con 0x7ff4080b1400 2023-07-21T22:13:41.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.905+0000 7ff40efd2700 1 -- 172.21.15.49:0/2129326250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff408148110 con 0x7ff4080b1400 2023-07-21T22:13:41.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.909+0000 7ff3fe7fc700 1 -- 172.21.15.49:0/2129326250 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+18475 (secure 0 0 0) 0x7ff408148110 con 0x7ff4080b1400 2023-07-21T22:13:41.954 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:41.955 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":61,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:13:40.537462+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:13:38.569931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:13:39.558524+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:13:41.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.913+0000 7ff40efd2700 1 -- 172.21.15.49:0/2129326250 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff3ec0662f0 msgr2=0x7ff3ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:41.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.913+0000 7ff40efd2700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff3ec0662f0 0x7ff3ec0687a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff404009ec0 tx=0x7ff404009240 comp rx=0 tx=0).stop 2023-07-21T22:13:41.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.913+0000 7ff40efd2700 1 -- 172.21.15.49:0/2129326250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080b1400 msgr2=0x7ff4080c6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:41.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.913+0000 7ff40efd2700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080b1400 0x7ff4080c6420 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff400003f70 tx=0x7ff400004af0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.913+0000 7ff40efd2700 1 -- 172.21.15.49:0/2129326250 shutdown_connections 2023-07-21T22:13:41.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.913+0000 7ff40efd2700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff3ec0662f0 0x7ff3ec0687a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.913+0000 7ff40efd2700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080b1400 0x7ff4080c6420 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.913+0000 7ff40efd2700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff408071c70 0x7ff4080c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.913+0000 7ff40efd2700 1 --2- 172.21.15.49:0/2129326250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff40806d380 0x7ff408144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:41.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.913+0000 7ff40efd2700 1 -- 172.21.15.49:0/2129326250 >> 172.21.15.49:0/2129326250 conn(0x7ff408070450 msgr2=0x7ff4080b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:41.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.913+0000 7ff40efd2700 1 -- 172.21.15.49:0/2129326250 shutdown_connections 2023-07-21T22:13:41.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:41.913+0000 7ff40efd2700 1 -- 172.21.15.49:0/2129326250 wait complete. 2023-07-21T22:13:41.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:13:42.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.117+0000 7effe5992700 1 Processor -- start 2023-07-21T22:13:42.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.117+0000 7effe5992700 1 -- start start 2023-07-21T22:13:42.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.121+0000 7effe5992700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7effe015bf20 0x7effe00ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:42.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.121+0000 7effe5992700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7effe00b19b0 0x7effe00b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:42.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.121+0000 7effe5992700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe01607a0 con 0x7effe00b4460 2023-07-21T22:13:42.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.121+0000 7effe5992700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe00ceda0 con 0x7effe00b19b0 2023-07-21T22:13:42.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.121+0000 7effe5992700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe00b48a0 con 0x7effe015bf20 2023-07-21T22:13:42.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.121+0000 7effde7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7effe00b19b0 0x7effe00b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:42.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.121+0000 7effde7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7effe00b19b0 0x7effe00b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47526/0 (socket says 172.21.15.49:47526) 2023-07-21T22:13:42.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.121+0000 7effde7fc700 1 -- 172.21.15.49:0/1384286973 learned_addr learned my addr 172.21.15.49:0/1384286973 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:42.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.121+0000 7effdeffd700 1 --2- 172.21.15.49:0/1384286973 >> v2:172.21.15.150:3300/0 conn(0x7effe015bf20 0x7effe00ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:42.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.121+0000 7effde7fc700 1 -- 172.21.15.49:0/1384286973 >> v2:172.21.15.150:3300/0 conn(0x7effe015bf20 msgr2=0x7effe00ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:42.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.121+0000 7effde7fc700 1 --2- 172.21.15.49:0/1384286973 >> v2:172.21.15.150:3300/0 conn(0x7effe015bf20 0x7effe00ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:42.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.121+0000 7effde7fc700 1 -- 172.21.15.49:0/1384286973 >> v1:172.21.15.49:6789/0 conn(0x7effe00b4460 legacy=0x7effe006e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:42.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.121+0000 7effde7fc700 1 -- 172.21.15.49:0/1384286973 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe015f8b0 con 0x7effe00b19b0 2023-07-21T22:13:42.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.121+0000 7effde7fc700 1 --2- 172.21.15.49:0/1384286973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe00b19b0 0x7effe00b3f20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7effe00732d0 tx=0x7effd4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d31d22eaef590a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:42.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.125+0000 7effddffb700 1 -- 172.21.15.49:0/1384286973 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4011830 con 0x7effe00b19b0 2023-07-21T22:13:42.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.125+0000 7effddffb700 1 -- 172.21.15.49:0/1384286973 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd4011990 con 0x7effe00b19b0 2023-07-21T22:13:42.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.125+0000 7effddffb700 1 -- 172.21.15.49:0/1384286973 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4011d20 con 0x7effe00b19b0 2023-07-21T22:13:42.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.125+0000 7effe5992700 1 -- 172.21.15.49:0/1384286973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe00b19b0 msgr2=0x7effe00b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:42.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.125+0000 7effe5992700 1 --2- 172.21.15.49:0/1384286973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe00b19b0 0x7effe00b3f20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7effe00732d0 tx=0x7effd4009bf0 comp rx=0 tx=0).stop 2023-07-21T22:13:42.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.125+0000 7effe5992700 1 -- 172.21.15.49:0/1384286973 shutdown_connections 2023-07-21T22:13:42.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.125+0000 7effe5992700 1 --2- 172.21.15.49:0/1384286973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe00b19b0 0x7effe00b3f20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:42.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.125+0000 7effe5992700 1 --2- 172.21.15.49:0/1384286973 >> v2:172.21.15.150:3300/0 conn(0x7effe015bf20 0x7effe00ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:42.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.125+0000 7effe5992700 1 -- 172.21.15.49:0/1384286973 >> 172.21.15.49:0/1384286973 conn(0x7effe00cef20 msgr2=0x7effe00cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:42.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.125+0000 7effe5992700 1 -- 172.21.15.49:0/1384286973 shutdown_connections 2023-07-21T22:13:42.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.125+0000 7effe5992700 1 -- 172.21.15.49:0/1384286973 wait complete. 2023-07-21T22:13:42.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.125+0000 7effe5992700 1 Processor -- start 2023-07-21T22:13:42.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effe5992700 1 -- start start 2023-07-21T22:13:42.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effe5992700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effe00b19b0 0x7effe00b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:42.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effe5992700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effe00b4460 0x7effe01564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:42.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effe5992700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe015bf20 0x7effe0155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:42.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effe5992700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe00b5b20 con 0x7effe015bf20 2023-07-21T22:13:42.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effe5992700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe00b5e00 con 0x7effe00b19b0 2023-07-21T22:13:42.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effe5992700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe00b60e0 con 0x7effe00b4460 2023-07-21T22:13:42.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effdf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe015bf20 0x7effe0155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:42.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effdf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe015bf20 0x7effe0155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47536/0 (socket says 172.21.15.49:47536) 2023-07-21T22:13:42.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effdf7fe700 1 -- 172.21.15.49:0/3673099692 learned_addr learned my addr 172.21.15.49:0/3673099692 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:42.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effde7fc700 1 --2- 172.21.15.49:0/3673099692 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effe00b4460 0x7effe01564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:42.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effdeffd700 1 --2- 172.21.15.49:0/3673099692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effe00b19b0 0x7effe00b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:42.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effdf7fe700 1 -- 172.21.15.49:0/3673099692 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effe00b4460 msgr2=0x7effe01564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:42.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effdf7fe700 1 --2- 172.21.15.49:0/3673099692 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effe00b4460 0x7effe01564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:42.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effdf7fe700 1 -- 172.21.15.49:0/3673099692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effe00b19b0 msgr2=0x7effe00b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:42.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effdf7fe700 1 --2- 172.21.15.49:0/3673099692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effe00b19b0 0x7effe00b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:42.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effdf7fe700 1 -- 172.21.15.49:0/3673099692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd4009570 con 0x7effe015bf20 2023-07-21T22:13:42.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effdf7fe700 1 --2- 172.21.15.49:0/3673099692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe015bf20 0x7effe0155520 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7effd800cc50 tx=0x7effd800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:42.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effc7fff700 1 -- 172.21.15.49:0/3673099692 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd8003c20 con 0x7effe015bf20 2023-07-21T22:13:42.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effc7fff700 1 -- 172.21.15.49:0/3673099692 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd8003d80 con 0x7effe015bf20 2023-07-21T22:13:42.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effe5992700 1 -- 172.21.15.49:0/3673099692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe00b63c0 con 0x7effe015bf20 2023-07-21T22:13:42.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.129+0000 7effc7fff700 1 -- 172.21.15.49:0/3673099692 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd800aab0 con 0x7effe015bf20 2023-07-21T22:13:42.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.133+0000 7effe5992700 1 -- 172.21.15.49:0/3673099692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe00b5810 con 0x7effe015bf20 2023-07-21T22:13:42.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.133+0000 7effe5992700 1 -- 172.21.15.49:0/3673099692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe004dcb0 con 0x7effe015bf20 2023-07-21T22:13:42.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.133+0000 7effc7fff700 1 -- 172.21.15.49:0/3673099692 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7effd800ac10 con 0x7effe015bf20 2023-07-21T22:13:42.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.137+0000 7effc7fff700 1 --2- 172.21.15.49:0/3673099692 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7effcc0662f0 0x7effcc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:42.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.137+0000 7effc7fff700 1 -- 172.21.15.49:0/3673099692 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7effd8083e40 con 0x7effe015bf20 2023-07-21T22:13:42.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.137+0000 7effdeffd700 1 --2- 172.21.15.49:0/3673099692 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7effcc0662f0 0x7effcc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:42.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.137+0000 7effdeffd700 1 --2- 172.21.15.49:0/3673099692 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7effcc0662f0 0x7effcc0687a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7effe00b3ae0 tx=0x7effd0009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:42.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.141+0000 7effc7fff700 1 -- 172.21.15.49:0/3673099692 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7effd8051170 con 0x7effe015bf20 2023-07-21T22:13:42.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:42.353+0000 7effe5992700 1 -- 172.21.15.49:0/3673099692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7effe00b0e50 con 0x7effe015bf20 2023-07-21T22:13:43.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.113+0000 7effc7fff700 1 -- 172.21.15.49:0/3673099692 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7effd8054790 con 0x7effe015bf20 2023-07-21T22:13:43.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.117+0000 7effe5992700 1 -- 172.21.15.49:0/3673099692 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7effcc0662f0 msgr2=0x7effcc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:43.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.117+0000 7effe5992700 1 --2- 172.21.15.49:0/3673099692 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7effcc0662f0 0x7effcc0687a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7effe00b3ae0 tx=0x7effd0009240 comp rx=0 tx=0).stop 2023-07-21T22:13:43.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.117+0000 7effe5992700 1 -- 172.21.15.49:0/3673099692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe015bf20 msgr2=0x7effe0155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:43.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.117+0000 7effe5992700 1 --2- 172.21.15.49:0/3673099692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe015bf20 0x7effe0155520 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7effd800cc50 tx=0x7effd800cf60 comp rx=0 tx=0).stop 2023-07-21T22:13:43.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.117+0000 7effe5992700 1 -- 172.21.15.49:0/3673099692 shutdown_connections 2023-07-21T22:13:43.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.117+0000 7effe5992700 1 --2- 172.21.15.49:0/3673099692 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7effcc0662f0 0x7effcc0687a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:43.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.117+0000 7effe5992700 1 --2- 172.21.15.49:0/3673099692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effe015bf20 0x7effe0155520 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:43.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.117+0000 7effe5992700 1 --2- 172.21.15.49:0/3673099692 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effe00b4460 0x7effe01564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:43.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.117+0000 7effe5992700 1 --2- 172.21.15.49:0/3673099692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effe00b19b0 0x7effe00b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:43.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.117+0000 7effe5992700 1 -- 172.21.15.49:0/3673099692 >> 172.21.15.49:0/3673099692 conn(0x7effe00cef20 msgr2=0x7effe015e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:43.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.117+0000 7effe5992700 1 -- 172.21.15.49:0/3673099692 shutdown_connections 2023-07-21T22:13:43.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.117+0000 7effe5992700 1 -- 172.21.15.49:0/3673099692 wait complete. 2023-07-21T22:13:43.186 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T22:13:43.187 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T22:13:43.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.337+0000 7fa42eb45700 1 Processor -- start 2023-07-21T22:13:43.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.337+0000 7fa42eb45700 1 -- start start 2023-07-21T22:13:43.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.341+0000 7fa42eb45700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa4280698a0 0x7fa428069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:43.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.341+0000 7fa42eb45700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4280aba80 0x7fa4280abf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:43.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.341+0000 7fa42eb45700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42806a230 con 0x7fa4280c9b80 2023-07-21T22:13:43.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.341+0000 7fa42eb45700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa428160710 con 0x7fa4280698a0 2023-07-21T22:13:43.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.341+0000 7fa42eb45700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42815f880 con 0x7fa4280aba80 2023-07-21T22:13:43.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.341+0000 7fa42d342700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa4280698a0 0x7fa428069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:43.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.341+0000 7fa42d342700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa4280698a0 0x7fa428069cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47550/0 (socket says 172.21.15.49:47550) 2023-07-21T22:13:43.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.341+0000 7fa42d342700 1 -- 172.21.15.49:0/2159132566 learned_addr learned my addr 172.21.15.49:0/2159132566 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:43.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.341+0000 7fa42e344700 1 --2- 172.21.15.49:0/2159132566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4280aba80 0x7fa4280abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:43.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42d342700 1 -- 172.21.15.49:0/2159132566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4280aba80 msgr2=0x7fa4280abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:43.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42d342700 1 --2- 172.21.15.49:0/2159132566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4280aba80 0x7fa4280abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:43.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42d342700 1 -- 172.21.15.49:0/2159132566 >> v1:172.21.15.150:6789/0 conn(0x7fa4280c9b80 legacy=0x7fa4280ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:43.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42d342700 1 -- 172.21.15.49:0/2159132566 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42815fa90 con 0x7fa4280698a0 2023-07-21T22:13:43.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42d342700 1 --2- 172.21.15.49:0/2159132566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280698a0 0x7fa428069cf0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa418009910 tx=0x7fa418009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1e08d7fd37d741 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:43.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42cb41700 1 -- 172.21.15.49:0/2159132566 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41800ba60 con 0x7fa4280698a0 2023-07-21T22:13:43.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42cb41700 1 -- 172.21.15.49:0/2159132566 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41800bbc0 con 0x7fa4280698a0 2023-07-21T22:13:43.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42cb41700 1 -- 172.21.15.49:0/2159132566 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418009e60 con 0x7fa4280698a0 2023-07-21T22:13:43.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42eb45700 1 -- 172.21.15.49:0/2159132566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280698a0 msgr2=0x7fa428069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:43.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42eb45700 1 --2- 172.21.15.49:0/2159132566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280698a0 0x7fa428069cf0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa418009910 tx=0x7fa418009c20 comp rx=0 tx=0).stop 2023-07-21T22:13:43.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42eb45700 1 -- 172.21.15.49:0/2159132566 shutdown_connections 2023-07-21T22:13:43.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42eb45700 1 --2- 172.21.15.49:0/2159132566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4280aba80 0x7fa4280abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:43.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42eb45700 1 --2- 172.21.15.49:0/2159132566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280698a0 0x7fa428069cf0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:43.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42eb45700 1 -- 172.21.15.49:0/2159132566 >> 172.21.15.49:0/2159132566 conn(0x7fa4280ce0d0 msgr2=0x7fa4280ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:43.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42eb45700 1 -- 172.21.15.49:0/2159132566 shutdown_connections 2023-07-21T22:13:43.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.345+0000 7fa42eb45700 1 -- 172.21.15.49:0/2159132566 wait complete. 2023-07-21T22:13:43.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.349+0000 7fa42eb45700 1 Processor -- start 2023-07-21T22:13:43.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.349+0000 7fa42eb45700 1 -- start start 2023-07-21T22:13:43.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42eb45700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4280698a0 0x7fa428156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42eb45700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280aba80 0x7fa4280aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42eb45700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4280c9b80 0x7fa4280ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42eb45700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4281f22b0 con 0x7fa4280aba80 2023-07-21T22:13:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42eb45700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4281f1420 con 0x7fa4280698a0 2023-07-21T22:13:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42eb45700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4281f1630 con 0x7fa4280c9b80 2023-07-21T22:13:43.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42d342700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280aba80 0x7fa4280aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:43.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42d342700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280aba80 0x7fa4280aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47556/0 (socket says 172.21.15.49:47556) 2023-07-21T22:13:43.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42d342700 1 -- 172.21.15.49:0/1847134468 learned_addr learned my addr 172.21.15.49:0/1847134468 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:43.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42e344700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4280c9b80 0x7fa4280ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:43.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42db43700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4280698a0 0x7fa428156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:43.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42d342700 1 -- 172.21.15.49:0/1847134468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4280c9b80 msgr2=0x7fa4280ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:43.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42d342700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4280c9b80 0x7fa4280ad3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:43.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42d342700 1 -- 172.21.15.49:0/1847134468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4280698a0 msgr2=0x7fa428156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:43.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42d342700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4280698a0 0x7fa428156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:43.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42d342700 1 -- 172.21.15.49:0/1847134468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa418009570 con 0x7fa4280aba80 2023-07-21T22:13:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42e344700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4280c9b80 0x7fa4280ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42d342700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280aba80 0x7fa4280aceb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa418014040 tx=0x7fa418004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa41e7fc700 1 -- 172.21.15.49:0/1847134468 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418004610 con 0x7fa4280aba80 2023-07-21T22:13:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa41e7fc700 1 -- 172.21.15.49:0/1847134468 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41801e070 con 0x7fa4280aba80 2023-07-21T22:13:43.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa41e7fc700 1 -- 172.21.15.49:0/1847134468 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180038e0 con 0x7fa4280aba80 2023-07-21T22:13:43.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42eb45700 1 -- 172.21.15.49:0/1847134468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4281f1910 con 0x7fa4280aba80 2023-07-21T22:13:43.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.353+0000 7fa42eb45700 1 -- 172.21.15.49:0/1847134468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4281f1ed0 con 0x7fa4280aba80 2023-07-21T22:13:43.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.357+0000 7fa42eb45700 1 -- 172.21.15.49:0/1847134468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4281f23f0 con 0x7fa4280aba80 2023-07-21T22:13:43.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.357+0000 7fa41e7fc700 1 -- 172.21.15.49:0/1847134468 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa418003a40 con 0x7fa4280aba80 2023-07-21T22:13:43.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.357+0000 7fa41e7fc700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa40c0662f0 0x7fa40c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.357+0000 7fa41e7fc700 1 -- 172.21.15.49:0/1847134468 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa418020070 con 0x7fa4280aba80 2023-07-21T22:13:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.361+0000 7fa42db43700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa40c0662f0 0x7fa40c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.361+0000 7fa42db43700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa40c0662f0 0x7fa40c0687a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa424000f60 tx=0x7fa424009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:43.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.365+0000 7fa41e7fc700 1 -- 172.21.15.49:0/1847134468 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa4281f23f0 con 0x7fa4280aba80 2023-07-21T22:13:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:43.581+0000 7fa42eb45700 1 -- 172.21.15.49:0/1847134468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa4281f23f0 con 0x7fa4280aba80 2023-07-21T22:13:44.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.125+0000 7fa41e7fc700 1 -- 172.21.15.49:0/1847134468 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa4281f23f0 con 0x7fa4280aba80 2023-07-21T22:13:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.129+0000 7fa42eb45700 1 -- 172.21.15.49:0/1847134468 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa40c0662f0 msgr2=0x7fa40c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.129+0000 7fa42eb45700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa40c0662f0 0x7fa40c0687a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa424000f60 tx=0x7fa424009040 comp rx=0 tx=0).stop 2023-07-21T22:13:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.129+0000 7fa42eb45700 1 -- 172.21.15.49:0/1847134468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280aba80 msgr2=0x7fa4280aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.129+0000 7fa42eb45700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280aba80 0x7fa4280aceb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa418014040 tx=0x7fa418004770 comp rx=0 tx=0).stop 2023-07-21T22:13:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.129+0000 7fa42eb45700 1 -- 172.21.15.49:0/1847134468 shutdown_connections 2023-07-21T22:13:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.129+0000 7fa42eb45700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa40c0662f0 0x7fa40c0687a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.129+0000 7fa42eb45700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280aba80 0x7fa4280aceb0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.129+0000 7fa42eb45700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4280c9b80 0x7fa4280ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.129+0000 7fa42eb45700 1 --2- 172.21.15.49:0/1847134468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4280698a0 0x7fa428156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.129+0000 7fa42eb45700 1 -- 172.21.15.49:0/1847134468 >> 172.21.15.49:0/1847134468 conn(0x7fa4280ce0d0 msgr2=0x7fa4280722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.129+0000 7fa42eb45700 1 -- 172.21.15.49:0/1847134468 shutdown_connections 2023-07-21T22:13:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.133+0000 7fa42eb45700 1 -- 172.21.15.49:0/1847134468 wait complete. 2023-07-21T22:13:44.199 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T22:13:44.200 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:13:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.337+0000 7fcff60bb700 1 Processor -- start 2023-07-21T22:13:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.337+0000 7fcff60bb700 1 -- start start 2023-07-21T22:13:44.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff60bb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcff0160370 0x7fcff006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:44.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff60bb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcff00c1470 0x7fcff00c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:44.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff60bb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff006e010 con 0x7fcff00ca2c0 2023-07-21T22:13:44.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff60bb700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff0160740 con 0x7fcff0160370 2023-07-21T22:13:44.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff60bb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff00ccc50 con 0x7fcff00c1470 2023-07-21T22:13:44.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff50b9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcff0160370 0x7fcff006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:44.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff48b8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcff00c1470 0x7fcff00c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:44.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff50b9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcff0160370 0x7fcff006d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47572/0 (socket says 172.21.15.49:47572) 2023-07-21T22:13:44.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff50b9700 1 -- 172.21.15.49:0/2866265035 learned_addr learned my addr 172.21.15.49:0/2866265035 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:44.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcfe7fff700 1 -- 172.21.15.49:0/2866265035 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835919185 0 0) 0x7fcff006e010 con 0x7fcff00ca2c0 2023-07-21T22:13:44.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff48b8700 1 -- 172.21.15.49:0/2866265035 >> v2:172.21.15.49:3300/0 conn(0x7fcff0160370 msgr2=0x7fcff006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:44.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff48b8700 1 --2- 172.21.15.49:0/2866265035 >> v2:172.21.15.49:3300/0 conn(0x7fcff0160370 0x7fcff006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff48b8700 1 -- 172.21.15.49:0/2866265035 >> v1:172.21.15.150:6789/0 conn(0x7fcff00ca2c0 legacy=0x7fcff00caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:44.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff48b8700 1 -- 172.21.15.49:0/2866265035 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff00afc90 con 0x7fcff00c1470 2023-07-21T22:13:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff50b9700 1 --2- 172.21.15.49:0/2866265035 >> v2:172.21.15.49:3300/0 conn(0x7fcff0160370 0x7fcff006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcff48b8700 1 --2- 172.21.15.49:0/2866265035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff00c1470 0x7fcff00c9d80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcff00c9a80 tx=0x7fcfe0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bd746c4b572a8c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcfe7fff700 1 -- 172.21.15.49:0/2866265035 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0011830 con 0x7fcff00c1470 2023-07-21T22:13:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcfe7fff700 1 -- 172.21.15.49:0/2866265035 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe0011990 con 0x7fcff00c1470 2023-07-21T22:13:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.341+0000 7fcfe7fff700 1 -- 172.21.15.49:0/2866265035 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0011d20 con 0x7fcff00c1470 2023-07-21T22:13:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.345+0000 7fcff60bb700 1 -- 172.21.15.49:0/2866265035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff00c1470 msgr2=0x7fcff00c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.345+0000 7fcff60bb700 1 --2- 172.21.15.49:0/2866265035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff00c1470 0x7fcff00c9d80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcff00c9a80 tx=0x7fcfe0009b30 comp rx=0 tx=0).stop 2023-07-21T22:13:44.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.345+0000 7fcff60bb700 1 -- 172.21.15.49:0/2866265035 shutdown_connections 2023-07-21T22:13:44.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.345+0000 7fcff60bb700 1 --2- 172.21.15.49:0/2866265035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff00c1470 0x7fcff00c9d80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.345+0000 7fcff60bb700 1 --2- 172.21.15.49:0/2866265035 >> v2:172.21.15.49:3300/0 conn(0x7fcff0160370 0x7fcff006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.345+0000 7fcff60bb700 1 -- 172.21.15.49:0/2866265035 >> 172.21.15.49:0/2866265035 conn(0x7fcff0070450 msgr2=0x7fcff0070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.345+0000 7fcff60bb700 1 -- 172.21.15.49:0/2866265035 shutdown_connections 2023-07-21T22:13:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.345+0000 7fcff60bb700 1 -- 172.21.15.49:0/2866265035 wait complete. 2023-07-21T22:13:44.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.349+0000 7fcff60bb700 1 Processor -- start 2023-07-21T22:13:44.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.349+0000 7fcff60bb700 1 -- start start 2023-07-21T22:13:44.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.349+0000 7fcff60bb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff00c1470 0x7fcff015e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:44.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.349+0000 7fcff60bb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcff00ca2c0 0x7fcff00c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:44.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.349+0000 7fcff60bb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcff0160370 0x7fcff00c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:44.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.349+0000 7fcff60bb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff015ebe0 con 0x7fcff00ca2c0 2023-07-21T22:13:44.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.349+0000 7fcff60bb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff00c25e0 con 0x7fcff00c1470 2023-07-21T22:13:44.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.349+0000 7fcff60bb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff00c28c0 con 0x7fcff0160370 2023-07-21T22:13:44.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.349+0000 7fcff48b8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcff00ca2c0 0x7fcff00c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:44.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.349+0000 7fcff48b8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcff00ca2c0 0x7fcff00c1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47574/0 (socket says 172.21.15.49:47574) 2023-07-21T22:13:44.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.349+0000 7fcff48b8700 1 -- 172.21.15.49:0/2052725173 learned_addr learned my addr 172.21.15.49:0/2052725173 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:44.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcff58ba700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcff0160370 0x7fcff00c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:44.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcff50b9700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff00c1470 0x7fcff015e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:44.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcff48b8700 1 -- 172.21.15.49:0/2052725173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcff0160370 msgr2=0x7fcff00c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:44.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcff48b8700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcff0160370 0x7fcff00c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcff48b8700 1 -- 172.21.15.49:0/2052725173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff00c1470 msgr2=0x7fcff015e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:44.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcff48b8700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff00c1470 0x7fcff015e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcff48b8700 1 -- 172.21.15.49:0/2052725173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec009570 con 0x7fcff00ca2c0 2023-07-21T22:13:44.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcff58ba700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcff0160370 0x7fcff00c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:44.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcff50b9700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff00c1470 0x7fcff015e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:44.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcff48b8700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcff00ca2c0 0x7fcff00c1c00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009fd0 tx=0x7fcfe0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:44.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcfe5ffb700 1 -- 172.21.15.49:0/2052725173 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00045b0 con 0x7fcff00ca2c0 2023-07-21T22:13:44.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcfe5ffb700 1 -- 172.21.15.49:0/2052725173 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe001f070 con 0x7fcff00ca2c0 2023-07-21T22:13:44.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcfe5ffb700 1 -- 172.21.15.49:0/2052725173 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00038e0 con 0x7fcff00ca2c0 2023-07-21T22:13:44.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcff60bb700 1 -- 172.21.15.49:0/2052725173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe00094b0 con 0x7fcff00ca2c0 2023-07-21T22:13:44.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcff60bb700 1 -- 172.21.15.49:0/2052725173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff00b2000 con 0x7fcff00ca2c0 2023-07-21T22:13:44.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.353+0000 7fcff60bb700 1 -- 172.21.15.49:0/2052725173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff004dcb0 con 0x7fcff00ca2c0 2023-07-21T22:13:44.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.357+0000 7fcfe5ffb700 1 -- 172.21.15.49:0/2052725173 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcfe0021030 con 0x7fcff00ca2c0 2023-07-21T22:13:44.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.357+0000 7fcfe5ffb700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcfd40662f0 0x7fcfd40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:44.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.357+0000 7fcfe5ffb700 1 -- 172.21.15.49:0/2052725173 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcfe0085400 con 0x7fcff00ca2c0 2023-07-21T22:13:44.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.357+0000 7fcff50b9700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcfd40662f0 0x7fcfd40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:44.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.361+0000 7fcff50b9700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcfd40662f0 0x7fcfd40687a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcff00c8140 tx=0x7fcfec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:44.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.365+0000 7fcfe5ffb700 1 -- 172.21.15.49:0/2052725173 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcfe0052850 con 0x7fcff00ca2c0 2023-07-21T22:13:44.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.573+0000 7fcff60bb700 1 -- 172.21.15.49:0/2052725173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcff00c8170 con 0x7fcff00ca2c0 2023-07-21T22:13:44.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.573+0000 7fcfe5ffb700 1 -- 172.21.15.49:0/2052725173 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4678 (secure 0 0 0) 0x7fcfe0055e70 con 0x7fcff00ca2c0 2023-07-21T22:13:44.619 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:44.620 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3145882220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3145882220},{"type":"v1","addr":"172.21.15.150:6834","nonce":3145882220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5657,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2809854510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2809854510},{"type":"v1","addr":"172.21.15.150:6835","nonce":2809854510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1044407594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1044407594},{"type":"v1","addr":"172.21.15.49:6837","nonce":1044407594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:13:40.538282+0000","modified":"2023-07-21T22:13:44.115111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6396":{"gid":6396,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6836/4142505890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4142505890},{"type":"v1","addr":"172.21.15.49:6836","nonce":4142505890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T22:13:44.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.577+0000 7fcff60bb700 1 -- 172.21.15.49:0/2052725173 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcfd40662f0 msgr2=0x7fcfd40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:44.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.577+0000 7fcff60bb700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcfd40662f0 0x7fcfd40687a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcff00c8140 tx=0x7fcfec008040 comp rx=0 tx=0).stop 2023-07-21T22:13:44.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.577+0000 7fcff60bb700 1 -- 172.21.15.49:0/2052725173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcff00ca2c0 msgr2=0x7fcff00c1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:44.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.577+0000 7fcff60bb700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcff00ca2c0 0x7fcff00c1c00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009fd0 tx=0x7fcfe0004770 comp rx=0 tx=0).stop 2023-07-21T22:13:44.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.577+0000 7fcff60bb700 1 -- 172.21.15.49:0/2052725173 shutdown_connections 2023-07-21T22:13:44.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.577+0000 7fcff60bb700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcfd40662f0 0x7fcfd40687a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.577+0000 7fcff60bb700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcff00ca2c0 0x7fcff00c1c00 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.577+0000 7fcff60bb700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcff0160370 0x7fcff00c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.577+0000 7fcff60bb700 1 --2- 172.21.15.49:0/2052725173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff00c1470 0x7fcff015e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.577+0000 7fcff60bb700 1 -- 172.21.15.49:0/2052725173 >> 172.21.15.49:0/2052725173 conn(0x7fcff0070450 msgr2=0x7fcff0162890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:44.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.577+0000 7fcff60bb700 1 -- 172.21.15.49:0/2052725173 shutdown_connections 2023-07-21T22:13:44.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.577+0000 7fcff60bb700 1 -- 172.21.15.49:0/2052725173 wait complete. 2023-07-21T22:13:44.625 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2023-07-21T22:13:44.643 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:13:44.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.777+0000 7f0e76a3e700 1 Processor -- start 2023-07-21T22:13:44.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.777+0000 7f0e76a3e700 1 -- start start 2023-07-21T22:13:44.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.777+0000 7f0e76a3e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7006d5d0 0x7f0e7006d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:44.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.777+0000 7f0e76a3e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7006dee0 con 0x7f0e7015d780 2023-07-21T22:13:44.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.777+0000 7f0e76a3e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e700b0330 con 0x7f0e70159f60 2023-07-21T22:13:44.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.777+0000 7f0e76a3e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700b0600 con 0x7f0e7006d5d0 2023-07-21T22:13:44.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.777+0000 7f0e74fdb700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0e7015d780 0x7f0e7015dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33750/0 (socket says 172.21.15.49:33750) 2023-07-21T22:13:44.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.777+0000 7f0e74fdb700 1 -- 172.21.15.49:0/2623346045 learned_addr learned my addr 172.21.15.49:0/2623346045 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:44.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.777+0000 7f0e6ffff700 1 --2- 172.21.15.49:0/2623346045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7006d5d0 0x7f0e7006d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e6effd700 1 -- 172.21.15.49:0/2623346045 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898004409 0 0) 0x7f0e7006dee0 con 0x7f0e7015d780 2023-07-21T22:13:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e6ffff700 1 -- 172.21.15.49:0/2623346045 >> v1:172.21.15.150:6789/0 conn(0x7f0e70159f60 legacy=0x7f0e700afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e6ffff700 1 -- 172.21.15.49:0/2623346045 >> v1:172.21.15.49:6789/0 conn(0x7f0e7015d780 legacy=0x7f0e7015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e6ffff700 1 -- 172.21.15.49:0/2623346045 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7015a470 con 0x7f0e7006d5d0 2023-07-21T22:13:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e6ffff700 1 --2- 172.21.15.49:0/2623346045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7006d5d0 0x7f0e7006d9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009dc0 tx=0x7f0e6000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6993c8b4246dd492 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:44.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e6effd700 1 -- 172.21.15.49:0/2623346045 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000e070 con 0x7f0e7006d5d0 2023-07-21T22:13:44.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e6effd700 1 -- 172.21.15.49:0/2623346045 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6000bbd0 con 0x7f0e7006d5d0 2023-07-21T22:13:44.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e6effd700 1 -- 172.21.15.49:0/2623346045 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60012430 con 0x7f0e7006d5d0 2023-07-21T22:13:44.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2623346045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7006d5d0 msgr2=0x7f0e7006d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e76a3e700 1 --2- 172.21.15.49:0/2623346045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7006d5d0 0x7f0e7006d9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009dc0 tx=0x7f0e6000b330 comp rx=0 tx=0).stop 2023-07-21T22:13:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2623346045 shutdown_connections 2023-07-21T22:13:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e76a3e700 1 --2- 172.21.15.49:0/2623346045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7006d5d0 0x7f0e7006d9a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2623346045 >> 172.21.15.49:0/2623346045 conn(0x7f0e7006f5a0 msgr2=0x7f0e700cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2623346045 shutdown_connections 2023-07-21T22:13:44.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.781+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2623346045 wait complete. 2023-07-21T22:13:44.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.785+0000 7f0e76a3e700 1 Processor -- start 2023-07-21T22:13:44.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.785+0000 7f0e76a3e700 1 -- start start 2023-07-21T22:13:44.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.785+0000 7f0e76a3e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7006d5d0 0x7f0e700b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:44.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.785+0000 7f0e76a3e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e70159f60 0x7f0e700b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:44.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.785+0000 7f0e76a3e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7015d780 0x7f0e701e5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:44.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.785+0000 7f0e76a3e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700b1b40 con 0x7f0e7006d5d0 2023-07-21T22:13:44.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.785+0000 7f0e76a3e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700b1e20 con 0x7f0e70159f60 2023-07-21T22:13:44.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.785+0000 7f0e76a3e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700b2100 con 0x7f0e7015d780 2023-07-21T22:13:44.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.785+0000 7f0e6ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7006d5d0 0x7f0e700b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:44.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.785+0000 7f0e6ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7006d5d0 0x7f0e700b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54514/0 (socket says 172.21.15.49:54514) 2023-07-21T22:13:44.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.785+0000 7f0e6ffff700 1 -- 172.21.15.49:0/2092050097 learned_addr learned my addr 172.21.15.49:0/2092050097 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:44.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.785+0000 7f0e74fdb700 1 --2- 172.21.15.49:0/2092050097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7015d780 0x7f0e701e5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:44.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.785+0000 7f0e6f7fe700 1 --2- 172.21.15.49:0/2092050097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e70159f60 0x7f0e700b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:44.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.789+0000 7f0e6ffff700 1 -- 172.21.15.49:0/2092050097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7015d780 msgr2=0x7f0e701e5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:44.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.789+0000 7f0e6ffff700 1 --2- 172.21.15.49:0/2092050097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7015d780 0x7f0e701e5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.789+0000 7f0e6ffff700 1 -- 172.21.15.49:0/2092050097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e70159f60 msgr2=0x7f0e700b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:44.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.789+0000 7f0e6ffff700 1 --2- 172.21.15.49:0/2092050097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e70159f60 0x7f0e700b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:44.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.789+0000 7f0e6ffff700 1 -- 172.21.15.49:0/2092050097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60009a70 con 0x7f0e7006d5d0 2023-07-21T22:13:44.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.789+0000 7f0e6ffff700 1 --2- 172.21.15.49:0/2092050097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7006d5d0 0x7f0e700b0fd0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0e60000f80 tx=0x7f0e60004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:44.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.789+0000 7f0e6cff9700 1 -- 172.21.15.49:0/2092050097 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6001b810 con 0x7f0e7006d5d0 2023-07-21T22:13:44.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.789+0000 7f0e6cff9700 1 -- 172.21.15.49:0/2092050097 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e60020070 con 0x7f0e7006d5d0 2023-07-21T22:13:44.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.789+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2092050097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e701f1b60 con 0x7f0e7006d5d0 2023-07-21T22:13:44.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.789+0000 7f0e6cff9700 1 -- 172.21.15.49:0/2092050097 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6001bbb0 con 0x7f0e7006d5d0 2023-07-21T22:13:44.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.789+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2092050097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e700c73a0 con 0x7f0e7006d5d0 2023-07-21T22:13:44.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.789+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2092050097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e70073130 con 0x7f0e7006d5d0 2023-07-21T22:13:44.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.793+0000 7f0e6cff9700 1 -- 172.21.15.49:0/2092050097 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e6001bd10 con 0x7f0e7006d5d0 2023-07-21T22:13:44.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.793+0000 7f0e6cff9700 1 --2- 172.21.15.49:0/2092050097 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0e5c0662f0 0x7f0e5c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:44.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.793+0000 7f0e6cff9700 1 -- 172.21.15.49:0/2092050097 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0e60022070 con 0x7f0e7006d5d0 2023-07-21T22:13:44.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.793+0000 7f0e6f7fe700 1 --2- 172.21.15.49:0/2092050097 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0e5c0662f0 0x7f0e5c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:44.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.793+0000 7f0e6f7fe700 1 --2- 172.21.15.49:0/2092050097 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0e5c0662f0 0x7f0e5c0687a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0e701e6ce0 tx=0x7f0e64009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.801+0000 7f0e6cff9700 1 -- 172.21.15.49:0/2092050097 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0e600539e0 con 0x7f0e7006d5d0 2023-07-21T22:13:45.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.977+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2092050097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e700cb980 con 0x7f0e7006d5d0 2023-07-21T22:13:45.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.977+0000 7f0e6cff9700 1 -- 172.21.15.49:0/2092050097 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+18462 (secure 0 0 0) 0x7f0e60057000 con 0x7f0e7006d5d0 2023-07-21T22:13:45.024 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:45.024 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":62,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:13:42.072628+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:13:38.569931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:13:39.558524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:13:45.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.985+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2092050097 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0e5c0662f0 msgr2=0x7f0e5c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:45.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.985+0000 7f0e76a3e700 1 --2- 172.21.15.49:0/2092050097 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0e5c0662f0 0x7f0e5c0687a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0e701e6ce0 tx=0x7f0e64009040 comp rx=0 tx=0).stop 2023-07-21T22:13:45.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.985+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2092050097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7006d5d0 msgr2=0x7f0e700b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.985+0000 7f0e76a3e700 1 --2- 172.21.15.49:0/2092050097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7006d5d0 0x7f0e700b0fd0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0e60000f80 tx=0x7f0e60004af0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.985+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2092050097 shutdown_connections 2023-07-21T22:13:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.985+0000 7f0e76a3e700 1 --2- 172.21.15.49:0/2092050097 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0e5c0662f0 0x7f0e5c0687a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.985+0000 7f0e76a3e700 1 --2- 172.21.15.49:0/2092050097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7015d780 0x7f0e701e5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.985+0000 7f0e76a3e700 1 --2- 172.21.15.49:0/2092050097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e70159f60 0x7f0e700b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.985+0000 7f0e76a3e700 1 --2- 172.21.15.49:0/2092050097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7006d5d0 0x7f0e700b0fd0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.985+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2092050097 >> 172.21.15.49:0/2092050097 conn(0x7f0e7006f5a0 msgr2=0x7f0e700c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:45.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.985+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2092050097 shutdown_connections 2023-07-21T22:13:45.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:44.985+0000 7f0e76a3e700 1 -- 172.21.15.49:0/2092050097 wait complete. 2023-07-21T22:13:45.050 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:13:45.050 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:13:45.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cca79e700 1 Processor -- start 2023-07-21T22:13:45.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cca79e700 1 -- start start 2023-07-21T22:13:45.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cca79e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3cc415d180 0x7f3cc406c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:45.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cca79e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cc40c90d0 0x7f3cc40c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:45.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cca79e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc40c9a70 con 0x7f3cc4158c00 2023-07-21T22:13:45.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cca79e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc406d650 con 0x7f3cc415d180 2023-07-21T22:13:45.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cca79e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc4158fd0 con 0x7f3cc40c90d0 2023-07-21T22:13:45.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cc979c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3cc4158c00 0x7f3cc406da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33766/0 (socket says 172.21.15.49:33766) 2023-07-21T22:13:45.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cc979c700 1 -- 172.21.15.49:0/1611856765 learned_addr learned my addr 172.21.15.49:0/1611856765 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:45.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cc8f9b700 1 --2- 172.21.15.49:0/1611856765 >> v2:172.21.15.150:3300/0 conn(0x7f3cc415d180 0x7f3cc406c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:45.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cc9f9d700 1 --2- 172.21.15.49:0/1611856765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cc40c90d0 0x7f3cc40c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:45.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cc8f9b700 1 -- 172.21.15.49:0/1611856765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cc40c90d0 msgr2=0x7f3cc40c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:45.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cc8f9b700 1 --2- 172.21.15.49:0/1611856765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cc40c90d0 0x7f3cc40c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cc8f9b700 1 -- 172.21.15.49:0/1611856765 >> v1:172.21.15.49:6789/0 conn(0x7f3cc4158c00 legacy=0x7f3cc406da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:45.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cc8f9b700 1 -- 172.21.15.49:0/1611856765 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc406c9d0 con 0x7f3cc415d180 2023-07-21T22:13:45.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.181+0000 7f3cbbfff700 1 -- 172.21.15.49:0/1611856765 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196227689 0 0) 0x7f3cc40c9a70 con 0x7f3cc4158c00 2023-07-21T22:13:45.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.185+0000 7f3cc8f9b700 1 --2- 172.21.15.49:0/1611856765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cc415d180 0x7f3cc406c180 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400baf0 tx=0x7f3cb400be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2f9ebdc3ff31a14 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:45.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.185+0000 7f3cbbfff700 1 -- 172.21.15.49:0/1611856765 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb400dc70 con 0x7f3cc415d180 2023-07-21T22:13:45.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.185+0000 7f3cbbfff700 1 -- 172.21.15.49:0/1611856765 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb400ddd0 con 0x7f3cc415d180 2023-07-21T22:13:45.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.185+0000 7f3cbbfff700 1 -- 172.21.15.49:0/1611856765 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4010690 con 0x7f3cc415d180 2023-07-21T22:13:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.185+0000 7f3cca79e700 1 -- 172.21.15.49:0/1611856765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cc415d180 msgr2=0x7f3cc406c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.185+0000 7f3cca79e700 1 --2- 172.21.15.49:0/1611856765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cc415d180 0x7f3cc406c180 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400baf0 tx=0x7f3cb400be00 comp rx=0 tx=0).stop 2023-07-21T22:13:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.185+0000 7f3cca79e700 1 -- 172.21.15.49:0/1611856765 shutdown_connections 2023-07-21T22:13:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.185+0000 7f3cca79e700 1 --2- 172.21.15.49:0/1611856765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cc40c90d0 0x7f3cc40c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.185+0000 7f3cca79e700 1 --2- 172.21.15.49:0/1611856765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cc415d180 0x7f3cc406c180 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.185+0000 7f3cca79e700 1 -- 172.21.15.49:0/1611856765 >> 172.21.15.49:0/1611856765 conn(0x7f3cc4070450 msgr2=0x7f3cc4070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.185+0000 7f3cca79e700 1 -- 172.21.15.49:0/1611856765 shutdown_connections 2023-07-21T22:13:45.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.185+0000 7f3cca79e700 1 -- 172.21.15.49:0/1611856765 wait complete. 2023-07-21T22:13:45.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cca79e700 1 Processor -- start 2023-07-21T22:13:45.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cca79e700 1 -- start start 2023-07-21T22:13:45.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cca79e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cc40c90d0 0x7f3cc4151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:45.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cca79e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cc4158c00 0x7f3cc40b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:45.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cca79e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc415d180 0x7f3cc40b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:45.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cca79e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc40b3d70 con 0x7f3cc415d180 2023-07-21T22:13:45.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cca79e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc40c7890 con 0x7f3cc40c90d0 2023-07-21T22:13:45.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cca79e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc4159d90 con 0x7f3cc4158c00 2023-07-21T22:13:45.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cc9f9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc415d180 0x7f3cc40b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:45.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cc9f9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc415d180 0x7f3cc40b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54524/0 (socket says 172.21.15.49:54524) 2023-07-21T22:13:45.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cc9f9d700 1 -- 172.21.15.49:0/4114555323 learned_addr learned my addr 172.21.15.49:0/4114555323 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:45.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cc979c700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cc40c90d0 0x7f3cc4151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:45.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cc8f9b700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cc4158c00 0x7f3cc40b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:45.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cc9f9d700 1 -- 172.21.15.49:0/4114555323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cc4158c00 msgr2=0x7f3cc40b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:45.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cc9f9d700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cc4158c00 0x7f3cc40b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cc9f9d700 1 -- 172.21.15.49:0/4114555323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cc40c90d0 msgr2=0x7f3cc4151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:45.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cc9f9d700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cc40c90d0 0x7f3cc4151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cc9f9d700 1 -- 172.21.15.49:0/4114555323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb400b750 con 0x7f3cc415d180 2023-07-21T22:13:45.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cc8f9b700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cc4158c00 0x7f3cc40b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:45.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cc9f9d700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc415d180 0x7f3cc40b3830 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc00efc0 tx=0x7f3cbc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:45.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cb9ffb700 1 -- 172.21.15.49:0/4114555323 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc009ba0 con 0x7f3cc415d180 2023-07-21T22:13:45.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cca79e700 1 -- 172.21.15.49:0/4114555323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc415a070 con 0x7f3cc415d180 2023-07-21T22:13:45.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cb9ffb700 1 -- 172.21.15.49:0/4114555323 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc00f040 con 0x7f3cc415d180 2023-07-21T22:13:45.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cb9ffb700 1 -- 172.21.15.49:0/4114555323 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc014480 con 0x7f3cc415d180 2023-07-21T22:13:45.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.189+0000 7f3cca79e700 1 -- 172.21.15.49:0/4114555323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc40adad0 con 0x7f3cc415d180 2023-07-21T22:13:45.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.193+0000 7f3cca79e700 1 -- 172.21.15.49:0/4114555323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc415a590 con 0x7f3cc415d180 2023-07-21T22:13:45.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.193+0000 7f3cb9ffb700 1 -- 172.21.15.49:0/4114555323 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3cbc0145e0 con 0x7f3cc415d180 2023-07-21T22:13:45.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.197+0000 7f3cb9ffb700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3ca80662f0 0x7f3ca80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:45.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.197+0000 7f3cb9ffb700 1 -- 172.21.15.49:0/4114555323 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3cbc084790 con 0x7f3cc415d180 2023-07-21T22:13:45.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.197+0000 7f3cc979c700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3ca80662f0 0x7f3ca80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:45.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.197+0000 7f3cc979c700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3ca80662f0 0x7f3ca80687a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0000f60 tx=0x7f3cc0007cb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:45.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.201+0000 7f3cb9ffb700 1 -- 172.21.15.49:0/4114555323 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3cc415a590 con 0x7f3cc415d180 2023-07-21T22:13:45.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.369+0000 7f3cca79e700 1 -- 172.21.15.49:0/4114555323 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3cc4159f00 con 0x7f3ca80662f0 2023-07-21T22:13:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.381+0000 7f3cb9ffb700 1 -- 172.21.15.49:0/4114555323 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308228 (secure 0 0 0) 0x7f3cc4159f00 con 0x7f3ca80662f0 2023-07-21T22:13:45.427 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.389+0000 7f3cca79e700 1 -- 172.21.15.49:0/4114555323 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3ca80662f0 msgr2=0x7f3ca80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.389+0000 7f3cca79e700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3ca80662f0 0x7f3ca80687a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0000f60 tx=0x7f3cc0007cb0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.389+0000 7f3cca79e700 1 -- 172.21.15.49:0/4114555323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc415d180 msgr2=0x7f3cc40b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.389+0000 7f3cca79e700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc415d180 0x7f3cc40b3830 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc00efc0 tx=0x7f3cbc00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.393+0000 7f3cca79e700 1 -- 172.21.15.49:0/4114555323 shutdown_connections 2023-07-21T22:13:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.393+0000 7f3cca79e700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3ca80662f0 0x7f3ca80687a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.393+0000 7f3cca79e700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc415d180 0x7f3cc40b3830 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.393+0000 7f3cca79e700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cc4158c00 0x7f3cc40b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.393+0000 7f3cca79e700 1 --2- 172.21.15.49:0/4114555323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cc40c90d0 0x7f3cc4151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.393+0000 7f3cca79e700 1 -- 172.21.15.49:0/4114555323 >> 172.21.15.49:0/4114555323 conn(0x7f3cc4070450 msgr2=0x7f3cc40cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.393+0000 7f3cca79e700 1 -- 172.21.15.49:0/4114555323 shutdown_connections 2023-07-21T22:13:45.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.393+0000 7f3cca79e700 1 -- 172.21.15.49:0/4114555323 wait complete. 2023-07-21T22:13:45.437 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:13:45.455 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2023-07-21T22:13:44.372743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":193,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246988,"kb_used_data":6796,"kb_used_omap":0,"kb_used_meta":240128,"kb_avail":754727732,"statfs":{"total":773094113280,"available":772841197568,"internally_reserved":0,"allocated":6959104,"data_stored":3841462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":245891072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.305549"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.085505+0000","last_change":"2023-07-21T22:13:40.085505+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.085505+0000","last_undegraded":"2023-07-21T22:13:40.085505+0000","last_fullsized":"2023-07-21T22:13:40.085505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.084869+0000","last_change":"2023-07-21T22:13:40.084869+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.084869+0000","last_undegraded":"2023-07-21T22:13:40.084869+0000","last_fullsized":"2023-07-21T22:13:40.084869+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114631+0000","last_change":"2023-07-21T22:13:41.102406+0000","last_active":"2023-07-21T22:13:41.114631+0000","last_peered":"2023-07-21T22:13:41.114631+0000","last_clean":"2023-07-21T22:13:41.114631+0000","last_became_active":"2023-07-21T22:13:41.102137+0000","last_became_peered":"2023-07-21T22:13:41.102137+0000","last_unstale":"2023-07-21T22:13:41.114631+0000","last_undegraded":"2023-07-21T22:13:41.114631+0000","last_fullsized":"2023-07-21T22:13:41.114631+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:35.630446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.109032+0000","last_change":"2023-07-21T22:13:41.093070+0000","last_active":"2023-07-21T22:13:41.109032+0000","last_peered":"2023-07-21T22:13:41.109032+0000","last_clean":"2023-07-21T22:13:41.109032+0000","last_became_active":"2023-07-21T22:13:41.092734+0000","last_became_peered":"2023-07-21T22:13:41.092734+0000","last_unstale":"2023-07-21T22:13:41.109032+0000","last_undegraded":"2023-07-21T22:13:41.109032+0000","last_fullsized":"2023-07-21T22:13:41.109032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:29:54.037991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115829+0000","last_change":"2023-07-21T22:13:41.108849+0000","last_active":"2023-07-21T22:13:41.115829+0000","last_peered":"2023-07-21T22:13:41.115829+0000","last_clean":"2023-07-21T22:13:41.115829+0000","last_became_active":"2023-07-21T22:13:41.108566+0000","last_became_peered":"2023-07-21T22:13:41.108566+0000","last_unstale":"2023-07-21T22:13:41.115829+0000","last_undegraded":"2023-07-21T22:13:41.115829+0000","last_fullsized":"2023-07-21T22:13:41.115829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:18:05.133741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114892+0000","last_change":"2023-07-21T22:13:41.111253+0000","last_active":"2023-07-21T22:13:41.114892+0000","last_peered":"2023-07-21T22:13:41.114892+0000","last_clean":"2023-07-21T22:13:41.114892+0000","last_became_active":"2023-07-21T22:13:41.110498+0000","last_became_peered":"2023-07-21T22:13:41.110498+0000","last_unstale":"2023-07-21T22:13:41.114892+0000","last_undegraded":"2023-07-21T22:13:41.114892+0000","last_fullsized":"2023-07-21T22:13:41.114892+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:52:07.339883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115154+0000","last_change":"2023-07-21T22:13:41.105865+0000","last_active":"2023-07-21T22:13:41.115154+0000","last_peered":"2023-07-21T22:13:41.115154+0000","last_clean":"2023-07-21T22:13:41.115154+0000","last_became_active":"2023-07-21T22:13:41.105567+0000","last_became_peered":"2023-07-21T22:13:41.105567+0000","last_unstale":"2023-07-21T22:13:41.115154+0000","last_undegraded":"2023-07-21T22:13:41.115154+0000","last_fullsized":"2023-07-21T22:13:41.115154+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:44:28.582096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108876+0000","last_change":"2023-07-21T22:13:41.102968+0000","last_active":"2023-07-21T22:13:41.108876+0000","last_peered":"2023-07-21T22:13:41.108876+0000","last_clean":"2023-07-21T22:13:41.108876+0000","last_became_active":"2023-07-21T22:13:41.102713+0000","last_became_peered":"2023-07-21T22:13:41.102713+0000","last_unstale":"2023-07-21T22:13:41.108876+0000","last_undegraded":"2023-07-21T22:13:41.108876+0000","last_fullsized":"2023-07-21T22:13:41.108876+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:37.212909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118275+0000","last_change":"2023-07-21T22:13:41.108597+0000","last_active":"2023-07-21T22:13:41.118275+0000","last_peered":"2023-07-21T22:13:41.118275+0000","last_clean":"2023-07-21T22:13:41.118275+0000","last_became_active":"2023-07-21T22:13:41.108348+0000","last_became_peered":"2023-07-21T22:13:41.108348+0000","last_unstale":"2023-07-21T22:13:41.118275+0000","last_undegraded":"2023-07-21T22:13:41.118275+0000","last_fullsized":"2023-07-21T22:13:41.118275+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:34.485489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115770+0000","last_change":"2023-07-21T22:13:41.104555+0000","last_active":"2023-07-21T22:13:41.115770+0000","last_peered":"2023-07-21T22:13:41.115770+0000","last_clean":"2023-07-21T22:13:41.115770+0000","last_became_active":"2023-07-21T22:13:41.104299+0000","last_became_peered":"2023-07-21T22:13:41.104299+0000","last_unstale":"2023-07-21T22:13:41.115770+0000","last_undegraded":"2023-07-21T22:13:41.115770+0000","last_fullsized":"2023-07-21T22:13:41.115770+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:15:37.915301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115753+0000","last_change":"2023-07-21T22:13:41.103712+0000","last_active":"2023-07-21T22:13:41.115753+0000","last_peered":"2023-07-21T22:13:41.115753+0000","last_clean":"2023-07-21T22:13:41.115753+0000","last_became_active":"2023-07-21T22:13:41.103431+0000","last_became_peered":"2023-07-21T22:13:41.103431+0000","last_unstale":"2023-07-21T22:13:41.115753+0000","last_undegraded":"2023-07-21T22:13:41.115753+0000","last_fullsized":"2023-07-21T22:13:41.115753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:39.364718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108913+0000","last_change":"2023-07-21T22:13:41.104207+0000","last_active":"2023-07-21T22:13:41.108913+0000","last_peered":"2023-07-21T22:13:41.108913+0000","last_clean":"2023-07-21T22:13:41.108913+0000","last_became_active":"2023-07-21T22:13:41.103922+0000","last_became_peered":"2023-07-21T22:13:41.103922+0000","last_unstale":"2023-07-21T22:13:41.108913+0000","last_undegraded":"2023-07-21T22:13:41.108913+0000","last_fullsized":"2023-07-21T22:13:41.108913+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:57.274636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108822+0000","last_change":"2023-07-21T22:13:41.097039+0000","last_active":"2023-07-21T22:13:41.108822+0000","last_peered":"2023-07-21T22:13:41.108822+0000","last_clean":"2023-07-21T22:13:41.108822+0000","last_became_active":"2023-07-21T22:13:41.096761+0000","last_became_peered":"2023-07-21T22:13:41.096761+0000","last_unstale":"2023-07-21T22:13:41.108822+0000","last_undegraded":"2023-07-21T22:13:41.108822+0000","last_fullsized":"2023-07-21T22:13:41.108822+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:15:37.915301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114332+0000","last_change":"2023-07-21T22:13:41.101818+0000","last_active":"2023-07-21T22:13:41.114332+0000","last_peered":"2023-07-21T22:13:41.114332+0000","last_clean":"2023-07-21T22:13:41.114332+0000","last_became_active":"2023-07-21T22:13:41.101516+0000","last_became_peered":"2023-07-21T22:13:41.101516+0000","last_unstale":"2023-07-21T22:13:41.114332+0000","last_undegraded":"2023-07-21T22:13:41.114332+0000","last_fullsized":"2023-07-21T22:13:41.114332+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:01.251820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115313+0000","last_change":"2023-07-21T22:13:41.103892+0000","last_active":"2023-07-21T22:13:41.115313+0000","last_peered":"2023-07-21T22:13:41.115313+0000","last_clean":"2023-07-21T22:13:41.115313+0000","last_became_active":"2023-07-21T22:13:41.103587+0000","last_became_peered":"2023-07-21T22:13:41.103587+0000","last_unstale":"2023-07-21T22:13:41.115313+0000","last_undegraded":"2023-07-21T22:13:41.115313+0000","last_fullsized":"2023-07-21T22:13:41.115313+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:08:19.007621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115207+0000","last_change":"2023-07-21T22:13:41.106608+0000","last_active":"2023-07-21T22:13:41.115207+0000","last_peered":"2023-07-21T22:13:41.115207+0000","last_clean":"2023-07-21T22:13:41.115207+0000","last_became_active":"2023-07-21T22:13:41.106100+0000","last_became_peered":"2023-07-21T22:13:41.106100+0000","last_unstale":"2023-07-21T22:13:41.115207+0000","last_undegraded":"2023-07-21T22:13:41.115207+0000","last_fullsized":"2023-07-21T22:13:41.115207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:14.077369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.082600+0000","last_change":"2023-07-21T22:13:40.082600+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.082600+0000","last_undegraded":"2023-07-21T22:13:40.082600+0000","last_fullsized":"2023-07-21T22:13:40.082600+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115386+0000","last_change":"2023-07-21T22:13:41.098779+0000","last_active":"2023-07-21T22:13:41.115386+0000","last_peered":"2023-07-21T22:13:41.115386+0000","last_clean":"2023-07-21T22:13:41.115386+0000","last_became_active":"2023-07-21T22:13:41.097678+0000","last_became_peered":"2023-07-21T22:13:41.097678+0000","last_unstale":"2023-07-21T22:13:41.115386+0000","last_undegraded":"2023-07-21T22:13:41.115386+0000","last_fullsized":"2023-07-21T22:13:41.115386+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:39.921791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115791+0000","last_change":"2023-07-21T22:13:41.110504+0000","last_active":"2023-07-21T22:13:41.115791+0000","last_peered":"2023-07-21T22:13:41.115791+0000","last_clean":"2023-07-21T22:13:41.115791+0000","last_became_active":"2023-07-21T22:13:41.110211+0000","last_became_peered":"2023-07-21T22:13:41.110211+0000","last_unstale":"2023-07-21T22:13:41.115791+0000","last_undegraded":"2023-07-21T22:13:41.115791+0000","last_fullsized":"2023-07-21T22:13:41.115791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:29:05.960444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.100716+0000","last_change":"2023-07-21T22:13:41.097911+0000","last_active":"2023-07-21T22:13:41.100716+0000","last_peered":"2023-07-21T22:13:41.100716+0000","last_clean":"2023-07-21T22:13:41.100716+0000","last_became_active":"2023-07-21T22:13:41.097604+0000","last_became_peered":"2023-07-21T22:13:41.097604+0000","last_unstale":"2023-07-21T22:13:41.100716+0000","last_undegraded":"2023-07-21T22:13:41.100716+0000","last_fullsized":"2023-07-21T22:13:41.100716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:34.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108802+0000","last_change":"2023-07-21T22:13:41.096467+0000","last_active":"2023-07-21T22:13:41.108802+0000","last_peered":"2023-07-21T22:13:41.108802+0000","last_clean":"2023-07-21T22:13:41.108802+0000","last_became_active":"2023-07-21T22:13:41.093898+0000","last_became_peered":"2023-07-21T22:13:41.093898+0000","last_unstale":"2023-07-21T22:13:41.108802+0000","last_undegraded":"2023-07-21T22:13:41.108802+0000","last_fullsized":"2023-07-21T22:13:41.108802+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:18:48.827452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108350+0000","last_change":"2023-07-21T22:13:41.104555+0000","last_active":"2023-07-21T22:13:41.108350+0000","last_peered":"2023-07-21T22:13:41.108350+0000","last_clean":"2023-07-21T22:13:41.108350+0000","last_became_active":"2023-07-21T22:13:41.104275+0000","last_became_peered":"2023-07-21T22:13:41.104275+0000","last_unstale":"2023-07-21T22:13:41.108350+0000","last_undegraded":"2023-07-21T22:13:41.108350+0000","last_fullsized":"2023-07-21T22:13:41.108350+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:52:50.466773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.109527+0000","last_change":"2023-07-21T22:13:41.103964+0000","last_active":"2023-07-21T22:13:41.109527+0000","last_peered":"2023-07-21T22:13:41.109527+0000","last_clean":"2023-07-21T22:13:41.109527+0000","last_became_active":"2023-07-21T22:13:41.103680+0000","last_became_peered":"2023-07-21T22:13:41.103680+0000","last_unstale":"2023-07-21T22:13:41.109527+0000","last_undegraded":"2023-07-21T22:13:41.109527+0000","last_fullsized":"2023-07-21T22:13:41.109527+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:39.370150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114357+0000","last_change":"2023-07-21T22:13:41.102028+0000","last_active":"2023-07-21T22:13:41.114357+0000","last_peered":"2023-07-21T22:13:41.114357+0000","last_clean":"2023-07-21T22:13:41.114357+0000","last_became_active":"2023-07-21T22:13:41.101730+0000","last_became_peered":"2023-07-21T22:13:41.101730+0000","last_unstale":"2023-07-21T22:13:41.114357+0000","last_undegraded":"2023-07-21T22:13:41.114357+0000","last_fullsized":"2023-07-21T22:13:41.114357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:39.844317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.106848+0000","last_change":"2023-07-21T22:13:41.096075+0000","last_active":"2023-07-21T22:13:41.106848+0000","last_peered":"2023-07-21T22:13:41.106848+0000","last_clean":"2023-07-21T22:13:41.106848+0000","last_became_active":"2023-07-21T22:13:41.093481+0000","last_became_peered":"2023-07-21T22:13:41.093481+0000","last_unstale":"2023-07-21T22:13:41.106848+0000","last_undegraded":"2023-07-21T22:13:41.106848+0000","last_fullsized":"2023-07-21T22:13:41.106848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:44.826686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108850+0000","last_change":"2023-07-21T22:13:41.098370+0000","last_active":"2023-07-21T22:13:41.108850+0000","last_peered":"2023-07-21T22:13:41.108850+0000","last_clean":"2023-07-21T22:13:41.108850+0000","last_became_active":"2023-07-21T22:13:41.098102+0000","last_became_peered":"2023-07-21T22:13:41.098102+0000","last_unstale":"2023-07-21T22:13:41.108850+0000","last_undegraded":"2023-07-21T22:13:41.108850+0000","last_fullsized":"2023-07-21T22:13:41.108850+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:34.485489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.113081+0000","last_change":"2023-07-21T22:13:41.097502+0000","last_active":"2023-07-21T22:13:41.113081+0000","last_peered":"2023-07-21T22:13:41.113081+0000","last_clean":"2023-07-21T22:13:41.113081+0000","last_became_active":"2023-07-21T22:13:41.097033+0000","last_became_peered":"2023-07-21T22:13:41.097033+0000","last_unstale":"2023-07-21T22:13:41.113081+0000","last_undegraded":"2023-07-21T22:13:41.113081+0000","last_fullsized":"2023-07-21T22:13:41.113081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:37.732164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.084808+0000","last_change":"2023-07-21T22:13:40.084808+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.084808+0000","last_undegraded":"2023-07-21T22:13:40.084808+0000","last_fullsized":"2023-07-21T22:13:40.084808+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114482+0000","last_change":"2023-07-21T22:13:41.102785+0000","last_active":"2023-07-21T22:13:41.114482+0000","last_peered":"2023-07-21T22:13:41.114482+0000","last_clean":"2023-07-21T22:13:41.114482+0000","last_became_active":"2023-07-21T22:13:41.102481+0000","last_became_peered":"2023-07-21T22:13:41.102481+0000","last_unstale":"2023-07-21T22:13:41.114482+0000","last_undegraded":"2023-07-21T22:13:41.114482+0000","last_fullsized":"2023-07-21T22:13:41.114482+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:19.379168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108932+0000","last_change":"2023-07-21T22:13:41.101943+0000","last_active":"2023-07-21T22:13:41.108932+0000","last_peered":"2023-07-21T22:13:41.108932+0000","last_clean":"2023-07-21T22:13:41.108932+0000","last_became_active":"2023-07-21T22:13:41.101635+0000","last_became_peered":"2023-07-21T22:13:41.101635+0000","last_unstale":"2023-07-21T22:13:41.108932+0000","last_undegraded":"2023-07-21T22:13:41.108932+0000","last_fullsized":"2023-07-21T22:13:41.108932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:01:51.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115272+0000","last_change":"2023-07-21T22:13:41.096068+0000","last_active":"2023-07-21T22:13:41.115272+0000","last_peered":"2023-07-21T22:13:41.115272+0000","last_clean":"2023-07-21T22:13:41.115272+0000","last_became_active":"2023-07-21T22:13:41.095783+0000","last_became_peered":"2023-07-21T22:13:41.095783+0000","last_unstale":"2023-07-21T22:13:41.115272+0000","last_undegraded":"2023-07-21T22:13:41.115272+0000","last_fullsized":"2023-07-21T22:13:41.115272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:51:09.826591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114831+0000","last_change":"2023-07-21T22:13:41.110068+0000","last_active":"2023-07-21T22:13:41.114831+0000","last_peered":"2023-07-21T22:13:41.114831+0000","last_clean":"2023-07-21T22:13:41.114831+0000","last_became_active":"2023-07-21T22:13:41.109762+0000","last_became_peered":"2023-07-21T22:13:41.109762+0000","last_unstale":"2023-07-21T22:13:41.114831+0000","last_undegraded":"2023-07-21T22:13:41.114831+0000","last_fullsized":"2023-07-21T22:13:41.114831+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:44:09.003020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112528+0000","last_change":"2023-07-21T22:13:41.107081+0000","last_active":"2023-07-21T22:13:41.112528+0000","last_peered":"2023-07-21T22:13:41.112528+0000","last_clean":"2023-07-21T22:13:41.112528+0000","last_became_active":"2023-07-21T22:13:41.106787+0000","last_became_peered":"2023-07-21T22:13:41.106787+0000","last_unstale":"2023-07-21T22:13:41.112528+0000","last_undegraded":"2023-07-21T22:13:41.112528+0000","last_fullsized":"2023-07-21T22:13:41.112528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:34:48.139648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.102949+0000","last_change":"2023-07-21T22:13:40.101387+0000","last_active":"2023-07-21T22:13:40.102949+0000","last_peered":"2023-07-21T22:13:40.102949+0000","last_clean":"2023-07-21T22:13:40.102949+0000","last_became_active":"2023-07-21T22:13:40.100913+0000","last_became_peered":"2023-07-21T22:13:40.100913+0000","last_unstale":"2023-07-21T22:13:40.102949+0000","last_undegraded":"2023-07-21T22:13:40.102949+0000","last_fullsized":"2023-07-21T22:13:40.102949+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:58:58.055258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112989+0000","last_change":"2023-07-21T22:13:41.096891+0000","last_active":"2023-07-21T22:13:41.112989+0000","last_peered":"2023-07-21T22:13:41.112989+0000","last_clean":"2023-07-21T22:13:41.112989+0000","last_became_active":"2023-07-21T22:13:41.095295+0000","last_became_peered":"2023-07-21T22:13:41.095295+0000","last_unstale":"2023-07-21T22:13:41.112989+0000","last_undegraded":"2023-07-21T22:13:41.112989+0000","last_fullsized":"2023-07-21T22:13:41.112989+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:14.952691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.121232+0000","last_change":"2023-07-21T22:13:40.094443+0000","last_active":"2023-07-21T22:13:41.121232+0000","last_peered":"2023-07-21T22:13:41.121232+0000","last_clean":"2023-07-21T22:13:41.121232+0000","last_became_active":"2023-07-21T22:13:40.094114+0000","last_became_peered":"2023-07-21T22:13:40.094114+0000","last_unstale":"2023-07-21T22:13:41.121232+0000","last_undegraded":"2023-07-21T22:13:41.121232+0000","last_fullsized":"2023-07-21T22:13:41.121232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:28.818934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.101929+0000","last_change":"2023-07-21T22:13:41.097322+0000","last_active":"2023-07-21T22:13:41.101929+0000","last_peered":"2023-07-21T22:13:41.101929+0000","last_clean":"2023-07-21T22:13:41.101929+0000","last_became_active":"2023-07-21T22:13:41.097054+0000","last_became_peered":"2023-07-21T22:13:41.097054+0000","last_unstale":"2023-07-21T22:13:41.101929+0000","last_undegraded":"2023-07-21T22:13:41.101929+0000","last_fullsized":"2023-07-21T22:13:41.101929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:24.106186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.122724+0000","last_change":"2023-07-21T22:13:40.087761+0000","last_active":"2023-07-21T22:13:41.122724+0000","last_peered":"2023-07-21T22:13:41.122724+0000","last_clean":"2023-07-21T22:13:41.122724+0000","last_became_active":"2023-07-21T22:13:40.087468+0000","last_became_peered":"2023-07-21T22:13:40.087468+0000","last_unstale":"2023-07-21T22:13:41.122724+0000","last_undegraded":"2023-07-21T22:13:41.122724+0000","last_fullsized":"2023-07-21T22:13:41.122724+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:53.822832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115750+0000","last_change":"2023-07-21T22:13:41.104006+0000","last_active":"2023-07-21T22:13:41.115750+0000","last_peered":"2023-07-21T22:13:41.115750+0000","last_clean":"2023-07-21T22:13:41.115750+0000","last_became_active":"2023-07-21T22:13:41.103736+0000","last_became_peered":"2023-07-21T22:13:41.103736+0000","last_unstale":"2023-07-21T22:13:41.115750+0000","last_undegraded":"2023-07-21T22:13:41.115750+0000","last_fullsized":"2023-07-21T22:13:41.115750+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:01:51.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.121997+0000","last_change":"2023-07-21T22:13:40.096070+0000","last_active":"2023-07-21T22:13:41.121997+0000","last_peered":"2023-07-21T22:13:41.121997+0000","last_clean":"2023-07-21T22:13:41.121997+0000","last_became_active":"2023-07-21T22:13:40.095788+0000","last_became_peered":"2023-07-21T22:13:40.095788+0000","last_unstale":"2023-07-21T22:13:41.121997+0000","last_undegraded":"2023-07-21T22:13:41.121997+0000","last_fullsized":"2023-07-21T22:13:41.121997+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:44:32.650671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115187+0000","last_change":"2023-07-21T22:13:41.106371+0000","last_active":"2023-07-21T22:13:41.115187+0000","last_peered":"2023-07-21T22:13:41.115187+0000","last_clean":"2023-07-21T22:13:41.115187+0000","last_became_active":"2023-07-21T22:13:41.105701+0000","last_became_peered":"2023-07-21T22:13:41.105701+0000","last_unstale":"2023-07-21T22:13:41.115187+0000","last_undegraded":"2023-07-21T22:13:41.115187+0000","last_fullsized":"2023-07-21T22:13:41.115187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:34:03.908679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119232+0000","last_change":"2023-07-21T22:13:40.091865+0000","last_active":"2023-07-21T22:13:41.119232+0000","last_peered":"2023-07-21T22:13:41.119232+0000","last_clean":"2023-07-21T22:13:41.119232+0000","last_became_active":"2023-07-21T22:13:40.091563+0000","last_became_peered":"2023-07-21T22:13:40.091563+0000","last_unstale":"2023-07-21T22:13:41.119232+0000","last_undegraded":"2023-07-21T22:13:41.119232+0000","last_fullsized":"2023-07-21T22:13:41.119232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:07.095120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.080876+0000","last_change":"2023-07-21T22:13:40.080876+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.080876+0000","last_undegraded":"2023-07-21T22:13:40.080876+0000","last_fullsized":"2023-07-21T22:13:40.080876+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118983+0000","last_change":"2023-07-21T22:13:40.088623+0000","last_active":"2023-07-21T22:13:41.118983+0000","last_peered":"2023-07-21T22:13:41.118983+0000","last_clean":"2023-07-21T22:13:41.118983+0000","last_became_active":"2023-07-21T22:13:40.088019+0000","last_became_peered":"2023-07-21T22:13:40.088019+0000","last_unstale":"2023-07-21T22:13:41.118983+0000","last_undegraded":"2023-07-21T22:13:41.118983+0000","last_fullsized":"2023-07-21T22:13:41.118983+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:11:27.016587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112409+0000","last_change":"2023-07-21T22:13:41.100003+0000","last_active":"2023-07-21T22:13:41.112409+0000","last_peered":"2023-07-21T22:13:41.112409+0000","last_clean":"2023-07-21T22:13:41.112409+0000","last_became_active":"2023-07-21T22:13:41.099703+0000","last_became_peered":"2023-07-21T22:13:41.099703+0000","last_unstale":"2023-07-21T22:13:41.112409+0000","last_undegraded":"2023-07-21T22:13:41.112409+0000","last_fullsized":"2023-07-21T22:13:41.112409+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:12:26.575731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078570+0000","last_change":"2023-07-21T22:13:40.092332+0000","last_active":"2023-07-21T22:13:41.078570+0000","last_peered":"2023-07-21T22:13:41.078570+0000","last_clean":"2023-07-21T22:13:41.078570+0000","last_became_active":"2023-07-21T22:13:40.091709+0000","last_became_peered":"2023-07-21T22:13:40.091709+0000","last_unstale":"2023-07-21T22:13:41.078570+0000","last_undegraded":"2023-07-21T22:13:41.078570+0000","last_fullsized":"2023-07-21T22:13:41.078570+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:00.067789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.100801+0000","last_change":"2023-07-21T22:13:41.096538+0000","last_active":"2023-07-21T22:13:41.100801+0000","last_peered":"2023-07-21T22:13:41.100801+0000","last_clean":"2023-07-21T22:13:41.100801+0000","last_became_active":"2023-07-21T22:13:41.096233+0000","last_became_peered":"2023-07-21T22:13:41.096233+0000","last_unstale":"2023-07-21T22:13:41.100801+0000","last_undegraded":"2023-07-21T22:13:41.100801+0000","last_fullsized":"2023-07-21T22:13:41.100801+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:55:28.232508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.088154+0000","last_change":"2023-07-21T22:13:40.099452+0000","last_active":"2023-07-21T22:13:41.088154+0000","last_peered":"2023-07-21T22:13:41.088154+0000","last_clean":"2023-07-21T22:13:41.088154+0000","last_became_active":"2023-07-21T22:13:40.099144+0000","last_became_peered":"2023-07-21T22:13:40.099144+0000","last_unstale":"2023-07-21T22:13:41.088154+0000","last_undegraded":"2023-07-21T22:13:41.088154+0000","last_fullsized":"2023-07-21T22:13:41.088154+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:51:43.066212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.084347+0000","last_change":"2023-07-21T22:13:40.084347+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.084347+0000","last_undegraded":"2023-07-21T22:13:40.084347+0000","last_fullsized":"2023-07-21T22:13:40.084347+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.088801+0000","last_change":"2023-07-21T22:13:40.100806+0000","last_active":"2023-07-21T22:13:41.088801+0000","last_peered":"2023-07-21T22:13:41.088801+0000","last_clean":"2023-07-21T22:13:41.088801+0000","last_became_active":"2023-07-21T22:13:40.100450+0000","last_became_peered":"2023-07-21T22:13:40.100450+0000","last_unstale":"2023-07-21T22:13:41.088801+0000","last_undegraded":"2023-07-21T22:13:41.088801+0000","last_fullsized":"2023-07-21T22:13:41.088801+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:16:10.411350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.092547+0000","last_change":"2023-07-21T22:13:41.089865+0000","last_active":"2023-07-21T22:13:41.092547+0000","last_peered":"2023-07-21T22:13:41.092547+0000","last_clean":"2023-07-21T22:13:41.092547+0000","last_became_active":"2023-07-21T22:13:41.089516+0000","last_became_peered":"2023-07-21T22:13:41.089516+0000","last_unstale":"2023-07-21T22:13:41.092547+0000","last_undegraded":"2023-07-21T22:13:41.092547+0000","last_fullsized":"2023-07-21T22:13:41.092547+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:24:50.488362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.081111+0000","last_change":"2023-07-21T22:13:40.094632+0000","last_active":"2023-07-21T22:13:41.081111+0000","last_peered":"2023-07-21T22:13:41.081111+0000","last_clean":"2023-07-21T22:13:41.081111+0000","last_became_active":"2023-07-21T22:13:40.094368+0000","last_became_peered":"2023-07-21T22:13:40.094368+0000","last_unstale":"2023-07-21T22:13:41.081111+0000","last_undegraded":"2023-07-21T22:13:41.081111+0000","last_fullsized":"2023-07-21T22:13:41.081111+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:09.684014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115717+0000","last_change":"2023-07-21T22:13:41.108001+0000","last_active":"2023-07-21T22:13:41.115717+0000","last_peered":"2023-07-21T22:13:41.115717+0000","last_clean":"2023-07-21T22:13:41.115717+0000","last_became_active":"2023-07-21T22:13:41.107733+0000","last_became_peered":"2023-07-21T22:13:41.107733+0000","last_unstale":"2023-07-21T22:13:41.115717+0000","last_undegraded":"2023-07-21T22:13:41.115717+0000","last_fullsized":"2023-07-21T22:13:41.115717+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:53:48.587220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118808+0000","last_change":"2023-07-21T22:13:40.098392+0000","last_active":"2023-07-21T22:13:41.118808+0000","last_peered":"2023-07-21T22:13:41.118808+0000","last_clean":"2023-07-21T22:13:41.118808+0000","last_became_active":"2023-07-21T22:13:40.098099+0000","last_became_peered":"2023-07-21T22:13:40.098099+0000","last_unstale":"2023-07-21T22:13:41.118808+0000","last_undegraded":"2023-07-21T22:13:41.118808+0000","last_fullsized":"2023-07-21T22:13:41.118808+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:04.466014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107884+0000","last_change":"2023-07-21T22:13:41.092950+0000","last_active":"2023-07-21T22:13:41.107884+0000","last_peered":"2023-07-21T22:13:41.107884+0000","last_clean":"2023-07-21T22:13:41.107884+0000","last_became_active":"2023-07-21T22:13:41.092105+0000","last_became_peered":"2023-07-21T22:13:41.092105+0000","last_unstale":"2023-07-21T22:13:41.107884+0000","last_undegraded":"2023-07-21T22:13:41.107884+0000","last_fullsized":"2023-07-21T22:13:41.107884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:33.372984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.096783+0000","last_change":"2023-07-21T22:13:40.094145+0000","last_active":"2023-07-21T22:13:40.096783+0000","last_peered":"2023-07-21T22:13:40.096783+0000","last_clean":"2023-07-21T22:13:40.096783+0000","last_became_active":"2023-07-21T22:13:40.093633+0000","last_became_peered":"2023-07-21T22:13:40.093633+0000","last_unstale":"2023-07-21T22:13:40.096783+0000","last_undegraded":"2023-07-21T22:13:40.096783+0000","last_fullsized":"2023-07-21T22:13:40.096783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:54.880684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.116141+0000","last_change":"2023-07-21T22:13:41.103922+0000","last_active":"2023-07-21T22:13:41.116141+0000","last_peered":"2023-07-21T22:13:41.116141+0000","last_clean":"2023-07-21T22:13:41.116141+0000","last_became_active":"2023-07-21T22:13:41.103642+0000","last_became_peered":"2023-07-21T22:13:41.103642+0000","last_unstale":"2023-07-21T22:13:41.116141+0000","last_undegraded":"2023-07-21T22:13:41.116141+0000","last_fullsized":"2023-07-21T22:13:41.116141+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:47:44.351565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119015+0000","last_change":"2023-07-21T22:13:40.096493+0000","last_active":"2023-07-21T22:13:41.119015+0000","last_peered":"2023-07-21T22:13:41.119015+0000","last_clean":"2023-07-21T22:13:41.119015+0000","last_became_active":"2023-07-21T22:13:40.096174+0000","last_became_peered":"2023-07-21T22:13:40.096174+0000","last_unstale":"2023-07-21T22:13:41.119015+0000","last_undegraded":"2023-07-21T22:13:41.119015+0000","last_fullsized":"2023-07-21T22:13:41.119015+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:50:47.997077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107074+0000","last_change":"2023-07-21T22:13:41.095610+0000","last_active":"2023-07-21T22:13:41.107074+0000","last_peered":"2023-07-21T22:13:41.107074+0000","last_clean":"2023-07-21T22:13:41.107074+0000","last_became_active":"2023-07-21T22:13:41.092550+0000","last_became_peered":"2023-07-21T22:13:41.092550+0000","last_unstale":"2023-07-21T22:13:41.107074+0000","last_undegraded":"2023-07-21T22:13:41.107074+0000","last_fullsized":"2023-07-21T22:13:41.107074+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:02:55.094217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080696+0000","last_change":"2023-07-21T22:13:40.095144+0000","last_active":"2023-07-21T22:13:41.080696+0000","last_peered":"2023-07-21T22:13:41.080696+0000","last_clean":"2023-07-21T22:13:41.080696+0000","last_became_active":"2023-07-21T22:13:40.094633+0000","last_became_peered":"2023-07-21T22:13:40.094633+0000","last_unstale":"2023-07-21T22:13:41.080696+0000","last_undegraded":"2023-07-21T22:13:41.080696+0000","last_fullsized":"2023-07-21T22:13:41.080696+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:16:10.411350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112455+0000","last_change":"2023-07-21T22:13:41.103229+0000","last_active":"2023-07-21T22:13:41.112455+0000","last_peered":"2023-07-21T22:13:41.112455+0000","last_clean":"2023-07-21T22:13:41.112455+0000","last_became_active":"2023-07-21T22:13:41.102919+0000","last_became_peered":"2023-07-21T22:13:41.102919+0000","last_unstale":"2023-07-21T22:13:41.112455+0000","last_undegraded":"2023-07-21T22:13:41.112455+0000","last_fullsized":"2023-07-21T22:13:41.112455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:57:31.042080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.090400+0000","last_change":"2023-07-21T22:13:40.097496+0000","last_active":"2023-07-21T22:13:41.090400+0000","last_peered":"2023-07-21T22:13:41.090400+0000","last_clean":"2023-07-21T22:13:41.090400+0000","last_became_active":"2023-07-21T22:13:40.097141+0000","last_became_peered":"2023-07-21T22:13:40.097141+0000","last_unstale":"2023-07-21T22:13:41.090400+0000","last_undegraded":"2023-07-21T22:13:41.090400+0000","last_fullsized":"2023-07-21T22:13:41.090400+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:01.084349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.080932+0000","last_change":"2023-07-21T22:13:40.080932+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.080932+0000","last_undegraded":"2023-07-21T22:13:40.080932+0000","last_fullsized":"2023-07-21T22:13:40.080932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.123480+0000","last_change":"2023-07-21T22:13:40.093508+0000","last_active":"2023-07-21T22:13:41.123480+0000","last_peered":"2023-07-21T22:13:41.123480+0000","last_clean":"2023-07-21T22:13:41.123480+0000","last_became_active":"2023-07-21T22:13:40.093118+0000","last_became_peered":"2023-07-21T22:13:40.093118+0000","last_unstale":"2023-07-21T22:13:41.123480+0000","last_undegraded":"2023-07-21T22:13:41.123480+0000","last_fullsized":"2023-07-21T22:13:41.123480+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:05:47.861560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.117774+0000","last_change":"2023-07-21T22:13:41.114988+0000","last_active":"2023-07-21T22:13:41.117774+0000","last_peered":"2023-07-21T22:13:41.117774+0000","last_clean":"2023-07-21T22:13:41.117774+0000","last_became_active":"2023-07-21T22:13:41.114608+0000","last_became_peered":"2023-07-21T22:13:41.114608+0000","last_unstale":"2023-07-21T22:13:41.117774+0000","last_undegraded":"2023-07-21T22:13:41.117774+0000","last_fullsized":"2023-07-21T22:13:41.117774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:12:14.393410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.120885+0000","last_change":"2023-07-21T22:13:40.095884+0000","last_active":"2023-07-21T22:13:41.120885+0000","last_peered":"2023-07-21T22:13:41.120885+0000","last_clean":"2023-07-21T22:13:41.120885+0000","last_became_active":"2023-07-21T22:13:40.095515+0000","last_became_peered":"2023-07-21T22:13:40.095515+0000","last_unstale":"2023-07-21T22:13:41.120885+0000","last_undegraded":"2023-07-21T22:13:41.120885+0000","last_fullsized":"2023-07-21T22:13:41.120885+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:29:53.027086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.111417+0000","last_change":"2023-07-21T22:13:41.099642+0000","last_active":"2023-07-21T22:13:41.111417+0000","last_peered":"2023-07-21T22:13:41.111417+0000","last_clean":"2023-07-21T22:13:41.111417+0000","last_became_active":"2023-07-21T22:13:41.099177+0000","last_became_peered":"2023-07-21T22:13:41.099177+0000","last_unstale":"2023-07-21T22:13:41.111417+0000","last_undegraded":"2023-07-21T22:13:41.111417+0000","last_fullsized":"2023-07-21T22:13:41.111417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:26.604799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080984+0000","last_change":"2023-07-21T22:13:40.089926+0000","last_active":"2023-07-21T22:13:41.080984+0000","last_peered":"2023-07-21T22:13:41.080984+0000","last_clean":"2023-07-21T22:13:41.080984+0000","last_became_active":"2023-07-21T22:13:40.089612+0000","last_became_peered":"2023-07-21T22:13:40.089612+0000","last_unstale":"2023-07-21T22:13:41.080984+0000","last_undegraded":"2023-07-21T22:13:41.080984+0000","last_fullsized":"2023-07-21T22:13:41.080984+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:01.084349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.101400+0000","last_change":"2023-07-21T22:13:41.092119+0000","last_active":"2023-07-21T22:13:41.101400+0000","last_peered":"2023-07-21T22:13:41.101400+0000","last_clean":"2023-07-21T22:13:41.101400+0000","last_became_active":"2023-07-21T22:13:41.091845+0000","last_became_peered":"2023-07-21T22:13:41.091845+0000","last_unstale":"2023-07-21T22:13:41.101400+0000","last_undegraded":"2023-07-21T22:13:41.101400+0000","last_fullsized":"2023-07-21T22:13:41.101400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:43:59.156552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.084066+0000","last_change":"2023-07-21T22:13:40.087676+0000","last_active":"2023-07-21T22:13:41.084066+0000","last_peered":"2023-07-21T22:13:41.084066+0000","last_clean":"2023-07-21T22:13:41.084066+0000","last_became_active":"2023-07-21T22:13:40.087408+0000","last_became_peered":"2023-07-21T22:13:40.087408+0000","last_unstale":"2023-07-21T22:13:41.084066+0000","last_undegraded":"2023-07-21T22:13:41.084066+0000","last_fullsized":"2023-07-21T22:13:41.084066+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:57:08.795253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107260+0000","last_change":"2023-07-21T22:13:41.098307+0000","last_active":"2023-07-21T22:13:41.107260+0000","last_peered":"2023-07-21T22:13:41.107260+0000","last_clean":"2023-07-21T22:13:41.107260+0000","last_became_active":"2023-07-21T22:13:41.097931+0000","last_became_peered":"2023-07-21T22:13:41.097931+0000","last_unstale":"2023-07-21T22:13:41.107260+0000","last_undegraded":"2023-07-21T22:13:41.107260+0000","last_fullsized":"2023-07-21T22:13:41.107260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:12:25.824212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.096763+0000","last_change":"2023-07-21T22:13:40.093966+0000","last_active":"2023-07-21T22:13:40.096763+0000","last_peered":"2023-07-21T22:13:40.096763+0000","last_clean":"2023-07-21T22:13:40.096763+0000","last_became_active":"2023-07-21T22:13:40.093353+0000","last_became_peered":"2023-07-21T22:13:40.093353+0000","last_unstale":"2023-07-21T22:13:40.096763+0000","last_undegraded":"2023-07-21T22:13:40.096763+0000","last_fullsized":"2023-07-21T22:13:40.096763+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:35:49.579192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112511+0000","last_change":"2023-07-21T22:13:41.105050+0000","last_active":"2023-07-21T22:13:41.112511+0000","last_peered":"2023-07-21T22:13:41.112511+0000","last_clean":"2023-07-21T22:13:41.112511+0000","last_became_active":"2023-07-21T22:13:41.104758+0000","last_became_peered":"2023-07-21T22:13:41.104758+0000","last_unstale":"2023-07-21T22:13:41.112511+0000","last_undegraded":"2023-07-21T22:13:41.112511+0000","last_fullsized":"2023-07-21T22:13:41.112511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:59.926223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.088595+0000","last_change":"2023-07-21T22:13:40.097222+0000","last_active":"2023-07-21T22:13:41.088595+0000","last_peered":"2023-07-21T22:13:41.088595+0000","last_clean":"2023-07-21T22:13:41.088595+0000","last_became_active":"2023-07-21T22:13:40.096883+0000","last_became_peered":"2023-07-21T22:13:40.096883+0000","last_unstale":"2023-07-21T22:13:41.088595+0000","last_undegraded":"2023-07-21T22:13:41.088595+0000","last_fullsized":"2023-07-21T22:13:41.088595+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:43:58.145647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115833+0000","last_change":"2023-07-21T22:13:41.104606+0000","last_active":"2023-07-21T22:13:41.115833+0000","last_peered":"2023-07-21T22:13:41.115833+0000","last_clean":"2023-07-21T22:13:41.115833+0000","last_became_active":"2023-07-21T22:13:41.104358+0000","last_became_peered":"2023-07-21T22:13:41.104358+0000","last_unstale":"2023-07-21T22:13:41.115833+0000","last_undegraded":"2023-07-21T22:13:41.115833+0000","last_fullsized":"2023-07-21T22:13:41.115833+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:29:40.368592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078740+0000","last_change":"2023-07-21T22:13:40.097893+0000","last_active":"2023-07-21T22:13:41.078740+0000","last_peered":"2023-07-21T22:13:41.078740+0000","last_clean":"2023-07-21T22:13:41.078740+0000","last_became_active":"2023-07-21T22:13:40.097514+0000","last_became_peered":"2023-07-21T22:13:40.097514+0000","last_unstale":"2023-07-21T22:13:41.078740+0000","last_undegraded":"2023-07-21T22:13:41.078740+0000","last_fullsized":"2023-07-21T22:13:41.078740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:42:29.625435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.081200+0000","last_change":"2023-07-21T22:13:40.081200+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.081200+0000","last_undegraded":"2023-07-21T22:13:40.081200+0000","last_fullsized":"2023-07-21T22:13:40.081200+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078342+0000","last_change":"2023-07-21T22:13:40.092519+0000","last_active":"2023-07-21T22:13:41.078342+0000","last_peered":"2023-07-21T22:13:41.078342+0000","last_clean":"2023-07-21T22:13:41.078342+0000","last_became_active":"2023-07-21T22:13:40.092070+0000","last_became_peered":"2023-07-21T22:13:40.092070+0000","last_unstale":"2023-07-21T22:13:41.078342+0000","last_undegraded":"2023-07-21T22:13:41.078342+0000","last_fullsized":"2023-07-21T22:13:41.078342+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:57:23.225259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115146+0000","last_change":"2023-07-21T22:13:41.107176+0000","last_active":"2023-07-21T22:13:41.115146+0000","last_peered":"2023-07-21T22:13:41.115146+0000","last_clean":"2023-07-21T22:13:41.115146+0000","last_became_active":"2023-07-21T22:13:41.106910+0000","last_became_peered":"2023-07-21T22:13:41.106910+0000","last_unstale":"2023-07-21T22:13:41.115146+0000","last_undegraded":"2023-07-21T22:13:41.115146+0000","last_fullsized":"2023-07-21T22:13:41.115146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:23:43.440412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.101793+0000","last_change":"2023-07-21T22:13:40.096525+0000","last_active":"2023-07-21T22:13:40.101793+0000","last_peered":"2023-07-21T22:13:40.101793+0000","last_clean":"2023-07-21T22:13:40.101793+0000","last_became_active":"2023-07-21T22:13:40.096154+0000","last_became_peered":"2023-07-21T22:13:40.096154+0000","last_unstale":"2023-07-21T22:13:40.101793+0000","last_undegraded":"2023-07-21T22:13:40.101793+0000","last_fullsized":"2023-07-21T22:13:40.101793+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:37:09.117491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.100241+0000","last_change":"2023-07-21T22:13:41.097870+0000","last_active":"2023-07-21T22:13:41.100241+0000","last_peered":"2023-07-21T22:13:41.100241+0000","last_clean":"2023-07-21T22:13:41.100241+0000","last_became_active":"2023-07-21T22:13:41.097551+0000","last_became_peered":"2023-07-21T22:13:41.097551+0000","last_unstale":"2023-07-21T22:13:41.100241+0000","last_undegraded":"2023-07-21T22:13:41.100241+0000","last_fullsized":"2023-07-21T22:13:41.100241+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:06.859565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080550+0000","last_change":"2023-07-21T22:13:40.087863+0000","last_active":"2023-07-21T22:13:41.080550+0000","last_peered":"2023-07-21T22:13:41.080550+0000","last_clean":"2023-07-21T22:13:41.080550+0000","last_became_active":"2023-07-21T22:13:40.087564+0000","last_became_peered":"2023-07-21T22:13:40.087564+0000","last_unstale":"2023-07-21T22:13:41.080550+0000","last_undegraded":"2023-07-21T22:13:41.080550+0000","last_fullsized":"2023-07-21T22:13:41.080550+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:18:30.093515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.089156+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:13:41.089156+0000","last_peered":"2023-07-21T22:13:41.089156+0000","last_clean":"2023-07-21T22:13:41.089156+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:13:41.089156+0000","last_undegraded":"2023-07-21T22:13:41.089156+0000","last_fullsized":"2023-07-21T22:13:41.089156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:23.622141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115411+0000","last_change":"2023-07-21T22:13:41.098808+0000","last_active":"2023-07-21T22:13:41.115411+0000","last_peered":"2023-07-21T22:13:41.115411+0000","last_clean":"2023-07-21T22:13:41.115411+0000","last_became_active":"2023-07-21T22:13:41.097724+0000","last_became_peered":"2023-07-21T22:13:41.097724+0000","last_unstale":"2023-07-21T22:13:41.115411+0000","last_undegraded":"2023-07-21T22:13:41.115411+0000","last_fullsized":"2023-07-21T22:13:41.115411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:14.461183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118701+0000","last_change":"2023-07-21T22:13:40.098471+0000","last_active":"2023-07-21T22:13:41.118701+0000","last_peered":"2023-07-21T22:13:41.118701+0000","last_clean":"2023-07-21T22:13:41.118701+0000","last_became_active":"2023-07-21T22:13:40.098189+0000","last_became_peered":"2023-07-21T22:13:40.098189+0000","last_unstale":"2023-07-21T22:13:41.118701+0000","last_undegraded":"2023-07-21T22:13:41.118701+0000","last_fullsized":"2023-07-21T22:13:41.118701+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:08:17.401688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":82,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.088290+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:13:40.088290+0000","last_peered":"2023-07-21T22:13:40.088290+0000","last_clean":"2023-07-21T22:13:40.088290+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:13:40.088290+0000","last_undegraded":"2023-07-21T22:13:40.088290+0000","last_fullsized":"2023-07-21T22:13:40.088290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:04.506510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115773+0000","last_change":"2023-07-21T22:13:41.109484+0000","last_active":"2023-07-21T22:13:41.115773+0000","last_peered":"2023-07-21T22:13:41.115773+0000","last_clean":"2023-07-21T22:13:41.115773+0000","last_became_active":"2023-07-21T22:13:41.109190+0000","last_became_peered":"2023-07-21T22:13:41.109190+0000","last_unstale":"2023-07-21T22:13:41.115773+0000","last_undegraded":"2023-07-21T22:13:41.115773+0000","last_fullsized":"2023-07-21T22:13:41.115773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:22:22.225547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119598+0000","last_change":"2023-07-21T22:13:40.100805+0000","last_active":"2023-07-21T22:13:41.119598+0000","last_peered":"2023-07-21T22:13:41.119598+0000","last_clean":"2023-07-21T22:13:41.119598+0000","last_became_active":"2023-07-21T22:13:40.100494+0000","last_became_peered":"2023-07-21T22:13:40.100494+0000","last_unstale":"2023-07-21T22:13:41.119598+0000","last_undegraded":"2023-07-21T22:13:41.119598+0000","last_fullsized":"2023-07-21T22:13:41.119598+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:56.263731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.086487+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:13:41.086487+0000","last_peered":"2023-07-21T22:13:41.086487+0000","last_clean":"2023-07-21T22:13:41.086487+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:13:41.086487+0000","last_undegraded":"2023-07-21T22:13:41.086487+0000","last_fullsized":"2023-07-21T22:13:41.086487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:36.844419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.120524+0000","last_change":"2023-07-21T22:13:41.117194+0000","last_active":"2023-07-21T22:13:41.120524+0000","last_peered":"2023-07-21T22:13:41.120524+0000","last_clean":"2023-07-21T22:13:41.120524+0000","last_became_active":"2023-07-21T22:13:41.116856+0000","last_became_peered":"2023-07-21T22:13:41.116856+0000","last_unstale":"2023-07-21T22:13:41.120524+0000","last_undegraded":"2023-07-21T22:13:41.120524+0000","last_fullsized":"2023-07-21T22:13:41.120524+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:02:55.094217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119515+0000","last_change":"2023-07-21T22:13:40.096336+0000","last_active":"2023-07-21T22:13:41.119515+0000","last_peered":"2023-07-21T22:13:41.119515+0000","last_clean":"2023-07-21T22:13:41.119515+0000","last_became_active":"2023-07-21T22:13:40.095997+0000","last_became_peered":"2023-07-21T22:13:40.095997+0000","last_unstale":"2023-07-21T22:13:41.119515+0000","last_undegraded":"2023-07-21T22:13:41.119515+0000","last_fullsized":"2023-07-21T22:13:41.119515+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:40.777899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":82,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.088052+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:13:40.088052+0000","last_peered":"2023-07-21T22:13:40.088052+0000","last_clean":"2023-07-21T22:13:40.088052+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:13:40.088052+0000","last_undegraded":"2023-07-21T22:13:40.088052+0000","last_fullsized":"2023-07-21T22:13:40.088052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:04:29.247679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112435+0000","last_change":"2023-07-21T22:13:41.100147+0000","last_active":"2023-07-21T22:13:41.112435+0000","last_peered":"2023-07-21T22:13:41.112435+0000","last_clean":"2023-07-21T22:13:41.112435+0000","last_became_active":"2023-07-21T22:13:41.099829+0000","last_became_peered":"2023-07-21T22:13:41.099829+0000","last_unstale":"2023-07-21T22:13:41.112435+0000","last_undegraded":"2023-07-21T22:13:41.112435+0000","last_fullsized":"2023-07-21T22:13:41.112435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:24.800740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.083747+0000","last_change":"2023-07-21T22:13:40.097666+0000","last_active":"2023-07-21T22:13:41.083747+0000","last_peered":"2023-07-21T22:13:41.083747+0000","last_clean":"2023-07-21T22:13:41.083747+0000","last_became_active":"2023-07-21T22:13:40.097365+0000","last_became_peered":"2023-07-21T22:13:40.097365+0000","last_unstale":"2023-07-21T22:13:41.083747+0000","last_undegraded":"2023-07-21T22:13:41.083747+0000","last_fullsized":"2023-07-21T22:13:41.083747+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:07:41.346094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080851+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:13:41.080851+0000","last_peered":"2023-07-21T22:13:41.080851+0000","last_clean":"2023-07-21T22:13:41.080851+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:13:41.080851+0000","last_undegraded":"2023-07-21T22:13:41.080851+0000","last_fullsized":"2023-07-21T22:13:41.080851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:27.861284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107095+0000","last_change":"2023-07-21T22:13:41.095803+0000","last_active":"2023-07-21T22:13:41.107095+0000","last_peered":"2023-07-21T22:13:41.107095+0000","last_clean":"2023-07-21T22:13:41.107095+0000","last_became_active":"2023-07-21T22:13:41.095315+0000","last_became_peered":"2023-07-21T22:13:41.095315+0000","last_unstale":"2023-07-21T22:13:41.107095+0000","last_undegraded":"2023-07-21T22:13:41.107095+0000","last_fullsized":"2023-07-21T22:13:41.107095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:35.630446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080918+0000","last_change":"2023-07-21T22:13:40.094937+0000","last_active":"2023-07-21T22:13:41.080918+0000","last_peered":"2023-07-21T22:13:41.080918+0000","last_clean":"2023-07-21T22:13:41.080918+0000","last_became_active":"2023-07-21T22:13:40.094169+0000","last_became_peered":"2023-07-21T22:13:40.094169+0000","last_unstale":"2023-07-21T22:13:41.080918+0000","last_undegraded":"2023-07-21T22:13:41.080918+0000","last_fullsized":"2023-07-21T22:13:41.080918+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:18.368263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.089510+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:13:41.089510+0000","last_peered":"2023-07-21T22:13:41.089510+0000","last_clean":"2023-07-21T22:13:41.089510+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:13:41.089510+0000","last_undegraded":"2023-07-21T22:13:41.089510+0000","last_fullsized":"2023-07-21T22:13:41.089510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:47:45.851156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.111847+0000","last_change":"2023-07-21T22:13:41.106922+0000","last_active":"2023-07-21T22:13:41.111847+0000","last_peered":"2023-07-21T22:13:41.111847+0000","last_clean":"2023-07-21T22:13:41.111847+0000","last_became_active":"2023-07-21T22:13:41.106619+0000","last_became_peered":"2023-07-21T22:13:41.106619+0000","last_unstale":"2023-07-21T22:13:41.111847+0000","last_undegraded":"2023-07-21T22:13:41.111847+0000","last_fullsized":"2023-07-21T22:13:41.111847+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:17:31.116227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.123287+0000","last_change":"2023-07-21T22:13:40.093838+0000","last_active":"2023-07-21T22:13:41.123287+0000","last_peered":"2023-07-21T22:13:41.123287+0000","last_clean":"2023-07-21T22:13:41.123287+0000","last_became_active":"2023-07-21T22:13:40.093566+0000","last_became_peered":"2023-07-21T22:13:40.093566+0000","last_unstale":"2023-07-21T22:13:41.123287+0000","last_undegraded":"2023-07-21T22:13:41.123287+0000","last_fullsized":"2023-07-21T22:13:41.123287+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:58:32.061562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.090597+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:13:41.090597+0000","last_peered":"2023-07-21T22:13:41.090597+0000","last_clean":"2023-07-21T22:13:41.090597+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:13:41.090597+0000","last_undegraded":"2023-07-21T22:13:41.090597+0000","last_fullsized":"2023-07-21T22:13:41.090597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:49:32.843652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112504+0000","last_change":"2023-07-21T22:13:41.105123+0000","last_active":"2023-07-21T22:13:41.112504+0000","last_peered":"2023-07-21T22:13:41.112504+0000","last_clean":"2023-07-21T22:13:41.112504+0000","last_became_active":"2023-07-21T22:13:41.104852+0000","last_became_peered":"2023-07-21T22:13:41.104852+0000","last_unstale":"2023-07-21T22:13:41.112504+0000","last_undegraded":"2023-07-21T22:13:41.112504+0000","last_fullsized":"2023-07-21T22:13:41.112504+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:56.106383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078209+0000","last_change":"2023-07-21T22:13:40.091829+0000","last_active":"2023-07-21T22:13:41.078209+0000","last_peered":"2023-07-21T22:13:41.078209+0000","last_clean":"2023-07-21T22:13:41.078209+0000","last_became_active":"2023-07-21T22:13:40.091466+0000","last_became_peered":"2023-07-21T22:13:40.091466+0000","last_unstale":"2023-07-21T22:13:41.078209+0000","last_undegraded":"2023-07-21T22:13:41.078209+0000","last_fullsized":"2023-07-21T22:13:41.078209+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:32:36.155188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.079865+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:13:41.079865+0000","last_peered":"2023-07-21T22:13:41.079865+0000","last_clean":"2023-07-21T22:13:41.079865+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:13:41.079865+0000","last_undegraded":"2023-07-21T22:13:41.079865+0000","last_fullsized":"2023-07-21T22:13:41.079865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:47:37.024948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":236,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.090730+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:13:41.090730+0000","last_peered":"2023-07-21T22:13:41.090730+0000","last_clean":"2023-07-21T22:13:41.090730+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:13:41.090730+0000","last_undegraded":"2023-07-21T22:13:41.090730+0000","last_fullsized":"2023-07-21T22:13:41.090730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:20.076638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32352,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339488,"statfs":{"total":96636764160,"available":96603635712,"internally_reserved":0,"allocated":1335296,"data_stored":928031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.2270000000000001,"15min":1.2250000000000001},"min":{"1min":0.92800000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6439999999999999,"5min":2.218,"15min":2.218},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.278,"15min":1.3100000000000001},"min":{"1min":0.98899999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.478,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.3240000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.196,"15min":1.218},"min":{"1min":0.749,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4830000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2370000000000001,"15min":1.2729999999999999},"min":{"1min":0.81000000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.5249999999999999,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.121}]},{"osd":2,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.21,"15min":1.2250000000000001},"min":{"1min":0.89000000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.4139999999999999,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.2709999999999999,"15min":1.2989999999999999},"min":{"1min":0.80000000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5940000000000001,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.367}]},{"osd":3,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.278,"15min":1.2929999999999999},"min":{"1min":0.93700000000000006,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4910000000000001,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.3560000000000001,"15min":1.4159999999999999},"min":{"1min":0.88500000000000001,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5329999999999999,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.595}]},{"osd":4,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.2050000000000001,"15min":1.23},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4790000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.466},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.304,"15min":1.3340000000000001},"min":{"1min":0.84399999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5189999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.53}]},{"osd":5,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3480000000000001,"15min":1.3660000000000001},"min":{"1min":0.66300000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4810000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.9930000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.3280000000000001,"15min":1.3740000000000001},"min":{"1min":0.89800000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.496,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.623}]},{"osd":6,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.4490000000000001,"15min":1.4950000000000001},"min":{"1min":0.96099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.6160000000000001,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3999999999999999,"15min":1.423},"min":{"1min":1.038,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.667,"5min":2.476,"15min":2.476},"last":1.7370000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":724992,"data_stored":336887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.105,"15min":1.119},"min":{"1min":0.71599999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.52,"5min":1.657,"15min":1.657},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.1120000000000001,"15min":1.141},"min":{"1min":0.78100000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.282,"5min":2.802,"15min":2.802},"last":1.266}]},{"osd":1,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2070000000000001,"15min":1.2430000000000001},"min":{"1min":0.90500000000000003,"5min":0.747,"15min":0.747},"max":{"1min":1.571,"5min":1.839,"15min":1.839},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.212,"15min":1.25},"min":{"1min":0.754,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7070000000000001,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.548}]},{"osd":2,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2370000000000001,"15min":1.2689999999999999},"min":{"1min":0.93500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.718,"5min":2.911,"15min":2.911},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.2889999999999999,"15min":1.355},"min":{"1min":0.77200000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4870000000000001,"5min":2.379,"15min":2.379},"last":1.393}]},{"osd":3,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.373,"15min":1.425},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.554,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.01},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.3580000000000001,"15min":1.4059999999999999},"min":{"1min":0.83899999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.716,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":1.5980000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.28,"15min":1.28},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8919999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.472},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.335,"15min":1.381},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6140000000000001,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.3440000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3740000000000001,"15min":1.3959999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.7290000000000001,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.516},{"interface":"front","average":{"1min":1.385,"5min":1.4350000000000001,"15min":1.452},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9419999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.6419999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.421,"15min":1.4410000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9390000000000001,"5min":4.194,"15min":4.194},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.524,"15min":1.55},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.8220000000000001,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.5740000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509484,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":729088,"data_stored":336909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.079,"15min":1.0960000000000001},"min":{"1min":0.67300000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.472,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1279999999999999,"15min":1.1399999999999999},"min":{"1min":0.77100000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5329999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.1990000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1619999999999999,"15min":1.2},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.593,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.073,"5min":1.1599999999999999,"15min":1.1839999999999999},"min":{"1min":0.72099999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.51,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.278}]},{"osd":2,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1619999999999999,"15min":1.1659999999999999},"min":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.105},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.272,"15min":1.3049999999999999},"min":{"1min":0.76100000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.615,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.353}]},{"osd":3,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.2250000000000001,"15min":1.2490000000000001},"min":{"1min":0.68400000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.47,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.024},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.371,"15min":1.401},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.671,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.411}]},{"osd":4,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3049999999999999,"15min":1.3360000000000001},"min":{"1min":0.93500000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.5960000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2909999999999999,"15min":1.304},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.673,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.379}]},{"osd":6,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.256,"15min":1.2829999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.621,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":0.85299999999999998,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.655,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.3069999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2789999999999999,"15min":1.3029999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5449999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.155},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4870000000000001,"15min":1.5189999999999999},"min":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7150000000000001,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.321}]}]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":737280,"data_stored":338451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.105,"15min":1.101},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.4039999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.095},{"interface":"front","average":{"1min":1.127,"5min":1.151,"15min":1.171},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5269999999999999,"5min":1.617,"15min":1.617},"last":0.90400000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.216,"15min":1.232},"min":{"1min":0.60699999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7030000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.498},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1930000000000001,"15min":1.1950000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.6000000000000001,"5min":1.665,"15min":1.665},"last":0.79800000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.143,"15min":1.1399999999999999},"min":{"1min":0.89800000000000002,"5min":0.748,"15min":0.748},"max":{"1min":1.585,"5min":1.609,"15min":1.609},"last":1.018},{"interface":"front","average":{"1min":1.28,"5min":1.2789999999999999,"15min":1.3},"min":{"1min":0.96399999999999997,"5min":0.621,"15min":0.621},"max":{"1min":1.6479999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.252}]},{"osd":3,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.2669999999999999,"15min":1.3049999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.482,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.236,"15min":1.2330000000000001},"min":{"1min":1.0069999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.504,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.2989999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.264,"15min":1.3},"min":{"1min":0.86199999999999999,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7470000000000001,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.373},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.246,"15min":1.2370000000000001},"min":{"1min":0.751,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.756,"5min":1.794,"15min":1.794},"last":1.3340000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.198,"15min":1.2},"min":{"1min":0.91700000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5760000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.3959999999999999,"15min":1.4259999999999999},"min":{"1min":0.995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8380000000000001,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.575}]},{"osd":7,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.385,"15min":1.369},"min":{"1min":0.85999999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.831,"5min":1.887,"15min":1.887},"last":1.524},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4119999999999999,"15min":1.409},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.835,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.4239999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509482,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":712704,"data_stored":329439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92000000000000004,"15min":0.93100000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":1.484},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88700000000000001,"15min":0.90100000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.9830000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.90500000000000003,"15min":0.93899999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1879999999999999,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.081,"15min":1.129},"min":{"1min":0.56999999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.71,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.3}]},{"osd":2,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.69199999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.52},{"interface":"front","average":{"1min":0.999,"5min":1.0329999999999999,"15min":1.04},"min":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5109999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":2.613}]},{"osd":4,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.3240000000000001,"15min":1.3420000000000001},"min":{"1min":0.90800000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.73,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.359},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.29,"15min":1.3340000000000001},"min":{"1min":0.76500000000000001,"5min":0.751,"15min":0.751},"max":{"1min":1.52,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.9350000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3029999999999999,"15min":1.339},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.694,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4359999999999999,"15min":1.466},"min":{"1min":0.96799999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.677,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.4019999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.337,"15min":1.367},"min":{"1min":0.86499999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.75,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":2.0379999999999998},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4099999999999999,"15min":1.4490000000000001},"min":{"1min":0.92700000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.653,"5min":2.161,"15min":2.161},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.4590000000000001,"15min":1.5069999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.6639999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.5229999999999999,"15min":1.5580000000000001},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.8140000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.4419999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":712704,"data_stored":329439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.872,"15min":0.88},"min":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1950000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.022,"15min":1.032},"min":{"1min":0.69099999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5189999999999999,"5min":1.534,"15min":1.534},"last":7.0300000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.93899999999999995,"15min":0.95699999999999996},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.272,"5min":1.486,"15min":1.486},"last":2.2949999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0980000000000001,"15min":1.1180000000000001},"min":{"1min":0.75600000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.2869999999999999,"5min":1.958,"15min":1.958},"last":4.1239999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.123,"15min":1.1379999999999999},"min":{"1min":0.70199999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.4419999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":3.5070000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.1299999999999999,"15min":1.1559999999999999},"min":{"1min":0.73999999999999999,"5min":0.623,"15min":0.623},"max":{"1min":1.365,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":2.46}]},{"osd":4,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3979999999999999,"15min":1.4199999999999999},"min":{"1min":1.0960000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6060000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":2.1840000000000002},{"interface":"front","average":{"1min":1.329,"5min":1.4670000000000001,"15min":1.5069999999999999},"min":{"1min":1.0580000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.607,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":2.516}]},{"osd":5,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.4770000000000001,"15min":1.506},"min":{"1min":1.1259999999999999,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":1.6599999999999999,"5min":3.331,"15min":3.331},"last":2.0139999999999998},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.5129999999999999,"15min":1.5529999999999999},"min":{"1min":1.1100000000000001,"5min":1.085,"15min":1.085},"max":{"1min":1.7649999999999999,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":2.2360000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4379999999999999,"15min":1.458},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.663,"5min":2.633,"15min":2.633},"last":2.399},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.421,"15min":1.458},"min":{"1min":1.1319999999999999,"5min":0.878,"15min":0.878},"max":{"1min":1.615,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.6299999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4510000000000001,"15min":1.4810000000000001},"min":{"1min":1.0009999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.738,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":2.137},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.534,"15min":1.5640000000000001},"min":{"1min":1.1379999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.72,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":2.3450000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":919807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.876,"15min":0.88800000000000001},"min":{"1min":0.63200000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.94799999999999995,"15min":0.97399999999999998},"min":{"1min":0.63500000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.296}]},{"osd":2,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.95499999999999996,"15min":0.93899999999999995},"min":{"1min":0.68200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.242},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.032,"15min":1.026},"min":{"1min":0.77300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.1850000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.96199999999999997,"15min":0.94999999999999996},"min":{"1min":0.63900000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.179,"15min":1.175},"min":{"1min":0.82099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":1.3340000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.264,"15min":1.2609999999999999},"min":{"1min":0.90900000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":3.1779999999999999,"5min":3.1779999999999999,"15min":3.1779999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.3899999999999999,"15min":1.3919999999999999},"min":{"1min":1.1559999999999999,"5min":1,"15min":1},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.4610000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.429,"15min":1.4870000000000001},"min":{"1min":0.96999999999999997,"5min":0.872,"15min":0.872},"max":{"1min":2.1150000000000002,"5min":2.419,"15min":2.419},"last":1.5},{"interface":"front","average":{"1min":1.409,"5min":1.383,"15min":1.4039999999999999},"min":{"1min":0.96699999999999997,"5min":0.872,"15min":0.872},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4870000000000001,"15min":1.522},"min":{"1min":1.0680000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.46,"5min":1.4770000000000001,"15min":1.5189999999999999},"min":{"1min":1.0980000000000001,"5min":1.038,"15min":1.038},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.552}]},{"osd":7,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.49,"15min":1.5369999999999999},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.4489999999999998,"5min":2.504,"15min":2.504},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4610000000000001,"15min":1.5009999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.3779999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":700416,"data_stored":322499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.877,"15min":0.89300000000000002},"min":{"1min":0.51600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":1.2589999999999999,"5min":2.113,"15min":2.113},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.627,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5009999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.89900000000000002,"15min":0.90000000000000002},"min":{"1min":0.505,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1659999999999999,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.034,"5min":1.0840000000000001,"15min":1.1180000000000001},"min":{"1min":0.65700000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.601,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.101}]},{"osd":3,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.3100000000000001,"15min":1.3899999999999999},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7110000000000001,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.1879999999999999,"15min":1.2509999999999999},"min":{"1min":0.70399999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4370000000000001,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":0.89000000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2869999999999999,"15min":1.3120000000000001},"min":{"1min":0.96199999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.617,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.272,"15min":1.302},"min":{"1min":0.996,"5min":0.377,"15min":0.377},"max":{"1min":1.6719999999999999,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.181}]},{"osd":5,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.319,"15min":1.361},"min":{"1min":0.92400000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.7869999999999999,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.4339999999999999,"15min":1.484},"min":{"1min":1.0800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.958,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.1479999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3919999999999999,"15min":1.4279999999999999},"min":{"1min":0.94099999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6439999999999999,"5min":2.238,"15min":2.238},"last":1.482},{"interface":"front","average":{"1min":1.359,"5min":1.4159999999999999,"15min":1.444},"min":{"1min":1.111,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.887,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.3340000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5209999999999999,"15min":1.5549999999999999},"min":{"1min":0.997,"5min":0.624,"15min":0.624},"max":{"1min":1.909,"5min":4.391,"15min":4.391},"last":1.306},{"interface":"front","average":{"1min":1.413,"5min":1.4830000000000001,"15min":1.5169999999999999},"min":{"1min":1.155,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.746,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.385}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:13:45.463 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:13:45.589 INFO:tasks.ceph.mds.c.smithi049.stderr:2023-07-21T22:13:45.545+0000 7f0ab56e1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:13:45.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.637+0000 7f24acbf7700 1 Processor -- start 2023-07-21T22:13:45.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.637+0000 7f24acbf7700 1 -- start start 2023-07-21T22:13:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.641+0000 7f24acbf7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24a806d5d0 0x7f24a806d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.641+0000 7f24acbf7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f24a815d780 0x7f24a815dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.641+0000 7f24acbf7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a806dee0 con 0x7f24a8159f60 2023-07-21T22:13:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.641+0000 7f24acbf7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a80b0330 con 0x7f24a815d780 2023-07-21T22:13:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.641+0000 7f24acbf7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80b0600 con 0x7f24a806d5d0 2023-07-21T22:13:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.641+0000 7f24a6d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f24a815d780 0x7f24a815dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.641+0000 7f24a6d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f24a815d780 0x7f24a815dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54528/0 (socket says 172.21.15.49:54528) 2023-07-21T22:13:45.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.641+0000 7f24a6d9d700 1 -- 172.21.15.49:0/4219669690 learned_addr learned my addr 172.21.15.49:0/4219669690 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:45.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.641+0000 7f24a659c700 1 --2- 172.21.15.49:0/4219669690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24a806d5d0 0x7f24a806d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:45.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.641+0000 7f24a6d9d700 1 -- 172.21.15.49:0/4219669690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24a806d5d0 msgr2=0x7f24a806d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:45.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.641+0000 7f24a6d9d700 1 --2- 172.21.15.49:0/4219669690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24a806d5d0 0x7f24a806d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.641+0000 7f24a6d9d700 1 -- 172.21.15.49:0/4219669690 >> v1:172.21.15.150:6789/0 conn(0x7f24a8159f60 legacy=0x7f24a80afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:45.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.641+0000 7f24a6d9d700 1 -- 172.21.15.49:0/4219669690 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a815a470 con 0x7f24a815d780 2023-07-21T22:13:45.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.645+0000 7f24a6d9d700 1 --2- 172.21.15.49:0/4219669690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a815d780 0x7f24a815dbd0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009e50 tx=0x7f24a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44269e16f610c427 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.645+0000 7f24a559a700 1 -- 172.21.15.49:0/4219669690 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a000e070 con 0x7f24a815d780 2023-07-21T22:13:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.645+0000 7f24a559a700 1 -- 172.21.15.49:0/4219669690 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a000b910 con 0x7f24a815d780 2023-07-21T22:13:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.645+0000 7f24a559a700 1 -- 172.21.15.49:0/4219669690 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a000bcc0 con 0x7f24a815d780 2023-07-21T22:13:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.645+0000 7f24acbf7700 1 -- 172.21.15.49:0/4219669690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a815d780 msgr2=0x7f24a815dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.645+0000 7f24acbf7700 1 --2- 172.21.15.49:0/4219669690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a815d780 0x7f24a815dbd0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009e50 tx=0x7f24a000b330 comp rx=0 tx=0).stop 2023-07-21T22:13:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.645+0000 7f24acbf7700 1 -- 172.21.15.49:0/4219669690 shutdown_connections 2023-07-21T22:13:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.645+0000 7f24acbf7700 1 --2- 172.21.15.49:0/4219669690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a815d780 0x7f24a815dbd0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.645+0000 7f24acbf7700 1 --2- 172.21.15.49:0/4219669690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24a806d5d0 0x7f24a806d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.645+0000 7f24acbf7700 1 -- 172.21.15.49:0/4219669690 >> 172.21.15.49:0/4219669690 conn(0x7f24a806f5a0 msgr2=0x7f24a80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.645+0000 7f24acbf7700 1 -- 172.21.15.49:0/4219669690 shutdown_connections 2023-07-21T22:13:45.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.645+0000 7f24acbf7700 1 -- 172.21.15.49:0/4219669690 wait complete. 2023-07-21T22:13:45.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24acbf7700 1 Processor -- start 2023-07-21T22:13:45.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24acbf7700 1 -- start start 2023-07-21T22:13:45.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24acbf7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24a806d5d0 0x7f24a8151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:45.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24acbf7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a8159f60 0x7f24a81524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24acbf7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a815d780 0x7f24a814fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24acbf7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a81e4de0 con 0x7f24a815d780 2023-07-21T22:13:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24acbf7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a81e5270 con 0x7f24a8159f60 2023-07-21T22:13:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24acbf7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a81e41d0 con 0x7f24a806d5d0 2023-07-21T22:13:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24a6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a815d780 0x7f24a814fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24a6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a815d780 0x7f24a814fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54530/0 (socket says 172.21.15.49:54530) 2023-07-21T22:13:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24a6d9d700 1 -- 172.21.15.49:0/3011308982 learned_addr learned my addr 172.21.15.49:0/3011308982 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:45.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24a659c700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24a806d5d0 0x7f24a8151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:45.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24a5d9b700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a8159f60 0x7f24a81524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:45.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24a6d9d700 1 -- 172.21.15.49:0/3011308982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24a806d5d0 msgr2=0x7f24a8151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:45.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24a6d9d700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24a806d5d0 0x7f24a8151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24a6d9d700 1 -- 172.21.15.49:0/3011308982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a8159f60 msgr2=0x7f24a81524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:45.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24a6d9d700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a8159f60 0x7f24a81524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24a6d9d700 1 -- 172.21.15.49:0/3011308982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a0009b30 con 0x7f24a815d780 2023-07-21T22:13:45.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24a659c700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24a806d5d0 0x7f24a8151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:45.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24a5d9b700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a8159f60 0x7f24a81524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:45.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24a6d9d700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a815d780 0x7f24a814fb70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f24a8066cd0 tx=0x7f24a0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:45.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f2496ffd700 1 -- 172.21.15.49:0/3011308982 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0004960 con 0x7f24a815d780 2023-07-21T22:13:45.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f2496ffd700 1 -- 172.21.15.49:0/3011308982 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a00099b0 con 0x7f24a815d780 2023-07-21T22:13:45.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f24acbf7700 1 -- 172.21.15.49:0/3011308982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a81e44b0 con 0x7f24a815d780 2023-07-21T22:13:45.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.649+0000 7f2496ffd700 1 -- 172.21.15.49:0/3011308982 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a001c650 con 0x7f24a815d780 2023-07-21T22:13:45.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.653+0000 7f24acbf7700 1 -- 172.21.15.49:0/3011308982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a81e4a70 con 0x7f24a815d780 2023-07-21T22:13:45.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.653+0000 7f24acbf7700 1 -- 172.21.15.49:0/3011308982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a8073130 con 0x7f24a815d780 2023-07-21T22:13:45.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.653+0000 7f2496ffd700 1 -- 172.21.15.49:0/3011308982 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f24a001c7b0 con 0x7f24a815d780 2023-07-21T22:13:45.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.657+0000 7f2496ffd700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f24880662f0 0x7f24880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:45.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.657+0000 7f2496ffd700 1 -- 172.21.15.49:0/3011308982 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f24a0085be0 con 0x7f24a815d780 2023-07-21T22:13:45.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.657+0000 7f24a659c700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f24880662f0 0x7f24880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:45.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.657+0000 7f24a659c700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f24880662f0 0x7f24880687a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2498009ad0 tx=0x7f2498008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.661+0000 7f2496ffd700 1 -- 172.21.15.49:0/3011308982 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f24a0052e90 con 0x7f24a815d780 2023-07-21T22:13:45.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.833+0000 7f24acbf7700 1 -- 172.21.15.49:0/3011308982 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24a815aa30 con 0x7f24880662f0 2023-07-21T22:13:45.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.849+0000 7f2496ffd700 1 -- 172.21.15.49:0/3011308982 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308228 (secure 0 0 0) 0x7f24980106e0 con 0x7f24880662f0 2023-07-21T22:13:45.899 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:45.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.857+0000 7f24acbf7700 1 -- 172.21.15.49:0/3011308982 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f24880662f0 msgr2=0x7f24880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:45.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.857+0000 7f24acbf7700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f24880662f0 0x7f24880687a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2498009ad0 tx=0x7f2498008040 comp rx=0 tx=0).stop 2023-07-21T22:13:45.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.857+0000 7f24acbf7700 1 -- 172.21.15.49:0/3011308982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a815d780 msgr2=0x7f24a814fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:45.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.857+0000 7f24acbf7700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a815d780 0x7f24a814fb70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f24a8066cd0 tx=0x7f24a0004af0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.857+0000 7f24acbf7700 1 -- 172.21.15.49:0/3011308982 shutdown_connections 2023-07-21T22:13:45.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.857+0000 7f24acbf7700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f24880662f0 0x7f24880687a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.857+0000 7f24acbf7700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a815d780 0x7f24a814fb70 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.857+0000 7f24acbf7700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a8159f60 0x7f24a81524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.857+0000 7f24acbf7700 1 --2- 172.21.15.49:0/3011308982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24a806d5d0 0x7f24a8151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:45.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.857+0000 7f24acbf7700 1 -- 172.21.15.49:0/3011308982 >> 172.21.15.49:0/3011308982 conn(0x7f24a806f5a0 msgr2=0x7f24a81548e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:45.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.857+0000 7f24acbf7700 1 -- 172.21.15.49:0/3011308982 shutdown_connections 2023-07-21T22:13:45.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:45.857+0000 7f24acbf7700 1 -- 172.21.15.49:0/3011308982 wait complete. 2023-07-21T22:13:45.904 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:13:45.925 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2023-07-21T22:13:44.372743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":193,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246988,"kb_used_data":6796,"kb_used_omap":0,"kb_used_meta":240128,"kb_avail":754727732,"statfs":{"total":773094113280,"available":772841197568,"internally_reserved":0,"allocated":6959104,"data_stored":3841462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":245891072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.305549"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.085505+0000","last_change":"2023-07-21T22:13:40.085505+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.085505+0000","last_undegraded":"2023-07-21T22:13:40.085505+0000","last_fullsized":"2023-07-21T22:13:40.085505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.084869+0000","last_change":"2023-07-21T22:13:40.084869+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.084869+0000","last_undegraded":"2023-07-21T22:13:40.084869+0000","last_fullsized":"2023-07-21T22:13:40.084869+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114631+0000","last_change":"2023-07-21T22:13:41.102406+0000","last_active":"2023-07-21T22:13:41.114631+0000","last_peered":"2023-07-21T22:13:41.114631+0000","last_clean":"2023-07-21T22:13:41.114631+0000","last_became_active":"2023-07-21T22:13:41.102137+0000","last_became_peered":"2023-07-21T22:13:41.102137+0000","last_unstale":"2023-07-21T22:13:41.114631+0000","last_undegraded":"2023-07-21T22:13:41.114631+0000","last_fullsized":"2023-07-21T22:13:41.114631+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:35.630446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.109032+0000","last_change":"2023-07-21T22:13:41.093070+0000","last_active":"2023-07-21T22:13:41.109032+0000","last_peered":"2023-07-21T22:13:41.109032+0000","last_clean":"2023-07-21T22:13:41.109032+0000","last_became_active":"2023-07-21T22:13:41.092734+0000","last_became_peered":"2023-07-21T22:13:41.092734+0000","last_unstale":"2023-07-21T22:13:41.109032+0000","last_undegraded":"2023-07-21T22:13:41.109032+0000","last_fullsized":"2023-07-21T22:13:41.109032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:29:54.037991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115829+0000","last_change":"2023-07-21T22:13:41.108849+0000","last_active":"2023-07-21T22:13:41.115829+0000","last_peered":"2023-07-21T22:13:41.115829+0000","last_clean":"2023-07-21T22:13:41.115829+0000","last_became_active":"2023-07-21T22:13:41.108566+0000","last_became_peered":"2023-07-21T22:13:41.108566+0000","last_unstale":"2023-07-21T22:13:41.115829+0000","last_undegraded":"2023-07-21T22:13:41.115829+0000","last_fullsized":"2023-07-21T22:13:41.115829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:18:05.133741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114892+0000","last_change":"2023-07-21T22:13:41.111253+0000","last_active":"2023-07-21T22:13:41.114892+0000","last_peered":"2023-07-21T22:13:41.114892+0000","last_clean":"2023-07-21T22:13:41.114892+0000","last_became_active":"2023-07-21T22:13:41.110498+0000","last_became_peered":"2023-07-21T22:13:41.110498+0000","last_unstale":"2023-07-21T22:13:41.114892+0000","last_undegraded":"2023-07-21T22:13:41.114892+0000","last_fullsized":"2023-07-21T22:13:41.114892+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:52:07.339883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115154+0000","last_change":"2023-07-21T22:13:41.105865+0000","last_active":"2023-07-21T22:13:41.115154+0000","last_peered":"2023-07-21T22:13:41.115154+0000","last_clean":"2023-07-21T22:13:41.115154+0000","last_became_active":"2023-07-21T22:13:41.105567+0000","last_became_peered":"2023-07-21T22:13:41.105567+0000","last_unstale":"2023-07-21T22:13:41.115154+0000","last_undegraded":"2023-07-21T22:13:41.115154+0000","last_fullsized":"2023-07-21T22:13:41.115154+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:44:28.582096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108876+0000","last_change":"2023-07-21T22:13:41.102968+0000","last_active":"2023-07-21T22:13:41.108876+0000","last_peered":"2023-07-21T22:13:41.108876+0000","last_clean":"2023-07-21T22:13:41.108876+0000","last_became_active":"2023-07-21T22:13:41.102713+0000","last_became_peered":"2023-07-21T22:13:41.102713+0000","last_unstale":"2023-07-21T22:13:41.108876+0000","last_undegraded":"2023-07-21T22:13:41.108876+0000","last_fullsized":"2023-07-21T22:13:41.108876+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:37.212909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118275+0000","last_change":"2023-07-21T22:13:41.108597+0000","last_active":"2023-07-21T22:13:41.118275+0000","last_peered":"2023-07-21T22:13:41.118275+0000","last_clean":"2023-07-21T22:13:41.118275+0000","last_became_active":"2023-07-21T22:13:41.108348+0000","last_became_peered":"2023-07-21T22:13:41.108348+0000","last_unstale":"2023-07-21T22:13:41.118275+0000","last_undegraded":"2023-07-21T22:13:41.118275+0000","last_fullsized":"2023-07-21T22:13:41.118275+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:34.485489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115770+0000","last_change":"2023-07-21T22:13:41.104555+0000","last_active":"2023-07-21T22:13:41.115770+0000","last_peered":"2023-07-21T22:13:41.115770+0000","last_clean":"2023-07-21T22:13:41.115770+0000","last_became_active":"2023-07-21T22:13:41.104299+0000","last_became_peered":"2023-07-21T22:13:41.104299+0000","last_unstale":"2023-07-21T22:13:41.115770+0000","last_undegraded":"2023-07-21T22:13:41.115770+0000","last_fullsized":"2023-07-21T22:13:41.115770+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:15:37.915301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115753+0000","last_change":"2023-07-21T22:13:41.103712+0000","last_active":"2023-07-21T22:13:41.115753+0000","last_peered":"2023-07-21T22:13:41.115753+0000","last_clean":"2023-07-21T22:13:41.115753+0000","last_became_active":"2023-07-21T22:13:41.103431+0000","last_became_peered":"2023-07-21T22:13:41.103431+0000","last_unstale":"2023-07-21T22:13:41.115753+0000","last_undegraded":"2023-07-21T22:13:41.115753+0000","last_fullsized":"2023-07-21T22:13:41.115753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:39.364718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108913+0000","last_change":"2023-07-21T22:13:41.104207+0000","last_active":"2023-07-21T22:13:41.108913+0000","last_peered":"2023-07-21T22:13:41.108913+0000","last_clean":"2023-07-21T22:13:41.108913+0000","last_became_active":"2023-07-21T22:13:41.103922+0000","last_became_peered":"2023-07-21T22:13:41.103922+0000","last_unstale":"2023-07-21T22:13:41.108913+0000","last_undegraded":"2023-07-21T22:13:41.108913+0000","last_fullsized":"2023-07-21T22:13:41.108913+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:57.274636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108822+0000","last_change":"2023-07-21T22:13:41.097039+0000","last_active":"2023-07-21T22:13:41.108822+0000","last_peered":"2023-07-21T22:13:41.108822+0000","last_clean":"2023-07-21T22:13:41.108822+0000","last_became_active":"2023-07-21T22:13:41.096761+0000","last_became_peered":"2023-07-21T22:13:41.096761+0000","last_unstale":"2023-07-21T22:13:41.108822+0000","last_undegraded":"2023-07-21T22:13:41.108822+0000","last_fullsized":"2023-07-21T22:13:41.108822+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:15:37.915301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114332+0000","last_change":"2023-07-21T22:13:41.101818+0000","last_active":"2023-07-21T22:13:41.114332+0000","last_peered":"2023-07-21T22:13:41.114332+0000","last_clean":"2023-07-21T22:13:41.114332+0000","last_became_active":"2023-07-21T22:13:41.101516+0000","last_became_peered":"2023-07-21T22:13:41.101516+0000","last_unstale":"2023-07-21T22:13:41.114332+0000","last_undegraded":"2023-07-21T22:13:41.114332+0000","last_fullsized":"2023-07-21T22:13:41.114332+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:01.251820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115313+0000","last_change":"2023-07-21T22:13:41.103892+0000","last_active":"2023-07-21T22:13:41.115313+0000","last_peered":"2023-07-21T22:13:41.115313+0000","last_clean":"2023-07-21T22:13:41.115313+0000","last_became_active":"2023-07-21T22:13:41.103587+0000","last_became_peered":"2023-07-21T22:13:41.103587+0000","last_unstale":"2023-07-21T22:13:41.115313+0000","last_undegraded":"2023-07-21T22:13:41.115313+0000","last_fullsized":"2023-07-21T22:13:41.115313+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:08:19.007621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115207+0000","last_change":"2023-07-21T22:13:41.106608+0000","last_active":"2023-07-21T22:13:41.115207+0000","last_peered":"2023-07-21T22:13:41.115207+0000","last_clean":"2023-07-21T22:13:41.115207+0000","last_became_active":"2023-07-21T22:13:41.106100+0000","last_became_peered":"2023-07-21T22:13:41.106100+0000","last_unstale":"2023-07-21T22:13:41.115207+0000","last_undegraded":"2023-07-21T22:13:41.115207+0000","last_fullsized":"2023-07-21T22:13:41.115207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:14.077369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.082600+0000","last_change":"2023-07-21T22:13:40.082600+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.082600+0000","last_undegraded":"2023-07-21T22:13:40.082600+0000","last_fullsized":"2023-07-21T22:13:40.082600+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115386+0000","last_change":"2023-07-21T22:13:41.098779+0000","last_active":"2023-07-21T22:13:41.115386+0000","last_peered":"2023-07-21T22:13:41.115386+0000","last_clean":"2023-07-21T22:13:41.115386+0000","last_became_active":"2023-07-21T22:13:41.097678+0000","last_became_peered":"2023-07-21T22:13:41.097678+0000","last_unstale":"2023-07-21T22:13:41.115386+0000","last_undegraded":"2023-07-21T22:13:41.115386+0000","last_fullsized":"2023-07-21T22:13:41.115386+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:39.921791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115791+0000","last_change":"2023-07-21T22:13:41.110504+0000","last_active":"2023-07-21T22:13:41.115791+0000","last_peered":"2023-07-21T22:13:41.115791+0000","last_clean":"2023-07-21T22:13:41.115791+0000","last_became_active":"2023-07-21T22:13:41.110211+0000","last_became_peered":"2023-07-21T22:13:41.110211+0000","last_unstale":"2023-07-21T22:13:41.115791+0000","last_undegraded":"2023-07-21T22:13:41.115791+0000","last_fullsized":"2023-07-21T22:13:41.115791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:29:05.960444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.100716+0000","last_change":"2023-07-21T22:13:41.097911+0000","last_active":"2023-07-21T22:13:41.100716+0000","last_peered":"2023-07-21T22:13:41.100716+0000","last_clean":"2023-07-21T22:13:41.100716+0000","last_became_active":"2023-07-21T22:13:41.097604+0000","last_became_peered":"2023-07-21T22:13:41.097604+0000","last_unstale":"2023-07-21T22:13:41.100716+0000","last_undegraded":"2023-07-21T22:13:41.100716+0000","last_fullsized":"2023-07-21T22:13:41.100716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:34.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108802+0000","last_change":"2023-07-21T22:13:41.096467+0000","last_active":"2023-07-21T22:13:41.108802+0000","last_peered":"2023-07-21T22:13:41.108802+0000","last_clean":"2023-07-21T22:13:41.108802+0000","last_became_active":"2023-07-21T22:13:41.093898+0000","last_became_peered":"2023-07-21T22:13:41.093898+0000","last_unstale":"2023-07-21T22:13:41.108802+0000","last_undegraded":"2023-07-21T22:13:41.108802+0000","last_fullsized":"2023-07-21T22:13:41.108802+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:18:48.827452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108350+0000","last_change":"2023-07-21T22:13:41.104555+0000","last_active":"2023-07-21T22:13:41.108350+0000","last_peered":"2023-07-21T22:13:41.108350+0000","last_clean":"2023-07-21T22:13:41.108350+0000","last_became_active":"2023-07-21T22:13:41.104275+0000","last_became_peered":"2023-07-21T22:13:41.104275+0000","last_unstale":"2023-07-21T22:13:41.108350+0000","last_undegraded":"2023-07-21T22:13:41.108350+0000","last_fullsized":"2023-07-21T22:13:41.108350+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:52:50.466773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.109527+0000","last_change":"2023-07-21T22:13:41.103964+0000","last_active":"2023-07-21T22:13:41.109527+0000","last_peered":"2023-07-21T22:13:41.109527+0000","last_clean":"2023-07-21T22:13:41.109527+0000","last_became_active":"2023-07-21T22:13:41.103680+0000","last_became_peered":"2023-07-21T22:13:41.103680+0000","last_unstale":"2023-07-21T22:13:41.109527+0000","last_undegraded":"2023-07-21T22:13:41.109527+0000","last_fullsized":"2023-07-21T22:13:41.109527+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:39.370150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114357+0000","last_change":"2023-07-21T22:13:41.102028+0000","last_active":"2023-07-21T22:13:41.114357+0000","last_peered":"2023-07-21T22:13:41.114357+0000","last_clean":"2023-07-21T22:13:41.114357+0000","last_became_active":"2023-07-21T22:13:41.101730+0000","last_became_peered":"2023-07-21T22:13:41.101730+0000","last_unstale":"2023-07-21T22:13:41.114357+0000","last_undegraded":"2023-07-21T22:13:41.114357+0000","last_fullsized":"2023-07-21T22:13:41.114357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:39.844317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.106848+0000","last_change":"2023-07-21T22:13:41.096075+0000","last_active":"2023-07-21T22:13:41.106848+0000","last_peered":"2023-07-21T22:13:41.106848+0000","last_clean":"2023-07-21T22:13:41.106848+0000","last_became_active":"2023-07-21T22:13:41.093481+0000","last_became_peered":"2023-07-21T22:13:41.093481+0000","last_unstale":"2023-07-21T22:13:41.106848+0000","last_undegraded":"2023-07-21T22:13:41.106848+0000","last_fullsized":"2023-07-21T22:13:41.106848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:44.826686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108850+0000","last_change":"2023-07-21T22:13:41.098370+0000","last_active":"2023-07-21T22:13:41.108850+0000","last_peered":"2023-07-21T22:13:41.108850+0000","last_clean":"2023-07-21T22:13:41.108850+0000","last_became_active":"2023-07-21T22:13:41.098102+0000","last_became_peered":"2023-07-21T22:13:41.098102+0000","last_unstale":"2023-07-21T22:13:41.108850+0000","last_undegraded":"2023-07-21T22:13:41.108850+0000","last_fullsized":"2023-07-21T22:13:41.108850+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:34.485489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.113081+0000","last_change":"2023-07-21T22:13:41.097502+0000","last_active":"2023-07-21T22:13:41.113081+0000","last_peered":"2023-07-21T22:13:41.113081+0000","last_clean":"2023-07-21T22:13:41.113081+0000","last_became_active":"2023-07-21T22:13:41.097033+0000","last_became_peered":"2023-07-21T22:13:41.097033+0000","last_unstale":"2023-07-21T22:13:41.113081+0000","last_undegraded":"2023-07-21T22:13:41.113081+0000","last_fullsized":"2023-07-21T22:13:41.113081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:37.732164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.084808+0000","last_change":"2023-07-21T22:13:40.084808+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.084808+0000","last_undegraded":"2023-07-21T22:13:40.084808+0000","last_fullsized":"2023-07-21T22:13:40.084808+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114482+0000","last_change":"2023-07-21T22:13:41.102785+0000","last_active":"2023-07-21T22:13:41.114482+0000","last_peered":"2023-07-21T22:13:41.114482+0000","last_clean":"2023-07-21T22:13:41.114482+0000","last_became_active":"2023-07-21T22:13:41.102481+0000","last_became_peered":"2023-07-21T22:13:41.102481+0000","last_unstale":"2023-07-21T22:13:41.114482+0000","last_undegraded":"2023-07-21T22:13:41.114482+0000","last_fullsized":"2023-07-21T22:13:41.114482+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:19.379168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108932+0000","last_change":"2023-07-21T22:13:41.101943+0000","last_active":"2023-07-21T22:13:41.108932+0000","last_peered":"2023-07-21T22:13:41.108932+0000","last_clean":"2023-07-21T22:13:41.108932+0000","last_became_active":"2023-07-21T22:13:41.101635+0000","last_became_peered":"2023-07-21T22:13:41.101635+0000","last_unstale":"2023-07-21T22:13:41.108932+0000","last_undegraded":"2023-07-21T22:13:41.108932+0000","last_fullsized":"2023-07-21T22:13:41.108932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:01:51.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115272+0000","last_change":"2023-07-21T22:13:41.096068+0000","last_active":"2023-07-21T22:13:41.115272+0000","last_peered":"2023-07-21T22:13:41.115272+0000","last_clean":"2023-07-21T22:13:41.115272+0000","last_became_active":"2023-07-21T22:13:41.095783+0000","last_became_peered":"2023-07-21T22:13:41.095783+0000","last_unstale":"2023-07-21T22:13:41.115272+0000","last_undegraded":"2023-07-21T22:13:41.115272+0000","last_fullsized":"2023-07-21T22:13:41.115272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:51:09.826591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114831+0000","last_change":"2023-07-21T22:13:41.110068+0000","last_active":"2023-07-21T22:13:41.114831+0000","last_peered":"2023-07-21T22:13:41.114831+0000","last_clean":"2023-07-21T22:13:41.114831+0000","last_became_active":"2023-07-21T22:13:41.109762+0000","last_became_peered":"2023-07-21T22:13:41.109762+0000","last_unstale":"2023-07-21T22:13:41.114831+0000","last_undegraded":"2023-07-21T22:13:41.114831+0000","last_fullsized":"2023-07-21T22:13:41.114831+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:44:09.003020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112528+0000","last_change":"2023-07-21T22:13:41.107081+0000","last_active":"2023-07-21T22:13:41.112528+0000","last_peered":"2023-07-21T22:13:41.112528+0000","last_clean":"2023-07-21T22:13:41.112528+0000","last_became_active":"2023-07-21T22:13:41.106787+0000","last_became_peered":"2023-07-21T22:13:41.106787+0000","last_unstale":"2023-07-21T22:13:41.112528+0000","last_undegraded":"2023-07-21T22:13:41.112528+0000","last_fullsized":"2023-07-21T22:13:41.112528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:34:48.139648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.102949+0000","last_change":"2023-07-21T22:13:40.101387+0000","last_active":"2023-07-21T22:13:40.102949+0000","last_peered":"2023-07-21T22:13:40.102949+0000","last_clean":"2023-07-21T22:13:40.102949+0000","last_became_active":"2023-07-21T22:13:40.100913+0000","last_became_peered":"2023-07-21T22:13:40.100913+0000","last_unstale":"2023-07-21T22:13:40.102949+0000","last_undegraded":"2023-07-21T22:13:40.102949+0000","last_fullsized":"2023-07-21T22:13:40.102949+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:58:58.055258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112989+0000","last_change":"2023-07-21T22:13:41.096891+0000","last_active":"2023-07-21T22:13:41.112989+0000","last_peered":"2023-07-21T22:13:41.112989+0000","last_clean":"2023-07-21T22:13:41.112989+0000","last_became_active":"2023-07-21T22:13:41.095295+0000","last_became_peered":"2023-07-21T22:13:41.095295+0000","last_unstale":"2023-07-21T22:13:41.112989+0000","last_undegraded":"2023-07-21T22:13:41.112989+0000","last_fullsized":"2023-07-21T22:13:41.112989+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:14.952691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.121232+0000","last_change":"2023-07-21T22:13:40.094443+0000","last_active":"2023-07-21T22:13:41.121232+0000","last_peered":"2023-07-21T22:13:41.121232+0000","last_clean":"2023-07-21T22:13:41.121232+0000","last_became_active":"2023-07-21T22:13:40.094114+0000","last_became_peered":"2023-07-21T22:13:40.094114+0000","last_unstale":"2023-07-21T22:13:41.121232+0000","last_undegraded":"2023-07-21T22:13:41.121232+0000","last_fullsized":"2023-07-21T22:13:41.121232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:28.818934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.101929+0000","last_change":"2023-07-21T22:13:41.097322+0000","last_active":"2023-07-21T22:13:41.101929+0000","last_peered":"2023-07-21T22:13:41.101929+0000","last_clean":"2023-07-21T22:13:41.101929+0000","last_became_active":"2023-07-21T22:13:41.097054+0000","last_became_peered":"2023-07-21T22:13:41.097054+0000","last_unstale":"2023-07-21T22:13:41.101929+0000","last_undegraded":"2023-07-21T22:13:41.101929+0000","last_fullsized":"2023-07-21T22:13:41.101929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:24.106186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.122724+0000","last_change":"2023-07-21T22:13:40.087761+0000","last_active":"2023-07-21T22:13:41.122724+0000","last_peered":"2023-07-21T22:13:41.122724+0000","last_clean":"2023-07-21T22:13:41.122724+0000","last_became_active":"2023-07-21T22:13:40.087468+0000","last_became_peered":"2023-07-21T22:13:40.087468+0000","last_unstale":"2023-07-21T22:13:41.122724+0000","last_undegraded":"2023-07-21T22:13:41.122724+0000","last_fullsized":"2023-07-21T22:13:41.122724+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:53.822832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115750+0000","last_change":"2023-07-21T22:13:41.104006+0000","last_active":"2023-07-21T22:13:41.115750+0000","last_peered":"2023-07-21T22:13:41.115750+0000","last_clean":"2023-07-21T22:13:41.115750+0000","last_became_active":"2023-07-21T22:13:41.103736+0000","last_became_peered":"2023-07-21T22:13:41.103736+0000","last_unstale":"2023-07-21T22:13:41.115750+0000","last_undegraded":"2023-07-21T22:13:41.115750+0000","last_fullsized":"2023-07-21T22:13:41.115750+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:01:51.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.121997+0000","last_change":"2023-07-21T22:13:40.096070+0000","last_active":"2023-07-21T22:13:41.121997+0000","last_peered":"2023-07-21T22:13:41.121997+0000","last_clean":"2023-07-21T22:13:41.121997+0000","last_became_active":"2023-07-21T22:13:40.095788+0000","last_became_peered":"2023-07-21T22:13:40.095788+0000","last_unstale":"2023-07-21T22:13:41.121997+0000","last_undegraded":"2023-07-21T22:13:41.121997+0000","last_fullsized":"2023-07-21T22:13:41.121997+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:44:32.650671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115187+0000","last_change":"2023-07-21T22:13:41.106371+0000","last_active":"2023-07-21T22:13:41.115187+0000","last_peered":"2023-07-21T22:13:41.115187+0000","last_clean":"2023-07-21T22:13:41.115187+0000","last_became_active":"2023-07-21T22:13:41.105701+0000","last_became_peered":"2023-07-21T22:13:41.105701+0000","last_unstale":"2023-07-21T22:13:41.115187+0000","last_undegraded":"2023-07-21T22:13:41.115187+0000","last_fullsized":"2023-07-21T22:13:41.115187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:34:03.908679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119232+0000","last_change":"2023-07-21T22:13:40.091865+0000","last_active":"2023-07-21T22:13:41.119232+0000","last_peered":"2023-07-21T22:13:41.119232+0000","last_clean":"2023-07-21T22:13:41.119232+0000","last_became_active":"2023-07-21T22:13:40.091563+0000","last_became_peered":"2023-07-21T22:13:40.091563+0000","last_unstale":"2023-07-21T22:13:41.119232+0000","last_undegraded":"2023-07-21T22:13:41.119232+0000","last_fullsized":"2023-07-21T22:13:41.119232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:07.095120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.080876+0000","last_change":"2023-07-21T22:13:40.080876+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.080876+0000","last_undegraded":"2023-07-21T22:13:40.080876+0000","last_fullsized":"2023-07-21T22:13:40.080876+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118983+0000","last_change":"2023-07-21T22:13:40.088623+0000","last_active":"2023-07-21T22:13:41.118983+0000","last_peered":"2023-07-21T22:13:41.118983+0000","last_clean":"2023-07-21T22:13:41.118983+0000","last_became_active":"2023-07-21T22:13:40.088019+0000","last_became_peered":"2023-07-21T22:13:40.088019+0000","last_unstale":"2023-07-21T22:13:41.118983+0000","last_undegraded":"2023-07-21T22:13:41.118983+0000","last_fullsized":"2023-07-21T22:13:41.118983+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:11:27.016587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112409+0000","last_change":"2023-07-21T22:13:41.100003+0000","last_active":"2023-07-21T22:13:41.112409+0000","last_peered":"2023-07-21T22:13:41.112409+0000","last_clean":"2023-07-21T22:13:41.112409+0000","last_became_active":"2023-07-21T22:13:41.099703+0000","last_became_peered":"2023-07-21T22:13:41.099703+0000","last_unstale":"2023-07-21T22:13:41.112409+0000","last_undegraded":"2023-07-21T22:13:41.112409+0000","last_fullsized":"2023-07-21T22:13:41.112409+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:12:26.575731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078570+0000","last_change":"2023-07-21T22:13:40.092332+0000","last_active":"2023-07-21T22:13:41.078570+0000","last_peered":"2023-07-21T22:13:41.078570+0000","last_clean":"2023-07-21T22:13:41.078570+0000","last_became_active":"2023-07-21T22:13:40.091709+0000","last_became_peered":"2023-07-21T22:13:40.091709+0000","last_unstale":"2023-07-21T22:13:41.078570+0000","last_undegraded":"2023-07-21T22:13:41.078570+0000","last_fullsized":"2023-07-21T22:13:41.078570+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:00.067789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.100801+0000","last_change":"2023-07-21T22:13:41.096538+0000","last_active":"2023-07-21T22:13:41.100801+0000","last_peered":"2023-07-21T22:13:41.100801+0000","last_clean":"2023-07-21T22:13:41.100801+0000","last_became_active":"2023-07-21T22:13:41.096233+0000","last_became_peered":"2023-07-21T22:13:41.096233+0000","last_unstale":"2023-07-21T22:13:41.100801+0000","last_undegraded":"2023-07-21T22:13:41.100801+0000","last_fullsized":"2023-07-21T22:13:41.100801+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:55:28.232508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.088154+0000","last_change":"2023-07-21T22:13:40.099452+0000","last_active":"2023-07-21T22:13:41.088154+0000","last_peered":"2023-07-21T22:13:41.088154+0000","last_clean":"2023-07-21T22:13:41.088154+0000","last_became_active":"2023-07-21T22:13:40.099144+0000","last_became_peered":"2023-07-21T22:13:40.099144+0000","last_unstale":"2023-07-21T22:13:41.088154+0000","last_undegraded":"2023-07-21T22:13:41.088154+0000","last_fullsized":"2023-07-21T22:13:41.088154+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:51:43.066212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.084347+0000","last_change":"2023-07-21T22:13:40.084347+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.084347+0000","last_undegraded":"2023-07-21T22:13:40.084347+0000","last_fullsized":"2023-07-21T22:13:40.084347+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.088801+0000","last_change":"2023-07-21T22:13:40.100806+0000","last_active":"2023-07-21T22:13:41.088801+0000","last_peered":"2023-07-21T22:13:41.088801+0000","last_clean":"2023-07-21T22:13:41.088801+0000","last_became_active":"2023-07-21T22:13:40.100450+0000","last_became_peered":"2023-07-21T22:13:40.100450+0000","last_unstale":"2023-07-21T22:13:41.088801+0000","last_undegraded":"2023-07-21T22:13:41.088801+0000","last_fullsized":"2023-07-21T22:13:41.088801+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:16:10.411350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.092547+0000","last_change":"2023-07-21T22:13:41.089865+0000","last_active":"2023-07-21T22:13:41.092547+0000","last_peered":"2023-07-21T22:13:41.092547+0000","last_clean":"2023-07-21T22:13:41.092547+0000","last_became_active":"2023-07-21T22:13:41.089516+0000","last_became_peered":"2023-07-21T22:13:41.089516+0000","last_unstale":"2023-07-21T22:13:41.092547+0000","last_undegraded":"2023-07-21T22:13:41.092547+0000","last_fullsized":"2023-07-21T22:13:41.092547+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:24:50.488362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.081111+0000","last_change":"2023-07-21T22:13:40.094632+0000","last_active":"2023-07-21T22:13:41.081111+0000","last_peered":"2023-07-21T22:13:41.081111+0000","last_clean":"2023-07-21T22:13:41.081111+0000","last_became_active":"2023-07-21T22:13:40.094368+0000","last_became_peered":"2023-07-21T22:13:40.094368+0000","last_unstale":"2023-07-21T22:13:41.081111+0000","last_undegraded":"2023-07-21T22:13:41.081111+0000","last_fullsized":"2023-07-21T22:13:41.081111+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:09.684014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115717+0000","last_change":"2023-07-21T22:13:41.108001+0000","last_active":"2023-07-21T22:13:41.115717+0000","last_peered":"2023-07-21T22:13:41.115717+0000","last_clean":"2023-07-21T22:13:41.115717+0000","last_became_active":"2023-07-21T22:13:41.107733+0000","last_became_peered":"2023-07-21T22:13:41.107733+0000","last_unstale":"2023-07-21T22:13:41.115717+0000","last_undegraded":"2023-07-21T22:13:41.115717+0000","last_fullsized":"2023-07-21T22:13:41.115717+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:53:48.587220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118808+0000","last_change":"2023-07-21T22:13:40.098392+0000","last_active":"2023-07-21T22:13:41.118808+0000","last_peered":"2023-07-21T22:13:41.118808+0000","last_clean":"2023-07-21T22:13:41.118808+0000","last_became_active":"2023-07-21T22:13:40.098099+0000","last_became_peered":"2023-07-21T22:13:40.098099+0000","last_unstale":"2023-07-21T22:13:41.118808+0000","last_undegraded":"2023-07-21T22:13:41.118808+0000","last_fullsized":"2023-07-21T22:13:41.118808+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:04.466014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107884+0000","last_change":"2023-07-21T22:13:41.092950+0000","last_active":"2023-07-21T22:13:41.107884+0000","last_peered":"2023-07-21T22:13:41.107884+0000","last_clean":"2023-07-21T22:13:41.107884+0000","last_became_active":"2023-07-21T22:13:41.092105+0000","last_became_peered":"2023-07-21T22:13:41.092105+0000","last_unstale":"2023-07-21T22:13:41.107884+0000","last_undegraded":"2023-07-21T22:13:41.107884+0000","last_fullsized":"2023-07-21T22:13:41.107884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:33.372984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.096783+0000","last_change":"2023-07-21T22:13:40.094145+0000","last_active":"2023-07-21T22:13:40.096783+0000","last_peered":"2023-07-21T22:13:40.096783+0000","last_clean":"2023-07-21T22:13:40.096783+0000","last_became_active":"2023-07-21T22:13:40.093633+0000","last_became_peered":"2023-07-21T22:13:40.093633+0000","last_unstale":"2023-07-21T22:13:40.096783+0000","last_undegraded":"2023-07-21T22:13:40.096783+0000","last_fullsized":"2023-07-21T22:13:40.096783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:54.880684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.116141+0000","last_change":"2023-07-21T22:13:41.103922+0000","last_active":"2023-07-21T22:13:41.116141+0000","last_peered":"2023-07-21T22:13:41.116141+0000","last_clean":"2023-07-21T22:13:41.116141+0000","last_became_active":"2023-07-21T22:13:41.103642+0000","last_became_peered":"2023-07-21T22:13:41.103642+0000","last_unstale":"2023-07-21T22:13:41.116141+0000","last_undegraded":"2023-07-21T22:13:41.116141+0000","last_fullsized":"2023-07-21T22:13:41.116141+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:47:44.351565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119015+0000","last_change":"2023-07-21T22:13:40.096493+0000","last_active":"2023-07-21T22:13:41.119015+0000","last_peered":"2023-07-21T22:13:41.119015+0000","last_clean":"2023-07-21T22:13:41.119015+0000","last_became_active":"2023-07-21T22:13:40.096174+0000","last_became_peered":"2023-07-21T22:13:40.096174+0000","last_unstale":"2023-07-21T22:13:41.119015+0000","last_undegraded":"2023-07-21T22:13:41.119015+0000","last_fullsized":"2023-07-21T22:13:41.119015+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:50:47.997077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107074+0000","last_change":"2023-07-21T22:13:41.095610+0000","last_active":"2023-07-21T22:13:41.107074+0000","last_peered":"2023-07-21T22:13:41.107074+0000","last_clean":"2023-07-21T22:13:41.107074+0000","last_became_active":"2023-07-21T22:13:41.092550+0000","last_became_peered":"2023-07-21T22:13:41.092550+0000","last_unstale":"2023-07-21T22:13:41.107074+0000","last_undegraded":"2023-07-21T22:13:41.107074+0000","last_fullsized":"2023-07-21T22:13:41.107074+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:02:55.094217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080696+0000","last_change":"2023-07-21T22:13:40.095144+0000","last_active":"2023-07-21T22:13:41.080696+0000","last_peered":"2023-07-21T22:13:41.080696+0000","last_clean":"2023-07-21T22:13:41.080696+0000","last_became_active":"2023-07-21T22:13:40.094633+0000","last_became_peered":"2023-07-21T22:13:40.094633+0000","last_unstale":"2023-07-21T22:13:41.080696+0000","last_undegraded":"2023-07-21T22:13:41.080696+0000","last_fullsized":"2023-07-21T22:13:41.080696+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:16:10.411350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112455+0000","last_change":"2023-07-21T22:13:41.103229+0000","last_active":"2023-07-21T22:13:41.112455+0000","last_peered":"2023-07-21T22:13:41.112455+0000","last_clean":"2023-07-21T22:13:41.112455+0000","last_became_active":"2023-07-21T22:13:41.102919+0000","last_became_peered":"2023-07-21T22:13:41.102919+0000","last_unstale":"2023-07-21T22:13:41.112455+0000","last_undegraded":"2023-07-21T22:13:41.112455+0000","last_fullsized":"2023-07-21T22:13:41.112455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:57:31.042080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.090400+0000","last_change":"2023-07-21T22:13:40.097496+0000","last_active":"2023-07-21T22:13:41.090400+0000","last_peered":"2023-07-21T22:13:41.090400+0000","last_clean":"2023-07-21T22:13:41.090400+0000","last_became_active":"2023-07-21T22:13:40.097141+0000","last_became_peered":"2023-07-21T22:13:40.097141+0000","last_unstale":"2023-07-21T22:13:41.090400+0000","last_undegraded":"2023-07-21T22:13:41.090400+0000","last_fullsized":"2023-07-21T22:13:41.090400+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:01.084349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.080932+0000","last_change":"2023-07-21T22:13:40.080932+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.080932+0000","last_undegraded":"2023-07-21T22:13:40.080932+0000","last_fullsized":"2023-07-21T22:13:40.080932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.123480+0000","last_change":"2023-07-21T22:13:40.093508+0000","last_active":"2023-07-21T22:13:41.123480+0000","last_peered":"2023-07-21T22:13:41.123480+0000","last_clean":"2023-07-21T22:13:41.123480+0000","last_became_active":"2023-07-21T22:13:40.093118+0000","last_became_peered":"2023-07-21T22:13:40.093118+0000","last_unstale":"2023-07-21T22:13:41.123480+0000","last_undegraded":"2023-07-21T22:13:41.123480+0000","last_fullsized":"2023-07-21T22:13:41.123480+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:05:47.861560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.117774+0000","last_change":"2023-07-21T22:13:41.114988+0000","last_active":"2023-07-21T22:13:41.117774+0000","last_peered":"2023-07-21T22:13:41.117774+0000","last_clean":"2023-07-21T22:13:41.117774+0000","last_became_active":"2023-07-21T22:13:41.114608+0000","last_became_peered":"2023-07-21T22:13:41.114608+0000","last_unstale":"2023-07-21T22:13:41.117774+0000","last_undegraded":"2023-07-21T22:13:41.117774+0000","last_fullsized":"2023-07-21T22:13:41.117774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:12:14.393410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.120885+0000","last_change":"2023-07-21T22:13:40.095884+0000","last_active":"2023-07-21T22:13:41.120885+0000","last_peered":"2023-07-21T22:13:41.120885+0000","last_clean":"2023-07-21T22:13:41.120885+0000","last_became_active":"2023-07-21T22:13:40.095515+0000","last_became_peered":"2023-07-21T22:13:40.095515+0000","last_unstale":"2023-07-21T22:13:41.120885+0000","last_undegraded":"2023-07-21T22:13:41.120885+0000","last_fullsized":"2023-07-21T22:13:41.120885+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:29:53.027086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.111417+0000","last_change":"2023-07-21T22:13:41.099642+0000","last_active":"2023-07-21T22:13:41.111417+0000","last_peered":"2023-07-21T22:13:41.111417+0000","last_clean":"2023-07-21T22:13:41.111417+0000","last_became_active":"2023-07-21T22:13:41.099177+0000","last_became_peered":"2023-07-21T22:13:41.099177+0000","last_unstale":"2023-07-21T22:13:41.111417+0000","last_undegraded":"2023-07-21T22:13:41.111417+0000","last_fullsized":"2023-07-21T22:13:41.111417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:26.604799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080984+0000","last_change":"2023-07-21T22:13:40.089926+0000","last_active":"2023-07-21T22:13:41.080984+0000","last_peered":"2023-07-21T22:13:41.080984+0000","last_clean":"2023-07-21T22:13:41.080984+0000","last_became_active":"2023-07-21T22:13:40.089612+0000","last_became_peered":"2023-07-21T22:13:40.089612+0000","last_unstale":"2023-07-21T22:13:41.080984+0000","last_undegraded":"2023-07-21T22:13:41.080984+0000","last_fullsized":"2023-07-21T22:13:41.080984+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:01.084349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.101400+0000","last_change":"2023-07-21T22:13:41.092119+0000","last_active":"2023-07-21T22:13:41.101400+0000","last_peered":"2023-07-21T22:13:41.101400+0000","last_clean":"2023-07-21T22:13:41.101400+0000","last_became_active":"2023-07-21T22:13:41.091845+0000","last_became_peered":"2023-07-21T22:13:41.091845+0000","last_unstale":"2023-07-21T22:13:41.101400+0000","last_undegraded":"2023-07-21T22:13:41.101400+0000","last_fullsized":"2023-07-21T22:13:41.101400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:43:59.156552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.084066+0000","last_change":"2023-07-21T22:13:40.087676+0000","last_active":"2023-07-21T22:13:41.084066+0000","last_peered":"2023-07-21T22:13:41.084066+0000","last_clean":"2023-07-21T22:13:41.084066+0000","last_became_active":"2023-07-21T22:13:40.087408+0000","last_became_peered":"2023-07-21T22:13:40.087408+0000","last_unstale":"2023-07-21T22:13:41.084066+0000","last_undegraded":"2023-07-21T22:13:41.084066+0000","last_fullsized":"2023-07-21T22:13:41.084066+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:57:08.795253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107260+0000","last_change":"2023-07-21T22:13:41.098307+0000","last_active":"2023-07-21T22:13:41.107260+0000","last_peered":"2023-07-21T22:13:41.107260+0000","last_clean":"2023-07-21T22:13:41.107260+0000","last_became_active":"2023-07-21T22:13:41.097931+0000","last_became_peered":"2023-07-21T22:13:41.097931+0000","last_unstale":"2023-07-21T22:13:41.107260+0000","last_undegraded":"2023-07-21T22:13:41.107260+0000","last_fullsized":"2023-07-21T22:13:41.107260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:12:25.824212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.096763+0000","last_change":"2023-07-21T22:13:40.093966+0000","last_active":"2023-07-21T22:13:40.096763+0000","last_peered":"2023-07-21T22:13:40.096763+0000","last_clean":"2023-07-21T22:13:40.096763+0000","last_became_active":"2023-07-21T22:13:40.093353+0000","last_became_peered":"2023-07-21T22:13:40.093353+0000","last_unstale":"2023-07-21T22:13:40.096763+0000","last_undegraded":"2023-07-21T22:13:40.096763+0000","last_fullsized":"2023-07-21T22:13:40.096763+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:35:49.579192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112511+0000","last_change":"2023-07-21T22:13:41.105050+0000","last_active":"2023-07-21T22:13:41.112511+0000","last_peered":"2023-07-21T22:13:41.112511+0000","last_clean":"2023-07-21T22:13:41.112511+0000","last_became_active":"2023-07-21T22:13:41.104758+0000","last_became_peered":"2023-07-21T22:13:41.104758+0000","last_unstale":"2023-07-21T22:13:41.112511+0000","last_undegraded":"2023-07-21T22:13:41.112511+0000","last_fullsized":"2023-07-21T22:13:41.112511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:59.926223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.088595+0000","last_change":"2023-07-21T22:13:40.097222+0000","last_active":"2023-07-21T22:13:41.088595+0000","last_peered":"2023-07-21T22:13:41.088595+0000","last_clean":"2023-07-21T22:13:41.088595+0000","last_became_active":"2023-07-21T22:13:40.096883+0000","last_became_peered":"2023-07-21T22:13:40.096883+0000","last_unstale":"2023-07-21T22:13:41.088595+0000","last_undegraded":"2023-07-21T22:13:41.088595+0000","last_fullsized":"2023-07-21T22:13:41.088595+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:43:58.145647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115833+0000","last_change":"2023-07-21T22:13:41.104606+0000","last_active":"2023-07-21T22:13:41.115833+0000","last_peered":"2023-07-21T22:13:41.115833+0000","last_clean":"2023-07-21T22:13:41.115833+0000","last_became_active":"2023-07-21T22:13:41.104358+0000","last_became_peered":"2023-07-21T22:13:41.104358+0000","last_unstale":"2023-07-21T22:13:41.115833+0000","last_undegraded":"2023-07-21T22:13:41.115833+0000","last_fullsized":"2023-07-21T22:13:41.115833+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:29:40.368592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078740+0000","last_change":"2023-07-21T22:13:40.097893+0000","last_active":"2023-07-21T22:13:41.078740+0000","last_peered":"2023-07-21T22:13:41.078740+0000","last_clean":"2023-07-21T22:13:41.078740+0000","last_became_active":"2023-07-21T22:13:40.097514+0000","last_became_peered":"2023-07-21T22:13:40.097514+0000","last_unstale":"2023-07-21T22:13:41.078740+0000","last_undegraded":"2023-07-21T22:13:41.078740+0000","last_fullsized":"2023-07-21T22:13:41.078740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:42:29.625435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.081200+0000","last_change":"2023-07-21T22:13:40.081200+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.081200+0000","last_undegraded":"2023-07-21T22:13:40.081200+0000","last_fullsized":"2023-07-21T22:13:40.081200+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078342+0000","last_change":"2023-07-21T22:13:40.092519+0000","last_active":"2023-07-21T22:13:41.078342+0000","last_peered":"2023-07-21T22:13:41.078342+0000","last_clean":"2023-07-21T22:13:41.078342+0000","last_became_active":"2023-07-21T22:13:40.092070+0000","last_became_peered":"2023-07-21T22:13:40.092070+0000","last_unstale":"2023-07-21T22:13:41.078342+0000","last_undegraded":"2023-07-21T22:13:41.078342+0000","last_fullsized":"2023-07-21T22:13:41.078342+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:57:23.225259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115146+0000","last_change":"2023-07-21T22:13:41.107176+0000","last_active":"2023-07-21T22:13:41.115146+0000","last_peered":"2023-07-21T22:13:41.115146+0000","last_clean":"2023-07-21T22:13:41.115146+0000","last_became_active":"2023-07-21T22:13:41.106910+0000","last_became_peered":"2023-07-21T22:13:41.106910+0000","last_unstale":"2023-07-21T22:13:41.115146+0000","last_undegraded":"2023-07-21T22:13:41.115146+0000","last_fullsized":"2023-07-21T22:13:41.115146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:23:43.440412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.101793+0000","last_change":"2023-07-21T22:13:40.096525+0000","last_active":"2023-07-21T22:13:40.101793+0000","last_peered":"2023-07-21T22:13:40.101793+0000","last_clean":"2023-07-21T22:13:40.101793+0000","last_became_active":"2023-07-21T22:13:40.096154+0000","last_became_peered":"2023-07-21T22:13:40.096154+0000","last_unstale":"2023-07-21T22:13:40.101793+0000","last_undegraded":"2023-07-21T22:13:40.101793+0000","last_fullsized":"2023-07-21T22:13:40.101793+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:37:09.117491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.100241+0000","last_change":"2023-07-21T22:13:41.097870+0000","last_active":"2023-07-21T22:13:41.100241+0000","last_peered":"2023-07-21T22:13:41.100241+0000","last_clean":"2023-07-21T22:13:41.100241+0000","last_became_active":"2023-07-21T22:13:41.097551+0000","last_became_peered":"2023-07-21T22:13:41.097551+0000","last_unstale":"2023-07-21T22:13:41.100241+0000","last_undegraded":"2023-07-21T22:13:41.100241+0000","last_fullsized":"2023-07-21T22:13:41.100241+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:06.859565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080550+0000","last_change":"2023-07-21T22:13:40.087863+0000","last_active":"2023-07-21T22:13:41.080550+0000","last_peered":"2023-07-21T22:13:41.080550+0000","last_clean":"2023-07-21T22:13:41.080550+0000","last_became_active":"2023-07-21T22:13:40.087564+0000","last_became_peered":"2023-07-21T22:13:40.087564+0000","last_unstale":"2023-07-21T22:13:41.080550+0000","last_undegraded":"2023-07-21T22:13:41.080550+0000","last_fullsized":"2023-07-21T22:13:41.080550+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:18:30.093515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.089156+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:13:41.089156+0000","last_peered":"2023-07-21T22:13:41.089156+0000","last_clean":"2023-07-21T22:13:41.089156+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:13:41.089156+0000","last_undegraded":"2023-07-21T22:13:41.089156+0000","last_fullsized":"2023-07-21T22:13:41.089156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:23.622141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115411+0000","last_change":"2023-07-21T22:13:41.098808+0000","last_active":"2023-07-21T22:13:41.115411+0000","last_peered":"2023-07-21T22:13:41.115411+0000","last_clean":"2023-07-21T22:13:41.115411+0000","last_became_active":"2023-07-21T22:13:41.097724+0000","last_became_peered":"2023-07-21T22:13:41.097724+0000","last_unstale":"2023-07-21T22:13:41.115411+0000","last_undegraded":"2023-07-21T22:13:41.115411+0000","last_fullsized":"2023-07-21T22:13:41.115411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:14.461183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118701+0000","last_change":"2023-07-21T22:13:40.098471+0000","last_active":"2023-07-21T22:13:41.118701+0000","last_peered":"2023-07-21T22:13:41.118701+0000","last_clean":"2023-07-21T22:13:41.118701+0000","last_became_active":"2023-07-21T22:13:40.098189+0000","last_became_peered":"2023-07-21T22:13:40.098189+0000","last_unstale":"2023-07-21T22:13:41.118701+0000","last_undegraded":"2023-07-21T22:13:41.118701+0000","last_fullsized":"2023-07-21T22:13:41.118701+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:08:17.401688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":82,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.088290+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:13:40.088290+0000","last_peered":"2023-07-21T22:13:40.088290+0000","last_clean":"2023-07-21T22:13:40.088290+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:13:40.088290+0000","last_undegraded":"2023-07-21T22:13:40.088290+0000","last_fullsized":"2023-07-21T22:13:40.088290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:04.506510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115773+0000","last_change":"2023-07-21T22:13:41.109484+0000","last_active":"2023-07-21T22:13:41.115773+0000","last_peered":"2023-07-21T22:13:41.115773+0000","last_clean":"2023-07-21T22:13:41.115773+0000","last_became_active":"2023-07-21T22:13:41.109190+0000","last_became_peered":"2023-07-21T22:13:41.109190+0000","last_unstale":"2023-07-21T22:13:41.115773+0000","last_undegraded":"2023-07-21T22:13:41.115773+0000","last_fullsized":"2023-07-21T22:13:41.115773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:22:22.225547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119598+0000","last_change":"2023-07-21T22:13:40.100805+0000","last_active":"2023-07-21T22:13:41.119598+0000","last_peered":"2023-07-21T22:13:41.119598+0000","last_clean":"2023-07-21T22:13:41.119598+0000","last_became_active":"2023-07-21T22:13:40.100494+0000","last_became_peered":"2023-07-21T22:13:40.100494+0000","last_unstale":"2023-07-21T22:13:41.119598+0000","last_undegraded":"2023-07-21T22:13:41.119598+0000","last_fullsized":"2023-07-21T22:13:41.119598+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:56.263731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.086487+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:13:41.086487+0000","last_peered":"2023-07-21T22:13:41.086487+0000","last_clean":"2023-07-21T22:13:41.086487+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:13:41.086487+0000","last_undegraded":"2023-07-21T22:13:41.086487+0000","last_fullsized":"2023-07-21T22:13:41.086487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:36.844419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.120524+0000","last_change":"2023-07-21T22:13:41.117194+0000","last_active":"2023-07-21T22:13:41.120524+0000","last_peered":"2023-07-21T22:13:41.120524+0000","last_clean":"2023-07-21T22:13:41.120524+0000","last_became_active":"2023-07-21T22:13:41.116856+0000","last_became_peered":"2023-07-21T22:13:41.116856+0000","last_unstale":"2023-07-21T22:13:41.120524+0000","last_undegraded":"2023-07-21T22:13:41.120524+0000","last_fullsized":"2023-07-21T22:13:41.120524+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:02:55.094217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119515+0000","last_change":"2023-07-21T22:13:40.096336+0000","last_active":"2023-07-21T22:13:41.119515+0000","last_peered":"2023-07-21T22:13:41.119515+0000","last_clean":"2023-07-21T22:13:41.119515+0000","last_became_active":"2023-07-21T22:13:40.095997+0000","last_became_peered":"2023-07-21T22:13:40.095997+0000","last_unstale":"2023-07-21T22:13:41.119515+0000","last_undegraded":"2023-07-21T22:13:41.119515+0000","last_fullsized":"2023-07-21T22:13:41.119515+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:40.777899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":82,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.088052+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:13:40.088052+0000","last_peered":"2023-07-21T22:13:40.088052+0000","last_clean":"2023-07-21T22:13:40.088052+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:13:40.088052+0000","last_undegraded":"2023-07-21T22:13:40.088052+0000","last_fullsized":"2023-07-21T22:13:40.088052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:04:29.247679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112435+0000","last_change":"2023-07-21T22:13:41.100147+0000","last_active":"2023-07-21T22:13:41.112435+0000","last_peered":"2023-07-21T22:13:41.112435+0000","last_clean":"2023-07-21T22:13:41.112435+0000","last_became_active":"2023-07-21T22:13:41.099829+0000","last_became_peered":"2023-07-21T22:13:41.099829+0000","last_unstale":"2023-07-21T22:13:41.112435+0000","last_undegraded":"2023-07-21T22:13:41.112435+0000","last_fullsized":"2023-07-21T22:13:41.112435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:24.800740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.083747+0000","last_change":"2023-07-21T22:13:40.097666+0000","last_active":"2023-07-21T22:13:41.083747+0000","last_peered":"2023-07-21T22:13:41.083747+0000","last_clean":"2023-07-21T22:13:41.083747+0000","last_became_active":"2023-07-21T22:13:40.097365+0000","last_became_peered":"2023-07-21T22:13:40.097365+0000","last_unstale":"2023-07-21T22:13:41.083747+0000","last_undegraded":"2023-07-21T22:13:41.083747+0000","last_fullsized":"2023-07-21T22:13:41.083747+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:07:41.346094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080851+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:13:41.080851+0000","last_peered":"2023-07-21T22:13:41.080851+0000","last_clean":"2023-07-21T22:13:41.080851+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:13:41.080851+0000","last_undegraded":"2023-07-21T22:13:41.080851+0000","last_fullsized":"2023-07-21T22:13:41.080851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:27.861284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107095+0000","last_change":"2023-07-21T22:13:41.095803+0000","last_active":"2023-07-21T22:13:41.107095+0000","last_peered":"2023-07-21T22:13:41.107095+0000","last_clean":"2023-07-21T22:13:41.107095+0000","last_became_active":"2023-07-21T22:13:41.095315+0000","last_became_peered":"2023-07-21T22:13:41.095315+0000","last_unstale":"2023-07-21T22:13:41.107095+0000","last_undegraded":"2023-07-21T22:13:41.107095+0000","last_fullsized":"2023-07-21T22:13:41.107095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:35.630446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080918+0000","last_change":"2023-07-21T22:13:40.094937+0000","last_active":"2023-07-21T22:13:41.080918+0000","last_peered":"2023-07-21T22:13:41.080918+0000","last_clean":"2023-07-21T22:13:41.080918+0000","last_became_active":"2023-07-21T22:13:40.094169+0000","last_became_peered":"2023-07-21T22:13:40.094169+0000","last_unstale":"2023-07-21T22:13:41.080918+0000","last_undegraded":"2023-07-21T22:13:41.080918+0000","last_fullsized":"2023-07-21T22:13:41.080918+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:18.368263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.089510+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:13:41.089510+0000","last_peered":"2023-07-21T22:13:41.089510+0000","last_clean":"2023-07-21T22:13:41.089510+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:13:41.089510+0000","last_undegraded":"2023-07-21T22:13:41.089510+0000","last_fullsized":"2023-07-21T22:13:41.089510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:47:45.851156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.111847+0000","last_change":"2023-07-21T22:13:41.106922+0000","last_active":"2023-07-21T22:13:41.111847+0000","last_peered":"2023-07-21T22:13:41.111847+0000","last_clean":"2023-07-21T22:13:41.111847+0000","last_became_active":"2023-07-21T22:13:41.106619+0000","last_became_peered":"2023-07-21T22:13:41.106619+0000","last_unstale":"2023-07-21T22:13:41.111847+0000","last_undegraded":"2023-07-21T22:13:41.111847+0000","last_fullsized":"2023-07-21T22:13:41.111847+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:17:31.116227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.123287+0000","last_change":"2023-07-21T22:13:40.093838+0000","last_active":"2023-07-21T22:13:41.123287+0000","last_peered":"2023-07-21T22:13:41.123287+0000","last_clean":"2023-07-21T22:13:41.123287+0000","last_became_active":"2023-07-21T22:13:40.093566+0000","last_became_peered":"2023-07-21T22:13:40.093566+0000","last_unstale":"2023-07-21T22:13:41.123287+0000","last_undegraded":"2023-07-21T22:13:41.123287+0000","last_fullsized":"2023-07-21T22:13:41.123287+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:58:32.061562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.090597+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:13:41.090597+0000","last_peered":"2023-07-21T22:13:41.090597+0000","last_clean":"2023-07-21T22:13:41.090597+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:13:41.090597+0000","last_undegraded":"2023-07-21T22:13:41.090597+0000","last_fullsized":"2023-07-21T22:13:41.090597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:49:32.843652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112504+0000","last_change":"2023-07-21T22:13:41.105123+0000","last_active":"2023-07-21T22:13:41.112504+0000","last_peered":"2023-07-21T22:13:41.112504+0000","last_clean":"2023-07-21T22:13:41.112504+0000","last_became_active":"2023-07-21T22:13:41.104852+0000","last_became_peered":"2023-07-21T22:13:41.104852+0000","last_unstale":"2023-07-21T22:13:41.112504+0000","last_undegraded":"2023-07-21T22:13:41.112504+0000","last_fullsized":"2023-07-21T22:13:41.112504+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:56.106383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078209+0000","last_change":"2023-07-21T22:13:40.091829+0000","last_active":"2023-07-21T22:13:41.078209+0000","last_peered":"2023-07-21T22:13:41.078209+0000","last_clean":"2023-07-21T22:13:41.078209+0000","last_became_active":"2023-07-21T22:13:40.091466+0000","last_became_peered":"2023-07-21T22:13:40.091466+0000","last_unstale":"2023-07-21T22:13:41.078209+0000","last_undegraded":"2023-07-21T22:13:41.078209+0000","last_fullsized":"2023-07-21T22:13:41.078209+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:32:36.155188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.079865+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:13:41.079865+0000","last_peered":"2023-07-21T22:13:41.079865+0000","last_clean":"2023-07-21T22:13:41.079865+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:13:41.079865+0000","last_undegraded":"2023-07-21T22:13:41.079865+0000","last_fullsized":"2023-07-21T22:13:41.079865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:47:37.024948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":236,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.090730+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:13:41.090730+0000","last_peered":"2023-07-21T22:13:41.090730+0000","last_clean":"2023-07-21T22:13:41.090730+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:13:41.090730+0000","last_undegraded":"2023-07-21T22:13:41.090730+0000","last_fullsized":"2023-07-21T22:13:41.090730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:20.076638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32352,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339488,"statfs":{"total":96636764160,"available":96603635712,"internally_reserved":0,"allocated":1335296,"data_stored":928031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.2270000000000001,"15min":1.2250000000000001},"min":{"1min":0.92800000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6439999999999999,"5min":2.218,"15min":2.218},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.278,"15min":1.3100000000000001},"min":{"1min":0.98899999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.478,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.3240000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.196,"15min":1.218},"min":{"1min":0.749,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4830000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2370000000000001,"15min":1.2729999999999999},"min":{"1min":0.81000000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.5249999999999999,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.121}]},{"osd":2,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.21,"15min":1.2250000000000001},"min":{"1min":0.89000000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.4139999999999999,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.2709999999999999,"15min":1.2989999999999999},"min":{"1min":0.80000000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5940000000000001,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.367}]},{"osd":3,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.278,"15min":1.2929999999999999},"min":{"1min":0.93700000000000006,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4910000000000001,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.3560000000000001,"15min":1.4159999999999999},"min":{"1min":0.88500000000000001,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5329999999999999,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.595}]},{"osd":4,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.2050000000000001,"15min":1.23},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4790000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.466},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.304,"15min":1.3340000000000001},"min":{"1min":0.84399999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5189999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.53}]},{"osd":5,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3480000000000001,"15min":1.3660000000000001},"min":{"1min":0.66300000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4810000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.9930000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.3280000000000001,"15min":1.3740000000000001},"min":{"1min":0.89800000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.496,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.623}]},{"osd":6,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.4490000000000001,"15min":1.4950000000000001},"min":{"1min":0.96099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.6160000000000001,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3999999999999999,"15min":1.423},"min":{"1min":1.038,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.667,"5min":2.476,"15min":2.476},"last":1.7370000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":724992,"data_stored":336887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.105,"15min":1.119},"min":{"1min":0.71599999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.52,"5min":1.657,"15min":1.657},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.1120000000000001,"15min":1.141},"min":{"1min":0.78100000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.282,"5min":2.802,"15min":2.802},"last":1.266}]},{"osd":1,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2070000000000001,"15min":1.2430000000000001},"min":{"1min":0.90500000000000003,"5min":0.747,"15min":0.747},"max":{"1min":1.571,"5min":1.839,"15min":1.839},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.212,"15min":1.25},"min":{"1min":0.754,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7070000000000001,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.548}]},{"osd":2,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2370000000000001,"15min":1.2689999999999999},"min":{"1min":0.93500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.718,"5min":2.911,"15min":2.911},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.2889999999999999,"15min":1.355},"min":{"1min":0.77200000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4870000000000001,"5min":2.379,"15min":2.379},"last":1.393}]},{"osd":3,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.373,"15min":1.425},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.554,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.01},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.3580000000000001,"15min":1.4059999999999999},"min":{"1min":0.83899999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.716,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":1.5980000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.28,"15min":1.28},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8919999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.472},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.335,"15min":1.381},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6140000000000001,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.3440000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3740000000000001,"15min":1.3959999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.7290000000000001,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.516},{"interface":"front","average":{"1min":1.385,"5min":1.4350000000000001,"15min":1.452},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9419999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.6419999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.421,"15min":1.4410000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9390000000000001,"5min":4.194,"15min":4.194},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.524,"15min":1.55},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.8220000000000001,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.5740000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509484,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":729088,"data_stored":336909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.079,"15min":1.0960000000000001},"min":{"1min":0.67300000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.472,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1279999999999999,"15min":1.1399999999999999},"min":{"1min":0.77100000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5329999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.1990000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1619999999999999,"15min":1.2},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.593,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.073,"5min":1.1599999999999999,"15min":1.1839999999999999},"min":{"1min":0.72099999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.51,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.278}]},{"osd":2,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1619999999999999,"15min":1.1659999999999999},"min":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.105},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.272,"15min":1.3049999999999999},"min":{"1min":0.76100000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.615,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.353}]},{"osd":3,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.2250000000000001,"15min":1.2490000000000001},"min":{"1min":0.68400000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.47,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.024},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.371,"15min":1.401},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.671,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.411}]},{"osd":4,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3049999999999999,"15min":1.3360000000000001},"min":{"1min":0.93500000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.5960000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2909999999999999,"15min":1.304},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.673,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.379}]},{"osd":6,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.256,"15min":1.2829999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.621,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":0.85299999999999998,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.655,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.3069999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2789999999999999,"15min":1.3029999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5449999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.155},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4870000000000001,"15min":1.5189999999999999},"min":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7150000000000001,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.321}]}]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":737280,"data_stored":338451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.105,"15min":1.101},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.4039999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.095},{"interface":"front","average":{"1min":1.127,"5min":1.151,"15min":1.171},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5269999999999999,"5min":1.617,"15min":1.617},"last":0.90400000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.216,"15min":1.232},"min":{"1min":0.60699999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7030000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.498},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1930000000000001,"15min":1.1950000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.6000000000000001,"5min":1.665,"15min":1.665},"last":0.79800000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.143,"15min":1.1399999999999999},"min":{"1min":0.89800000000000002,"5min":0.748,"15min":0.748},"max":{"1min":1.585,"5min":1.609,"15min":1.609},"last":1.018},{"interface":"front","average":{"1min":1.28,"5min":1.2789999999999999,"15min":1.3},"min":{"1min":0.96399999999999997,"5min":0.621,"15min":0.621},"max":{"1min":1.6479999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.252}]},{"osd":3,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.2669999999999999,"15min":1.3049999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.482,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.236,"15min":1.2330000000000001},"min":{"1min":1.0069999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.504,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.2989999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.264,"15min":1.3},"min":{"1min":0.86199999999999999,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7470000000000001,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.373},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.246,"15min":1.2370000000000001},"min":{"1min":0.751,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.756,"5min":1.794,"15min":1.794},"last":1.3340000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.198,"15min":1.2},"min":{"1min":0.91700000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5760000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.3959999999999999,"15min":1.4259999999999999},"min":{"1min":0.995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8380000000000001,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.575}]},{"osd":7,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.385,"15min":1.369},"min":{"1min":0.85999999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.831,"5min":1.887,"15min":1.887},"last":1.524},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4119999999999999,"15min":1.409},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.835,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.4239999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509482,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":712704,"data_stored":329439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92000000000000004,"15min":0.93100000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":1.484},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88700000000000001,"15min":0.90100000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.9830000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.90500000000000003,"15min":0.93899999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1879999999999999,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.081,"15min":1.129},"min":{"1min":0.56999999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.71,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.3}]},{"osd":2,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.69199999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.52},{"interface":"front","average":{"1min":0.999,"5min":1.0329999999999999,"15min":1.04},"min":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5109999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":2.613}]},{"osd":4,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.3240000000000001,"15min":1.3420000000000001},"min":{"1min":0.90800000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.73,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.359},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.29,"15min":1.3340000000000001},"min":{"1min":0.76500000000000001,"5min":0.751,"15min":0.751},"max":{"1min":1.52,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.9350000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3029999999999999,"15min":1.339},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.694,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4359999999999999,"15min":1.466},"min":{"1min":0.96799999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.677,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.4019999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.337,"15min":1.367},"min":{"1min":0.86499999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.75,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":2.0379999999999998},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4099999999999999,"15min":1.4490000000000001},"min":{"1min":0.92700000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.653,"5min":2.161,"15min":2.161},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.4590000000000001,"15min":1.5069999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.6639999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.5229999999999999,"15min":1.5580000000000001},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.8140000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.4419999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":712704,"data_stored":329439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.872,"15min":0.88},"min":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1950000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.022,"15min":1.032},"min":{"1min":0.69099999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5189999999999999,"5min":1.534,"15min":1.534},"last":7.0300000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.93899999999999995,"15min":0.95699999999999996},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.272,"5min":1.486,"15min":1.486},"last":2.2949999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0980000000000001,"15min":1.1180000000000001},"min":{"1min":0.75600000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.2869999999999999,"5min":1.958,"15min":1.958},"last":4.1239999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.123,"15min":1.1379999999999999},"min":{"1min":0.70199999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.4419999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":3.5070000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.1299999999999999,"15min":1.1559999999999999},"min":{"1min":0.73999999999999999,"5min":0.623,"15min":0.623},"max":{"1min":1.365,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":2.46}]},{"osd":4,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3979999999999999,"15min":1.4199999999999999},"min":{"1min":1.0960000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6060000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":2.1840000000000002},{"interface":"front","average":{"1min":1.329,"5min":1.4670000000000001,"15min":1.5069999999999999},"min":{"1min":1.0580000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.607,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":2.516}]},{"osd":5,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.4770000000000001,"15min":1.506},"min":{"1min":1.1259999999999999,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":1.6599999999999999,"5min":3.331,"15min":3.331},"last":2.0139999999999998},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.5129999999999999,"15min":1.5529999999999999},"min":{"1min":1.1100000000000001,"5min":1.085,"15min":1.085},"max":{"1min":1.7649999999999999,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":2.2360000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4379999999999999,"15min":1.458},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.663,"5min":2.633,"15min":2.633},"last":2.399},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.421,"15min":1.458},"min":{"1min":1.1319999999999999,"5min":0.878,"15min":0.878},"max":{"1min":1.615,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.6299999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4510000000000001,"15min":1.4810000000000001},"min":{"1min":1.0009999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.738,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":2.137},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.534,"15min":1.5640000000000001},"min":{"1min":1.1379999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.72,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":2.3450000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":919807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.876,"15min":0.88800000000000001},"min":{"1min":0.63200000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.94799999999999995,"15min":0.97399999999999998},"min":{"1min":0.63500000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.296}]},{"osd":2,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.95499999999999996,"15min":0.93899999999999995},"min":{"1min":0.68200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.242},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.032,"15min":1.026},"min":{"1min":0.77300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.1850000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.96199999999999997,"15min":0.94999999999999996},"min":{"1min":0.63900000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.179,"15min":1.175},"min":{"1min":0.82099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":1.3340000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.264,"15min":1.2609999999999999},"min":{"1min":0.90900000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":3.1779999999999999,"5min":3.1779999999999999,"15min":3.1779999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.3899999999999999,"15min":1.3919999999999999},"min":{"1min":1.1559999999999999,"5min":1,"15min":1},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.4610000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.429,"15min":1.4870000000000001},"min":{"1min":0.96999999999999997,"5min":0.872,"15min":0.872},"max":{"1min":2.1150000000000002,"5min":2.419,"15min":2.419},"last":1.5},{"interface":"front","average":{"1min":1.409,"5min":1.383,"15min":1.4039999999999999},"min":{"1min":0.96699999999999997,"5min":0.872,"15min":0.872},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4870000000000001,"15min":1.522},"min":{"1min":1.0680000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.46,"5min":1.4770000000000001,"15min":1.5189999999999999},"min":{"1min":1.0980000000000001,"5min":1.038,"15min":1.038},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.552}]},{"osd":7,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.49,"15min":1.5369999999999999},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.4489999999999998,"5min":2.504,"15min":2.504},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4610000000000001,"15min":1.5009999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.3779999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":700416,"data_stored":322499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.877,"15min":0.89300000000000002},"min":{"1min":0.51600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":1.2589999999999999,"5min":2.113,"15min":2.113},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.627,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5009999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.89900000000000002,"15min":0.90000000000000002},"min":{"1min":0.505,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1659999999999999,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.034,"5min":1.0840000000000001,"15min":1.1180000000000001},"min":{"1min":0.65700000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.601,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.101}]},{"osd":3,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.3100000000000001,"15min":1.3899999999999999},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7110000000000001,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.1879999999999999,"15min":1.2509999999999999},"min":{"1min":0.70399999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4370000000000001,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":0.89000000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2869999999999999,"15min":1.3120000000000001},"min":{"1min":0.96199999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.617,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.272,"15min":1.302},"min":{"1min":0.996,"5min":0.377,"15min":0.377},"max":{"1min":1.6719999999999999,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.181}]},{"osd":5,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.319,"15min":1.361},"min":{"1min":0.92400000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.7869999999999999,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.4339999999999999,"15min":1.484},"min":{"1min":1.0800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.958,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.1479999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3919999999999999,"15min":1.4279999999999999},"min":{"1min":0.94099999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6439999999999999,"5min":2.238,"15min":2.238},"last":1.482},{"interface":"front","average":{"1min":1.359,"5min":1.4159999999999999,"15min":1.444},"min":{"1min":1.111,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.887,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.3340000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5209999999999999,"15min":1.5549999999999999},"min":{"1min":0.997,"5min":0.624,"15min":0.624},"max":{"1min":1.909,"5min":4.391,"15min":4.391},"last":1.306},{"interface":"front","average":{"1min":1.413,"5min":1.4830000000000001,"15min":1.5169999999999999},"min":{"1min":1.155,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.746,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.385}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:13:45.932 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:13:46.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.109+0000 7fec1d200700 1 Processor -- start 2023-07-21T22:13:46.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.109+0000 7fec1d200700 1 -- start start 2023-07-21T22:13:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.109+0000 7fec1d200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec1806d630 0x7fec1806e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.109+0000 7fec1d200700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fec18070d30 0x7fec1806da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.109+0000 7fec1d200700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec180cbbd0 0x7fec180b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.109+0000 7fec1d200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1815d610 con 0x7fec1806d630 2023-07-21T22:13:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.109+0000 7fec1d200700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1815deb0 con 0x7fec18070d30 2023-07-21T22:13:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.109+0000 7fec1d200700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1806df40 con 0x7fec180cbbd0 2023-07-21T22:13:46.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.109+0000 7fec16d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec1806d630 0x7fec1806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:46.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.109+0000 7fec16d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec1806d630 0x7fec1806e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54546/0 (socket says 172.21.15.49:54546) 2023-07-21T22:13:46.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.109+0000 7fec16d9d700 1 -- 172.21.15.49:0/2986600986 learned_addr learned my addr 172.21.15.49:0/2986600986 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:46.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.109+0000 7fec1c9ff700 1 --2- 172.21.15.49:0/2986600986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec180cbbd0 0x7fec180b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.109+0000 7fec1659c700 1 --2- 172.21.15.49:0/2986600986 >> v2:172.21.15.150:3300/0 conn(0x7fec18070d30 0x7fec1806da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec16d9d700 1 -- 172.21.15.49:0/2986600986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec180cbbd0 msgr2=0x7fec180b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec16d9d700 1 --2- 172.21.15.49:0/2986600986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec180cbbd0 0x7fec180b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec16d9d700 1 -- 172.21.15.49:0/2986600986 >> v2:172.21.15.150:3300/0 conn(0x7fec18070d30 msgr2=0x7fec1806da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:46.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec16d9d700 1 --2- 172.21.15.49:0/2986600986 >> v2:172.21.15.150:3300/0 conn(0x7fec18070d30 0x7fec1806da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec16d9d700 1 -- 172.21.15.49:0/2986600986 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec180cc0b0 con 0x7fec1806d630 2023-07-21T22:13:46.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec1c9ff700 1 --2- 172.21.15.49:0/2986600986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec180cbbd0 0x7fec180b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:46.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec16d9d700 1 --2- 172.21.15.49:0/2986600986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1806d630 0x7fec1806e960 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fec180cd1e0 tx=0x7fec08009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99db4d1d31dccc64 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:46.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec15d9b700 1 -- 172.21.15.49:0/2986600986 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800b8a0 con 0x7fec1806d630 2023-07-21T22:13:46.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec15d9b700 1 -- 172.21.15.49:0/2986600986 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0800ba00 con 0x7fec1806d630 2023-07-21T22:13:46.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec15d9b700 1 -- 172.21.15.49:0/2986600986 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800bd90 con 0x7fec1806d630 2023-07-21T22:13:46.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec1d200700 1 -- 172.21.15.49:0/2986600986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1806d630 msgr2=0x7fec1806e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:46.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec1d200700 1 --2- 172.21.15.49:0/2986600986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1806d630 0x7fec1806e960 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fec180cd1e0 tx=0x7fec08009bf0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec1d200700 1 -- 172.21.15.49:0/2986600986 shutdown_connections 2023-07-21T22:13:46.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec1d200700 1 --2- 172.21.15.49:0/2986600986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec180cbbd0 0x7fec180b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec1d200700 1 --2- 172.21.15.49:0/2986600986 >> v2:172.21.15.150:3300/0 conn(0x7fec18070d30 0x7fec1806da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec1d200700 1 --2- 172.21.15.49:0/2986600986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1806d630 0x7fec1806e960 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec1d200700 1 -- 172.21.15.49:0/2986600986 >> 172.21.15.49:0/2986600986 conn(0x7fec180cc430 msgr2=0x7fec180cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:46.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec1d200700 1 -- 172.21.15.49:0/2986600986 shutdown_connections 2023-07-21T22:13:46.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.113+0000 7fec1d200700 1 -- 172.21.15.49:0/2986600986 wait complete. 2023-07-21T22:13:46.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.117+0000 7fec1d200700 1 Processor -- start 2023-07-21T22:13:46.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.117+0000 7fec1d200700 1 -- start start 2023-07-21T22:13:46.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1d200700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec1806d630 0x7fec1815c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:46.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1d200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec18070d30 0x7fec1815b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:46.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1d200700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec180cbbd0 0x7fec1815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:46.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1d200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec181f1200 con 0x7fec18070d30 2023-07-21T22:13:46.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1d200700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec181f5520 con 0x7fec180cbbd0 2023-07-21T22:13:46.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1d200700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec181f13f0 con 0x7fec1806d630 2023-07-21T22:13:46.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec18070d30 0x7fec1815b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:46.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec18070d30 0x7fec1815b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54548/0 (socket says 172.21.15.49:54548) 2023-07-21T22:13:46.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1659c700 1 -- 172.21.15.49:0/3685209532 learned_addr learned my addr 172.21.15.49:0/3685209532 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:46.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec16d9d700 1 --2- 172.21.15.49:0/3685209532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec1806d630 0x7fec1815c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:46.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1c9ff700 1 --2- 172.21.15.49:0/3685209532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec180cbbd0 0x7fec1815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:46.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1659c700 1 -- 172.21.15.49:0/3685209532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec1806d630 msgr2=0x7fec1815c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:46.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1659c700 1 --2- 172.21.15.49:0/3685209532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec1806d630 0x7fec1815c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1659c700 1 -- 172.21.15.49:0/3685209532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec180cbbd0 msgr2=0x7fec1815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1659c700 1 --2- 172.21.15.49:0/3685209532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec180cbbd0 0x7fec1815b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1659c700 1 -- 172.21.15.49:0/3685209532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec08009570 con 0x7fec18070d30 2023-07-21T22:13:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1659c700 1 --2- 172.21.15.49:0/3685209532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec18070d30 0x7fec1815b190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00e810 tx=0x7fec0c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7febff7fe700 1 -- 172.21.15.49:0/3685209532 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00c070 con 0x7fec18070d30 2023-07-21T22:13:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7febff7fe700 1 -- 172.21.15.49:0/3685209532 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c013610 con 0x7fec18070d30 2023-07-21T22:13:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1d200700 1 -- 172.21.15.49:0/3685209532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec181f16d0 con 0x7fec18070d30 2023-07-21T22:13:46.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7febff7fe700 1 -- 172.21.15.49:0/3685209532 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c013980 con 0x7fec18070d30 2023-07-21T22:13:46.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.121+0000 7fec1d200700 1 -- 172.21.15.49:0/3685209532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1815cd20 con 0x7fec18070d30 2023-07-21T22:13:46.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.125+0000 7fec1d200700 1 -- 172.21.15.49:0/3685209532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1815e320 con 0x7fec18070d30 2023-07-21T22:13:46.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.125+0000 7febff7fe700 1 -- 172.21.15.49:0/3685209532 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec0c013ae0 con 0x7fec18070d30 2023-07-21T22:13:46.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.129+0000 7febff7fe700 1 --2- 172.21.15.49:0/3685209532 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec040662f0 0x7fec040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:46.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.129+0000 7febff7fe700 1 -- 172.21.15.49:0/3685209532 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fec0c083ba0 con 0x7fec18070d30 2023-07-21T22:13:46.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.129+0000 7fec16d9d700 1 --2- 172.21.15.49:0/3685209532 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec040662f0 0x7fec040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:46.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.129+0000 7fec16d9d700 1 --2- 172.21.15.49:0/3685209532 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec040662f0 0x7fec040687a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fec08000c00 tx=0x7fec08008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:46.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.137+0000 7febff7fe700 1 -- 172.21.15.49:0/3685209532 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec1815e320 con 0x7fec18070d30 2023-07-21T22:13:46.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.305+0000 7fec1d200700 1 -- 172.21.15.49:0/3685209532 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec1815db40 con 0x7fec040662f0 2023-07-21T22:13:46.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.321+0000 7febff7fe700 1 -- 172.21.15.49:0/3685209532 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308228 (secure 0 0 0) 0x7fec08006d40 con 0x7fec040662f0 2023-07-21T22:13:46.372 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:46.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.329+0000 7fec1d200700 1 -- 172.21.15.49:0/3685209532 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec040662f0 msgr2=0x7fec040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:46.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.329+0000 7fec1d200700 1 --2- 172.21.15.49:0/3685209532 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec040662f0 0x7fec040687a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fec08000c00 tx=0x7fec08008030 comp rx=0 tx=0).stop 2023-07-21T22:13:46.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.329+0000 7fec1d200700 1 -- 172.21.15.49:0/3685209532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec18070d30 msgr2=0x7fec1815b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:46.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.329+0000 7fec1d200700 1 --2- 172.21.15.49:0/3685209532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec18070d30 0x7fec1815b190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00e810 tx=0x7fec0c00eb20 comp rx=0 tx=0).stop 2023-07-21T22:13:46.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.329+0000 7fec1d200700 1 -- 172.21.15.49:0/3685209532 shutdown_connections 2023-07-21T22:13:46.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.329+0000 7fec1d200700 1 --2- 172.21.15.49:0/3685209532 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec040662f0 0x7fec040687a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.329+0000 7fec1d200700 1 --2- 172.21.15.49:0/3685209532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec18070d30 0x7fec1815b190 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.329+0000 7fec1d200700 1 --2- 172.21.15.49:0/3685209532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec180cbbd0 0x7fec1815b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.329+0000 7fec1d200700 1 --2- 172.21.15.49:0/3685209532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec1806d630 0x7fec1815c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.329+0000 7fec1d200700 1 -- 172.21.15.49:0/3685209532 >> 172.21.15.49:0/3685209532 conn(0x7fec180cc430 msgr2=0x7fec180b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:46.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.333+0000 7fec1d200700 1 -- 172.21.15.49:0/3685209532 shutdown_connections 2023-07-21T22:13:46.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.333+0000 7fec1d200700 1 -- 172.21.15.49:0/3685209532 wait complete. 2023-07-21T22:13:46.378 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:13:46.397 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2023-07-21T22:13:44.372743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":193,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246988,"kb_used_data":6796,"kb_used_omap":0,"kb_used_meta":240128,"kb_avail":754727732,"statfs":{"total":773094113280,"available":772841197568,"internally_reserved":0,"allocated":6959104,"data_stored":3841462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":245891072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.305549"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.085505+0000","last_change":"2023-07-21T22:13:40.085505+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.085505+0000","last_undegraded":"2023-07-21T22:13:40.085505+0000","last_fullsized":"2023-07-21T22:13:40.085505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.084869+0000","last_change":"2023-07-21T22:13:40.084869+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.084869+0000","last_undegraded":"2023-07-21T22:13:40.084869+0000","last_fullsized":"2023-07-21T22:13:40.084869+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114631+0000","last_change":"2023-07-21T22:13:41.102406+0000","last_active":"2023-07-21T22:13:41.114631+0000","last_peered":"2023-07-21T22:13:41.114631+0000","last_clean":"2023-07-21T22:13:41.114631+0000","last_became_active":"2023-07-21T22:13:41.102137+0000","last_became_peered":"2023-07-21T22:13:41.102137+0000","last_unstale":"2023-07-21T22:13:41.114631+0000","last_undegraded":"2023-07-21T22:13:41.114631+0000","last_fullsized":"2023-07-21T22:13:41.114631+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:35.630446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.109032+0000","last_change":"2023-07-21T22:13:41.093070+0000","last_active":"2023-07-21T22:13:41.109032+0000","last_peered":"2023-07-21T22:13:41.109032+0000","last_clean":"2023-07-21T22:13:41.109032+0000","last_became_active":"2023-07-21T22:13:41.092734+0000","last_became_peered":"2023-07-21T22:13:41.092734+0000","last_unstale":"2023-07-21T22:13:41.109032+0000","last_undegraded":"2023-07-21T22:13:41.109032+0000","last_fullsized":"2023-07-21T22:13:41.109032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:29:54.037991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115829+0000","last_change":"2023-07-21T22:13:41.108849+0000","last_active":"2023-07-21T22:13:41.115829+0000","last_peered":"2023-07-21T22:13:41.115829+0000","last_clean":"2023-07-21T22:13:41.115829+0000","last_became_active":"2023-07-21T22:13:41.108566+0000","last_became_peered":"2023-07-21T22:13:41.108566+0000","last_unstale":"2023-07-21T22:13:41.115829+0000","last_undegraded":"2023-07-21T22:13:41.115829+0000","last_fullsized":"2023-07-21T22:13:41.115829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:18:05.133741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114892+0000","last_change":"2023-07-21T22:13:41.111253+0000","last_active":"2023-07-21T22:13:41.114892+0000","last_peered":"2023-07-21T22:13:41.114892+0000","last_clean":"2023-07-21T22:13:41.114892+0000","last_became_active":"2023-07-21T22:13:41.110498+0000","last_became_peered":"2023-07-21T22:13:41.110498+0000","last_unstale":"2023-07-21T22:13:41.114892+0000","last_undegraded":"2023-07-21T22:13:41.114892+0000","last_fullsized":"2023-07-21T22:13:41.114892+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:52:07.339883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115154+0000","last_change":"2023-07-21T22:13:41.105865+0000","last_active":"2023-07-21T22:13:41.115154+0000","last_peered":"2023-07-21T22:13:41.115154+0000","last_clean":"2023-07-21T22:13:41.115154+0000","last_became_active":"2023-07-21T22:13:41.105567+0000","last_became_peered":"2023-07-21T22:13:41.105567+0000","last_unstale":"2023-07-21T22:13:41.115154+0000","last_undegraded":"2023-07-21T22:13:41.115154+0000","last_fullsized":"2023-07-21T22:13:41.115154+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:44:28.582096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108876+0000","last_change":"2023-07-21T22:13:41.102968+0000","last_active":"2023-07-21T22:13:41.108876+0000","last_peered":"2023-07-21T22:13:41.108876+0000","last_clean":"2023-07-21T22:13:41.108876+0000","last_became_active":"2023-07-21T22:13:41.102713+0000","last_became_peered":"2023-07-21T22:13:41.102713+0000","last_unstale":"2023-07-21T22:13:41.108876+0000","last_undegraded":"2023-07-21T22:13:41.108876+0000","last_fullsized":"2023-07-21T22:13:41.108876+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:37.212909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118275+0000","last_change":"2023-07-21T22:13:41.108597+0000","last_active":"2023-07-21T22:13:41.118275+0000","last_peered":"2023-07-21T22:13:41.118275+0000","last_clean":"2023-07-21T22:13:41.118275+0000","last_became_active":"2023-07-21T22:13:41.108348+0000","last_became_peered":"2023-07-21T22:13:41.108348+0000","last_unstale":"2023-07-21T22:13:41.118275+0000","last_undegraded":"2023-07-21T22:13:41.118275+0000","last_fullsized":"2023-07-21T22:13:41.118275+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:34.485489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115770+0000","last_change":"2023-07-21T22:13:41.104555+0000","last_active":"2023-07-21T22:13:41.115770+0000","last_peered":"2023-07-21T22:13:41.115770+0000","last_clean":"2023-07-21T22:13:41.115770+0000","last_became_active":"2023-07-21T22:13:41.104299+0000","last_became_peered":"2023-07-21T22:13:41.104299+0000","last_unstale":"2023-07-21T22:13:41.115770+0000","last_undegraded":"2023-07-21T22:13:41.115770+0000","last_fullsized":"2023-07-21T22:13:41.115770+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:15:37.915301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115753+0000","last_change":"2023-07-21T22:13:41.103712+0000","last_active":"2023-07-21T22:13:41.115753+0000","last_peered":"2023-07-21T22:13:41.115753+0000","last_clean":"2023-07-21T22:13:41.115753+0000","last_became_active":"2023-07-21T22:13:41.103431+0000","last_became_peered":"2023-07-21T22:13:41.103431+0000","last_unstale":"2023-07-21T22:13:41.115753+0000","last_undegraded":"2023-07-21T22:13:41.115753+0000","last_fullsized":"2023-07-21T22:13:41.115753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:39.364718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108913+0000","last_change":"2023-07-21T22:13:41.104207+0000","last_active":"2023-07-21T22:13:41.108913+0000","last_peered":"2023-07-21T22:13:41.108913+0000","last_clean":"2023-07-21T22:13:41.108913+0000","last_became_active":"2023-07-21T22:13:41.103922+0000","last_became_peered":"2023-07-21T22:13:41.103922+0000","last_unstale":"2023-07-21T22:13:41.108913+0000","last_undegraded":"2023-07-21T22:13:41.108913+0000","last_fullsized":"2023-07-21T22:13:41.108913+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:57.274636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108822+0000","last_change":"2023-07-21T22:13:41.097039+0000","last_active":"2023-07-21T22:13:41.108822+0000","last_peered":"2023-07-21T22:13:41.108822+0000","last_clean":"2023-07-21T22:13:41.108822+0000","last_became_active":"2023-07-21T22:13:41.096761+0000","last_became_peered":"2023-07-21T22:13:41.096761+0000","last_unstale":"2023-07-21T22:13:41.108822+0000","last_undegraded":"2023-07-21T22:13:41.108822+0000","last_fullsized":"2023-07-21T22:13:41.108822+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:15:37.915301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114332+0000","last_change":"2023-07-21T22:13:41.101818+0000","last_active":"2023-07-21T22:13:41.114332+0000","last_peered":"2023-07-21T22:13:41.114332+0000","last_clean":"2023-07-21T22:13:41.114332+0000","last_became_active":"2023-07-21T22:13:41.101516+0000","last_became_peered":"2023-07-21T22:13:41.101516+0000","last_unstale":"2023-07-21T22:13:41.114332+0000","last_undegraded":"2023-07-21T22:13:41.114332+0000","last_fullsized":"2023-07-21T22:13:41.114332+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:01.251820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115313+0000","last_change":"2023-07-21T22:13:41.103892+0000","last_active":"2023-07-21T22:13:41.115313+0000","last_peered":"2023-07-21T22:13:41.115313+0000","last_clean":"2023-07-21T22:13:41.115313+0000","last_became_active":"2023-07-21T22:13:41.103587+0000","last_became_peered":"2023-07-21T22:13:41.103587+0000","last_unstale":"2023-07-21T22:13:41.115313+0000","last_undegraded":"2023-07-21T22:13:41.115313+0000","last_fullsized":"2023-07-21T22:13:41.115313+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:08:19.007621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115207+0000","last_change":"2023-07-21T22:13:41.106608+0000","last_active":"2023-07-21T22:13:41.115207+0000","last_peered":"2023-07-21T22:13:41.115207+0000","last_clean":"2023-07-21T22:13:41.115207+0000","last_became_active":"2023-07-21T22:13:41.106100+0000","last_became_peered":"2023-07-21T22:13:41.106100+0000","last_unstale":"2023-07-21T22:13:41.115207+0000","last_undegraded":"2023-07-21T22:13:41.115207+0000","last_fullsized":"2023-07-21T22:13:41.115207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:14.077369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.082600+0000","last_change":"2023-07-21T22:13:40.082600+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.082600+0000","last_undegraded":"2023-07-21T22:13:40.082600+0000","last_fullsized":"2023-07-21T22:13:40.082600+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115386+0000","last_change":"2023-07-21T22:13:41.098779+0000","last_active":"2023-07-21T22:13:41.115386+0000","last_peered":"2023-07-21T22:13:41.115386+0000","last_clean":"2023-07-21T22:13:41.115386+0000","last_became_active":"2023-07-21T22:13:41.097678+0000","last_became_peered":"2023-07-21T22:13:41.097678+0000","last_unstale":"2023-07-21T22:13:41.115386+0000","last_undegraded":"2023-07-21T22:13:41.115386+0000","last_fullsized":"2023-07-21T22:13:41.115386+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:39.921791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115791+0000","last_change":"2023-07-21T22:13:41.110504+0000","last_active":"2023-07-21T22:13:41.115791+0000","last_peered":"2023-07-21T22:13:41.115791+0000","last_clean":"2023-07-21T22:13:41.115791+0000","last_became_active":"2023-07-21T22:13:41.110211+0000","last_became_peered":"2023-07-21T22:13:41.110211+0000","last_unstale":"2023-07-21T22:13:41.115791+0000","last_undegraded":"2023-07-21T22:13:41.115791+0000","last_fullsized":"2023-07-21T22:13:41.115791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:29:05.960444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.100716+0000","last_change":"2023-07-21T22:13:41.097911+0000","last_active":"2023-07-21T22:13:41.100716+0000","last_peered":"2023-07-21T22:13:41.100716+0000","last_clean":"2023-07-21T22:13:41.100716+0000","last_became_active":"2023-07-21T22:13:41.097604+0000","last_became_peered":"2023-07-21T22:13:41.097604+0000","last_unstale":"2023-07-21T22:13:41.100716+0000","last_undegraded":"2023-07-21T22:13:41.100716+0000","last_fullsized":"2023-07-21T22:13:41.100716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:34.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108802+0000","last_change":"2023-07-21T22:13:41.096467+0000","last_active":"2023-07-21T22:13:41.108802+0000","last_peered":"2023-07-21T22:13:41.108802+0000","last_clean":"2023-07-21T22:13:41.108802+0000","last_became_active":"2023-07-21T22:13:41.093898+0000","last_became_peered":"2023-07-21T22:13:41.093898+0000","last_unstale":"2023-07-21T22:13:41.108802+0000","last_undegraded":"2023-07-21T22:13:41.108802+0000","last_fullsized":"2023-07-21T22:13:41.108802+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:18:48.827452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108350+0000","last_change":"2023-07-21T22:13:41.104555+0000","last_active":"2023-07-21T22:13:41.108350+0000","last_peered":"2023-07-21T22:13:41.108350+0000","last_clean":"2023-07-21T22:13:41.108350+0000","last_became_active":"2023-07-21T22:13:41.104275+0000","last_became_peered":"2023-07-21T22:13:41.104275+0000","last_unstale":"2023-07-21T22:13:41.108350+0000","last_undegraded":"2023-07-21T22:13:41.108350+0000","last_fullsized":"2023-07-21T22:13:41.108350+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:52:50.466773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.109527+0000","last_change":"2023-07-21T22:13:41.103964+0000","last_active":"2023-07-21T22:13:41.109527+0000","last_peered":"2023-07-21T22:13:41.109527+0000","last_clean":"2023-07-21T22:13:41.109527+0000","last_became_active":"2023-07-21T22:13:41.103680+0000","last_became_peered":"2023-07-21T22:13:41.103680+0000","last_unstale":"2023-07-21T22:13:41.109527+0000","last_undegraded":"2023-07-21T22:13:41.109527+0000","last_fullsized":"2023-07-21T22:13:41.109527+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:39.370150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114357+0000","last_change":"2023-07-21T22:13:41.102028+0000","last_active":"2023-07-21T22:13:41.114357+0000","last_peered":"2023-07-21T22:13:41.114357+0000","last_clean":"2023-07-21T22:13:41.114357+0000","last_became_active":"2023-07-21T22:13:41.101730+0000","last_became_peered":"2023-07-21T22:13:41.101730+0000","last_unstale":"2023-07-21T22:13:41.114357+0000","last_undegraded":"2023-07-21T22:13:41.114357+0000","last_fullsized":"2023-07-21T22:13:41.114357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:39.844317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.106848+0000","last_change":"2023-07-21T22:13:41.096075+0000","last_active":"2023-07-21T22:13:41.106848+0000","last_peered":"2023-07-21T22:13:41.106848+0000","last_clean":"2023-07-21T22:13:41.106848+0000","last_became_active":"2023-07-21T22:13:41.093481+0000","last_became_peered":"2023-07-21T22:13:41.093481+0000","last_unstale":"2023-07-21T22:13:41.106848+0000","last_undegraded":"2023-07-21T22:13:41.106848+0000","last_fullsized":"2023-07-21T22:13:41.106848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:44.826686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108850+0000","last_change":"2023-07-21T22:13:41.098370+0000","last_active":"2023-07-21T22:13:41.108850+0000","last_peered":"2023-07-21T22:13:41.108850+0000","last_clean":"2023-07-21T22:13:41.108850+0000","last_became_active":"2023-07-21T22:13:41.098102+0000","last_became_peered":"2023-07-21T22:13:41.098102+0000","last_unstale":"2023-07-21T22:13:41.108850+0000","last_undegraded":"2023-07-21T22:13:41.108850+0000","last_fullsized":"2023-07-21T22:13:41.108850+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:34.485489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.113081+0000","last_change":"2023-07-21T22:13:41.097502+0000","last_active":"2023-07-21T22:13:41.113081+0000","last_peered":"2023-07-21T22:13:41.113081+0000","last_clean":"2023-07-21T22:13:41.113081+0000","last_became_active":"2023-07-21T22:13:41.097033+0000","last_became_peered":"2023-07-21T22:13:41.097033+0000","last_unstale":"2023-07-21T22:13:41.113081+0000","last_undegraded":"2023-07-21T22:13:41.113081+0000","last_fullsized":"2023-07-21T22:13:41.113081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:37.732164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.084808+0000","last_change":"2023-07-21T22:13:40.084808+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.084808+0000","last_undegraded":"2023-07-21T22:13:40.084808+0000","last_fullsized":"2023-07-21T22:13:40.084808+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114482+0000","last_change":"2023-07-21T22:13:41.102785+0000","last_active":"2023-07-21T22:13:41.114482+0000","last_peered":"2023-07-21T22:13:41.114482+0000","last_clean":"2023-07-21T22:13:41.114482+0000","last_became_active":"2023-07-21T22:13:41.102481+0000","last_became_peered":"2023-07-21T22:13:41.102481+0000","last_unstale":"2023-07-21T22:13:41.114482+0000","last_undegraded":"2023-07-21T22:13:41.114482+0000","last_fullsized":"2023-07-21T22:13:41.114482+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:19.379168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108932+0000","last_change":"2023-07-21T22:13:41.101943+0000","last_active":"2023-07-21T22:13:41.108932+0000","last_peered":"2023-07-21T22:13:41.108932+0000","last_clean":"2023-07-21T22:13:41.108932+0000","last_became_active":"2023-07-21T22:13:41.101635+0000","last_became_peered":"2023-07-21T22:13:41.101635+0000","last_unstale":"2023-07-21T22:13:41.108932+0000","last_undegraded":"2023-07-21T22:13:41.108932+0000","last_fullsized":"2023-07-21T22:13:41.108932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:01:51.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115272+0000","last_change":"2023-07-21T22:13:41.096068+0000","last_active":"2023-07-21T22:13:41.115272+0000","last_peered":"2023-07-21T22:13:41.115272+0000","last_clean":"2023-07-21T22:13:41.115272+0000","last_became_active":"2023-07-21T22:13:41.095783+0000","last_became_peered":"2023-07-21T22:13:41.095783+0000","last_unstale":"2023-07-21T22:13:41.115272+0000","last_undegraded":"2023-07-21T22:13:41.115272+0000","last_fullsized":"2023-07-21T22:13:41.115272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:51:09.826591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114831+0000","last_change":"2023-07-21T22:13:41.110068+0000","last_active":"2023-07-21T22:13:41.114831+0000","last_peered":"2023-07-21T22:13:41.114831+0000","last_clean":"2023-07-21T22:13:41.114831+0000","last_became_active":"2023-07-21T22:13:41.109762+0000","last_became_peered":"2023-07-21T22:13:41.109762+0000","last_unstale":"2023-07-21T22:13:41.114831+0000","last_undegraded":"2023-07-21T22:13:41.114831+0000","last_fullsized":"2023-07-21T22:13:41.114831+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:44:09.003020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112528+0000","last_change":"2023-07-21T22:13:41.107081+0000","last_active":"2023-07-21T22:13:41.112528+0000","last_peered":"2023-07-21T22:13:41.112528+0000","last_clean":"2023-07-21T22:13:41.112528+0000","last_became_active":"2023-07-21T22:13:41.106787+0000","last_became_peered":"2023-07-21T22:13:41.106787+0000","last_unstale":"2023-07-21T22:13:41.112528+0000","last_undegraded":"2023-07-21T22:13:41.112528+0000","last_fullsized":"2023-07-21T22:13:41.112528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:34:48.139648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.102949+0000","last_change":"2023-07-21T22:13:40.101387+0000","last_active":"2023-07-21T22:13:40.102949+0000","last_peered":"2023-07-21T22:13:40.102949+0000","last_clean":"2023-07-21T22:13:40.102949+0000","last_became_active":"2023-07-21T22:13:40.100913+0000","last_became_peered":"2023-07-21T22:13:40.100913+0000","last_unstale":"2023-07-21T22:13:40.102949+0000","last_undegraded":"2023-07-21T22:13:40.102949+0000","last_fullsized":"2023-07-21T22:13:40.102949+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:58:58.055258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112989+0000","last_change":"2023-07-21T22:13:41.096891+0000","last_active":"2023-07-21T22:13:41.112989+0000","last_peered":"2023-07-21T22:13:41.112989+0000","last_clean":"2023-07-21T22:13:41.112989+0000","last_became_active":"2023-07-21T22:13:41.095295+0000","last_became_peered":"2023-07-21T22:13:41.095295+0000","last_unstale":"2023-07-21T22:13:41.112989+0000","last_undegraded":"2023-07-21T22:13:41.112989+0000","last_fullsized":"2023-07-21T22:13:41.112989+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:14.952691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.121232+0000","last_change":"2023-07-21T22:13:40.094443+0000","last_active":"2023-07-21T22:13:41.121232+0000","last_peered":"2023-07-21T22:13:41.121232+0000","last_clean":"2023-07-21T22:13:41.121232+0000","last_became_active":"2023-07-21T22:13:40.094114+0000","last_became_peered":"2023-07-21T22:13:40.094114+0000","last_unstale":"2023-07-21T22:13:41.121232+0000","last_undegraded":"2023-07-21T22:13:41.121232+0000","last_fullsized":"2023-07-21T22:13:41.121232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:28.818934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.101929+0000","last_change":"2023-07-21T22:13:41.097322+0000","last_active":"2023-07-21T22:13:41.101929+0000","last_peered":"2023-07-21T22:13:41.101929+0000","last_clean":"2023-07-21T22:13:41.101929+0000","last_became_active":"2023-07-21T22:13:41.097054+0000","last_became_peered":"2023-07-21T22:13:41.097054+0000","last_unstale":"2023-07-21T22:13:41.101929+0000","last_undegraded":"2023-07-21T22:13:41.101929+0000","last_fullsized":"2023-07-21T22:13:41.101929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:24.106186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.122724+0000","last_change":"2023-07-21T22:13:40.087761+0000","last_active":"2023-07-21T22:13:41.122724+0000","last_peered":"2023-07-21T22:13:41.122724+0000","last_clean":"2023-07-21T22:13:41.122724+0000","last_became_active":"2023-07-21T22:13:40.087468+0000","last_became_peered":"2023-07-21T22:13:40.087468+0000","last_unstale":"2023-07-21T22:13:41.122724+0000","last_undegraded":"2023-07-21T22:13:41.122724+0000","last_fullsized":"2023-07-21T22:13:41.122724+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:53.822832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115750+0000","last_change":"2023-07-21T22:13:41.104006+0000","last_active":"2023-07-21T22:13:41.115750+0000","last_peered":"2023-07-21T22:13:41.115750+0000","last_clean":"2023-07-21T22:13:41.115750+0000","last_became_active":"2023-07-21T22:13:41.103736+0000","last_became_peered":"2023-07-21T22:13:41.103736+0000","last_unstale":"2023-07-21T22:13:41.115750+0000","last_undegraded":"2023-07-21T22:13:41.115750+0000","last_fullsized":"2023-07-21T22:13:41.115750+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:01:51.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.121997+0000","last_change":"2023-07-21T22:13:40.096070+0000","last_active":"2023-07-21T22:13:41.121997+0000","last_peered":"2023-07-21T22:13:41.121997+0000","last_clean":"2023-07-21T22:13:41.121997+0000","last_became_active":"2023-07-21T22:13:40.095788+0000","last_became_peered":"2023-07-21T22:13:40.095788+0000","last_unstale":"2023-07-21T22:13:41.121997+0000","last_undegraded":"2023-07-21T22:13:41.121997+0000","last_fullsized":"2023-07-21T22:13:41.121997+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:44:32.650671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115187+0000","last_change":"2023-07-21T22:13:41.106371+0000","last_active":"2023-07-21T22:13:41.115187+0000","last_peered":"2023-07-21T22:13:41.115187+0000","last_clean":"2023-07-21T22:13:41.115187+0000","last_became_active":"2023-07-21T22:13:41.105701+0000","last_became_peered":"2023-07-21T22:13:41.105701+0000","last_unstale":"2023-07-21T22:13:41.115187+0000","last_undegraded":"2023-07-21T22:13:41.115187+0000","last_fullsized":"2023-07-21T22:13:41.115187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:34:03.908679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119232+0000","last_change":"2023-07-21T22:13:40.091865+0000","last_active":"2023-07-21T22:13:41.119232+0000","last_peered":"2023-07-21T22:13:41.119232+0000","last_clean":"2023-07-21T22:13:41.119232+0000","last_became_active":"2023-07-21T22:13:40.091563+0000","last_became_peered":"2023-07-21T22:13:40.091563+0000","last_unstale":"2023-07-21T22:13:41.119232+0000","last_undegraded":"2023-07-21T22:13:41.119232+0000","last_fullsized":"2023-07-21T22:13:41.119232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:07.095120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.080876+0000","last_change":"2023-07-21T22:13:40.080876+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.080876+0000","last_undegraded":"2023-07-21T22:13:40.080876+0000","last_fullsized":"2023-07-21T22:13:40.080876+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118983+0000","last_change":"2023-07-21T22:13:40.088623+0000","last_active":"2023-07-21T22:13:41.118983+0000","last_peered":"2023-07-21T22:13:41.118983+0000","last_clean":"2023-07-21T22:13:41.118983+0000","last_became_active":"2023-07-21T22:13:40.088019+0000","last_became_peered":"2023-07-21T22:13:40.088019+0000","last_unstale":"2023-07-21T22:13:41.118983+0000","last_undegraded":"2023-07-21T22:13:41.118983+0000","last_fullsized":"2023-07-21T22:13:41.118983+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:11:27.016587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112409+0000","last_change":"2023-07-21T22:13:41.100003+0000","last_active":"2023-07-21T22:13:41.112409+0000","last_peered":"2023-07-21T22:13:41.112409+0000","last_clean":"2023-07-21T22:13:41.112409+0000","last_became_active":"2023-07-21T22:13:41.099703+0000","last_became_peered":"2023-07-21T22:13:41.099703+0000","last_unstale":"2023-07-21T22:13:41.112409+0000","last_undegraded":"2023-07-21T22:13:41.112409+0000","last_fullsized":"2023-07-21T22:13:41.112409+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:12:26.575731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078570+0000","last_change":"2023-07-21T22:13:40.092332+0000","last_active":"2023-07-21T22:13:41.078570+0000","last_peered":"2023-07-21T22:13:41.078570+0000","last_clean":"2023-07-21T22:13:41.078570+0000","last_became_active":"2023-07-21T22:13:40.091709+0000","last_became_peered":"2023-07-21T22:13:40.091709+0000","last_unstale":"2023-07-21T22:13:41.078570+0000","last_undegraded":"2023-07-21T22:13:41.078570+0000","last_fullsized":"2023-07-21T22:13:41.078570+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:00.067789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.100801+0000","last_change":"2023-07-21T22:13:41.096538+0000","last_active":"2023-07-21T22:13:41.100801+0000","last_peered":"2023-07-21T22:13:41.100801+0000","last_clean":"2023-07-21T22:13:41.100801+0000","last_became_active":"2023-07-21T22:13:41.096233+0000","last_became_peered":"2023-07-21T22:13:41.096233+0000","last_unstale":"2023-07-21T22:13:41.100801+0000","last_undegraded":"2023-07-21T22:13:41.100801+0000","last_fullsized":"2023-07-21T22:13:41.100801+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:55:28.232508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.088154+0000","last_change":"2023-07-21T22:13:40.099452+0000","last_active":"2023-07-21T22:13:41.088154+0000","last_peered":"2023-07-21T22:13:41.088154+0000","last_clean":"2023-07-21T22:13:41.088154+0000","last_became_active":"2023-07-21T22:13:40.099144+0000","last_became_peered":"2023-07-21T22:13:40.099144+0000","last_unstale":"2023-07-21T22:13:41.088154+0000","last_undegraded":"2023-07-21T22:13:41.088154+0000","last_fullsized":"2023-07-21T22:13:41.088154+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:51:43.066212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.084347+0000","last_change":"2023-07-21T22:13:40.084347+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.084347+0000","last_undegraded":"2023-07-21T22:13:40.084347+0000","last_fullsized":"2023-07-21T22:13:40.084347+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.088801+0000","last_change":"2023-07-21T22:13:40.100806+0000","last_active":"2023-07-21T22:13:41.088801+0000","last_peered":"2023-07-21T22:13:41.088801+0000","last_clean":"2023-07-21T22:13:41.088801+0000","last_became_active":"2023-07-21T22:13:40.100450+0000","last_became_peered":"2023-07-21T22:13:40.100450+0000","last_unstale":"2023-07-21T22:13:41.088801+0000","last_undegraded":"2023-07-21T22:13:41.088801+0000","last_fullsized":"2023-07-21T22:13:41.088801+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:16:10.411350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.092547+0000","last_change":"2023-07-21T22:13:41.089865+0000","last_active":"2023-07-21T22:13:41.092547+0000","last_peered":"2023-07-21T22:13:41.092547+0000","last_clean":"2023-07-21T22:13:41.092547+0000","last_became_active":"2023-07-21T22:13:41.089516+0000","last_became_peered":"2023-07-21T22:13:41.089516+0000","last_unstale":"2023-07-21T22:13:41.092547+0000","last_undegraded":"2023-07-21T22:13:41.092547+0000","last_fullsized":"2023-07-21T22:13:41.092547+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:24:50.488362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.081111+0000","last_change":"2023-07-21T22:13:40.094632+0000","last_active":"2023-07-21T22:13:41.081111+0000","last_peered":"2023-07-21T22:13:41.081111+0000","last_clean":"2023-07-21T22:13:41.081111+0000","last_became_active":"2023-07-21T22:13:40.094368+0000","last_became_peered":"2023-07-21T22:13:40.094368+0000","last_unstale":"2023-07-21T22:13:41.081111+0000","last_undegraded":"2023-07-21T22:13:41.081111+0000","last_fullsized":"2023-07-21T22:13:41.081111+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:09.684014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115717+0000","last_change":"2023-07-21T22:13:41.108001+0000","last_active":"2023-07-21T22:13:41.115717+0000","last_peered":"2023-07-21T22:13:41.115717+0000","last_clean":"2023-07-21T22:13:41.115717+0000","last_became_active":"2023-07-21T22:13:41.107733+0000","last_became_peered":"2023-07-21T22:13:41.107733+0000","last_unstale":"2023-07-21T22:13:41.115717+0000","last_undegraded":"2023-07-21T22:13:41.115717+0000","last_fullsized":"2023-07-21T22:13:41.115717+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:53:48.587220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118808+0000","last_change":"2023-07-21T22:13:40.098392+0000","last_active":"2023-07-21T22:13:41.118808+0000","last_peered":"2023-07-21T22:13:41.118808+0000","last_clean":"2023-07-21T22:13:41.118808+0000","last_became_active":"2023-07-21T22:13:40.098099+0000","last_became_peered":"2023-07-21T22:13:40.098099+0000","last_unstale":"2023-07-21T22:13:41.118808+0000","last_undegraded":"2023-07-21T22:13:41.118808+0000","last_fullsized":"2023-07-21T22:13:41.118808+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:04.466014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107884+0000","last_change":"2023-07-21T22:13:41.092950+0000","last_active":"2023-07-21T22:13:41.107884+0000","last_peered":"2023-07-21T22:13:41.107884+0000","last_clean":"2023-07-21T22:13:41.107884+0000","last_became_active":"2023-07-21T22:13:41.092105+0000","last_became_peered":"2023-07-21T22:13:41.092105+0000","last_unstale":"2023-07-21T22:13:41.107884+0000","last_undegraded":"2023-07-21T22:13:41.107884+0000","last_fullsized":"2023-07-21T22:13:41.107884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:33.372984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.096783+0000","last_change":"2023-07-21T22:13:40.094145+0000","last_active":"2023-07-21T22:13:40.096783+0000","last_peered":"2023-07-21T22:13:40.096783+0000","last_clean":"2023-07-21T22:13:40.096783+0000","last_became_active":"2023-07-21T22:13:40.093633+0000","last_became_peered":"2023-07-21T22:13:40.093633+0000","last_unstale":"2023-07-21T22:13:40.096783+0000","last_undegraded":"2023-07-21T22:13:40.096783+0000","last_fullsized":"2023-07-21T22:13:40.096783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:54.880684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.116141+0000","last_change":"2023-07-21T22:13:41.103922+0000","last_active":"2023-07-21T22:13:41.116141+0000","last_peered":"2023-07-21T22:13:41.116141+0000","last_clean":"2023-07-21T22:13:41.116141+0000","last_became_active":"2023-07-21T22:13:41.103642+0000","last_became_peered":"2023-07-21T22:13:41.103642+0000","last_unstale":"2023-07-21T22:13:41.116141+0000","last_undegraded":"2023-07-21T22:13:41.116141+0000","last_fullsized":"2023-07-21T22:13:41.116141+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:47:44.351565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119015+0000","last_change":"2023-07-21T22:13:40.096493+0000","last_active":"2023-07-21T22:13:41.119015+0000","last_peered":"2023-07-21T22:13:41.119015+0000","last_clean":"2023-07-21T22:13:41.119015+0000","last_became_active":"2023-07-21T22:13:40.096174+0000","last_became_peered":"2023-07-21T22:13:40.096174+0000","last_unstale":"2023-07-21T22:13:41.119015+0000","last_undegraded":"2023-07-21T22:13:41.119015+0000","last_fullsized":"2023-07-21T22:13:41.119015+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:50:47.997077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107074+0000","last_change":"2023-07-21T22:13:41.095610+0000","last_active":"2023-07-21T22:13:41.107074+0000","last_peered":"2023-07-21T22:13:41.107074+0000","last_clean":"2023-07-21T22:13:41.107074+0000","last_became_active":"2023-07-21T22:13:41.092550+0000","last_became_peered":"2023-07-21T22:13:41.092550+0000","last_unstale":"2023-07-21T22:13:41.107074+0000","last_undegraded":"2023-07-21T22:13:41.107074+0000","last_fullsized":"2023-07-21T22:13:41.107074+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:02:55.094217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080696+0000","last_change":"2023-07-21T22:13:40.095144+0000","last_active":"2023-07-21T22:13:41.080696+0000","last_peered":"2023-07-21T22:13:41.080696+0000","last_clean":"2023-07-21T22:13:41.080696+0000","last_became_active":"2023-07-21T22:13:40.094633+0000","last_became_peered":"2023-07-21T22:13:40.094633+0000","last_unstale":"2023-07-21T22:13:41.080696+0000","last_undegraded":"2023-07-21T22:13:41.080696+0000","last_fullsized":"2023-07-21T22:13:41.080696+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:16:10.411350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112455+0000","last_change":"2023-07-21T22:13:41.103229+0000","last_active":"2023-07-21T22:13:41.112455+0000","last_peered":"2023-07-21T22:13:41.112455+0000","last_clean":"2023-07-21T22:13:41.112455+0000","last_became_active":"2023-07-21T22:13:41.102919+0000","last_became_peered":"2023-07-21T22:13:41.102919+0000","last_unstale":"2023-07-21T22:13:41.112455+0000","last_undegraded":"2023-07-21T22:13:41.112455+0000","last_fullsized":"2023-07-21T22:13:41.112455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:57:31.042080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.090400+0000","last_change":"2023-07-21T22:13:40.097496+0000","last_active":"2023-07-21T22:13:41.090400+0000","last_peered":"2023-07-21T22:13:41.090400+0000","last_clean":"2023-07-21T22:13:41.090400+0000","last_became_active":"2023-07-21T22:13:40.097141+0000","last_became_peered":"2023-07-21T22:13:40.097141+0000","last_unstale":"2023-07-21T22:13:41.090400+0000","last_undegraded":"2023-07-21T22:13:41.090400+0000","last_fullsized":"2023-07-21T22:13:41.090400+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:01.084349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.080932+0000","last_change":"2023-07-21T22:13:40.080932+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.080932+0000","last_undegraded":"2023-07-21T22:13:40.080932+0000","last_fullsized":"2023-07-21T22:13:40.080932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.123480+0000","last_change":"2023-07-21T22:13:40.093508+0000","last_active":"2023-07-21T22:13:41.123480+0000","last_peered":"2023-07-21T22:13:41.123480+0000","last_clean":"2023-07-21T22:13:41.123480+0000","last_became_active":"2023-07-21T22:13:40.093118+0000","last_became_peered":"2023-07-21T22:13:40.093118+0000","last_unstale":"2023-07-21T22:13:41.123480+0000","last_undegraded":"2023-07-21T22:13:41.123480+0000","last_fullsized":"2023-07-21T22:13:41.123480+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:05:47.861560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.117774+0000","last_change":"2023-07-21T22:13:41.114988+0000","last_active":"2023-07-21T22:13:41.117774+0000","last_peered":"2023-07-21T22:13:41.117774+0000","last_clean":"2023-07-21T22:13:41.117774+0000","last_became_active":"2023-07-21T22:13:41.114608+0000","last_became_peered":"2023-07-21T22:13:41.114608+0000","last_unstale":"2023-07-21T22:13:41.117774+0000","last_undegraded":"2023-07-21T22:13:41.117774+0000","last_fullsized":"2023-07-21T22:13:41.117774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:12:14.393410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.120885+0000","last_change":"2023-07-21T22:13:40.095884+0000","last_active":"2023-07-21T22:13:41.120885+0000","last_peered":"2023-07-21T22:13:41.120885+0000","last_clean":"2023-07-21T22:13:41.120885+0000","last_became_active":"2023-07-21T22:13:40.095515+0000","last_became_peered":"2023-07-21T22:13:40.095515+0000","last_unstale":"2023-07-21T22:13:41.120885+0000","last_undegraded":"2023-07-21T22:13:41.120885+0000","last_fullsized":"2023-07-21T22:13:41.120885+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:29:53.027086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.111417+0000","last_change":"2023-07-21T22:13:41.099642+0000","last_active":"2023-07-21T22:13:41.111417+0000","last_peered":"2023-07-21T22:13:41.111417+0000","last_clean":"2023-07-21T22:13:41.111417+0000","last_became_active":"2023-07-21T22:13:41.099177+0000","last_became_peered":"2023-07-21T22:13:41.099177+0000","last_unstale":"2023-07-21T22:13:41.111417+0000","last_undegraded":"2023-07-21T22:13:41.111417+0000","last_fullsized":"2023-07-21T22:13:41.111417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:26.604799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080984+0000","last_change":"2023-07-21T22:13:40.089926+0000","last_active":"2023-07-21T22:13:41.080984+0000","last_peered":"2023-07-21T22:13:41.080984+0000","last_clean":"2023-07-21T22:13:41.080984+0000","last_became_active":"2023-07-21T22:13:40.089612+0000","last_became_peered":"2023-07-21T22:13:40.089612+0000","last_unstale":"2023-07-21T22:13:41.080984+0000","last_undegraded":"2023-07-21T22:13:41.080984+0000","last_fullsized":"2023-07-21T22:13:41.080984+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:01.084349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.101400+0000","last_change":"2023-07-21T22:13:41.092119+0000","last_active":"2023-07-21T22:13:41.101400+0000","last_peered":"2023-07-21T22:13:41.101400+0000","last_clean":"2023-07-21T22:13:41.101400+0000","last_became_active":"2023-07-21T22:13:41.091845+0000","last_became_peered":"2023-07-21T22:13:41.091845+0000","last_unstale":"2023-07-21T22:13:41.101400+0000","last_undegraded":"2023-07-21T22:13:41.101400+0000","last_fullsized":"2023-07-21T22:13:41.101400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:43:59.156552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.084066+0000","last_change":"2023-07-21T22:13:40.087676+0000","last_active":"2023-07-21T22:13:41.084066+0000","last_peered":"2023-07-21T22:13:41.084066+0000","last_clean":"2023-07-21T22:13:41.084066+0000","last_became_active":"2023-07-21T22:13:40.087408+0000","last_became_peered":"2023-07-21T22:13:40.087408+0000","last_unstale":"2023-07-21T22:13:41.084066+0000","last_undegraded":"2023-07-21T22:13:41.084066+0000","last_fullsized":"2023-07-21T22:13:41.084066+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:57:08.795253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107260+0000","last_change":"2023-07-21T22:13:41.098307+0000","last_active":"2023-07-21T22:13:41.107260+0000","last_peered":"2023-07-21T22:13:41.107260+0000","last_clean":"2023-07-21T22:13:41.107260+0000","last_became_active":"2023-07-21T22:13:41.097931+0000","last_became_peered":"2023-07-21T22:13:41.097931+0000","last_unstale":"2023-07-21T22:13:41.107260+0000","last_undegraded":"2023-07-21T22:13:41.107260+0000","last_fullsized":"2023-07-21T22:13:41.107260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:12:25.824212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.096763+0000","last_change":"2023-07-21T22:13:40.093966+0000","last_active":"2023-07-21T22:13:40.096763+0000","last_peered":"2023-07-21T22:13:40.096763+0000","last_clean":"2023-07-21T22:13:40.096763+0000","last_became_active":"2023-07-21T22:13:40.093353+0000","last_became_peered":"2023-07-21T22:13:40.093353+0000","last_unstale":"2023-07-21T22:13:40.096763+0000","last_undegraded":"2023-07-21T22:13:40.096763+0000","last_fullsized":"2023-07-21T22:13:40.096763+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:35:49.579192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112511+0000","last_change":"2023-07-21T22:13:41.105050+0000","last_active":"2023-07-21T22:13:41.112511+0000","last_peered":"2023-07-21T22:13:41.112511+0000","last_clean":"2023-07-21T22:13:41.112511+0000","last_became_active":"2023-07-21T22:13:41.104758+0000","last_became_peered":"2023-07-21T22:13:41.104758+0000","last_unstale":"2023-07-21T22:13:41.112511+0000","last_undegraded":"2023-07-21T22:13:41.112511+0000","last_fullsized":"2023-07-21T22:13:41.112511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:59.926223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.088595+0000","last_change":"2023-07-21T22:13:40.097222+0000","last_active":"2023-07-21T22:13:41.088595+0000","last_peered":"2023-07-21T22:13:41.088595+0000","last_clean":"2023-07-21T22:13:41.088595+0000","last_became_active":"2023-07-21T22:13:40.096883+0000","last_became_peered":"2023-07-21T22:13:40.096883+0000","last_unstale":"2023-07-21T22:13:41.088595+0000","last_undegraded":"2023-07-21T22:13:41.088595+0000","last_fullsized":"2023-07-21T22:13:41.088595+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:43:58.145647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115833+0000","last_change":"2023-07-21T22:13:41.104606+0000","last_active":"2023-07-21T22:13:41.115833+0000","last_peered":"2023-07-21T22:13:41.115833+0000","last_clean":"2023-07-21T22:13:41.115833+0000","last_became_active":"2023-07-21T22:13:41.104358+0000","last_became_peered":"2023-07-21T22:13:41.104358+0000","last_unstale":"2023-07-21T22:13:41.115833+0000","last_undegraded":"2023-07-21T22:13:41.115833+0000","last_fullsized":"2023-07-21T22:13:41.115833+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:29:40.368592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078740+0000","last_change":"2023-07-21T22:13:40.097893+0000","last_active":"2023-07-21T22:13:41.078740+0000","last_peered":"2023-07-21T22:13:41.078740+0000","last_clean":"2023-07-21T22:13:41.078740+0000","last_became_active":"2023-07-21T22:13:40.097514+0000","last_became_peered":"2023-07-21T22:13:40.097514+0000","last_unstale":"2023-07-21T22:13:41.078740+0000","last_undegraded":"2023-07-21T22:13:41.078740+0000","last_fullsized":"2023-07-21T22:13:41.078740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:42:29.625435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-07-21T22:13:40.081200+0000","last_change":"2023-07-21T22:13:40.081200+0000","last_active":"2023-07-21T22:13:40.060998+0000","last_peered":"2023-07-21T22:13:40.060998+0000","last_clean":"2023-07-21T22:13:40.060998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:13:40.081200+0000","last_undegraded":"2023-07-21T22:13:40.081200+0000","last_fullsized":"2023-07-21T22:13:40.081200+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078342+0000","last_change":"2023-07-21T22:13:40.092519+0000","last_active":"2023-07-21T22:13:41.078342+0000","last_peered":"2023-07-21T22:13:41.078342+0000","last_clean":"2023-07-21T22:13:41.078342+0000","last_became_active":"2023-07-21T22:13:40.092070+0000","last_became_peered":"2023-07-21T22:13:40.092070+0000","last_unstale":"2023-07-21T22:13:41.078342+0000","last_undegraded":"2023-07-21T22:13:41.078342+0000","last_fullsized":"2023-07-21T22:13:41.078342+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:57:23.225259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115146+0000","last_change":"2023-07-21T22:13:41.107176+0000","last_active":"2023-07-21T22:13:41.115146+0000","last_peered":"2023-07-21T22:13:41.115146+0000","last_clean":"2023-07-21T22:13:41.115146+0000","last_became_active":"2023-07-21T22:13:41.106910+0000","last_became_peered":"2023-07-21T22:13:41.106910+0000","last_unstale":"2023-07-21T22:13:41.115146+0000","last_undegraded":"2023-07-21T22:13:41.115146+0000","last_fullsized":"2023-07-21T22:13:41.115146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:23:43.440412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.101793+0000","last_change":"2023-07-21T22:13:40.096525+0000","last_active":"2023-07-21T22:13:40.101793+0000","last_peered":"2023-07-21T22:13:40.101793+0000","last_clean":"2023-07-21T22:13:40.101793+0000","last_became_active":"2023-07-21T22:13:40.096154+0000","last_became_peered":"2023-07-21T22:13:40.096154+0000","last_unstale":"2023-07-21T22:13:40.101793+0000","last_undegraded":"2023-07-21T22:13:40.101793+0000","last_fullsized":"2023-07-21T22:13:40.101793+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:37:09.117491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.100241+0000","last_change":"2023-07-21T22:13:41.097870+0000","last_active":"2023-07-21T22:13:41.100241+0000","last_peered":"2023-07-21T22:13:41.100241+0000","last_clean":"2023-07-21T22:13:41.100241+0000","last_became_active":"2023-07-21T22:13:41.097551+0000","last_became_peered":"2023-07-21T22:13:41.097551+0000","last_unstale":"2023-07-21T22:13:41.100241+0000","last_undegraded":"2023-07-21T22:13:41.100241+0000","last_fullsized":"2023-07-21T22:13:41.100241+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:06.859565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080550+0000","last_change":"2023-07-21T22:13:40.087863+0000","last_active":"2023-07-21T22:13:41.080550+0000","last_peered":"2023-07-21T22:13:41.080550+0000","last_clean":"2023-07-21T22:13:41.080550+0000","last_became_active":"2023-07-21T22:13:40.087564+0000","last_became_peered":"2023-07-21T22:13:40.087564+0000","last_unstale":"2023-07-21T22:13:41.080550+0000","last_undegraded":"2023-07-21T22:13:41.080550+0000","last_fullsized":"2023-07-21T22:13:41.080550+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:18:30.093515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.089156+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:13:41.089156+0000","last_peered":"2023-07-21T22:13:41.089156+0000","last_clean":"2023-07-21T22:13:41.089156+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:13:41.089156+0000","last_undegraded":"2023-07-21T22:13:41.089156+0000","last_fullsized":"2023-07-21T22:13:41.089156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:23.622141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115411+0000","last_change":"2023-07-21T22:13:41.098808+0000","last_active":"2023-07-21T22:13:41.115411+0000","last_peered":"2023-07-21T22:13:41.115411+0000","last_clean":"2023-07-21T22:13:41.115411+0000","last_became_active":"2023-07-21T22:13:41.097724+0000","last_became_peered":"2023-07-21T22:13:41.097724+0000","last_unstale":"2023-07-21T22:13:41.115411+0000","last_undegraded":"2023-07-21T22:13:41.115411+0000","last_fullsized":"2023-07-21T22:13:41.115411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:14.461183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118701+0000","last_change":"2023-07-21T22:13:40.098471+0000","last_active":"2023-07-21T22:13:41.118701+0000","last_peered":"2023-07-21T22:13:41.118701+0000","last_clean":"2023-07-21T22:13:41.118701+0000","last_became_active":"2023-07-21T22:13:40.098189+0000","last_became_peered":"2023-07-21T22:13:40.098189+0000","last_unstale":"2023-07-21T22:13:41.118701+0000","last_undegraded":"2023-07-21T22:13:41.118701+0000","last_fullsized":"2023-07-21T22:13:41.118701+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:08:17.401688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":82,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.088290+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:13:40.088290+0000","last_peered":"2023-07-21T22:13:40.088290+0000","last_clean":"2023-07-21T22:13:40.088290+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:13:40.088290+0000","last_undegraded":"2023-07-21T22:13:40.088290+0000","last_fullsized":"2023-07-21T22:13:40.088290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:04.506510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115773+0000","last_change":"2023-07-21T22:13:41.109484+0000","last_active":"2023-07-21T22:13:41.115773+0000","last_peered":"2023-07-21T22:13:41.115773+0000","last_clean":"2023-07-21T22:13:41.115773+0000","last_became_active":"2023-07-21T22:13:41.109190+0000","last_became_peered":"2023-07-21T22:13:41.109190+0000","last_unstale":"2023-07-21T22:13:41.115773+0000","last_undegraded":"2023-07-21T22:13:41.115773+0000","last_fullsized":"2023-07-21T22:13:41.115773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:22:22.225547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119598+0000","last_change":"2023-07-21T22:13:40.100805+0000","last_active":"2023-07-21T22:13:41.119598+0000","last_peered":"2023-07-21T22:13:41.119598+0000","last_clean":"2023-07-21T22:13:41.119598+0000","last_became_active":"2023-07-21T22:13:40.100494+0000","last_became_peered":"2023-07-21T22:13:40.100494+0000","last_unstale":"2023-07-21T22:13:41.119598+0000","last_undegraded":"2023-07-21T22:13:41.119598+0000","last_fullsized":"2023-07-21T22:13:41.119598+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:56.263731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.086487+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:13:41.086487+0000","last_peered":"2023-07-21T22:13:41.086487+0000","last_clean":"2023-07-21T22:13:41.086487+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:13:41.086487+0000","last_undegraded":"2023-07-21T22:13:41.086487+0000","last_fullsized":"2023-07-21T22:13:41.086487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:36.844419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.120524+0000","last_change":"2023-07-21T22:13:41.117194+0000","last_active":"2023-07-21T22:13:41.120524+0000","last_peered":"2023-07-21T22:13:41.120524+0000","last_clean":"2023-07-21T22:13:41.120524+0000","last_became_active":"2023-07-21T22:13:41.116856+0000","last_became_peered":"2023-07-21T22:13:41.116856+0000","last_unstale":"2023-07-21T22:13:41.120524+0000","last_undegraded":"2023-07-21T22:13:41.120524+0000","last_fullsized":"2023-07-21T22:13:41.120524+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:02:55.094217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119515+0000","last_change":"2023-07-21T22:13:40.096336+0000","last_active":"2023-07-21T22:13:41.119515+0000","last_peered":"2023-07-21T22:13:41.119515+0000","last_clean":"2023-07-21T22:13:41.119515+0000","last_became_active":"2023-07-21T22:13:40.095997+0000","last_became_peered":"2023-07-21T22:13:40.095997+0000","last_unstale":"2023-07-21T22:13:41.119515+0000","last_undegraded":"2023-07-21T22:13:41.119515+0000","last_fullsized":"2023-07-21T22:13:41.119515+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:40.777899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":82,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-07-21T22:13:40.088052+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:13:40.088052+0000","last_peered":"2023-07-21T22:13:40.088052+0000","last_clean":"2023-07-21T22:13:40.088052+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:13:40.088052+0000","last_undegraded":"2023-07-21T22:13:40.088052+0000","last_fullsized":"2023-07-21T22:13:40.088052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:04:29.247679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112435+0000","last_change":"2023-07-21T22:13:41.100147+0000","last_active":"2023-07-21T22:13:41.112435+0000","last_peered":"2023-07-21T22:13:41.112435+0000","last_clean":"2023-07-21T22:13:41.112435+0000","last_became_active":"2023-07-21T22:13:41.099829+0000","last_became_peered":"2023-07-21T22:13:41.099829+0000","last_unstale":"2023-07-21T22:13:41.112435+0000","last_undegraded":"2023-07-21T22:13:41.112435+0000","last_fullsized":"2023-07-21T22:13:41.112435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:24.800740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.083747+0000","last_change":"2023-07-21T22:13:40.097666+0000","last_active":"2023-07-21T22:13:41.083747+0000","last_peered":"2023-07-21T22:13:41.083747+0000","last_clean":"2023-07-21T22:13:41.083747+0000","last_became_active":"2023-07-21T22:13:40.097365+0000","last_became_peered":"2023-07-21T22:13:40.097365+0000","last_unstale":"2023-07-21T22:13:41.083747+0000","last_undegraded":"2023-07-21T22:13:41.083747+0000","last_fullsized":"2023-07-21T22:13:41.083747+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:07:41.346094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080851+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:13:41.080851+0000","last_peered":"2023-07-21T22:13:41.080851+0000","last_clean":"2023-07-21T22:13:41.080851+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:13:41.080851+0000","last_undegraded":"2023-07-21T22:13:41.080851+0000","last_fullsized":"2023-07-21T22:13:41.080851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:27.861284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107095+0000","last_change":"2023-07-21T22:13:41.095803+0000","last_active":"2023-07-21T22:13:41.107095+0000","last_peered":"2023-07-21T22:13:41.107095+0000","last_clean":"2023-07-21T22:13:41.107095+0000","last_became_active":"2023-07-21T22:13:41.095315+0000","last_became_peered":"2023-07-21T22:13:41.095315+0000","last_unstale":"2023-07-21T22:13:41.107095+0000","last_undegraded":"2023-07-21T22:13:41.107095+0000","last_fullsized":"2023-07-21T22:13:41.107095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:35.630446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080918+0000","last_change":"2023-07-21T22:13:40.094937+0000","last_active":"2023-07-21T22:13:41.080918+0000","last_peered":"2023-07-21T22:13:41.080918+0000","last_clean":"2023-07-21T22:13:41.080918+0000","last_became_active":"2023-07-21T22:13:40.094169+0000","last_became_peered":"2023-07-21T22:13:40.094169+0000","last_unstale":"2023-07-21T22:13:41.080918+0000","last_undegraded":"2023-07-21T22:13:41.080918+0000","last_fullsized":"2023-07-21T22:13:41.080918+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:18.368263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.089510+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:13:41.089510+0000","last_peered":"2023-07-21T22:13:41.089510+0000","last_clean":"2023-07-21T22:13:41.089510+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:13:41.089510+0000","last_undegraded":"2023-07-21T22:13:41.089510+0000","last_fullsized":"2023-07-21T22:13:41.089510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:47:45.851156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.111847+0000","last_change":"2023-07-21T22:13:41.106922+0000","last_active":"2023-07-21T22:13:41.111847+0000","last_peered":"2023-07-21T22:13:41.111847+0000","last_clean":"2023-07-21T22:13:41.111847+0000","last_became_active":"2023-07-21T22:13:41.106619+0000","last_became_peered":"2023-07-21T22:13:41.106619+0000","last_unstale":"2023-07-21T22:13:41.111847+0000","last_undegraded":"2023-07-21T22:13:41.111847+0000","last_fullsized":"2023-07-21T22:13:41.111847+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:17:31.116227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.123287+0000","last_change":"2023-07-21T22:13:40.093838+0000","last_active":"2023-07-21T22:13:41.123287+0000","last_peered":"2023-07-21T22:13:41.123287+0000","last_clean":"2023-07-21T22:13:41.123287+0000","last_became_active":"2023-07-21T22:13:40.093566+0000","last_became_peered":"2023-07-21T22:13:40.093566+0000","last_unstale":"2023-07-21T22:13:41.123287+0000","last_undegraded":"2023-07-21T22:13:41.123287+0000","last_fullsized":"2023-07-21T22:13:41.123287+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:58:32.061562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.090597+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:13:41.090597+0000","last_peered":"2023-07-21T22:13:41.090597+0000","last_clean":"2023-07-21T22:13:41.090597+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:13:41.090597+0000","last_undegraded":"2023-07-21T22:13:41.090597+0000","last_fullsized":"2023-07-21T22:13:41.090597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:49:32.843652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112504+0000","last_change":"2023-07-21T22:13:41.105123+0000","last_active":"2023-07-21T22:13:41.112504+0000","last_peered":"2023-07-21T22:13:41.112504+0000","last_clean":"2023-07-21T22:13:41.112504+0000","last_became_active":"2023-07-21T22:13:41.104852+0000","last_became_peered":"2023-07-21T22:13:41.104852+0000","last_unstale":"2023-07-21T22:13:41.112504+0000","last_undegraded":"2023-07-21T22:13:41.112504+0000","last_fullsized":"2023-07-21T22:13:41.112504+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:56.106383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078209+0000","last_change":"2023-07-21T22:13:40.091829+0000","last_active":"2023-07-21T22:13:41.078209+0000","last_peered":"2023-07-21T22:13:41.078209+0000","last_clean":"2023-07-21T22:13:41.078209+0000","last_became_active":"2023-07-21T22:13:40.091466+0000","last_became_peered":"2023-07-21T22:13:40.091466+0000","last_unstale":"2023-07-21T22:13:41.078209+0000","last_undegraded":"2023-07-21T22:13:41.078209+0000","last_fullsized":"2023-07-21T22:13:41.078209+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:32:36.155188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.079865+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:13:41.079865+0000","last_peered":"2023-07-21T22:13:41.079865+0000","last_clean":"2023-07-21T22:13:41.079865+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:13:41.079865+0000","last_undegraded":"2023-07-21T22:13:41.079865+0000","last_fullsized":"2023-07-21T22:13:41.079865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:47:37.024948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":236,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.090730+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:13:41.090730+0000","last_peered":"2023-07-21T22:13:41.090730+0000","last_clean":"2023-07-21T22:13:41.090730+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:13:41.090730+0000","last_undegraded":"2023-07-21T22:13:41.090730+0000","last_fullsized":"2023-07-21T22:13:41.090730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:20.076638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32352,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339488,"statfs":{"total":96636764160,"available":96603635712,"internally_reserved":0,"allocated":1335296,"data_stored":928031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.2270000000000001,"15min":1.2250000000000001},"min":{"1min":0.92800000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6439999999999999,"5min":2.218,"15min":2.218},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.278,"15min":1.3100000000000001},"min":{"1min":0.98899999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.478,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.3240000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.196,"15min":1.218},"min":{"1min":0.749,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4830000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2370000000000001,"15min":1.2729999999999999},"min":{"1min":0.81000000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.5249999999999999,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.121}]},{"osd":2,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.21,"15min":1.2250000000000001},"min":{"1min":0.89000000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.4139999999999999,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.2709999999999999,"15min":1.2989999999999999},"min":{"1min":0.80000000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5940000000000001,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.367}]},{"osd":3,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.278,"15min":1.2929999999999999},"min":{"1min":0.93700000000000006,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4910000000000001,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.3560000000000001,"15min":1.4159999999999999},"min":{"1min":0.88500000000000001,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5329999999999999,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.595}]},{"osd":4,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.2050000000000001,"15min":1.23},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4790000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.466},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.304,"15min":1.3340000000000001},"min":{"1min":0.84399999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5189999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.53}]},{"osd":5,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3480000000000001,"15min":1.3660000000000001},"min":{"1min":0.66300000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4810000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.9930000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.3280000000000001,"15min":1.3740000000000001},"min":{"1min":0.89800000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.496,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.623}]},{"osd":6,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.4490000000000001,"15min":1.4950000000000001},"min":{"1min":0.96099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.6160000000000001,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3999999999999999,"15min":1.423},"min":{"1min":1.038,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.667,"5min":2.476,"15min":2.476},"last":1.7370000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":724992,"data_stored":336887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.105,"15min":1.119},"min":{"1min":0.71599999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.52,"5min":1.657,"15min":1.657},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.1120000000000001,"15min":1.141},"min":{"1min":0.78100000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.282,"5min":2.802,"15min":2.802},"last":1.266}]},{"osd":1,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2070000000000001,"15min":1.2430000000000001},"min":{"1min":0.90500000000000003,"5min":0.747,"15min":0.747},"max":{"1min":1.571,"5min":1.839,"15min":1.839},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.212,"15min":1.25},"min":{"1min":0.754,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7070000000000001,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.548}]},{"osd":2,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2370000000000001,"15min":1.2689999999999999},"min":{"1min":0.93500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.718,"5min":2.911,"15min":2.911},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.2889999999999999,"15min":1.355},"min":{"1min":0.77200000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4870000000000001,"5min":2.379,"15min":2.379},"last":1.393}]},{"osd":3,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.373,"15min":1.425},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.554,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.01},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.3580000000000001,"15min":1.4059999999999999},"min":{"1min":0.83899999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.716,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":1.5980000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.28,"15min":1.28},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8919999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.472},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.335,"15min":1.381},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6140000000000001,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.3440000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3740000000000001,"15min":1.3959999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.7290000000000001,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.516},{"interface":"front","average":{"1min":1.385,"5min":1.4350000000000001,"15min":1.452},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9419999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.6419999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.421,"15min":1.4410000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9390000000000001,"5min":4.194,"15min":4.194},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.524,"15min":1.55},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.8220000000000001,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.5740000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509484,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":729088,"data_stored":336909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.079,"15min":1.0960000000000001},"min":{"1min":0.67300000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.472,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1279999999999999,"15min":1.1399999999999999},"min":{"1min":0.77100000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5329999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.1990000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1619999999999999,"15min":1.2},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.593,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.073,"5min":1.1599999999999999,"15min":1.1839999999999999},"min":{"1min":0.72099999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.51,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.278}]},{"osd":2,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1619999999999999,"15min":1.1659999999999999},"min":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.105},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.272,"15min":1.3049999999999999},"min":{"1min":0.76100000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.615,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.353}]},{"osd":3,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.2250000000000001,"15min":1.2490000000000001},"min":{"1min":0.68400000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.47,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.024},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.371,"15min":1.401},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.671,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.411}]},{"osd":4,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3049999999999999,"15min":1.3360000000000001},"min":{"1min":0.93500000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.5960000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2909999999999999,"15min":1.304},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.673,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.379}]},{"osd":6,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.256,"15min":1.2829999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.621,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":0.85299999999999998,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.655,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.3069999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2789999999999999,"15min":1.3029999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5449999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.155},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4870000000000001,"15min":1.5189999999999999},"min":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7150000000000001,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.321}]}]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":737280,"data_stored":338451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.105,"15min":1.101},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.4039999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.095},{"interface":"front","average":{"1min":1.127,"5min":1.151,"15min":1.171},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5269999999999999,"5min":1.617,"15min":1.617},"last":0.90400000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.216,"15min":1.232},"min":{"1min":0.60699999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7030000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.498},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1930000000000001,"15min":1.1950000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.6000000000000001,"5min":1.665,"15min":1.665},"last":0.79800000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.143,"15min":1.1399999999999999},"min":{"1min":0.89800000000000002,"5min":0.748,"15min":0.748},"max":{"1min":1.585,"5min":1.609,"15min":1.609},"last":1.018},{"interface":"front","average":{"1min":1.28,"5min":1.2789999999999999,"15min":1.3},"min":{"1min":0.96399999999999997,"5min":0.621,"15min":0.621},"max":{"1min":1.6479999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.252}]},{"osd":3,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.2669999999999999,"15min":1.3049999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.482,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.236,"15min":1.2330000000000001},"min":{"1min":1.0069999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.504,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.2989999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.264,"15min":1.3},"min":{"1min":0.86199999999999999,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7470000000000001,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.373},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.246,"15min":1.2370000000000001},"min":{"1min":0.751,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.756,"5min":1.794,"15min":1.794},"last":1.3340000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.198,"15min":1.2},"min":{"1min":0.91700000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5760000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.3959999999999999,"15min":1.4259999999999999},"min":{"1min":0.995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8380000000000001,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.575}]},{"osd":7,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.385,"15min":1.369},"min":{"1min":0.85999999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.831,"5min":1.887,"15min":1.887},"last":1.524},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4119999999999999,"15min":1.409},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.835,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.4239999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509482,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":712704,"data_stored":329439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92000000000000004,"15min":0.93100000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":1.484},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88700000000000001,"15min":0.90100000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.9830000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.90500000000000003,"15min":0.93899999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1879999999999999,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.081,"15min":1.129},"min":{"1min":0.56999999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.71,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.3}]},{"osd":2,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.69199999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.52},{"interface":"front","average":{"1min":0.999,"5min":1.0329999999999999,"15min":1.04},"min":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5109999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":2.613}]},{"osd":4,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.3240000000000001,"15min":1.3420000000000001},"min":{"1min":0.90800000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.73,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.359},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.29,"15min":1.3340000000000001},"min":{"1min":0.76500000000000001,"5min":0.751,"15min":0.751},"max":{"1min":1.52,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.9350000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3029999999999999,"15min":1.339},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.694,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4359999999999999,"15min":1.466},"min":{"1min":0.96799999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.677,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.4019999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.337,"15min":1.367},"min":{"1min":0.86499999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.75,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":2.0379999999999998},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4099999999999999,"15min":1.4490000000000001},"min":{"1min":0.92700000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.653,"5min":2.161,"15min":2.161},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.4590000000000001,"15min":1.5069999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.6639999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.5229999999999999,"15min":1.5580000000000001},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.8140000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.4419999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":712704,"data_stored":329439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.872,"15min":0.88},"min":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1950000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.022,"15min":1.032},"min":{"1min":0.69099999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5189999999999999,"5min":1.534,"15min":1.534},"last":7.0300000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.93899999999999995,"15min":0.95699999999999996},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.272,"5min":1.486,"15min":1.486},"last":2.2949999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0980000000000001,"15min":1.1180000000000001},"min":{"1min":0.75600000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.2869999999999999,"5min":1.958,"15min":1.958},"last":4.1239999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.123,"15min":1.1379999999999999},"min":{"1min":0.70199999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.4419999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":3.5070000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.1299999999999999,"15min":1.1559999999999999},"min":{"1min":0.73999999999999999,"5min":0.623,"15min":0.623},"max":{"1min":1.365,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":2.46}]},{"osd":4,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3979999999999999,"15min":1.4199999999999999},"min":{"1min":1.0960000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6060000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":2.1840000000000002},{"interface":"front","average":{"1min":1.329,"5min":1.4670000000000001,"15min":1.5069999999999999},"min":{"1min":1.0580000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.607,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":2.516}]},{"osd":5,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.4770000000000001,"15min":1.506},"min":{"1min":1.1259999999999999,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":1.6599999999999999,"5min":3.331,"15min":3.331},"last":2.0139999999999998},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.5129999999999999,"15min":1.5529999999999999},"min":{"1min":1.1100000000000001,"5min":1.085,"15min":1.085},"max":{"1min":1.7649999999999999,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":2.2360000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4379999999999999,"15min":1.458},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.663,"5min":2.633,"15min":2.633},"last":2.399},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.421,"15min":1.458},"min":{"1min":1.1319999999999999,"5min":0.878,"15min":0.878},"max":{"1min":1.615,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.6299999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4510000000000001,"15min":1.4810000000000001},"min":{"1min":1.0009999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.738,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":2.137},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.534,"15min":1.5640000000000001},"min":{"1min":1.1379999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.72,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":2.3450000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":919807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.876,"15min":0.88800000000000001},"min":{"1min":0.63200000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.94799999999999995,"15min":0.97399999999999998},"min":{"1min":0.63500000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.296}]},{"osd":2,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.95499999999999996,"15min":0.93899999999999995},"min":{"1min":0.68200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.242},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.032,"15min":1.026},"min":{"1min":0.77300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.1850000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.96199999999999997,"15min":0.94999999999999996},"min":{"1min":0.63900000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.179,"15min":1.175},"min":{"1min":0.82099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":1.3340000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.264,"15min":1.2609999999999999},"min":{"1min":0.90900000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":3.1779999999999999,"5min":3.1779999999999999,"15min":3.1779999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.3899999999999999,"15min":1.3919999999999999},"min":{"1min":1.1559999999999999,"5min":1,"15min":1},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.4610000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.429,"15min":1.4870000000000001},"min":{"1min":0.96999999999999997,"5min":0.872,"15min":0.872},"max":{"1min":2.1150000000000002,"5min":2.419,"15min":2.419},"last":1.5},{"interface":"front","average":{"1min":1.409,"5min":1.383,"15min":1.4039999999999999},"min":{"1min":0.96699999999999997,"5min":0.872,"15min":0.872},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4870000000000001,"15min":1.522},"min":{"1min":1.0680000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.46,"5min":1.4770000000000001,"15min":1.5189999999999999},"min":{"1min":1.0980000000000001,"5min":1.038,"15min":1.038},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.552}]},{"osd":7,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.49,"15min":1.5369999999999999},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.4489999999999998,"5min":2.504,"15min":2.504},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4610000000000001,"15min":1.5009999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.3779999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":700416,"data_stored":322499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.877,"15min":0.89300000000000002},"min":{"1min":0.51600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":1.2589999999999999,"5min":2.113,"15min":2.113},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.627,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5009999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.89900000000000002,"15min":0.90000000000000002},"min":{"1min":0.505,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1659999999999999,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.034,"5min":1.0840000000000001,"15min":1.1180000000000001},"min":{"1min":0.65700000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.601,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.101}]},{"osd":3,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.3100000000000001,"15min":1.3899999999999999},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7110000000000001,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.1879999999999999,"15min":1.2509999999999999},"min":{"1min":0.70399999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4370000000000001,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":0.89000000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2869999999999999,"15min":1.3120000000000001},"min":{"1min":0.96199999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.617,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.272,"15min":1.302},"min":{"1min":0.996,"5min":0.377,"15min":0.377},"max":{"1min":1.6719999999999999,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.181}]},{"osd":5,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.319,"15min":1.361},"min":{"1min":0.92400000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.7869999999999999,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.4339999999999999,"15min":1.484},"min":{"1min":1.0800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.958,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.1479999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3919999999999999,"15min":1.4279999999999999},"min":{"1min":0.94099999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6439999999999999,"5min":2.238,"15min":2.238},"last":1.482},{"interface":"front","average":{"1min":1.359,"5min":1.4159999999999999,"15min":1.444},"min":{"1min":1.111,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.887,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.3340000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5209999999999999,"15min":1.5549999999999999},"min":{"1min":0.997,"5min":0.624,"15min":0.624},"max":{"1min":1.909,"5min":4.391,"15min":4.391},"last":1.306},{"interface":"front","average":{"1min":1.413,"5min":1.4830000000000001,"15min":1.5169999999999999},"min":{"1min":1.155,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.746,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.385}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:13:46.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-07-21T22:13:46.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:13:40.085505+0000', 'last_change': '2023-07-21T22:13:40.085505+0000', 'last_active': '2023-07-21T22:13:40.060998+0000', 'last_peered': '2023-07-21T22:13:40.060998+0000', 'last_clean': '2023-07-21T22:13:40.060998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:13:40.085505+0000', 'last_undegraded': '2023-07-21T22:13:40.085505+0000', 'last_fullsized': '2023-07-21T22:13:40.085505+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_clean_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:13:46.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-07-21T22:13:46.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:13:40.084869+0000', 'last_change': '2023-07-21T22:13:40.084869+0000', 'last_active': '2023-07-21T22:13:40.060998+0000', 'last_peered': '2023-07-21T22:13:40.060998+0000', 'last_clean': '2023-07-21T22:13:40.060998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:13:40.084869+0000', 'last_undegraded': '2023-07-21T22:13:40.084869+0000', 'last_fullsized': '2023-07-21T22:13:40.084869+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_clean_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:13:46.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2023-07-21T22:13:46.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:13:40.082600+0000', 'last_change': '2023-07-21T22:13:40.082600+0000', 'last_active': '2023-07-21T22:13:40.060998+0000', 'last_peered': '2023-07-21T22:13:40.060998+0000', 'last_clean': '2023-07-21T22:13:40.060998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:13:40.082600+0000', 'last_undegraded': '2023-07-21T22:13:40.082600+0000', 'last_fullsized': '2023-07-21T22:13:40.082600+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_clean_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:13:46.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-07-21T22:13:46.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:13:40.084808+0000', 'last_change': '2023-07-21T22:13:40.084808+0000', 'last_active': '2023-07-21T22:13:40.060998+0000', 'last_peered': '2023-07-21T22:13:40.060998+0000', 'last_clean': '2023-07-21T22:13:40.060998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:13:40.084808+0000', 'last_undegraded': '2023-07-21T22:13:40.084808+0000', 'last_fullsized': '2023-07-21T22:13:40.084808+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_clean_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:13:46.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-07-21T22:13:46.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:13:40.080876+0000', 'last_change': '2023-07-21T22:13:40.080876+0000', 'last_active': '2023-07-21T22:13:40.060998+0000', 'last_peered': '2023-07-21T22:13:40.060998+0000', 'last_clean': '2023-07-21T22:13:40.060998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:13:40.080876+0000', 'last_undegraded': '2023-07-21T22:13:40.080876+0000', 'last_fullsized': '2023-07-21T22:13:40.080876+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_clean_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:13:46.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-07-21T22:13:46.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:13:40.084347+0000', 'last_change': '2023-07-21T22:13:40.084347+0000', 'last_active': '2023-07-21T22:13:40.060998+0000', 'last_peered': '2023-07-21T22:13:40.060998+0000', 'last_clean': '2023-07-21T22:13:40.060998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:13:40.084347+0000', 'last_undegraded': '2023-07-21T22:13:40.084347+0000', 'last_fullsized': '2023-07-21T22:13:40.084347+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_clean_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:13:46.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-07-21T22:13:46.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:13:40.080932+0000', 'last_change': '2023-07-21T22:13:40.080932+0000', 'last_active': '2023-07-21T22:13:40.060998+0000', 'last_peered': '2023-07-21T22:13:40.060998+0000', 'last_clean': '2023-07-21T22:13:40.060998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:13:40.080932+0000', 'last_undegraded': '2023-07-21T22:13:40.080932+0000', 'last_fullsized': '2023-07-21T22:13:40.080932+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_clean_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:13:46.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-07-21T22:13:46.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:13:40.081200+0000', 'last_change': '2023-07-21T22:13:40.081200+0000', 'last_active': '2023-07-21T22:13:40.060998+0000', 'last_peered': '2023-07-21T22:13:40.060998+0000', 'last_clean': '2023-07-21T22:13:40.060998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:13:40.081200+0000', 'last_undegraded': '2023-07-21T22:13:40.081200+0000', 'last_fullsized': '2023-07-21T22:13:40.081200+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'last_clean_scrub_stamp': '2023-07-21T22:13:40.060998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:13:46.410 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-21T22:13:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.569+0000 7fde6f265700 1 Processor -- start 2023-07-21T22:13:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.569+0000 7fde6f265700 1 -- start start 2023-07-21T22:13:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.569+0000 7fde6f265700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680cbde0 0x7fde680cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.569+0000 7fde6f265700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fde680cb6d0 0x7fde68070a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:46.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.569+0000 7fde6f265700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde680cbb30 con 0x7fde68070690 2023-07-21T22:13:46.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.569+0000 7fde6f265700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6815c260 con 0x7fde680cb6d0 2023-07-21T22:13:46.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.569+0000 7fde6f265700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde680abfe0 con 0x7fde680cbde0 2023-07-21T22:13:46.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.569+0000 7fde6d001700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fde68070690 0x7fde680ab8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33780/0 (socket says 172.21.15.49:33780) 2023-07-21T22:13:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.569+0000 7fde6d001700 1 -- 172.21.15.49:0/271328614 learned_addr learned my addr 172.21.15.49:0/271328614 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:46.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.569+0000 7fde6c800700 1 --2- 172.21.15.49:0/271328614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680cbde0 0x7fde680cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:46.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.569+0000 7fde6d802700 1 --2- 172.21.15.49:0/271328614 >> v2:172.21.15.49:3300/0 conn(0x7fde680cb6d0 0x7fde68070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:46.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde5ffff700 1 -- 172.21.15.49:0/271328614 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717455497 0 0) 0x7fde680cbb30 con 0x7fde68070690 2023-07-21T22:13:46.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde5ffff700 1 -- 172.21.15.49:0/271328614 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde540035d0 con 0x7fde68070690 2023-07-21T22:13:46.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde6d802700 1 -- 172.21.15.49:0/271328614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680cbde0 msgr2=0x7fde680cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:46.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde6d802700 1 --2- 172.21.15.49:0/271328614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680cbde0 0x7fde680cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde6d802700 1 -- 172.21.15.49:0/271328614 >> v1:172.21.15.49:6789/0 conn(0x7fde68070690 legacy=0x7fde680ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:46.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde6d802700 1 -- 172.21.15.49:0/271328614 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680ad2d0 con 0x7fde680cb6d0 2023-07-21T22:13:46.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde6d802700 1 --2- 172.21.15.49:0/271328614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde680cb6d0 0x7fde68070a60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fde60009d90 tx=0x7fde6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4462d2715641f468 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:46.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde5ffff700 1 -- 172.21.15.49:0/271328614 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6000e070 con 0x7fde680cb6d0 2023-07-21T22:13:46.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde5ffff700 1 -- 172.21.15.49:0/271328614 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6000bb20 con 0x7fde680cb6d0 2023-07-21T22:13:46.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde5ffff700 1 -- 172.21.15.49:0/271328614 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde60012430 con 0x7fde680cb6d0 2023-07-21T22:13:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde6f265700 1 -- 172.21.15.49:0/271328614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde680cb6d0 msgr2=0x7fde68070a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde6f265700 1 --2- 172.21.15.49:0/271328614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde680cb6d0 0x7fde68070a60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fde60009d90 tx=0x7fde6000b330 comp rx=0 tx=0).stop 2023-07-21T22:13:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde6f265700 1 -- 172.21.15.49:0/271328614 shutdown_connections 2023-07-21T22:13:46.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde6f265700 1 --2- 172.21.15.49:0/271328614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde680cb6d0 0x7fde68070a60 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde6f265700 1 --2- 172.21.15.49:0/271328614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680cbde0 0x7fde680cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde6f265700 1 -- 172.21.15.49:0/271328614 >> 172.21.15.49:0/271328614 conn(0x7fde6806f5a0 msgr2=0x7fde680afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:46.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde6f265700 1 -- 172.21.15.49:0/271328614 shutdown_connections 2023-07-21T22:13:46.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.573+0000 7fde6f265700 1 -- 172.21.15.49:0/271328614 wait complete. 2023-07-21T22:13:46.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.577+0000 7fde6f265700 1 Processor -- start 2023-07-21T22:13:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.577+0000 7fde6f265700 1 -- start start 2023-07-21T22:13:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.577+0000 7fde6f265700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde68070690 0x7fde6814ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.577+0000 7fde6f265700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde680cb6d0 0x7fde6814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.577+0000 7fde6f265700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde680cbde0 0x7fde6814b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.577+0000 7fde6f265700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde68149090 con 0x7fde680cb6d0 2023-07-21T22:13:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.577+0000 7fde6f265700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6814f1d0 con 0x7fde680cbde0 2023-07-21T22:13:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.577+0000 7fde6f265700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde680b3e60 con 0x7fde68070690 2023-07-21T22:13:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde6c800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde680cb6d0 0x7fde6814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde6d001700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde68070690 0x7fde6814ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde6c800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde680cb6d0 0x7fde6814b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54568/0 (socket says 172.21.15.49:54568) 2023-07-21T22:13:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde6c800700 1 -- 172.21.15.49:0/3766492 learned_addr learned my addr 172.21.15.49:0/3766492 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde6d802700 1 --2- 172.21.15.49:0/3766492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde680cbde0 0x7fde6814b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde6c800700 1 -- 172.21.15.49:0/3766492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde68070690 msgr2=0x7fde6814ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde6c800700 1 --2- 172.21.15.49:0/3766492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde68070690 0x7fde6814ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde6c800700 1 -- 172.21.15.49:0/3766492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde680cbde0 msgr2=0x7fde6814b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde6c800700 1 --2- 172.21.15.49:0/3766492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde680cbde0 0x7fde6814b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde6c800700 1 -- 172.21.15.49:0/3766492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde60009a70 con 0x7fde680cb6d0 2023-07-21T22:13:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde6d001700 1 --2- 172.21.15.49:0/3766492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde68070690 0x7fde6814ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde6c800700 1 --2- 172.21.15.49:0/3766492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde680cb6d0 0x7fde6814b2f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fde5800e9d0 tx=0x7fde5800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde5dffb700 1 -- 172.21.15.49:0/3766492 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58009720 con 0x7fde680cb6d0 2023-07-21T22:13:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde5dffb700 1 -- 172.21.15.49:0/3766492 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5800ee70 con 0x7fde680cb6d0 2023-07-21T22:13:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde5dffb700 1 -- 172.21.15.49:0/3766492 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5800ca50 con 0x7fde680cb6d0 2023-07-21T22:13:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde6f265700 1 -- 172.21.15.49:0/3766492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde680c6d40 con 0x7fde680cb6d0 2023-07-21T22:13:46.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.581+0000 7fde6f265700 1 -- 172.21.15.49:0/3766492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde680c7300 con 0x7fde680cb6d0 2023-07-21T22:13:46.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.585+0000 7fde6f265700 1 -- 172.21.15.49:0/3766492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde6804dd20 con 0x7fde680cb6d0 2023-07-21T22:13:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.585+0000 7fde5dffb700 1 -- 172.21.15.49:0/3766492 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde5800cbb0 con 0x7fde680cb6d0 2023-07-21T22:13:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.585+0000 7fde5dffb700 1 --2- 172.21.15.49:0/3766492 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fde4c0662f0 0x7fde4c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.585+0000 7fde5dffb700 1 -- 172.21.15.49:0/3766492 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fde58083ef0 con 0x7fde680cb6d0 2023-07-21T22:13:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.589+0000 7fde6d001700 1 --2- 172.21.15.49:0/3766492 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fde4c0662f0 0x7fde4c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.589+0000 7fde6d001700 1 --2- 172.21.15.49:0/3766492 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fde4c0662f0 0x7fde4c0687a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fde64007fd0 tx=0x7fde64007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.593+0000 7fde5dffb700 1 -- 172.21.15.49:0/3766492 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde58054c20 con 0x7fde680cb6d0 2023-07-21T22:13:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.829+0000 7fde6f265700 1 -- 172.21.15.49:0/3766492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fde680b4190 con 0x7fde680cb6d0 2023-07-21T22:13:46.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.833+0000 7fde5dffb700 1 -- 172.21.15.49:0/3766492 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1099 (secure 0 0 0) 0x7fde58017460 con 0x7fde680cb6d0 2023-07-21T22:13:46.876 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:46.876 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":218,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1689977420,"num_in_osds":8,"osd_in_since":1689977411,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97},{"state_name":"creating+peering","count":8}],"num_pgs":105,"num_pools":4,"num_objects":17,"data_bytes":590584,"bytes_used":252915712,"bytes_avail":772841197568,"bytes_total":773094113280,"inactive_pgs_ratio":0.076190479099750519,"write_bytes_sec":1930,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":26,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":6396}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-07-21T22:13:26.367547+0000","services":{}},"progress_events":{}} 2023-07-21T22:13:46.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.837+0000 7fde6f265700 1 -- 172.21.15.49:0/3766492 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fde4c0662f0 msgr2=0x7fde4c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:46.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.837+0000 7fde6f265700 1 --2- 172.21.15.49:0/3766492 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fde4c0662f0 0x7fde4c0687a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fde64007fd0 tx=0x7fde64007de0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.837+0000 7fde6f265700 1 -- 172.21.15.49:0/3766492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde680cb6d0 msgr2=0x7fde6814b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:46.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.837+0000 7fde6f265700 1 --2- 172.21.15.49:0/3766492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde680cb6d0 0x7fde6814b2f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fde5800e9d0 tx=0x7fde5800ece0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.837+0000 7fde6f265700 1 -- 172.21.15.49:0/3766492 shutdown_connections 2023-07-21T22:13:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.837+0000 7fde6f265700 1 --2- 172.21.15.49:0/3766492 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fde4c0662f0 0x7fde4c0687a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.837+0000 7fde6f265700 1 --2- 172.21.15.49:0/3766492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde680cb6d0 0x7fde6814b2f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.837+0000 7fde6f265700 1 --2- 172.21.15.49:0/3766492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde680cbde0 0x7fde6814b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.837+0000 7fde6f265700 1 --2- 172.21.15.49:0/3766492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde68070690 0x7fde6814ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.837+0000 7fde6f265700 1 -- 172.21.15.49:0/3766492 >> 172.21.15.49:0/3766492 conn(0x7fde6806f5a0 msgr2=0x7fde680afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.837+0000 7fde6f265700 1 -- 172.21.15.49:0/3766492 shutdown_connections 2023-07-21T22:13:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:46.837+0000 7fde6f265700 1 -- 172.21.15.49:0/3766492 wait complete. 2023-07-21T22:13:46.903 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-21T22:13:46.903 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:13:47.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.029+0000 7f176b59e700 1 Processor -- start 2023-07-21T22:13:47.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f176b59e700 1 -- start start 2023-07-21T22:13:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f176b59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f176c071c70 0x7f176c0b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f176b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f176c0b1400 0x7f176c0cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f176b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c0cab20 con 0x7f176c06d380 2023-07-21T22:13:47.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f176b59e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c0c9e80 con 0x7f176c071c70 2023-07-21T22:13:47.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f176b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c0afeb0 con 0x7f176c0b1400 2023-07-21T22:13:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f1769d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f176c071c70 0x7f176c0b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f1769d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f176c071c70 0x7f176c0b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54576/0 (socket says 172.21.15.49:54576) 2023-07-21T22:13:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f176a59c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f176c06d380 0x7f176c06d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:34568/0 (socket says 172.21.15.49:34568) 2023-07-21T22:13:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f1769d9b700 1 -- 172.21.15.49:0/1997836788 learned_addr learned my addr 172.21.15.49:0/1997836788 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f176ad9d700 1 --2- 172.21.15.49:0/1997836788 >> v2:172.21.15.150:3300/0 conn(0x7f176c0b1400 0x7f176c0cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f1769d9b700 1 -- 172.21.15.49:0/1997836788 >> v2:172.21.15.150:3300/0 conn(0x7f176c0b1400 msgr2=0x7f176c0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f1769d9b700 1 --2- 172.21.15.49:0/1997836788 >> v2:172.21.15.150:3300/0 conn(0x7f176c0b1400 0x7f176c0cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f1769d9b700 1 -- 172.21.15.49:0/1997836788 >> v1:172.21.15.150:6789/0 conn(0x7f176c06d380 legacy=0x7f176c06d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f1769d9b700 1 -- 172.21.15.49:0/1997836788 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c0ca1f0 con 0x7f176c071c70 2023-07-21T22:13:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.033+0000 7f176959a700 1 -- 172.21.15.49:0/1997836788 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102103885 0 0) 0x7f176c0cab20 con 0x7f176c06d380 2023-07-21T22:13:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.037+0000 7f1769d9b700 1 --2- 172.21.15.49:0/1997836788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c071c70 0x7f176c0b0ec0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f176c06f8e0 tx=0x7f1760009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967cbc89548b4227 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.037+0000 7f176959a700 1 -- 172.21.15.49:0/1997836788 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760011830 con 0x7f176c071c70 2023-07-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.037+0000 7f176959a700 1 -- 172.21.15.49:0/1997836788 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1760011990 con 0x7f176c071c70 2023-07-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.037+0000 7f176959a700 1 -- 172.21.15.49:0/1997836788 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760011d20 con 0x7f176c071c70 2023-07-21T22:13:47.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.037+0000 7f176b59e700 1 -- 172.21.15.49:0/1997836788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c071c70 msgr2=0x7f176c0b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:47.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.037+0000 7f176b59e700 1 --2- 172.21.15.49:0/1997836788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c071c70 0x7f176c0b0ec0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f176c06f8e0 tx=0x7f1760009bf0 comp rx=0 tx=0).stop 2023-07-21T22:13:47.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.037+0000 7f176b59e700 1 -- 172.21.15.49:0/1997836788 shutdown_connections 2023-07-21T22:13:47.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.037+0000 7f176b59e700 1 --2- 172.21.15.49:0/1997836788 >> v2:172.21.15.150:3300/0 conn(0x7f176c0b1400 0x7f176c0cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:47.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.037+0000 7f176b59e700 1 --2- 172.21.15.49:0/1997836788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c071c70 0x7f176c0b0ec0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:47.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.037+0000 7f176b59e700 1 -- 172.21.15.49:0/1997836788 >> 172.21.15.49:0/1997836788 conn(0x7f176c070450 msgr2=0x7f176c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:47.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.037+0000 7f176b59e700 1 -- 172.21.15.49:0/1997836788 shutdown_connections 2023-07-21T22:13:47.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.037+0000 7f176b59e700 1 -- 172.21.15.49:0/1997836788 wait complete. 2023-07-21T22:13:47.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f176b59e700 1 Processor -- start 2023-07-21T22:13:47.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f176b59e700 1 -- start start 2023-07-21T22:13:47.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f176b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f176c06d380 0x7f176c0c2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:47.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f176b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c071c70 0x7f176c1f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:47.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f176b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f176c0b1400 0x7f176c1f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:47.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f176b59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0c41c0 con 0x7f176c071c70 2023-07-21T22:13:47.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f176b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0c35b0 con 0x7f176c0b1400 2023-07-21T22:13:47.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f176b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0c3890 con 0x7f176c06d380 2023-07-21T22:13:47.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f1769d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c071c70 0x7f176c1f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:47.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f1769d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c071c70 0x7f176c1f0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54584/0 (socket says 172.21.15.49:54584) 2023-07-21T22:13:47.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f1769d9b700 1 -- 172.21.15.49:0/1337913081 learned_addr learned my addr 172.21.15.49:0/1337913081 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:47.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f176a59c700 1 --2- 172.21.15.49:0/1337913081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f176c06d380 0x7f176c0c2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:47.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f176ad9d700 1 --2- 172.21.15.49:0/1337913081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f176c0b1400 0x7f176c1f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:47.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f1769d9b700 1 -- 172.21.15.49:0/1337913081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f176c06d380 msgr2=0x7f176c0c2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:47.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f1769d9b700 1 --2- 172.21.15.49:0/1337913081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f176c06d380 0x7f176c0c2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:47.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f1769d9b700 1 -- 172.21.15.49:0/1337913081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f176c0b1400 msgr2=0x7f176c1f1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:47.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f1769d9b700 1 --2- 172.21.15.49:0/1337913081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f176c0b1400 0x7f176c1f1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:47.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.041+0000 7f1769d9b700 1 -- 172.21.15.49:0/1337913081 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760009570 con 0x7f176c071c70 2023-07-21T22:13:47.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.045+0000 7f1769d9b700 1 --2- 172.21.15.49:0/1337913081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c071c70 0x7f176c1f0dc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1760009c30 tx=0x7f1760004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:47.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.045+0000 7f175affd700 1 -- 172.21.15.49:0/1337913081 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17600042c0 con 0x7f176c071c70 2023-07-21T22:13:47.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.045+0000 7f175affd700 1 -- 172.21.15.49:0/1337913081 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176001f070 con 0x7f176c071c70 2023-07-21T22:13:47.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.045+0000 7f175affd700 1 -- 172.21.15.49:0/1337913081 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17600036c0 con 0x7f176c071c70 2023-07-21T22:13:47.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.045+0000 7f176b59e700 1 -- 172.21.15.49:0/1337913081 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c0c3b70 con 0x7f176c071c70 2023-07-21T22:13:47.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.045+0000 7f176b59e700 1 -- 172.21.15.49:0/1337913081 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c1f1ab0 con 0x7f176c071c70 2023-07-21T22:13:47.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.045+0000 7f176b59e700 1 -- 172.21.15.49:0/1337913081 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c04dcb0 con 0x7f176c071c70 2023-07-21T22:13:47.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.049+0000 7f175affd700 1 -- 172.21.15.49:0/1337913081 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1760021030 con 0x7f176c071c70 2023-07-21T22:13:47.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.049+0000 7f175affd700 1 --2- 172.21.15.49:0/1337913081 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f174c0662f0 0x7f174c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:47.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.049+0000 7f175affd700 1 -- 172.21.15.49:0/1337913081 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f17600852d0 con 0x7f176c071c70 2023-07-21T22:13:47.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.049+0000 7f176a59c700 1 --2- 172.21.15.49:0/1337913081 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f174c0662f0 0x7f174c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:47.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.049+0000 7f176a59c700 1 --2- 172.21.15.49:0/1337913081 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f174c0662f0 0x7f174c0687a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f175c000f60 tx=0x7f175c007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.057+0000 7f175affd700 1 -- 172.21.15.49:0/1337913081 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1760052720 con 0x7f176c071c70 2023-07-21T22:13:47.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.225+0000 7f176b59e700 1 -- 172.21.15.49:0/1337913081 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f176c0ca7b0 con 0x7f174c0662f0 2023-07-21T22:13:47.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.241+0000 7f175affd700 1 -- 172.21.15.49:0/1337913081 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308921 (secure 0 0 0) 0x7f175c0012b0 con 0x7f174c0662f0 2023-07-21T22:13:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:47.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.249+0000 7f176b59e700 1 -- 172.21.15.49:0/1337913081 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f174c0662f0 msgr2=0x7f174c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:47.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.249+0000 7f176b59e700 1 --2- 172.21.15.49:0/1337913081 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f174c0662f0 0x7f174c0687a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f175c000f60 tx=0x7f175c007e90 comp rx=0 tx=0).stop 2023-07-21T22:13:47.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.249+0000 7f176b59e700 1 -- 172.21.15.49:0/1337913081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c071c70 msgr2=0x7f176c1f0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:47.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.249+0000 7f176b59e700 1 --2- 172.21.15.49:0/1337913081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c071c70 0x7f176c1f0dc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1760009c30 tx=0x7f1760004770 comp rx=0 tx=0).stop 2023-07-21T22:13:47.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.249+0000 7f176b59e700 1 -- 172.21.15.49:0/1337913081 shutdown_connections 2023-07-21T22:13:47.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.249+0000 7f176b59e700 1 --2- 172.21.15.49:0/1337913081 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f174c0662f0 0x7f174c0687a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:47.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.249+0000 7f176b59e700 1 --2- 172.21.15.49:0/1337913081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c071c70 0x7f176c1f0dc0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:47.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.249+0000 7f176b59e700 1 --2- 172.21.15.49:0/1337913081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f176c0b1400 0x7f176c1f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:47.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.249+0000 7f176b59e700 1 --2- 172.21.15.49:0/1337913081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f176c06d380 0x7f176c0c2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:47.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.249+0000 7f176b59e700 1 -- 172.21.15.49:0/1337913081 >> 172.21.15.49:0/1337913081 conn(0x7f176c070450 msgr2=0x7f176c0cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:47.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.249+0000 7f176b59e700 1 -- 172.21.15.49:0/1337913081 shutdown_connections 2023-07-21T22:13:47.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:47.249+0000 7f176b59e700 1 -- 172.21.15.49:0/1337913081 wait complete. 2023-07-21T22:13:47.296 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:13:47.315 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2023-07-21T22:13:46.373270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247052,"kb_used_data":6860,"kb_used_omap":0,"kb_used_meta":240128,"kb_avail":754727668,"statfs":{"total":773094113280,"available":772841132032,"internally_reserved":0,"allocated":7024640,"data_stored":3865151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":245891072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.302539"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089180+0000","last_change":"2023-07-21T22:13:41.102207+0000","last_active":"2023-07-21T22:13:42.089180+0000","last_peered":"2023-07-21T22:13:42.089180+0000","last_clean":"2023-07-21T22:13:42.089180+0000","last_became_active":"2023-07-21T22:13:41.101916+0000","last_became_peered":"2023-07-21T22:13:41.101916+0000","last_unstale":"2023-07-21T22:13:42.089180+0000","last_undegraded":"2023-07-21T22:13:42.089180+0000","last_fullsized":"2023-07-21T22:13:42.089180+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:46:55.324549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088843+0000","last_change":"2023-07-21T22:13:41.101881+0000","last_active":"2023-07-21T22:13:42.088843+0000","last_peered":"2023-07-21T22:13:42.088843+0000","last_clean":"2023-07-21T22:13:42.088843+0000","last_became_active":"2023-07-21T22:13:41.101588+0000","last_became_peered":"2023-07-21T22:13:41.101588+0000","last_unstale":"2023-07-21T22:13:42.088843+0000","last_undegraded":"2023-07-21T22:13:42.088843+0000","last_fullsized":"2023-07-21T22:13:42.088843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:50:15.771280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114631+0000","last_change":"2023-07-21T22:13:41.102406+0000","last_active":"2023-07-21T22:13:41.114631+0000","last_peered":"2023-07-21T22:13:41.114631+0000","last_clean":"2023-07-21T22:13:41.114631+0000","last_became_active":"2023-07-21T22:13:41.102137+0000","last_became_peered":"2023-07-21T22:13:41.102137+0000","last_unstale":"2023-07-21T22:13:41.114631+0000","last_undegraded":"2023-07-21T22:13:41.114631+0000","last_fullsized":"2023-07-21T22:13:41.114631+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:35.630446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.109032+0000","last_change":"2023-07-21T22:13:41.093070+0000","last_active":"2023-07-21T22:13:41.109032+0000","last_peered":"2023-07-21T22:13:41.109032+0000","last_clean":"2023-07-21T22:13:41.109032+0000","last_became_active":"2023-07-21T22:13:41.092734+0000","last_became_peered":"2023-07-21T22:13:41.092734+0000","last_unstale":"2023-07-21T22:13:41.109032+0000","last_undegraded":"2023-07-21T22:13:41.109032+0000","last_fullsized":"2023-07-21T22:13:41.109032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:29:54.037991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115829+0000","last_change":"2023-07-21T22:13:41.108849+0000","last_active":"2023-07-21T22:13:41.115829+0000","last_peered":"2023-07-21T22:13:41.115829+0000","last_clean":"2023-07-21T22:13:41.115829+0000","last_became_active":"2023-07-21T22:13:41.108566+0000","last_became_peered":"2023-07-21T22:13:41.108566+0000","last_unstale":"2023-07-21T22:13:41.115829+0000","last_undegraded":"2023-07-21T22:13:41.115829+0000","last_fullsized":"2023-07-21T22:13:41.115829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:18:05.133741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114892+0000","last_change":"2023-07-21T22:13:41.111253+0000","last_active":"2023-07-21T22:13:41.114892+0000","last_peered":"2023-07-21T22:13:41.114892+0000","last_clean":"2023-07-21T22:13:41.114892+0000","last_became_active":"2023-07-21T22:13:41.110498+0000","last_became_peered":"2023-07-21T22:13:41.110498+0000","last_unstale":"2023-07-21T22:13:41.114892+0000","last_undegraded":"2023-07-21T22:13:41.114892+0000","last_fullsized":"2023-07-21T22:13:41.114892+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:52:07.339883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115154+0000","last_change":"2023-07-21T22:13:41.105865+0000","last_active":"2023-07-21T22:13:41.115154+0000","last_peered":"2023-07-21T22:13:41.115154+0000","last_clean":"2023-07-21T22:13:41.115154+0000","last_became_active":"2023-07-21T22:13:41.105567+0000","last_became_peered":"2023-07-21T22:13:41.105567+0000","last_unstale":"2023-07-21T22:13:41.115154+0000","last_undegraded":"2023-07-21T22:13:41.115154+0000","last_fullsized":"2023-07-21T22:13:41.115154+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:44:28.582096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108876+0000","last_change":"2023-07-21T22:13:41.102968+0000","last_active":"2023-07-21T22:13:41.108876+0000","last_peered":"2023-07-21T22:13:41.108876+0000","last_clean":"2023-07-21T22:13:41.108876+0000","last_became_active":"2023-07-21T22:13:41.102713+0000","last_became_peered":"2023-07-21T22:13:41.102713+0000","last_unstale":"2023-07-21T22:13:41.108876+0000","last_undegraded":"2023-07-21T22:13:41.108876+0000","last_fullsized":"2023-07-21T22:13:41.108876+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:37.212909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118275+0000","last_change":"2023-07-21T22:13:41.108597+0000","last_active":"2023-07-21T22:13:41.118275+0000","last_peered":"2023-07-21T22:13:41.118275+0000","last_clean":"2023-07-21T22:13:41.118275+0000","last_became_active":"2023-07-21T22:13:41.108348+0000","last_became_peered":"2023-07-21T22:13:41.108348+0000","last_unstale":"2023-07-21T22:13:41.118275+0000","last_undegraded":"2023-07-21T22:13:41.118275+0000","last_fullsized":"2023-07-21T22:13:41.118275+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:34.485489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115770+0000","last_change":"2023-07-21T22:13:41.104555+0000","last_active":"2023-07-21T22:13:41.115770+0000","last_peered":"2023-07-21T22:13:41.115770+0000","last_clean":"2023-07-21T22:13:41.115770+0000","last_became_active":"2023-07-21T22:13:41.104299+0000","last_became_peered":"2023-07-21T22:13:41.104299+0000","last_unstale":"2023-07-21T22:13:41.115770+0000","last_undegraded":"2023-07-21T22:13:41.115770+0000","last_fullsized":"2023-07-21T22:13:41.115770+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:15:37.915301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115753+0000","last_change":"2023-07-21T22:13:41.103712+0000","last_active":"2023-07-21T22:13:41.115753+0000","last_peered":"2023-07-21T22:13:41.115753+0000","last_clean":"2023-07-21T22:13:41.115753+0000","last_became_active":"2023-07-21T22:13:41.103431+0000","last_became_peered":"2023-07-21T22:13:41.103431+0000","last_unstale":"2023-07-21T22:13:41.115753+0000","last_undegraded":"2023-07-21T22:13:41.115753+0000","last_fullsized":"2023-07-21T22:13:41.115753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:39.364718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108913+0000","last_change":"2023-07-21T22:13:41.104207+0000","last_active":"2023-07-21T22:13:41.108913+0000","last_peered":"2023-07-21T22:13:41.108913+0000","last_clean":"2023-07-21T22:13:41.108913+0000","last_became_active":"2023-07-21T22:13:41.103922+0000","last_became_peered":"2023-07-21T22:13:41.103922+0000","last_unstale":"2023-07-21T22:13:41.108913+0000","last_undegraded":"2023-07-21T22:13:41.108913+0000","last_fullsized":"2023-07-21T22:13:41.108913+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:57.274636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108822+0000","last_change":"2023-07-21T22:13:41.097039+0000","last_active":"2023-07-21T22:13:41.108822+0000","last_peered":"2023-07-21T22:13:41.108822+0000","last_clean":"2023-07-21T22:13:41.108822+0000","last_became_active":"2023-07-21T22:13:41.096761+0000","last_became_peered":"2023-07-21T22:13:41.096761+0000","last_unstale":"2023-07-21T22:13:41.108822+0000","last_undegraded":"2023-07-21T22:13:41.108822+0000","last_fullsized":"2023-07-21T22:13:41.108822+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:15:37.915301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114332+0000","last_change":"2023-07-21T22:13:41.101818+0000","last_active":"2023-07-21T22:13:41.114332+0000","last_peered":"2023-07-21T22:13:41.114332+0000","last_clean":"2023-07-21T22:13:41.114332+0000","last_became_active":"2023-07-21T22:13:41.101516+0000","last_became_peered":"2023-07-21T22:13:41.101516+0000","last_unstale":"2023-07-21T22:13:41.114332+0000","last_undegraded":"2023-07-21T22:13:41.114332+0000","last_fullsized":"2023-07-21T22:13:41.114332+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:01.251820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115313+0000","last_change":"2023-07-21T22:13:41.103892+0000","last_active":"2023-07-21T22:13:41.115313+0000","last_peered":"2023-07-21T22:13:41.115313+0000","last_clean":"2023-07-21T22:13:41.115313+0000","last_became_active":"2023-07-21T22:13:41.103587+0000","last_became_peered":"2023-07-21T22:13:41.103587+0000","last_unstale":"2023-07-21T22:13:41.115313+0000","last_undegraded":"2023-07-21T22:13:41.115313+0000","last_fullsized":"2023-07-21T22:13:41.115313+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:08:19.007621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115207+0000","last_change":"2023-07-21T22:13:41.106608+0000","last_active":"2023-07-21T22:13:41.115207+0000","last_peered":"2023-07-21T22:13:41.115207+0000","last_clean":"2023-07-21T22:13:41.115207+0000","last_became_active":"2023-07-21T22:13:41.106100+0000","last_became_peered":"2023-07-21T22:13:41.106100+0000","last_unstale":"2023-07-21T22:13:41.115207+0000","last_undegraded":"2023-07-21T22:13:41.115207+0000","last_fullsized":"2023-07-21T22:13:41.115207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:14.077369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089247+0000","last_change":"2023-07-21T22:13:41.104857+0000","last_active":"2023-07-21T22:13:42.089247+0000","last_peered":"2023-07-21T22:13:42.089247+0000","last_clean":"2023-07-21T22:13:42.089247+0000","last_became_active":"2023-07-21T22:13:41.104573+0000","last_became_peered":"2023-07-21T22:13:41.104573+0000","last_unstale":"2023-07-21T22:13:42.089247+0000","last_undegraded":"2023-07-21T22:13:42.089247+0000","last_fullsized":"2023-07-21T22:13:42.089247+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:12:26.300399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115386+0000","last_change":"2023-07-21T22:13:41.098779+0000","last_active":"2023-07-21T22:13:41.115386+0000","last_peered":"2023-07-21T22:13:41.115386+0000","last_clean":"2023-07-21T22:13:41.115386+0000","last_became_active":"2023-07-21T22:13:41.097678+0000","last_became_peered":"2023-07-21T22:13:41.097678+0000","last_unstale":"2023-07-21T22:13:41.115386+0000","last_undegraded":"2023-07-21T22:13:41.115386+0000","last_fullsized":"2023-07-21T22:13:41.115386+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:39.921791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115791+0000","last_change":"2023-07-21T22:13:41.110504+0000","last_active":"2023-07-21T22:13:41.115791+0000","last_peered":"2023-07-21T22:13:41.115791+0000","last_clean":"2023-07-21T22:13:41.115791+0000","last_became_active":"2023-07-21T22:13:41.110211+0000","last_became_peered":"2023-07-21T22:13:41.110211+0000","last_unstale":"2023-07-21T22:13:41.115791+0000","last_undegraded":"2023-07-21T22:13:41.115791+0000","last_fullsized":"2023-07-21T22:13:41.115791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:29:05.960444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.100716+0000","last_change":"2023-07-21T22:13:41.097911+0000","last_active":"2023-07-21T22:13:41.100716+0000","last_peered":"2023-07-21T22:13:41.100716+0000","last_clean":"2023-07-21T22:13:41.100716+0000","last_became_active":"2023-07-21T22:13:41.097604+0000","last_became_peered":"2023-07-21T22:13:41.097604+0000","last_unstale":"2023-07-21T22:13:41.100716+0000","last_undegraded":"2023-07-21T22:13:41.100716+0000","last_fullsized":"2023-07-21T22:13:41.100716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:34.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108802+0000","last_change":"2023-07-21T22:13:41.096467+0000","last_active":"2023-07-21T22:13:41.108802+0000","last_peered":"2023-07-21T22:13:41.108802+0000","last_clean":"2023-07-21T22:13:41.108802+0000","last_became_active":"2023-07-21T22:13:41.093898+0000","last_became_peered":"2023-07-21T22:13:41.093898+0000","last_unstale":"2023-07-21T22:13:41.108802+0000","last_undegraded":"2023-07-21T22:13:41.108802+0000","last_fullsized":"2023-07-21T22:13:41.108802+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:18:48.827452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108350+0000","last_change":"2023-07-21T22:13:41.104555+0000","last_active":"2023-07-21T22:13:41.108350+0000","last_peered":"2023-07-21T22:13:41.108350+0000","last_clean":"2023-07-21T22:13:41.108350+0000","last_became_active":"2023-07-21T22:13:41.104275+0000","last_became_peered":"2023-07-21T22:13:41.104275+0000","last_unstale":"2023-07-21T22:13:41.108350+0000","last_undegraded":"2023-07-21T22:13:41.108350+0000","last_fullsized":"2023-07-21T22:13:41.108350+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:52:50.466773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.109527+0000","last_change":"2023-07-21T22:13:41.103964+0000","last_active":"2023-07-21T22:13:41.109527+0000","last_peered":"2023-07-21T22:13:41.109527+0000","last_clean":"2023-07-21T22:13:41.109527+0000","last_became_active":"2023-07-21T22:13:41.103680+0000","last_became_peered":"2023-07-21T22:13:41.103680+0000","last_unstale":"2023-07-21T22:13:41.109527+0000","last_undegraded":"2023-07-21T22:13:41.109527+0000","last_fullsized":"2023-07-21T22:13:41.109527+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:39.370150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114357+0000","last_change":"2023-07-21T22:13:41.102028+0000","last_active":"2023-07-21T22:13:41.114357+0000","last_peered":"2023-07-21T22:13:41.114357+0000","last_clean":"2023-07-21T22:13:41.114357+0000","last_became_active":"2023-07-21T22:13:41.101730+0000","last_became_peered":"2023-07-21T22:13:41.101730+0000","last_unstale":"2023-07-21T22:13:41.114357+0000","last_undegraded":"2023-07-21T22:13:41.114357+0000","last_fullsized":"2023-07-21T22:13:41.114357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:39.844317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.106848+0000","last_change":"2023-07-21T22:13:41.096075+0000","last_active":"2023-07-21T22:13:41.106848+0000","last_peered":"2023-07-21T22:13:41.106848+0000","last_clean":"2023-07-21T22:13:41.106848+0000","last_became_active":"2023-07-21T22:13:41.093481+0000","last_became_peered":"2023-07-21T22:13:41.093481+0000","last_unstale":"2023-07-21T22:13:41.106848+0000","last_undegraded":"2023-07-21T22:13:41.106848+0000","last_fullsized":"2023-07-21T22:13:41.106848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:44.826686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108850+0000","last_change":"2023-07-21T22:13:41.098370+0000","last_active":"2023-07-21T22:13:41.108850+0000","last_peered":"2023-07-21T22:13:41.108850+0000","last_clean":"2023-07-21T22:13:41.108850+0000","last_became_active":"2023-07-21T22:13:41.098102+0000","last_became_peered":"2023-07-21T22:13:41.098102+0000","last_unstale":"2023-07-21T22:13:41.108850+0000","last_undegraded":"2023-07-21T22:13:41.108850+0000","last_fullsized":"2023-07-21T22:13:41.108850+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:34.485489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.113081+0000","last_change":"2023-07-21T22:13:41.097502+0000","last_active":"2023-07-21T22:13:41.113081+0000","last_peered":"2023-07-21T22:13:41.113081+0000","last_clean":"2023-07-21T22:13:41.113081+0000","last_became_active":"2023-07-21T22:13:41.097033+0000","last_became_peered":"2023-07-21T22:13:41.097033+0000","last_unstale":"2023-07-21T22:13:41.113081+0000","last_undegraded":"2023-07-21T22:13:41.113081+0000","last_fullsized":"2023-07-21T22:13:41.113081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:37.732164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088237+0000","last_change":"2023-07-21T22:13:41.100363+0000","last_active":"2023-07-21T22:13:42.088237+0000","last_peered":"2023-07-21T22:13:42.088237+0000","last_clean":"2023-07-21T22:13:42.088237+0000","last_became_active":"2023-07-21T22:13:41.100037+0000","last_became_peered":"2023-07-21T22:13:41.100037+0000","last_unstale":"2023-07-21T22:13:42.088237+0000","last_undegraded":"2023-07-21T22:13:42.088237+0000","last_fullsized":"2023-07-21T22:13:42.088237+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:38:08.319743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114482+0000","last_change":"2023-07-21T22:13:41.102785+0000","last_active":"2023-07-21T22:13:41.114482+0000","last_peered":"2023-07-21T22:13:41.114482+0000","last_clean":"2023-07-21T22:13:41.114482+0000","last_became_active":"2023-07-21T22:13:41.102481+0000","last_became_peered":"2023-07-21T22:13:41.102481+0000","last_unstale":"2023-07-21T22:13:41.114482+0000","last_undegraded":"2023-07-21T22:13:41.114482+0000","last_fullsized":"2023-07-21T22:13:41.114482+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:19.379168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.108932+0000","last_change":"2023-07-21T22:13:41.101943+0000","last_active":"2023-07-21T22:13:41.108932+0000","last_peered":"2023-07-21T22:13:41.108932+0000","last_clean":"2023-07-21T22:13:41.108932+0000","last_became_active":"2023-07-21T22:13:41.101635+0000","last_became_peered":"2023-07-21T22:13:41.101635+0000","last_unstale":"2023-07-21T22:13:41.108932+0000","last_undegraded":"2023-07-21T22:13:41.108932+0000","last_fullsized":"2023-07-21T22:13:41.108932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:01:51.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115272+0000","last_change":"2023-07-21T22:13:41.096068+0000","last_active":"2023-07-21T22:13:41.115272+0000","last_peered":"2023-07-21T22:13:41.115272+0000","last_clean":"2023-07-21T22:13:41.115272+0000","last_became_active":"2023-07-21T22:13:41.095783+0000","last_became_peered":"2023-07-21T22:13:41.095783+0000","last_unstale":"2023-07-21T22:13:41.115272+0000","last_undegraded":"2023-07-21T22:13:41.115272+0000","last_fullsized":"2023-07-21T22:13:41.115272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:51:09.826591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.114831+0000","last_change":"2023-07-21T22:13:41.110068+0000","last_active":"2023-07-21T22:13:41.114831+0000","last_peered":"2023-07-21T22:13:41.114831+0000","last_clean":"2023-07-21T22:13:41.114831+0000","last_became_active":"2023-07-21T22:13:41.109762+0000","last_became_peered":"2023-07-21T22:13:41.109762+0000","last_unstale":"2023-07-21T22:13:41.114831+0000","last_undegraded":"2023-07-21T22:13:41.114831+0000","last_fullsized":"2023-07-21T22:13:41.114831+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:44:09.003020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112528+0000","last_change":"2023-07-21T22:13:41.107081+0000","last_active":"2023-07-21T22:13:41.112528+0000","last_peered":"2023-07-21T22:13:41.112528+0000","last_clean":"2023-07-21T22:13:41.112528+0000","last_became_active":"2023-07-21T22:13:41.106787+0000","last_became_peered":"2023-07-21T22:13:41.106787+0000","last_unstale":"2023-07-21T22:13:41.112528+0000","last_undegraded":"2023-07-21T22:13:41.112528+0000","last_fullsized":"2023-07-21T22:13:41.112528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:34:48.139648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"61'4","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089353+0000","last_change":"2023-07-21T22:13:40.101387+0000","last_active":"2023-07-21T22:13:42.089353+0000","last_peered":"2023-07-21T22:13:42.089353+0000","last_clean":"2023-07-21T22:13:42.089353+0000","last_became_active":"2023-07-21T22:13:40.100913+0000","last_became_peered":"2023-07-21T22:13:40.100913+0000","last_unstale":"2023-07-21T22:13:42.089353+0000","last_undegraded":"2023-07-21T22:13:42.089353+0000","last_fullsized":"2023-07-21T22:13:42.089353+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:23.939422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112989+0000","last_change":"2023-07-21T22:13:41.096891+0000","last_active":"2023-07-21T22:13:41.112989+0000","last_peered":"2023-07-21T22:13:41.112989+0000","last_clean":"2023-07-21T22:13:41.112989+0000","last_became_active":"2023-07-21T22:13:41.095295+0000","last_became_peered":"2023-07-21T22:13:41.095295+0000","last_unstale":"2023-07-21T22:13:41.112989+0000","last_undegraded":"2023-07-21T22:13:41.112989+0000","last_fullsized":"2023-07-21T22:13:41.112989+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:14.952691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.121232+0000","last_change":"2023-07-21T22:13:40.094443+0000","last_active":"2023-07-21T22:13:41.121232+0000","last_peered":"2023-07-21T22:13:41.121232+0000","last_clean":"2023-07-21T22:13:41.121232+0000","last_became_active":"2023-07-21T22:13:40.094114+0000","last_became_peered":"2023-07-21T22:13:40.094114+0000","last_unstale":"2023-07-21T22:13:41.121232+0000","last_undegraded":"2023-07-21T22:13:41.121232+0000","last_fullsized":"2023-07-21T22:13:41.121232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:28.818934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.101929+0000","last_change":"2023-07-21T22:13:41.097322+0000","last_active":"2023-07-21T22:13:41.101929+0000","last_peered":"2023-07-21T22:13:41.101929+0000","last_clean":"2023-07-21T22:13:41.101929+0000","last_became_active":"2023-07-21T22:13:41.097054+0000","last_became_peered":"2023-07-21T22:13:41.097054+0000","last_unstale":"2023-07-21T22:13:41.101929+0000","last_undegraded":"2023-07-21T22:13:41.101929+0000","last_fullsized":"2023-07-21T22:13:41.101929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:24.106186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.122724+0000","last_change":"2023-07-21T22:13:40.087761+0000","last_active":"2023-07-21T22:13:41.122724+0000","last_peered":"2023-07-21T22:13:41.122724+0000","last_clean":"2023-07-21T22:13:41.122724+0000","last_became_active":"2023-07-21T22:13:40.087468+0000","last_became_peered":"2023-07-21T22:13:40.087468+0000","last_unstale":"2023-07-21T22:13:41.122724+0000","last_undegraded":"2023-07-21T22:13:41.122724+0000","last_fullsized":"2023-07-21T22:13:41.122724+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:53.822832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115750+0000","last_change":"2023-07-21T22:13:41.104006+0000","last_active":"2023-07-21T22:13:41.115750+0000","last_peered":"2023-07-21T22:13:41.115750+0000","last_clean":"2023-07-21T22:13:41.115750+0000","last_became_active":"2023-07-21T22:13:41.103736+0000","last_became_peered":"2023-07-21T22:13:41.103736+0000","last_unstale":"2023-07-21T22:13:41.115750+0000","last_undegraded":"2023-07-21T22:13:41.115750+0000","last_fullsized":"2023-07-21T22:13:41.115750+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:01:51.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.121997+0000","last_change":"2023-07-21T22:13:40.096070+0000","last_active":"2023-07-21T22:13:41.121997+0000","last_peered":"2023-07-21T22:13:41.121997+0000","last_clean":"2023-07-21T22:13:41.121997+0000","last_became_active":"2023-07-21T22:13:40.095788+0000","last_became_peered":"2023-07-21T22:13:40.095788+0000","last_unstale":"2023-07-21T22:13:41.121997+0000","last_undegraded":"2023-07-21T22:13:41.121997+0000","last_fullsized":"2023-07-21T22:13:41.121997+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:44:32.650671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115187+0000","last_change":"2023-07-21T22:13:41.106371+0000","last_active":"2023-07-21T22:13:41.115187+0000","last_peered":"2023-07-21T22:13:41.115187+0000","last_clean":"2023-07-21T22:13:41.115187+0000","last_became_active":"2023-07-21T22:13:41.105701+0000","last_became_peered":"2023-07-21T22:13:41.105701+0000","last_unstale":"2023-07-21T22:13:41.115187+0000","last_undegraded":"2023-07-21T22:13:41.115187+0000","last_fullsized":"2023-07-21T22:13:41.115187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:34:03.908679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119232+0000","last_change":"2023-07-21T22:13:40.091865+0000","last_active":"2023-07-21T22:13:41.119232+0000","last_peered":"2023-07-21T22:13:41.119232+0000","last_clean":"2023-07-21T22:13:41.119232+0000","last_became_active":"2023-07-21T22:13:40.091563+0000","last_became_peered":"2023-07-21T22:13:40.091563+0000","last_unstale":"2023-07-21T22:13:41.119232+0000","last_undegraded":"2023-07-21T22:13:41.119232+0000","last_fullsized":"2023-07-21T22:13:41.119232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:07.095120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087875+0000","last_change":"2023-07-21T22:13:41.100501+0000","last_active":"2023-07-21T22:13:42.087875+0000","last_peered":"2023-07-21T22:13:42.087875+0000","last_clean":"2023-07-21T22:13:42.087875+0000","last_became_active":"2023-07-21T22:13:41.100189+0000","last_became_peered":"2023-07-21T22:13:41.100189+0000","last_unstale":"2023-07-21T22:13:42.087875+0000","last_undegraded":"2023-07-21T22:13:42.087875+0000","last_fullsized":"2023-07-21T22:13:42.087875+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:29:26.099634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118983+0000","last_change":"2023-07-21T22:13:40.088623+0000","last_active":"2023-07-21T22:13:41.118983+0000","last_peered":"2023-07-21T22:13:41.118983+0000","last_clean":"2023-07-21T22:13:41.118983+0000","last_became_active":"2023-07-21T22:13:40.088019+0000","last_became_peered":"2023-07-21T22:13:40.088019+0000","last_unstale":"2023-07-21T22:13:41.118983+0000","last_undegraded":"2023-07-21T22:13:41.118983+0000","last_fullsized":"2023-07-21T22:13:41.118983+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:11:27.016587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112409+0000","last_change":"2023-07-21T22:13:41.100003+0000","last_active":"2023-07-21T22:13:41.112409+0000","last_peered":"2023-07-21T22:13:41.112409+0000","last_clean":"2023-07-21T22:13:41.112409+0000","last_became_active":"2023-07-21T22:13:41.099703+0000","last_became_peered":"2023-07-21T22:13:41.099703+0000","last_unstale":"2023-07-21T22:13:41.112409+0000","last_undegraded":"2023-07-21T22:13:41.112409+0000","last_fullsized":"2023-07-21T22:13:41.112409+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:12:26.575731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078570+0000","last_change":"2023-07-21T22:13:40.092332+0000","last_active":"2023-07-21T22:13:41.078570+0000","last_peered":"2023-07-21T22:13:41.078570+0000","last_clean":"2023-07-21T22:13:41.078570+0000","last_became_active":"2023-07-21T22:13:40.091709+0000","last_became_peered":"2023-07-21T22:13:40.091709+0000","last_unstale":"2023-07-21T22:13:41.078570+0000","last_undegraded":"2023-07-21T22:13:41.078570+0000","last_fullsized":"2023-07-21T22:13:41.078570+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:00.067789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.100801+0000","last_change":"2023-07-21T22:13:41.096538+0000","last_active":"2023-07-21T22:13:41.100801+0000","last_peered":"2023-07-21T22:13:41.100801+0000","last_clean":"2023-07-21T22:13:41.100801+0000","last_became_active":"2023-07-21T22:13:41.096233+0000","last_became_peered":"2023-07-21T22:13:41.096233+0000","last_unstale":"2023-07-21T22:13:41.100801+0000","last_undegraded":"2023-07-21T22:13:41.100801+0000","last_fullsized":"2023-07-21T22:13:41.100801+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:55:28.232508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.088154+0000","last_change":"2023-07-21T22:13:40.099452+0000","last_active":"2023-07-21T22:13:41.088154+0000","last_peered":"2023-07-21T22:13:41.088154+0000","last_clean":"2023-07-21T22:13:41.088154+0000","last_became_active":"2023-07-21T22:13:40.099144+0000","last_became_peered":"2023-07-21T22:13:40.099144+0000","last_unstale":"2023-07-21T22:13:41.088154+0000","last_undegraded":"2023-07-21T22:13:41.088154+0000","last_fullsized":"2023-07-21T22:13:41.088154+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:51:43.066212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088379+0000","last_change":"2023-07-21T22:13:41.095806+0000","last_active":"2023-07-21T22:13:42.088379+0000","last_peered":"2023-07-21T22:13:42.088379+0000","last_clean":"2023-07-21T22:13:42.088379+0000","last_became_active":"2023-07-21T22:13:41.095496+0000","last_became_peered":"2023-07-21T22:13:41.095496+0000","last_unstale":"2023-07-21T22:13:42.088379+0000","last_undegraded":"2023-07-21T22:13:42.088379+0000","last_fullsized":"2023-07-21T22:13:42.088379+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:13.001060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.088801+0000","last_change":"2023-07-21T22:13:40.100806+0000","last_active":"2023-07-21T22:13:41.088801+0000","last_peered":"2023-07-21T22:13:41.088801+0000","last_clean":"2023-07-21T22:13:41.088801+0000","last_became_active":"2023-07-21T22:13:40.100450+0000","last_became_peered":"2023-07-21T22:13:40.100450+0000","last_unstale":"2023-07-21T22:13:41.088801+0000","last_undegraded":"2023-07-21T22:13:41.088801+0000","last_fullsized":"2023-07-21T22:13:41.088801+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:16:10.411350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.092547+0000","last_change":"2023-07-21T22:13:41.089865+0000","last_active":"2023-07-21T22:13:41.092547+0000","last_peered":"2023-07-21T22:13:41.092547+0000","last_clean":"2023-07-21T22:13:41.092547+0000","last_became_active":"2023-07-21T22:13:41.089516+0000","last_became_peered":"2023-07-21T22:13:41.089516+0000","last_unstale":"2023-07-21T22:13:41.092547+0000","last_undegraded":"2023-07-21T22:13:41.092547+0000","last_fullsized":"2023-07-21T22:13:41.092547+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:24:50.488362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.081111+0000","last_change":"2023-07-21T22:13:40.094632+0000","last_active":"2023-07-21T22:13:41.081111+0000","last_peered":"2023-07-21T22:13:41.081111+0000","last_clean":"2023-07-21T22:13:41.081111+0000","last_became_active":"2023-07-21T22:13:40.094368+0000","last_became_peered":"2023-07-21T22:13:40.094368+0000","last_unstale":"2023-07-21T22:13:41.081111+0000","last_undegraded":"2023-07-21T22:13:41.081111+0000","last_fullsized":"2023-07-21T22:13:41.081111+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:09.684014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115717+0000","last_change":"2023-07-21T22:13:41.108001+0000","last_active":"2023-07-21T22:13:41.115717+0000","last_peered":"2023-07-21T22:13:41.115717+0000","last_clean":"2023-07-21T22:13:41.115717+0000","last_became_active":"2023-07-21T22:13:41.107733+0000","last_became_peered":"2023-07-21T22:13:41.107733+0000","last_unstale":"2023-07-21T22:13:41.115717+0000","last_undegraded":"2023-07-21T22:13:41.115717+0000","last_fullsized":"2023-07-21T22:13:41.115717+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:53:48.587220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118808+0000","last_change":"2023-07-21T22:13:40.098392+0000","last_active":"2023-07-21T22:13:41.118808+0000","last_peered":"2023-07-21T22:13:41.118808+0000","last_clean":"2023-07-21T22:13:41.118808+0000","last_became_active":"2023-07-21T22:13:40.098099+0000","last_became_peered":"2023-07-21T22:13:40.098099+0000","last_unstale":"2023-07-21T22:13:41.118808+0000","last_undegraded":"2023-07-21T22:13:41.118808+0000","last_fullsized":"2023-07-21T22:13:41.118808+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:04.466014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107884+0000","last_change":"2023-07-21T22:13:41.092950+0000","last_active":"2023-07-21T22:13:41.107884+0000","last_peered":"2023-07-21T22:13:41.107884+0000","last_clean":"2023-07-21T22:13:41.107884+0000","last_became_active":"2023-07-21T22:13:41.092105+0000","last_became_peered":"2023-07-21T22:13:41.092105+0000","last_unstale":"2023-07-21T22:13:41.107884+0000","last_undegraded":"2023-07-21T22:13:41.107884+0000","last_fullsized":"2023-07-21T22:13:41.107884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:33.372984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088589+0000","last_change":"2023-07-21T22:13:40.094145+0000","last_active":"2023-07-21T22:13:42.088589+0000","last_peered":"2023-07-21T22:13:42.088589+0000","last_clean":"2023-07-21T22:13:42.088589+0000","last_became_active":"2023-07-21T22:13:40.093633+0000","last_became_peered":"2023-07-21T22:13:40.093633+0000","last_unstale":"2023-07-21T22:13:42.088589+0000","last_undegraded":"2023-07-21T22:13:42.088589+0000","last_fullsized":"2023-07-21T22:13:42.088589+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:19:31.029843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.116141+0000","last_change":"2023-07-21T22:13:41.103922+0000","last_active":"2023-07-21T22:13:41.116141+0000","last_peered":"2023-07-21T22:13:41.116141+0000","last_clean":"2023-07-21T22:13:41.116141+0000","last_became_active":"2023-07-21T22:13:41.103642+0000","last_became_peered":"2023-07-21T22:13:41.103642+0000","last_unstale":"2023-07-21T22:13:41.116141+0000","last_undegraded":"2023-07-21T22:13:41.116141+0000","last_fullsized":"2023-07-21T22:13:41.116141+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:47:44.351565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119015+0000","last_change":"2023-07-21T22:13:40.096493+0000","last_active":"2023-07-21T22:13:41.119015+0000","last_peered":"2023-07-21T22:13:41.119015+0000","last_clean":"2023-07-21T22:13:41.119015+0000","last_became_active":"2023-07-21T22:13:40.096174+0000","last_became_peered":"2023-07-21T22:13:40.096174+0000","last_unstale":"2023-07-21T22:13:41.119015+0000","last_undegraded":"2023-07-21T22:13:41.119015+0000","last_fullsized":"2023-07-21T22:13:41.119015+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:50:47.997077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107074+0000","last_change":"2023-07-21T22:13:41.095610+0000","last_active":"2023-07-21T22:13:41.107074+0000","last_peered":"2023-07-21T22:13:41.107074+0000","last_clean":"2023-07-21T22:13:41.107074+0000","last_became_active":"2023-07-21T22:13:41.092550+0000","last_became_peered":"2023-07-21T22:13:41.092550+0000","last_unstale":"2023-07-21T22:13:41.107074+0000","last_undegraded":"2023-07-21T22:13:41.107074+0000","last_fullsized":"2023-07-21T22:13:41.107074+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:02:55.094217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080696+0000","last_change":"2023-07-21T22:13:40.095144+0000","last_active":"2023-07-21T22:13:41.080696+0000","last_peered":"2023-07-21T22:13:41.080696+0000","last_clean":"2023-07-21T22:13:41.080696+0000","last_became_active":"2023-07-21T22:13:40.094633+0000","last_became_peered":"2023-07-21T22:13:40.094633+0000","last_unstale":"2023-07-21T22:13:41.080696+0000","last_undegraded":"2023-07-21T22:13:41.080696+0000","last_fullsized":"2023-07-21T22:13:41.080696+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:16:10.411350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112455+0000","last_change":"2023-07-21T22:13:41.103229+0000","last_active":"2023-07-21T22:13:41.112455+0000","last_peered":"2023-07-21T22:13:41.112455+0000","last_clean":"2023-07-21T22:13:41.112455+0000","last_became_active":"2023-07-21T22:13:41.102919+0000","last_became_peered":"2023-07-21T22:13:41.102919+0000","last_unstale":"2023-07-21T22:13:41.112455+0000","last_undegraded":"2023-07-21T22:13:41.112455+0000","last_fullsized":"2023-07-21T22:13:41.112455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:57:31.042080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.090400+0000","last_change":"2023-07-21T22:13:40.097496+0000","last_active":"2023-07-21T22:13:41.090400+0000","last_peered":"2023-07-21T22:13:41.090400+0000","last_clean":"2023-07-21T22:13:41.090400+0000","last_became_active":"2023-07-21T22:13:40.097141+0000","last_became_peered":"2023-07-21T22:13:40.097141+0000","last_unstale":"2023-07-21T22:13:41.090400+0000","last_undegraded":"2023-07-21T22:13:41.090400+0000","last_fullsized":"2023-07-21T22:13:41.090400+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:01.084349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088595+0000","last_change":"2023-07-21T22:13:41.104249+0000","last_active":"2023-07-21T22:13:42.088595+0000","last_peered":"2023-07-21T22:13:42.088595+0000","last_clean":"2023-07-21T22:13:42.088595+0000","last_became_active":"2023-07-21T22:13:41.103977+0000","last_became_peered":"2023-07-21T22:13:41.103977+0000","last_unstale":"2023-07-21T22:13:42.088595+0000","last_undegraded":"2023-07-21T22:13:42.088595+0000","last_fullsized":"2023-07-21T22:13:42.088595+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:20:42.386961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.123480+0000","last_change":"2023-07-21T22:13:40.093508+0000","last_active":"2023-07-21T22:13:41.123480+0000","last_peered":"2023-07-21T22:13:41.123480+0000","last_clean":"2023-07-21T22:13:41.123480+0000","last_became_active":"2023-07-21T22:13:40.093118+0000","last_became_peered":"2023-07-21T22:13:40.093118+0000","last_unstale":"2023-07-21T22:13:41.123480+0000","last_undegraded":"2023-07-21T22:13:41.123480+0000","last_fullsized":"2023-07-21T22:13:41.123480+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:05:47.861560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.117774+0000","last_change":"2023-07-21T22:13:41.114988+0000","last_active":"2023-07-21T22:13:41.117774+0000","last_peered":"2023-07-21T22:13:41.117774+0000","last_clean":"2023-07-21T22:13:41.117774+0000","last_became_active":"2023-07-21T22:13:41.114608+0000","last_became_peered":"2023-07-21T22:13:41.114608+0000","last_unstale":"2023-07-21T22:13:41.117774+0000","last_undegraded":"2023-07-21T22:13:41.117774+0000","last_fullsized":"2023-07-21T22:13:41.117774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:12:14.393410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.120885+0000","last_change":"2023-07-21T22:13:40.095884+0000","last_active":"2023-07-21T22:13:41.120885+0000","last_peered":"2023-07-21T22:13:41.120885+0000","last_clean":"2023-07-21T22:13:41.120885+0000","last_became_active":"2023-07-21T22:13:40.095515+0000","last_became_peered":"2023-07-21T22:13:40.095515+0000","last_unstale":"2023-07-21T22:13:41.120885+0000","last_undegraded":"2023-07-21T22:13:41.120885+0000","last_fullsized":"2023-07-21T22:13:41.120885+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:29:53.027086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.111417+0000","last_change":"2023-07-21T22:13:41.099642+0000","last_active":"2023-07-21T22:13:41.111417+0000","last_peered":"2023-07-21T22:13:41.111417+0000","last_clean":"2023-07-21T22:13:41.111417+0000","last_became_active":"2023-07-21T22:13:41.099177+0000","last_became_peered":"2023-07-21T22:13:41.099177+0000","last_unstale":"2023-07-21T22:13:41.111417+0000","last_undegraded":"2023-07-21T22:13:41.111417+0000","last_fullsized":"2023-07-21T22:13:41.111417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:26.604799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080984+0000","last_change":"2023-07-21T22:13:40.089926+0000","last_active":"2023-07-21T22:13:41.080984+0000","last_peered":"2023-07-21T22:13:41.080984+0000","last_clean":"2023-07-21T22:13:41.080984+0000","last_became_active":"2023-07-21T22:13:40.089612+0000","last_became_peered":"2023-07-21T22:13:40.089612+0000","last_unstale":"2023-07-21T22:13:41.080984+0000","last_undegraded":"2023-07-21T22:13:41.080984+0000","last_fullsized":"2023-07-21T22:13:41.080984+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:01.084349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.101400+0000","last_change":"2023-07-21T22:13:41.092119+0000","last_active":"2023-07-21T22:13:41.101400+0000","last_peered":"2023-07-21T22:13:41.101400+0000","last_clean":"2023-07-21T22:13:41.101400+0000","last_became_active":"2023-07-21T22:13:41.091845+0000","last_became_peered":"2023-07-21T22:13:41.091845+0000","last_unstale":"2023-07-21T22:13:41.101400+0000","last_undegraded":"2023-07-21T22:13:41.101400+0000","last_fullsized":"2023-07-21T22:13:41.101400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:43:59.156552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.084066+0000","last_change":"2023-07-21T22:13:40.087676+0000","last_active":"2023-07-21T22:13:41.084066+0000","last_peered":"2023-07-21T22:13:41.084066+0000","last_clean":"2023-07-21T22:13:41.084066+0000","last_became_active":"2023-07-21T22:13:40.087408+0000","last_became_peered":"2023-07-21T22:13:40.087408+0000","last_unstale":"2023-07-21T22:13:41.084066+0000","last_undegraded":"2023-07-21T22:13:41.084066+0000","last_fullsized":"2023-07-21T22:13:41.084066+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:57:08.795253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107260+0000","last_change":"2023-07-21T22:13:41.098307+0000","last_active":"2023-07-21T22:13:41.107260+0000","last_peered":"2023-07-21T22:13:41.107260+0000","last_clean":"2023-07-21T22:13:41.107260+0000","last_became_active":"2023-07-21T22:13:41.097931+0000","last_became_peered":"2023-07-21T22:13:41.097931+0000","last_unstale":"2023-07-21T22:13:41.107260+0000","last_undegraded":"2023-07-21T22:13:41.107260+0000","last_fullsized":"2023-07-21T22:13:41.107260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:12:25.824212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088710+0000","last_change":"2023-07-21T22:13:40.093966+0000","last_active":"2023-07-21T22:13:42.088710+0000","last_peered":"2023-07-21T22:13:42.088710+0000","last_clean":"2023-07-21T22:13:42.088710+0000","last_became_active":"2023-07-21T22:13:40.093353+0000","last_became_peered":"2023-07-21T22:13:40.093353+0000","last_unstale":"2023-07-21T22:13:42.088710+0000","last_undegraded":"2023-07-21T22:13:42.088710+0000","last_fullsized":"2023-07-21T22:13:42.088710+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:21:38.041433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112511+0000","last_change":"2023-07-21T22:13:41.105050+0000","last_active":"2023-07-21T22:13:41.112511+0000","last_peered":"2023-07-21T22:13:41.112511+0000","last_clean":"2023-07-21T22:13:41.112511+0000","last_became_active":"2023-07-21T22:13:41.104758+0000","last_became_peered":"2023-07-21T22:13:41.104758+0000","last_unstale":"2023-07-21T22:13:41.112511+0000","last_undegraded":"2023-07-21T22:13:41.112511+0000","last_fullsized":"2023-07-21T22:13:41.112511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:59.926223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.088595+0000","last_change":"2023-07-21T22:13:40.097222+0000","last_active":"2023-07-21T22:13:41.088595+0000","last_peered":"2023-07-21T22:13:41.088595+0000","last_clean":"2023-07-21T22:13:41.088595+0000","last_became_active":"2023-07-21T22:13:40.096883+0000","last_became_peered":"2023-07-21T22:13:40.096883+0000","last_unstale":"2023-07-21T22:13:41.088595+0000","last_undegraded":"2023-07-21T22:13:41.088595+0000","last_fullsized":"2023-07-21T22:13:41.088595+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:43:58.145647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115833+0000","last_change":"2023-07-21T22:13:41.104606+0000","last_active":"2023-07-21T22:13:41.115833+0000","last_peered":"2023-07-21T22:13:41.115833+0000","last_clean":"2023-07-21T22:13:41.115833+0000","last_became_active":"2023-07-21T22:13:41.104358+0000","last_became_peered":"2023-07-21T22:13:41.104358+0000","last_unstale":"2023-07-21T22:13:41.115833+0000","last_undegraded":"2023-07-21T22:13:41.115833+0000","last_fullsized":"2023-07-21T22:13:41.115833+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:29:40.368592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078740+0000","last_change":"2023-07-21T22:13:40.097893+0000","last_active":"2023-07-21T22:13:41.078740+0000","last_peered":"2023-07-21T22:13:41.078740+0000","last_clean":"2023-07-21T22:13:41.078740+0000","last_became_active":"2023-07-21T22:13:40.097514+0000","last_became_peered":"2023-07-21T22:13:40.097514+0000","last_unstale":"2023-07-21T22:13:41.078740+0000","last_undegraded":"2023-07-21T22:13:41.078740+0000","last_fullsized":"2023-07-21T22:13:41.078740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:42:29.625435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089550+0000","last_change":"2023-07-21T22:13:41.100628+0000","last_active":"2023-07-21T22:13:42.089550+0000","last_peered":"2023-07-21T22:13:42.089550+0000","last_clean":"2023-07-21T22:13:42.089550+0000","last_became_active":"2023-07-21T22:13:41.100324+0000","last_became_peered":"2023-07-21T22:13:41.100324+0000","last_unstale":"2023-07-21T22:13:42.089550+0000","last_undegraded":"2023-07-21T22:13:42.089550+0000","last_fullsized":"2023-07-21T22:13:42.089550+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:40:56.494244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078342+0000","last_change":"2023-07-21T22:13:40.092519+0000","last_active":"2023-07-21T22:13:41.078342+0000","last_peered":"2023-07-21T22:13:41.078342+0000","last_clean":"2023-07-21T22:13:41.078342+0000","last_became_active":"2023-07-21T22:13:40.092070+0000","last_became_peered":"2023-07-21T22:13:40.092070+0000","last_unstale":"2023-07-21T22:13:41.078342+0000","last_undegraded":"2023-07-21T22:13:41.078342+0000","last_fullsized":"2023-07-21T22:13:41.078342+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:57:23.225259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115146+0000","last_change":"2023-07-21T22:13:41.107176+0000","last_active":"2023-07-21T22:13:41.115146+0000","last_peered":"2023-07-21T22:13:41.115146+0000","last_clean":"2023-07-21T22:13:41.115146+0000","last_became_active":"2023-07-21T22:13:41.106910+0000","last_became_peered":"2023-07-21T22:13:41.106910+0000","last_unstale":"2023-07-21T22:13:41.115146+0000","last_undegraded":"2023-07-21T22:13:41.115146+0000","last_fullsized":"2023-07-21T22:13:41.115146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:23:43.440412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088241+0000","last_change":"2023-07-21T22:13:40.096525+0000","last_active":"2023-07-21T22:13:42.088241+0000","last_peered":"2023-07-21T22:13:42.088241+0000","last_clean":"2023-07-21T22:13:42.088241+0000","last_became_active":"2023-07-21T22:13:40.096154+0000","last_became_peered":"2023-07-21T22:13:40.096154+0000","last_unstale":"2023-07-21T22:13:42.088241+0000","last_undegraded":"2023-07-21T22:13:42.088241+0000","last_fullsized":"2023-07-21T22:13:42.088241+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:31:03.344696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.100241+0000","last_change":"2023-07-21T22:13:41.097870+0000","last_active":"2023-07-21T22:13:41.100241+0000","last_peered":"2023-07-21T22:13:41.100241+0000","last_clean":"2023-07-21T22:13:41.100241+0000","last_became_active":"2023-07-21T22:13:41.097551+0000","last_became_peered":"2023-07-21T22:13:41.097551+0000","last_unstale":"2023-07-21T22:13:41.100241+0000","last_undegraded":"2023-07-21T22:13:41.100241+0000","last_fullsized":"2023-07-21T22:13:41.100241+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:06.859565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080550+0000","last_change":"2023-07-21T22:13:40.087863+0000","last_active":"2023-07-21T22:13:41.080550+0000","last_peered":"2023-07-21T22:13:41.080550+0000","last_clean":"2023-07-21T22:13:41.080550+0000","last_became_active":"2023-07-21T22:13:40.087564+0000","last_became_peered":"2023-07-21T22:13:40.087564+0000","last_unstale":"2023-07-21T22:13:41.080550+0000","last_undegraded":"2023-07-21T22:13:41.080550+0000","last_fullsized":"2023-07-21T22:13:41.080550+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:18:30.093515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.089156+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:13:41.089156+0000","last_peered":"2023-07-21T22:13:41.089156+0000","last_clean":"2023-07-21T22:13:41.089156+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:13:41.089156+0000","last_undegraded":"2023-07-21T22:13:41.089156+0000","last_fullsized":"2023-07-21T22:13:41.089156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:23.622141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115411+0000","last_change":"2023-07-21T22:13:41.098808+0000","last_active":"2023-07-21T22:13:41.115411+0000","last_peered":"2023-07-21T22:13:41.115411+0000","last_clean":"2023-07-21T22:13:41.115411+0000","last_became_active":"2023-07-21T22:13:41.097724+0000","last_became_peered":"2023-07-21T22:13:41.097724+0000","last_unstale":"2023-07-21T22:13:41.115411+0000","last_undegraded":"2023-07-21T22:13:41.115411+0000","last_fullsized":"2023-07-21T22:13:41.115411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:14.461183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.118701+0000","last_change":"2023-07-21T22:13:40.098471+0000","last_active":"2023-07-21T22:13:41.118701+0000","last_peered":"2023-07-21T22:13:41.118701+0000","last_clean":"2023-07-21T22:13:41.118701+0000","last_became_active":"2023-07-21T22:13:40.098189+0000","last_became_peered":"2023-07-21T22:13:40.098189+0000","last_unstale":"2023-07-21T22:13:41.118701+0000","last_undegraded":"2023-07-21T22:13:41.118701+0000","last_fullsized":"2023-07-21T22:13:41.118701+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:08:17.401688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089026+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:13:42.089026+0000","last_peered":"2023-07-21T22:13:42.089026+0000","last_clean":"2023-07-21T22:13:42.089026+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:13:42.089026+0000","last_undegraded":"2023-07-21T22:13:42.089026+0000","last_fullsized":"2023-07-21T22:13:42.089026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:57.136703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.115773+0000","last_change":"2023-07-21T22:13:41.109484+0000","last_active":"2023-07-21T22:13:41.115773+0000","last_peered":"2023-07-21T22:13:41.115773+0000","last_clean":"2023-07-21T22:13:41.115773+0000","last_became_active":"2023-07-21T22:13:41.109190+0000","last_became_peered":"2023-07-21T22:13:41.109190+0000","last_unstale":"2023-07-21T22:13:41.115773+0000","last_undegraded":"2023-07-21T22:13:41.115773+0000","last_fullsized":"2023-07-21T22:13:41.115773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:22:22.225547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119598+0000","last_change":"2023-07-21T22:13:40.100805+0000","last_active":"2023-07-21T22:13:41.119598+0000","last_peered":"2023-07-21T22:13:41.119598+0000","last_clean":"2023-07-21T22:13:41.119598+0000","last_became_active":"2023-07-21T22:13:40.100494+0000","last_became_peered":"2023-07-21T22:13:40.100494+0000","last_unstale":"2023-07-21T22:13:41.119598+0000","last_undegraded":"2023-07-21T22:13:41.119598+0000","last_fullsized":"2023-07-21T22:13:41.119598+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:56.263731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.086487+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:13:41.086487+0000","last_peered":"2023-07-21T22:13:41.086487+0000","last_clean":"2023-07-21T22:13:41.086487+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:13:41.086487+0000","last_undegraded":"2023-07-21T22:13:41.086487+0000","last_fullsized":"2023-07-21T22:13:41.086487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:36.844419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.120524+0000","last_change":"2023-07-21T22:13:41.117194+0000","last_active":"2023-07-21T22:13:41.120524+0000","last_peered":"2023-07-21T22:13:41.120524+0000","last_clean":"2023-07-21T22:13:41.120524+0000","last_became_active":"2023-07-21T22:13:41.116856+0000","last_became_peered":"2023-07-21T22:13:41.116856+0000","last_unstale":"2023-07-21T22:13:41.120524+0000","last_undegraded":"2023-07-21T22:13:41.120524+0000","last_fullsized":"2023-07-21T22:13:41.120524+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:02:55.094217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.119515+0000","last_change":"2023-07-21T22:13:40.096336+0000","last_active":"2023-07-21T22:13:41.119515+0000","last_peered":"2023-07-21T22:13:41.119515+0000","last_clean":"2023-07-21T22:13:41.119515+0000","last_became_active":"2023-07-21T22:13:40.095997+0000","last_became_peered":"2023-07-21T22:13:40.095997+0000","last_unstale":"2023-07-21T22:13:41.119515+0000","last_undegraded":"2023-07-21T22:13:41.119515+0000","last_fullsized":"2023-07-21T22:13:41.119515+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:40.777899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088826+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:13:42.088826+0000","last_peered":"2023-07-21T22:13:42.088826+0000","last_clean":"2023-07-21T22:13:42.088826+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:13:42.088826+0000","last_undegraded":"2023-07-21T22:13:42.088826+0000","last_fullsized":"2023-07-21T22:13:42.088826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:58:24.336351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112435+0000","last_change":"2023-07-21T22:13:41.100147+0000","last_active":"2023-07-21T22:13:41.112435+0000","last_peered":"2023-07-21T22:13:41.112435+0000","last_clean":"2023-07-21T22:13:41.112435+0000","last_became_active":"2023-07-21T22:13:41.099829+0000","last_became_peered":"2023-07-21T22:13:41.099829+0000","last_unstale":"2023-07-21T22:13:41.112435+0000","last_undegraded":"2023-07-21T22:13:41.112435+0000","last_fullsized":"2023-07-21T22:13:41.112435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:24.800740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.083747+0000","last_change":"2023-07-21T22:13:40.097666+0000","last_active":"2023-07-21T22:13:41.083747+0000","last_peered":"2023-07-21T22:13:41.083747+0000","last_clean":"2023-07-21T22:13:41.083747+0000","last_became_active":"2023-07-21T22:13:40.097365+0000","last_became_peered":"2023-07-21T22:13:40.097365+0000","last_unstale":"2023-07-21T22:13:41.083747+0000","last_undegraded":"2023-07-21T22:13:41.083747+0000","last_fullsized":"2023-07-21T22:13:41.083747+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:07:41.346094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080851+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:13:41.080851+0000","last_peered":"2023-07-21T22:13:41.080851+0000","last_clean":"2023-07-21T22:13:41.080851+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:13:41.080851+0000","last_undegraded":"2023-07-21T22:13:41.080851+0000","last_fullsized":"2023-07-21T22:13:41.080851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:27.861284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.107095+0000","last_change":"2023-07-21T22:13:41.095803+0000","last_active":"2023-07-21T22:13:41.107095+0000","last_peered":"2023-07-21T22:13:41.107095+0000","last_clean":"2023-07-21T22:13:41.107095+0000","last_became_active":"2023-07-21T22:13:41.095315+0000","last_became_peered":"2023-07-21T22:13:41.095315+0000","last_unstale":"2023-07-21T22:13:41.107095+0000","last_undegraded":"2023-07-21T22:13:41.107095+0000","last_fullsized":"2023-07-21T22:13:41.107095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:35.630446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.080918+0000","last_change":"2023-07-21T22:13:40.094937+0000","last_active":"2023-07-21T22:13:41.080918+0000","last_peered":"2023-07-21T22:13:41.080918+0000","last_clean":"2023-07-21T22:13:41.080918+0000","last_became_active":"2023-07-21T22:13:40.094169+0000","last_became_peered":"2023-07-21T22:13:40.094169+0000","last_unstale":"2023-07-21T22:13:41.080918+0000","last_undegraded":"2023-07-21T22:13:41.080918+0000","last_fullsized":"2023-07-21T22:13:41.080918+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:18.368263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.089510+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:13:41.089510+0000","last_peered":"2023-07-21T22:13:41.089510+0000","last_clean":"2023-07-21T22:13:41.089510+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:13:41.089510+0000","last_undegraded":"2023-07-21T22:13:41.089510+0000","last_fullsized":"2023-07-21T22:13:41.089510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:47:45.851156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.111847+0000","last_change":"2023-07-21T22:13:41.106922+0000","last_active":"2023-07-21T22:13:41.111847+0000","last_peered":"2023-07-21T22:13:41.111847+0000","last_clean":"2023-07-21T22:13:41.111847+0000","last_became_active":"2023-07-21T22:13:41.106619+0000","last_became_peered":"2023-07-21T22:13:41.106619+0000","last_unstale":"2023-07-21T22:13:41.111847+0000","last_undegraded":"2023-07-21T22:13:41.111847+0000","last_fullsized":"2023-07-21T22:13:41.111847+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:17:31.116227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.123287+0000","last_change":"2023-07-21T22:13:40.093838+0000","last_active":"2023-07-21T22:13:41.123287+0000","last_peered":"2023-07-21T22:13:41.123287+0000","last_clean":"2023-07-21T22:13:41.123287+0000","last_became_active":"2023-07-21T22:13:40.093566+0000","last_became_peered":"2023-07-21T22:13:40.093566+0000","last_unstale":"2023-07-21T22:13:41.123287+0000","last_undegraded":"2023-07-21T22:13:41.123287+0000","last_fullsized":"2023-07-21T22:13:41.123287+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:58:32.061562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.090597+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:13:41.090597+0000","last_peered":"2023-07-21T22:13:41.090597+0000","last_clean":"2023-07-21T22:13:41.090597+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:13:41.090597+0000","last_undegraded":"2023-07-21T22:13:41.090597+0000","last_fullsized":"2023-07-21T22:13:41.090597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:49:32.843652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.112504+0000","last_change":"2023-07-21T22:13:41.105123+0000","last_active":"2023-07-21T22:13:41.112504+0000","last_peered":"2023-07-21T22:13:41.112504+0000","last_clean":"2023-07-21T22:13:41.112504+0000","last_became_active":"2023-07-21T22:13:41.104852+0000","last_became_peered":"2023-07-21T22:13:41.104852+0000","last_unstale":"2023-07-21T22:13:41.112504+0000","last_undegraded":"2023-07-21T22:13:41.112504+0000","last_fullsized":"2023-07-21T22:13:41.112504+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:56.106383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.078209+0000","last_change":"2023-07-21T22:13:40.091829+0000","last_active":"2023-07-21T22:13:41.078209+0000","last_peered":"2023-07-21T22:13:41.078209+0000","last_clean":"2023-07-21T22:13:41.078209+0000","last_became_active":"2023-07-21T22:13:40.091466+0000","last_became_peered":"2023-07-21T22:13:40.091466+0000","last_unstale":"2023-07-21T22:13:41.078209+0000","last_undegraded":"2023-07-21T22:13:41.078209+0000","last_fullsized":"2023-07-21T22:13:41.078209+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:32:36.155188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.079865+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:13:41.079865+0000","last_peered":"2023-07-21T22:13:41.079865+0000","last_clean":"2023-07-21T22:13:41.079865+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:13:41.079865+0000","last_undegraded":"2023-07-21T22:13:41.079865+0000","last_fullsized":"2023-07-21T22:13:41.079865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:47:37.024948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":236,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-21T22:13:41.090730+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:13:41.090730+0000","last_peered":"2023-07-21T22:13:41.090730+0000","last_clean":"2023-07-21T22:13:41.090730+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:13:41.090730+0000","last_undegraded":"2023-07-21T22:13:41.090730+0000","last_fullsized":"2023-07-21T22:13:41.090730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:20.076638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32352,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339488,"statfs":{"total":96636764160,"available":96603635712,"internally_reserved":0,"allocated":1335296,"data_stored":928031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.2270000000000001,"15min":1.2250000000000001},"min":{"1min":0.92800000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6439999999999999,"5min":2.218,"15min":2.218},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.278,"15min":1.3100000000000001},"min":{"1min":0.98899999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.478,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.3240000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.196,"15min":1.218},"min":{"1min":0.749,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4830000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2370000000000001,"15min":1.2729999999999999},"min":{"1min":0.81000000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.5249999999999999,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.121}]},{"osd":2,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.21,"15min":1.2250000000000001},"min":{"1min":0.89000000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.4139999999999999,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.2709999999999999,"15min":1.2989999999999999},"min":{"1min":0.80000000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5940000000000001,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.367}]},{"osd":3,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.278,"15min":1.2929999999999999},"min":{"1min":0.93700000000000006,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4910000000000001,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.3560000000000001,"15min":1.4159999999999999},"min":{"1min":0.88500000000000001,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5329999999999999,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.595}]},{"osd":4,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.2050000000000001,"15min":1.23},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4790000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.466},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.304,"15min":1.3340000000000001},"min":{"1min":0.84399999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5189999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.53}]},{"osd":5,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3480000000000001,"15min":1.3660000000000001},"min":{"1min":0.66300000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4810000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.9930000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.3280000000000001,"15min":1.3740000000000001},"min":{"1min":0.89800000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.496,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.623}]},{"osd":6,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.4490000000000001,"15min":1.4950000000000001},"min":{"1min":0.96099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.6160000000000001,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3999999999999999,"15min":1.423},"min":{"1min":1.038,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.667,"5min":2.476,"15min":2.476},"last":1.7370000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":724992,"data_stored":336887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.105,"15min":1.119},"min":{"1min":0.71599999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.52,"5min":1.657,"15min":1.657},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.1120000000000001,"15min":1.141},"min":{"1min":0.78100000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.282,"5min":2.802,"15min":2.802},"last":1.266}]},{"osd":1,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2070000000000001,"15min":1.2430000000000001},"min":{"1min":0.90500000000000003,"5min":0.747,"15min":0.747},"max":{"1min":1.571,"5min":1.839,"15min":1.839},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.212,"15min":1.25},"min":{"1min":0.754,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7070000000000001,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.548}]},{"osd":2,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2370000000000001,"15min":1.2689999999999999},"min":{"1min":0.93500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.718,"5min":2.911,"15min":2.911},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.2889999999999999,"15min":1.355},"min":{"1min":0.77200000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4870000000000001,"5min":2.379,"15min":2.379},"last":1.393}]},{"osd":3,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.373,"15min":1.425},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.554,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.01},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.3580000000000001,"15min":1.4059999999999999},"min":{"1min":0.83899999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.716,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":1.5980000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.28,"15min":1.28},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8919999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.472},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.335,"15min":1.381},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6140000000000001,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.3440000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3740000000000001,"15min":1.3959999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.7290000000000001,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.516},{"interface":"front","average":{"1min":1.385,"5min":1.4350000000000001,"15min":1.452},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9419999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.6419999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.421,"15min":1.4410000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9390000000000001,"5min":4.194,"15min":4.194},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.524,"15min":1.55},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.8220000000000001,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.5740000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509484,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":729088,"data_stored":336909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.079,"15min":1.0960000000000001},"min":{"1min":0.67300000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.472,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1279999999999999,"15min":1.1399999999999999},"min":{"1min":0.77100000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5329999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.1990000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1619999999999999,"15min":1.2},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.593,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.073,"5min":1.1599999999999999,"15min":1.1839999999999999},"min":{"1min":0.72099999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.51,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.278}]},{"osd":2,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1619999999999999,"15min":1.1659999999999999},"min":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.105},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.272,"15min":1.3049999999999999},"min":{"1min":0.76100000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.615,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.353}]},{"osd":3,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.2250000000000001,"15min":1.2490000000000001},"min":{"1min":0.68400000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.47,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.024},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.371,"15min":1.401},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.671,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.411}]},{"osd":4,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3049999999999999,"15min":1.3360000000000001},"min":{"1min":0.93500000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.5960000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2909999999999999,"15min":1.304},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.673,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.379}]},{"osd":6,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.256,"15min":1.2829999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.621,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":0.85299999999999998,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.655,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.3069999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2789999999999999,"15min":1.3029999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5449999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.155},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4870000000000001,"15min":1.5189999999999999},"min":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7150000000000001,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.321}]}]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":737280,"data_stored":338451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.105,"15min":1.101},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.4039999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.095},{"interface":"front","average":{"1min":1.127,"5min":1.151,"15min":1.171},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5269999999999999,"5min":1.617,"15min":1.617},"last":0.90400000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.216,"15min":1.232},"min":{"1min":0.60699999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7030000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.498},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1930000000000001,"15min":1.1950000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.6000000000000001,"5min":1.665,"15min":1.665},"last":0.79800000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.143,"15min":1.1399999999999999},"min":{"1min":0.89800000000000002,"5min":0.748,"15min":0.748},"max":{"1min":1.585,"5min":1.609,"15min":1.609},"last":1.018},{"interface":"front","average":{"1min":1.28,"5min":1.2789999999999999,"15min":1.3},"min":{"1min":0.96399999999999997,"5min":0.621,"15min":0.621},"max":{"1min":1.6479999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.252}]},{"osd":3,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.2669999999999999,"15min":1.3049999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.482,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.236,"15min":1.2330000000000001},"min":{"1min":1.0069999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.504,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.2989999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.264,"15min":1.3},"min":{"1min":0.86199999999999999,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7470000000000001,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.373},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.246,"15min":1.2370000000000001},"min":{"1min":0.751,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.756,"5min":1.794,"15min":1.794},"last":1.3340000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.198,"15min":1.2},"min":{"1min":0.91700000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5760000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.3959999999999999,"15min":1.4259999999999999},"min":{"1min":0.995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8380000000000001,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.575}]},{"osd":7,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.385,"15min":1.369},"min":{"1min":0.85999999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.831,"5min":1.887,"15min":1.887},"last":1.524},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4119999999999999,"15min":1.409},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.835,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.4239999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509482,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":712704,"data_stored":329439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92000000000000004,"15min":0.93100000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":1.484},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88700000000000001,"15min":0.90100000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.9830000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.90500000000000003,"15min":0.93899999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1879999999999999,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.081,"15min":1.129},"min":{"1min":0.56999999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.71,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.3}]},{"osd":2,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.69199999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.52},{"interface":"front","average":{"1min":0.999,"5min":1.0329999999999999,"15min":1.04},"min":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5109999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":2.613}]},{"osd":4,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.3240000000000001,"15min":1.3420000000000001},"min":{"1min":0.90800000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.73,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.359},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.29,"15min":1.3340000000000001},"min":{"1min":0.76500000000000001,"5min":0.751,"15min":0.751},"max":{"1min":1.52,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.9350000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3029999999999999,"15min":1.339},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.694,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4359999999999999,"15min":1.466},"min":{"1min":0.96799999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.677,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.4019999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.337,"15min":1.367},"min":{"1min":0.86499999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.75,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":2.0379999999999998},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4099999999999999,"15min":1.4490000000000001},"min":{"1min":0.92700000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.653,"5min":2.161,"15min":2.161},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.4590000000000001,"15min":1.5069999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.6639999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.5229999999999999,"15min":1.5580000000000001},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.8140000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.4419999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":712704,"data_stored":329439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.872,"15min":0.88},"min":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1950000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.022,"15min":1.032},"min":{"1min":0.69099999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5189999999999999,"5min":1.534,"15min":1.534},"last":7.0300000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.93899999999999995,"15min":0.95699999999999996},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.272,"5min":1.486,"15min":1.486},"last":2.2949999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0980000000000001,"15min":1.1180000000000001},"min":{"1min":0.75600000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.2869999999999999,"5min":1.958,"15min":1.958},"last":4.1239999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.123,"15min":1.1379999999999999},"min":{"1min":0.70199999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.4419999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":3.5070000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.1299999999999999,"15min":1.1559999999999999},"min":{"1min":0.73999999999999999,"5min":0.623,"15min":0.623},"max":{"1min":1.365,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":2.46}]},{"osd":4,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3979999999999999,"15min":1.4199999999999999},"min":{"1min":1.0960000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6060000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":2.1840000000000002},{"interface":"front","average":{"1min":1.329,"5min":1.4670000000000001,"15min":1.5069999999999999},"min":{"1min":1.0580000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.607,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":2.516}]},{"osd":5,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.4770000000000001,"15min":1.506},"min":{"1min":1.1259999999999999,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":1.6599999999999999,"5min":3.331,"15min":3.331},"last":2.0139999999999998},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.5129999999999999,"15min":1.5529999999999999},"min":{"1min":1.1100000000000001,"5min":1.085,"15min":1.085},"max":{"1min":1.7649999999999999,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":2.2360000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4379999999999999,"15min":1.458},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.663,"5min":2.633,"15min":2.633},"last":2.399},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.421,"15min":1.458},"min":{"1min":1.1319999999999999,"5min":0.878,"15min":0.878},"max":{"1min":1.615,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.6299999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4510000000000001,"15min":1.4810000000000001},"min":{"1min":1.0009999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.738,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":2.137},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.534,"15min":1.5640000000000001},"min":{"1min":1.1379999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.72,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":2.3450000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":919807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.876,"15min":0.88800000000000001},"min":{"1min":0.63200000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.94799999999999995,"15min":0.97399999999999998},"min":{"1min":0.63500000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.296}]},{"osd":2,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.95499999999999996,"15min":0.93899999999999995},"min":{"1min":0.68200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.242},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.032,"15min":1.026},"min":{"1min":0.77300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.1850000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.96199999999999997,"15min":0.94999999999999996},"min":{"1min":0.63900000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.179,"15min":1.175},"min":{"1min":0.82099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":1.3340000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.264,"15min":1.2609999999999999},"min":{"1min":0.90900000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":3.1779999999999999,"5min":3.1779999999999999,"15min":3.1779999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.3899999999999999,"15min":1.3919999999999999},"min":{"1min":1.1559999999999999,"5min":1,"15min":1},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.4610000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.429,"15min":1.4870000000000001},"min":{"1min":0.96999999999999997,"5min":0.872,"15min":0.872},"max":{"1min":2.1150000000000002,"5min":2.419,"15min":2.419},"last":1.5},{"interface":"front","average":{"1min":1.409,"5min":1.383,"15min":1.4039999999999999},"min":{"1min":0.96699999999999997,"5min":0.872,"15min":0.872},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4870000000000001,"15min":1.522},"min":{"1min":1.0680000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.46,"5min":1.4770000000000001,"15min":1.5189999999999999},"min":{"1min":1.0980000000000001,"5min":1.038,"15min":1.038},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.552}]},{"osd":7,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.49,"15min":1.5369999999999999},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.4489999999999998,"5min":2.504,"15min":2.504},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4610000000000001,"15min":1.5009999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.3779999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":346188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.877,"15min":0.89300000000000002},"min":{"1min":0.51600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":1.2589999999999999,"5min":2.113,"15min":2.113},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.627,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5009999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.82299999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.89900000000000002,"15min":0.90000000000000002},"min":{"1min":0.505,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1659999999999999,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.0840000000000001,"15min":1.1180000000000001},"min":{"1min":0.65700000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.601,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":0.92600000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.3100000000000001,"15min":1.3899999999999999},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7110000000000001,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.1879999999999999,"15min":1.2509999999999999},"min":{"1min":0.70399999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4370000000000001,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":0.996}]},{"osd":4,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2869999999999999,"15min":1.3120000000000001},"min":{"1min":0.96199999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.617,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.272,"15min":1.302},"min":{"1min":0.996,"5min":0.377,"15min":0.377},"max":{"1min":1.6719999999999999,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.53}]},{"osd":5,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.319,"15min":1.361},"min":{"1min":0.92400000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.7869999999999999,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.4339999999999999,"15min":1.484},"min":{"1min":1.0800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.958,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.4139999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3919999999999999,"15min":1.4279999999999999},"min":{"1min":0.94099999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6439999999999999,"5min":2.238,"15min":2.238},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.4159999999999999,"15min":1.444},"min":{"1min":1.111,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.887,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.3109999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5209999999999999,"15min":1.5549999999999999},"min":{"1min":0.997,"5min":0.624,"15min":0.624},"max":{"1min":1.909,"5min":4.391,"15min":4.391},"last":1.498},{"interface":"front","average":{"1min":1.413,"5min":1.4830000000000001,"15min":1.5169999999999999},"min":{"1min":1.155,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.746,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.4630000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:13:50.323 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:13:50.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.457+0000 7fb3754ee700 1 Processor -- start 2023-07-21T22:13:50.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.457+0000 7fb3754ee700 1 -- start start 2023-07-21T22:13:50.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb3754ee700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3700cf6d0 0x7fb370160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:50.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb3754ee700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3700ccc30 con 0x7fb37015bb80 2023-07-21T22:13:50.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb3754ee700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3700ce9a0 con 0x7fb37015bf50 2023-07-21T22:13:50.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb3754ee700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37006f480 con 0x7fb3700cf6d0 2023-07-21T22:13:50.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb36e7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3700cf6d0 0x7fb370160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:50.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb36effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb37015bb80 0x7fb3700cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33786/0 (socket says 172.21.15.49:33786) 2023-07-21T22:13:50.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb36effd700 1 -- 172.21.15.49:0/1134327288 learned_addr learned my addr 172.21.15.49:0/1134327288 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:50.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb36e7fc700 1 -- 172.21.15.49:0/1134327288 >> v1:172.21.15.150:6789/0 conn(0x7fb37015bf50 legacy=0x7fb3700d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:50.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb36e7fc700 1 -- 172.21.15.49:0/1134327288 >> v1:172.21.15.49:6789/0 conn(0x7fb37015bb80 legacy=0x7fb3700cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:50.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb36e7fc700 1 -- 172.21.15.49:0/1134327288 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3700cec40 con 0x7fb3700cf6d0 2023-07-21T22:13:50.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb36e7fc700 1 --2- 172.21.15.49:0/1134327288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3700cf6d0 0x7fb370160320 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb364009850 tx=0x7fb364009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5296b75b7f662e43 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:50.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb36dffb700 1 -- 172.21.15.49:0/1134327288 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364011830 con 0x7fb3700cf6d0 2023-07-21T22:13:50.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb36dffb700 1 -- 172.21.15.49:0/1134327288 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb364011990 con 0x7fb3700cf6d0 2023-07-21T22:13:50.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb36dffb700 1 -- 172.21.15.49:0/1134327288 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364011d20 con 0x7fb3700cf6d0 2023-07-21T22:13:50.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb3754ee700 1 -- 172.21.15.49:0/1134327288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3700cf6d0 msgr2=0x7fb370160320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:50.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb3754ee700 1 --2- 172.21.15.49:0/1134327288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3700cf6d0 0x7fb370160320 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb364009850 tx=0x7fb364009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:50.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb3754ee700 1 -- 172.21.15.49:0/1134327288 shutdown_connections 2023-07-21T22:13:50.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb3754ee700 1 --2- 172.21.15.49:0/1134327288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3700cf6d0 0x7fb370160320 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:50.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb3754ee700 1 -- 172.21.15.49:0/1134327288 >> 172.21.15.49:0/1134327288 conn(0x7fb37006fdc0 msgr2=0x7fb370070190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:50.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb3754ee700 1 -- 172.21.15.49:0/1134327288 shutdown_connections 2023-07-21T22:13:50.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.461+0000 7fb3754ee700 1 -- 172.21.15.49:0/1134327288 wait complete. 2023-07-21T22:13:50.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.465+0000 7fb3754ee700 1 Processor -- start 2023-07-21T22:13:50.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.465+0000 7fb3754ee700 1 -- start start 2023-07-21T22:13:50.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.465+0000 7fb3754ee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3700cf6d0 0x7fb3700ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:50.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.465+0000 7fb3754ee700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb37015bb80 0x7fb3700c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.465+0000 7fb3754ee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb37015bf50 0x7fb370152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.465+0000 7fb3754ee700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700c6650 con 0x7fb3700cf6d0 2023-07-21T22:13:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.465+0000 7fb3754ee700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700c7920 con 0x7fb37015bf50 2023-07-21T22:13:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.465+0000 7fb3754ee700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700c6880 con 0x7fb37015bb80 2023-07-21T22:13:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.465+0000 7fb36effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3700cf6d0 0x7fb3700ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.465+0000 7fb36f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb37015bf50 0x7fb370152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.465+0000 7fb36f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb37015bf50 0x7fb370152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:57568/0 (socket says 172.21.15.49:57568) 2023-07-21T22:13:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.465+0000 7fb36f7fe700 1 -- 172.21.15.49:0/1410987568 learned_addr learned my addr 172.21.15.49:0/1410987568 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb36e7fc700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb37015bb80 0x7fb3700c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:50.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb36e7fc700 1 -- 172.21.15.49:0/1410987568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb37015bf50 msgr2=0x7fb370152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:50.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb36e7fc700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb37015bf50 0x7fb370152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:50.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb36e7fc700 1 -- 172.21.15.49:0/1410987568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3700cf6d0 msgr2=0x7fb3700ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:50.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb36e7fc700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3700cf6d0 0x7fb3700ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:50.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb36e7fc700 1 -- 172.21.15.49:0/1410987568 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3640094b0 con 0x7fb37015bb80 2023-07-21T22:13:50.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb36f7fe700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb37015bf50 0x7fb370152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:50.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb36effd700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3700cf6d0 0x7fb3700ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:50.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb36e7fc700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb37015bb80 0x7fb3700c6110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb364016000 tx=0x7fb364004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:50.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb3577fe700 1 -- 172.21.15.49:0/1410987568 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3640036c0 con 0x7fb37015bb80 2023-07-21T22:13:50.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb3577fe700 1 -- 172.21.15.49:0/1410987568 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36401f070 con 0x7fb37015bb80 2023-07-21T22:13:50.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb3577fe700 1 -- 172.21.15.49:0/1410987568 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364003aa0 con 0x7fb37015bb80 2023-07-21T22:13:50.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb3754ee700 1 -- 172.21.15.49:0/1410987568 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3700c6b60 con 0x7fb37015bb80 2023-07-21T22:13:50.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb3754ee700 1 -- 172.21.15.49:0/1410987568 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3700c7120 con 0x7fb37015bb80 2023-07-21T22:13:50.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.469+0000 7fb3754ee700 1 -- 172.21.15.49:0/1410987568 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37004dcb0 con 0x7fb37015bb80 2023-07-21T22:13:50.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.473+0000 7fb3577fe700 1 -- 172.21.15.49:0/1410987568 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb364003c00 con 0x7fb37015bb80 2023-07-21T22:13:50.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.473+0000 7fb3577fe700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb35c0662f0 0x7fb35c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.473+0000 7fb3577fe700 1 -- 172.21.15.49:0/1410987568 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb364021070 con 0x7fb37015bb80 2023-07-21T22:13:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.477+0000 7fb36effd700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb35c0662f0 0x7fb35c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.477+0000 7fb36effd700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb35c0662f0 0x7fb35c0687a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb360005930 tx=0x7fb360009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.481+0000 7fb3577fe700 1 -- 172.21.15.49:0/1410987568 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb364052a30 con 0x7fb37015bb80 2023-07-21T22:13:50.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.653+0000 7fb3754ee700 1 -- 172.21.15.49:0/1410987568 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3700cd160 con 0x7fb35c0662f0 2023-07-21T22:13:50.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.665+0000 7fb3577fe700 1 -- 172.21.15.49:0/1410987568 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308953 (secure 0 0 0) 0x7fb360001990 con 0x7fb35c0662f0 2023-07-21T22:13:50.710 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:50.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.673+0000 7fb3754ee700 1 -- 172.21.15.49:0/1410987568 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb35c0662f0 msgr2=0x7fb35c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:50.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.673+0000 7fb3754ee700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb35c0662f0 0x7fb35c0687a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb360005930 tx=0x7fb360009040 comp rx=0 tx=0).stop 2023-07-21T22:13:50.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.673+0000 7fb3754ee700 1 -- 172.21.15.49:0/1410987568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb37015bb80 msgr2=0x7fb3700c6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:50.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.673+0000 7fb3754ee700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb37015bb80 0x7fb3700c6110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb364016000 tx=0x7fb364004770 comp rx=0 tx=0).stop 2023-07-21T22:13:50.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.673+0000 7fb3754ee700 1 -- 172.21.15.49:0/1410987568 shutdown_connections 2023-07-21T22:13:50.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.673+0000 7fb3754ee700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb35c0662f0 0x7fb35c0687a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:50.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.673+0000 7fb3754ee700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb37015bf50 0x7fb370152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:50.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.673+0000 7fb3754ee700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb37015bb80 0x7fb3700c6110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:50.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.673+0000 7fb3754ee700 1 --2- 172.21.15.49:0/1410987568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3700cf6d0 0x7fb3700ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:50.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.673+0000 7fb3754ee700 1 -- 172.21.15.49:0/1410987568 >> 172.21.15.49:0/1410987568 conn(0x7fb37006fdc0 msgr2=0x7fb3700cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:50.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.673+0000 7fb3754ee700 1 -- 172.21.15.49:0/1410987568 shutdown_connections 2023-07-21T22:13:50.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.673+0000 7fb3754ee700 1 -- 172.21.15.49:0/1410987568 wait complete. 2023-07-21T22:13:50.719 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:13:50.739 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2023-07-21T22:13:50.375014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247176,"kb_used_data":6984,"kb_used_omap":0,"kb_used_meta":240128,"kb_avail":754727544,"statfs":{"total":773094113280,"available":772841005056,"internally_reserved":0,"allocated":7151616,"data_stored":3936340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":245891072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.298680"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089180+0000","last_change":"2023-07-21T22:13:41.102207+0000","last_active":"2023-07-21T22:13:42.089180+0000","last_peered":"2023-07-21T22:13:42.089180+0000","last_clean":"2023-07-21T22:13:42.089180+0000","last_became_active":"2023-07-21T22:13:41.101916+0000","last_became_peered":"2023-07-21T22:13:41.101916+0000","last_unstale":"2023-07-21T22:13:42.089180+0000","last_undegraded":"2023-07-21T22:13:42.089180+0000","last_fullsized":"2023-07-21T22:13:42.089180+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:46:55.324549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088843+0000","last_change":"2023-07-21T22:13:41.101881+0000","last_active":"2023-07-21T22:13:42.088843+0000","last_peered":"2023-07-21T22:13:42.088843+0000","last_clean":"2023-07-21T22:13:42.088843+0000","last_became_active":"2023-07-21T22:13:41.101588+0000","last_became_peered":"2023-07-21T22:13:41.101588+0000","last_unstale":"2023-07-21T22:13:42.088843+0000","last_undegraded":"2023-07-21T22:13:42.088843+0000","last_fullsized":"2023-07-21T22:13:42.088843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:50:15.771280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087597+0000","last_change":"2023-07-21T22:13:41.102406+0000","last_active":"2023-07-21T22:13:42.087597+0000","last_peered":"2023-07-21T22:13:42.087597+0000","last_clean":"2023-07-21T22:13:42.087597+0000","last_became_active":"2023-07-21T22:13:41.102137+0000","last_became_peered":"2023-07-21T22:13:41.102137+0000","last_unstale":"2023-07-21T22:13:42.087597+0000","last_undegraded":"2023-07-21T22:13:42.087597+0000","last_fullsized":"2023-07-21T22:13:42.087597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:51:09.826591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.086521+0000","last_change":"2023-07-21T22:13:41.093070+0000","last_active":"2023-07-21T22:13:42.086521+0000","last_peered":"2023-07-21T22:13:42.086521+0000","last_clean":"2023-07-21T22:13:42.086521+0000","last_became_active":"2023-07-21T22:13:41.092734+0000","last_became_peered":"2023-07-21T22:13:41.092734+0000","last_unstale":"2023-07-21T22:13:42.086521+0000","last_undegraded":"2023-07-21T22:13:42.086521+0000","last_fullsized":"2023-07-21T22:13:42.086521+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:30:24.422596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083658+0000","last_change":"2023-07-21T22:13:41.108849+0000","last_active":"2023-07-21T22:13:42.083658+0000","last_peered":"2023-07-21T22:13:42.083658+0000","last_clean":"2023-07-21T22:13:42.083658+0000","last_became_active":"2023-07-21T22:13:41.108566+0000","last_became_peered":"2023-07-21T22:13:41.108566+0000","last_unstale":"2023-07-21T22:13:42.083658+0000","last_undegraded":"2023-07-21T22:13:42.083658+0000","last_fullsized":"2023-07-21T22:13:42.083658+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:02:26.223615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089273+0000","last_change":"2023-07-21T22:13:41.111253+0000","last_active":"2023-07-21T22:13:42.089273+0000","last_peered":"2023-07-21T22:13:42.089273+0000","last_clean":"2023-07-21T22:13:42.089273+0000","last_became_active":"2023-07-21T22:13:41.110498+0000","last_became_peered":"2023-07-21T22:13:41.110498+0000","last_unstale":"2023-07-21T22:13:42.089273+0000","last_undegraded":"2023-07-21T22:13:42.089273+0000","last_fullsized":"2023-07-21T22:13:42.089273+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:11:28.027492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.082060+0000","last_change":"2023-07-21T22:13:41.105865+0000","last_active":"2023-07-21T22:13:42.082060+0000","last_peered":"2023-07-21T22:13:42.082060+0000","last_clean":"2023-07-21T22:13:42.082060+0000","last_became_active":"2023-07-21T22:13:41.105567+0000","last_became_peered":"2023-07-21T22:13:41.105567+0000","last_unstale":"2023-07-21T22:13:42.082060+0000","last_undegraded":"2023-07-21T22:13:42.082060+0000","last_fullsized":"2023-07-21T22:13:42.082060+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:48:30.357800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083253+0000","last_change":"2023-07-21T22:13:41.102968+0000","last_active":"2023-07-21T22:13:42.083253+0000","last_peered":"2023-07-21T22:13:42.083253+0000","last_clean":"2023-07-21T22:13:42.083253+0000","last_became_active":"2023-07-21T22:13:41.102713+0000","last_became_peered":"2023-07-21T22:13:41.102713+0000","last_unstale":"2023-07-21T22:13:42.083253+0000","last_undegraded":"2023-07-21T22:13:42.083253+0000","last_fullsized":"2023-07-21T22:13:42.083253+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:39.921791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087971+0000","last_change":"2023-07-21T22:13:41.108597+0000","last_active":"2023-07-21T22:13:42.087971+0000","last_peered":"2023-07-21T22:13:42.087971+0000","last_clean":"2023-07-21T22:13:42.087971+0000","last_became_active":"2023-07-21T22:13:41.108348+0000","last_became_peered":"2023-07-21T22:13:41.108348+0000","last_unstale":"2023-07-21T22:13:42.087971+0000","last_undegraded":"2023-07-21T22:13:42.087971+0000","last_fullsized":"2023-07-21T22:13:42.087971+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:24:29.357456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087743+0000","last_change":"2023-07-21T22:13:41.104555+0000","last_active":"2023-07-21T22:13:42.087743+0000","last_peered":"2023-07-21T22:13:42.087743+0000","last_clean":"2023-07-21T22:13:42.087743+0000","last_became_active":"2023-07-21T22:13:41.104299+0000","last_became_peered":"2023-07-21T22:13:41.104299+0000","last_unstale":"2023-07-21T22:13:42.087743+0000","last_undegraded":"2023-07-21T22:13:42.087743+0000","last_fullsized":"2023-07-21T22:13:42.087743+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:29:40.368592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.085965+0000","last_change":"2023-07-21T22:13:41.103712+0000","last_active":"2023-07-21T22:13:42.085965+0000","last_peered":"2023-07-21T22:13:42.085965+0000","last_clean":"2023-07-21T22:13:42.085965+0000","last_became_active":"2023-07-21T22:13:41.103431+0000","last_became_peered":"2023-07-21T22:13:41.103431+0000","last_unstale":"2023-07-21T22:13:42.085965+0000","last_undegraded":"2023-07-21T22:13:42.085965+0000","last_fullsized":"2023-07-21T22:13:42.085965+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:05.543723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.084151+0000","last_change":"2023-07-21T22:13:41.104207+0000","last_active":"2023-07-21T22:13:42.084151+0000","last_peered":"2023-07-21T22:13:42.084151+0000","last_clean":"2023-07-21T22:13:42.084151+0000","last_became_active":"2023-07-21T22:13:41.103922+0000","last_became_peered":"2023-07-21T22:13:41.103922+0000","last_unstale":"2023-07-21T22:13:42.084151+0000","last_undegraded":"2023-07-21T22:13:42.084151+0000","last_fullsized":"2023-07-21T22:13:42.084151+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:26:58.922966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083255+0000","last_change":"2023-07-21T22:13:41.097039+0000","last_active":"2023-07-21T22:13:42.083255+0000","last_peered":"2023-07-21T22:13:42.083255+0000","last_clean":"2023-07-21T22:13:42.083255+0000","last_became_active":"2023-07-21T22:13:41.096761+0000","last_became_peered":"2023-07-21T22:13:41.096761+0000","last_unstale":"2023-07-21T22:13:42.083255+0000","last_undegraded":"2023-07-21T22:13:42.083255+0000","last_fullsized":"2023-07-21T22:13:42.083255+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:14.461183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087392+0000","last_change":"2023-07-21T22:13:41.101818+0000","last_active":"2023-07-21T22:13:42.087392+0000","last_peered":"2023-07-21T22:13:42.087392+0000","last_clean":"2023-07-21T22:13:42.087392+0000","last_became_active":"2023-07-21T22:13:41.101516+0000","last_became_peered":"2023-07-21T22:13:41.101516+0000","last_unstale":"2023-07-21T22:13:42.087392+0000","last_undegraded":"2023-07-21T22:13:42.087392+0000","last_fullsized":"2023-07-21T22:13:42.087392+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:29:54.037991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087687+0000","last_change":"2023-07-21T22:13:41.103892+0000","last_active":"2023-07-21T22:13:42.087687+0000","last_peered":"2023-07-21T22:13:42.087687+0000","last_clean":"2023-07-21T22:13:42.087687+0000","last_became_active":"2023-07-21T22:13:41.103587+0000","last_became_peered":"2023-07-21T22:13:41.103587+0000","last_unstale":"2023-07-21T22:13:42.087687+0000","last_undegraded":"2023-07-21T22:13:42.087687+0000","last_fullsized":"2023-07-21T22:13:42.087687+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:37.732164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.082026+0000","last_change":"2023-07-21T22:13:41.106608+0000","last_active":"2023-07-21T22:13:42.082026+0000","last_peered":"2023-07-21T22:13:42.082026+0000","last_clean":"2023-07-21T22:13:42.082026+0000","last_became_active":"2023-07-21T22:13:41.106100+0000","last_became_peered":"2023-07-21T22:13:41.106100+0000","last_unstale":"2023-07-21T22:13:42.082026+0000","last_undegraded":"2023-07-21T22:13:42.082026+0000","last_fullsized":"2023-07-21T22:13:42.082026+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:56:07.689696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089247+0000","last_change":"2023-07-21T22:13:41.104857+0000","last_active":"2023-07-21T22:13:42.089247+0000","last_peered":"2023-07-21T22:13:42.089247+0000","last_clean":"2023-07-21T22:13:42.089247+0000","last_became_active":"2023-07-21T22:13:41.104573+0000","last_became_peered":"2023-07-21T22:13:41.104573+0000","last_unstale":"2023-07-21T22:13:42.089247+0000","last_undegraded":"2023-07-21T22:13:42.089247+0000","last_fullsized":"2023-07-21T22:13:42.089247+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:12:26.300399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.085946+0000","last_change":"2023-07-21T22:13:41.098779+0000","last_active":"2023-07-21T22:13:42.085946+0000","last_peered":"2023-07-21T22:13:42.085946+0000","last_clean":"2023-07-21T22:13:42.085946+0000","last_became_active":"2023-07-21T22:13:41.097678+0000","last_became_peered":"2023-07-21T22:13:41.097678+0000","last_unstale":"2023-07-21T22:13:42.085946+0000","last_undegraded":"2023-07-21T22:13:42.085946+0000","last_fullsized":"2023-07-21T22:13:42.085946+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:08:36.528853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.084178+0000","last_change":"2023-07-21T22:13:41.110504+0000","last_active":"2023-07-21T22:13:42.084178+0000","last_peered":"2023-07-21T22:13:42.084178+0000","last_clean":"2023-07-21T22:13:42.084178+0000","last_became_active":"2023-07-21T22:13:41.110211+0000","last_became_peered":"2023-07-21T22:13:41.110211+0000","last_unstale":"2023-07-21T22:13:42.084178+0000","last_undegraded":"2023-07-21T22:13:42.084178+0000","last_fullsized":"2023-07-21T22:13:42.084178+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:07:44.349060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088362+0000","last_change":"2023-07-21T22:13:41.097911+0000","last_active":"2023-07-21T22:13:42.088362+0000","last_peered":"2023-07-21T22:13:42.088362+0000","last_clean":"2023-07-21T22:13:42.088362+0000","last_became_active":"2023-07-21T22:13:41.097604+0000","last_became_peered":"2023-07-21T22:13:41.097604+0000","last_unstale":"2023-07-21T22:13:42.088362+0000","last_undegraded":"2023-07-21T22:13:42.088362+0000","last_fullsized":"2023-07-21T22:13:42.088362+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:15:12.623481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083516+0000","last_change":"2023-07-21T22:13:41.096467+0000","last_active":"2023-07-21T22:13:42.083516+0000","last_peered":"2023-07-21T22:13:42.083516+0000","last_clean":"2023-07-21T22:13:42.083516+0000","last_became_active":"2023-07-21T22:13:41.093898+0000","last_became_peered":"2023-07-21T22:13:41.093898+0000","last_unstale":"2023-07-21T22:13:42.083516+0000","last_undegraded":"2023-07-21T22:13:42.083516+0000","last_fullsized":"2023-07-21T22:13:42.083516+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:10.694919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088108+0000","last_change":"2023-07-21T22:13:41.104555+0000","last_active":"2023-07-21T22:13:42.088108+0000","last_peered":"2023-07-21T22:13:42.088108+0000","last_clean":"2023-07-21T22:13:42.088108+0000","last_became_active":"2023-07-21T22:13:41.104275+0000","last_became_peered":"2023-07-21T22:13:41.104275+0000","last_unstale":"2023-07-21T22:13:42.088108+0000","last_undegraded":"2023-07-21T22:13:42.088108+0000","last_fullsized":"2023-07-21T22:13:42.088108+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:09:40.138456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088767+0000","last_change":"2023-07-21T22:13:41.103964+0000","last_active":"2023-07-21T22:13:42.088767+0000","last_peered":"2023-07-21T22:13:42.088767+0000","last_clean":"2023-07-21T22:13:42.088767+0000","last_became_active":"2023-07-21T22:13:41.103680+0000","last_became_peered":"2023-07-21T22:13:41.103680+0000","last_unstale":"2023-07-21T22:13:42.088767+0000","last_undegraded":"2023-07-21T22:13:42.088767+0000","last_fullsized":"2023-07-21T22:13:42.088767+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:09:14.919502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087161+0000","last_change":"2023-07-21T22:13:41.102028+0000","last_active":"2023-07-21T22:13:42.087161+0000","last_peered":"2023-07-21T22:13:42.087161+0000","last_clean":"2023-07-21T22:13:42.087161+0000","last_became_active":"2023-07-21T22:13:41.101730+0000","last_became_peered":"2023-07-21T22:13:41.101730+0000","last_unstale":"2023-07-21T22:13:42.087161+0000","last_undegraded":"2023-07-21T22:13:42.087161+0000","last_fullsized":"2023-07-21T22:13:42.087161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:39.921791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.084978+0000","last_change":"2023-07-21T22:13:41.096075+0000","last_active":"2023-07-21T22:13:42.084978+0000","last_peered":"2023-07-21T22:13:42.084978+0000","last_clean":"2023-07-21T22:13:42.084978+0000","last_became_active":"2023-07-21T22:13:41.093481+0000","last_became_peered":"2023-07-21T22:13:41.093481+0000","last_unstale":"2023-07-21T22:13:42.084978+0000","last_undegraded":"2023-07-21T22:13:42.084978+0000","last_fullsized":"2023-07-21T22:13:42.084978+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:19.315236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.084908+0000","last_change":"2023-07-21T22:13:41.098370+0000","last_active":"2023-07-21T22:13:42.084908+0000","last_peered":"2023-07-21T22:13:42.084908+0000","last_clean":"2023-07-21T22:13:42.084908+0000","last_became_active":"2023-07-21T22:13:41.098102+0000","last_became_peered":"2023-07-21T22:13:41.098102+0000","last_unstale":"2023-07-21T22:13:42.084908+0000","last_undegraded":"2023-07-21T22:13:42.084908+0000","last_fullsized":"2023-07-21T22:13:42.084908+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:17.716313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.086042+0000","last_change":"2023-07-21T22:13:41.097502+0000","last_active":"2023-07-21T22:13:42.086042+0000","last_peered":"2023-07-21T22:13:42.086042+0000","last_clean":"2023-07-21T22:13:42.086042+0000","last_became_active":"2023-07-21T22:13:41.097033+0000","last_became_peered":"2023-07-21T22:13:41.097033+0000","last_unstale":"2023-07-21T22:13:42.086042+0000","last_undegraded":"2023-07-21T22:13:42.086042+0000","last_fullsized":"2023-07-21T22:13:42.086042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:44:24.926904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088237+0000","last_change":"2023-07-21T22:13:41.100363+0000","last_active":"2023-07-21T22:13:42.088237+0000","last_peered":"2023-07-21T22:13:42.088237+0000","last_clean":"2023-07-21T22:13:42.088237+0000","last_became_active":"2023-07-21T22:13:41.100037+0000","last_became_peered":"2023-07-21T22:13:41.100037+0000","last_unstale":"2023-07-21T22:13:42.088237+0000","last_undegraded":"2023-07-21T22:13:42.088237+0000","last_fullsized":"2023-07-21T22:13:42.088237+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:38:08.319743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087438+0000","last_change":"2023-07-21T22:13:41.102785+0000","last_active":"2023-07-21T22:13:42.087438+0000","last_peered":"2023-07-21T22:13:42.087438+0000","last_clean":"2023-07-21T22:13:42.087438+0000","last_became_active":"2023-07-21T22:13:41.102481+0000","last_became_peered":"2023-07-21T22:13:41.102481+0000","last_unstale":"2023-07-21T22:13:42.087438+0000","last_undegraded":"2023-07-21T22:13:42.087438+0000","last_fullsized":"2023-07-21T22:13:42.087438+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:47:44.351565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083439+0000","last_change":"2023-07-21T22:13:41.101943+0000","last_active":"2023-07-21T22:13:42.083439+0000","last_peered":"2023-07-21T22:13:42.083439+0000","last_clean":"2023-07-21T22:13:42.083439+0000","last_became_active":"2023-07-21T22:13:41.101635+0000","last_became_peered":"2023-07-21T22:13:41.101635+0000","last_unstale":"2023-07-21T22:13:42.083439+0000","last_undegraded":"2023-07-21T22:13:42.083439+0000","last_fullsized":"2023-07-21T22:13:42.083439+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:05:48.872465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.084711+0000","last_change":"2023-07-21T22:13:41.096068+0000","last_active":"2023-07-21T22:13:42.084711+0000","last_peered":"2023-07-21T22:13:42.084711+0000","last_clean":"2023-07-21T22:13:42.084711+0000","last_became_active":"2023-07-21T22:13:41.095783+0000","last_became_peered":"2023-07-21T22:13:41.095783+0000","last_unstale":"2023-07-21T22:13:42.084711+0000","last_undegraded":"2023-07-21T22:13:42.084711+0000","last_fullsized":"2023-07-21T22:13:42.084711+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:32:07.689420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087590+0000","last_change":"2023-07-21T22:13:41.110068+0000","last_active":"2023-07-21T22:13:42.087590+0000","last_peered":"2023-07-21T22:13:42.087590+0000","last_clean":"2023-07-21T22:13:42.087590+0000","last_became_active":"2023-07-21T22:13:41.109762+0000","last_became_peered":"2023-07-21T22:13:41.109762+0000","last_unstale":"2023-07-21T22:13:42.087590+0000","last_undegraded":"2023-07-21T22:13:42.087590+0000","last_fullsized":"2023-07-21T22:13:42.087590+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:32:37.166093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.084611+0000","last_change":"2023-07-21T22:13:41.107081+0000","last_active":"2023-07-21T22:13:42.084611+0000","last_peered":"2023-07-21T22:13:42.084611+0000","last_clean":"2023-07-21T22:13:42.084611+0000","last_became_active":"2023-07-21T22:13:41.106787+0000","last_became_peered":"2023-07-21T22:13:41.106787+0000","last_unstale":"2023-07-21T22:13:42.084611+0000","last_undegraded":"2023-07-21T22:13:42.084611+0000","last_fullsized":"2023-07-21T22:13:42.084611+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:05:37.638816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"61'4","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089353+0000","last_change":"2023-07-21T22:13:40.101387+0000","last_active":"2023-07-21T22:13:42.089353+0000","last_peered":"2023-07-21T22:13:42.089353+0000","last_clean":"2023-07-21T22:13:42.089353+0000","last_became_active":"2023-07-21T22:13:40.100913+0000","last_became_peered":"2023-07-21T22:13:40.100913+0000","last_unstale":"2023-07-21T22:13:42.089353+0000","last_undegraded":"2023-07-21T22:13:42.089353+0000","last_fullsized":"2023-07-21T22:13:42.089353+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:23.939422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.086116+0000","last_change":"2023-07-21T22:13:41.096891+0000","last_active":"2023-07-21T22:13:42.086116+0000","last_peered":"2023-07-21T22:13:42.086116+0000","last_clean":"2023-07-21T22:13:42.086116+0000","last_became_active":"2023-07-21T22:13:41.095295+0000","last_became_peered":"2023-07-21T22:13:41.095295+0000","last_unstale":"2023-07-21T22:13:42.086116+0000","last_undegraded":"2023-07-21T22:13:42.086116+0000","last_fullsized":"2023-07-21T22:13:42.086116+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:45:45.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.090333+0000","last_change":"2023-07-21T22:13:40.094443+0000","last_active":"2023-07-21T22:13:42.090333+0000","last_peered":"2023-07-21T22:13:42.090333+0000","last_clean":"2023-07-21T22:13:42.090333+0000","last_became_active":"2023-07-21T22:13:40.094114+0000","last_became_peered":"2023-07-21T22:13:40.094114+0000","last_unstale":"2023-07-21T22:13:42.090333+0000","last_undegraded":"2023-07-21T22:13:42.090333+0000","last_fullsized":"2023-07-21T22:13:42.090333+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:33.768749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.090199+0000","last_change":"2023-07-21T22:13:41.097322+0000","last_active":"2023-07-21T22:13:42.090199+0000","last_peered":"2023-07-21T22:13:42.090199+0000","last_clean":"2023-07-21T22:13:42.090199+0000","last_became_active":"2023-07-21T22:13:41.097054+0000","last_became_peered":"2023-07-21T22:13:41.097054+0000","last_unstale":"2023-07-21T22:13:42.090199+0000","last_undegraded":"2023-07-21T22:13:42.090199+0000","last_fullsized":"2023-07-21T22:13:42.090199+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:55:28.232508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.090042+0000","last_change":"2023-07-21T22:13:40.087761+0000","last_active":"2023-07-21T22:13:42.090042+0000","last_peered":"2023-07-21T22:13:42.090042+0000","last_clean":"2023-07-21T22:13:42.090042+0000","last_became_active":"2023-07-21T22:13:40.087468+0000","last_became_peered":"2023-07-21T22:13:40.087468+0000","last_unstale":"2023-07-21T22:13:42.090042+0000","last_undegraded":"2023-07-21T22:13:42.090042+0000","last_fullsized":"2023-07-21T22:13:42.090042+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:07.095120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087702+0000","last_change":"2023-07-21T22:13:41.104006+0000","last_active":"2023-07-21T22:13:42.087702+0000","last_peered":"2023-07-21T22:13:42.087702+0000","last_clean":"2023-07-21T22:13:42.087702+0000","last_became_active":"2023-07-21T22:13:41.103736+0000","last_became_peered":"2023-07-21T22:13:41.103736+0000","last_unstale":"2023-07-21T22:13:42.087702+0000","last_undegraded":"2023-07-21T22:13:42.087702+0000","last_fullsized":"2023-07-21T22:13:42.087702+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:39.364718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089720+0000","last_change":"2023-07-21T22:13:40.096070+0000","last_active":"2023-07-21T22:13:42.089720+0000","last_peered":"2023-07-21T22:13:42.089720+0000","last_clean":"2023-07-21T22:13:42.089720+0000","last_became_active":"2023-07-21T22:13:40.095788+0000","last_became_peered":"2023-07-21T22:13:40.095788+0000","last_unstale":"2023-07-21T22:13:42.089720+0000","last_undegraded":"2023-07-21T22:13:42.089720+0000","last_fullsized":"2023-07-21T22:13:42.089720+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:42:29.625435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.082191+0000","last_change":"2023-07-21T22:13:41.106371+0000","last_active":"2023-07-21T22:13:42.082191+0000","last_peered":"2023-07-21T22:13:42.082191+0000","last_clean":"2023-07-21T22:13:42.082191+0000","last_became_active":"2023-07-21T22:13:41.105701+0000","last_became_peered":"2023-07-21T22:13:41.105701+0000","last_unstale":"2023-07-21T22:13:42.082191+0000","last_undegraded":"2023-07-21T22:13:42.082191+0000","last_fullsized":"2023-07-21T22:13:42.082191+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:23:41.235260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089435+0000","last_change":"2023-07-21T22:13:40.091865+0000","last_active":"2023-07-21T22:13:42.089435+0000","last_peered":"2023-07-21T22:13:42.089435+0000","last_clean":"2023-07-21T22:13:42.089435+0000","last_became_active":"2023-07-21T22:13:40.091563+0000","last_became_peered":"2023-07-21T22:13:40.091563+0000","last_unstale":"2023-07-21T22:13:42.089435+0000","last_undegraded":"2023-07-21T22:13:42.089435+0000","last_fullsized":"2023-07-21T22:13:42.089435+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:53:38.888693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087875+0000","last_change":"2023-07-21T22:13:41.100501+0000","last_active":"2023-07-21T22:13:42.087875+0000","last_peered":"2023-07-21T22:13:42.087875+0000","last_clean":"2023-07-21T22:13:42.087875+0000","last_became_active":"2023-07-21T22:13:41.100189+0000","last_became_peered":"2023-07-21T22:13:41.100189+0000","last_unstale":"2023-07-21T22:13:42.087875+0000","last_undegraded":"2023-07-21T22:13:42.087875+0000","last_fullsized":"2023-07-21T22:13:42.087875+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:29:26.099634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088238+0000","last_change":"2023-07-21T22:13:40.088623+0000","last_active":"2023-07-21T22:13:42.088238+0000","last_peered":"2023-07-21T22:13:42.088238+0000","last_clean":"2023-07-21T22:13:42.088238+0000","last_became_active":"2023-07-21T22:13:40.088019+0000","last_became_peered":"2023-07-21T22:13:40.088019+0000","last_unstale":"2023-07-21T22:13:42.088238+0000","last_undegraded":"2023-07-21T22:13:42.088238+0000","last_fullsized":"2023-07-21T22:13:42.088238+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:34.128599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.084032+0000","last_change":"2023-07-21T22:13:41.100003+0000","last_active":"2023-07-21T22:13:42.084032+0000","last_peered":"2023-07-21T22:13:42.084032+0000","last_clean":"2023-07-21T22:13:42.084032+0000","last_became_active":"2023-07-21T22:13:41.099703+0000","last_became_peered":"2023-07-21T22:13:41.099703+0000","last_unstale":"2023-07-21T22:13:42.084032+0000","last_undegraded":"2023-07-21T22:13:42.084032+0000","last_fullsized":"2023-07-21T22:13:42.084032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:00:10.702183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088912+0000","last_change":"2023-07-21T22:13:40.092332+0000","last_active":"2023-07-21T22:13:42.088912+0000","last_peered":"2023-07-21T22:13:42.088912+0000","last_clean":"2023-07-21T22:13:42.088912+0000","last_became_active":"2023-07-21T22:13:40.091709+0000","last_became_peered":"2023-07-21T22:13:40.091709+0000","last_unstale":"2023-07-21T22:13:42.088912+0000","last_undegraded":"2023-07-21T22:13:42.088912+0000","last_fullsized":"2023-07-21T22:13:42.088912+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:12:14.782162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089285+0000","last_change":"2023-07-21T22:13:41.096538+0000","last_active":"2023-07-21T22:13:42.089285+0000","last_peered":"2023-07-21T22:13:42.089285+0000","last_clean":"2023-07-21T22:13:42.089285+0000","last_became_active":"2023-07-21T22:13:41.096233+0000","last_became_peered":"2023-07-21T22:13:41.096233+0000","last_unstale":"2023-07-21T22:13:42.089285+0000","last_undegraded":"2023-07-21T22:13:42.089285+0000","last_fullsized":"2023-07-21T22:13:42.089285+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:52:44.664642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083292+0000","last_change":"2023-07-21T22:13:40.099452+0000","last_active":"2023-07-21T22:13:42.083292+0000","last_peered":"2023-07-21T22:13:42.083292+0000","last_clean":"2023-07-21T22:13:42.083292+0000","last_became_active":"2023-07-21T22:13:40.099144+0000","last_became_peered":"2023-07-21T22:13:40.099144+0000","last_unstale":"2023-07-21T22:13:42.083292+0000","last_undegraded":"2023-07-21T22:13:42.083292+0000","last_fullsized":"2023-07-21T22:13:42.083292+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:35:34.091896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088379+0000","last_change":"2023-07-21T22:13:41.095806+0000","last_active":"2023-07-21T22:13:42.088379+0000","last_peered":"2023-07-21T22:13:42.088379+0000","last_clean":"2023-07-21T22:13:42.088379+0000","last_became_active":"2023-07-21T22:13:41.095496+0000","last_became_peered":"2023-07-21T22:13:41.095496+0000","last_unstale":"2023-07-21T22:13:42.088379+0000","last_undegraded":"2023-07-21T22:13:42.088379+0000","last_fullsized":"2023-07-21T22:13:42.088379+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:13.001060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088021+0000","last_change":"2023-07-21T22:13:40.100806+0000","last_active":"2023-07-21T22:13:42.088021+0000","last_peered":"2023-07-21T22:13:42.088021+0000","last_clean":"2023-07-21T22:13:42.088021+0000","last_became_active":"2023-07-21T22:13:40.100450+0000","last_became_peered":"2023-07-21T22:13:40.100450+0000","last_unstale":"2023-07-21T22:13:42.088021+0000","last_undegraded":"2023-07-21T22:13:42.088021+0000","last_fullsized":"2023-07-21T22:13:42.088021+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:08:35.517948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089621+0000","last_change":"2023-07-21T22:13:41.089865+0000","last_active":"2023-07-21T22:13:42.089621+0000","last_peered":"2023-07-21T22:13:42.089621+0000","last_clean":"2023-07-21T22:13:42.089621+0000","last_became_active":"2023-07-21T22:13:41.089516+0000","last_became_peered":"2023-07-21T22:13:41.089516+0000","last_unstale":"2023-07-21T22:13:42.089621+0000","last_undegraded":"2023-07-21T22:13:42.089621+0000","last_fullsized":"2023-07-21T22:13:42.089621+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:59.838254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.086261+0000","last_change":"2023-07-21T22:13:40.094632+0000","last_active":"2023-07-21T22:13:42.086261+0000","last_peered":"2023-07-21T22:13:42.086261+0000","last_clean":"2023-07-21T22:13:42.086261+0000","last_became_active":"2023-07-21T22:13:40.094368+0000","last_became_peered":"2023-07-21T22:13:40.094368+0000","last_unstale":"2023-07-21T22:13:42.086261+0000","last_undegraded":"2023-07-21T22:13:42.086261+0000","last_fullsized":"2023-07-21T22:13:42.086261+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:08:18.340470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083390+0000","last_change":"2023-07-21T22:13:41.108001+0000","last_active":"2023-07-21T22:13:42.083390+0000","last_peered":"2023-07-21T22:13:42.083390+0000","last_clean":"2023-07-21T22:13:42.083390+0000","last_became_active":"2023-07-21T22:13:41.107733+0000","last_became_peered":"2023-07-21T22:13:41.107733+0000","last_unstale":"2023-07-21T22:13:42.083390+0000","last_undegraded":"2023-07-21T22:13:42.083390+0000","last_fullsized":"2023-07-21T22:13:42.083390+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:13:48.151221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087766+0000","last_change":"2023-07-21T22:13:40.098392+0000","last_active":"2023-07-21T22:13:42.087766+0000","last_peered":"2023-07-21T22:13:42.087766+0000","last_clean":"2023-07-21T22:13:42.087766+0000","last_became_active":"2023-07-21T22:13:40.098099+0000","last_became_peered":"2023-07-21T22:13:40.098099+0000","last_unstale":"2023-07-21T22:13:42.087766+0000","last_undegraded":"2023-07-21T22:13:42.087766+0000","last_fullsized":"2023-07-21T22:13:42.087766+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:26:57.912061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.086477+0000","last_change":"2023-07-21T22:13:41.092950+0000","last_active":"2023-07-21T22:13:42.086477+0000","last_peered":"2023-07-21T22:13:42.086477+0000","last_clean":"2023-07-21T22:13:42.086477+0000","last_became_active":"2023-07-21T22:13:41.092105+0000","last_became_peered":"2023-07-21T22:13:41.092105+0000","last_unstale":"2023-07-21T22:13:42.086477+0000","last_undegraded":"2023-07-21T22:13:42.086477+0000","last_fullsized":"2023-07-21T22:13:42.086477+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:48:16.837074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088589+0000","last_change":"2023-07-21T22:13:40.094145+0000","last_active":"2023-07-21T22:13:42.088589+0000","last_peered":"2023-07-21T22:13:42.088589+0000","last_clean":"2023-07-21T22:13:42.088589+0000","last_became_active":"2023-07-21T22:13:40.093633+0000","last_became_peered":"2023-07-21T22:13:40.093633+0000","last_unstale":"2023-07-21T22:13:42.088589+0000","last_undegraded":"2023-07-21T22:13:42.088589+0000","last_fullsized":"2023-07-21T22:13:42.088589+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:19:31.029843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083116+0000","last_change":"2023-07-21T22:13:41.103922+0000","last_active":"2023-07-21T22:13:42.083116+0000","last_peered":"2023-07-21T22:13:42.083116+0000","last_clean":"2023-07-21T22:13:42.083116+0000","last_became_active":"2023-07-21T22:13:41.103642+0000","last_became_peered":"2023-07-21T22:13:41.103642+0000","last_unstale":"2023-07-21T22:13:42.083116+0000","last_undegraded":"2023-07-21T22:13:42.083116+0000","last_fullsized":"2023-07-21T22:13:42.083116+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:17.716313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087596+0000","last_change":"2023-07-21T22:13:40.096493+0000","last_active":"2023-07-21T22:13:42.087596+0000","last_peered":"2023-07-21T22:13:42.087596+0000","last_clean":"2023-07-21T22:13:42.087596+0000","last_became_active":"2023-07-21T22:13:40.096174+0000","last_became_peered":"2023-07-21T22:13:40.096174+0000","last_unstale":"2023-07-21T22:13:42.087596+0000","last_undegraded":"2023-07-21T22:13:42.087596+0000","last_fullsized":"2023-07-21T22:13:42.087596+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:09.684014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083502+0000","last_change":"2023-07-21T22:13:41.095610+0000","last_active":"2023-07-21T22:13:42.083502+0000","last_peered":"2023-07-21T22:13:42.083502+0000","last_clean":"2023-07-21T22:13:42.083502+0000","last_became_active":"2023-07-21T22:13:41.092550+0000","last_became_peered":"2023-07-21T22:13:41.092550+0000","last_unstale":"2023-07-21T22:13:42.083502+0000","last_undegraded":"2023-07-21T22:13:42.083502+0000","last_fullsized":"2023-07-21T22:13:42.083502+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:33.372984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083636+0000","last_change":"2023-07-21T22:13:40.095144+0000","last_active":"2023-07-21T22:13:42.083636+0000","last_peered":"2023-07-21T22:13:42.083636+0000","last_clean":"2023-07-21T22:13:42.083636+0000","last_became_active":"2023-07-21T22:13:40.094633+0000","last_became_peered":"2023-07-21T22:13:40.094633+0000","last_unstale":"2023-07-21T22:13:42.083636+0000","last_undegraded":"2023-07-21T22:13:42.083636+0000","last_fullsized":"2023-07-21T22:13:42.083636+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:51:08.815686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.084197+0000","last_change":"2023-07-21T22:13:41.103229+0000","last_active":"2023-07-21T22:13:42.084197+0000","last_peered":"2023-07-21T22:13:42.084197+0000","last_clean":"2023-07-21T22:13:42.084197+0000","last_became_active":"2023-07-21T22:13:41.102919+0000","last_became_peered":"2023-07-21T22:13:41.102919+0000","last_unstale":"2023-07-21T22:13:42.084197+0000","last_undegraded":"2023-07-21T22:13:42.084197+0000","last_fullsized":"2023-07-21T22:13:42.084197+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:42:57.275574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087463+0000","last_change":"2023-07-21T22:13:40.097496+0000","last_active":"2023-07-21T22:13:42.087463+0000","last_peered":"2023-07-21T22:13:42.087463+0000","last_clean":"2023-07-21T22:13:42.087463+0000","last_became_active":"2023-07-21T22:13:40.097141+0000","last_became_peered":"2023-07-21T22:13:40.097141+0000","last_unstale":"2023-07-21T22:13:42.087463+0000","last_undegraded":"2023-07-21T22:13:42.087463+0000","last_fullsized":"2023-07-21T22:13:42.087463+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:05:47.861560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088595+0000","last_change":"2023-07-21T22:13:41.104249+0000","last_active":"2023-07-21T22:13:42.088595+0000","last_peered":"2023-07-21T22:13:42.088595+0000","last_clean":"2023-07-21T22:13:42.088595+0000","last_became_active":"2023-07-21T22:13:41.103977+0000","last_became_peered":"2023-07-21T22:13:41.103977+0000","last_unstale":"2023-07-21T22:13:42.088595+0000","last_undegraded":"2023-07-21T22:13:42.088595+0000","last_fullsized":"2023-07-21T22:13:42.088595+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:20:42.386961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":21,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.084405+0000","last_change":"2023-07-21T22:13:40.093508+0000","last_active":"2023-07-21T22:13:42.084405+0000","last_peered":"2023-07-21T22:13:42.084405+0000","last_clean":"2023-07-21T22:13:42.084405+0000","last_became_active":"2023-07-21T22:13:40.093118+0000","last_became_peered":"2023-07-21T22:13:40.093118+0000","last_unstale":"2023-07-21T22:13:42.084405+0000","last_undegraded":"2023-07-21T22:13:42.084405+0000","last_fullsized":"2023-07-21T22:13:42.084405+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:18.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089715+0000","last_change":"2023-07-21T22:13:41.114988+0000","last_active":"2023-07-21T22:13:42.089715+0000","last_peered":"2023-07-21T22:13:42.089715+0000","last_clean":"2023-07-21T22:13:42.089715+0000","last_became_active":"2023-07-21T22:13:41.114608+0000","last_became_peered":"2023-07-21T22:13:41.114608+0000","last_unstale":"2023-07-21T22:13:42.089715+0000","last_undegraded":"2023-07-21T22:13:42.089715+0000","last_fullsized":"2023-07-21T22:13:42.089715+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:01.078694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.085272+0000","last_change":"2023-07-21T22:13:40.095884+0000","last_active":"2023-07-21T22:13:42.085272+0000","last_peered":"2023-07-21T22:13:42.085272+0000","last_clean":"2023-07-21T22:13:42.085272+0000","last_became_active":"2023-07-21T22:13:40.095515+0000","last_became_peered":"2023-07-21T22:13:40.095515+0000","last_unstale":"2023-07-21T22:13:42.085272+0000","last_undegraded":"2023-07-21T22:13:42.085272+0000","last_fullsized":"2023-07-21T22:13:42.085272+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:04.532818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.082682+0000","last_change":"2023-07-21T22:13:41.099642+0000","last_active":"2023-07-21T22:13:42.082682+0000","last_peered":"2023-07-21T22:13:42.082682+0000","last_clean":"2023-07-21T22:13:42.082682+0000","last_became_active":"2023-07-21T22:13:41.099177+0000","last_became_peered":"2023-07-21T22:13:41.099177+0000","last_unstale":"2023-07-21T22:13:42.082682+0000","last_undegraded":"2023-07-21T22:13:42.082682+0000","last_fullsized":"2023-07-21T22:13:42.082682+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:18:13.560517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.085287+0000","last_change":"2023-07-21T22:13:40.089926+0000","last_active":"2023-07-21T22:13:42.085287+0000","last_peered":"2023-07-21T22:13:42.085287+0000","last_clean":"2023-07-21T22:13:42.085287+0000","last_became_active":"2023-07-21T22:13:40.089612+0000","last_became_peered":"2023-07-21T22:13:40.089612+0000","last_unstale":"2023-07-21T22:13:42.085287+0000","last_undegraded":"2023-07-21T22:13:42.085287+0000","last_fullsized":"2023-07-21T22:13:42.085287+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:08:35.517948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.085073+0000","last_change":"2023-07-21T22:13:41.092119+0000","last_active":"2023-07-21T22:13:42.085073+0000","last_peered":"2023-07-21T22:13:42.085073+0000","last_clean":"2023-07-21T22:13:42.085073+0000","last_became_active":"2023-07-21T22:13:41.091845+0000","last_became_peered":"2023-07-21T22:13:41.091845+0000","last_unstale":"2023-07-21T22:13:42.085073+0000","last_undegraded":"2023-07-21T22:13:42.085073+0000","last_fullsized":"2023-07-21T22:13:42.085073+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:24:29.357456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.090330+0000","last_change":"2023-07-21T22:13:40.087676+0000","last_active":"2023-07-21T22:13:42.090330+0000","last_peered":"2023-07-21T22:13:42.090330+0000","last_clean":"2023-07-21T22:13:42.090330+0000","last_became_active":"2023-07-21T22:13:40.087408+0000","last_became_peered":"2023-07-21T22:13:40.087408+0000","last_unstale":"2023-07-21T22:13:42.090330+0000","last_undegraded":"2023-07-21T22:13:42.090330+0000","last_fullsized":"2023-07-21T22:13:42.090330+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:24:49.477457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.085413+0000","last_change":"2023-07-21T22:13:41.098307+0000","last_active":"2023-07-21T22:13:42.085413+0000","last_peered":"2023-07-21T22:13:42.085413+0000","last_clean":"2023-07-21T22:13:42.085413+0000","last_became_active":"2023-07-21T22:13:41.097931+0000","last_became_peered":"2023-07-21T22:13:41.097931+0000","last_unstale":"2023-07-21T22:13:42.085413+0000","last_undegraded":"2023-07-21T22:13:42.085413+0000","last_fullsized":"2023-07-21T22:13:42.085413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:03:44.909126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088710+0000","last_change":"2023-07-21T22:13:40.093966+0000","last_active":"2023-07-21T22:13:42.088710+0000","last_peered":"2023-07-21T22:13:42.088710+0000","last_clean":"2023-07-21T22:13:42.088710+0000","last_became_active":"2023-07-21T22:13:40.093353+0000","last_became_peered":"2023-07-21T22:13:40.093353+0000","last_unstale":"2023-07-21T22:13:42.088710+0000","last_undegraded":"2023-07-21T22:13:42.088710+0000","last_fullsized":"2023-07-21T22:13:42.088710+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:21:38.041433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083102+0000","last_change":"2023-07-21T22:13:41.105050+0000","last_active":"2023-07-21T22:13:42.083102+0000","last_peered":"2023-07-21T22:13:42.083102+0000","last_clean":"2023-07-21T22:13:42.083102+0000","last_became_active":"2023-07-21T22:13:41.104758+0000","last_became_peered":"2023-07-21T22:13:41.104758+0000","last_unstale":"2023-07-21T22:13:42.083102+0000","last_undegraded":"2023-07-21T22:13:42.083102+0000","last_fullsized":"2023-07-21T22:13:42.083102+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:04:04.307712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087914+0000","last_change":"2023-07-21T22:13:40.097222+0000","last_active":"2023-07-21T22:13:42.087914+0000","last_peered":"2023-07-21T22:13:42.087914+0000","last_clean":"2023-07-21T22:13:42.087914+0000","last_became_active":"2023-07-21T22:13:40.096883+0000","last_became_peered":"2023-07-21T22:13:40.096883+0000","last_unstale":"2023-07-21T22:13:42.087914+0000","last_undegraded":"2023-07-21T22:13:42.087914+0000","last_fullsized":"2023-07-21T22:13:42.087914+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:16.705408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.084866+0000","last_change":"2023-07-21T22:13:41.104606+0000","last_active":"2023-07-21T22:13:42.084866+0000","last_peered":"2023-07-21T22:13:42.084866+0000","last_clean":"2023-07-21T22:13:42.084866+0000","last_became_active":"2023-07-21T22:13:41.104358+0000","last_became_peered":"2023-07-21T22:13:41.104358+0000","last_unstale":"2023-07-21T22:13:42.084866+0000","last_undegraded":"2023-07-21T22:13:42.084866+0000","last_fullsized":"2023-07-21T22:13:42.084866+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:24:29.357456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088364+0000","last_change":"2023-07-21T22:13:40.097893+0000","last_active":"2023-07-21T22:13:42.088364+0000","last_peered":"2023-07-21T22:13:42.088364+0000","last_clean":"2023-07-21T22:13:42.088364+0000","last_became_active":"2023-07-21T22:13:40.097514+0000","last_became_peered":"2023-07-21T22:13:40.097514+0000","last_unstale":"2023-07-21T22:13:42.088364+0000","last_undegraded":"2023-07-21T22:13:42.088364+0000","last_fullsized":"2023-07-21T22:13:42.088364+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:25.022711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089550+0000","last_change":"2023-07-21T22:13:41.100628+0000","last_active":"2023-07-21T22:13:42.089550+0000","last_peered":"2023-07-21T22:13:42.089550+0000","last_clean":"2023-07-21T22:13:42.089550+0000","last_became_active":"2023-07-21T22:13:41.100324+0000","last_became_peered":"2023-07-21T22:13:41.100324+0000","last_unstale":"2023-07-21T22:13:42.089550+0000","last_undegraded":"2023-07-21T22:13:42.089550+0000","last_fullsized":"2023-07-21T22:13:42.089550+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:40:56.494244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088845+0000","last_change":"2023-07-21T22:13:40.092519+0000","last_active":"2023-07-21T22:13:42.088845+0000","last_peered":"2023-07-21T22:13:42.088845+0000","last_clean":"2023-07-21T22:13:42.088845+0000","last_became_active":"2023-07-21T22:13:40.092070+0000","last_became_peered":"2023-07-21T22:13:40.092070+0000","last_unstale":"2023-07-21T22:13:42.088845+0000","last_undegraded":"2023-07-21T22:13:42.088845+0000","last_fullsized":"2023-07-21T22:13:42.088845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:30:24.115974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.081972+0000","last_change":"2023-07-21T22:13:41.107176+0000","last_active":"2023-07-21T22:13:42.081972+0000","last_peered":"2023-07-21T22:13:42.081972+0000","last_clean":"2023-07-21T22:13:42.081972+0000","last_became_active":"2023-07-21T22:13:41.106910+0000","last_became_peered":"2023-07-21T22:13:41.106910+0000","last_unstale":"2023-07-21T22:13:42.081972+0000","last_undegraded":"2023-07-21T22:13:42.081972+0000","last_fullsized":"2023-07-21T22:13:42.081972+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:31:48.257897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088241+0000","last_change":"2023-07-21T22:13:40.096525+0000","last_active":"2023-07-21T22:13:42.088241+0000","last_peered":"2023-07-21T22:13:42.088241+0000","last_clean":"2023-07-21T22:13:42.088241+0000","last_became_active":"2023-07-21T22:13:40.096154+0000","last_became_peered":"2023-07-21T22:13:40.096154+0000","last_unstale":"2023-07-21T22:13:42.088241+0000","last_undegraded":"2023-07-21T22:13:42.088241+0000","last_fullsized":"2023-07-21T22:13:42.088241+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:31:03.344696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.085568+0000","last_change":"2023-07-21T22:13:41.097870+0000","last_active":"2023-07-21T22:13:42.085568+0000","last_peered":"2023-07-21T22:13:42.085568+0000","last_clean":"2023-07-21T22:13:42.085568+0000","last_became_active":"2023-07-21T22:13:41.097551+0000","last_became_peered":"2023-07-21T22:13:41.097551+0000","last_unstale":"2023-07-21T22:13:42.085568+0000","last_undegraded":"2023-07-21T22:13:42.085568+0000","last_fullsized":"2023-07-21T22:13:42.085568+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:20:26.962444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088515+0000","last_change":"2023-07-21T22:13:40.087863+0000","last_active":"2023-07-21T22:13:42.088515+0000","last_peered":"2023-07-21T22:13:42.088515+0000","last_clean":"2023-07-21T22:13:42.088515+0000","last_became_active":"2023-07-21T22:13:40.087564+0000","last_became_peered":"2023-07-21T22:13:40.087564+0000","last_unstale":"2023-07-21T22:13:42.088515+0000","last_undegraded":"2023-07-21T22:13:42.088515+0000","last_fullsized":"2023-07-21T22:13:42.088515+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:45:31.104525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":84,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.085771+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:13:42.085771+0000","last_peered":"2023-07-21T22:13:42.085771+0000","last_clean":"2023-07-21T22:13:42.085771+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:13:42.085771+0000","last_undegraded":"2023-07-21T22:13:42.085771+0000","last_fullsized":"2023-07-21T22:13:42.085771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:02.145183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.086124+0000","last_change":"2023-07-21T22:13:41.098808+0000","last_active":"2023-07-21T22:13:42.086124+0000","last_peered":"2023-07-21T22:13:42.086124+0000","last_clean":"2023-07-21T22:13:42.086124+0000","last_became_active":"2023-07-21T22:13:41.097724+0000","last_became_peered":"2023-07-21T22:13:41.097724+0000","last_unstale":"2023-07-21T22:13:42.086124+0000","last_undegraded":"2023-07-21T22:13:42.086124+0000","last_fullsized":"2023-07-21T22:13:42.086124+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:04:24.639277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088066+0000","last_change":"2023-07-21T22:13:40.098471+0000","last_active":"2023-07-21T22:13:42.088066+0000","last_peered":"2023-07-21T22:13:42.088066+0000","last_clean":"2023-07-21T22:13:42.088066+0000","last_became_active":"2023-07-21T22:13:40.098189+0000","last_became_peered":"2023-07-21T22:13:40.098189+0000","last_unstale":"2023-07-21T22:13:42.088066+0000","last_undegraded":"2023-07-21T22:13:42.088066+0000","last_fullsized":"2023-07-21T22:13:42.088066+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:04.532818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089026+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:13:42.089026+0000","last_peered":"2023-07-21T22:13:42.089026+0000","last_clean":"2023-07-21T22:13:42.089026+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:13:42.089026+0000","last_undegraded":"2023-07-21T22:13:42.089026+0000","last_fullsized":"2023-07-21T22:13:42.089026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:57.136703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.084342+0000","last_change":"2023-07-21T22:13:41.109484+0000","last_active":"2023-07-21T22:13:42.084342+0000","last_peered":"2023-07-21T22:13:42.084342+0000","last_clean":"2023-07-21T22:13:42.084342+0000","last_became_active":"2023-07-21T22:13:41.109190+0000","last_became_peered":"2023-07-21T22:13:41.109190+0000","last_unstale":"2023-07-21T22:13:42.084342+0000","last_undegraded":"2023-07-21T22:13:42.084342+0000","last_fullsized":"2023-07-21T22:13:42.084342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:09:27.354070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087939+0000","last_change":"2023-07-21T22:13:40.100805+0000","last_active":"2023-07-21T22:13:42.087939+0000","last_peered":"2023-07-21T22:13:42.087939+0000","last_clean":"2023-07-21T22:13:42.087939+0000","last_became_active":"2023-07-21T22:13:40.100494+0000","last_became_peered":"2023-07-21T22:13:40.100494+0000","last_unstale":"2023-07-21T22:13:42.087939+0000","last_undegraded":"2023-07-21T22:13:42.087939+0000","last_fullsized":"2023-07-21T22:13:42.087939+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:32:06.678515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":82,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087924+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:13:42.087924+0000","last_peered":"2023-07-21T22:13:42.087924+0000","last_clean":"2023-07-21T22:13:42.087924+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:13:42.087924+0000","last_undegraded":"2023-07-21T22:13:42.087924+0000","last_fullsized":"2023-07-21T22:13:42.087924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:21:07.332202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087646+0000","last_change":"2023-07-21T22:13:41.117194+0000","last_active":"2023-07-21T22:13:42.087646+0000","last_peered":"2023-07-21T22:13:42.087646+0000","last_clean":"2023-07-21T22:13:42.087646+0000","last_became_active":"2023-07-21T22:13:41.116856+0000","last_became_peered":"2023-07-21T22:13:41.116856+0000","last_unstale":"2023-07-21T22:13:42.087646+0000","last_undegraded":"2023-07-21T22:13:42.087646+0000","last_fullsized":"2023-07-21T22:13:42.087646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:14.952691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.084978+0000","last_change":"2023-07-21T22:13:40.096336+0000","last_active":"2023-07-21T22:13:42.084978+0000","last_peered":"2023-07-21T22:13:42.084978+0000","last_clean":"2023-07-21T22:13:42.084978+0000","last_became_active":"2023-07-21T22:13:40.095997+0000","last_became_peered":"2023-07-21T22:13:40.095997+0000","last_unstale":"2023-07-21T22:13:42.084978+0000","last_undegraded":"2023-07-21T22:13:42.084978+0000","last_fullsized":"2023-07-21T22:13:42.084978+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:32:06.678515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088826+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:13:42.088826+0000","last_peered":"2023-07-21T22:13:42.088826+0000","last_clean":"2023-07-21T22:13:42.088826+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:13:42.088826+0000","last_undegraded":"2023-07-21T22:13:42.088826+0000","last_fullsized":"2023-07-21T22:13:42.088826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:58:24.336351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.084340+0000","last_change":"2023-07-21T22:13:41.100147+0000","last_active":"2023-07-21T22:13:42.084340+0000","last_peered":"2023-07-21T22:13:42.084340+0000","last_clean":"2023-07-21T22:13:42.084340+0000","last_became_active":"2023-07-21T22:13:41.099829+0000","last_became_peered":"2023-07-21T22:13:41.099829+0000","last_unstale":"2023-07-21T22:13:42.084340+0000","last_undegraded":"2023-07-21T22:13:42.084340+0000","last_fullsized":"2023-07-21T22:13:42.084340+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:11.172856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087987+0000","last_change":"2023-07-21T22:13:40.097666+0000","last_active":"2023-07-21T22:13:42.087987+0000","last_peered":"2023-07-21T22:13:42.087987+0000","last_clean":"2023-07-21T22:13:42.087987+0000","last_became_active":"2023-07-21T22:13:40.097365+0000","last_became_peered":"2023-07-21T22:13:40.097365+0000","last_unstale":"2023-07-21T22:13:42.087987+0000","last_undegraded":"2023-07-21T22:13:42.087987+0000","last_fullsized":"2023-07-21T22:13:42.087987+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:57:23.225259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":86,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083915+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:13:42.083915+0000","last_peered":"2023-07-21T22:13:42.083915+0000","last_clean":"2023-07-21T22:13:42.083915+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:13:42.083915+0000","last_undegraded":"2023-07-21T22:13:42.083915+0000","last_fullsized":"2023-07-21T22:13:42.083915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:26:28.385559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083714+0000","last_change":"2023-07-21T22:13:41.095803+0000","last_active":"2023-07-21T22:13:42.083714+0000","last_peered":"2023-07-21T22:13:42.083714+0000","last_clean":"2023-07-21T22:13:42.083714+0000","last_became_active":"2023-07-21T22:13:41.095315+0000","last_became_peered":"2023-07-21T22:13:41.095315+0000","last_unstale":"2023-07-21T22:13:42.083714+0000","last_undegraded":"2023-07-21T22:13:42.083714+0000","last_fullsized":"2023-07-21T22:13:42.083714+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:37.732164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083794+0000","last_change":"2023-07-21T22:13:40.094937+0000","last_active":"2023-07-21T22:13:42.083794+0000","last_peered":"2023-07-21T22:13:42.083794+0000","last_clean":"2023-07-21T22:13:42.083794+0000","last_became_active":"2023-07-21T22:13:40.094169+0000","last_became_peered":"2023-07-21T22:13:40.094169+0000","last_unstale":"2023-07-21T22:13:42.083794+0000","last_undegraded":"2023-07-21T22:13:42.083794+0000","last_fullsized":"2023-07-21T22:13:42.083794+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:38.353813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":86,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.082315+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:13:42.082315+0000","last_peered":"2023-07-21T22:13:42.082315+0000","last_clean":"2023-07-21T22:13:42.082315+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:13:42.082315+0000","last_undegraded":"2023-07-21T22:13:42.082315+0000","last_fullsized":"2023-07-21T22:13:42.082315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:03:56.835097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089418+0000","last_change":"2023-07-21T22:13:41.106922+0000","last_active":"2023-07-21T22:13:42.089418+0000","last_peered":"2023-07-21T22:13:42.089418+0000","last_clean":"2023-07-21T22:13:42.089418+0000","last_became_active":"2023-07-21T22:13:41.106619+0000","last_became_peered":"2023-07-21T22:13:41.106619+0000","last_unstale":"2023-07-21T22:13:42.089418+0000","last_undegraded":"2023-07-21T22:13:42.089418+0000","last_fullsized":"2023-07-21T22:13:42.089418+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:39.370150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.089483+0000","last_change":"2023-07-21T22:13:40.093838+0000","last_active":"2023-07-21T22:13:42.089483+0000","last_peered":"2023-07-21T22:13:42.089483+0000","last_clean":"2023-07-21T22:13:42.089483+0000","last_became_active":"2023-07-21T22:13:40.093566+0000","last_became_peered":"2023-07-21T22:13:40.093566+0000","last_unstale":"2023-07-21T22:13:42.089483+0000","last_undegraded":"2023-07-21T22:13:42.089483+0000","last_fullsized":"2023-07-21T22:13:42.089483+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:52:49.455868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":82,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087424+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:13:42.087424+0000","last_peered":"2023-07-21T22:13:42.087424+0000","last_clean":"2023-07-21T22:13:42.087424+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:13:42.087424+0000","last_undegraded":"2023-07-21T22:13:42.087424+0000","last_fullsized":"2023-07-21T22:13:42.087424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:04:02.478150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083846+0000","last_change":"2023-07-21T22:13:41.105123+0000","last_active":"2023-07-21T22:13:42.083846+0000","last_peered":"2023-07-21T22:13:42.083846+0000","last_clean":"2023-07-21T22:13:42.083846+0000","last_became_active":"2023-07-21T22:13:41.104852+0000","last_became_peered":"2023-07-21T22:13:41.104852+0000","last_unstale":"2023-07-21T22:13:42.083846+0000","last_undegraded":"2023-07-21T22:13:42.083846+0000","last_fullsized":"2023-07-21T22:13:42.083846+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:40.060998+0000","last_clean_scrub_stamp":"2023-07-21T22:13:40.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:24:28.791078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.088663+0000","last_change":"2023-07-21T22:13:40.091829+0000","last_active":"2023-07-21T22:13:42.088663+0000","last_peered":"2023-07-21T22:13:42.088663+0000","last_clean":"2023-07-21T22:13:42.088663+0000","last_became_active":"2023-07-21T22:13:40.091466+0000","last_became_peered":"2023-07-21T22:13:40.091466+0000","last_unstale":"2023-07-21T22:13:42.088663+0000","last_undegraded":"2023-07-21T22:13:42.088663+0000","last_fullsized":"2023-07-21T22:13:42.088663+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:13:39.050093+0000","last_clean_scrub_stamp":"2023-07-21T22:13:39.050093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:47.503277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.083683+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:13:42.083683+0000","last_peered":"2023-07-21T22:13:42.083683+0000","last_clean":"2023-07-21T22:13:42.083683+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:13:42.083683+0000","last_undegraded":"2023-07-21T22:13:42.083683+0000","last_fullsized":"2023-07-21T22:13:42.083683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:29:02.969658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":238,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-07-21T22:13:42.087583+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:13:42.087583+0000","last_peered":"2023-07-21T22:13:42.087583+0000","last_clean":"2023-07-21T22:13:42.087583+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:13:42.087583+0000","last_undegraded":"2023-07-21T22:13:42.087583+0000","last_fullsized":"2023-07-21T22:13:42.087583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:16.236713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1347584,"data_stored":935004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.2270000000000001,"15min":1.2250000000000001},"min":{"1min":0.92800000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6439999999999999,"5min":2.218,"15min":2.218},"last":1.083},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.278,"15min":1.3100000000000001},"min":{"1min":0.98899999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.478,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.2569999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.196,"15min":1.218},"min":{"1min":0.749,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4830000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2370000000000001,"15min":1.2729999999999999},"min":{"1min":0.81000000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.5249999999999999,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.1200000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.21,"15min":1.2250000000000001},"min":{"1min":0.89000000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.4139999999999999,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.2709999999999999,"15min":1.2989999999999999},"min":{"1min":0.80000000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5940000000000001,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.202}]},{"osd":3,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.278,"15min":1.2929999999999999},"min":{"1min":0.93700000000000006,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4910000000000001,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.3560000000000001,"15min":1.4159999999999999},"min":{"1min":0.88500000000000001,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5329999999999999,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.369}]},{"osd":4,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.2050000000000001,"15min":1.23},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4790000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.304,"15min":1.3340000000000001},"min":{"1min":0.84399999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5189999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.87}]},{"osd":5,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3480000000000001,"15min":1.3660000000000001},"min":{"1min":0.66300000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4810000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.282},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.3280000000000001,"15min":1.3740000000000001},"min":{"1min":0.89800000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.496,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.032}]},{"osd":6,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.4490000000000001,"15min":1.4950000000000001},"min":{"1min":0.96099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.6160000000000001,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.173},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3999999999999999,"15min":1.423},"min":{"1min":1.038,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.667,"5min":2.476,"15min":2.476},"last":1.3280000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":741376,"data_stored":343894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.105,"15min":1.119},"min":{"1min":0.71599999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.52,"5min":1.657,"15min":1.657},"last":1.48},{"interface":"front","average":{"1min":1.02,"5min":1.1120000000000001,"15min":1.141},"min":{"1min":0.78100000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.282,"5min":2.802,"15min":2.802},"last":1.085}]},{"osd":1,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2070000000000001,"15min":1.2430000000000001},"min":{"1min":0.90500000000000003,"5min":0.747,"15min":0.747},"max":{"1min":1.571,"5min":1.839,"15min":1.839},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.212,"15min":1.25},"min":{"1min":0.754,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7070000000000001,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.0640000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2370000000000001,"15min":1.2689999999999999},"min":{"1min":0.93500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.718,"5min":2.911,"15min":2.911},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.2889999999999999,"15min":1.355},"min":{"1min":0.77200000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4870000000000001,"5min":2.379,"15min":2.379},"last":1.1970000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.373,"15min":1.425},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.554,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.111},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.3580000000000001,"15min":1.4059999999999999},"min":{"1min":0.83899999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.716,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":1.2430000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.28,"15min":1.28},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8919999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.335,"15min":1.381},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6140000000000001,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.399}]},{"osd":5,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3740000000000001,"15min":1.3959999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.7290000000000001,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.359},{"interface":"front","average":{"1min":1.385,"5min":1.4350000000000001,"15min":1.452},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9419999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.159}]},{"osd":7,"last update":"Fri Jul 21 22:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.421,"15min":1.4410000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9390000000000001,"5min":4.194,"15min":4.194},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.524,"15min":1.55},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.8220000000000001,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.2789999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509485,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":741376,"data_stored":343882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.079,"15min":1.0960000000000001},"min":{"1min":0.67300000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.472,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1279999999999999,"15min":1.1399999999999999},"min":{"1min":0.77100000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5329999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1619999999999999,"15min":1.2},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.593,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.1599999999999999,"15min":1.1839999999999999},"min":{"1min":0.72099999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.51,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.026}]},{"osd":2,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1619999999999999,"15min":1.1659999999999999},"min":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.272,"15min":1.3049999999999999},"min":{"1min":0.76100000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.615,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.083}]},{"osd":3,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.2250000000000001,"15min":1.2490000000000001},"min":{"1min":0.68400000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.47,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.373},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.371,"15min":1.401},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.671,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.403}]},{"osd":4,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3049999999999999,"15min":1.3360000000000001},"min":{"1min":0.93500000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.5960000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.876},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2909999999999999,"15min":1.304},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.673,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.266}]},{"osd":6,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.256,"15min":1.2829999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.621,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.204},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":0.85299999999999998,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.655,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.1559999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:24 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2789999999999999,"15min":1.3029999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5449999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4870000000000001,"15min":1.5189999999999999},"min":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7150000000000001,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.458}]}]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":345424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.105,"15min":1.101},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.4039999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.151,"15min":1.171},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5269999999999999,"5min":1.617,"15min":1.617},"last":1.399}]},{"osd":1,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.216,"15min":1.232},"min":{"1min":0.60699999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7030000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.661},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1930000000000001,"15min":1.1950000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.6000000000000001,"5min":1.665,"15min":1.665},"last":1.536}]},{"osd":2,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.143,"15min":1.1399999999999999},"min":{"1min":0.89800000000000002,"5min":0.748,"15min":0.748},"max":{"1min":1.585,"5min":1.609,"15min":1.609},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.2789999999999999,"15min":1.3},"min":{"1min":0.96399999999999997,"5min":0.621,"15min":0.621},"max":{"1min":1.6479999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.228}]},{"osd":3,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.2669999999999999,"15min":1.3049999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.482,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.619},{"interface":"front","average":{"1min":1.266,"5min":1.236,"15min":1.2330000000000001},"min":{"1min":1.0069999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.504,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.2789999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.264,"15min":1.3},"min":{"1min":0.86199999999999999,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7470000000000001,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.573},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.246,"15min":1.2370000000000001},"min":{"1min":0.751,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.756,"5min":1.794,"15min":1.794},"last":1.321}]},{"osd":6,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.198,"15min":1.2},"min":{"1min":0.91700000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5760000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.367},{"interface":"front","average":{"1min":1.385,"5min":1.3959999999999999,"15min":1.4259999999999999},"min":{"1min":0.995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8380000000000001,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.498}]},{"osd":7,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.385,"15min":1.369},"min":{"1min":0.85999999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.831,"5min":1.887,"15min":1.887},"last":1.425},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4119999999999999,"15min":1.409},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.835,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.464}]}]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":737280,"data_stored":343860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92000000000000004,"15min":0.93100000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88700000000000001,"15min":0.90100000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.90500000000000003,"15min":0.93899999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1879999999999999,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.081,"15min":1.129},"min":{"1min":0.56999999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.71,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.0700000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.69199999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.137},{"interface":"front","average":{"1min":0.999,"5min":1.0329999999999999,"15min":1.04},"min":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5109999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.0109999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.3240000000000001,"15min":1.3420000000000001},"min":{"1min":0.90800000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.73,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.29,"15min":1.3340000000000001},"min":{"1min":0.76500000000000001,"5min":0.751,"15min":0.751},"max":{"1min":1.52,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.4370000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3029999999999999,"15min":1.339},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.694,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.651},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4359999999999999,"15min":1.466},"min":{"1min":0.96799999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.677,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.6890000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.337,"15min":1.367},"min":{"1min":0.86499999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.75,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4099999999999999,"15min":1.4490000000000001},"min":{"1min":0.92700000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.653,"5min":2.161,"15min":2.161},"last":1.714}]},{"osd":7,"last update":"Fri Jul 21 22:13:33 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.4590000000000001,"15min":1.5069999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.6639999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.7789999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.5229999999999999,"15min":1.5580000000000001},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.8140000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.5700000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509483,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":737280,"data_stored":343860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.872,"15min":0.88},"min":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1950000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.022,"15min":1.032},"min":{"1min":0.69099999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5189999999999999,"5min":1.534,"15min":1.534},"last":1.4350000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.93899999999999995,"15min":0.95699999999999996},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.272,"5min":1.486,"15min":1.486},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0980000000000001,"15min":1.1180000000000001},"min":{"1min":0.75600000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.2869999999999999,"5min":1.958,"15min":1.958},"last":1.1200000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.123,"15min":1.1379999999999999},"min":{"1min":0.70199999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.4419999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.1299999999999999,"15min":1.1559999999999999},"min":{"1min":0.73999999999999999,"5min":0.623,"15min":0.623},"max":{"1min":1.365,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.0489999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3979999999999999,"15min":1.4199999999999999},"min":{"1min":1.0960000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6060000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.169},{"interface":"front","average":{"1min":1.329,"5min":1.4670000000000001,"15min":1.5069999999999999},"min":{"1min":1.0580000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.607,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.369}]},{"osd":5,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.4770000000000001,"15min":1.506},"min":{"1min":1.1259999999999999,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":1.6599999999999999,"5min":3.331,"15min":3.331},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.5129999999999999,"15min":1.5529999999999999},"min":{"1min":1.1100000000000001,"5min":1.085,"15min":1.085},"max":{"1min":1.7649999999999999,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.083}]},{"osd":6,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4379999999999999,"15min":1.458},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.663,"5min":2.633,"15min":2.633},"last":1.389},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.421,"15min":1.458},"min":{"1min":1.1319999999999999,"5min":0.878,"15min":0.878},"max":{"1min":1.615,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.2689999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4510000000000001,"15min":1.4810000000000001},"min":{"1min":1.0009999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.738,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.534,"15min":1.5640000000000001},"min":{"1min":1.1379999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.72,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.3300000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1331200,"data_stored":934228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.876,"15min":0.88800000000000001},"min":{"1min":0.63200000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.94799999999999995,"15min":0.97399999999999998},"min":{"1min":0.63500000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.95499999999999996,"15min":0.93899999999999995},"min":{"1min":0.68200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.032,"15min":1.026},"min":{"1min":0.77300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.96199999999999997,"15min":0.94999999999999996},"min":{"1min":0.63900000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.179,"15min":1.175},"min":{"1min":0.82099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":0.88}]},{"osd":4,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.264,"15min":1.2609999999999999},"min":{"1min":0.90900000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":3.1779999999999999,"5min":3.1779999999999999,"15min":3.1779999999999999},"last":1.095},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.3899999999999999,"15min":1.3919999999999999},"min":{"1min":1.1559999999999999,"5min":1,"15min":1},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.3540000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.429,"15min":1.4870000000000001},"min":{"1min":0.96999999999999997,"5min":0.872,"15min":0.872},"max":{"1min":2.1150000000000002,"5min":2.419,"15min":2.419},"last":1.232},{"interface":"front","average":{"1min":1.409,"5min":1.383,"15min":1.4039999999999999},"min":{"1min":0.96699999999999997,"5min":0.872,"15min":0.872},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.1240000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4870000000000001,"15min":1.522},"min":{"1min":1.0680000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.254},{"interface":"front","average":{"1min":1.46,"5min":1.4770000000000001,"15min":1.5189999999999999},"min":{"1min":1.0980000000000001,"5min":1.038,"15min":1.038},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.3919999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.49,"15min":1.5369999999999999},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.4489999999999998,"5min":2.504,"15min":2.504},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4610000000000001,"15min":1.5009999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.4770000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":346188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.877,"15min":0.89300000000000002},"min":{"1min":0.51600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":1.2589999999999999,"5min":2.113,"15min":2.113},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.627,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5009999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.82299999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.89900000000000002,"15min":0.90000000000000002},"min":{"1min":0.505,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1659999999999999,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.0840000000000001,"15min":1.1180000000000001},"min":{"1min":0.65700000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.601,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":0.92600000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.3100000000000001,"15min":1.3899999999999999},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7110000000000001,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.1879999999999999,"15min":1.2509999999999999},"min":{"1min":0.70399999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4370000000000001,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":0.996}]},{"osd":4,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2869999999999999,"15min":1.3120000000000001},"min":{"1min":0.96199999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.617,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.272,"15min":1.302},"min":{"1min":0.996,"5min":0.377,"15min":0.377},"max":{"1min":1.6719999999999999,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.53}]},{"osd":5,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.319,"15min":1.361},"min":{"1min":0.92400000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.7869999999999999,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.4339999999999999,"15min":1.484},"min":{"1min":1.0800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.958,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.4139999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3919999999999999,"15min":1.4279999999999999},"min":{"1min":0.94099999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6439999999999999,"5min":2.238,"15min":2.238},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.4159999999999999,"15min":1.444},"min":{"1min":1.111,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.887,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.3109999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5209999999999999,"15min":1.5549999999999999},"min":{"1min":0.997,"5min":0.624,"15min":0.624},"max":{"1min":1.909,"5min":4.391,"15min":4.391},"last":1.498},{"interface":"front","average":{"1min":1.413,"5min":1.4830000000000001,"15min":1.5169999999999999},"min":{"1min":1.155,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.746,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.4630000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:13:50.746 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:13:50.747 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T22:13:50.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.933+0000 7fa80262f700 1 Processor -- start 2023-07-21T22:13:50.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.933+0000 7fa80262f700 1 -- start start 2023-07-21T22:13:50.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa80262f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7fc15bed0 0x7fa7fc0ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:50.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa80262f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa7fc0cef30 0x7fa7fc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:50.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa80262f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7fc0b5460 con 0x7fa7fc0d07b0 2023-07-21T22:13:50.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa80262f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7fc0d1030 con 0x7fa7fc15bed0 2023-07-21T22:13:50.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa80262f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7fc0d1310 con 0x7fa7fc0cef30 2023-07-21T22:13:50.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa80162d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7fc15bed0 0x7fa7fc0ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:50.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa80162d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7fc15bed0 0x7fa7fc0ce9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54620/0 (socket says 172.21.15.49:54620) 2023-07-21T22:13:50.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa801e2e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa7fc0d07b0 0x7fa7fc0b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33790/0 (socket says 172.21.15.49:33790) 2023-07-21T22:13:50.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa80162d700 1 -- 172.21.15.49:0/1635236324 learned_addr learned my addr 172.21.15.49:0/1635236324 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:50.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa800e2c700 1 --2- 172.21.15.49:0/1635236324 >> v2:172.21.15.150:3300/0 conn(0x7fa7fc0cef30 0x7fa7fc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa80162d700 1 -- 172.21.15.49:0/1635236324 >> v2:172.21.15.150:3300/0 conn(0x7fa7fc0cef30 msgr2=0x7fa7fc0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa80162d700 1 --2- 172.21.15.49:0/1635236324 >> v2:172.21.15.150:3300/0 conn(0x7fa7fc0cef30 0x7fa7fc0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa80162d700 1 -- 172.21.15.49:0/1635236324 >> v1:172.21.15.49:6789/0 conn(0x7fa7fc0d07b0 legacy=0x7fa7fc0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa80162d700 1 -- 172.21.15.49:0/1635236324 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc0d15f0 con 0x7fa7fc15bed0 2023-07-21T22:13:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa800e2c700 1 --2- 172.21.15.49:0/1635236324 >> v2:172.21.15.150:3300/0 conn(0x7fa7fc0cef30 0x7fa7fc0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa80162d700 1 --2- 172.21.15.49:0/1635236324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7fc15bed0 0x7fa7fc0ce9f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc070c00 tx=0x7fa7f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531d1a31ead2844e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:50.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa7f3fff700 1 -- 172.21.15.49:0/1635236324 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f800e070 con 0x7fa7fc15bed0 2023-07-21T22:13:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa7f3fff700 1 -- 172.21.15.49:0/1635236324 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f800b9c0 con 0x7fa7fc15bed0 2023-07-21T22:13:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.937+0000 7fa7f3fff700 1 -- 172.21.15.49:0/1635236324 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f800bd70 con 0x7fa7fc15bed0 2023-07-21T22:13:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.941+0000 7fa80262f700 1 -- 172.21.15.49:0/1635236324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7fc15bed0 msgr2=0x7fa7fc0ce9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.941+0000 7fa80262f700 1 --2- 172.21.15.49:0/1635236324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7fc15bed0 0x7fa7fc0ce9f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc070c00 tx=0x7fa7f800b330 comp rx=0 tx=0).stop 2023-07-21T22:13:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.941+0000 7fa80262f700 1 -- 172.21.15.49:0/1635236324 shutdown_connections 2023-07-21T22:13:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.941+0000 7fa80262f700 1 --2- 172.21.15.49:0/1635236324 >> v2:172.21.15.150:3300/0 conn(0x7fa7fc0cef30 0x7fa7fc0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.941+0000 7fa80262f700 1 --2- 172.21.15.49:0/1635236324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7fc15bed0 0x7fa7fc0ce9f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.941+0000 7fa80262f700 1 -- 172.21.15.49:0/1635236324 >> 172.21.15.49:0/1635236324 conn(0x7fa7fc065af0 msgr2=0x7fa7fc06fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.941+0000 7fa80262f700 1 -- 172.21.15.49:0/1635236324 shutdown_connections 2023-07-21T22:13:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.941+0000 7fa80262f700 1 -- 172.21.15.49:0/1635236324 wait complete. 2023-07-21T22:13:50.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa80262f700 1 Processor -- start 2023-07-21T22:13:50.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa80262f700 1 -- start start 2023-07-21T22:13:50.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa80262f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7fc0cef30 0x7fa7fc147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:50.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa80262f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7fc0d07b0 0x7fa7fc0c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:50.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa80262f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7fc15bed0 0x7fa7fc0b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:50.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa80262f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc156ce0 con 0x7fa7fc15bed0 2023-07-21T22:13:50.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa80262f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0cb410 con 0x7fa7fc0cef30 2023-07-21T22:13:50.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa80262f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0cb6f0 con 0x7fa7fc0d07b0 2023-07-21T22:13:50.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa801e2e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7fc15bed0 0x7fa7fc0b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:50.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa801e2e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7fc15bed0 0x7fa7fc0b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54628/0 (socket says 172.21.15.49:54628) 2023-07-21T22:13:50.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa801e2e700 1 -- 172.21.15.49:0/4187230411 learned_addr learned my addr 172.21.15.49:0/4187230411 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:50.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa80162d700 1 --2- 172.21.15.49:0/4187230411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7fc0cef30 0x7fa7fc147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:50.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa800e2c700 1 --2- 172.21.15.49:0/4187230411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7fc0d07b0 0x7fa7fc0c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:50.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa801e2e700 1 -- 172.21.15.49:0/4187230411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7fc0d07b0 msgr2=0x7fa7fc0c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:50.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa801e2e700 1 --2- 172.21.15.49:0/4187230411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7fc0d07b0 0x7fa7fc0c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:50.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa801e2e700 1 -- 172.21.15.49:0/4187230411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7fc0cef30 msgr2=0x7fa7fc147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa801e2e700 1 --2- 172.21.15.49:0/4187230411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7fc0cef30 0x7fa7fc147330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa801e2e700 1 -- 172.21.15.49:0/4187230411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f8009b30 con 0x7fa7fc15bed0 2023-07-21T22:13:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.945+0000 7fa801e2e700 1 --2- 172.21.15.49:0/4187230411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7fc15bed0 0x7fa7fc0b7700 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400c500 tx=0x7fa7f400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.949+0000 7fa7f1ffb700 1 -- 172.21.15.49:0/4187230411 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4005cd0 con 0x7fa7fc15bed0 2023-07-21T22:13:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.949+0000 7fa7f1ffb700 1 -- 172.21.15.49:0/4187230411 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f4005e30 con 0x7fa7fc15bed0 2023-07-21T22:13:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.949+0000 7fa80262f700 1 -- 172.21.15.49:0/4187230411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7fc0cb9d0 con 0x7fa7fc15bed0 2023-07-21T22:13:50.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.949+0000 7fa7f1ffb700 1 -- 172.21.15.49:0/4187230411 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40072f0 con 0x7fa7fc15bed0 2023-07-21T22:13:50.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.949+0000 7fa80262f700 1 -- 172.21.15.49:0/4187230411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7fc0cbf90 con 0x7fa7fc15bed0 2023-07-21T22:13:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.949+0000 7fa80262f700 1 -- 172.21.15.49:0/4187230411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7fc0cc1b0 con 0x7fa7fc15bed0 2023-07-21T22:13:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.949+0000 7fa7f1ffb700 1 -- 172.21.15.49:0/4187230411 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7f4007450 con 0x7fa7fc15bed0 2023-07-21T22:13:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.953+0000 7fa7f1ffb700 1 --2- 172.21.15.49:0/4187230411 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa7e00662f0 0x7fa7e00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.953+0000 7fa7f1ffb700 1 -- 172.21.15.49:0/4187230411 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa7f4083350 con 0x7fa7fc15bed0 2023-07-21T22:13:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.953+0000 7fa80162d700 1 --2- 172.21.15.49:0/4187230411 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa7e00662f0 0x7fa7e00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:50.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.953+0000 7fa80162d700 1 --2- 172.21.15.49:0/4187230411 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa7e00662f0 0x7fa7e00687a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8000f80 tx=0x7fa7f8009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:51.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:50.957+0000 7fa7f1ffb700 1 -- 172.21.15.49:0/4187230411 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7f40505f0 con 0x7fa7fc15bed0 2023-07-21T22:13:51.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.197+0000 7fa80262f700 1 -- 172.21.15.49:0/4187230411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa7fc04dcb0 con 0x7fa7fc15bed0 2023-07-21T22:13:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.205+0000 7fa7f1ffb700 1 -- 172.21.15.49:0/4187230411 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa7f4053c10 con 0x7fa7fc15bed0 2023-07-21T22:13:51.248 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2023-07-21T22:13:51.249 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtkU5ZaIRAAchCJhuM71+rGOBHBlX77wA== 2023-07-21T22:13:51.249 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow" 2023-07-21T22:13:51.249 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2023-07-21T22:13:51.249 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T22:13:51.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.205+0000 7fa80262f700 1 -- 172.21.15.49:0/4187230411 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa7e00662f0 msgr2=0x7fa7e00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:51.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.205+0000 7fa80262f700 1 --2- 172.21.15.49:0/4187230411 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa7e00662f0 0x7fa7e00687a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8000f80 tx=0x7fa7f8009000 comp rx=0 tx=0).stop 2023-07-21T22:13:51.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.205+0000 7fa80262f700 1 -- 172.21.15.49:0/4187230411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7fc15bed0 msgr2=0x7fa7fc0b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:51.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.205+0000 7fa80262f700 1 --2- 172.21.15.49:0/4187230411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7fc15bed0 0x7fa7fc0b7700 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400c500 tx=0x7fa7f400c810 comp rx=0 tx=0).stop 2023-07-21T22:13:51.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.205+0000 7fa80262f700 1 -- 172.21.15.49:0/4187230411 shutdown_connections 2023-07-21T22:13:51.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.205+0000 7fa80262f700 1 --2- 172.21.15.49:0/4187230411 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa7e00662f0 0x7fa7e00687a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:51.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.205+0000 7fa80262f700 1 --2- 172.21.15.49:0/4187230411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7fc15bed0 0x7fa7fc0b7700 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.205+0000 7fa80262f700 1 --2- 172.21.15.49:0/4187230411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7fc0d07b0 0x7fa7fc0c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.209+0000 7fa80262f700 1 --2- 172.21.15.49:0/4187230411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7fc0cef30 0x7fa7fc147330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.209+0000 7fa80262f700 1 -- 172.21.15.49:0/4187230411 >> 172.21.15.49:0/4187230411 conn(0x7fa7fc065af0 msgr2=0x7fa7fc0b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:51.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.209+0000 7fa80262f700 1 -- 172.21.15.49:0/4187230411 shutdown_connections 2023-07-21T22:13:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.209+0000 7fa80262f700 1 -- 172.21.15.49:0/4187230411 wait complete. 2023-07-21T22:13:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-07-21T22:13:51.274 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:13:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.413+0000 7f20549af700 1 Processor -- start 2023-07-21T22:13:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.413+0000 7f20549af700 1 -- start start 2023-07-21T22:13:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.413+0000 7f20549af700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f205006d380 0x7f205006d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.413+0000 7f20549af700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20500cab20 con 0x7f20500cafb0 2023-07-21T22:13:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.413+0000 7f20549af700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205006dc90 con 0x7f2050071c70 2023-07-21T22:13:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.413+0000 7f20549af700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20500c9e80 con 0x7f205006d380 2023-07-21T22:13:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f204f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f205006d380 0x7f205006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f204f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f205006d380 0x7f205006d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54634/0 (socket says 172.21.15.49:54634) 2023-07-21T22:13:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f204f7fe700 1 -- 172.21.15.49:0/483242455 learned_addr learned my addr 172.21.15.49:0/483242455 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f204f7fe700 1 -- 172.21.15.49:0/483242455 >> v1:172.21.15.150:6789/0 conn(0x7f2050071c70 legacy=0x7f20500b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f204f7fe700 1 -- 172.21.15.49:0/483242455 >> v1:172.21.15.49:6789/0 conn(0x7f20500cafb0 legacy=0x7f2050164730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f204f7fe700 1 -- 172.21.15.49:0/483242455 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20500ca1f0 con 0x7f205006d380 2023-07-21T22:13:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f204f7fe700 1 --2- 172.21.15.49:0/483242455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f205006d380 0x7f205006d750 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2040009910 tx=0x7f2040009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a196e764ee5ee6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:51.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f204effd700 1 -- 172.21.15.49:0/483242455 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040004230 con 0x7f205006d380 2023-07-21T22:13:51.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f204effd700 1 -- 172.21.15.49:0/483242455 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2040004390 con 0x7f205006d380 2023-07-21T22:13:51.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f204effd700 1 -- 172.21.15.49:0/483242455 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040009e60 con 0x7f205006d380 2023-07-21T22:13:51.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f20549af700 1 -- 172.21.15.49:0/483242455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f205006d380 msgr2=0x7f205006d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:51.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f20549af700 1 --2- 172.21.15.49:0/483242455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f205006d380 0x7f205006d750 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2040009910 tx=0x7f2040009c20 comp rx=0 tx=0).stop 2023-07-21T22:13:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f20549af700 1 -- 172.21.15.49:0/483242455 shutdown_connections 2023-07-21T22:13:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f20549af700 1 --2- 172.21.15.49:0/483242455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f205006d380 0x7f205006d750 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f20549af700 1 -- 172.21.15.49:0/483242455 >> 172.21.15.49:0/483242455 conn(0x7f2050070450 msgr2=0x7f2050070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f20549af700 1 -- 172.21.15.49:0/483242455 shutdown_connections 2023-07-21T22:13:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.417+0000 7f20549af700 1 -- 172.21.15.49:0/483242455 wait complete. 2023-07-21T22:13:51.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.421+0000 7f20549af700 1 Processor -- start 2023-07-21T22:13:51.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.421+0000 7f20549af700 1 -- start start 2023-07-21T22:13:51.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f20549af700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205006d380 0x7f2050149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:51.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f20549af700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050071c70 0x7f20500b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:51.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f20549af700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20500cafb0 0x7f20500b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:51.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f20549af700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20500cdc10 con 0x7f2050071c70 2023-07-21T22:13:51.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f20549af700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20500ccb70 con 0x7f205006d380 2023-07-21T22:13:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f20549af700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20500cce50 con 0x7f20500cafb0 2023-07-21T22:13:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f2047fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050071c70 0x7f20500b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f2047fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050071c70 0x7f20500b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54640/0 (socket says 172.21.15.49:54640) 2023-07-21T22:13:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f2047fff700 1 -- 172.21.15.49:0/280391002 learned_addr learned my addr 172.21.15.49:0/280391002 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f204f7fe700 1 --2- 172.21.15.49:0/280391002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205006d380 0x7f2050149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f204ffff700 1 --2- 172.21.15.49:0/280391002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20500cafb0 0x7f20500b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f2047fff700 1 -- 172.21.15.49:0/280391002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20500cafb0 msgr2=0x7f20500b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f2047fff700 1 --2- 172.21.15.49:0/280391002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20500cafb0 0x7f20500b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:51.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f2047fff700 1 -- 172.21.15.49:0/280391002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205006d380 msgr2=0x7f2050149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:51.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f2047fff700 1 --2- 172.21.15.49:0/280391002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205006d380 0x7f2050149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:51.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f2047fff700 1 -- 172.21.15.49:0/280391002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2040009570 con 0x7f2050071c70 2023-07-21T22:13:51.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f2047fff700 1 --2- 172.21.15.49:0/280391002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050071c70 0x7f20500b2460 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f203800b4a0 tx=0x7f203800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f204cff9700 1 -- 172.21.15.49:0/280391002 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038011830 con 0x7f2050071c70 2023-07-21T22:13:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f204cff9700 1 -- 172.21.15.49:0/280391002 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2038011990 con 0x7f2050071c70 2023-07-21T22:13:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f204cff9700 1 -- 172.21.15.49:0/280391002 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038011d40 con 0x7f2050071c70 2023-07-21T22:13:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f20549af700 1 -- 172.21.15.49:0/280391002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20500cd130 con 0x7f2050071c70 2023-07-21T22:13:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.425+0000 7f20549af700 1 -- 172.21.15.49:0/280391002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20500cd6f0 con 0x7f2050071c70 2023-07-21T22:13:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.429+0000 7f20549af700 1 -- 172.21.15.49:0/280391002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205004dcb0 con 0x7f2050071c70 2023-07-21T22:13:51.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.429+0000 7f204cff9700 1 -- 172.21.15.49:0/280391002 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f203801a400 con 0x7f2050071c70 2023-07-21T22:13:51.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.433+0000 7f204cff9700 1 --2- 172.21.15.49:0/280391002 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f20300662f0 0x7f20300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:51.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.433+0000 7f204cff9700 1 -- 172.21.15.49:0/280391002 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2038083b40 con 0x7f2050071c70 2023-07-21T22:13:51.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.433+0000 7f204f7fe700 1 --2- 172.21.15.49:0/280391002 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f20300662f0 0x7f20300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:51.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.433+0000 7f204f7fe700 1 --2- 172.21.15.49:0/280391002 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f20300662f0 0x7f20300687a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2040009910 tx=0x7f2040008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:51.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.437+0000 7f204cff9700 1 -- 172.21.15.49:0/280391002 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2038050df0 con 0x7f2050071c70 2023-07-21T22:13:51.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.645+0000 7f20549af700 1 -- 172.21.15.49:0/280391002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20500b3ff0 con 0x7f2050071c70 2023-07-21T22:13:51.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.645+0000 7f204cff9700 1 -- 172.21.15.49:0/280391002 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4678 (secure 0 0 0) 0x7f2038015020 con 0x7f2050071c70 2023-07-21T22:13:51.690 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:51.691 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3145882220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3145882220},{"type":"v1","addr":"172.21.15.150:6834","nonce":3145882220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5657,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2809854510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2809854510},{"type":"v1","addr":"172.21.15.150:6835","nonce":2809854510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1044407594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1044407594},{"type":"v1","addr":"172.21.15.49:6837","nonce":1044407594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:13:40.538282+0000","modified":"2023-07-21T22:13:44.115111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6396":{"gid":6396,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6836/4142505890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4142505890},{"type":"v1","addr":"172.21.15.49:6836","nonce":4142505890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T22:13:51.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.649+0000 7f20549af700 1 -- 172.21.15.49:0/280391002 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f20300662f0 msgr2=0x7f20300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:51.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.649+0000 7f20549af700 1 --2- 172.21.15.49:0/280391002 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f20300662f0 0x7f20300687a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2040009910 tx=0x7f2040008030 comp rx=0 tx=0).stop 2023-07-21T22:13:51.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.649+0000 7f20549af700 1 -- 172.21.15.49:0/280391002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050071c70 msgr2=0x7f20500b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:51.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.649+0000 7f20549af700 1 --2- 172.21.15.49:0/280391002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050071c70 0x7f20500b2460 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f203800b4a0 tx=0x7f203800b7b0 comp rx=0 tx=0).stop 2023-07-21T22:13:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.649+0000 7f20549af700 1 -- 172.21.15.49:0/280391002 shutdown_connections 2023-07-21T22:13:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.649+0000 7f20549af700 1 --2- 172.21.15.49:0/280391002 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f20300662f0 0x7f20300687a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.649+0000 7f20549af700 1 --2- 172.21.15.49:0/280391002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050071c70 0x7f20500b2460 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.649+0000 7f20549af700 1 --2- 172.21.15.49:0/280391002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20500cafb0 0x7f20500b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.649+0000 7f20549af700 1 --2- 172.21.15.49:0/280391002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205006d380 0x7f2050149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.649+0000 7f20549af700 1 -- 172.21.15.49:0/280391002 >> 172.21.15.49:0/280391002 conn(0x7f2050070450 msgr2=0x7f20500b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.649+0000 7f20549af700 1 -- 172.21.15.49:0/280391002 shutdown_connections 2023-07-21T22:13:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:51.649+0000 7f20549af700 1 -- 172.21.15.49:0/280391002 wait complete. 2023-07-21T22:13:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2023-07-21T22:13:52.120 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:13:40.538282+0000', 'modified': '2023-07-21T22:13:44.115111+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6396}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6396': {'gid': 6396, 'name': 'c', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6836/4142505890', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 4142505890}, {'type': 'v1', 'addr': '172.21.15.49:6836', 'nonce': 4142505890}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:13:52.121 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:13:52.121 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-21T22:13:52.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.265+0000 7f80f5627700 1 Processor -- start 2023-07-21T22:13:52.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.265+0000 7f80f5627700 1 -- start start 2023-07-21T22:13:52.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.265+0000 7f80f5627700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80f006d380 0x7f80f006d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.265+0000 7f80f5627700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f80f00cafb0 0x7f80f00cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.265+0000 7f80f5627700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f00cb940 con 0x7f80f0071c70 2023-07-21T22:13:52.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.265+0000 7f80f5627700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f00c9e80 con 0x7f80f00cafb0 2023-07-21T22:13:52.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.265+0000 7f80f5627700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00afeb0 con 0x7f80f006d380 2023-07-21T22:13:52.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80f4e26700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f80f00cafb0 0x7f80f00cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80e7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f80f0071c70 0x7f80f00b0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33798/0 (socket says 172.21.15.49:33798) 2023-07-21T22:13:52.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80e7fff700 1 -- 172.21.15.49:0/440894173 learned_addr learned my addr 172.21.15.49:0/440894173 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:52.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80effff700 1 --2- 172.21.15.49:0/440894173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80f006d380 0x7f80f006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80f4e26700 1 -- 172.21.15.49:0/440894173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80f006d380 msgr2=0x7f80f006d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:52.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80f4e26700 1 --2- 172.21.15.49:0/440894173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80f006d380 0x7f80f006d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80f4e26700 1 -- 172.21.15.49:0/440894173 >> v1:172.21.15.49:6789/0 conn(0x7f80f0071c70 legacy=0x7f80f00b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80f4e26700 1 -- 172.21.15.49:0/440894173 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f00cab20 con 0x7f80f00cafb0 2023-07-21T22:13:52.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80f4e26700 1 --2- 172.21.15.49:0/440894173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f00cafb0 0x7f80f00cb400 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009d90 tx=0x7f80e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efacc9fcb366e46 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:52.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80ef7fe700 1 -- 172.21.15.49:0/440894173 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e800e070 con 0x7f80f00cafb0 2023-07-21T22:13:52.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80ef7fe700 1 -- 172.21.15.49:0/440894173 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e800bbd0 con 0x7f80f00cafb0 2023-07-21T22:13:52.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80ef7fe700 1 -- 172.21.15.49:0/440894173 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8012430 con 0x7f80f00cafb0 2023-07-21T22:13:52.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80f5627700 1 -- 172.21.15.49:0/440894173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f00cafb0 msgr2=0x7f80f00cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80f5627700 1 --2- 172.21.15.49:0/440894173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f00cafb0 0x7f80f00cb400 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009d90 tx=0x7f80e800b330 comp rx=0 tx=0).stop 2023-07-21T22:13:52.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80f5627700 1 -- 172.21.15.49:0/440894173 shutdown_connections 2023-07-21T22:13:52.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80f5627700 1 --2- 172.21.15.49:0/440894173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f00cafb0 0x7f80f00cb400 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80f5627700 1 --2- 172.21.15.49:0/440894173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80f006d380 0x7f80f006d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80f5627700 1 -- 172.21.15.49:0/440894173 >> 172.21.15.49:0/440894173 conn(0x7f80f0070450 msgr2=0x7f80f0070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:52.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80f5627700 1 -- 172.21.15.49:0/440894173 shutdown_connections 2023-07-21T22:13:52.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.269+0000 7f80f5627700 1 -- 172.21.15.49:0/440894173 wait complete. 2023-07-21T22:13:52.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.273+0000 7f80f5627700 1 Processor -- start 2023-07-21T22:13:52.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80f5627700 1 -- start start 2023-07-21T22:13:52.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80f5627700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80f006d380 0x7f80f014a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80f5627700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f0071c70 0x7f80f0146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80f5627700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80f00cafb0 0x7f80f0148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80f5627700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0148920 con 0x7f80f0071c70 2023-07-21T22:13:52.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80f5627700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f01492f0 con 0x7f80f006d380 2023-07-21T22:13:52.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80f5627700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0147d10 con 0x7f80f00cafb0 2023-07-21T22:13:52.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f0071c70 0x7f80f0146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f0071c70 0x7f80f0146e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54660/0 (socket says 172.21.15.49:54660) 2023-07-21T22:13:52.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80e7fff700 1 -- 172.21.15.49:0/1076670199 learned_addr learned my addr 172.21.15.49:0/1076670199 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:52.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80effff700 1 --2- 172.21.15.49:0/1076670199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80f006d380 0x7f80f014a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80f4e26700 1 --2- 172.21.15.49:0/1076670199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80f00cafb0 0x7f80f0148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80e7fff700 1 -- 172.21.15.49:0/1076670199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80f00cafb0 msgr2=0x7f80f0148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80e7fff700 1 --2- 172.21.15.49:0/1076670199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80f00cafb0 0x7f80f0148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80e7fff700 1 -- 172.21.15.49:0/1076670199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80f006d380 msgr2=0x7f80f014a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80e7fff700 1 --2- 172.21.15.49:0/1076670199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80f006d380 0x7f80f014a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80e7fff700 1 -- 172.21.15.49:0/1076670199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e8009a70 con 0x7f80f0071c70 2023-07-21T22:13:52.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80e7fff700 1 --2- 172.21.15.49:0/1076670199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f0071c70 0x7f80f0146e20 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f80d800c700 tx=0x7f80d800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:52.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80ed7fa700 1 -- 172.21.15.49:0/1076670199 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8005d90 con 0x7f80f0071c70 2023-07-21T22:13:52.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80ed7fa700 1 -- 172.21.15.49:0/1076670199 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d80070d0 con 0x7f80f0071c70 2023-07-21T22:13:52.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.277+0000 7f80ed7fa700 1 -- 172.21.15.49:0/1076670199 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8007440 con 0x7f80f0071c70 2023-07-21T22:13:52.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.281+0000 7f80f5627700 1 -- 172.21.15.49:0/1076670199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f0147ff0 con 0x7f80f0071c70 2023-07-21T22:13:52.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.281+0000 7f80f5627700 1 -- 172.21.15.49:0/1076670199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f01485b0 con 0x7f80f0071c70 2023-07-21T22:13:52.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.281+0000 7f80ed7fa700 1 -- 172.21.15.49:0/1076670199 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f80d80075a0 con 0x7f80f0071c70 2023-07-21T22:13:52.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.285+0000 7f80ed7fa700 1 --2- 172.21.15.49:0/1076670199 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f80d00662f0 0x7f80d00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.285+0000 7f80ed7fa700 1 -- 172.21.15.49:0/1076670199 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f80d8083100 con 0x7f80f0071c70 2023-07-21T22:13:52.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.285+0000 7f80effff700 1 --2- 172.21.15.49:0/1076670199 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f80d00662f0 0x7f80d00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.285+0000 7f80effff700 1 --2- 172.21.15.49:0/1076670199 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f80d00662f0 0x7f80d00687a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f80e0007a60 tx=0x7f80e0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:52.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.285+0000 7f80f9b11740 1 Processor -- start 2023-07-21T22:13:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 -- start start 2023-07-21T22:13:52.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32eb0 0x21ebfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21ec500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32710 0x21eca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x20bf270 con 0x1f32ae0 2023-07-21T22:13:52.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x21123a0 con 0x1f32710 2023-07-21T22:13:52.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x210b600 con 0x1f32eb0 2023-07-21T22:13:52.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21ec500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21ec500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54672/0 (socket says 172.21.15.49:54672) 2023-07-21T22:13:52.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80e7fff700 1 -- 172.21.15.49:0/3963141571 learned_addr learned my addr 172.21.15.49:0/3963141571 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:52.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80effff700 1 --2- 172.21.15.49:0/3963141571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32eb0 0x21ebfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f4e26700 1 --2- 172.21.15.49:0/3963141571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32710 0x21eca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80e7fff700 1 -- 172.21.15.49:0/3963141571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32eb0 msgr2=0x21ebfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:52.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80e7fff700 1 --2- 172.21.15.49:0/3963141571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32eb0 0x21ebfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80e7fff700 1 -- 172.21.15.49:0/3963141571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32710 msgr2=0x21eca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:52.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80e7fff700 1 --2- 172.21.15.49:0/3963141571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32710 0x21eca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80e7fff700 1 -- 172.21.15.49:0/3963141571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f7e9e0 con 0x1f32ae0 2023-07-21T22:13:52.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f4e26700 1 --2- 172.21.15.49:0/3963141571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32710 0x21eca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:52.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80e7fff700 1 --2- 172.21.15.49:0/3963141571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21ec500 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f80d80812f0 tx=0x7f80d8053b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95621d8263b63fa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:52.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80e5ffb700 1 -- 172.21.15.49:0/3963141571 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d805c440 con 0x1f32ae0 2023-07-21T22:13:52.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80e5ffb700 1 -- 172.21.15.49:0/3963141571 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d8052540 con 0x1f32ae0 2023-07-21T22:13:52.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80e5ffb700 1 -- 172.21.15.49:0/3963141571 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d805c1b0 con 0x1f32ae0 2023-07-21T22:13:52.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 -- 172.21.15.49:0/3963141571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 msgr2=0x21ec500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 --2- 172.21.15.49:0/3963141571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21ec500 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f80d80812f0 tx=0x7f80d8053b00 comp rx=0 tx=0).stop 2023-07-21T22:13:52.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 -- 172.21.15.49:0/3963141571 shutdown_connections 2023-07-21T22:13:52.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 --2- 172.21.15.49:0/3963141571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21ec500 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 --2- 172.21.15.49:0/3963141571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32710 0x21eca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 --2- 172.21.15.49:0/3963141571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32eb0 0x21ebfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 -- 172.21.15.49:0/3963141571 >> 172.21.15.49:0/3963141571 conn(0x219cb60 msgr2=0x21a6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:52.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 -- 172.21.15.49:0/3963141571 shutdown_connections 2023-07-21T22:13:52.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.289+0000 7f80f9b11740 1 -- 172.21.15.49:0/3963141571 wait complete. 2023-07-21T22:13:52.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80f9b11740 1 -- start start 2023-07-21T22:13:52.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80f9b11740 1 Processor -- start 2023-07-21T22:13:52.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80f9b11740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32710 0x21d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80f9b11740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80f9b11740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32eb0 0x21ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80f9b11740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x20cdb00 con 0x1f32ae0 2023-07-21T22:13:52.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80f9b11740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x20cc470 con 0x1f32710 2023-07-21T22:13:52.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80f9b11740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fb7b20 con 0x1f32eb0 2023-07-21T22:13:52.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80f9b11740 10 client.0 _ll_register_callbacks cb 0x2131530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:13:52.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80effff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32710 0x21d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21a6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54680/0 (socket says 172.21.15.49:54680) 2023-07-21T22:13:52.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80e7fff700 1 -- 172.21.15.49:0/1850674468 learned_addr learned my addr 172.21.15.49:0/1850674468 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:52.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80f4e26700 1 --2- 172.21.15.49:0/1850674468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32eb0 0x21ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80effff700 1 -- 172.21.15.49:0/1850674468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32eb0 msgr2=0x21ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:52.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80effff700 1 --2- 172.21.15.49:0/1850674468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32eb0 0x21ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80effff700 1 -- 172.21.15.49:0/1850674468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 msgr2=0x21a6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:52.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80effff700 1 --2- 172.21.15.49:0/1850674468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21a6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80effff700 1 -- 172.21.15.49:0/1850674468 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f01485b0 con 0x1f32710 2023-07-21T22:13:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80e7fff700 1 --2- 172.21.15.49:0/1850674468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.293+0000 7f80f4e26700 1 --2- 172.21.15.49:0/1850674468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32eb0 0x21ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80effff700 1 --2- 172.21.15.49:0/1850674468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32710 0x21d1ea0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f80e0006f30 tx=0x7f80e00047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e117083fda0b12 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2023-07-21T22:13:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80ceffd700 1 -- 172.21.15.49:0/1850674468 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e00076f0 con 0x1f32710 2023-07-21T22:13:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80ceffd700 1 -- 172.21.15.49:0/1850674468 <== mon.1 v2:172.21.15.150:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f80e0004030 con 0x1f32710 2023-07-21T22:13:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80f9b11740 1 -- 172.21.15.49:0/1850674468 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x21045e0 con 0x1f32710 2023-07-21T22:13:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80ceffd700 1 -- 172.21.15.49:0/1850674468 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80e0010e90 con 0x1f32710 2023-07-21T22:13:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80f9b11740 10 client.6379 fetch_fsmap learned FSMap version 26 2023-07-21T22:13:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80f9b11740 1 -- 172.21.15.49:0/1850674468 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x20d1250 con 0x1f32710 2023-07-21T22:13:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80ceffd700 1 -- 172.21.15.49:0/1850674468 <== mon.1 v2:172.21.15.150:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x21045e0 con 0x1f32710 2023-07-21T22:13:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80ceffd700 1 -- 172.21.15.49:0/1850674468 <== mon.1 v2:172.21.15.150:3300/0 5 ==== fsmap(e 26) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f80e0029060 con 0x1f32710 2023-07-21T22:13:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80f9b11740 10 client.6379 fetch_fsmap finished waiting for FSMap version 26 2023-07-21T22:13:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80f9b11740 10 client.6379 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-21T22:13:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80f9b11740 20 client.6379 populate_metadata read hostname 'smithi049' 2023-07-21T22:13:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80f9b11740 1 --2- 172.21.15.49:0/1850674468 >> [v2:172.21.15.49:6834/4142505890,v1:172.21.15.49:6836/4142505890] conn(0x1f7d790 0x21a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80f9b11740 4 client.6379 mds_command: new command op to 6396 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:13:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80f9b11740 1 -- 172.21.15.49:0/1850674468 --> [v2:172.21.15.49:6834/4142505890,v1:172.21.15.49:6836/4142505890] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2104300 con 0x1f7d790 2023-07-21T22:13:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80e7fff700 1 --2- 172.21.15.49:0/1850674468 >> [v2:172.21.15.49:6834/4142505890,v1:172.21.15.49:6836/4142505890] conn(0x1f7d790 0x21a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80ceffd700 10 client.6379 ms_handle_connect on v2:172.21.15.49:6834/4142505890 2023-07-21T22:13:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.297+0000 7f80e7fff700 1 --2- 172.21.15.49:0/1850674468 >> [v2:172.21.15.49:6834/4142505890,v1:172.21.15.49:6836/4142505890] conn(0x1f7d790 0x21a5360 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ededb30769565cdc server_cookie=6697b7da4af1647e in_seq=0 out_seq=0 2023-07-21T22:13:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80ceffd700 1 -- 172.21.15.49:0/1850674468 <== mds.0 v2:172.21.15.49:6834/4142505890 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x2104300 con 0x1f7d790 2023-07-21T22:13:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80ceffd700 10 client.6379 handle_command_reply: tid=0 2023-07-21T22:13:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80f9b11740 1 client.6379 shutdown 2023-07-21T22:13:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80f9b11740 1 -- 172.21.15.49:0/1850674468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32710 msgr2=0x21d1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80f9b11740 1 --2- 172.21.15.49:0/1850674468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32710 0x21d1ea0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f80e0006f30 tx=0x7f80e00047e0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80f9b11740 1 -- 172.21.15.49:0/1850674468 shutdown_connections 2023-07-21T22:13:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80f9b11740 1 --2- 172.21.15.49:0/1850674468 >> [v2:172.21.15.49:6834/4142505890,v1:172.21.15.49:6836/4142505890] conn(0x1f7d790 0x21a5360 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80f9b11740 1 --2- 172.21.15.49:0/1850674468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80f9b11740 1 --2- 172.21.15.49:0/1850674468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32eb0 0x21ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80ceffd700 0 client.6379 ms_handle_reset on v2:172.21.15.49:6834/4142505890 2023-07-21T22:13:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80f9b11740 1 --2- 172.21.15.49:0/1850674468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32710 0x21d1ea0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80f9b11740 1 -- 172.21.15.49:0/1850674468 >> 172.21.15.49:0/1850674468 conn(0x219cb60 msgr2=0x21cd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80f9b11740 1 -- 172.21.15.49:0/1850674468 shutdown_connections 2023-07-21T22:13:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80f9b11740 1 -- 172.21.15.49:0/1850674468 wait complete. 2023-07-21T22:13:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.301+0000 7f80f9b11740 20 client.6379 trim_cache size 0 max 16384 2023-07-21T22:13:52.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.321+0000 7f80f9b11740 1 Processor -- start 2023-07-21T22:13:52.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.321+0000 7f80f9b11740 1 -- start start 2023-07-21T22:13:52.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32710 0x21ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32ae0 0x21a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32eb0 0x21a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x20b1330 con 0x1f32eb0 2023-07-21T22:13:52.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x20dad50 con 0x1f32ae0 2023-07-21T22:13:52.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x2108a00 con 0x1f32710 2023-07-21T22:13:52.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f4e26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32eb0 0x21a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80e7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32ae0 0x21a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f4e26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32eb0 0x21a19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54690/0 (socket says 172.21.15.49:54690) 2023-07-21T22:13:52.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80e7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32ae0 0x21a14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:57632/0 (socket says 172.21.15.49:57632) 2023-07-21T22:13:52.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f4e26700 1 -- 172.21.15.49:0/772241924 learned_addr learned my addr 172.21.15.49:0/772241924 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:52.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80effff700 1 --2- 172.21.15.49:0/772241924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32710 0x21ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80e7fff700 1 -- 172.21.15.49:0/772241924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32710 msgr2=0x21ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:52.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80e7fff700 1 --2- 172.21.15.49:0/772241924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32710 0x21ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80e7fff700 1 -- 172.21.15.49:0/772241924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32eb0 msgr2=0x21a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:52.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80e7fff700 1 --2- 172.21.15.49:0/772241924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32eb0 0x21a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80e7fff700 1 -- 172.21.15.49:0/772241924 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f0147820 con 0x1f32ae0 2023-07-21T22:13:52.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80e7fff700 1 --2- 172.21.15.49:0/772241924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32ae0 0x21a14a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f80d8007fd0 tx=0x7f80d8072040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7498e025ef1c18b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:52.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80e67fc700 1 -- 172.21.15.49:0/772241924 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d80810c0 con 0x1f32ae0 2023-07-21T22:13:52.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80e67fc700 1 -- 172.21.15.49:0/772241924 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d80720b0 con 0x1f32ae0 2023-07-21T22:13:52.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80e67fc700 1 -- 172.21.15.49:0/772241924 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d805c1b0 con 0x1f32ae0 2023-07-21T22:13:52.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 -- 172.21.15.49:0/772241924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32ae0 msgr2=0x21a14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 --2- 172.21.15.49:0/772241924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32ae0 0x21a14a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f80d8007fd0 tx=0x7f80d8072040 comp rx=0 tx=0).stop 2023-07-21T22:13:52.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 -- 172.21.15.49:0/772241924 shutdown_connections 2023-07-21T22:13:52.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 --2- 172.21.15.49:0/772241924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32eb0 0x21a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 --2- 172.21.15.49:0/772241924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32ae0 0x21a14a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 --2- 172.21.15.49:0/772241924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32710 0x21ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 -- 172.21.15.49:0/772241924 >> 172.21.15.49:0/772241924 conn(0x219cb60 msgr2=0x21c9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:52.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 -- 172.21.15.49:0/772241924 shutdown_connections 2023-07-21T22:13:52.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.325+0000 7f80f9b11740 1 -- 172.21.15.49:0/772241924 wait complete. 2023-07-21T22:13:52.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80f9b11740 1 -- start start 2023-07-21T22:13:52.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80f9b11740 1 Processor -- start 2023-07-21T22:13:52.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80f9b11740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32710 0x224bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80f9b11740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21feec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80f9b11740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32eb0 0x21ffb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80f9b11740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2113630 con 0x1f32ae0 2023-07-21T22:13:52.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80f9b11740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x2108e10 con 0x1f32eb0 2023-07-21T22:13:52.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80f9b11740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x21a7730 con 0x1f32710 2023-07-21T22:13:52.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80f9b11740 10 client.0 _ll_register_callbacks cb 0x20dac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:13:52.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21feec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21feec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54698/0 (socket says 172.21.15.49:54698) 2023-07-21T22:13:52.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80e7fff700 1 -- 172.21.15.49:0/564574376 learned_addr learned my addr 172.21.15.49:0/564574376 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:52.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80f4e26700 1 --2- 172.21.15.49:0/564574376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32eb0 0x21ffb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80effff700 1 --2- 172.21.15.49:0/564574376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32710 0x224bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80e7fff700 1 -- 172.21.15.49:0/564574376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32710 msgr2=0x224bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:52.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80e7fff700 1 --2- 172.21.15.49:0/564574376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32710 0x224bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80e7fff700 1 -- 172.21.15.49:0/564574376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32eb0 msgr2=0x21ffb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:52.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80e7fff700 1 --2- 172.21.15.49:0/564574376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32eb0 0x21ffb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80e7fff700 1 -- 172.21.15.49:0/564574376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1f7e9e0 con 0x1f32ae0 2023-07-21T22:13:52.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80e7fff700 1 --2- 172.21.15.49:0/564574376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21feec0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f80d80506a0 tx=0x7f80d8001e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b9f7593954b8d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:52.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.329+0000 7f80ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-07-21T22:13:52.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80ceffd700 1 -- 172.21.15.49:0/564574376 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d805c1b0 con 0x1f32ae0 2023-07-21T22:13:52.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 -- 172.21.15.49:0/564574376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f80d8052540 con 0x1f32ae0 2023-07-21T22:13:52.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80ceffd700 1 -- 172.21.15.49:0/564574376 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f80d807ce10 con 0x1f32ae0 2023-07-21T22:13:52.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80ceffd700 1 -- 172.21.15.49:0/564574376 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80d80810c0 con 0x1f32ae0 2023-07-21T22:13:52.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 10 client.6588 fetch_fsmap learned FSMap version 26 2023-07-21T22:13:52.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 -- 172.21.15.49:0/564574376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x20b75c0 con 0x1f32ae0 2023-07-21T22:13:52.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80ceffd700 1 -- 172.21.15.49:0/564574376 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d8052540 con 0x1f32ae0 2023-07-21T22:13:52.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80ceffd700 1 -- 172.21.15.49:0/564574376 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f80d804ff90 con 0x1f32ae0 2023-07-21T22:13:52.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 10 client.6588 fetch_fsmap finished waiting for FSMap version 26 2023-07-21T22:13:52.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 10 client.6588 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-21T22:13:52.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 20 client.6588 populate_metadata read hostname 'smithi049' 2023-07-21T22:13:52.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 --2- 172.21.15.49:0/564574376 >> [v2:172.21.15.49:6834/4142505890,v1:172.21.15.49:6836/4142505890] conn(0x22013a0 0x2201770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 4 client.6588 mds_command: new command op to 6396 tid=0[{"prefix": "status"}] 2023-07-21T22:13:52.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 -- 172.21.15.49:0/564574376 --> [v2:172.21.15.49:6834/4142505890,v1:172.21.15.49:6836/4142505890] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1f8a4e0 con 0x22013a0 2023-07-21T22:13:52.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80effff700 1 --2- 172.21.15.49:0/564574376 >> [v2:172.21.15.49:6834/4142505890,v1:172.21.15.49:6836/4142505890] conn(0x22013a0 0x2201770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80effff700 1 --2- 172.21.15.49:0/564574376 >> [v2:172.21.15.49:6834/4142505890,v1:172.21.15.49:6836/4142505890] conn(0x22013a0 0x2201770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=579bf265a01f624d server_cookie=4756f04d9c1a6ead in_seq=0 out_seq=0 2023-07-21T22:13:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80ceffd700 10 client.6588 ms_handle_connect on v2:172.21.15.49:6834/4142505890 2023-07-21T22:13:52.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80ceffd700 1 -- 172.21.15.49:0/564574376 <== mds.0 v2:172.21.15.49:6834/4142505890 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x1f8a4e0 con 0x22013a0 2023-07-21T22:13:52.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80ceffd700 10 client.6588 handle_command_reply: tid=0 2023-07-21T22:13:52.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 client.6588 shutdown 2023-07-21T22:13:52.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 -- 172.21.15.49:0/564574376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 msgr2=0x21feec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 --2- 172.21.15.49:0/564574376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21feec0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f80d80506a0 tx=0x7f80d8001e40 comp rx=0 tx=0).stop 2023-07-21T22:13:52.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 -- 172.21.15.49:0/564574376 shutdown_connections 2023-07-21T22:13:52.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 --2- 172.21.15.49:0/564574376 >> [v2:172.21.15.49:6834/4142505890,v1:172.21.15.49:6836/4142505890] conn(0x22013a0 0x2201770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 --2- 172.21.15.49:0/564574376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f32ae0 0x21feec0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 --2- 172.21.15.49:0/564574376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x1f32eb0 0x21ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 --2- 172.21.15.49:0/564574376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x1f32710 0x224bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80ceffd700 0 client.6588 ms_handle_reset on v2:172.21.15.49:6834/4142505890 2023-07-21T22:13:52.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 -- 172.21.15.49:0/564574376 >> 172.21.15.49:0/564574376 conn(0x219cb60 msgr2=0x21a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:52.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 -- 172.21.15.49:0/564574376 shutdown_connections 2023-07-21T22:13:52.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.333+0000 7f80f9b11740 1 -- 172.21.15.49:0/564574376 wait complete. 2023-07-21T22:13:52.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.337+0000 7f80f9b11740 20 client.6588 trim_cache size 0 max 16384 2023-07-21T22:13:52.389 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:13:52.389 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "c1346180-e695-42c2-8f5b-b72be8101116", 2023-07-21T22:13:52.389 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-07-21T22:13:52.389 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6396, 2023-07-21T22:13:52.389 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-07-21T22:13:52.390 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-07-21T22:13:52.390 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-07-21T22:13:52.390 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 11.243166462, 2023-07-21T22:13:52.390 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 26, 2023-07-21T22:13:52.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 62, 2023-07-21T22:13:52.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 62, 2023-07-21T22:13:52.390 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 17.503317908 2023-07-21T22:13:52.391 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:13:52.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.337+0000 7f80f5627700 1 -- 172.21.15.49:0/1076670199 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f80d00662f0 msgr2=0x7f80d00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.337+0000 7f80f5627700 1 --2- 172.21.15.49:0/1076670199 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f80d00662f0 0x7f80d00687a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f80e0007a60 tx=0x7f80e0008040 comp rx=0 tx=0).stop 2023-07-21T22:13:52.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.337+0000 7f80f5627700 1 -- 172.21.15.49:0/1076670199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f0071c70 msgr2=0x7f80f0146e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.337+0000 7f80f5627700 1 --2- 172.21.15.49:0/1076670199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f0071c70 0x7f80f0146e20 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f80d800c700 tx=0x7f80d800ca10 comp rx=0 tx=0).stop 2023-07-21T22:13:52.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.337+0000 7f80f5627700 1 -- 172.21.15.49:0/1076670199 shutdown_connections 2023-07-21T22:13:52.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.337+0000 7f80f5627700 1 --2- 172.21.15.49:0/1076670199 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f80d00662f0 0x7f80d00687a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.337+0000 7f80f5627700 1 --2- 172.21.15.49:0/1076670199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f0071c70 0x7f80f0146e20 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.337+0000 7f80f5627700 1 --2- 172.21.15.49:0/1076670199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80f00cafb0 0x7f80f0148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.337+0000 7f80f5627700 1 --2- 172.21.15.49:0/1076670199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80f006d380 0x7f80f014a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.337+0000 7f80f5627700 1 -- 172.21.15.49:0/1076670199 >> 172.21.15.49:0/1076670199 conn(0x7f80f0070450 msgr2=0x7f80f00b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:52.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.337+0000 7f80f5627700 1 -- 172.21.15.49:0/1076670199 shutdown_connections 2023-07-21T22:13:52.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.337+0000 7f80f5627700 1 -- 172.21.15.49:0/1076670199 wait complete. 2023-07-21T22:13:52.404 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:13:52.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.541+0000 7fe1331e3700 1 Processor -- start 2023-07-21T22:13:52.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.541+0000 7fe1331e3700 1 -- start start 2023-07-21T22:13:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.541+0000 7fe1331e3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe12c15bf30 0x7fe12c0ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.541+0000 7fe1331e3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe12c0b0200 0x7fe12c0ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.541+0000 7fe1331e3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12c0cb270 con 0x7fe12c0cbc40 2023-07-21T22:13:52.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.541+0000 7fe1331e3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12c15c300 con 0x7fe12c0b0200 2023-07-21T22:13:52.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.541+0000 7fe1331e3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0acac0 con 0x7fe12c15bf30 2023-07-21T22:13:52.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1329e2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe12c0b0200 0x7fe12c0ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1319e0700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe12c0cbc40 0x7fe12c0afaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33810/0 (socket says 172.21.15.49:33810) 2023-07-21T22:13:52.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1319e0700 1 -- 172.21.15.49:0/3930127128 learned_addr learned my addr 172.21.15.49:0/3930127128 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:52.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1321e1700 1 --2- 172.21.15.49:0/3930127128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe12c15bf30 0x7fe12c0ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1329e2700 1 -- 172.21.15.49:0/3930127128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe12c15bf30 msgr2=0x7fe12c0ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:52.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1329e2700 1 --2- 172.21.15.49:0/3930127128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe12c15bf30 0x7fe12c0ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1329e2700 1 -- 172.21.15.49:0/3930127128 >> v1:172.21.15.49:6789/0 conn(0x7fe12c0cbc40 legacy=0x7fe12c0afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1329e2700 1 -- 172.21.15.49:0/3930127128 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c06f740 con 0x7fe12c0b0200 2023-07-21T22:13:52.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1329e2700 1 --2- 172.21.15.49:0/3930127128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0b0200 0x7fe12c0ab8d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe124009d90 tx=0x7fe12400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd52304e68b2174 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:52.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1311df700 1 -- 172.21.15.49:0/3930127128 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12400e070 con 0x7fe12c0b0200 2023-07-21T22:13:52.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1311df700 1 -- 172.21.15.49:0/3930127128 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12400bb20 con 0x7fe12c0b0200 2023-07-21T22:13:52.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1311df700 1 -- 172.21.15.49:0/3930127128 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124012430 con 0x7fe12c0b0200 2023-07-21T22:13:52.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1331e3700 1 -- 172.21.15.49:0/3930127128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0b0200 msgr2=0x7fe12c0ab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1331e3700 1 --2- 172.21.15.49:0/3930127128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0b0200 0x7fe12c0ab8d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe124009d90 tx=0x7fe12400b330 comp rx=0 tx=0).stop 2023-07-21T22:13:52.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1331e3700 1 -- 172.21.15.49:0/3930127128 shutdown_connections 2023-07-21T22:13:52.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.545+0000 7fe1331e3700 1 --2- 172.21.15.49:0/3930127128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0b0200 0x7fe12c0ab8d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.549+0000 7fe1331e3700 1 --2- 172.21.15.49:0/3930127128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe12c15bf30 0x7fe12c0ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.549+0000 7fe1331e3700 1 -- 172.21.15.49:0/3930127128 >> 172.21.15.49:0/3930127128 conn(0x7fe12c070450 msgr2=0x7fe12c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:52.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.549+0000 7fe1331e3700 1 -- 172.21.15.49:0/3930127128 shutdown_connections 2023-07-21T22:13:52.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.549+0000 7fe1331e3700 1 -- 172.21.15.49:0/3930127128 wait complete. 2023-07-21T22:13:52.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.549+0000 7fe1331e3700 1 Processor -- start 2023-07-21T22:13:52.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.549+0000 7fe1331e3700 1 -- start start 2023-07-21T22:13:52.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1331e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0b0200 0x7fe12c1f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1331e3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe12c0cbc40 0x7fe12c0c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1331e3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe12c15bf30 0x7fe12c0b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1331e3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0c4840 con 0x7fe12c0b0200 2023-07-21T22:13:52.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1331e3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c1f2bb0 con 0x7fe12c15bf30 2023-07-21T22:13:52.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1331e3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0c3be0 con 0x7fe12c0cbc40 2023-07-21T22:13:52.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1321e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0b0200 0x7fe12c1f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1321e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0b0200 0x7fe12c1f2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54716/0 (socket says 172.21.15.49:54716) 2023-07-21T22:13:52.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1321e1700 1 -- 172.21.15.49:0/3661956439 learned_addr learned my addr 172.21.15.49:0/3661956439 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:52.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1319e0700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe12c0cbc40 0x7fe12c0c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1321e1700 1 -- 172.21.15.49:0/3661956439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe12c0cbc40 msgr2=0x7fe12c0c36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1329e2700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe12c15bf30 0x7fe12c0b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1321e1700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe12c0cbc40 0x7fe12c0c36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1321e1700 1 -- 172.21.15.49:0/3661956439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe12c15bf30 msgr2=0x7fe12c0b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1321e1700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe12c15bf30 0x7fe12c0b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1321e1700 1 -- 172.21.15.49:0/3661956439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe124009a70 con 0x7fe12c0b0200 2023-07-21T22:13:52.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1329e2700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe12c15bf30 0x7fe12c0b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:52.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1319e0700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe12c0cbc40 0x7fe12c0c36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:52.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1321e1700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0b0200 0x7fe12c1f2670 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe12800e9d0 tx=0x7fe12800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:52.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe122ffd700 1 -- 172.21.15.49:0/3661956439 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128009720 con 0x7fe12c0b0200 2023-07-21T22:13:52.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe122ffd700 1 -- 172.21.15.49:0/3661956439 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12800c850 con 0x7fe12c0b0200 2023-07-21T22:13:52.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1331e3700 1 -- 172.21.15.49:0/3661956439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12c0b13d0 con 0x7fe12c0b0200 2023-07-21T22:13:52.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe122ffd700 1 -- 172.21.15.49:0/3661956439 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12800cbc0 con 0x7fe12c0b0200 2023-07-21T22:13:52.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.553+0000 7fe1331e3700 1 -- 172.21.15.49:0/3661956439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12c0b1990 con 0x7fe12c0b0200 2023-07-21T22:13:52.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.557+0000 7fe1331e3700 1 -- 172.21.15.49:0/3661956439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12c04dcb0 con 0x7fe12c0b0200 2023-07-21T22:13:52.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.557+0000 7fe122ffd700 1 -- 172.21.15.49:0/3661956439 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe12800cd20 con 0x7fe12c0b0200 2023-07-21T22:13:52.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.557+0000 7fe122ffd700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe1100662f0 0x7fe1100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:52.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.557+0000 7fe122ffd700 1 -- 172.21.15.49:0/3661956439 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe128083f50 con 0x7fe12c0b0200 2023-07-21T22:13:52.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.561+0000 7fe1319e0700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe1100662f0 0x7fe1100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:52.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.561+0000 7fe1319e0700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe1100662f0 0x7fe1100687a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe12c1f62a0 tx=0x7fe11c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:52.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.565+0000 7fe122ffd700 1 -- 172.21.15.49:0/3661956439 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe128054db0 con 0x7fe12c0b0200 2023-07-21T22:13:52.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.773+0000 7fe1331e3700 1 -- 172.21.15.49:0/3661956439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe12c06b770 con 0x7fe12c0b0200 2023-07-21T22:13:52.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.773+0000 7fe122ffd700 1 -- 172.21.15.49:0/3661956439 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe128017070 con 0x7fe12c0b0200 2023-07-21T22:13:52.819 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:13:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.777+0000 7fe1331e3700 1 -- 172.21.15.49:0/3661956439 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe1100662f0 msgr2=0x7fe1100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.777+0000 7fe1331e3700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe1100662f0 0x7fe1100687a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe12c1f62a0 tx=0x7fe11c009040 comp rx=0 tx=0).stop 2023-07-21T22:13:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.777+0000 7fe1331e3700 1 -- 172.21.15.49:0/3661956439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0b0200 msgr2=0x7fe12c1f2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.777+0000 7fe1331e3700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0b0200 0x7fe12c1f2670 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe12800e9d0 tx=0x7fe12800ed90 comp rx=0 tx=0).stop 2023-07-21T22:13:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.777+0000 7fe1331e3700 1 -- 172.21.15.49:0/3661956439 shutdown_connections 2023-07-21T22:13:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.777+0000 7fe1331e3700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe1100662f0 0x7fe1100687a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.777+0000 7fe1331e3700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe12c15bf30 0x7fe12c0b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.777+0000 7fe1331e3700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe12c0cbc40 0x7fe12c0c36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.777+0000 7fe1331e3700 1 --2- 172.21.15.49:0/3661956439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0b0200 0x7fe12c1f2670 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:52.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.777+0000 7fe1331e3700 1 -- 172.21.15.49:0/3661956439 >> 172.21.15.49:0/3661956439 conn(0x7fe12c070450 msgr2=0x7fe12c15a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:52.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.777+0000 7fe1331e3700 1 -- 172.21.15.49:0/3661956439 shutdown_connections 2023-07-21T22:13:52.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:52.777+0000 7fe1331e3700 1 -- 172.21.15.49:0/3661956439 wait complete. 2023-07-21T22:13:52.843 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:13:52.843 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:13:52.844 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-07-21T22:13:52.844 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:13:52.844 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:13:52.844 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:13:52.845 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:13:52.845 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:13:52.845 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:13:52.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:52.846 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-07-21T22:13:52.861 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:13:52.862 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:13:52.862 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:13:52.862 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:52.862 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-07-21T22:13:52.863 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:52.863 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:13:52.863 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:13:52.863 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-07-21T22:13:52.863 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:13:52.863 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:13:52.863 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-07-21T22:13:52.864 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:13:52.864 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:13:52.864 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-07-21T22:13:52.864 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:13:52.864 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42121sec preferred_lft 42121sec 2023-07-21T22:13:52.864 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-07-21T22:13:52.864 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:52.865 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:13:52.865 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:13:52.865 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-07-21T22:13:52.865 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:13:52.865 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:19:e1:20:16 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:13:52.865 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:13:52.866 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:52.866 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:13:52.866 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether aa:11:6f:e1:a1:5e brd ff:ff:ff:ff:ff:ff 2023-07-21T22:13:52.866 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:13:52.866 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:52.866 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec43:77ff:fe1f:6f26/64 scope link 2023-07-21T22:13:52.866 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:52.867 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:13:52.867 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether aa:11:6f:e1:a1:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:13:52.867 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a811:6fff:fee1:a15e/64 scope link 2023-07-21T22:13:52.867 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:52.867 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:13:52.867 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether da:09:9c:11:2a:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:13:52.867 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::d809:9cff:fe11:2aa0/64 scope link 2023-07-21T22:13:52.868 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:13:52.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:52.869 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:13:52.952 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-07-21T22:13:52.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:52.955 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-07-21T22:13:53.020 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-07-21T22:13:53.020 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:13:53.020 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:13:53.021 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:13:53.021 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:13:53.021 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:13:53.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:53.022 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:13:53.022 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:13:53.023 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:13:53.023 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:13:53.024 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:13:53.024 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:13:53.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:53.160 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-07-21T22:13:53.175 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:13:53.175 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:13:53.176 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:13:53.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:53.177 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-07-21T22:13:53.253 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-21T22:13:53.254 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:13:53.254 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:13:53.311 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:13:53.312 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:13:53.312 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:13:53.371 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:13:53.452 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:13:53.452 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:13:53.529 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:13:53.533 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:13:53.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:53.534 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:13:53.593 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-21T22:13:53.594 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-21T22:13:53.643 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:13:53.674 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:13:53.675 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:13:53.745 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:13:53.746 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:13:53.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:53.747 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:13:53.783 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2023-07-21T22:13:53.741+0000 7f9be2198640 -1 init, newargv = 0x55e9e5f1fd50 newargc=15 2023-07-21T22:13:53.784 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[48367]: starting ceph client 2023-07-21T22:13:53.795 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[48367]: starting fuse 2023-07-21T22:13:53.798 INFO:teuthology.orchestra.run.smithi049.stdout:49 2023-07-21T22:13:53.798 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-07-21T22:13:53.799 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T22:13:53.799 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2023-07-21T22:13:53.800 DEBUG:teuthology.orchestra.run.smithi049:> import re 2023-07-21T22:13:53.800 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-07-21T22:13:53.800 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-07-21T22:13:53.801 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:13:53.801 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2023-07-21T22:13:53.801 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-21T22:13:53.802 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2023-07-21T22:13:53.802 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-21T22:13:53.802 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:13:53.802 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2023-07-21T22:13:53.803 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2023-07-21T22:13:53.803 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2023-07-21T22:13:53.803 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2023-07-21T22:13:53.804 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:13:53.804 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2023-07-21T22:13:53.804 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T22:13:53.805 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T22:13:53.805 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T22:13:53.805 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2023-07-21T22:13:53.805 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2023-07-21T22:13:53.806 DEBUG:teuthology.orchestra.run.smithi049:> return f 2023-07-21T22:13:53.806 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T22:13:53.806 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:13:53.807 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2023-07-21T22:13:53.807 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-07-21T22:13:53.959 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.48367.asok 2023-07-21T22:13:54.143 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48367.asok 2023-07-21T22:13:54.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:54.144 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48367.asok status 2023-07-21T22:13:54.342 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:13:54.342 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2023-07-21T22:13:54.342 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea", 2023-07-21T22:13:54.342 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:13:54.343 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2023-07-21T22:13:54.343 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2023-07-21T22:13:54.343 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-21T22:13:54.343 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "48367", 2023-07-21T22:13:54.343 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2023-07-21T22:13:54.343 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:54.343 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2023-07-21T22:13:54.344 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2023-07-21T22:13:54.344 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6603, 2023-07-21T22:13:54.344 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2023-07-21T22:13:54.344 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2023-07-21T22:13:54.344 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2023-07-21T22:13:54.344 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 6603 2023-07-21T22:13:54.344 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:54.345 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:13:54.345 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:13:54.345 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:0", 2023-07-21T22:13:54.345 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2955614666 2023-07-21T22:13:54.345 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:13:54.345 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:54.345 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:13:54.345 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:13:54.346 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:0", 2023-07-21T22:13:54.346 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2955614666 2023-07-21T22:13:54.346 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:13:54.346 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.6603 172.21.15.49:0/2955614666", 2023-07-21T22:13:54.346 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "172.21.15.49:0/2955614666", 2023-07-21T22:13:54.346 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2023-07-21T22:13:54.346 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 26, 2023-07-21T22:13:54.346 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 62, 2023-07-21T22:13:54.347 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2023-07-21T22:13:54.347 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2023-07-21T22:13:54.347 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2023-07-21T22:13:54.347 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:13:54.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:54.357 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2023-07-21T22:13:54.357 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-21T22:13:54.378 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2023-07-21T22:13:54.378 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-21T22:13:54.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:54.379 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:13:54.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:13:54.458 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2023-07-21T22:13:54.535 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2023-07-21T22:13:54.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.721+0000 7f4514fca700 1 Processor -- start 2023-07-21T22:13:54.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.721+0000 7f4514fca700 1 -- start start 2023-07-21T22:13:54.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f4514fca700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f451015bed0 0x7f45100ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:54.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f4514fca700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45100d0980 0x7f45100b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:54.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f4514fca700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45100b5460 con 0x7f45100cef30 2023-07-21T22:13:54.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f4514fca700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45100d0dc0 con 0x7f45100d0980 2023-07-21T22:13:54.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f4514fca700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45100d1030 con 0x7f451015bed0 2023-07-21T22:13:54.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f450ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45100d0980 0x7f45100b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:54.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f450ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45100d0980 0x7f45100b5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47244/0 (socket says 172.21.15.49:47244) 2023-07-21T22:13:54.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f450ffff700 1 -- 172.21.15.49:0/1004488760 learned_addr learned my addr 172.21.15.49:0/1004488760 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:54.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f450f7fe700 1 --2- 172.21.15.49:0/1004488760 >> v2:172.21.15.150:3300/0 conn(0x7f451015bed0 0x7f45100ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:54.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f450ffff700 1 -- 172.21.15.49:0/1004488760 >> v2:172.21.15.150:3300/0 conn(0x7f451015bed0 msgr2=0x7f45100ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:54.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f450ffff700 1 --2- 172.21.15.49:0/1004488760 >> v2:172.21.15.150:3300/0 conn(0x7f451015bed0 0x7f45100ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:54.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f450ffff700 1 -- 172.21.15.49:0/1004488760 >> v1:172.21.15.150:6789/0 conn(0x7f45100cef30 legacy=0x7f45100d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:54.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f450ffff700 1 -- 172.21.15.49:0/1004488760 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45100d1310 con 0x7f45100d0980 2023-07-21T22:13:54.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f450f7fe700 1 --2- 172.21.15.49:0/1004488760 >> v2:172.21.15.150:3300/0 conn(0x7f451015bed0 0x7f45100ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:54.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f450ffff700 1 --2- 172.21.15.49:0/1004488760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45100d0980 0x7f45100b5bd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f45100d3620 tx=0x7f450800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101971402c4eceaa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:54.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f450e7fc700 1 -- 172.21.15.49:0/1004488760 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450800e070 con 0x7f45100d0980 2023-07-21T22:13:54.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f450e7fc700 1 -- 172.21.15.49:0/1004488760 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4508003a40 con 0x7f45100d0980 2023-07-21T22:13:54.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f450e7fc700 1 -- 172.21.15.49:0/1004488760 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508003df0 con 0x7f45100d0980 2023-07-21T22:13:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f4514fca700 1 -- 172.21.15.49:0/1004488760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45100d0980 msgr2=0x7f45100b5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f4514fca700 1 --2- 172.21.15.49:0/1004488760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45100d0980 0x7f45100b5bd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f45100d3620 tx=0x7f450800b330 comp rx=0 tx=0).stop 2023-07-21T22:13:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f4514fca700 1 -- 172.21.15.49:0/1004488760 shutdown_connections 2023-07-21T22:13:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f4514fca700 1 --2- 172.21.15.49:0/1004488760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45100d0980 0x7f45100b5bd0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f4514fca700 1 --2- 172.21.15.49:0/1004488760 >> v2:172.21.15.150:3300/0 conn(0x7f451015bed0 0x7f45100ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.725+0000 7f4514fca700 1 -- 172.21.15.49:0/1004488760 >> 172.21.15.49:0/1004488760 conn(0x7f4510065af0 msgr2=0x7f451006fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.729+0000 7f4514fca700 1 -- 172.21.15.49:0/1004488760 shutdown_connections 2023-07-21T22:13:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.729+0000 7f4514fca700 1 -- 172.21.15.49:0/1004488760 wait complete. 2023-07-21T22:13:54.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.729+0000 7f4514fca700 1 Processor -- start 2023-07-21T22:13:54.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f4514fca700 1 -- start start 2023-07-21T22:13:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f4514fca700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45100cef30 0x7f451015dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:54.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f4514fca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45100d0980 0x7f451015c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:54.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f4514fca700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f451015bed0 0x7f45100c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:54.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f4514fca700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451015d1b0 con 0x7f45100d0980 2023-07-21T22:13:54.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f4514fca700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45101559b0 con 0x7f451015bed0 2023-07-21T22:13:54.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f4514fca700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451015cbf0 con 0x7f45100cef30 2023-07-21T22:13:54.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f450effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45100d0980 0x7f451015c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f450effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45100d0980 0x7f451015c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47250/0 (socket says 172.21.15.49:47250) 2023-07-21T22:13:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f450effd700 1 -- 172.21.15.49:0/2975304421 learned_addr learned my addr 172.21.15.49:0/2975304421 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f450f7fe700 1 --2- 172.21.15.49:0/2975304421 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45100cef30 0x7f451015dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f450ffff700 1 --2- 172.21.15.49:0/2975304421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f451015bed0 0x7f45100c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f450effd700 1 -- 172.21.15.49:0/2975304421 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45100cef30 msgr2=0x7f451015dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f450effd700 1 --2- 172.21.15.49:0/2975304421 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45100cef30 0x7f451015dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f450effd700 1 -- 172.21.15.49:0/2975304421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f451015bed0 msgr2=0x7f45100c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f450effd700 1 --2- 172.21.15.49:0/2975304421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f451015bed0 0x7f45100c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.733+0000 7f450effd700 1 -- 172.21.15.49:0/2975304421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4508009b30 con 0x7f45100d0980 2023-07-21T22:13:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.737+0000 7f450effd700 1 --2- 172.21.15.49:0/2975304421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45100d0980 0x7f451015c2a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f450400c4e0 tx=0x7f450400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.737+0000 7f44f7fff700 1 -- 172.21.15.49:0/2975304421 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504011790 con 0x7f45100d0980 2023-07-21T22:13:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.737+0000 7f44f7fff700 1 -- 172.21.15.49:0/2975304421 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4504011910 con 0x7f45100d0980 2023-07-21T22:13:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.737+0000 7f4514fca700 1 -- 172.21.15.49:0/2975304421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451015ced0 con 0x7f45100d0980 2023-07-21T22:13:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.737+0000 7f44f7fff700 1 -- 172.21.15.49:0/2975304421 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504011cc0 con 0x7f45100d0980 2023-07-21T22:13:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.737+0000 7f4514fca700 1 -- 172.21.15.49:0/2975304421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451015c7e0 con 0x7f45100d0980 2023-07-21T22:13:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.737+0000 7f4514fca700 1 -- 172.21.15.49:0/2975304421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45101554a0 con 0x7f45100d0980 2023-07-21T22:13:54.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.741+0000 7f44f7fff700 1 -- 172.21.15.49:0/2975304421 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f450401c460 con 0x7f45100d0980 2023-07-21T22:13:54.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.745+0000 7f44f7fff700 1 --2- 172.21.15.49:0/2975304421 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f44fc0662f0 0x7f44fc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:54.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.745+0000 7f44f7fff700 1 -- 172.21.15.49:0/2975304421 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f45040846a0 con 0x7f45100d0980 2023-07-21T22:13:54.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.745+0000 7f450f7fe700 1 --2- 172.21.15.49:0/2975304421 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f44fc0662f0 0x7f44fc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:54.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.745+0000 7f450f7fe700 1 --2- 172.21.15.49:0/2975304421 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f44fc0662f0 0x7f44fc0687a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f450000a9a0 tx=0x7f4500008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:54.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.749+0000 7f44f7fff700 1 -- 172.21.15.49:0/2975304421 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4504051940 con 0x7f45100d0980 2023-07-21T22:13:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.977+0000 7f4514fca700 1 -- 172.21.15.49:0/2975304421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) v1 -- 0x7f45101554a0 con 0x7f45100d0980 2023-07-21T22:13:55.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.985+0000 7f44f7fff700 1 -- 172.21.15.49:0/2975304421 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v18) v1 ==== 183+0+140 (secure 0 0 0) 0x7f45101554a0 con 0x7f45100d0980 2023-07-21T22:13:55.030 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2023-07-21T22:13:55.030 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtkU5ZaIRAAchCJhuM71+rGOBHBlX77wA== 2023-07-21T22:13:55.031 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow" 2023-07-21T22:13:55.031 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2023-07-21T22:13:55.031 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow r pool=cephfs_data" 2023-07-21T22:13:55.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.989+0000 7f4514fca700 1 -- 172.21.15.49:0/2975304421 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f44fc0662f0 msgr2=0x7f44fc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:55.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.989+0000 7f4514fca700 1 --2- 172.21.15.49:0/2975304421 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f44fc0662f0 0x7f44fc0687a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f450000a9a0 tx=0x7f4500008040 comp rx=0 tx=0).stop 2023-07-21T22:13:55.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.989+0000 7f4514fca700 1 -- 172.21.15.49:0/2975304421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45100d0980 msgr2=0x7f451015c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:55.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.989+0000 7f4514fca700 1 --2- 172.21.15.49:0/2975304421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45100d0980 0x7f451015c2a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f450400c4e0 tx=0x7f450400c8a0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.989+0000 7f4514fca700 1 -- 172.21.15.49:0/2975304421 shutdown_connections 2023-07-21T22:13:55.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.989+0000 7f4514fca700 1 --2- 172.21.15.49:0/2975304421 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f44fc0662f0 0x7f44fc0687a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.989+0000 7f4514fca700 1 --2- 172.21.15.49:0/2975304421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45100d0980 0x7f451015c2a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.989+0000 7f4514fca700 1 --2- 172.21.15.49:0/2975304421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f451015bed0 0x7f45100c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.989+0000 7f4514fca700 1 --2- 172.21.15.49:0/2975304421 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45100cef30 0x7f451015dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.989+0000 7f4514fca700 1 -- 172.21.15.49:0/2975304421 >> 172.21.15.49:0/2975304421 conn(0x7f4510065af0 msgr2=0x7f45101e6850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:55.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.989+0000 7f4514fca700 1 -- 172.21.15.49:0/2975304421 shutdown_connections 2023-07-21T22:13:55.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:54.989+0000 7f4514fca700 1 -- 172.21.15.49:0/2975304421 wait complete. 2023-07-21T22:13:55.036 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-07-21T22:13:55.055 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:13:55.056 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:13:55.073 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:13:55.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.241+0000 7fc04bc58700 1 Processor -- start 2023-07-21T22:13:55.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.241+0000 7fc04bc58700 1 -- start start 2023-07-21T22:13:55.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc04bc58700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0440cdd50 0x7fc0440ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:55.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc04bc58700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc0440ce790 0x7fc0440d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:55.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc04bc58700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc0440ce240 0x7fc0440d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:55.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc04bc58700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0440b8680 con 0x7fc0440ce790 2023-07-21T22:13:55.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc04bc58700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0440d3500 con 0x7fc0440ce240 2023-07-21T22:13:55.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc04bc58700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440d2fa0 con 0x7fc0440cdd50 2023-07-21T22:13:55.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc0491f3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc0440ce790 0x7fc0440d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:55.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc0491f3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc0440ce790 0x7fc0440d0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47262/0 (socket says 172.21.15.49:47262) 2023-07-21T22:13:55.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc0491f3700 1 -- 172.21.15.49:0/2453249918 learned_addr learned my addr 172.21.15.49:0/2453249918 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:55.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc04a1f5700 1 --2- 172.21.15.49:0/2453249918 >> v2:172.21.15.150:3300/0 conn(0x7fc0440ce240 0x7fc0440d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:55.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc0499f4700 1 --2- 172.21.15.49:0/2453249918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0440cdd50 0x7fc0440ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:55.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc0491f3700 1 -- 172.21.15.49:0/2453249918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0440cdd50 msgr2=0x7fc0440ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:55.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc0491f3700 1 --2- 172.21.15.49:0/2453249918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0440cdd50 0x7fc0440ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc0491f3700 1 -- 172.21.15.49:0/2453249918 >> v2:172.21.15.150:3300/0 conn(0x7fc0440ce240 msgr2=0x7fc0440d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:55.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc0491f3700 1 --2- 172.21.15.49:0/2453249918 >> v2:172.21.15.150:3300/0 conn(0x7fc0440ce240 0x7fc0440d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc0491f3700 1 -- 172.21.15.49:0/2453249918 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0440b6290 con 0x7fc0440ce790 2023-07-21T22:13:55.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc0491f3700 1 --2- 172.21.15.49:0/2453249918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440ce790 0x7fc0440d0470 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc0440d1c50 tx=0x7fc034009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e18cce9641b9c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:55.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc0489f2700 1 -- 172.21.15.49:0/2453249918 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034011830 con 0x7fc0440ce790 2023-07-21T22:13:55.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc0489f2700 1 -- 172.21.15.49:0/2453249918 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc034011990 con 0x7fc0440ce790 2023-07-21T22:13:55.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.245+0000 7fc0489f2700 1 -- 172.21.15.49:0/2453249918 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034011d20 con 0x7fc0440ce790 2023-07-21T22:13:55.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.249+0000 7fc04bc58700 1 -- 172.21.15.49:0/2453249918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440ce790 msgr2=0x7fc0440d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:55.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.249+0000 7fc04bc58700 1 --2- 172.21.15.49:0/2453249918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440ce790 0x7fc0440d0470 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc0440d1c50 tx=0x7fc034009bf0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.249+0000 7fc04bc58700 1 -- 172.21.15.49:0/2453249918 shutdown_connections 2023-07-21T22:13:55.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.249+0000 7fc04bc58700 1 --2- 172.21.15.49:0/2453249918 >> v2:172.21.15.150:3300/0 conn(0x7fc0440ce240 0x7fc0440d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.249+0000 7fc04bc58700 1 --2- 172.21.15.49:0/2453249918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440ce790 0x7fc0440d0470 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.249+0000 7fc04bc58700 1 --2- 172.21.15.49:0/2453249918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0440cdd50 0x7fc0440ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.249+0000 7fc04bc58700 1 -- 172.21.15.49:0/2453249918 >> 172.21.15.49:0/2453249918 conn(0x7fc0440b55e0 msgr2=0x7fc0440b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:55.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.249+0000 7fc04bc58700 1 -- 172.21.15.49:0/2453249918 shutdown_connections 2023-07-21T22:13:55.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.249+0000 7fc04bc58700 1 -- 172.21.15.49:0/2453249918 wait complete. 2023-07-21T22:13:55.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.249+0000 7fc04bc58700 1 Processor -- start 2023-07-21T22:13:55.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.249+0000 7fc04bc58700 1 -- start start 2023-07-21T22:13:55.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc04bc58700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440cdd50 0x7fc04409f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:55.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc04bc58700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0440ce240 0x7fc04406fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:55.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc04bc58700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0440ce790 0x7fc0440700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:55.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc04bc58700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440ca540 con 0x7fc0440cdd50 2023-07-21T22:13:55.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc04bc58700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440cade0 con 0x7fc0440ce790 2023-07-21T22:13:55.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc04bc58700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440c8e20 con 0x7fc0440ce240 2023-07-21T22:13:55.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc0499f4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440cdd50 0x7fc04409f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:55.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc0499f4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440cdd50 0x7fc04409f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47272/0 (socket says 172.21.15.49:47272) 2023-07-21T22:13:55.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc0499f4700 1 -- 172.21.15.49:0/293892450 learned_addr learned my addr 172.21.15.49:0/293892450 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:55.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc0491f3700 1 --2- 172.21.15.49:0/293892450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0440ce240 0x7fc04406fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:55.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc04a1f5700 1 --2- 172.21.15.49:0/293892450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0440ce790 0x7fc0440700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:55.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc0499f4700 1 -- 172.21.15.49:0/293892450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0440ce240 msgr2=0x7fc04406fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:55.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc0499f4700 1 --2- 172.21.15.49:0/293892450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0440ce240 0x7fc04406fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc0499f4700 1 -- 172.21.15.49:0/293892450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0440ce790 msgr2=0x7fc0440700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:55.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc0499f4700 1 --2- 172.21.15.49:0/293892450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0440ce790 0x7fc0440700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc0499f4700 1 -- 172.21.15.49:0/293892450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034009570 con 0x7fc0440cdd50 2023-07-21T22:13:55.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc0499f4700 1 --2- 172.21.15.49:0/293892450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440cdd50 0x7fc04409f950 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc04000e960 tx=0x7fc04000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:55.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc03a7fc700 1 -- 172.21.15.49:0/293892450 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc040005a40 con 0x7fc0440cdd50 2023-07-21T22:13:55.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc03a7fc700 1 -- 172.21.15.49:0/293892450 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc040005ba0 con 0x7fc0440cdd50 2023-07-21T22:13:55.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc04bc58700 1 -- 172.21.15.49:0/293892450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0440ca790 con 0x7fc0440cdd50 2023-07-21T22:13:55.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc03a7fc700 1 -- 172.21.15.49:0/293892450 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc040013680 con 0x7fc0440cdd50 2023-07-21T22:13:55.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.253+0000 7fc04bc58700 1 -- 172.21.15.49:0/293892450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04409fe90 con 0x7fc0440cdd50 2023-07-21T22:13:55.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.257+0000 7fc04bc58700 1 -- 172.21.15.49:0/293892450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04404dcb0 con 0x7fc0440cdd50 2023-07-21T22:13:55.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.257+0000 7fc03a7fc700 1 -- 172.21.15.49:0/293892450 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc0400137e0 con 0x7fc0440cdd50 2023-07-21T22:13:55.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.257+0000 7fc03a7fc700 1 --2- 172.21.15.49:0/293892450 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc0280662f0 0x7fc0280687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:55.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.257+0000 7fc03a7fc700 1 -- 172.21.15.49:0/293892450 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc040083f60 con 0x7fc0440cdd50 2023-07-21T22:13:55.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.257+0000 7fc0491f3700 1 --2- 172.21.15.49:0/293892450 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc0280662f0 0x7fc0280687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:55.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.261+0000 7fc0491f3700 1 --2- 172.21.15.49:0/293892450 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc0280662f0 0x7fc0280687a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc034000c00 tx=0x7fc034008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:55.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.265+0000 7fc03a7fc700 1 -- 172.21.15.49:0/293892450 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc0400512a0 con 0x7fc0440cdd50 2023-07-21T22:13:55.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.441+0000 7fc04bc58700 1 -- 172.21.15.49:0/293892450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0440b8090 con 0x7fc0440cdd50 2023-07-21T22:13:55.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.445+0000 7fc03a7fc700 1 -- 172.21.15.49:0/293892450 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+18462 (secure 0 0 0) 0x7fc040020020 con 0x7fc0440cdd50 2023-07-21T22:13:55.490 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:55.490 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":62,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:13:42.072628+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:13:38.569931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:13:39.558524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:13:55.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.449+0000 7fc04bc58700 1 -- 172.21.15.49:0/293892450 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc0280662f0 msgr2=0x7fc0280687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:55.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.449+0000 7fc04bc58700 1 --2- 172.21.15.49:0/293892450 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc0280662f0 0x7fc0280687a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc034000c00 tx=0x7fc034008030 comp rx=0 tx=0).stop 2023-07-21T22:13:55.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.449+0000 7fc04bc58700 1 -- 172.21.15.49:0/293892450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440cdd50 msgr2=0x7fc04409f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:55.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.449+0000 7fc04bc58700 1 --2- 172.21.15.49:0/293892450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440cdd50 0x7fc04409f950 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc04000e960 tx=0x7fc04000ec70 comp rx=0 tx=0).stop 2023-07-21T22:13:55.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.449+0000 7fc04bc58700 1 -- 172.21.15.49:0/293892450 shutdown_connections 2023-07-21T22:13:55.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.449+0000 7fc04bc58700 1 --2- 172.21.15.49:0/293892450 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc0280662f0 0x7fc0280687a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.449+0000 7fc04bc58700 1 --2- 172.21.15.49:0/293892450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0440ce790 0x7fc0440700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.449+0000 7fc04bc58700 1 --2- 172.21.15.49:0/293892450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0440ce240 0x7fc04406fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.449+0000 7fc04bc58700 1 --2- 172.21.15.49:0/293892450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440cdd50 0x7fc04409f950 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.449+0000 7fc04bc58700 1 -- 172.21.15.49:0/293892450 >> 172.21.15.49:0/293892450 conn(0x7fc0440b55e0 msgr2=0x7fc04415be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.449+0000 7fc04bc58700 1 -- 172.21.15.49:0/293892450 shutdown_connections 2023-07-21T22:13:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.449+0000 7fc04bc58700 1 -- 172.21.15.49:0/293892450 wait complete. 2023-07-21T22:13:55.514 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:13:38.569931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:13:39.558524+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:13:55.515 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:13:55.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.657+0000 7f580759e700 1 Processor -- start 2023-07-21T22:13:55.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.657+0000 7f580759e700 1 -- start start 2023-07-21T22:13:55.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080b7af0 0x7f58080b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:55.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580759e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58080b3e80 con 0x7f58080cee10 2023-07-21T22:13:55.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580759e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580815fd40 con 0x7f58080d1e40 2023-07-21T22:13:55.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080cea00 con 0x7f58080b7af0 2023-07-21T22:13:55.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f5806d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f58080cee10 0x7f58080b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33318/0 (socket says 172.21.15.49:33318) 2023-07-21T22:13:55.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f5806d9d700 1 -- 172.21.15.49:0/3080421413 learned_addr learned my addr 172.21.15.49:0/3080421413 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:55.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580659c700 1 --2- 172.21.15.49:0/3080421413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080b7af0 0x7f58080b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:55.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580559a700 1 -- 172.21.15.49:0/3080421413 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609817891 0 0) 0x7f58080b3e80 con 0x7f58080cee10 2023-07-21T22:13:55.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580559a700 1 -- 172.21.15.49:0/3080421413 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f00035d0 con 0x7f58080cee10 2023-07-21T22:13:55.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580559a700 1 -- 172.21.15.49:0/3080421413 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286959808 0 0) 0x7f580815fd40 con 0x7f58080d1e40 2023-07-21T22:13:55.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580559a700 1 -- 172.21.15.49:0/3080421413 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58080b3e80 con 0x7f58080d1e40 2023-07-21T22:13:55.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580659c700 1 -- 172.21.15.49:0/3080421413 >> v1:172.21.15.150:6789/0 conn(0x7f58080d1e40 legacy=0x7f580815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:55.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580659c700 1 -- 172.21.15.49:0/3080421413 >> v1:172.21.15.49:6789/0 conn(0x7f58080cee10 legacy=0x7f58080b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:55.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580659c700 1 -- 172.21.15.49:0/3080421413 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080ccbf0 con 0x7f58080b7af0 2023-07-21T22:13:55.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580659c700 1 --2- 172.21.15.49:0/3080421413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080b7af0 0x7f58080b1630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009880 tx=0x7f57f8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=245f3a323e4f110f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:55.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580559a700 1 -- 172.21.15.49:0/3080421413 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8011830 con 0x7f58080b7af0 2023-07-21T22:13:55.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580559a700 1 -- 172.21.15.49:0/3080421413 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f8011990 con 0x7f58080b7af0 2023-07-21T22:13:55.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.661+0000 7f580559a700 1 -- 172.21.15.49:0/3080421413 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8011d20 con 0x7f58080b7af0 2023-07-21T22:13:55.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.665+0000 7f580759e700 1 -- 172.21.15.49:0/3080421413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080b7af0 msgr2=0x7f58080b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:55.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.665+0000 7f580759e700 1 --2- 172.21.15.49:0/3080421413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080b7af0 0x7f58080b1630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009880 tx=0x7f57f8009b90 comp rx=0 tx=0).stop 2023-07-21T22:13:55.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.665+0000 7f580759e700 1 -- 172.21.15.49:0/3080421413 shutdown_connections 2023-07-21T22:13:55.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.665+0000 7f580759e700 1 --2- 172.21.15.49:0/3080421413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080b7af0 0x7f58080b1630 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.665+0000 7f580759e700 1 -- 172.21.15.49:0/3080421413 >> 172.21.15.49:0/3080421413 conn(0x7f580806e960 msgr2=0x7f580806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:55.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.665+0000 7f580759e700 1 -- 172.21.15.49:0/3080421413 shutdown_connections 2023-07-21T22:13:55.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.665+0000 7f580759e700 1 -- 172.21.15.49:0/3080421413 wait complete. 2023-07-21T22:13:55.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.669+0000 7f580759e700 1 Processor -- start 2023-07-21T22:13:55.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.669+0000 7f580759e700 1 -- start start 2023-07-21T22:13:55.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.669+0000 7f580759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080b7af0 0x7f58080b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:55.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.669+0000 7f580759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58080cee10 0x7f58080b6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:55.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.669+0000 7f580759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58080d1e40 0x7f58080c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:55.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.669+0000 7f580759e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580814bbf0 con 0x7f58080cee10 2023-07-21T22:13:55.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.669+0000 7f580759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580814b040 con 0x7f58080d1e40 2023-07-21T22:13:55.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.669+0000 7f580759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080b6b70 con 0x7f58080b7af0 2023-07-21T22:13:55.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.669+0000 7f5805d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58080cee10 0x7f58080b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:55.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f5805d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58080cee10 0x7f58080b6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47286/0 (socket says 172.21.15.49:47286) 2023-07-21T22:13:55.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f5805d9b700 1 -- 172.21.15.49:0/3672822591 learned_addr learned my addr 172.21.15.49:0/3672822591 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:55.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f580659c700 1 --2- 172.21.15.49:0/3672822591 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080b7af0 0x7f58080b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:55.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f5806d9d700 1 --2- 172.21.15.49:0/3672822591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58080d1e40 0x7f58080c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:55.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f5805d9b700 1 -- 172.21.15.49:0/3672822591 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080b7af0 msgr2=0x7f58080b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:55.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f5805d9b700 1 --2- 172.21.15.49:0/3672822591 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080b7af0 0x7f58080b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f5805d9b700 1 -- 172.21.15.49:0/3672822591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58080d1e40 msgr2=0x7f58080c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:55.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f5805d9b700 1 --2- 172.21.15.49:0/3672822591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58080d1e40 0x7f58080c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f5805d9b700 1 -- 172.21.15.49:0/3672822591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f80094b0 con 0x7f58080cee10 2023-07-21T22:13:55.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f5805d9b700 1 --2- 172.21.15.49:0/3672822591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58080cee10 0x7f58080b6630 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00c730 tx=0x7f57fc00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:55.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f57f6ffd700 1 -- 172.21.15.49:0/3672822591 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc0052d0 con 0x7f58080cee10 2023-07-21T22:13:55.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f57f6ffd700 1 -- 172.21.15.49:0/3672822591 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc005430 con 0x7f58080cee10 2023-07-21T22:13:55.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f57f6ffd700 1 -- 172.21.15.49:0/3672822591 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc0055a0 con 0x7f58080cee10 2023-07-21T22:13:55.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f580759e700 1 -- 172.21.15.49:0/3672822591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580814b250 con 0x7f58080cee10 2023-07-21T22:13:55.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f580759e700 1 -- 172.21.15.49:0/3672822591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580814b810 con 0x7f58080cee10 2023-07-21T22:13:55.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.673+0000 7f580759e700 1 -- 172.21.15.49:0/3672822591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580814bd30 con 0x7f58080cee10 2023-07-21T22:13:55.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.677+0000 7f57f6ffd700 1 -- 172.21.15.49:0/3672822591 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f57fc0038e0 con 0x7f58080cee10 2023-07-21T22:13:55.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.677+0000 7f57f6ffd700 1 --2- 172.21.15.49:0/3672822591 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f57e80662f0 0x7f57e80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:55.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.677+0000 7f57f6ffd700 1 -- 172.21.15.49:0/3672822591 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f57fc0833f0 con 0x7f58080cee10 2023-07-21T22:13:55.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.677+0000 7f580659c700 1 --2- 172.21.15.49:0/3672822591 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f57e80662f0 0x7f57e80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:55.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.681+0000 7f580659c700 1 --2- 172.21.15.49:0/3672822591 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f57e80662f0 0x7f57e80687a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f57f80090b0 tx=0x7f57f801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:55.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.685+0000 7f57f6ffd700 1 -- 172.21.15.49:0/3672822591 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f580814bd30 con 0x7f58080cee10 2023-07-21T22:13:55.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.857+0000 7f580759e700 1 -- 172.21.15.49:0/3672822591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f580814bd30 con 0x7f58080cee10 2023-07-21T22:13:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.861+0000 7f57f6ffd700 1 -- 172.21.15.49:0/3672822591 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7f580814bd30 con 0x7f58080cee10 2023-07-21T22:13:55.904 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:13:55.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.861+0000 7f580759e700 1 -- 172.21.15.49:0/3672822591 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f57e80662f0 msgr2=0x7f57e80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.861+0000 7f580759e700 1 --2- 172.21.15.49:0/3672822591 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f57e80662f0 0x7f57e80687a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f57f80090b0 tx=0x7f57f801c040 comp rx=0 tx=0).stop 2023-07-21T22:13:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.861+0000 7f580759e700 1 -- 172.21.15.49:0/3672822591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58080cee10 msgr2=0x7f58080b6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.861+0000 7f580759e700 1 --2- 172.21.15.49:0/3672822591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58080cee10 0x7f58080b6630 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00c730 tx=0x7f57fc00caf0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.861+0000 7f580759e700 1 -- 172.21.15.49:0/3672822591 shutdown_connections 2023-07-21T22:13:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.861+0000 7f580759e700 1 --2- 172.21.15.49:0/3672822591 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f57e80662f0 0x7f57e80687a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.861+0000 7f580759e700 1 --2- 172.21.15.49:0/3672822591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58080cee10 0x7f58080b6630 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.861+0000 7f580759e700 1 --2- 172.21.15.49:0/3672822591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58080d1e40 0x7f58080c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.861+0000 7f580759e700 1 --2- 172.21.15.49:0/3672822591 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080b7af0 0x7f58080b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:55.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.861+0000 7f580759e700 1 -- 172.21.15.49:0/3672822591 >> 172.21.15.49:0/3672822591 conn(0x7f580806e960 msgr2=0x7f58080b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:55.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.861+0000 7f580759e700 1 -- 172.21.15.49:0/3672822591 shutdown_connections 2023-07-21T22:13:55.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:55.861+0000 7f580759e700 1 -- 172.21.15.49:0/3672822591 wait complete. 2023-07-21T22:13:55.929 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:13:56.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.069+0000 7fe682f64700 1 Processor -- start 2023-07-21T22:13:56.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.069+0000 7fe682f64700 1 -- start start 2023-07-21T22:13:56.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.073+0000 7fe682f64700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe67c0b7af0 0x7fe67c0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.073+0000 7fe682f64700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe67c0b3e80 con 0x7fe67c0d1e40 2023-07-21T22:13:56.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.073+0000 7fe682f64700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe67c15fd40 con 0x7fe67c0cee10 2023-07-21T22:13:56.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.073+0000 7fe682f64700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67c0cea00 con 0x7fe67c0b7af0 2023-07-21T22:13:56.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.073+0000 7fe681f62700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe67c0b7af0 0x7fe67c0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.073+0000 7fe681761700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe67c0d1e40 0x7fe67c15f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33330/0 (socket says 172.21.15.49:33330) 2023-07-21T22:13:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.073+0000 7fe681761700 1 -- 172.21.15.49:0/3346653342 learned_addr learned my addr 172.21.15.49:0/3346653342 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:56.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.073+0000 7fe681f62700 1 -- 172.21.15.49:0/3346653342 >> v1:172.21.15.150:6789/0 conn(0x7fe67c0cee10 legacy=0x7fe67c0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.073+0000 7fe681f62700 1 -- 172.21.15.49:0/3346653342 >> v1:172.21.15.49:6789/0 conn(0x7fe67c0d1e40 legacy=0x7fe67c15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.073+0000 7fe681f62700 1 -- 172.21.15.49:0/3346653342 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c0ccbf0 con 0x7fe67c0b7af0 2023-07-21T22:13:56.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.073+0000 7fe681f62700 1 --2- 172.21.15.49:0/3346653342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe67c0b7af0 0x7fe67c0b1630 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe678009850 tx=0x7fe678009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af802b41d132084a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:56.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.077+0000 7fe680f60700 1 -- 172.21.15.49:0/3346653342 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678011830 con 0x7fe67c0b7af0 2023-07-21T22:13:56.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.077+0000 7fe680f60700 1 -- 172.21.15.49:0/3346653342 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe678011990 con 0x7fe67c0b7af0 2023-07-21T22:13:56.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.077+0000 7fe680f60700 1 -- 172.21.15.49:0/3346653342 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678011d20 con 0x7fe67c0b7af0 2023-07-21T22:13:56.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.077+0000 7fe682f64700 1 -- 172.21.15.49:0/3346653342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe67c0b7af0 msgr2=0x7fe67c0b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.077+0000 7fe682f64700 1 --2- 172.21.15.49:0/3346653342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe67c0b7af0 0x7fe67c0b1630 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe678009850 tx=0x7fe678009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:56.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.077+0000 7fe682f64700 1 -- 172.21.15.49:0/3346653342 shutdown_connections 2023-07-21T22:13:56.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.077+0000 7fe682f64700 1 --2- 172.21.15.49:0/3346653342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe67c0b7af0 0x7fe67c0b1630 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.077+0000 7fe682f64700 1 -- 172.21.15.49:0/3346653342 >> 172.21.15.49:0/3346653342 conn(0x7fe67c06e960 msgr2=0x7fe67c06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:56.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.077+0000 7fe682f64700 1 -- 172.21.15.49:0/3346653342 shutdown_connections 2023-07-21T22:13:56.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.077+0000 7fe682f64700 1 -- 172.21.15.49:0/3346653342 wait complete. 2023-07-21T22:13:56.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.077+0000 7fe682f64700 1 Processor -- start 2023-07-21T22:13:56.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe682f64700 1 -- start start 2023-07-21T22:13:56.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe682f64700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe67c0b7af0 0x7fe67c15c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe682f64700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67c0cee10 0x7fe67c15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe682f64700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe67c0d1e40 0x7fe67c1e4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe682f64700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c0c80b0 con 0x7fe67c0d1e40 2023-07-21T22:13:56.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe682f64700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c15cba0 con 0x7fe67c0b7af0 2023-07-21T22:13:56.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe682f64700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c0c7cf0 con 0x7fe67c0cee10 2023-07-21T22:13:56.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe682763700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe67c0d1e40 0x7fe67c1e4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe681761700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67c0cee10 0x7fe67c15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe681f62700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe67c0b7af0 0x7fe67c15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe682763700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe67c0d1e40 0x7fe67c1e4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47308/0 (socket says 172.21.15.49:47308) 2023-07-21T22:13:56.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe682763700 1 -- 172.21.15.49:0/1855797156 learned_addr learned my addr 172.21.15.49:0/1855797156 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:56.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe681f62700 1 -- 172.21.15.49:0/1855797156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67c0cee10 msgr2=0x7fe67c15d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe681f62700 1 --2- 172.21.15.49:0/1855797156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67c0cee10 0x7fe67c15d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe681f62700 1 -- 172.21.15.49:0/1855797156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe67c0d1e40 msgr2=0x7fe67c1e4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe681f62700 1 --2- 172.21.15.49:0/1855797156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe67c0d1e40 0x7fe67c1e4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe681f62700 1 -- 172.21.15.49:0/1855797156 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6780094b0 con 0x7fe67c0b7af0 2023-07-21T22:13:56.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe682763700 1 --2- 172.21.15.49:0/1855797156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe67c0d1e40 0x7fe67c1e4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:56.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.081+0000 7fe681f62700 1 --2- 172.21.15.49:0/1855797156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe67c0b7af0 0x7fe67c15c660 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe678016000 tx=0x7fe678004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:56.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.085+0000 7fe6727fc700 1 -- 172.21.15.49:0/1855797156 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6780036c0 con 0x7fe67c0b7af0 2023-07-21T22:13:56.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.085+0000 7fe6727fc700 1 -- 172.21.15.49:0/1855797156 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe678003860 con 0x7fe67c0b7af0 2023-07-21T22:13:56.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.085+0000 7fe682f64700 1 -- 172.21.15.49:0/1855797156 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67c0c7380 con 0x7fe67c0b7af0 2023-07-21T22:13:56.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.085+0000 7fe6727fc700 1 -- 172.21.15.49:0/1855797156 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678003c10 con 0x7fe67c0b7af0 2023-07-21T22:13:56.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.085+0000 7fe682f64700 1 -- 172.21.15.49:0/1855797156 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67c15d8b0 con 0x7fe67c0b7af0 2023-07-21T22:13:56.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.085+0000 7fe682f64700 1 -- 172.21.15.49:0/1855797156 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67c0c81f0 con 0x7fe67c0b7af0 2023-07-21T22:13:56.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.089+0000 7fe6727fc700 1 -- 172.21.15.49:0/1855797156 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe67801a430 con 0x7fe67c0b7af0 2023-07-21T22:13:56.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.089+0000 7fe6727fc700 1 --2- 172.21.15.49:0/1855797156 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe6600662f0 0x7fe6600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.089+0000 7fe6727fc700 1 -- 172.21.15.49:0/1855797156 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe678021030 con 0x7fe67c0b7af0 2023-07-21T22:13:56.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.089+0000 7fe681761700 1 --2- 172.21.15.49:0/1855797156 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe6600662f0 0x7fe6600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.093+0000 7fe681761700 1 --2- 172.21.15.49:0/1855797156 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe6600662f0 0x7fe6600687a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe67c15eb60 tx=0x7fe66c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:56.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.097+0000 7fe6727fc700 1 -- 172.21.15.49:0/1855797156 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe67c0c81f0 con 0x7fe67c0b7af0 2023-07-21T22:13:56.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.269+0000 7fe682f64700 1 -- 172.21.15.49:0/1855797156 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe67c04dcb0 con 0x7fe67c0b7af0 2023-07-21T22:13:56.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.273+0000 7fe6727fc700 1 -- 172.21.15.49:0/1855797156 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v62) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe678052910 con 0x7fe67c0b7af0 2023-07-21T22:13:56.316 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:13:56.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.273+0000 7fe682f64700 1 -- 172.21.15.49:0/1855797156 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe6600662f0 msgr2=0x7fe6600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.273+0000 7fe682f64700 1 --2- 172.21.15.49:0/1855797156 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe6600662f0 0x7fe6600687a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe67c15eb60 tx=0x7fe66c009040 comp rx=0 tx=0).stop 2023-07-21T22:13:56.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.277+0000 7fe682f64700 1 -- 172.21.15.49:0/1855797156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe67c0b7af0 msgr2=0x7fe67c15c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.277+0000 7fe682f64700 1 --2- 172.21.15.49:0/1855797156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe67c0b7af0 0x7fe67c15c660 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe678016000 tx=0x7fe678004770 comp rx=0 tx=0).stop 2023-07-21T22:13:56.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.277+0000 7fe682f64700 1 -- 172.21.15.49:0/1855797156 shutdown_connections 2023-07-21T22:13:56.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.277+0000 7fe682f64700 1 --2- 172.21.15.49:0/1855797156 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe6600662f0 0x7fe6600687a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.277+0000 7fe682f64700 1 --2- 172.21.15.49:0/1855797156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe67c0d1e40 0x7fe67c1e4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.277+0000 7fe682f64700 1 --2- 172.21.15.49:0/1855797156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67c0cee10 0x7fe67c15d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.277+0000 7fe682f64700 1 --2- 172.21.15.49:0/1855797156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe67c0b7af0 0x7fe67c15c660 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.277+0000 7fe682f64700 1 -- 172.21.15.49:0/1855797156 >> 172.21.15.49:0/1855797156 conn(0x7fe67c06e960 msgr2=0x7fe67c0b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.277+0000 7fe682f64700 1 -- 172.21.15.49:0/1855797156 shutdown_connections 2023-07-21T22:13:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.277+0000 7fe682f64700 1 -- 172.21.15.49:0/1855797156 wait complete. 2023-07-21T22:13:56.343 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:13:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.485+0000 7fc16b59e700 1 Processor -- start 2023-07-21T22:13:56.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.485+0000 7fc16b59e700 1 -- start start 2023-07-21T22:13:56.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.485+0000 7fc16b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc16c0d1e40 0x7fc16c0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.485+0000 7fc16b59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc16c0b3e80 con 0x7fc16c0cee10 2023-07-21T22:13:56.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.485+0000 7fc16b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc16c15fd40 con 0x7fc16c0b7af0 2023-07-21T22:13:56.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.485+0000 7fc16b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c0cea00 con 0x7fc16c0d1e40 2023-07-21T22:13:56.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.485+0000 7fc16ad9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc16c0cee10 0x7fc16c0b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33346/0 (socket says 172.21.15.49:33346) 2023-07-21T22:13:56.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.485+0000 7fc16ad9d700 1 -- 172.21.15.49:0/2129775217 learned_addr learned my addr 172.21.15.49:0/2129775217 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:56.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.485+0000 7fc169d9b700 1 --2- 172.21.15.49:0/2129775217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc16c0d1e40 0x7fc16c0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 -- 172.21.15.49:0/2129775217 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662850869 0 0) 0x7fc16c0b3e80 con 0x7fc16c0cee10 2023-07-21T22:13:56.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 -- 172.21.15.49:0/2129775217 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1580035d0 con 0x7fc16c0cee10 2023-07-21T22:13:56.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 -- 172.21.15.49:0/2129775217 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 294916764 0 0) 0x7fc1580035d0 con 0x7fc16c0cee10 2023-07-21T22:13:56.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 -- 172.21.15.49:0/2129775217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc16c0d1e40 msgr2=0x7fc16c0b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:56.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 --2- 172.21.15.49:0/2129775217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc16c0d1e40 0x7fc16c0b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 -- 172.21.15.49:0/2129775217 >> v1:172.21.15.150:6789/0 conn(0x7fc16c0b7af0 legacy=0x7fc16c15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 -- 172.21.15.49:0/2129775217 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c0ccbf0 con 0x7fc16c0cee10 2023-07-21T22:13:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 -- 172.21.15.49:0/2129775217 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7fc164001a40 con 0x7fc16c0cee10 2023-07-21T22:13:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 -- 172.21.15.49:0/2129775217 >> v1:172.21.15.49:6789/0 conn(0x7fc16c0cee10 legacy=0x7fc16c0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 --2- 172.21.15.49:0/2129775217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc158003a50 0x7fc158003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 --2- 172.21.15.49:0/2129775217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1580043f0 0x7fc1580048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 --2- 172.21.15.49:0/2129775217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc16c0d1e40 0x7fc158005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 -- 172.21.15.49:0/2129775217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c0cea00 con 0x7fc1580043f0 2023-07-21T22:13:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 -- 172.21.15.49:0/2129775217 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15800ba30 con 0x7fc158003a50 2023-07-21T22:13:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 -- 172.21.15.49:0/2129775217 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15800bbc0 con 0x7fc16c0d1e40 2023-07-21T22:13:56.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc169d9b700 1 --2- 172.21.15.49:0/2129775217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1580043f0 0x7fc1580048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16a59c700 1 --2- 172.21.15.49:0/2129775217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc158003a50 0x7fc158003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16ad9d700 1 --2- 172.21.15.49:0/2129775217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc16c0d1e40 0x7fc158005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc169d9b700 1 -- 172.21.15.49:0/2129775217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc16c0d1e40 msgr2=0x7fc158005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc169d9b700 1 --2- 172.21.15.49:0/2129775217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc16c0d1e40 0x7fc158005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc169d9b700 1 -- 172.21.15.49:0/2129775217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc158003a50 msgr2=0x7fc158003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc169d9b700 1 --2- 172.21.15.49:0/2129775217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc158003a50 0x7fc158003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc169d9b700 1 -- 172.21.15.49:0/2129775217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1580035d0 con 0x7fc1580043f0 2023-07-21T22:13:56.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16a59c700 1 --2- 172.21.15.49:0/2129775217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc158003a50 0x7fc158003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:13:56.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc169d9b700 1 --2- 172.21.15.49:0/2129775217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1580043f0 0x7fc1580048b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc154009b70 tx=0x7fc1580058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5267d8f4760b2f4d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:56.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 -- 172.21.15.49:0/2129775217 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400e6c0 con 0x7fc1580043f0 2023-07-21T22:13:56.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 -- 172.21.15.49:0/2129775217 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15400e820 con 0x7fc1580043f0 2023-07-21T22:13:56.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.489+0000 7fc16959a700 1 -- 172.21.15.49:0/2129775217 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400eb90 con 0x7fc1580043f0 2023-07-21T22:13:56.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.493+0000 7fc16b59e700 1 -- 172.21.15.49:0/2129775217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1580043f0 msgr2=0x7fc1580048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.493+0000 7fc16b59e700 1 --2- 172.21.15.49:0/2129775217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1580043f0 0x7fc1580048b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc154009b70 tx=0x7fc1580058a0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.493+0000 7fc16ad9d700 1 -- 172.21.15.49:0/2129775217 reap_dead start 2023-07-21T22:13:56.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.493+0000 7fc16b59e700 1 -- 172.21.15.49:0/2129775217 shutdown_connections 2023-07-21T22:13:56.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.493+0000 7fc16b59e700 1 -- 172.21.15.49:0/2129775217 >> 172.21.15.49:0/2129775217 conn(0x7fc16c06e960 msgr2=0x7fc16c06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:56.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.493+0000 7fc16b59e700 1 -- 172.21.15.49:0/2129775217 shutdown_connections 2023-07-21T22:13:56.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.493+0000 7fc16b59e700 1 -- 172.21.15.49:0/2129775217 wait complete. 2023-07-21T22:13:56.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.497+0000 7fc16b59e700 1 Processor -- start 2023-07-21T22:13:56.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.497+0000 7fc16b59e700 1 -- start start 2023-07-21T22:13:56.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.497+0000 7fc16b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1580043f0 0x7fc16c14bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.497+0000 7fc16b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc16c0c94d0 0x7fc16c0c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.497+0000 7fc16b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc16c1f4690 0x7fc16c1f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.497+0000 7fc16b59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c1f5040 con 0x7fc16c1f4690 2023-07-21T22:13:56.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.497+0000 7fc16b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c14c100 con 0x7fc1580043f0 2023-07-21T22:13:56.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.497+0000 7fc16b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c0c7ac0 con 0x7fc16c0c94d0 2023-07-21T22:13:56.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc16ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc16c1f4690 0x7fc16c1f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc16ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc16c1f4690 0x7fc16c1f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47328/0 (socket says 172.21.15.49:47328) 2023-07-21T22:13:56.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc16ad9d700 1 -- 172.21.15.49:0/2622963632 learned_addr learned my addr 172.21.15.49:0/2622963632 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:56.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc169d9b700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc16c0c94d0 0x7fc16c0c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc16a59c700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1580043f0 0x7fc16c14bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc16ad9d700 1 -- 172.21.15.49:0/2622963632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc16c0c94d0 msgr2=0x7fc16c0c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc16ad9d700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc16c0c94d0 0x7fc16c0c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc16ad9d700 1 -- 172.21.15.49:0/2622963632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1580043f0 msgr2=0x7fc16c14bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc16ad9d700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1580043f0 0x7fc16c14bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc16ad9d700 1 -- 172.21.15.49:0/2622963632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c0c7da0 con 0x7fc16c1f4690 2023-07-21T22:13:56.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc16a59c700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1580043f0 0x7fc16c14bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:56.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc16ad9d700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc16c1f4690 0x7fc16c1f4b00 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0d1200 tx=0x7fc16400a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:56.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc162ffd700 1 -- 172.21.15.49:0/2622963632 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16400aba0 con 0x7fc16c1f4690 2023-07-21T22:13:56.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc162ffd700 1 -- 172.21.15.49:0/2622963632 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16400ad00 con 0x7fc16c1f4690 2023-07-21T22:13:56.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc16b59e700 1 -- 172.21.15.49:0/2622963632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16c0c8080 con 0x7fc16c1f4690 2023-07-21T22:13:56.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc162ffd700 1 -- 172.21.15.49:0/2622963632 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164013630 con 0x7fc16c1f4690 2023-07-21T22:13:56.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc16b59e700 1 -- 172.21.15.49:0/2622963632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16c0c8640 con 0x7fc16c1f4690 2023-07-21T22:13:56.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.501+0000 7fc16b59e700 1 -- 172.21.15.49:0/2622963632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16c04dcb0 con 0x7fc16c1f4690 2023-07-21T22:13:56.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.505+0000 7fc162ffd700 1 -- 172.21.15.49:0/2622963632 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc164013790 con 0x7fc16c1f4690 2023-07-21T22:13:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.505+0000 7fc162ffd700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc14c0662f0 0x7fc14c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.505+0000 7fc162ffd700 1 -- 172.21.15.49:0/2622963632 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc164084790 con 0x7fc16c1f4690 2023-07-21T22:13:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.505+0000 7fc16a59c700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc14c0662f0 0x7fc14c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.509+0000 7fc16a59c700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc14c0662f0 0x7fc14c0687a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc15c000c00 tx=0x7fc15c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.513+0000 7fc162ffd700 1 -- 172.21.15.49:0/2622963632 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc164051a40 con 0x7fc16c1f4690 2023-07-21T22:13:56.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.689+0000 7fc16b59e700 1 -- 172.21.15.49:0/2622963632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc16c0b4800 con 0x7fc16c1f4690 2023-07-21T22:13:56.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.689+0000 7fc162ffd700 1 -- 172.21.15.49:0/2622963632 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v62) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc164055060 con 0x7fc16c1f4690 2023-07-21T22:13:56.734 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:13:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.693+0000 7fc16b59e700 1 -- 172.21.15.49:0/2622963632 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc14c0662f0 msgr2=0x7fc14c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.693+0000 7fc16b59e700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc14c0662f0 0x7fc14c0687a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc15c000c00 tx=0x7fc15c009040 comp rx=0 tx=0).stop 2023-07-21T22:13:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.693+0000 7fc16b59e700 1 -- 172.21.15.49:0/2622963632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc16c1f4690 msgr2=0x7fc16c1f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.693+0000 7fc16b59e700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc16c1f4690 0x7fc16c1f4b00 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0d1200 tx=0x7fc16400a510 comp rx=0 tx=0).stop 2023-07-21T22:13:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.693+0000 7fc16b59e700 1 -- 172.21.15.49:0/2622963632 shutdown_connections 2023-07-21T22:13:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.693+0000 7fc16b59e700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc14c0662f0 0x7fc14c0687a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.693+0000 7fc16b59e700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc16c1f4690 0x7fc16c1f4b00 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.693+0000 7fc16b59e700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc16c0c94d0 0x7fc16c0c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.693+0000 7fc16b59e700 1 --2- 172.21.15.49:0/2622963632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1580043f0 0x7fc16c14bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.693+0000 7fc16b59e700 1 -- 172.21.15.49:0/2622963632 >> 172.21.15.49:0/2622963632 conn(0x7fc16c06e960 msgr2=0x7fc16c15a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.693+0000 7fc16b59e700 1 -- 172.21.15.49:0/2622963632 shutdown_connections 2023-07-21T22:13:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.693+0000 7fc16b59e700 1 -- 172.21.15.49:0/2622963632 wait complete. 2023-07-21T22:13:56.759 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:13:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.897+0000 7f95e984a700 1 Processor -- start 2023-07-21T22:13:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.897+0000 7f95e984a700 1 -- start start 2023-07-21T22:13:56.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e984a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95e40cefd0 0x7f95e40cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e984a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f95e40ce310 0x7f95e40ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e984a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f95e40b4040 0x7f95e40b4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e984a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e41615d0 con 0x7f95e40ce310 2023-07-21T22:13:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e984a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e4161990 con 0x7f95e40b4040 2023-07-21T22:13:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e984a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40cf8e0 con 0x7f95e40cefd0 2023-07-21T22:13:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e27fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f95e40ce310 0x7f95e40ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e27fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f95e40ce310 0x7f95e40ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47338/0 (socket says 172.21.15.49:47338) 2023-07-21T22:13:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e27fc700 1 -- 172.21.15.49:0/1406212406 learned_addr learned my addr 172.21.15.49:0/1406212406 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e2ffd700 1 --2- 172.21.15.49:0/1406212406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95e40cefd0 0x7f95e40cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e37fe700 1 --2- 172.21.15.49:0/1406212406 >> v2:172.21.15.150:3300/0 conn(0x7f95e40b4040 0x7f95e40b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e27fc700 1 -- 172.21.15.49:0/1406212406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95e40cefd0 msgr2=0x7f95e40cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e27fc700 1 --2- 172.21.15.49:0/1406212406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95e40cefd0 0x7f95e40cf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e27fc700 1 -- 172.21.15.49:0/1406212406 >> v2:172.21.15.150:3300/0 conn(0x7f95e40b4040 msgr2=0x7f95e40b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e27fc700 1 --2- 172.21.15.49:0/1406212406 >> v2:172.21.15.150:3300/0 conn(0x7f95e40b4040 0x7f95e40b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e27fc700 1 -- 172.21.15.49:0/1406212406 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4160950 con 0x7f95e40ce310 2023-07-21T22:13:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e2ffd700 1 --2- 172.21.15.49:0/1406212406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95e40cefd0 0x7f95e40cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e37fe700 1 --2- 172.21.15.49:0/1406212406 >> v2:172.21.15.150:3300/0 conn(0x7f95e40b4040 0x7f95e40b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e27fc700 1 --2- 172.21.15.49:0/1406212406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95e40ce310 0x7f95e40ce760 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f95e4161b60 tx=0x7f95d8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad3bf801c3479d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e1ffb700 1 -- 172.21.15.49:0/1406212406 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8004230 con 0x7f95e40ce310 2023-07-21T22:13:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e1ffb700 1 -- 172.21.15.49:0/1406212406 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d8004390 con 0x7f95e40ce310 2023-07-21T22:13:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e1ffb700 1 -- 172.21.15.49:0/1406212406 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80036c0 con 0x7f95e40ce310 2023-07-21T22:13:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e984a700 1 -- 172.21.15.49:0/1406212406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95e40ce310 msgr2=0x7f95e40ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e984a700 1 --2- 172.21.15.49:0/1406212406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95e40ce310 0x7f95e40ce760 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f95e4161b60 tx=0x7f95d8009bf0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e984a700 1 -- 172.21.15.49:0/1406212406 shutdown_connections 2023-07-21T22:13:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e984a700 1 --2- 172.21.15.49:0/1406212406 >> v2:172.21.15.150:3300/0 conn(0x7f95e40b4040 0x7f95e40b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e984a700 1 --2- 172.21.15.49:0/1406212406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95e40ce310 0x7f95e40ce760 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e984a700 1 --2- 172.21.15.49:0/1406212406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95e40cefd0 0x7f95e40cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.901+0000 7f95e984a700 1 -- 172.21.15.49:0/1406212406 >> 172.21.15.49:0/1406212406 conn(0x7f95e40658e0 msgr2=0x7f95e406fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.905+0000 7f95e984a700 1 -- 172.21.15.49:0/1406212406 shutdown_connections 2023-07-21T22:13:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.905+0000 7f95e984a700 1 -- 172.21.15.49:0/1406212406 wait complete. 2023-07-21T22:13:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e984a700 1 Processor -- start 2023-07-21T22:13:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e984a700 1 -- start start 2023-07-21T22:13:56.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e984a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95e40b4040 0x7f95e40cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e984a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95e40ce310 0x7f95e41f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e984a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95e40cefd0 0x7f95e4145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e984a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40b7690 con 0x7f95e40b4040 2023-07-21T22:13:56.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e984a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40b7970 con 0x7f95e40cefd0 2023-07-21T22:13:56.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e984a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40b7c50 con 0x7f95e40ce310 2023-07-21T22:13:56.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95e40b4040 0x7f95e40cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95e40b4040 0x7f95e40cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47352/0 (socket says 172.21.15.49:47352) 2023-07-21T22:13:56.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e2ffd700 1 -- 172.21.15.49:0/2764699851 learned_addr learned my addr 172.21.15.49:0/2764699851 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e37fe700 1 --2- 172.21.15.49:0/2764699851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95e40cefd0 0x7f95e4145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e2ffd700 1 -- 172.21.15.49:0/2764699851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95e40ce310 msgr2=0x7f95e41f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e2ffd700 1 --2- 172.21.15.49:0/2764699851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95e40ce310 0x7f95e41f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e2ffd700 1 -- 172.21.15.49:0/2764699851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95e40cefd0 msgr2=0x7f95e4145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e2ffd700 1 --2- 172.21.15.49:0/2764699851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95e40cefd0 0x7f95e4145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e2ffd700 1 -- 172.21.15.49:0/2764699851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d8009570 con 0x7f95e40b4040 2023-07-21T22:13:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e2ffd700 1 --2- 172.21.15.49:0/2764699851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95e40b4040 0x7f95e40cbc70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f95d400c770 tx=0x7f95d400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95cbfff700 1 -- 172.21.15.49:0/2764699851 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4011800 con 0x7f95e40b4040 2023-07-21T22:13:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95cbfff700 1 -- 172.21.15.49:0/2764699851 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d4011960 con 0x7f95e40b4040 2023-07-21T22:13:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e984a700 1 -- 172.21.15.49:0/2764699851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e40cc1b0 con 0x7f95e40b4040 2023-07-21T22:13:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95cbfff700 1 -- 172.21.15.49:0/2764699851 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4011d10 con 0x7f95e40b4040 2023-07-21T22:13:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.909+0000 7f95e984a700 1 -- 172.21.15.49:0/2764699851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e41f95a0 con 0x7f95e40b4040 2023-07-21T22:13:56.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.913+0000 7f95e984a700 1 -- 172.21.15.49:0/2764699851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e404dd50 con 0x7f95e40b4040 2023-07-21T22:13:56.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.913+0000 7f95cbfff700 1 -- 172.21.15.49:0/2764699851 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95d4018360 con 0x7f95e40b4040 2023-07-21T22:13:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.913+0000 7f95cbfff700 1 --2- 172.21.15.49:0/2764699851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f95d00662f0 0x7f95d00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.913+0000 7f95cbfff700 1 -- 172.21.15.49:0/2764699851 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f95d4083da0 con 0x7f95e40b4040 2023-07-21T22:13:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.917+0000 7f95e27fc700 1 --2- 172.21.15.49:0/2764699851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f95d00662f0 0x7f95d00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.917+0000 7f95e27fc700 1 --2- 172.21.15.49:0/2764699851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f95d00662f0 0x7f95d00687a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f95e4161b60 tx=0x7f95d8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:56.917+0000 7f95cbfff700 1 -- 172.21.15.49:0/2764699851 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95d4051040 con 0x7f95e40b4040 2023-07-21T22:13:57.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.085+0000 7f95e984a700 1 -- 172.21.15.49:0/2764699851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95e41f95a0 con 0x7f95e40b4040 2023-07-21T22:13:57.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.085+0000 7f95cbfff700 1 -- 172.21.15.49:0/2764699851 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v62) v1 ==== 100+0+11 (secure 0 0 0) 0x7f95e41f95a0 con 0x7f95e40b4040 2023-07-21T22:13:57.131 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:13:57.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.089+0000 7f95e984a700 1 -- 172.21.15.49:0/2764699851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f95d00662f0 msgr2=0x7f95d00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:57.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.089+0000 7f95e984a700 1 --2- 172.21.15.49:0/2764699851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f95d00662f0 0x7f95d00687a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f95e4161b60 tx=0x7f95d8010000 comp rx=0 tx=0).stop 2023-07-21T22:13:57.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.089+0000 7f95e984a700 1 -- 172.21.15.49:0/2764699851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95e40b4040 msgr2=0x7f95e40cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:57.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.089+0000 7f95e984a700 1 --2- 172.21.15.49:0/2764699851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95e40b4040 0x7f95e40cbc70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f95d400c770 tx=0x7f95d400cb30 comp rx=0 tx=0).stop 2023-07-21T22:13:57.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.089+0000 7f95e984a700 1 -- 172.21.15.49:0/2764699851 shutdown_connections 2023-07-21T22:13:57.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.089+0000 7f95e984a700 1 --2- 172.21.15.49:0/2764699851 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f95d00662f0 0x7f95d00687a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.089+0000 7f95e984a700 1 --2- 172.21.15.49:0/2764699851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95e40cefd0 0x7f95e4145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.089+0000 7f95e984a700 1 --2- 172.21.15.49:0/2764699851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95e40ce310 0x7f95e41f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.089+0000 7f95e984a700 1 --2- 172.21.15.49:0/2764699851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95e40b4040 0x7f95e40cbc70 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.089+0000 7f95e984a700 1 -- 172.21.15.49:0/2764699851 >> 172.21.15.49:0/2764699851 conn(0x7f95e40658e0 msgr2=0x7f95e406fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:57.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.089+0000 7f95e984a700 1 -- 172.21.15.49:0/2764699851 shutdown_connections 2023-07-21T22:13:57.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.089+0000 7f95e984a700 1 -- 172.21.15.49:0/2764699851 wait complete. 2023-07-21T22:13:57.157 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:13:57.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.297+0000 7fa355d6b700 1 Processor -- start 2023-07-21T22:13:57.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.297+0000 7fa355d6b700 1 -- start start 2023-07-21T22:13:57.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa355d6b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa350160370 0x7fa35006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:57.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa355d6b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa3500c1470 0x7fa3500c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:57.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa355d6b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3500ca2c0 0x7fa3500caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:57.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa355d6b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35006e010 con 0x7fa3500ca2c0 2023-07-21T22:13:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa355d6b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa350160740 con 0x7fa3500c1470 2023-07-21T22:13:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa355d6b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3500afc90 con 0x7fa350160370 2023-07-21T22:13:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa35556a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3500ca2c0 0x7fa3500caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa35556a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3500ca2c0 0x7fa3500caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47368/0 (socket says 172.21.15.49:47368) 2023-07-21T22:13:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa35556a700 1 -- 172.21.15.49:0/482293682 learned_addr learned my addr 172.21.15.49:0/482293682 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa354d69700 1 --2- 172.21.15.49:0/482293682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa350160370 0x7fa35006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa34ffff700 1 --2- 172.21.15.49:0/482293682 >> v2:172.21.15.150:3300/0 conn(0x7fa3500c1470 0x7fa3500c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa35556a700 1 -- 172.21.15.49:0/482293682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa350160370 msgr2=0x7fa35006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:57.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa35556a700 1 --2- 172.21.15.49:0/482293682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa350160370 0x7fa35006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa35556a700 1 -- 172.21.15.49:0/482293682 >> v2:172.21.15.150:3300/0 conn(0x7fa3500c1470 msgr2=0x7fa3500c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:57.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa35556a700 1 --2- 172.21.15.49:0/482293682 >> v2:172.21.15.150:3300/0 conn(0x7fa3500c1470 0x7fa3500c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa35556a700 1 -- 172.21.15.49:0/482293682 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3500aff70 con 0x7fa3500ca2c0 2023-07-21T22:13:57.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa354d69700 1 --2- 172.21.15.49:0/482293682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa350160370 0x7fa35006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:57.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa35556a700 1 --2- 172.21.15.49:0/482293682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3500ca2c0 0x7fa3500caa80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa35006adc0 tx=0x7fa34800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5323d75f5fce358 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:57.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa34f7fe700 1 -- 172.21.15.49:0/482293682 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34800e070 con 0x7fa3500ca2c0 2023-07-21T22:13:57.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa34f7fe700 1 -- 172.21.15.49:0/482293682 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34800b910 con 0x7fa3500ca2c0 2023-07-21T22:13:57.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.301+0000 7fa34f7fe700 1 -- 172.21.15.49:0/482293682 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34800bcc0 con 0x7fa3500ca2c0 2023-07-21T22:13:57.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.305+0000 7fa355d6b700 1 -- 172.21.15.49:0/482293682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3500ca2c0 msgr2=0x7fa3500caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:57.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.305+0000 7fa355d6b700 1 --2- 172.21.15.49:0/482293682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3500ca2c0 0x7fa3500caa80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa35006adc0 tx=0x7fa34800b330 comp rx=0 tx=0).stop 2023-07-21T22:13:57.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.305+0000 7fa355d6b700 1 -- 172.21.15.49:0/482293682 shutdown_connections 2023-07-21T22:13:57.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.305+0000 7fa355d6b700 1 --2- 172.21.15.49:0/482293682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3500ca2c0 0x7fa3500caa80 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.305+0000 7fa355d6b700 1 --2- 172.21.15.49:0/482293682 >> v2:172.21.15.150:3300/0 conn(0x7fa3500c1470 0x7fa3500c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.305+0000 7fa355d6b700 1 --2- 172.21.15.49:0/482293682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa350160370 0x7fa35006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.305+0000 7fa355d6b700 1 -- 172.21.15.49:0/482293682 >> 172.21.15.49:0/482293682 conn(0x7fa350070450 msgr2=0x7fa350070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:57.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.305+0000 7fa355d6b700 1 -- 172.21.15.49:0/482293682 shutdown_connections 2023-07-21T22:13:57.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.305+0000 7fa355d6b700 1 -- 172.21.15.49:0/482293682 wait complete. 2023-07-21T22:13:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa355d6b700 1 Processor -- start 2023-07-21T22:13:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa355d6b700 1 -- start start 2023-07-21T22:13:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa355d6b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3500c1470 0x7fa3500c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa355d6b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3500ca2c0 0x7fa3500b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa355d6b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa350160370 0x7fa3501f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa355d6b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3500b24d0 con 0x7fa350160370 2023-07-21T22:13:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa355d6b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3500c6ba0 con 0x7fa3500ca2c0 2023-07-21T22:13:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa355d6b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3500c6e60 con 0x7fa3500c1470 2023-07-21T22:13:57.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa35556a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa350160370 0x7fa3501f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:57.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa35556a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa350160370 0x7fa3501f8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47382/0 (socket says 172.21.15.49:47382) 2023-07-21T22:13:57.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa35556a700 1 -- 172.21.15.49:0/3058415459 learned_addr learned my addr 172.21.15.49:0/3058415459 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:57.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa34ffff700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3500ca2c0 0x7fa3500b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:57.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa354d69700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3500c1470 0x7fa3500c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:57.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa35556a700 1 -- 172.21.15.49:0/3058415459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3500c1470 msgr2=0x7fa3500c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:57.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa35556a700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3500c1470 0x7fa3500c1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa35556a700 1 -- 172.21.15.49:0/3058415459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3500ca2c0 msgr2=0x7fa3500b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:57.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa35556a700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3500ca2c0 0x7fa3500b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa35556a700 1 -- 172.21.15.49:0/3058415459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa348009b30 con 0x7fa350160370 2023-07-21T22:13:57.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.309+0000 7fa34ffff700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3500ca2c0 0x7fa3500b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:57.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.313+0000 7fa35556a700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa350160370 0x7fa3501f8de0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa3500cbbf0 tx=0x7fa348004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:57.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.313+0000 7fa34d7fa700 1 -- 172.21.15.49:0/3058415459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3480099b0 con 0x7fa350160370 2023-07-21T22:13:57.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.313+0000 7fa34d7fa700 1 -- 172.21.15.49:0/3058415459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa348004250 con 0x7fa350160370 2023-07-21T22:13:57.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.313+0000 7fa355d6b700 1 -- 172.21.15.49:0/3058415459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3500c7140 con 0x7fa350160370 2023-07-21T22:13:57.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.313+0000 7fa34d7fa700 1 -- 172.21.15.49:0/3058415459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348004600 con 0x7fa350160370 2023-07-21T22:13:57.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.313+0000 7fa355d6b700 1 -- 172.21.15.49:0/3058415459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3500c7700 con 0x7fa350160370 2023-07-21T22:13:57.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.313+0000 7fa355d6b700 1 -- 172.21.15.49:0/3058415459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3500c7920 con 0x7fa350160370 2023-07-21T22:13:57.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.317+0000 7fa34d7fa700 1 -- 172.21.15.49:0/3058415459 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa348004760 con 0x7fa350160370 2023-07-21T22:13:57.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.317+0000 7fa34d7fa700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa334066340 0x7fa3340687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:57.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.317+0000 7fa34d7fa700 1 -- 172.21.15.49:0/3058415459 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa3480852f0 con 0x7fa350160370 2023-07-21T22:13:57.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.317+0000 7fa354d69700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa334066340 0x7fa3340687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:57.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.321+0000 7fa354d69700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa334066340 0x7fa3340687f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa3440099f0 tx=0x7fa344008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:57.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.325+0000 7fa34d7fa700 1 -- 172.21.15.49:0/3058415459 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3480526d0 con 0x7fa350160370 2023-07-21T22:13:57.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.509+0000 7fa355d6b700 1 -- 172.21.15.49:0/3058415459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa35004dcb0 con 0x7fa350160370 2023-07-21T22:13:57.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.509+0000 7fa34d7fa700 1 -- 172.21.15.49:0/3058415459 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v62) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa348055cf0 con 0x7fa350160370 2023-07-21T22:13:57.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.513+0000 7fa355d6b700 1 -- 172.21.15.49:0/3058415459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa334066340 msgr2=0x7fa3340687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:57.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.513+0000 7fa355d6b700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa334066340 0x7fa3340687f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa3440099f0 tx=0x7fa344008040 comp rx=0 tx=0).stop 2023-07-21T22:13:57.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.513+0000 7fa355d6b700 1 -- 172.21.15.49:0/3058415459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa350160370 msgr2=0x7fa3501f8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:57.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.513+0000 7fa355d6b700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa350160370 0x7fa3501f8de0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa3500cbbf0 tx=0x7fa348004af0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.517+0000 7fa355d6b700 1 -- 172.21.15.49:0/3058415459 shutdown_connections 2023-07-21T22:13:57.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.517+0000 7fa355d6b700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa334066340 0x7fa3340687f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.517+0000 7fa355d6b700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa350160370 0x7fa3501f8de0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.517+0000 7fa355d6b700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3500ca2c0 0x7fa3500b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.517+0000 7fa355d6b700 1 --2- 172.21.15.49:0/3058415459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3500c1470 0x7fa3500c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.517+0000 7fa355d6b700 1 -- 172.21.15.49:0/3058415459 >> 172.21.15.49:0/3058415459 conn(0x7fa350070450 msgr2=0x7fa3500ada60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:57.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.517+0000 7fa355d6b700 1 -- 172.21.15.49:0/3058415459 shutdown_connections 2023-07-21T22:13:57.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.517+0000 7fa355d6b700 1 -- 172.21.15.49:0/3058415459 wait complete. 2023-07-21T22:13:57.563 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:13:57.582 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:13:57.582 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:13:57.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:13:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.773+0000 7f0b5e165700 1 Processor -- start 2023-07-21T22:13:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.773+0000 7f0b5e165700 1 -- start start 2023-07-21T22:13:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b5e165700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b5806d5d0 0x7f0b5806d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b5e165700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0b58159f60 0x7f0b580afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b5e165700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5806dee0 con 0x7f0b580b0160 2023-07-21T22:13:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b5e165700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b580b0600 con 0x7f0b58159f60 2023-07-21T22:13:57.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b5e165700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5815a470 con 0x7f0b5806d5d0 2023-07-21T22:13:57.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b56ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0b58159f60 0x7f0b580afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:57.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b56ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0b58159f60 0x7f0b580afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47384/0 (socket says 172.21.15.49:47384) 2023-07-21T22:13:57.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b56ffd700 1 -- 172.21.15.49:0/2103763201 learned_addr learned my addr 172.21.15.49:0/2103763201 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:57.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b57fff700 1 --1- 172.21.15.49:0/2103763201 >> v1:172.21.15.49:6789/0 conn(0x7f0b580b0160 0x7f0b58070600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33362/0 (socket says 172.21.15.49:33362) 2023-07-21T22:13:57.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b577fe700 1 --2- 172.21.15.49:0/2103763201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b5806d5d0 0x7f0b5806d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b56ffd700 1 -- 172.21.15.49:0/2103763201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b5806d5d0 msgr2=0x7f0b5806d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b56ffd700 1 --2- 172.21.15.49:0/2103763201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b5806d5d0 0x7f0b5806d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b56ffd700 1 -- 172.21.15.49:0/2103763201 >> v1:172.21.15.49:6789/0 conn(0x7f0b580b0160 legacy=0x7f0b58070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b56ffd700 1 -- 172.21.15.49:0/2103763201 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5815a750 con 0x7f0b58159f60 2023-07-21T22:13:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b56ffd700 1 --2- 172.21.15.49:0/2103763201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b58159f60 0x7f0b580afc20 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009910 tx=0x7f0b4c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ffa0da55366308 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.777+0000 7f0b567fc700 1 -- 172.21.15.49:0/2103763201 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c00ba60 con 0x7f0b58159f60 2023-07-21T22:13:57.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.781+0000 7f0b567fc700 1 -- 172.21.15.49:0/2103763201 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c00bbc0 con 0x7f0b58159f60 2023-07-21T22:13:57.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.781+0000 7f0b567fc700 1 -- 172.21.15.49:0/2103763201 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c009e60 con 0x7f0b58159f60 2023-07-21T22:13:57.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.781+0000 7f0b5e165700 1 -- 172.21.15.49:0/2103763201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b58159f60 msgr2=0x7f0b580afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:57.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.781+0000 7f0b5e165700 1 --2- 172.21.15.49:0/2103763201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b58159f60 0x7f0b580afc20 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009910 tx=0x7f0b4c009c20 comp rx=0 tx=0).stop 2023-07-21T22:13:57.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.781+0000 7f0b5e165700 1 -- 172.21.15.49:0/2103763201 shutdown_connections 2023-07-21T22:13:57.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.781+0000 7f0b5e165700 1 --2- 172.21.15.49:0/2103763201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b58159f60 0x7f0b580afc20 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.781+0000 7f0b5e165700 1 --2- 172.21.15.49:0/2103763201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b5806d5d0 0x7f0b5806d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.781+0000 7f0b5e165700 1 -- 172.21.15.49:0/2103763201 >> 172.21.15.49:0/2103763201 conn(0x7f0b5806f5a0 msgr2=0x7f0b580cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:57.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.781+0000 7f0b5e165700 1 -- 172.21.15.49:0/2103763201 shutdown_connections 2023-07-21T22:13:57.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.781+0000 7f0b5e165700 1 -- 172.21.15.49:0/2103763201 wait complete. 2023-07-21T22:13:57.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b5e165700 1 Processor -- start 2023-07-21T22:13:57.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b5e165700 1 -- start start 2023-07-21T22:13:57.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b5e165700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b5806d5d0 0x7f0b58158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:57.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b5e165700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b580b0160 0x7f0b580c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:57.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b5e165700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b58159f60 0x7f0b580c3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:57.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b5e165700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b580c5d30 con 0x7f0b58159f60 2023-07-21T22:13:57.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b5e165700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b580c6010 con 0x7f0b5806d5d0 2023-07-21T22:13:57.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b5e165700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b580c62f0 con 0x7f0b580b0160 2023-07-21T22:13:57.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b57fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b58159f60 0x7f0b580c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:57.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b57fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b58159f60 0x7f0b580c3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47388/0 (socket says 172.21.15.49:47388) 2023-07-21T22:13:57.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b57fff700 1 -- 172.21.15.49:0/3822579991 learned_addr learned my addr 172.21.15.49:0/3822579991 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:57.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b577fe700 1 --2- 172.21.15.49:0/3822579991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b5806d5d0 0x7f0b58158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:57.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b56ffd700 1 --2- 172.21.15.49:0/3822579991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b580b0160 0x7f0b580c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:57.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b57fff700 1 -- 172.21.15.49:0/3822579991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b580b0160 msgr2=0x7f0b580c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:57.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b57fff700 1 --2- 172.21.15.49:0/3822579991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b580b0160 0x7f0b580c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b57fff700 1 -- 172.21.15.49:0/3822579991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b5806d5d0 msgr2=0x7f0b58158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:57.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b57fff700 1 --2- 172.21.15.49:0/3822579991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b5806d5d0 0x7f0b58158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:57.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b57fff700 1 -- 172.21.15.49:0/3822579991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c009570 con 0x7f0b58159f60 2023-07-21T22:13:57.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.785+0000 7f0b57fff700 1 --2- 172.21.15.49:0/3822579991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b58159f60 0x7f0b580c3860 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000cba0 tx=0x7f0b5000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:57.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.789+0000 7f0b3ffff700 1 -- 172.21.15.49:0/3822579991 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5000aaa0 con 0x7f0b58159f60 2023-07-21T22:13:57.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.789+0000 7f0b3ffff700 1 -- 172.21.15.49:0/3822579991 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5000ac00 con 0x7f0b58159f60 2023-07-21T22:13:57.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.789+0000 7f0b3ffff700 1 -- 172.21.15.49:0/3822579991 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50007070 con 0x7f0b58159f60 2023-07-21T22:13:57.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.789+0000 7f0b5e165700 1 -- 172.21.15.49:0/3822579991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b580c65d0 con 0x7f0b58159f60 2023-07-21T22:13:57.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.789+0000 7f0b5e165700 1 -- 172.21.15.49:0/3822579991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b58159100 con 0x7f0b58159f60 2023-07-21T22:13:57.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.789+0000 7f0b5e165700 1 -- 172.21.15.49:0/3822579991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b58073130 con 0x7f0b58159f60 2023-07-21T22:13:57.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.789+0000 7f0b3ffff700 1 -- 172.21.15.49:0/3822579991 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b500071d0 con 0x7f0b58159f60 2023-07-21T22:13:57.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.793+0000 7f0b3ffff700 1 --2- 172.21.15.49:0/3822579991 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0b440662f0 0x7f0b440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:57.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.793+0000 7f0b3ffff700 1 -- 172.21.15.49:0/3822579991 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0b50083a80 con 0x7f0b58159f60 2023-07-21T22:13:57.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.793+0000 7f0b577fe700 1 --2- 172.21.15.49:0/3822579991 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0b440662f0 0x7f0b440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:57.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.793+0000 7f0b577fe700 1 --2- 172.21.15.49:0/3822579991 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0b440662f0 0x7f0b440687a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0b48007a60 tx=0x7f0b48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:57.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.797+0000 7f0b3ffff700 1 -- 172.21.15.49:0/3822579991 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b50050e60 con 0x7f0b58159f60 2023-07-21T22:13:58.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.973+0000 7f0b5e165700 1 -- 172.21.15.49:0/3822579991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b5804dcb0 con 0x7f0b58159f60 2023-07-21T22:13:58.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.977+0000 7f0b3ffff700 1 -- 172.21.15.49:0/3822579991 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+18462 (secure 0 0 0) 0x7f0b50017020 con 0x7f0b58159f60 2023-07-21T22:13:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:13:58.020 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":62,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:13:42.072628+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:13:38.569931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:13:39.558524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:13:58.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.977+0000 7f0b5e165700 1 -- 172.21.15.49:0/3822579991 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0b440662f0 msgr2=0x7f0b440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.977+0000 7f0b5e165700 1 --2- 172.21.15.49:0/3822579991 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0b440662f0 0x7f0b440687a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0b48007a60 tx=0x7f0b48008040 comp rx=0 tx=0).stop 2023-07-21T22:13:58.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.977+0000 7f0b5e165700 1 -- 172.21.15.49:0/3822579991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b58159f60 msgr2=0x7f0b580c3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.977+0000 7f0b5e165700 1 --2- 172.21.15.49:0/3822579991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b58159f60 0x7f0b580c3860 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000cba0 tx=0x7f0b5000ceb0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.977+0000 7f0b5e165700 1 -- 172.21.15.49:0/3822579991 shutdown_connections 2023-07-21T22:13:58.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.977+0000 7f0b5e165700 1 --2- 172.21.15.49:0/3822579991 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f0b440662f0 0x7f0b440687a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.977+0000 7f0b5e165700 1 --2- 172.21.15.49:0/3822579991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b58159f60 0x7f0b580c3860 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.977+0000 7f0b5e165700 1 --2- 172.21.15.49:0/3822579991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b580b0160 0x7f0b580c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.977+0000 7f0b5e165700 1 --2- 172.21.15.49:0/3822579991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b5806d5d0 0x7f0b58158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.977+0000 7f0b5e165700 1 -- 172.21.15.49:0/3822579991 >> 172.21.15.49:0/3822579991 conn(0x7f0b5806f5a0 msgr2=0x7f0b5815c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:58.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.977+0000 7f0b5e165700 1 -- 172.21.15.49:0/3822579991 shutdown_connections 2023-07-21T22:13:58.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:57.977+0000 7f0b5e165700 1 -- 172.21.15.49:0/3822579991 wait complete. 2023-07-21T22:13:58.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:13:38.569931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:13:39.558524+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:13:58.045 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:13:58.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.185+0000 7fd5e33e8700 1 Processor -- start 2023-07-21T22:13:58.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.185+0000 7fd5e33e8700 1 -- start start 2023-07-21T22:13:58.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.185+0000 7fd5e33e8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd5dc159be0 0x7fd5dc0c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:58.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.185+0000 7fd5e33e8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd5dc0ca550 0x7fd5dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.185+0000 7fd5e33e8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5dc06d6d0 0x7fd5dc0698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.185+0000 7fd5e33e8700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5dc0c8b80 con 0x7fd5dc0ca550 2023-07-21T22:13:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.185+0000 7fd5e33e8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5dc06db90 con 0x7fd5dc159be0 2023-07-21T22:13:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.185+0000 7fd5e33e8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc06de70 con 0x7fd5dc06d6d0 2023-07-21T22:13:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e1be5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd5dc0ca550 0x7fd5dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e1be5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd5dc0ca550 0x7fd5dc06d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47392/0 (socket says 172.21.15.49:47392) 2023-07-21T22:13:58.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e1be5700 1 -- 172.21.15.49:0/2323293916 learned_addr learned my addr 172.21.15.49:0/2323293916 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:58.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e23e6700 1 --2- 172.21.15.49:0/2323293916 >> v2:172.21.15.150:3300/0 conn(0x7fd5dc159be0 0x7fd5dc0c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:58.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e2be7700 1 --2- 172.21.15.49:0/2323293916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5dc06d6d0 0x7fd5dc0698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:58.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e1be5700 1 -- 172.21.15.49:0/2323293916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5dc06d6d0 msgr2=0x7fd5dc0698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:58.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e1be5700 1 --2- 172.21.15.49:0/2323293916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5dc06d6d0 0x7fd5dc0698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e1be5700 1 -- 172.21.15.49:0/2323293916 >> v2:172.21.15.150:3300/0 conn(0x7fd5dc159be0 msgr2=0x7fd5dc0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:58.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e1be5700 1 --2- 172.21.15.49:0/2323293916 >> v2:172.21.15.150:3300/0 conn(0x7fd5dc159be0 0x7fd5dc0c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e1be5700 1 -- 172.21.15.49:0/2323293916 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc0c8810 con 0x7fd5dc0ca550 2023-07-21T22:13:58.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e23e6700 1 --2- 172.21.15.49:0/2323293916 >> v2:172.21.15.150:3300/0 conn(0x7fd5dc159be0 0x7fd5dc0c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:58.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e2be7700 1 --2- 172.21.15.49:0/2323293916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5dc06d6d0 0x7fd5dc0698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:58.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e1be5700 1 --2- 172.21.15.49:0/2323293916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5dc0ca550 0x7fd5dc06d190 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc072070 tx=0x7fd5cc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aea1a4e1323eefe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:58.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e13e4700 1 -- 172.21.15.49:0/2323293916 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc00b8a0 con 0x7fd5dc0ca550 2023-07-21T22:13:58.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e13e4700 1 -- 172.21.15.49:0/2323293916 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc00ba00 con 0x7fd5dc0ca550 2023-07-21T22:13:58.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e13e4700 1 -- 172.21.15.49:0/2323293916 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc00bd90 con 0x7fd5dc0ca550 2023-07-21T22:13:58.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e33e8700 1 -- 172.21.15.49:0/2323293916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5dc0ca550 msgr2=0x7fd5dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e33e8700 1 --2- 172.21.15.49:0/2323293916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5dc0ca550 0x7fd5dc06d190 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc072070 tx=0x7fd5cc009bf0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e33e8700 1 -- 172.21.15.49:0/2323293916 shutdown_connections 2023-07-21T22:13:58.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e33e8700 1 --2- 172.21.15.49:0/2323293916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5dc06d6d0 0x7fd5dc0698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e33e8700 1 --2- 172.21.15.49:0/2323293916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5dc0ca550 0x7fd5dc06d190 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e33e8700 1 --2- 172.21.15.49:0/2323293916 >> v2:172.21.15.150:3300/0 conn(0x7fd5dc159be0 0x7fd5dc0c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e33e8700 1 -- 172.21.15.49:0/2323293916 >> 172.21.15.49:0/2323293916 conn(0x7fd5dc0ce0d0 msgr2=0x7fd5dc0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:58.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e33e8700 1 -- 172.21.15.49:0/2323293916 shutdown_connections 2023-07-21T22:13:58.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.189+0000 7fd5e33e8700 1 -- 172.21.15.49:0/2323293916 wait complete. 2023-07-21T22:13:58.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.193+0000 7fd5e33e8700 1 Processor -- start 2023-07-21T22:13:58.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.193+0000 7fd5e33e8700 1 -- start start 2023-07-21T22:13:58.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.193+0000 7fd5e33e8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5dc06d6d0 0x7fd5dc1eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:58.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.193+0000 7fd5e33e8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5dc0ca550 0x7fd5dc15bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:58.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.193+0000 7fd5e33e8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5dc159be0 0x7fd5dc15c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:58.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.193+0000 7fd5e33e8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0b1f00 con 0x7fd5dc06d6d0 2023-07-21T22:13:58.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.193+0000 7fd5e33e8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc14b010 con 0x7fd5dc0ca550 2023-07-21T22:13:58.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.193+0000 7fd5e33e8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc1ef0d0 con 0x7fd5dc159be0 2023-07-21T22:13:58.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5e23e6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5dc06d6d0 0x7fd5dc1eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:58.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5e23e6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5dc06d6d0 0x7fd5dc1eeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47404/0 (socket says 172.21.15.49:47404) 2023-07-21T22:13:58.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5e23e6700 1 -- 172.21.15.49:0/3096091221 learned_addr learned my addr 172.21.15.49:0/3096091221 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:58.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5e1be5700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5dc0ca550 0x7fd5dc15bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:58.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5e2be7700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5dc159be0 0x7fd5dc15c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:58.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5e23e6700 1 -- 172.21.15.49:0/3096091221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5dc159be0 msgr2=0x7fd5dc15c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5e23e6700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5dc159be0 0x7fd5dc15c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5e23e6700 1 -- 172.21.15.49:0/3096091221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5dc0ca550 msgr2=0x7fd5dc15bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5e23e6700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5dc0ca550 0x7fd5dc15bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5e23e6700 1 -- 172.21.15.49:0/3096091221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc009570 con 0x7fd5dc06d6d0 2023-07-21T22:13:58.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5e2be7700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5dc159be0 0x7fd5dc15c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:58.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5e23e6700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5dc06d6d0 0x7fd5dc1eeb90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800c7c0 tx=0x7fd5d800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:58.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5d2ffd700 1 -- 172.21.15.49:0/3096091221 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8011800 con 0x7fd5dc06d6d0 2023-07-21T22:13:58.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5d2ffd700 1 -- 172.21.15.49:0/3096091221 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d8011960 con 0x7fd5dc06d6d0 2023-07-21T22:13:58.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5d2ffd700 1 -- 172.21.15.49:0/3096091221 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8011cf0 con 0x7fd5dc06d6d0 2023-07-21T22:13:58.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5e33e8700 1 -- 172.21.15.49:0/3096091221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5dc0b06c0 con 0x7fd5dc06d6d0 2023-07-21T22:13:58.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.197+0000 7fd5e33e8700 1 -- 172.21.15.49:0/3096091221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5dc15c9e0 con 0x7fd5dc06d6d0 2023-07-21T22:13:58.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.201+0000 7fd5e33e8700 1 -- 172.21.15.49:0/3096091221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5dc06caf0 con 0x7fd5dc06d6d0 2023-07-21T22:13:58.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.201+0000 7fd5d2ffd700 1 -- 172.21.15.49:0/3096091221 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5d8021350 con 0x7fd5dc06d6d0 2023-07-21T22:13:58.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.201+0000 7fd5d2ffd700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd5c0066320 0x7fd5c00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:58.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.201+0000 7fd5d2ffd700 1 -- 172.21.15.49:0/3096091221 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd5d8083c90 con 0x7fd5dc06d6d0 2023-07-21T22:13:58.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.201+0000 7fd5e1be5700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd5c0066320 0x7fd5c00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:58.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.205+0000 7fd5e1be5700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd5c0066320 0x7fd5c00687d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc000c00 tx=0x7fd5cc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:58.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.209+0000 7fd5d2ffd700 1 -- 172.21.15.49:0/3096091221 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5d80549d0 con 0x7fd5dc06d6d0 2023-07-21T22:13:58.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.385+0000 7fd5e33e8700 1 -- 172.21.15.49:0/3096091221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5dc04dcb0 con 0x7fd5dc06d6d0 2023-07-21T22:13:58.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.385+0000 7fd5d2ffd700 1 -- 172.21.15.49:0/3096091221 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5d8054560 con 0x7fd5dc06d6d0 2023-07-21T22:13:58.429 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:13:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.389+0000 7fd5e33e8700 1 -- 172.21.15.49:0/3096091221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd5c0066320 msgr2=0x7fd5c00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.389+0000 7fd5e33e8700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd5c0066320 0x7fd5c00687d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc000c00 tx=0x7fd5cc008030 comp rx=0 tx=0).stop 2023-07-21T22:13:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.389+0000 7fd5e33e8700 1 -- 172.21.15.49:0/3096091221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5dc06d6d0 msgr2=0x7fd5dc1eeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.389+0000 7fd5e33e8700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5dc06d6d0 0x7fd5dc1eeb90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800c7c0 tx=0x7fd5d800cad0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.389+0000 7fd5e33e8700 1 -- 172.21.15.49:0/3096091221 shutdown_connections 2023-07-21T22:13:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.389+0000 7fd5e33e8700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd5c0066320 0x7fd5c00687d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.389+0000 7fd5e33e8700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5dc159be0 0x7fd5dc15c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.389+0000 7fd5e33e8700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5dc0ca550 0x7fd5dc15bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.389+0000 7fd5e33e8700 1 --2- 172.21.15.49:0/3096091221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5dc06d6d0 0x7fd5dc1eeb90 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.389+0000 7fd5e33e8700 1 -- 172.21.15.49:0/3096091221 >> 172.21.15.49:0/3096091221 conn(0x7fd5dc0ce0d0 msgr2=0x7fd5dc0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.389+0000 7fd5e33e8700 1 -- 172.21.15.49:0/3096091221 shutdown_connections 2023-07-21T22:13:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.389+0000 7fd5e33e8700 1 -- 172.21.15.49:0/3096091221 wait complete. 2023-07-21T22:13:58.452 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:13:58.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.593+0000 7fadb759e700 1 Processor -- start 2023-07-21T22:13:58.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.593+0000 7fadb759e700 1 -- start start 2023-07-21T22:13:58.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.597+0000 7fadb759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fadb80b7af0 0x7fadb80b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.597+0000 7fadb759e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb80b3e80 con 0x7fadb80d1e40 2023-07-21T22:13:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.597+0000 7fadb759e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb815fd40 con 0x7fadb80cee10 2023-07-21T22:13:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.597+0000 7fadb759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb80cea00 con 0x7fadb80b7af0 2023-07-21T22:13:58.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.597+0000 7fadb5d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fadb80d1e40 0x7fadb815f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33372/0 (socket says 172.21.15.49:33372) 2023-07-21T22:13:58.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.597+0000 7fadb5d9b700 1 -- 172.21.15.49:0/223878039 learned_addr learned my addr 172.21.15.49:0/223878039 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:58.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.597+0000 7fadb659c700 1 --2- 172.21.15.49:0/223878039 >> v2:172.21.15.150:3300/0 conn(0x7fadb80b7af0 0x7fadb80b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:58.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.597+0000 7fadb559a700 1 -- 172.21.15.49:0/223878039 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 996513967 0 0) 0x7fadb815fd40 con 0x7fadb80cee10 2023-07-21T22:13:58.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.597+0000 7fadb559a700 1 -- 172.21.15.49:0/223878039 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fada00035d0 con 0x7fadb80cee10 2023-07-21T22:13:58.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.597+0000 7fadb559a700 1 -- 172.21.15.49:0/223878039 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989366710 0 0) 0x7fadb80b3e80 con 0x7fadb80d1e40 2023-07-21T22:13:58.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.597+0000 7fadb559a700 1 -- 172.21.15.49:0/223878039 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb815fd40 con 0x7fadb80d1e40 2023-07-21T22:13:58.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.597+0000 7fadb659c700 1 -- 172.21.15.49:0/223878039 >> v1:172.21.15.150:6789/0 conn(0x7fadb80cee10 legacy=0x7fadb80b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.597+0000 7fadb659c700 1 -- 172.21.15.49:0/223878039 >> v1:172.21.15.49:6789/0 conn(0x7fadb80d1e40 legacy=0x7fadb815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.597+0000 7fadb659c700 1 -- 172.21.15.49:0/223878039 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb80ccbf0 con 0x7fadb80b7af0 2023-07-21T22:13:58.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.601+0000 7fadb659c700 1 --2- 172.21.15.49:0/223878039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadb80b7af0 0x7fadb80b1630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fada8009850 tx=0x7fada8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a0f3801321005da server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:58.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.601+0000 7fadb559a700 1 -- 172.21.15.49:0/223878039 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8011830 con 0x7fadb80b7af0 2023-07-21T22:13:58.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.601+0000 7fadb559a700 1 -- 172.21.15.49:0/223878039 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada8011990 con 0x7fadb80b7af0 2023-07-21T22:13:58.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.601+0000 7fadb559a700 1 -- 172.21.15.49:0/223878039 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8011d40 con 0x7fadb80b7af0 2023-07-21T22:13:58.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.601+0000 7fadb759e700 1 -- 172.21.15.49:0/223878039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadb80b7af0 msgr2=0x7fadb80b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.601+0000 7fadb759e700 1 --2- 172.21.15.49:0/223878039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadb80b7af0 0x7fadb80b1630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fada8009850 tx=0x7fada8009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:58.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.601+0000 7fadb759e700 1 -- 172.21.15.49:0/223878039 shutdown_connections 2023-07-21T22:13:58.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.601+0000 7fadb759e700 1 --2- 172.21.15.49:0/223878039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadb80b7af0 0x7fadb80b1630 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.601+0000 7fadb759e700 1 -- 172.21.15.49:0/223878039 >> 172.21.15.49:0/223878039 conn(0x7fadb806e960 msgr2=0x7fadb806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.601+0000 7fadb759e700 1 -- 172.21.15.49:0/223878039 shutdown_connections 2023-07-21T22:13:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.601+0000 7fadb759e700 1 -- 172.21.15.49:0/223878039 wait complete. 2023-07-21T22:13:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.605+0000 7fadb759e700 1 Processor -- start 2023-07-21T22:13:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.605+0000 7fadb759e700 1 -- start start 2023-07-21T22:13:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadb80b7af0 0x7fadb815dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadb80cee10 0x7fadb81f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadb80d1e40 0x7fadb80c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb759e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb81f5600 con 0x7fadb80cee10 2023-07-21T22:13:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb815cc70 con 0x7fadb80b7af0 2023-07-21T22:13:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb815cf10 con 0x7fadb80d1e40 2023-07-21T22:13:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadb80cee10 0x7fadb81f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadb80cee10 0x7fadb81f50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47420/0 (socket says 172.21.15.49:47420) 2023-07-21T22:13:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb5d9b700 1 -- 172.21.15.49:0/2175316334 learned_addr learned my addr 172.21.15.49:0/2175316334 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:58.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb659c700 1 --2- 172.21.15.49:0/2175316334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadb80b7af0 0x7fadb815dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:58.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb6d9d700 1 --2- 172.21.15.49:0/2175316334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadb80d1e40 0x7fadb80c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:58.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb5d9b700 1 -- 172.21.15.49:0/2175316334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadb80d1e40 msgr2=0x7fadb80c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb5d9b700 1 --2- 172.21.15.49:0/2175316334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadb80d1e40 0x7fadb80c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb5d9b700 1 -- 172.21.15.49:0/2175316334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadb80b7af0 msgr2=0x7fadb815dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb5d9b700 1 --2- 172.21.15.49:0/2175316334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadb80b7af0 0x7fadb815dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb5d9b700 1 -- 172.21.15.49:0/2175316334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada80094b0 con 0x7fadb80cee10 2023-07-21T22:13:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb5d9b700 1 --2- 172.21.15.49:0/2175316334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadb80cee10 0x7fadb81f50c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fadac00c4d0 tx=0x7fadac00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fada6ffd700 1 -- 172.21.15.49:0/2175316334 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac005d90 con 0x7fadb80cee10 2023-07-21T22:13:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fada6ffd700 1 -- 172.21.15.49:0/2175316334 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac0070d0 con 0x7fadb80cee10 2023-07-21T22:13:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fada6ffd700 1 -- 172.21.15.49:0/2175316334 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac007440 con 0x7fadb80cee10 2023-07-21T22:13:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb759e700 1 -- 172.21.15.49:0/2175316334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb815d1f0 con 0x7fadb80cee10 2023-07-21T22:13:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.609+0000 7fadb759e700 1 -- 172.21.15.49:0/2175316334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb815d7b0 con 0x7fadb80cee10 2023-07-21T22:13:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.613+0000 7fadb759e700 1 -- 172.21.15.49:0/2175316334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb804dcb0 con 0x7fadb80cee10 2023-07-21T22:13:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.613+0000 7fada6ffd700 1 -- 172.21.15.49:0/2175316334 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fadac0075a0 con 0x7fadb80cee10 2023-07-21T22:13:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.617+0000 7fada6ffd700 1 --2- 172.21.15.49:0/2175316334 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fad98066320 0x7fad980687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.617+0000 7fada6ffd700 1 -- 172.21.15.49:0/2175316334 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fadac083130 con 0x7fadb80cee10 2023-07-21T22:13:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.617+0000 7fadb659c700 1 --2- 172.21.15.49:0/2175316334 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fad98066320 0x7fad980687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:58.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.617+0000 7fadb659c700 1 --2- 172.21.15.49:0/2175316334 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fad98066320 0x7fad980687d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fada80090b0 tx=0x7fada8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:58.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.625+0000 7fada6ffd700 1 -- 172.21.15.49:0/2175316334 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fadac050500 con 0x7fadb80cee10 2023-07-21T22:13:58.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.801+0000 7fadb759e700 1 -- 172.21.15.49:0/2175316334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fadb80c5c90 con 0x7fadb80cee10 2023-07-21T22:13:58.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.805+0000 7fada6ffd700 1 -- 172.21.15.49:0/2175316334 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v62) v1 ==== 92+0+10 (secure 0 0 0) 0x7fadac053b20 con 0x7fadb80cee10 2023-07-21T22:13:58.848 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:13:58.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.805+0000 7fadb759e700 1 -- 172.21.15.49:0/2175316334 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fad98066320 msgr2=0x7fad980687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.805+0000 7fadb759e700 1 --2- 172.21.15.49:0/2175316334 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fad98066320 0x7fad980687d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fada80090b0 tx=0x7fada8008030 comp rx=0 tx=0).stop 2023-07-21T22:13:58.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.805+0000 7fadb759e700 1 -- 172.21.15.49:0/2175316334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadb80cee10 msgr2=0x7fadb81f50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.805+0000 7fadb759e700 1 --2- 172.21.15.49:0/2175316334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadb80cee10 0x7fadb81f50c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fadac00c4d0 tx=0x7fadac00c7e0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.805+0000 7fadb759e700 1 -- 172.21.15.49:0/2175316334 shutdown_connections 2023-07-21T22:13:58.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.805+0000 7fadb759e700 1 --2- 172.21.15.49:0/2175316334 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fad98066320 0x7fad980687d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.805+0000 7fadb759e700 1 --2- 172.21.15.49:0/2175316334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadb80cee10 0x7fadb81f50c0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.805+0000 7fadb759e700 1 --2- 172.21.15.49:0/2175316334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadb80d1e40 0x7fadb80c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.805+0000 7fadb759e700 1 --2- 172.21.15.49:0/2175316334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadb80b7af0 0x7fadb815dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.805+0000 7fadb759e700 1 -- 172.21.15.49:0/2175316334 >> 172.21.15.49:0/2175316334 conn(0x7fadb806e960 msgr2=0x7fadb80b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.809+0000 7fadb759e700 1 -- 172.21.15.49:0/2175316334 shutdown_connections 2023-07-21T22:13:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:58.809+0000 7fadb759e700 1 -- 172.21.15.49:0/2175316334 wait complete. 2023-07-21T22:13:58.875 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:13:59.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.013+0000 7f5533fd5700 1 Processor -- start 2023-07-21T22:13:59.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.013+0000 7f5533fd5700 1 -- start start 2023-07-21T22:13:59.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5533fd5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f552c071220 0x7f552c0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5533fd5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552c0cdf00 con 0x7f552c160110 2023-07-21T22:13:59.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5533fd5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552c0ce600 con 0x7f552c071670 2023-07-21T22:13:59.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5533fd5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c0cd730 con 0x7f552c071220 2023-07-21T22:13:59.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5531d71700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f552c160110 0x7f552c0cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33378/0 (socket says 172.21.15.49:33378) 2023-07-21T22:13:59.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5531d71700 1 -- 172.21.15.49:0/170281259 learned_addr learned my addr 172.21.15.49:0/170281259 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:59.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5531570700 1 --2- 172.21.15.49:0/170281259 >> v2:172.21.15.150:3300/0 conn(0x7f552c071220 0x7f552c0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5530d6f700 1 -- 172.21.15.49:0/170281259 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535652333 0 0) 0x7f552c0cdf00 con 0x7f552c160110 2023-07-21T22:13:59.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5530d6f700 1 -- 172.21.15.49:0/170281259 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55180035d0 con 0x7f552c160110 2023-07-21T22:13:59.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5530d6f700 1 -- 172.21.15.49:0/170281259 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014742779 0 0) 0x7f552c0ce600 con 0x7f552c071670 2023-07-21T22:13:59.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5530d6f700 1 -- 172.21.15.49:0/170281259 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f552c0cdf00 con 0x7f552c071670 2023-07-21T22:13:59.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5531570700 1 -- 172.21.15.49:0/170281259 >> v1:172.21.15.150:6789/0 conn(0x7f552c071670 legacy=0x7f552c163d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5531570700 1 -- 172.21.15.49:0/170281259 >> v1:172.21.15.49:6789/0 conn(0x7f552c160110 legacy=0x7f552c0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5531570700 1 -- 172.21.15.49:0/170281259 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c06e190 con 0x7f552c071220 2023-07-21T22:13:59.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5531570700 1 --2- 172.21.15.49:0/170281259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f552c071220 0x7f552c0cabe0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f551c009840 tx=0x7f551c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30030cabf05e6244 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:59.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5530d6f700 1 -- 172.21.15.49:0/170281259 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c005e50 con 0x7f552c071220 2023-07-21T22:13:59.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5530d6f700 1 -- 172.21.15.49:0/170281259 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c006030 con 0x7f552c071220 2023-07-21T22:13:59.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.017+0000 7f5530d6f700 1 -- 172.21.15.49:0/170281259 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0063c0 con 0x7f552c071220 2023-07-21T22:13:59.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.021+0000 7f5533fd5700 1 -- 172.21.15.49:0/170281259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f552c071220 msgr2=0x7f552c0cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.021+0000 7f5533fd5700 1 --2- 172.21.15.49:0/170281259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f552c071220 0x7f552c0cabe0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f551c009840 tx=0x7f551c009b50 comp rx=0 tx=0).stop 2023-07-21T22:13:59.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.021+0000 7f5533fd5700 1 -- 172.21.15.49:0/170281259 shutdown_connections 2023-07-21T22:13:59.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.021+0000 7f5533fd5700 1 --2- 172.21.15.49:0/170281259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f552c071220 0x7f552c0cabe0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.021+0000 7f5533fd5700 1 -- 172.21.15.49:0/170281259 >> 172.21.15.49:0/170281259 conn(0x7f552c06e960 msgr2=0x7f552c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:59.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.021+0000 7f5533fd5700 1 -- 172.21.15.49:0/170281259 shutdown_connections 2023-07-21T22:13:59.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.021+0000 7f5533fd5700 1 -- 172.21.15.49:0/170281259 wait complete. 2023-07-21T22:13:59.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.025+0000 7f5533fd5700 1 Processor -- start 2023-07-21T22:13:59.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.025+0000 7f5533fd5700 1 -- start start 2023-07-21T22:13:59.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.025+0000 7f5533fd5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f552c071220 0x7f552c155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.025+0000 7f5533fd5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c071670 0x7f552c154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.025+0000 7f5533fd5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f552c160110 0x7f552c156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.025+0000 7f5533fd5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c158340 con 0x7f552c071670 2023-07-21T22:13:59.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.025+0000 7f5533fd5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c0c71b0 con 0x7f552c160110 2023-07-21T22:13:59.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.025+0000 7f5533fd5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c157a50 con 0x7f552c071220 2023-07-21T22:13:59.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.025+0000 7f5531570700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c071670 0x7f552c154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.025+0000 7f5531570700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c071670 0x7f552c154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47434/0 (socket says 172.21.15.49:47434) 2023-07-21T22:13:59.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.025+0000 7f5531570700 1 -- 172.21.15.49:0/1701761165 learned_addr learned my addr 172.21.15.49:0/1701761165 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:59.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.025+0000 7f5531d71700 1 --2- 172.21.15.49:0/1701761165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f552c071220 0x7f552c155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.025+0000 7f5532572700 1 --2- 172.21.15.49:0/1701761165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f552c160110 0x7f552c156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.029+0000 7f5531570700 1 -- 172.21.15.49:0/1701761165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f552c071220 msgr2=0x7f552c155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.029+0000 7f5531570700 1 --2- 172.21.15.49:0/1701761165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f552c071220 0x7f552c155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.029+0000 7f5531570700 1 -- 172.21.15.49:0/1701761165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f552c160110 msgr2=0x7f552c156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.029+0000 7f5531570700 1 --2- 172.21.15.49:0/1701761165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f552c160110 0x7f552c156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.029+0000 7f5531570700 1 -- 172.21.15.49:0/1701761165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c009450 con 0x7f552c071670 2023-07-21T22:13:59.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.029+0000 7f5531570700 1 --2- 172.21.15.49:0/1701761165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c071670 0x7f552c154050 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f551c013040 tx=0x7f551c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:59.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.029+0000 7f55227fc700 1 -- 172.21.15.49:0/1701761165 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c006810 con 0x7f552c071670 2023-07-21T22:13:59.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.029+0000 7f55227fc700 1 -- 172.21.15.49:0/1701761165 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c020070 con 0x7f552c071670 2023-07-21T22:13:59.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.029+0000 7f55227fc700 1 -- 172.21.15.49:0/1701761165 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c025670 con 0x7f552c071670 2023-07-21T22:13:59.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.029+0000 7f5533fd5700 1 -- 172.21.15.49:0/1701761165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552c157cf0 con 0x7f552c071670 2023-07-21T22:13:59.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.029+0000 7f5533fd5700 1 -- 172.21.15.49:0/1701761165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c154590 con 0x7f552c071670 2023-07-21T22:13:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.029+0000 7f5533fd5700 1 -- 172.21.15.49:0/1701761165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552c04dd50 con 0x7f552c071670 2023-07-21T22:13:59.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.033+0000 7f55227fc700 1 -- 172.21.15.49:0/1701761165 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f551c022030 con 0x7f552c071670 2023-07-21T22:13:59.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.033+0000 7f55227fc700 1 --2- 172.21.15.49:0/1701761165 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5510066340 0x7f55100687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.033+0000 7f55227fc700 1 -- 172.21.15.49:0/1701761165 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f551c0852e0 con 0x7f552c071670 2023-07-21T22:13:59.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.033+0000 7f5531d71700 1 --2- 172.21.15.49:0/1701761165 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5510066340 0x7f55100687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.037+0000 7f5531d71700 1 --2- 172.21.15.49:0/1701761165 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5510066340 0x7f55100687f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5528000f60 tx=0x7f5528007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:59.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.041+0000 7f55227fc700 1 -- 172.21.15.49:0/1701761165 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f551c0527b0 con 0x7f552c071670 2023-07-21T22:13:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.217+0000 7f5533fd5700 1 -- 172.21.15.49:0/1701761165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f552c158480 con 0x7f552c071670 2023-07-21T22:13:59.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.217+0000 7f55227fc700 1 -- 172.21.15.49:0/1701761165 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v62) v1 ==== 104+0+11 (secure 0 0 0) 0x7f552c158480 con 0x7f552c071670 2023-07-21T22:13:59.263 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:13:59.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.221+0000 7f5533fd5700 1 -- 172.21.15.49:0/1701761165 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5510066340 msgr2=0x7f55100687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.221+0000 7f5533fd5700 1 --2- 172.21.15.49:0/1701761165 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5510066340 0x7f55100687f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5528000f60 tx=0x7f5528007e20 comp rx=0 tx=0).stop 2023-07-21T22:13:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.221+0000 7f5533fd5700 1 -- 172.21.15.49:0/1701761165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c071670 msgr2=0x7f552c154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.221+0000 7f5533fd5700 1 --2- 172.21.15.49:0/1701761165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c071670 0x7f552c154050 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f551c013040 tx=0x7f551c004770 comp rx=0 tx=0).stop 2023-07-21T22:13:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.221+0000 7f5533fd5700 1 -- 172.21.15.49:0/1701761165 shutdown_connections 2023-07-21T22:13:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.221+0000 7f5533fd5700 1 --2- 172.21.15.49:0/1701761165 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f5510066340 0x7f55100687f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.221+0000 7f5533fd5700 1 --2- 172.21.15.49:0/1701761165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c071670 0x7f552c154050 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.221+0000 7f5533fd5700 1 --2- 172.21.15.49:0/1701761165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f552c160110 0x7f552c156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.221+0000 7f5533fd5700 1 --2- 172.21.15.49:0/1701761165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f552c071220 0x7f552c155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.221+0000 7f5533fd5700 1 -- 172.21.15.49:0/1701761165 >> 172.21.15.49:0/1701761165 conn(0x7f552c06e960 msgr2=0x7f552c0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:59.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.221+0000 7f5533fd5700 1 -- 172.21.15.49:0/1701761165 shutdown_connections 2023-07-21T22:13:59.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.221+0000 7f5533fd5700 1 -- 172.21.15.49:0/1701761165 wait complete. 2023-07-21T22:13:59.285 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:13:59.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.429+0000 7fc82a36b700 1 Processor -- start 2023-07-21T22:13:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.429+0000 7fc82a36b700 1 -- start start 2023-07-21T22:13:59.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.429+0000 7fc82a36b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc824160010 0x7fc8240ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.429+0000 7fc82a36b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc824163ee0 con 0x7fc8240ca680 2023-07-21T22:13:59.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.429+0000 7fc82a36b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8240cd6d0 con 0x7fc8241603e0 2023-07-21T22:13:59.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.429+0000 7fc82a36b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8240cdf70 con 0x7fc824160010 2023-07-21T22:13:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.433+0000 7fc829369700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc824160010 0x7fc8240ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.433+0000 7fc829b6a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc8240ca680 0x7fc8240cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33386/0 (socket says 172.21.15.49:33386) 2023-07-21T22:13:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.433+0000 7fc829b6a700 1 -- 172.21.15.49:0/1920103195 learned_addr learned my addr 172.21.15.49:0/1920103195 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.433+0000 7fc829369700 1 -- 172.21.15.49:0/1920103195 >> v1:172.21.15.150:6789/0 conn(0x7fc8241603e0 legacy=0x7fc824164370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.433+0000 7fc829369700 1 -- 172.21.15.49:0/1920103195 >> v1:172.21.15.49:6789/0 conn(0x7fc8240ca680 legacy=0x7fc8240cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.433+0000 7fc829369700 1 -- 172.21.15.49:0/1920103195 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8240cd9b0 con 0x7fc824160010 2023-07-21T22:13:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.433+0000 7fc81bfff700 1 -- 172.21.15.49:0/1920103195 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674671938 0 0) 0x7fc824163ee0 con 0x7fc8240ca680 2023-07-21T22:13:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.433+0000 7fc829369700 1 --2- 172.21.15.49:0/1920103195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc824160010 0x7fc8240ca140 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc820009850 tx=0x7fc820009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28508810dce872eb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.433+0000 7fc81bfff700 1 -- 172.21.15.49:0/1920103195 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820011830 con 0x7fc824160010 2023-07-21T22:13:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.433+0000 7fc81bfff700 1 -- 172.21.15.49:0/1920103195 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc820011990 con 0x7fc824160010 2023-07-21T22:13:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.433+0000 7fc81bfff700 1 -- 172.21.15.49:0/1920103195 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820011d20 con 0x7fc824160010 2023-07-21T22:13:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.433+0000 7fc82a36b700 1 -- 172.21.15.49:0/1920103195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc824160010 msgr2=0x7fc8240ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.433+0000 7fc82a36b700 1 --2- 172.21.15.49:0/1920103195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc824160010 0x7fc8240ca140 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc820009850 tx=0x7fc820009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:59.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.437+0000 7fc82a36b700 1 -- 172.21.15.49:0/1920103195 shutdown_connections 2023-07-21T22:13:59.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.437+0000 7fc82a36b700 1 --2- 172.21.15.49:0/1920103195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc824160010 0x7fc8240ca140 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.437+0000 7fc82a36b700 1 -- 172.21.15.49:0/1920103195 >> 172.21.15.49:0/1920103195 conn(0x7fc8240ce0d0 msgr2=0x7fc8240ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:59.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.437+0000 7fc82a36b700 1 -- 172.21.15.49:0/1920103195 shutdown_connections 2023-07-21T22:13:59.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.437+0000 7fc82a36b700 1 -- 172.21.15.49:0/1920103195 wait complete. 2023-07-21T22:13:59.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.437+0000 7fc82a36b700 1 Processor -- start 2023-07-21T22:13:59.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc82a36b700 1 -- start start 2023-07-21T22:13:59.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc82a36b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8240ca680 0x7fc824151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc82a36b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc824160010 0x7fc8240c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc82a36b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8241603e0 0x7fc8240cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc82a36b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8241f5840 con 0x7fc8240ca680 2023-07-21T22:13:59.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc82a36b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240b20b0 con 0x7fc824160010 2023-07-21T22:13:59.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc82a36b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240b2950 con 0x7fc8241603e0 2023-07-21T22:13:59.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc829369700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8240ca680 0x7fc824151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc829369700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8240ca680 0x7fc824151bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47454/0 (socket says 172.21.15.49:47454) 2023-07-21T22:13:59.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc829369700 1 -- 172.21.15.49:0/3709162113 learned_addr learned my addr 172.21.15.49:0/3709162113 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:59.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc828b68700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc824160010 0x7fc8240c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc829369700 1 -- 172.21.15.49:0/3709162113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8241603e0 msgr2=0x7fc8240cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc829b6a700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8241603e0 0x7fc8240cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc829369700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8241603e0 0x7fc8240cab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc829369700 1 -- 172.21.15.49:0/3709162113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc824160010 msgr2=0x7fc8240c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc829369700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc824160010 0x7fc8240c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc829369700 1 -- 172.21.15.49:0/3709162113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200094b0 con 0x7fc8240ca680 2023-07-21T22:13:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc828b68700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc824160010 0x7fc8240c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:13:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc829369700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8240ca680 0x7fc824151bf0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc820000c00 tx=0x7fc820004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc819ffb700 1 -- 172.21.15.49:0/3709162113 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200036c0 con 0x7fc8240ca680 2023-07-21T22:13:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc819ffb700 1 -- 172.21.15.49:0/3709162113 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82001f070 con 0x7fc8240ca680 2023-07-21T22:13:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc82a36b700 1 -- 172.21.15.49:0/3709162113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8240c8270 con 0x7fc8240ca680 2023-07-21T22:13:59.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc819ffb700 1 -- 172.21.15.49:0/3709162113 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820003a40 con 0x7fc8240ca680 2023-07-21T22:13:59.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.441+0000 7fc82a36b700 1 -- 172.21.15.49:0/3709162113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8240b25e0 con 0x7fc8240ca680 2023-07-21T22:13:59.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.445+0000 7fc82a36b700 1 -- 172.21.15.49:0/3709162113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82404dcb0 con 0x7fc8240ca680 2023-07-21T22:13:59.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.445+0000 7fc819ffb700 1 -- 172.21.15.49:0/3709162113 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc820021030 con 0x7fc8240ca680 2023-07-21T22:13:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.449+0000 7fc819ffb700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc8080662f0 0x7fc8080687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.449+0000 7fc819ffb700 1 -- 172.21.15.49:0/3709162113 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc820085460 con 0x7fc8240ca680 2023-07-21T22:13:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.449+0000 7fc828b68700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc8080662f0 0x7fc8080687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.449+0000 7fc828b68700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc8080662f0 0x7fc8080687a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc82415fd70 tx=0x7fc814009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.453+0000 7fc819ffb700 1 -- 172.21.15.49:0/3709162113 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc8200528b0 con 0x7fc8240ca680 2023-07-21T22:13:59.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.629+0000 7fc82a36b700 1 -- 172.21.15.49:0/3709162113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8241635c0 con 0x7fc8240ca680 2023-07-21T22:13:59.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.629+0000 7fc819ffb700 1 -- 172.21.15.49:0/3709162113 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v62) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc820055ed0 con 0x7fc8240ca680 2023-07-21T22:13:59.675 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:13:59.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.633+0000 7fc82a36b700 1 -- 172.21.15.49:0/3709162113 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc8080662f0 msgr2=0x7fc8080687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.633+0000 7fc82a36b700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc8080662f0 0x7fc8080687a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc82415fd70 tx=0x7fc814009040 comp rx=0 tx=0).stop 2023-07-21T22:13:59.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.633+0000 7fc82a36b700 1 -- 172.21.15.49:0/3709162113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8240ca680 msgr2=0x7fc824151bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.633+0000 7fc82a36b700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8240ca680 0x7fc824151bf0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc820000c00 tx=0x7fc820004770 comp rx=0 tx=0).stop 2023-07-21T22:13:59.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.633+0000 7fc82a36b700 1 -- 172.21.15.49:0/3709162113 shutdown_connections 2023-07-21T22:13:59.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.633+0000 7fc82a36b700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc8080662f0 0x7fc8080687a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.633+0000 7fc82a36b700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8241603e0 0x7fc8240cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.633+0000 7fc82a36b700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc824160010 0x7fc8240c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.633+0000 7fc82a36b700 1 --2- 172.21.15.49:0/3709162113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8240ca680 0x7fc824151bf0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.633+0000 7fc82a36b700 1 -- 172.21.15.49:0/3709162113 >> 172.21.15.49:0/3709162113 conn(0x7fc8240ce0d0 msgr2=0x7fc824070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:59.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.633+0000 7fc82a36b700 1 -- 172.21.15.49:0/3709162113 shutdown_connections 2023-07-21T22:13:59.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.633+0000 7fc82a36b700 1 -- 172.21.15.49:0/3709162113 wait complete. 2023-07-21T22:13:59.700 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:13:59.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.833+0000 7fd09d5d9700 1 Processor -- start 2023-07-21T22:13:59.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.833+0000 7fd09d5d9700 1 -- start start 2023-07-21T22:13:59.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd09d5d9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd098160370 0x7fd09806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd09d5d9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd0980ca490 0x7fd098163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd09d5d9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09806e010 con 0x7fd0980c1470 2023-07-21T22:13:59.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd09d5d9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd098160740 con 0x7fd0980ca490 2023-07-21T22:13:59.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd09d5d9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0980ccc50 con 0x7fd098160370 2023-07-21T22:13:59.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd09cdd8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd0980ca490 0x7fd098163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd097fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd098160370 0x7fd09806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd08f7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd0980c1470 0x7fd0980c9d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33402/0 (socket says 172.21.15.49:33402) 2023-07-21T22:13:59.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd08f7fe700 1 -- 172.21.15.49:0/1695500149 learned_addr learned my addr 172.21.15.49:0/1695500149 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:13:59.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd09cdd8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd0980ca490 0x7fd098163ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47466/0 (socket says 172.21.15.49:47466) 2023-07-21T22:13:59.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd097fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd098160370 0x7fd09806d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:36350/0 (socket says 172.21.15.49:36350) 2023-07-21T22:13:59.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd097fff700 1 -- 172.21.15.49:0/1695500149 >> v2:172.21.15.49:3300/0 conn(0x7fd0980ca490 msgr2=0x7fd098163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:13:59.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd097fff700 1 --2- 172.21.15.49:0/1695500149 >> v2:172.21.15.49:3300/0 conn(0x7fd0980ca490 0x7fd098163ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd097fff700 1 -- 172.21.15.49:0/1695500149 >> v1:172.21.15.49:6789/0 conn(0x7fd0980c1470 legacy=0x7fd0980c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd097fff700 1 -- 172.21.15.49:0/1695500149 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0980afc90 con 0x7fd098160370 2023-07-21T22:13:59.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.837+0000 7fd097fff700 1 --2- 172.21.15.49:0/1695500149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd098160370 0x7fd09806d7e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd088009850 tx=0x7fd088009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b8b81d199c54da server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:59.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.841+0000 7fd0977fe700 1 -- 172.21.15.49:0/1695500149 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088011830 con 0x7fd098160370 2023-07-21T22:13:59.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.841+0000 7fd0977fe700 1 -- 172.21.15.49:0/1695500149 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd088011990 con 0x7fd098160370 2023-07-21T22:13:59.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.841+0000 7fd0977fe700 1 -- 172.21.15.49:0/1695500149 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088011d40 con 0x7fd098160370 2023-07-21T22:13:59.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.841+0000 7fd09d5d9700 1 -- 172.21.15.49:0/1695500149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd098160370 msgr2=0x7fd09806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.841+0000 7fd09d5d9700 1 --2- 172.21.15.49:0/1695500149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd098160370 0x7fd09806d7e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd088009850 tx=0x7fd088009b60 comp rx=0 tx=0).stop 2023-07-21T22:13:59.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.841+0000 7fd09d5d9700 1 -- 172.21.15.49:0/1695500149 shutdown_connections 2023-07-21T22:13:59.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.841+0000 7fd09d5d9700 1 --2- 172.21.15.49:0/1695500149 >> v2:172.21.15.49:3300/0 conn(0x7fd0980ca490 0x7fd098163ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.841+0000 7fd09d5d9700 1 --2- 172.21.15.49:0/1695500149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd098160370 0x7fd09806d7e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.841+0000 7fd09d5d9700 1 -- 172.21.15.49:0/1695500149 >> 172.21.15.49:0/1695500149 conn(0x7fd098070450 msgr2=0x7fd098070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:59.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.841+0000 7fd09d5d9700 1 -- 172.21.15.49:0/1695500149 shutdown_connections 2023-07-21T22:13:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.841+0000 7fd09d5d9700 1 -- 172.21.15.49:0/1695500149 wait complete. 2023-07-21T22:13:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd09d5d9700 1 Processor -- start 2023-07-21T22:13:59.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd09d5d9700 1 -- start start 2023-07-21T22:13:59.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd09d5d9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0980c1470 0x7fd09814c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd09d5d9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0980ca490 0x7fd0980c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd09d5d9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd098160370 0x7fd0980ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd09d5d9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09815b290 con 0x7fd0980c1470 2023-07-21T22:13:59.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd09d5d9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09814ca30 con 0x7fd098160370 2023-07-21T22:13:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd09d5d9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0980c7bc0 con 0x7fd0980ca490 2023-07-21T22:13:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd097fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0980c1470 0x7fd09814c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd097fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0980c1470 0x7fd09814c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47472/0 (socket says 172.21.15.49:47472) 2023-07-21T22:13:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd097fff700 1 -- 172.21.15.49:0/2362352021 learned_addr learned my addr 172.21.15.49:0/2362352021 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:13:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd08f7fe700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0980ca490 0x7fd0980c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd09cdd8700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd098160370 0x7fd0980ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd097fff700 1 -- 172.21.15.49:0/2362352021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0980ca490 msgr2=0x7fd0980c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd097fff700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0980ca490 0x7fd0980c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd097fff700 1 -- 172.21.15.49:0/2362352021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd098160370 msgr2=0x7fd0980ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:59.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd097fff700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd098160370 0x7fd0980ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:59.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd097fff700 1 -- 172.21.15.49:0/2362352021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0880094b0 con 0x7fd0980c1470 2023-07-21T22:13:59.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd09cdd8700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd098160370 0x7fd0980ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:59.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd08f7fe700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0980ca490 0x7fd0980c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:59.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd097fff700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0980c1470 0x7fd09814c4f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd088014040 tx=0x7fd088004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:59.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd0957fa700 1 -- 172.21.15.49:0/2362352021 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0880038c0 con 0x7fd0980c1470 2023-07-21T22:13:59.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd0957fa700 1 -- 172.21.15.49:0/2362352021 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08801e070 con 0x7fd0980c1470 2023-07-21T22:13:59.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd09d5d9700 1 -- 172.21.15.49:0/2362352021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0980c7600 con 0x7fd0980c1470 2023-07-21T22:13:59.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd0957fa700 1 -- 172.21.15.49:0/2362352021 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088003c80 con 0x7fd0980c1470 2023-07-21T22:13:59.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.845+0000 7fd09d5d9700 1 -- 172.21.15.49:0/2362352021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09815aeb0 con 0x7fd0980c1470 2023-07-21T22:13:59.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.849+0000 7fd09d5d9700 1 -- 172.21.15.49:0/2362352021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0980c5040 con 0x7fd0980c1470 2023-07-21T22:13:59.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.849+0000 7fd0957fa700 1 -- 172.21.15.49:0/2362352021 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd08801a420 con 0x7fd0980c1470 2023-07-21T22:13:59.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.849+0000 7fd0957fa700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd07c0662f0 0x7fd07c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:59.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.849+0000 7fd0957fa700 1 -- 172.21.15.49:0/2362352021 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd088020070 con 0x7fd0980c1470 2023-07-21T22:13:59.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.853+0000 7fd08f7fe700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd07c0662f0 0x7fd07c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:59.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.853+0000 7fd08f7fe700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd07c0662f0 0x7fd07c0687a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd0980b3220 tx=0x7fd080009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:59.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:13:59.857+0000 7fd0957fa700 1 -- 172.21.15.49:0/2362352021 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0980c5040 con 0x7fd0980c1470 2023-07-21T22:14:00.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:00.041+0000 7fd09d5d9700 1 -- 172.21.15.49:0/2362352021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd0980c5040 con 0x7fd0980c1470 2023-07-21T22:14:00.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:00.041+0000 7fd0957fa700 1 -- 172.21.15.49:0/2362352021 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v62) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd0980c5040 con 0x7fd0980c1470 2023-07-21T22:14:00.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:00.045+0000 7fd09d5d9700 1 -- 172.21.15.49:0/2362352021 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd07c0662f0 msgr2=0x7fd07c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:00.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:00.045+0000 7fd09d5d9700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd07c0662f0 0x7fd07c0687a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd0980b3220 tx=0x7fd080009040 comp rx=0 tx=0).stop 2023-07-21T22:14:00.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:00.045+0000 7fd09d5d9700 1 -- 172.21.15.49:0/2362352021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0980c1470 msgr2=0x7fd09814c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:00.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:00.045+0000 7fd09d5d9700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0980c1470 0x7fd09814c4f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd088014040 tx=0x7fd088004770 comp rx=0 tx=0).stop 2023-07-21T22:14:00.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:00.045+0000 7fd09d5d9700 1 -- 172.21.15.49:0/2362352021 shutdown_connections 2023-07-21T22:14:00.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:00.045+0000 7fd09d5d9700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd07c0662f0 0x7fd07c0687a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:00.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:00.045+0000 7fd09d5d9700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd098160370 0x7fd0980ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:00.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:00.045+0000 7fd09d5d9700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0980ca490 0x7fd0980c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:00.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:00.045+0000 7fd09d5d9700 1 --2- 172.21.15.49:0/2362352021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0980c1470 0x7fd09814c4f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:00.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:00.045+0000 7fd09d5d9700 1 -- 172.21.15.49:0/2362352021 >> 172.21.15.49:0/2362352021 conn(0x7fd098070450 msgr2=0x7fd0980adab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:00.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:00.045+0000 7fd09d5d9700 1 -- 172.21.15.49:0/2362352021 shutdown_connections 2023-07-21T22:14:00.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:00.045+0000 7fd09d5d9700 1 -- 172.21.15.49:0/2362352021 wait complete. 2023-07-21T22:14:00.091 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:14:00.110 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2023-07-21T22:14:00.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:00.112 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:00.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[48367]: fuse finished with error 0 and tester_r 0 2023-07-21T22:14:00.150 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:14:00.349 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:14:00.357 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:14:06.252 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:14:06.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:06.253 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:14:06.274 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:14:06.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.453+0000 7f4c12324700 1 Processor -- start 2023-07-21T22:14:06.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.453+0000 7f4c12324700 1 -- start start 2023-07-21T22:14:06.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.453+0000 7f4c12324700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c0c160370 0x7f4c0c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:06.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.453+0000 7f4c12324700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4c0c0ca490 0x7f4c0c163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:06.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.453+0000 7f4c12324700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0c06e010 con 0x7f4c0c0c1470 2023-07-21T22:14:06.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.453+0000 7f4c12324700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0c160740 con 0x7f4c0c160370 2023-07-21T22:14:06.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.453+0000 7f4c12324700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0c0ccc50 con 0x7f4c0c0ca490 2023-07-21T22:14:06.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.453+0000 7f4c11322700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c0c160370 0x7f4c0c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:06.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.453+0000 7f4c11322700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c0c160370 0x7f4c0c06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40296/0 (socket says 172.21.15.49:40296) 2023-07-21T22:14:06.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.453+0000 7f4c11322700 1 -- 172.21.15.49:0/4124818998 learned_addr learned my addr 172.21.15.49:0/4124818998 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:06.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.453+0000 7f4c11b23700 1 --2- 172.21.15.49:0/4124818998 >> v2:172.21.15.150:3300/0 conn(0x7f4c0c0ca490 0x7f4c0c163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:06.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c11322700 1 -- 172.21.15.49:0/4124818998 >> v2:172.21.15.150:3300/0 conn(0x7f4c0c0ca490 msgr2=0x7f4c0c163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:06.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c11322700 1 --2- 172.21.15.49:0/4124818998 >> v2:172.21.15.150:3300/0 conn(0x7f4c0c0ca490 0x7f4c0c163ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:06.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c11322700 1 -- 172.21.15.49:0/4124818998 >> v1:172.21.15.150:6789/0 conn(0x7f4c0c0c1470 legacy=0x7f4c0c0c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:06.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c11322700 1 -- 172.21.15.49:0/4124818998 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c0afc90 con 0x7f4c0c160370 2023-07-21T22:14:06.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c11322700 1 --2- 172.21.15.49:0/4124818998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c0c160370 0x7f4c0c06d7e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c06bc50 tx=0x7f4c08009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f11b8a78ca902a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:06.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c03fff700 1 -- 172.21.15.49:0/4124818998 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08011830 con 0x7f4c0c160370 2023-07-21T22:14:06.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c03fff700 1 -- 172.21.15.49:0/4124818998 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08011990 con 0x7f4c0c160370 2023-07-21T22:14:06.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c03fff700 1 -- 172.21.15.49:0/4124818998 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08011d20 con 0x7f4c0c160370 2023-07-21T22:14:06.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c12324700 1 -- 172.21.15.49:0/4124818998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c0c160370 msgr2=0x7f4c0c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:06.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c12324700 1 --2- 172.21.15.49:0/4124818998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c0c160370 0x7f4c0c06d7e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c06bc50 tx=0x7f4c08009bf0 comp rx=0 tx=0).stop 2023-07-21T22:14:06.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c12324700 1 -- 172.21.15.49:0/4124818998 shutdown_connections 2023-07-21T22:14:06.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c12324700 1 --2- 172.21.15.49:0/4124818998 >> v2:172.21.15.150:3300/0 conn(0x7f4c0c0ca490 0x7f4c0c163ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:06.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c12324700 1 --2- 172.21.15.49:0/4124818998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c0c160370 0x7f4c0c06d7e0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:06.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c12324700 1 -- 172.21.15.49:0/4124818998 >> 172.21.15.49:0/4124818998 conn(0x7f4c0c070450 msgr2=0x7f4c0c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:06.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c12324700 1 -- 172.21.15.49:0/4124818998 shutdown_connections 2023-07-21T22:14:06.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.457+0000 7f4c12324700 1 -- 172.21.15.49:0/4124818998 wait complete. 2023-07-21T22:14:06.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.461+0000 7f4c12324700 1 Processor -- start 2023-07-21T22:14:06.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.461+0000 7f4c12324700 1 -- start start 2023-07-21T22:14:06.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c12324700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c0c0c1470 0x7f4c0c0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:06.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c12324700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c0c0ca490 0x7f4c0c14b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:06.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c12324700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c0c160370 0x7f4c0c14b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:06.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c12324700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c14b640 con 0x7f4c0c0ca490 2023-07-21T22:14:06.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c12324700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c15f240 con 0x7f4c0c160370 2023-07-21T22:14:06.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c12324700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c0c70e0 con 0x7f4c0c0c1470 2023-07-21T22:14:06.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c10b21700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c0c0ca490 0x7f4c0c14b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:06.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c10b21700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c0c0ca490 0x7f4c0c14b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40306/0 (socket says 172.21.15.49:40306) 2023-07-21T22:14:06.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c10b21700 1 -- 172.21.15.49:0/3534552545 learned_addr learned my addr 172.21.15.49:0/3534552545 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:06.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c11322700 1 --2- 172.21.15.49:0/3534552545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c0c0c1470 0x7f4c0c0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:06.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c11b23700 1 --2- 172.21.15.49:0/3534552545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c0c160370 0x7f4c0c14b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c10b21700 1 -- 172.21.15.49:0/3534552545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c0c0c1470 msgr2=0x7f4c0c0c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c10b21700 1 --2- 172.21.15.49:0/3534552545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c0c0c1470 0x7f4c0c0c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c10b21700 1 -- 172.21.15.49:0/3534552545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c0c160370 msgr2=0x7f4c0c14b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c10b21700 1 --2- 172.21.15.49:0/3534552545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c0c160370 0x7f4c0c14b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c10b21700 1 -- 172.21.15.49:0/3534552545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c08009570 con 0x7f4c0c0ca490 2023-07-21T22:14:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c10b21700 1 --2- 172.21.15.49:0/3534552545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c0c0ca490 0x7f4c0c14b100 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00c500 tx=0x7f4bfc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:06.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c01ffb700 1 -- 172.21.15.49:0/3534552545 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0052d0 con 0x7f4c0c0ca490 2023-07-21T22:14:06.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c01ffb700 1 -- 172.21.15.49:0/3534552545 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc005430 con 0x7f4c0c0ca490 2023-07-21T22:14:06.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c12324700 1 -- 172.21.15.49:0/3534552545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0c0c73c0 con 0x7f4c0c0ca490 2023-07-21T22:14:06.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c01ffb700 1 -- 172.21.15.49:0/3534552545 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0055a0 con 0x7f4c0c0ca490 2023-07-21T22:14:06.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.465+0000 7f4c12324700 1 -- 172.21.15.49:0/3534552545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0c0c7980 con 0x7f4c0c0ca490 2023-07-21T22:14:06.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.469+0000 7f4c12324700 1 -- 172.21.15.49:0/3534552545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0c04dcb0 con 0x7f4c0c0ca490 2023-07-21T22:14:06.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.469+0000 7f4c01ffb700 1 -- 172.21.15.49:0/3534552545 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4bfc0038e0 con 0x7f4c0c0ca490 2023-07-21T22:14:06.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.473+0000 7f4c01ffb700 1 --2- 172.21.15.49:0/3534552545 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4bf00662f0 0x7f4bf00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:06.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.473+0000 7f4c01ffb700 1 -- 172.21.15.49:0/3534552545 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4bfc083310 con 0x7f4c0c0ca490 2023-07-21T22:14:06.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.473+0000 7f4c11322700 1 --2- 172.21.15.49:0/3534552545 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4bf00662f0 0x7f4bf00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:06.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.473+0000 7f4c11322700 1 --2- 172.21.15.49:0/3534552545 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4bf00662f0 0x7f4bf00687a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4c08000c00 tx=0x7f4c08008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:06.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.477+0000 7f4c01ffb700 1 -- 172.21.15.49:0/3534552545 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4bfc0505b0 con 0x7f4c0c0ca490 2023-07-21T22:14:06.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.689+0000 7f4c12324700 1 -- 172.21.15.49:0/3534552545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4c0c0ad7b0 con 0x7f4c0c0ca490 2023-07-21T22:14:06.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.693+0000 7f4c01ffb700 1 -- 172.21.15.49:0/3534552545 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4bfc053bd0 con 0x7f4c0c0ca490 2023-07-21T22:14:06.736 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:14:06.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.693+0000 7f4c12324700 1 -- 172.21.15.49:0/3534552545 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4bf00662f0 msgr2=0x7f4bf00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:06.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.693+0000 7f4c12324700 1 --2- 172.21.15.49:0/3534552545 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4bf00662f0 0x7f4bf00687a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4c08000c00 tx=0x7f4c08008030 comp rx=0 tx=0).stop 2023-07-21T22:14:06.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.693+0000 7f4c12324700 1 -- 172.21.15.49:0/3534552545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c0c0ca490 msgr2=0x7f4c0c14b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:06.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.693+0000 7f4c12324700 1 --2- 172.21.15.49:0/3534552545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c0c0ca490 0x7f4c0c14b100 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00c500 tx=0x7f4bfc00c810 comp rx=0 tx=0).stop 2023-07-21T22:14:06.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.693+0000 7f4c12324700 1 -- 172.21.15.49:0/3534552545 shutdown_connections 2023-07-21T22:14:06.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.693+0000 7f4c12324700 1 --2- 172.21.15.49:0/3534552545 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4bf00662f0 0x7f4bf00687a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:06.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.693+0000 7f4c12324700 1 --2- 172.21.15.49:0/3534552545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c0c0ca490 0x7f4c0c14b100 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:06.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.693+0000 7f4c12324700 1 --2- 172.21.15.49:0/3534552545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c0c160370 0x7f4c0c14b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:06.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.693+0000 7f4c12324700 1 --2- 172.21.15.49:0/3534552545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c0c0c1470 0x7f4c0c0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:06.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.693+0000 7f4c12324700 1 -- 172.21.15.49:0/3534552545 >> 172.21.15.49:0/3534552545 conn(0x7f4c0c070450 msgr2=0x7f4c0c0ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:06.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.693+0000 7f4c12324700 1 -- 172.21.15.49:0/3534552545 shutdown_connections 2023-07-21T22:14:06.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:06.693+0000 7f4c12324700 1 -- 172.21.15.49:0/3534552545 wait complete. 2023-07-21T22:14:06.758 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:14:06.758 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:14:06.759 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-07-21T22:14:06.759 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:14:06.760 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:06.760 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:14:06.760 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:14:06.761 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:14:06.761 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:14:06.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:06.762 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-07-21T22:14:06.781 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:14:06.781 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:14:06.781 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:14:06.781 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:06.781 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-07-21T22:14:06.782 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:06.782 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:14:06.782 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:14:06.782 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-07-21T22:14:06.782 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:14:06.782 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:14:06.782 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-07-21T22:14:06.783 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:14:06.783 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:14:06.783 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-07-21T22:14:06.783 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:14:06.783 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42107sec preferred_lft 42107sec 2023-07-21T22:14:06.783 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-07-21T22:14:06.783 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:06.783 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:14:06.784 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:14:06.784 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-07-21T22:14:06.784 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:14:06.784 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:19:e1:20:16 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:14:06.784 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:14:06.784 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:06.784 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:14:06.785 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether aa:11:6f:e1:a1:5e brd ff:ff:ff:ff:ff:ff 2023-07-21T22:14:06.785 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:14:06.785 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:06.785 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec43:77ff:fe1f:6f26/64 scope link 2023-07-21T22:14:06.785 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:06.785 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:14:06.785 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether aa:11:6f:e1:a1:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:14:06.785 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a811:6fff:fee1:a15e/64 scope link 2023-07-21T22:14:06.786 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:06.786 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:14:06.786 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether da:09:9c:11:2a:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:14:06.786 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::d809:9cff:fe11:2aa0/64 scope link 2023-07-21T22:14:06.786 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:06.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:06.787 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:14:06.873 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-07-21T22:14:06.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:06.876 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-07-21T22:14:06.943 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-07-21T22:14:06.943 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:14:06.944 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:14:06.944 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:14:06.944 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:14:06.945 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:14:06.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:06.946 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:14:06.946 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:14:06.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:14:06.948 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:14:06.948 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:14:06.948 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:14:07.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:07.092 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-07-21T22:14:07.110 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:14:07.110 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:14:07.111 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:14:07.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:07.111 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-07-21T22:14:07.187 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-21T22:14:07.188 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:14:07.188 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:07.250 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:14:07.250 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:14:07.250 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:07.311 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:14:07.394 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:14:07.395 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:14:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:14:07.472 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:14:07.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:07.474 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:14:07.536 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-21T22:14:07.536 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-21T22:14:07.589 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:14:07.625 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:14:07.626 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:14:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:14:07.703 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:14:07.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:07.705 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:14:07.742 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2023-07-21T22:14:07.697+0000 7fc50dfcf640 -1 init, newargv = 0x557f0daa1cf0 newargc=15 2023-07-21T22:14:07.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[48834]: starting ceph client 2023-07-21T22:14:07.754 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[48834]: starting fuse 2023-07-21T22:14:07.757 INFO:teuthology.orchestra.run.smithi049.stdout:49 2023-07-21T22:14:07.758 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-07-21T22:14:07.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T22:14:07.758 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2023-07-21T22:14:07.759 DEBUG:teuthology.orchestra.run.smithi049:> import re 2023-07-21T22:14:07.759 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-07-21T22:14:07.759 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-07-21T22:14:07.760 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:14:07.760 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2023-07-21T22:14:07.760 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-21T22:14:07.761 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2023-07-21T22:14:07.761 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-21T22:14:07.761 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:14:07.762 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2023-07-21T22:14:07.762 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2023-07-21T22:14:07.763 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2023-07-21T22:14:07.763 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2023-07-21T22:14:07.763 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:14:07.763 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2023-07-21T22:14:07.764 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T22:14:07.764 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T22:14:07.764 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T22:14:07.765 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2023-07-21T22:14:07.765 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2023-07-21T22:14:07.765 DEBUG:teuthology.orchestra.run.smithi049:> return f 2023-07-21T22:14:07.765 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T22:14:07.766 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:14:07.766 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2023-07-21T22:14:07.766 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-07-21T22:14:07.921 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.48834.asok 2023-07-21T22:14:08.106 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48834.asok 2023-07-21T22:14:08.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:08.106 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48834.asok status 2023-07-21T22:14:08.305 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:14:08.306 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2023-07-21T22:14:08.306 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea", 2023-07-21T22:14:08.306 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:14:08.306 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2023-07-21T22:14:08.306 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2023-07-21T22:14:08.307 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-21T22:14:08.307 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "48834", 2023-07-21T22:14:08.307 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2023-07-21T22:14:08.307 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:14:08.307 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2023-07-21T22:14:08.307 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2023-07-21T22:14:08.308 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6702, 2023-07-21T22:14:08.308 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2023-07-21T22:14:08.308 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2023-07-21T22:14:08.308 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2023-07-21T22:14:08.308 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 6702 2023-07-21T22:14:08.308 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:14:08.308 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:14:08.308 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:14:08.309 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:14:08.309 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 3822138365 2023-07-21T22:14:08.309 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:14:08.309 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:14:08.309 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:14:08.309 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:14:08.309 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:14:08.310 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 3822138365 2023-07-21T22:14:08.310 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:14:08.310 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.6702 192.168.0.1:0/3822138365", 2023-07-21T22:14:08.310 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/3822138365", 2023-07-21T22:14:08.310 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2023-07-21T22:14:08.310 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 26, 2023-07-21T22:14:08.310 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 62, 2023-07-21T22:14:08.310 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2023-07-21T22:14:08.311 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2023-07-21T22:14:08.311 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2023-07-21T22:14:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:14:08.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:08.321 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2023-07-21T22:14:08.321 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:08.337 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2023-07-21T22:14:08.337 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:08.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:08.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:08.414 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T22:14:08.415 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-07-21T22:14:08.415 DEBUG:teuthology.orchestra.run.smithi049:> import errno 2023-07-21T22:14:08.415 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:14:08.415 DEBUG:teuthology.orchestra.run.smithi049:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-07-21T22:14:08.416 DEBUG:teuthology.orchestra.run.smithi049:> try: 2023-07-21T22:14:08.416 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2023-07-21T22:14:08.416 DEBUG:teuthology.orchestra.run.smithi049:> ret = os.read(fd, 1024) 2023-07-21T22:14:08.417 DEBUG:teuthology.orchestra.run.smithi049:> else: 2023-07-21T22:14:08.417 DEBUG:teuthology.orchestra.run.smithi049:> os.write(fd, b'"'"'content'"'"') 2023-07-21T22:14:08.417 DEBUG:teuthology.orchestra.run.smithi049:> except OSError as e: 2023-07-21T22:14:08.417 DEBUG:teuthology.orchestra.run.smithi049:> if e.errno != errno.EPERM: 2023-07-21T22:14:08.418 DEBUG:teuthology.orchestra.run.smithi049:> raise 2023-07-21T22:14:08.418 DEBUG:teuthology.orchestra.run.smithi049:> else: 2023-07-21T22:14:08.418 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("client does not check permission of data pool") 2023-07-21T22:14:08.418 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-07-21T22:14:08.740 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2023-07-21T22:14:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.933+0000 7f942d5dc700 1 Processor -- start 2023-07-21T22:14:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.933+0000 7f942d5dc700 1 -- start start 2023-07-21T22:14:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f942d5dc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f94280cf100 0x7f94280d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f942d5dc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94280b5460 con 0x7f942815bed0 2023-07-21T22:14:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f942d5dc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94280d1030 con 0x7f94280d07b0 2023-07-21T22:14:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f942d5dc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94280d1310 con 0x7f94280cf100 2023-07-21T22:14:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f9427fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f942815bed0 0x7f94280ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41806/0 (socket says 172.21.15.49:41806) 2023-07-21T22:14:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f9427fff700 1 -- 172.21.15.49:0/2089355356 learned_addr learned my addr 172.21.15.49:0/2089355356 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f941f7fe700 1 --2- 172.21.15.49:0/2089355356 >> v2:172.21.15.150:3300/0 conn(0x7f94280cf100 0x7f94280d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 -- 172.21.15.49:0/2089355356 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113087123 0 0) 0x7f94280b5460 con 0x7f942815bed0 2023-07-21T22:14:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 -- 172.21.15.49:0/2089355356 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94140035d0 con 0x7f942815bed0 2023-07-21T22:14:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 -- 172.21.15.49:0/2089355356 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 690359704 0 0) 0x7f94140035d0 con 0x7f942815bed0 2023-07-21T22:14:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 -- 172.21.15.49:0/2089355356 >> v2:172.21.15.150:3300/0 conn(0x7f94280cf100 msgr2=0x7f94280d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 --2- 172.21.15.49:0/2089355356 >> v2:172.21.15.150:3300/0 conn(0x7f94280cf100 0x7f94280d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 -- 172.21.15.49:0/2089355356 >> v1:172.21.15.150:6789/0 conn(0x7f94280d07b0 legacy=0x7f94280b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 -- 172.21.15.49:0/2089355356 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94280d15f0 con 0x7f942815bed0 2023-07-21T22:14:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 -- 172.21.15.49:0/2089355356 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f9418001670 con 0x7f942815bed0 2023-07-21T22:14:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 -- 172.21.15.49:0/2089355356 >> v1:172.21.15.49:6789/0 conn(0x7f942815bed0 legacy=0x7f94280ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 --2- 172.21.15.49:0/2089355356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9414003a20 0x7f9414003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 --2- 172.21.15.49:0/2089355356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9414004870 0x7f9414004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 --2- 172.21.15.49:0/2089355356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9414005220 0x7f941400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 -- 172.21.15.49:0/2089355356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94280d1310 con 0x7f9414005220 2023-07-21T22:14:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 -- 172.21.15.49:0/2089355356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941400c0a0 con 0x7f9414004870 2023-07-21T22:14:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f94277fe700 1 -- 172.21.15.49:0/2089355356 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941400c260 con 0x7f9414003a20 2023-07-21T22:14:08.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f941f7fe700 1 --2- 172.21.15.49:0/2089355356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9414004870 0x7f9414004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:08.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f942cddb700 1 --2- 172.21.15.49:0/2089355356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9414005220 0x7f941400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:08.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.937+0000 7f9427fff700 1 --2- 172.21.15.49:0/2089355356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9414003a20 0x7f9414003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f9427fff700 1 -- 172.21.15.49:0/2089355356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9414004870 msgr2=0x7f9414004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f9427fff700 1 --2- 172.21.15.49:0/2089355356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9414004870 0x7f9414004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f9427fff700 1 -- 172.21.15.49:0/2089355356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9414005220 msgr2=0x7f941400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f9427fff700 1 --2- 172.21.15.49:0/2089355356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9414005220 0x7f941400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f9427fff700 1 -- 172.21.15.49:0/2089355356 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94140035d0 con 0x7f9414003a20 2023-07-21T22:14:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f942cddb700 1 --2- 172.21.15.49:0/2089355356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9414005220 0x7f941400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:14:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f941f7fe700 1 --2- 172.21.15.49:0/2089355356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9414004870 0x7f9414004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:14:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f942cddb700 1 -- 172.21.15.49:0/2089355356 reap_dead start 2023-07-21T22:14:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f9427fff700 1 --2- 172.21.15.49:0/2089355356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9414003a20 0x7f9414003e30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f941800c320 tx=0x7f94140058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bee98a84b16c8ec server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f94277fe700 1 -- 172.21.15.49:0/2089355356 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418007c30 con 0x7f9414003a20 2023-07-21T22:14:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f94277fe700 1 -- 172.21.15.49:0/2089355356 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941800ce80 con 0x7f9414003a20 2023-07-21T22:14:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f94277fe700 1 -- 172.21.15.49:0/2089355356 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418005bc0 con 0x7f9414003a20 2023-07-21T22:14:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f942d5dc700 1 -- 172.21.15.49:0/2089355356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9414003a20 msgr2=0x7f9414003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f942d5dc700 1 --2- 172.21.15.49:0/2089355356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9414003a20 0x7f9414003e30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f941800c320 tx=0x7f94140058a0 comp rx=0 tx=0).stop 2023-07-21T22:14:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f942d5dc700 1 -- 172.21.15.49:0/2089355356 shutdown_connections 2023-07-21T22:14:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f942d5dc700 1 --2- 172.21.15.49:0/2089355356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9414003a20 0x7f9414003e30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f942d5dc700 1 -- 172.21.15.49:0/2089355356 >> 172.21.15.49:0/2089355356 conn(0x7f9428065af0 msgr2=0x7f942806fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f942d5dc700 1 -- 172.21.15.49:0/2089355356 shutdown_connections 2023-07-21T22:14:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.941+0000 7f942d5dc700 1 -- 172.21.15.49:0/2089355356 wait complete. 2023-07-21T22:14:08.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f942d5dc700 1 Processor -- start 2023-07-21T22:14:08.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f942d5dc700 1 -- start start 2023-07-21T22:14:08.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f942d5dc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9414003a20 0x7f9428158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:08.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f942d5dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94280c8490 0x7f942815dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:08.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f942d5dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942815c2a0 0x7f94281e5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:08.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f942d5dc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9428159270 con 0x7f94280c8490 2023-07-21T22:14:08.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f942d5dc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942815d7b0 con 0x7f9414003a20 2023-07-21T22:14:08.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f942d5dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942815e180 con 0x7f942815c2a0 2023-07-21T22:14:08.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f941f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94280c8490 0x7f942815dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:08.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f941f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94280c8490 0x7f942815dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40318/0 (socket says 172.21.15.49:40318) 2023-07-21T22:14:08.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f941f7fe700 1 -- 172.21.15.49:0/942933673 learned_addr learned my addr 172.21.15.49:0/942933673 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:08.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f942cddb700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942815c2a0 0x7f94281e5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:08.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f9427fff700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9414003a20 0x7f9428158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:08.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f941f7fe700 1 -- 172.21.15.49:0/942933673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942815c2a0 msgr2=0x7f94281e5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:08.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f941f7fe700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942815c2a0 0x7f94281e5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:08.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f941f7fe700 1 -- 172.21.15.49:0/942933673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9414003a20 msgr2=0x7f9428158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:08.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f941f7fe700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9414003a20 0x7f9428158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:08.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f941f7fe700 1 -- 172.21.15.49:0/942933673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942815cba0 con 0x7f94280c8490 2023-07-21T22:14:08.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f9427fff700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9414003a20 0x7f9428158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:08.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f942cddb700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942815c2a0 0x7f94281e5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:08.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.945+0000 7f941f7fe700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94280c8490 0x7f942815dc40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f941000f440 tx=0x7f941000f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:08.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.949+0000 7f94257fa700 1 -- 172.21.15.49:0/942933673 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941000e040 con 0x7f94280c8490 2023-07-21T22:14:08.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.949+0000 7f94257fa700 1 -- 172.21.15.49:0/942933673 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941000f040 con 0x7f94280c8490 2023-07-21T22:14:08.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.949+0000 7f94257fa700 1 -- 172.21.15.49:0/942933673 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410003e60 con 0x7f94280c8490 2023-07-21T22:14:08.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.949+0000 7f942d5dc700 1 -- 172.21.15.49:0/942933673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942815ce80 con 0x7f94280c8490 2023-07-21T22:14:08.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.949+0000 7f942d5dc700 1 -- 172.21.15.49:0/942933673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942815d440 con 0x7f94280c8490 2023-07-21T22:14:08.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.949+0000 7f942d5dc700 1 -- 172.21.15.49:0/942933673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f942804dcb0 con 0x7f94280c8490 2023-07-21T22:14:08.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.949+0000 7f94257fa700 1 -- 172.21.15.49:0/942933673 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9410004020 con 0x7f94280c8490 2023-07-21T22:14:08.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.953+0000 7f94257fa700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9408066320 0x7f94080687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:08.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.953+0000 7f94257fa700 1 -- 172.21.15.49:0/942933673 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9410084650 con 0x7f94280c8490 2023-07-21T22:14:08.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.953+0000 7f9427fff700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9408066320 0x7f94080687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:08.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.953+0000 7f9427fff700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9408066320 0x7f94080687d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9418001930 tx=0x7f9418007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:09.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:08.957+0000 7f94257fa700 1 -- 172.21.15.49:0/942933673 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94100518f0 con 0x7f94280c8490 2023-07-21T22:14:09.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.193+0000 7f942d5dc700 1 -- 172.21.15.49:0/942933673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) v1 -- 0x7f942815d8f0 con 0x7f94280c8490 2023-07-21T22:14:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.201+0000 7f94257fa700 1 -- 172.21.15.49:0/942933673 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v19) v1 ==== 183+0+140 (secure 0 0 0) 0x7f9410054f10 con 0x7f94280c8490 2023-07-21T22:14:09.245 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2023-07-21T22:14:09.246 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtkU5ZaIRAAchCJhuM71+rGOBHBlX77wA== 2023-07-21T22:14:09.246 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow" 2023-07-21T22:14:09.246 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2023-07-21T22:14:09.246 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow w pool=cephfs_data" 2023-07-21T22:14:09.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.205+0000 7f942d5dc700 1 -- 172.21.15.49:0/942933673 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9408066320 msgr2=0x7f94080687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:09.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.205+0000 7f942d5dc700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9408066320 0x7f94080687d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9418001930 tx=0x7f9418007000 comp rx=0 tx=0).stop 2023-07-21T22:14:09.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.205+0000 7f942d5dc700 1 -- 172.21.15.49:0/942933673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94280c8490 msgr2=0x7f942815dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:09.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.205+0000 7f942d5dc700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94280c8490 0x7f942815dc40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f941000f440 tx=0x7f941000f800 comp rx=0 tx=0).stop 2023-07-21T22:14:09.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.205+0000 7f942d5dc700 1 -- 172.21.15.49:0/942933673 shutdown_connections 2023-07-21T22:14:09.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.205+0000 7f942d5dc700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9408066320 0x7f94080687d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.205+0000 7f942d5dc700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94280c8490 0x7f942815dc40 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.205+0000 7f942d5dc700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f942815c2a0 0x7f94281e5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.205+0000 7f942d5dc700 1 --2- 172.21.15.49:0/942933673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9414003a20 0x7f9428158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.205+0000 7f942d5dc700 1 -- 172.21.15.49:0/942933673 >> 172.21.15.49:0/942933673 conn(0x7f9428065af0 msgr2=0x7f9428159680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:09.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.205+0000 7f942d5dc700 1 -- 172.21.15.49:0/942933673 shutdown_connections 2023-07-21T22:14:09.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.205+0000 7f942d5dc700 1 -- 172.21.15.49:0/942933673 wait complete. 2023-07-21T22:14:09.253 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-07-21T22:14:09.273 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:14:09.274 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:14:09.290 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:14:09.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.461+0000 7f1df6aac700 1 Processor -- start 2023-07-21T22:14:09.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.461+0000 7f1df6aac700 1 -- start start 2023-07-21T22:14:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.465+0000 7f1df6aac700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1df01628f0 0x7f1df0164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.465+0000 7f1df6aac700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df00b0330 con 0x7f1df006d5d0 2023-07-21T22:14:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.465+0000 7f1df6aac700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df00b0600 con 0x7f1df0159f60 2023-07-21T22:14:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.465+0000 7f1df6aac700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df015a470 con 0x7f1df01628f0 2023-07-21T22:14:09.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.465+0000 7f1df4848700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1df006d5d0 0x7f1df006d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41810/0 (socket says 172.21.15.49:41810) 2023-07-21T22:14:09.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.465+0000 7f1df4848700 1 -- 172.21.15.49:0/3177617672 learned_addr learned my addr 172.21.15.49:0/3177617672 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:09.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.465+0000 7f1df5049700 1 --2- 172.21.15.49:0/3177617672 >> v2:172.21.15.49:3300/0 conn(0x7f1df01628f0 0x7f1df0164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:09.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.465+0000 7f1df5049700 1 -- 172.21.15.49:0/3177617672 >> v1:172.21.15.150:6789/0 conn(0x7f1df0159f60 legacy=0x7f1df00afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:09.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.465+0000 7f1df5049700 1 -- 172.21.15.49:0/3177617672 >> v1:172.21.15.49:6789/0 conn(0x7f1df006d5d0 legacy=0x7f1df006d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:09.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.465+0000 7f1df5049700 1 -- 172.21.15.49:0/3177617672 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df015a750 con 0x7f1df01628f0 2023-07-21T22:14:09.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.465+0000 7f1df5049700 1 --2- 172.21.15.49:0/3177617672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df01628f0 0x7f1df0164cd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009d90 tx=0x7f1de800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0278f0489a15645 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:09.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.469+0000 7f1def7fe700 1 -- 172.21.15.49:0/3177617672 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de800e070 con 0x7f1df01628f0 2023-07-21T22:14:09.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.469+0000 7f1def7fe700 1 -- 172.21.15.49:0/3177617672 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de800bbd0 con 0x7f1df01628f0 2023-07-21T22:14:09.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.469+0000 7f1def7fe700 1 -- 172.21.15.49:0/3177617672 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8012430 con 0x7f1df01628f0 2023-07-21T22:14:09.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.469+0000 7f1df6aac700 1 -- 172.21.15.49:0/3177617672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df01628f0 msgr2=0x7f1df0164cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:09.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.469+0000 7f1df6aac700 1 --2- 172.21.15.49:0/3177617672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df01628f0 0x7f1df0164cd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009d90 tx=0x7f1de800b330 comp rx=0 tx=0).stop 2023-07-21T22:14:09.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.469+0000 7f1df6aac700 1 -- 172.21.15.49:0/3177617672 shutdown_connections 2023-07-21T22:14:09.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.469+0000 7f1df6aac700 1 --2- 172.21.15.49:0/3177617672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df01628f0 0x7f1df0164cd0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.469+0000 7f1df6aac700 1 -- 172.21.15.49:0/3177617672 >> 172.21.15.49:0/3177617672 conn(0x7f1df006f5a0 msgr2=0x7f1df00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:09.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.469+0000 7f1df6aac700 1 -- 172.21.15.49:0/3177617672 shutdown_connections 2023-07-21T22:14:09.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.469+0000 7f1df6aac700 1 -- 172.21.15.49:0/3177617672 wait complete. 2023-07-21T22:14:09.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.469+0000 7f1df6aac700 1 Processor -- start 2023-07-21T22:14:09.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.469+0000 7f1df6aac700 1 -- start start 2023-07-21T22:14:09.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df6aac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df006d5d0 0x7f1df014eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df6aac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1df0159f60 0x7f1df0154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df6aac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1df01628f0 0x7f1df0154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df6aac700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df0159140 con 0x7f1df006d5d0 2023-07-21T22:14:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df6aac700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df01584c0 con 0x7f1df01628f0 2023-07-21T22:14:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df6aac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df01587a0 con 0x7f1df0159f60 2023-07-21T22:14:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df4848700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df006d5d0 0x7f1df014eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:09.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df4848700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df006d5d0 0x7f1df014eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40338/0 (socket says 172.21.15.49:40338) 2023-07-21T22:14:09.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df4848700 1 -- 172.21.15.49:0/1663239526 learned_addr learned my addr 172.21.15.49:0/1663239526 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:09.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1deffff700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1df0159f60 0x7f1df0154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:09.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df5049700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1df01628f0 0x7f1df0154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:09.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df4848700 1 -- 172.21.15.49:0/1663239526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1df0159f60 msgr2=0x7f1df0154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:09.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df4848700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1df0159f60 0x7f1df0154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df4848700 1 -- 172.21.15.49:0/1663239526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1df01628f0 msgr2=0x7f1df0154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:09.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df4848700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1df01628f0 0x7f1df0154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df4848700 1 -- 172.21.15.49:0/1663239526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de8009a70 con 0x7f1df006d5d0 2023-07-21T22:14:09.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df5049700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1df01628f0 0x7f1df0154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df4848700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df006d5d0 0x7f1df014eb20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f1de4001eb0 tx=0x7f1de400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1ded7fa700 1 -- 172.21.15.49:0/1663239526 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4005d90 con 0x7f1df006d5d0 2023-07-21T22:14:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1ded7fa700 1 -- 172.21.15.49:0/1663239526 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de40070d0 con 0x7f1df006d5d0 2023-07-21T22:14:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1ded7fa700 1 -- 172.21.15.49:0/1663239526 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4007440 con 0x7f1df006d5d0 2023-07-21T22:14:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df6aac700 1 -- 172.21.15.49:0/1663239526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df0158a80 con 0x7f1df006d5d0 2023-07-21T22:14:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.473+0000 7f1df6aac700 1 -- 172.21.15.49:0/1663239526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df01577d0 con 0x7f1df006d5d0 2023-07-21T22:14:09.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.477+0000 7f1df6aac700 1 -- 172.21.15.49:0/1663239526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df0073130 con 0x7f1df006d5d0 2023-07-21T22:14:09.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.477+0000 7f1ded7fa700 1 -- 172.21.15.49:0/1663239526 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1de40075a0 con 0x7f1df006d5d0 2023-07-21T22:14:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.481+0000 7f1ded7fa700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1dd40662f0 0x7f1dd40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:09.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.481+0000 7f1ded7fa700 1 -- 172.21.15.49:0/1663239526 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1de40831a0 con 0x7f1df006d5d0 2023-07-21T22:14:09.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.481+0000 7f1deffff700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1dd40662f0 0x7f1dd40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:09.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.481+0000 7f1deffff700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1dd40662f0 0x7f1dd40687a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1df015b1f0 tx=0x7f1ddc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:09.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.485+0000 7f1ded7fa700 1 -- 172.21.15.49:0/1663239526 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1de40504f0 con 0x7f1df006d5d0 2023-07-21T22:14:09.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.661+0000 7f1df6aac700 1 -- 172.21.15.49:0/1663239526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1df004dcb0 con 0x7f1df006d5d0 2023-07-21T22:14:09.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.661+0000 7f1ded7fa700 1 -- 172.21.15.49:0/1663239526 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+18462 (secure 0 0 0) 0x7f1de4053b10 con 0x7f1df006d5d0 2023-07-21T22:14:09.707 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:09.708 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":62,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:13:42.072628+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:13:38.569931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:13:39.558524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:14:09.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.665+0000 7f1df6aac700 1 -- 172.21.15.49:0/1663239526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1dd40662f0 msgr2=0x7f1dd40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:09.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.665+0000 7f1df6aac700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1dd40662f0 0x7f1dd40687a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1df015b1f0 tx=0x7f1ddc009040 comp rx=0 tx=0).stop 2023-07-21T22:14:09.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.665+0000 7f1df6aac700 1 -- 172.21.15.49:0/1663239526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df006d5d0 msgr2=0x7f1df014eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:09.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.665+0000 7f1df6aac700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df006d5d0 0x7f1df014eb20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f1de4001eb0 tx=0x7f1de400c7b0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.665+0000 7f1df6aac700 1 -- 172.21.15.49:0/1663239526 shutdown_connections 2023-07-21T22:14:09.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.665+0000 7f1df6aac700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f1dd40662f0 0x7f1dd40687a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.665+0000 7f1df6aac700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1df01628f0 0x7f1df0154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.665+0000 7f1df6aac700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1df0159f60 0x7f1df0154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.665+0000 7f1df6aac700 1 --2- 172.21.15.49:0/1663239526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df006d5d0 0x7f1df014eb20 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.665+0000 7f1df6aac700 1 -- 172.21.15.49:0/1663239526 >> 172.21.15.49:0/1663239526 conn(0x7f1df006f5a0 msgr2=0x7f1df006bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:09.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.665+0000 7f1df6aac700 1 -- 172.21.15.49:0/1663239526 shutdown_connections 2023-07-21T22:14:09.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.665+0000 7f1df6aac700 1 -- 172.21.15.49:0/1663239526 wait complete. 2023-07-21T22:14:09.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:13:38.569931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:13:39.558524+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:14:09.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:14:09.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.865+0000 7fa2ad29f700 1 Processor -- start 2023-07-21T22:14:09.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.869+0000 7fa2ad29f700 1 -- start start 2023-07-21T22:14:09.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.869+0000 7fa2ad29f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2a80ca550 0x7fa2a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:09.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.869+0000 7fa2ad29f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a80c8b80 con 0x7fa2a806d6d0 2023-07-21T22:14:09.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.869+0000 7fa2ad29f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a806db90 con 0x7fa2a8159be0 2023-07-21T22:14:09.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.869+0000 7fa2ad29f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a80c9720 con 0x7fa2a80ca550 2023-07-21T22:14:09.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.869+0000 7fa2aca9e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa2a806d6d0 0x7fa2a80698a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41822/0 (socket says 172.21.15.49:41822) 2023-07-21T22:14:09.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.869+0000 7fa2aca9e700 1 -- 172.21.15.49:0/235612767 learned_addr learned my addr 172.21.15.49:0/235612767 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:09.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.869+0000 7fa29ffff700 1 --2- 172.21.15.49:0/235612767 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2a80ca550 0x7fa2a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:09.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa2a77fe700 1 -- 172.21.15.49:0/235612767 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815585027 0 0) 0x7fa2a80c8b80 con 0x7fa2a806d6d0 2023-07-21T22:14:09.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa2a77fe700 1 -- 172.21.15.49:0/235612767 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2940035d0 con 0x7fa2a806d6d0 2023-07-21T22:14:09.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa2a77fe700 1 -- 172.21.15.49:0/235612767 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549595391 0 0) 0x7fa2a806db90 con 0x7fa2a8159be0 2023-07-21T22:14:09.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa2a77fe700 1 -- 172.21.15.49:0/235612767 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2a80c8b80 con 0x7fa2a8159be0 2023-07-21T22:14:09.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa29ffff700 1 -- 172.21.15.49:0/235612767 >> v1:172.21.15.150:6789/0 conn(0x7fa2a8159be0 legacy=0x7fa2a80c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:09.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa29ffff700 1 -- 172.21.15.49:0/235612767 >> v1:172.21.15.49:6789/0 conn(0x7fa2a806d6d0 legacy=0x7fa2a80698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:09.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa29ffff700 1 -- 172.21.15.49:0/235612767 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a806de70 con 0x7fa2a80ca550 2023-07-21T22:14:09.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa29ffff700 1 --2- 172.21.15.49:0/235612767 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2a80ca550 0x7fa2a806d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa290009880 tx=0x7fa290009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1ce070553289baa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:09.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa2a77fe700 1 -- 172.21.15.49:0/235612767 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290011830 con 0x7fa2a80ca550 2023-07-21T22:14:09.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa2a77fe700 1 -- 172.21.15.49:0/235612767 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa290011990 con 0x7fa2a80ca550 2023-07-21T22:14:09.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa2a77fe700 1 -- 172.21.15.49:0/235612767 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290011d20 con 0x7fa2a80ca550 2023-07-21T22:14:09.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa2ad29f700 1 -- 172.21.15.49:0/235612767 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2a80ca550 msgr2=0x7fa2a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:09.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa2ad29f700 1 --2- 172.21.15.49:0/235612767 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2a80ca550 0x7fa2a806d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa290009880 tx=0x7fa290009b90 comp rx=0 tx=0).stop 2023-07-21T22:14:09.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa2ad29f700 1 -- 172.21.15.49:0/235612767 shutdown_connections 2023-07-21T22:14:09.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa2ad29f700 1 --2- 172.21.15.49:0/235612767 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2a80ca550 0x7fa2a806d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa2ad29f700 1 -- 172.21.15.49:0/235612767 >> 172.21.15.49:0/235612767 conn(0x7fa2a80ce0d0 msgr2=0x7fa2a80ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa2ad29f700 1 -- 172.21.15.49:0/235612767 shutdown_connections 2023-07-21T22:14:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.873+0000 7fa2ad29f700 1 -- 172.21.15.49:0/235612767 wait complete. 2023-07-21T22:14:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.877+0000 7fa2ad29f700 1 Processor -- start 2023-07-21T22:14:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.877+0000 7fa2ad29f700 1 -- start start 2023-07-21T22:14:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.877+0000 7fa2ad29f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2a806d6d0 0x7fa2a80ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.877+0000 7fa2ad29f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2a80ca550 0x7fa2a815be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:09.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.877+0000 7fa2ad29f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2a8159be0 0x7fa2a815c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:09.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.877+0000 7fa2ad29f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a815cc40 con 0x7fa2a8159be0 2023-07-21T22:14:09.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.877+0000 7fa2ad29f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a815ce70 con 0x7fa2a80ca550 2023-07-21T22:14:09.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.877+0000 7fa2ad29f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a80adbe0 con 0x7fa2a806d6d0 2023-07-21T22:14:09.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.877+0000 7fa2aca9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2a8159be0 0x7fa2a815c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:09.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.877+0000 7fa2aca9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2a8159be0 0x7fa2a815c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40340/0 (socket says 172.21.15.49:40340) 2023-07-21T22:14:09.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.877+0000 7fa2aca9e700 1 -- 172.21.15.49:0/4175291656 learned_addr learned my addr 172.21.15.49:0/4175291656 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.877+0000 7fa2a7fff700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2a806d6d0 0x7fa2a80ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.877+0000 7fa29ffff700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2a80ca550 0x7fa2a815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.881+0000 7fa2aca9e700 1 -- 172.21.15.49:0/4175291656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2a806d6d0 msgr2=0x7fa2a80ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.881+0000 7fa2aca9e700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2a806d6d0 0x7fa2a80ae9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.881+0000 7fa2aca9e700 1 -- 172.21.15.49:0/4175291656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2a80ca550 msgr2=0x7fa2a815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.881+0000 7fa2aca9e700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2a80ca550 0x7fa2a815be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.881+0000 7fa2aca9e700 1 -- 172.21.15.49:0/4175291656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900094b0 con 0x7fa2a8159be0 2023-07-21T22:14:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.881+0000 7fa29ffff700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2a80ca550 0x7fa2a815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:09.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.881+0000 7fa2aca9e700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2a8159be0 0x7fa2a815c700 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000caa0 tx=0x7fa2a000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:09.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.881+0000 7fa2a57fa700 1 -- 172.21.15.49:0/4175291656 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0007480 con 0x7fa2a8159be0 2023-07-21T22:14:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.881+0000 7fa2a57fa700 1 -- 172.21.15.49:0/4175291656 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a00075e0 con 0x7fa2a8159be0 2023-07-21T22:14:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.881+0000 7fa2ad29f700 1 -- 172.21.15.49:0/4175291656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a80adec0 con 0x7fa2a8159be0 2023-07-21T22:14:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.881+0000 7fa2a57fa700 1 -- 172.21.15.49:0/4175291656 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0007950 con 0x7fa2a8159be0 2023-07-21T22:14:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.881+0000 7fa2ad29f700 1 -- 172.21.15.49:0/4175291656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a80ae480 con 0x7fa2a8159be0 2023-07-21T22:14:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.881+0000 7fa2ad29f700 1 -- 172.21.15.49:0/4175291656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a80ae670 con 0x7fa2a8159be0 2023-07-21T22:14:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.881+0000 7fa2a57fa700 1 -- 172.21.15.49:0/4175291656 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa2a001b3b0 con 0x7fa2a8159be0 2023-07-21T22:14:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.885+0000 7fa2a57fa700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2880662f0 0x7fa2880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.885+0000 7fa2a57fa700 1 -- 172.21.15.49:0/4175291656 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa2a0083580 con 0x7fa2a8159be0 2023-07-21T22:14:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.885+0000 7fa2a7fff700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2880662f0 0x7fa2880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.885+0000 7fa2a7fff700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2880662f0 0x7fa2880687a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa2980011e0 tx=0x7fa298009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:09.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:09.889+0000 7fa2a57fa700 1 -- 172.21.15.49:0/4175291656 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa2a0050a00 con 0x7fa2a8159be0 2023-07-21T22:14:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.065+0000 7fa2ad29f700 1 -- 172.21.15.49:0/4175291656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2a804dcb0 con 0x7fa2a8159be0 2023-07-21T22:14:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.065+0000 7fa2a57fa700 1 -- 172.21.15.49:0/4175291656 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2a0054020 con 0x7fa2a8159be0 2023-07-21T22:14:10.109 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:14:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.069+0000 7fa2ad29f700 1 -- 172.21.15.49:0/4175291656 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2880662f0 msgr2=0x7fa2880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.069+0000 7fa2ad29f700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2880662f0 0x7fa2880687a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa2980011e0 tx=0x7fa298009040 comp rx=0 tx=0).stop 2023-07-21T22:14:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.069+0000 7fa2ad29f700 1 -- 172.21.15.49:0/4175291656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2a8159be0 msgr2=0x7fa2a815c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.069+0000 7fa2ad29f700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2a8159be0 0x7fa2a815c700 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000caa0 tx=0x7fa2a000cad0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.069+0000 7fa2ad29f700 1 -- 172.21.15.49:0/4175291656 shutdown_connections 2023-07-21T22:14:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.069+0000 7fa2ad29f700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa2880662f0 0x7fa2880687a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.069+0000 7fa2ad29f700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2a8159be0 0x7fa2a815c700 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.069+0000 7fa2ad29f700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2a80ca550 0x7fa2a815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.069+0000 7fa2ad29f700 1 --2- 172.21.15.49:0/4175291656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2a806d6d0 0x7fa2a80ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.069+0000 7fa2ad29f700 1 -- 172.21.15.49:0/4175291656 >> 172.21.15.49:0/4175291656 conn(0x7fa2a80ce0d0 msgr2=0x7fa2a80706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:10.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.069+0000 7fa2ad29f700 1 -- 172.21.15.49:0/4175291656 shutdown_connections 2023-07-21T22:14:10.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.069+0000 7fa2ad29f700 1 -- 172.21.15.49:0/4175291656 wait complete. 2023-07-21T22:14:10.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:14:10.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcc02825700 1 Processor -- start 2023-07-21T22:14:10.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcc02825700 1 -- start start 2023-07-21T22:14:10.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcc02825700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbfc15e380 0x7fcbfc0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:10.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcc02825700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcbfc0c9cd0 0x7fcbfc0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:10.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcc02825700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbfc0ca190 con 0x7fcbfc0b3a50 2023-07-21T22:14:10.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcc02825700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbfc159fd0 con 0x7fcbfc0c9cd0 2023-07-21T22:14:10.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcc02825700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc15d6e0 con 0x7fcbfc15e380 2023-07-21T22:14:10.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcbfbfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbfc15e380 0x7fcbfc0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:10.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcc00dc2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcbfc0c9cd0 0x7fcbfc0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:10.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcbfbfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbfc15e380 0x7fcbfc0cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:36566/0 (socket says 172.21.15.49:36566) 2023-07-21T22:14:10.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcbfbfff700 1 -- 172.21.15.49:0/2906538357 learned_addr learned my addr 172.21.15.49:0/2906538357 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:10.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcbfbfff700 1 -- 172.21.15.49:0/2906538357 >> v2:172.21.15.150:3300/0 conn(0x7fcbfc0c9cd0 msgr2=0x7fcbfc0cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:10.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcbfbfff700 1 --2- 172.21.15.49:0/2906538357 >> v2:172.21.15.150:3300/0 conn(0x7fcbfc0c9cd0 0x7fcbfc0cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcbfbfff700 1 -- 172.21.15.49:0/2906538357 >> v1:172.21.15.150:6789/0 conn(0x7fcbfc0b3a50 legacy=0x7fcbfc0c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:10.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.277+0000 7fcbfbfff700 1 -- 172.21.15.49:0/2906538357 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc0ca900 con 0x7fcbfc15e380 2023-07-21T22:14:10.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.281+0000 7fcbfbfff700 1 --2- 172.21.15.49:0/2906538357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbfc15e380 0x7fcbfc0cabe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009910 tx=0x7fcbec009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2eed94fd2423a64 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:10.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.281+0000 7fcbfaffd700 1 -- 172.21.15.49:0/2906538357 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec011830 con 0x7fcbfc15e380 2023-07-21T22:14:10.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.281+0000 7fcbfaffd700 1 -- 172.21.15.49:0/2906538357 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec011990 con 0x7fcbfc15e380 2023-07-21T22:14:10.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.281+0000 7fcbfaffd700 1 -- 172.21.15.49:0/2906538357 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec011d40 con 0x7fcbfc15e380 2023-07-21T22:14:10.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.285+0000 7fcc02825700 1 -- 172.21.15.49:0/2906538357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbfc15e380 msgr2=0x7fcbfc0cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:10.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.285+0000 7fcc02825700 1 --2- 172.21.15.49:0/2906538357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbfc15e380 0x7fcbfc0cabe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009910 tx=0x7fcbec009c20 comp rx=0 tx=0).stop 2023-07-21T22:14:10.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.285+0000 7fcc02825700 1 -- 172.21.15.49:0/2906538357 shutdown_connections 2023-07-21T22:14:10.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.285+0000 7fcc02825700 1 --2- 172.21.15.49:0/2906538357 >> v2:172.21.15.150:3300/0 conn(0x7fcbfc0c9cd0 0x7fcbfc0cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.285+0000 7fcc02825700 1 --2- 172.21.15.49:0/2906538357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbfc15e380 0x7fcbfc0cabe0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.285+0000 7fcc02825700 1 -- 172.21.15.49:0/2906538357 >> 172.21.15.49:0/2906538357 conn(0x7fcbfc06e960 msgr2=0x7fcbfc06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:10.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.285+0000 7fcc02825700 1 -- 172.21.15.49:0/2906538357 shutdown_connections 2023-07-21T22:14:10.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.285+0000 7fcc02825700 1 -- 172.21.15.49:0/2906538357 wait complete. 2023-07-21T22:14:10.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.285+0000 7fcc02825700 1 Processor -- start 2023-07-21T22:14:10.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.285+0000 7fcc02825700 1 -- start start 2023-07-21T22:14:10.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc02825700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbfc0b3a50 0x7fcbfc0c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:10.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc02825700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbfc0c9cd0 0x7fcbfc0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:10.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc02825700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbfc15e380 0x7fcbfc0c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:10.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc02825700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0c6fa0 con 0x7fcbfc15e380 2023-07-21T22:14:10.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc02825700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0cbe40 con 0x7fcbfc0b3a50 2023-07-21T22:14:10.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc02825700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0c57e0 con 0x7fcbfc0c9cd0 2023-07-21T22:14:10.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc00dc2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbfc15e380 0x7fcbfc0c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:10.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc00dc2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbfc15e380 0x7fcbfc0c42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40344/0 (socket says 172.21.15.49:40344) 2023-07-21T22:14:10.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc00dc2700 1 -- 172.21.15.49:0/3582786413 learned_addr learned my addr 172.21.15.49:0/3582786413 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:10.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcbfb7fe700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbfc0c9cd0 0x7fcbfc0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:10.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcbfbfff700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbfc0b3a50 0x7fcbfc0c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:10.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc00dc2700 1 -- 172.21.15.49:0/3582786413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbfc0c9cd0 msgr2=0x7fcbfc0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:10.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc00dc2700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbfc0c9cd0 0x7fcbfc0c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc00dc2700 1 -- 172.21.15.49:0/3582786413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbfc0b3a50 msgr2=0x7fcbfc0c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc00dc2700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbfc0b3a50 0x7fcbfc0c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc00dc2700 1 -- 172.21.15.49:0/3582786413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec009570 con 0x7fcbfc15e380 2023-07-21T22:14:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcbfbfff700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbfc0b3a50 0x7fcbfc0c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:14:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc00dc2700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbfc15e380 0x7fcbfc0c42e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400ef90 tx=0x7fcbf400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:10.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcbf8ff9700 1 -- 172.21.15.49:0/3582786413 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf400cc90 con 0x7fcbfc15e380 2023-07-21T22:14:10.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcbf8ff9700 1 -- 172.21.15.49:0/3582786413 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf400f040 con 0x7fcbfc15e380 2023-07-21T22:14:10.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc02825700 1 -- 172.21.15.49:0/3582786413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc1f5280 con 0x7fcbfc15e380 2023-07-21T22:14:10.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcbf8ff9700 1 -- 172.21.15.49:0/3582786413 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4014480 con 0x7fcbfc15e380 2023-07-21T22:14:10.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.289+0000 7fcc02825700 1 -- 172.21.15.49:0/3582786413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc1f5840 con 0x7fcbfc15e380 2023-07-21T22:14:10.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.293+0000 7fcc02825700 1 -- 172.21.15.49:0/3582786413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbfc0cc040 con 0x7fcbfc15e380 2023-07-21T22:14:10.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.293+0000 7fcbf8ff9700 1 -- 172.21.15.49:0/3582786413 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcbf40145e0 con 0x7fcbfc15e380 2023-07-21T22:14:10.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.297+0000 7fcbf8ff9700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcbe80662f0 0x7fcbe80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:10.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.297+0000 7fcbf8ff9700 1 -- 172.21.15.49:0/3582786413 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcbf4084a00 con 0x7fcbfc15e380 2023-07-21T22:14:10.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.297+0000 7fcbfbfff700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcbe80662f0 0x7fcbe80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:10.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.297+0000 7fcbfbfff700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcbe80662f0 0x7fcbe80687a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcbec014040 tx=0x7fcbec008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.301+0000 7fcbf8ff9700 1 -- 172.21.15.49:0/3582786413 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcbfc0cc040 con 0x7fcbfc15e380 2023-07-21T22:14:10.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.477+0000 7fcc02825700 1 -- 172.21.15.49:0/3582786413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcbfc0cc000 con 0x7fcbfc15e380 2023-07-21T22:14:10.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.477+0000 7fcbf8ff9700 1 -- 172.21.15.49:0/3582786413 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v62) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcbf40180a0 con 0x7fcbfc15e380 2023-07-21T22:14:10.521 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:14:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.481+0000 7fcc02825700 1 -- 172.21.15.49:0/3582786413 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcbe80662f0 msgr2=0x7fcbe80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.481+0000 7fcc02825700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcbe80662f0 0x7fcbe80687a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcbec014040 tx=0x7fcbec008030 comp rx=0 tx=0).stop 2023-07-21T22:14:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.481+0000 7fcc02825700 1 -- 172.21.15.49:0/3582786413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbfc15e380 msgr2=0x7fcbfc0c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.481+0000 7fcc02825700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbfc15e380 0x7fcbfc0c42e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400ef90 tx=0x7fcbf400c3a0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.481+0000 7fcc02825700 1 -- 172.21.15.49:0/3582786413 shutdown_connections 2023-07-21T22:14:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.481+0000 7fcc02825700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcbe80662f0 0x7fcbe80687a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.481+0000 7fcc02825700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbfc15e380 0x7fcbfc0c42e0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.481+0000 7fcc02825700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbfc0c9cd0 0x7fcbfc0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.481+0000 7fcc02825700 1 --2- 172.21.15.49:0/3582786413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbfc0b3a50 0x7fcbfc0c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.481+0000 7fcc02825700 1 -- 172.21.15.49:0/3582786413 >> 172.21.15.49:0/3582786413 conn(0x7fcbfc06e960 msgr2=0x7fcbfc0b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:10.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.481+0000 7fcc02825700 1 -- 172.21.15.49:0/3582786413 shutdown_connections 2023-07-21T22:14:10.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.481+0000 7fcc02825700 1 -- 172.21.15.49:0/3582786413 wait complete. 2023-07-21T22:14:10.548 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:14:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.681+0000 7f6575546700 1 Processor -- start 2023-07-21T22:14:10.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.681+0000 7f6575546700 1 -- start start 2023-07-21T22:14:10.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f6575546700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f65700ca550 0x7f657006d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:10.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f6575546700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f657006d6d0 0x7f65700698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:10.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f6575546700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700c8b80 con 0x7f6570159be0 2023-07-21T22:14:10.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f6575546700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700c9720 con 0x7f65700ca550 2023-07-21T22:14:10.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f6575546700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657006db90 con 0x7f657006d6d0 2023-07-21T22:14:10.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f6567fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f65700ca550 0x7f657006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:10.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f6567fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f65700ca550 0x7f657006d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40352/0 (socket says 172.21.15.49:40352) 2023-07-21T22:14:10.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f656effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6570159be0 0x7f65700c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41836/0 (socket says 172.21.15.49:41836) 2023-07-21T22:14:10.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f6567fff700 1 -- 172.21.15.49:0/3142376515 learned_addr learned my addr 172.21.15.49:0/3142376515 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:10.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f656f7fe700 1 --2- 172.21.15.49:0/3142376515 >> v2:172.21.15.150:3300/0 conn(0x7f657006d6d0 0x7f65700698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f6567fff700 1 -- 172.21.15.49:0/3142376515 >> v2:172.21.15.150:3300/0 conn(0x7f657006d6d0 msgr2=0x7f65700698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f6567fff700 1 --2- 172.21.15.49:0/3142376515 >> v2:172.21.15.150:3300/0 conn(0x7f657006d6d0 0x7f65700698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f6567fff700 1 -- 172.21.15.49:0/3142376515 >> v1:172.21.15.49:6789/0 conn(0x7f6570159be0 legacy=0x7f65700c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f6567fff700 1 -- 172.21.15.49:0/3142376515 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657006de70 con 0x7f65700ca550 2023-07-21T22:14:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f6567fff700 1 --2- 172.21.15.49:0/3142376515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65700ca550 0x7f657006d190 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f65700700b0 tx=0x7f6558009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a801c20f788b0f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f656e7fc700 1 -- 172.21.15.49:0/3142376515 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655800b8a0 con 0x7f65700ca550 2023-07-21T22:14:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f656e7fc700 1 -- 172.21.15.49:0/3142376515 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655800ba00 con 0x7f65700ca550 2023-07-21T22:14:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.685+0000 7f656e7fc700 1 -- 172.21.15.49:0/3142376515 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655800bd90 con 0x7f65700ca550 2023-07-21T22:14:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.689+0000 7f6575546700 1 -- 172.21.15.49:0/3142376515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65700ca550 msgr2=0x7f657006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.689+0000 7f6575546700 1 --2- 172.21.15.49:0/3142376515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65700ca550 0x7f657006d190 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f65700700b0 tx=0x7f6558009bf0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.689+0000 7f6575546700 1 -- 172.21.15.49:0/3142376515 shutdown_connections 2023-07-21T22:14:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.689+0000 7f6575546700 1 --2- 172.21.15.49:0/3142376515 >> v2:172.21.15.150:3300/0 conn(0x7f657006d6d0 0x7f65700698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.689+0000 7f6575546700 1 --2- 172.21.15.49:0/3142376515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65700ca550 0x7f657006d190 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.689+0000 7f6575546700 1 -- 172.21.15.49:0/3142376515 >> 172.21.15.49:0/3142376515 conn(0x7f65700ce0d0 msgr2=0x7f65700ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.689+0000 7f6575546700 1 -- 172.21.15.49:0/3142376515 shutdown_connections 2023-07-21T22:14:10.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.689+0000 7f6575546700 1 -- 172.21.15.49:0/3142376515 wait complete. 2023-07-21T22:14:10.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.689+0000 7f6575546700 1 Processor -- start 2023-07-21T22:14:10.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.689+0000 7f6575546700 1 -- start start 2023-07-21T22:14:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6575546700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f657006d6d0 0x7f65700b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6575546700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65700ca550 0x7f65700c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:10.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6575546700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6570159be0 0x7f657015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:10.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6575546700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700b3300 con 0x7f65700ca550 2023-07-21T22:14:10.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6575546700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700b3720 con 0x7f6570159be0 2023-07-21T22:14:10.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6575546700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700b2680 con 0x7f657006d6d0 2023-07-21T22:14:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6567fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65700ca550 0x7f65700c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6567fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65700ca550 0x7f65700c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40364/0 (socket says 172.21.15.49:40364) 2023-07-21T22:14:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6567fff700 1 -- 172.21.15.49:0/3403877582 learned_addr learned my addr 172.21.15.49:0/3403877582 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f656effd700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f657006d6d0 0x7f65700b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f656f7fe700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6570159be0 0x7f657015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6567fff700 1 -- 172.21.15.49:0/3403877582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f657006d6d0 msgr2=0x7f65700b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6567fff700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f657006d6d0 0x7f65700b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6567fff700 1 -- 172.21.15.49:0/3403877582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6570159be0 msgr2=0x7f657015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6567fff700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6570159be0 0x7f657015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6567fff700 1 -- 172.21.15.49:0/3403877582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6558009570 con 0x7f65700ca550 2023-07-21T22:14:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f656effd700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f657006d6d0 0x7f65700b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:10.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f656f7fe700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6570159be0 0x7f657015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:10.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6567fff700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65700ca550 0x7f65700c79a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f655800b0e0 tx=0x7f6558004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:10.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f65677fe700 1 -- 172.21.15.49:0/3403877582 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65580038c0 con 0x7f65700ca550 2023-07-21T22:14:10.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f65677fe700 1 -- 172.21.15.49:0/3403877582 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655801f070 con 0x7f65700ca550 2023-07-21T22:14:10.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f65677fe700 1 -- 172.21.15.49:0/3403877582 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558003c60 con 0x7f65700ca550 2023-07-21T22:14:10.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6575546700 1 -- 172.21.15.49:0/3403877582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65700b2960 con 0x7f65700ca550 2023-07-21T22:14:10.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.693+0000 7f6575546700 1 -- 172.21.15.49:0/3403877582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65700b2f20 con 0x7f65700ca550 2023-07-21T22:14:10.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.697+0000 7f6575546700 1 -- 172.21.15.49:0/3403877582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65700b3440 con 0x7f65700ca550 2023-07-21T22:14:10.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.697+0000 7f65677fe700 1 -- 172.21.15.49:0/3403877582 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6558026480 con 0x7f65700ca550 2023-07-21T22:14:10.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.697+0000 7f65677fe700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65500662f0 0x7f65500687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:10.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.697+0000 7f65677fe700 1 -- 172.21.15.49:0/3403877582 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6558021070 con 0x7f65700ca550 2023-07-21T22:14:10.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.697+0000 7f656effd700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65500662f0 0x7f65500687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:10.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.701+0000 7f656effd700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65500662f0 0x7f65500687a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f65700c7930 tx=0x7f6560007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.705+0000 7f65677fe700 1 -- 172.21.15.49:0/3403877582 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65700b3440 con 0x7f65700ca550 2023-07-21T22:14:10.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.877+0000 7f6575546700 1 -- 172.21.15.49:0/3403877582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f65700b3440 con 0x7f65700ca550 2023-07-21T22:14:10.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.881+0000 7f65677fe700 1 -- 172.21.15.49:0/3403877582 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v62) v1 ==== 104+0+11 (secure 0 0 0) 0x7f65700b3440 con 0x7f65700ca550 2023-07-21T22:14:10.924 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:14:10.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.885+0000 7f6575546700 1 -- 172.21.15.49:0/3403877582 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65500662f0 msgr2=0x7f65500687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:10.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.885+0000 7f6575546700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65500662f0 0x7f65500687a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f65700c7930 tx=0x7f6560007e30 comp rx=0 tx=0).stop 2023-07-21T22:14:10.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.885+0000 7f6575546700 1 -- 172.21.15.49:0/3403877582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65700ca550 msgr2=0x7f65700c79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:10.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.885+0000 7f6575546700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65700ca550 0x7f65700c79a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f655800b0e0 tx=0x7f6558004770 comp rx=0 tx=0).stop 2023-07-21T22:14:10.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.885+0000 7f6575546700 1 -- 172.21.15.49:0/3403877582 shutdown_connections 2023-07-21T22:14:10.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.885+0000 7f6575546700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65500662f0 0x7f65500687a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.885+0000 7f6575546700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65700ca550 0x7f65700c79a0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.885+0000 7f6575546700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6570159be0 0x7f657015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.885+0000 7f6575546700 1 --2- 172.21.15.49:0/3403877582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f657006d6d0 0x7f65700b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:10.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.885+0000 7f6575546700 1 -- 172.21.15.49:0/3403877582 >> 172.21.15.49:0/3403877582 conn(0x7f65700ce0d0 msgr2=0x7f65700cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:10.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.885+0000 7f6575546700 1 -- 172.21.15.49:0/3403877582 shutdown_connections 2023-07-21T22:14:10.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:10.885+0000 7f6575546700 1 -- 172.21.15.49:0/3403877582 wait complete. 2023-07-21T22:14:10.950 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:14:11.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.089+0000 7f07d0faf700 1 Processor -- start 2023-07-21T22:14:11.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.089+0000 7f07d0faf700 1 -- start start 2023-07-21T22:14:11.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07d0faf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07cc0b7af0 0x7f07cc0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:11.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07d0faf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f07cc0d1e40 0x7f07cc15f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07d0faf700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07cc0b3e80 con 0x7f07cc0cee10 2023-07-21T22:14:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07d0faf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07cc0cea00 con 0x7f07cc0d1e40 2023-07-21T22:14:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07d0faf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc0ccbf0 con 0x7f07cc0b7af0 2023-07-21T22:14:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07cbfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f07cc0cee10 0x7f07cc0b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41850/0 (socket says 172.21.15.49:41850) 2023-07-21T22:14:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07cbfff700 1 -- 172.21.15.49:0/2908068509 learned_addr learned my addr 172.21.15.49:0/2908068509 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07cb7fe700 1 --2- 172.21.15.49:0/2908068509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07cc0b7af0 0x7f07cc0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07caffd700 1 --2- 172.21.15.49:0/2908068509 >> v2:172.21.15.150:3300/0 conn(0x7f07cc0d1e40 0x7f07cc15f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07ca7fc700 1 -- 172.21.15.49:0/2908068509 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717623907 0 0) 0x7f07cc0b3e80 con 0x7f07cc0cee10 2023-07-21T22:14:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07cb7fe700 1 -- 172.21.15.49:0/2908068509 >> v2:172.21.15.150:3300/0 conn(0x7f07cc0d1e40 msgr2=0x7f07cc15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07cb7fe700 1 --2- 172.21.15.49:0/2908068509 >> v2:172.21.15.150:3300/0 conn(0x7f07cc0d1e40 0x7f07cc15f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07cb7fe700 1 -- 172.21.15.49:0/2908068509 >> v1:172.21.15.49:6789/0 conn(0x7f07cc0cee10 legacy=0x7f07cc0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07cb7fe700 1 -- 172.21.15.49:0/2908068509 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc0cced0 con 0x7f07cc0b7af0 2023-07-21T22:14:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07cb7fe700 1 --2- 172.21.15.49:0/2908068509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07cc0b7af0 0x7f07cc0b1630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009850 tx=0x7f07bc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e8fd4440f33e14f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:11.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.093+0000 7f07ca7fc700 1 -- 172.21.15.49:0/2908068509 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc011830 con 0x7f07cc0b7af0 2023-07-21T22:14:11.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.097+0000 7f07ca7fc700 1 -- 172.21.15.49:0/2908068509 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc011990 con 0x7f07cc0b7af0 2023-07-21T22:14:11.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.097+0000 7f07ca7fc700 1 -- 172.21.15.49:0/2908068509 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc011d40 con 0x7f07cc0b7af0 2023-07-21T22:14:11.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.097+0000 7f07d0faf700 1 -- 172.21.15.49:0/2908068509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07cc0b7af0 msgr2=0x7f07cc0b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:11.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.097+0000 7f07d0faf700 1 --2- 172.21.15.49:0/2908068509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07cc0b7af0 0x7f07cc0b1630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009850 tx=0x7f07bc009b60 comp rx=0 tx=0).stop 2023-07-21T22:14:11.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.097+0000 7f07d0faf700 1 -- 172.21.15.49:0/2908068509 shutdown_connections 2023-07-21T22:14:11.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.097+0000 7f07d0faf700 1 --2- 172.21.15.49:0/2908068509 >> v2:172.21.15.150:3300/0 conn(0x7f07cc0d1e40 0x7f07cc15f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.097+0000 7f07d0faf700 1 --2- 172.21.15.49:0/2908068509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07cc0b7af0 0x7f07cc0b1630 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.097+0000 7f07d0faf700 1 -- 172.21.15.49:0/2908068509 >> 172.21.15.49:0/2908068509 conn(0x7f07cc06e960 msgr2=0x7f07cc06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:11.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.097+0000 7f07d0faf700 1 -- 172.21.15.49:0/2908068509 shutdown_connections 2023-07-21T22:14:11.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.097+0000 7f07d0faf700 1 -- 172.21.15.49:0/2908068509 wait complete. 2023-07-21T22:14:11.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.101+0000 7f07d0faf700 1 Processor -- start 2023-07-21T22:14:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.101+0000 7f07d0faf700 1 -- start start 2023-07-21T22:14:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.101+0000 7f07d0faf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07cc0b7af0 0x7f07cc1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.101+0000 7f07d0faf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07cc0cee10 0x7f07cc1f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.101+0000 7f07d0faf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07cc0d1e40 0x7f07cc0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.101+0000 7f07d0faf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc15e300 con 0x7f07cc0b7af0 2023-07-21T22:14:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.101+0000 7f07d0faf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc1f51a0 con 0x7f07cc0cee10 2023-07-21T22:14:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.101+0000 7f07d0faf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc0c9970 con 0x7f07cc0d1e40 2023-07-21T22:14:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.101+0000 7f07cb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07cc0b7af0 0x7f07cc1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.101+0000 7f07cb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07cc0b7af0 0x7f07cc1574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40376/0 (socket says 172.21.15.49:40376) 2023-07-21T22:14:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.101+0000 7f07cb7fe700 1 -- 172.21.15.49:0/2474162436 learned_addr learned my addr 172.21.15.49:0/2474162436 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.101+0000 7f07caffd700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07cc0cee10 0x7f07cc1f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.101+0000 7f07cbfff700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07cc0d1e40 0x7f07cc0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:11.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.101+0000 7f07cb7fe700 1 -- 172.21.15.49:0/2474162436 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07cc0d1e40 msgr2=0x7f07cc0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:11.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.105+0000 7f07cb7fe700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07cc0d1e40 0x7f07cc0b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.105+0000 7f07cb7fe700 1 -- 172.21.15.49:0/2474162436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07cc0cee10 msgr2=0x7f07cc1f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.105+0000 7f07cb7fe700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07cc0cee10 0x7f07cc1f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.105+0000 7f07cb7fe700 1 -- 172.21.15.49:0/2474162436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc0094b0 con 0x7f07cc0b7af0 2023-07-21T22:14:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.105+0000 7f07caffd700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07cc0cee10 0x7f07cc1f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.105+0000 7f07cb7fe700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07cc0b7af0 0x7f07cc1574a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0090b0 tx=0x7f07bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.105+0000 7f07b3fff700 1 -- 172.21.15.49:0/2474162436 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0036c0 con 0x7f07cc0b7af0 2023-07-21T22:14:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.105+0000 7f07b3fff700 1 -- 172.21.15.49:0/2474162436 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc01f070 con 0x7f07cc0b7af0 2023-07-21T22:14:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.105+0000 7f07b3fff700 1 -- 172.21.15.49:0/2474162436 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc003a80 con 0x7f07cc0b7af0 2023-07-21T22:14:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.105+0000 7f07d0faf700 1 -- 172.21.15.49:0/2474162436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07cc1f4be0 con 0x7f07cc0b7af0 2023-07-21T22:14:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.105+0000 7f07d0faf700 1 -- 172.21.15.49:0/2474162436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07cc0c9600 con 0x7f07cc0b7af0 2023-07-21T22:14:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.105+0000 7f07d0faf700 1 -- 172.21.15.49:0/2474162436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07cc04dcb0 con 0x7f07cc0b7af0 2023-07-21T22:14:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.109+0000 7f07b3fff700 1 -- 172.21.15.49:0/2474162436 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f07bc003be0 con 0x7f07cc0b7af0 2023-07-21T22:14:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.109+0000 7f07b3fff700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f07b80662f0 0x7f07b80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.109+0000 7f07b3fff700 1 -- 172.21.15.49:0/2474162436 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f07bc021070 con 0x7f07cc0b7af0 2023-07-21T22:14:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.109+0000 7f07caffd700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f07b80662f0 0x7f07b80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.109+0000 7f07caffd700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f07b80662f0 0x7f07b80687a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f07cc15e670 tx=0x7f07c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.117+0000 7f07b3fff700 1 -- 172.21.15.49:0/2474162436 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07bc052b80 con 0x7f07cc0b7af0 2023-07-21T22:14:11.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.289+0000 7f07d0faf700 1 -- 172.21.15.49:0/2474162436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07cc1602e0 con 0x7f07cc0b7af0 2023-07-21T22:14:11.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.293+0000 7f07b3fff700 1 -- 172.21.15.49:0/2474162436 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v62) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07bc083e60 con 0x7f07cc0b7af0 2023-07-21T22:14:11.373 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:14:11.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.293+0000 7f07d0faf700 1 -- 172.21.15.49:0/2474162436 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f07b80662f0 msgr2=0x7f07b80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:11.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.293+0000 7f07d0faf700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f07b80662f0 0x7f07b80687a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f07cc15e670 tx=0x7f07c0008040 comp rx=0 tx=0).stop 2023-07-21T22:14:11.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.293+0000 7f07d0faf700 1 -- 172.21.15.49:0/2474162436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07cc0b7af0 msgr2=0x7f07cc1574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:11.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.293+0000 7f07d0faf700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07cc0b7af0 0x7f07cc1574a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0090b0 tx=0x7f07bc004770 comp rx=0 tx=0).stop 2023-07-21T22:14:11.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.293+0000 7f07d0faf700 1 -- 172.21.15.49:0/2474162436 shutdown_connections 2023-07-21T22:14:11.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.293+0000 7f07d0faf700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f07b80662f0 0x7f07b80687a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.293+0000 7f07d0faf700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07cc0d1e40 0x7f07cc0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.293+0000 7f07d0faf700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07cc0cee10 0x7f07cc1f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.293+0000 7f07d0faf700 1 --2- 172.21.15.49:0/2474162436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07cc0b7af0 0x7f07cc1574a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.293+0000 7f07d0faf700 1 -- 172.21.15.49:0/2474162436 >> 172.21.15.49:0/2474162436 conn(0x7f07cc06e960 msgr2=0x7f07cc070510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:11.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.293+0000 7f07d0faf700 1 -- 172.21.15.49:0/2474162436 shutdown_connections 2023-07-21T22:14:11.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.293+0000 7f07d0faf700 1 -- 172.21.15.49:0/2474162436 wait complete. 2023-07-21T22:14:11.378 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:14:11.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.517+0000 7f10ad211700 1 Processor -- start 2023-07-21T22:14:11.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.517+0000 7f10ad211700 1 -- start start 2023-07-21T22:14:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10ad211700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a8159f60 0x7f10a80afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10ad211700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a80b0600 con 0x7f10a80b0160 2023-07-21T22:14:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10ad211700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a815a470 con 0x7f10a806d5d0 2023-07-21T22:14:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10ad211700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a815a750 con 0x7f10a8159f60 2023-07-21T22:14:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10a659c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a8159f60 0x7f10a80afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10a6d9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f10a806d5d0 0x7f10a806d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:59850/0 (socket says 172.21.15.49:59850) 2023-07-21T22:14:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10a759e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f10a80b0160 0x7f10a815d780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41858/0 (socket says 172.21.15.49:41858) 2023-07-21T22:14:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10a6d9d700 1 -- 172.21.15.49:0/992158669 learned_addr learned my addr 172.21.15.49:0/992158669 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10a5d9b700 1 -- 172.21.15.49:0/992158669 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725083848 0 0) 0x7f10a80b0600 con 0x7f10a80b0160 2023-07-21T22:14:11.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10a5d9b700 1 -- 172.21.15.49:0/992158669 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10900035d0 con 0x7f10a80b0160 2023-07-21T22:14:11.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10a5d9b700 1 -- 172.21.15.49:0/992158669 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905104878 0 0) 0x7f10a815a470 con 0x7f10a806d5d0 2023-07-21T22:14:11.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10a659c700 1 -- 172.21.15.49:0/992158669 >> v1:172.21.15.150:6789/0 conn(0x7f10a806d5d0 legacy=0x7f10a806d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:11.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10a659c700 1 -- 172.21.15.49:0/992158669 >> v1:172.21.15.49:6789/0 conn(0x7f10a80b0160 legacy=0x7f10a815d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:11.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10a659c700 1 -- 172.21.15.49:0/992158669 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a815aa30 con 0x7f10a8159f60 2023-07-21T22:14:11.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10a659c700 1 --2- 172.21.15.49:0/992158669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a8159f60 0x7f10a80afc20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f109c009880 tx=0x7f109c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33b640b1b5ca81cc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:11.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10a5d9b700 1 -- 172.21.15.49:0/992158669 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c011830 con 0x7f10a8159f60 2023-07-21T22:14:11.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10a5d9b700 1 -- 172.21.15.49:0/992158669 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c011990 con 0x7f10a8159f60 2023-07-21T22:14:11.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.521+0000 7f10a5d9b700 1 -- 172.21.15.49:0/992158669 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c011d20 con 0x7f10a8159f60 2023-07-21T22:14:11.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.525+0000 7f10ad211700 1 -- 172.21.15.49:0/992158669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a8159f60 msgr2=0x7f10a80afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:11.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.525+0000 7f10ad211700 1 --2- 172.21.15.49:0/992158669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a8159f60 0x7f10a80afc20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f109c009880 tx=0x7f109c009b90 comp rx=0 tx=0).stop 2023-07-21T22:14:11.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.525+0000 7f10ad211700 1 -- 172.21.15.49:0/992158669 shutdown_connections 2023-07-21T22:14:11.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.525+0000 7f10ad211700 1 --2- 172.21.15.49:0/992158669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a8159f60 0x7f10a80afc20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.525+0000 7f10ad211700 1 -- 172.21.15.49:0/992158669 >> 172.21.15.49:0/992158669 conn(0x7f10a806f5a0 msgr2=0x7f10a80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.525+0000 7f10ad211700 1 -- 172.21.15.49:0/992158669 shutdown_connections 2023-07-21T22:14:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.525+0000 7f10ad211700 1 -- 172.21.15.49:0/992158669 wait complete. 2023-07-21T22:14:11.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.525+0000 7f10ad211700 1 Processor -- start 2023-07-21T22:14:11.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.525+0000 7f10ad211700 1 -- start start 2023-07-21T22:14:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10ad211700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a806d5d0 0x7f10a81fa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10ad211700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80b0160 0x7f10a8153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10ad211700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a8159f60 0x7f10a81561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10ad211700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a80b2210 con 0x7f10a8159f60 2023-07-21T22:14:11.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10ad211700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a80b1600 con 0x7f10a80b0160 2023-07-21T22:14:11.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10ad211700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a80b18e0 con 0x7f10a806d5d0 2023-07-21T22:14:11.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10a759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a8159f60 0x7f10a81561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:11.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10a759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a8159f60 0x7f10a81561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40392/0 (socket says 172.21.15.49:40392) 2023-07-21T22:14:11.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10a759e700 1 -- 172.21.15.49:0/2008908979 learned_addr learned my addr 172.21.15.49:0/2008908979 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:11.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10a6d9d700 1 --2- 172.21.15.49:0/2008908979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a806d5d0 0x7f10a81fa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:11.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10a659c700 1 --2- 172.21.15.49:0/2008908979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80b0160 0x7f10a8153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:11.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10a759e700 1 -- 172.21.15.49:0/2008908979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a806d5d0 msgr2=0x7f10a81fa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:11.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10a759e700 1 --2- 172.21.15.49:0/2008908979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a806d5d0 0x7f10a81fa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10a759e700 1 -- 172.21.15.49:0/2008908979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80b0160 msgr2=0x7f10a8153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:11.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10a759e700 1 --2- 172.21.15.49:0/2008908979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80b0160 0x7f10a8153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10a759e700 1 -- 172.21.15.49:0/2008908979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c0094b0 con 0x7f10a8159f60 2023-07-21T22:14:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10a759e700 1 --2- 172.21.15.49:0/2008908979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a8159f60 0x7f10a81561a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f10a000cbd0 tx=0x7f10a000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f108f7fe700 1 -- 172.21.15.49:0/2008908979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a000aaa0 con 0x7f10a8159f60 2023-07-21T22:14:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f108f7fe700 1 -- 172.21.15.49:0/2008908979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a000ac00 con 0x7f10a8159f60 2023-07-21T22:14:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f108f7fe700 1 -- 172.21.15.49:0/2008908979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a0007070 con 0x7f10a8159f60 2023-07-21T22:14:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10ad211700 1 -- 172.21.15.49:0/2008908979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a80b1bc0 con 0x7f10a8159f60 2023-07-21T22:14:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.529+0000 7f10ad211700 1 -- 172.21.15.49:0/2008908979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a81539a0 con 0x7f10a8159f60 2023-07-21T22:14:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.533+0000 7f10ad211700 1 -- 172.21.15.49:0/2008908979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a8073130 con 0x7f10a8159f60 2023-07-21T22:14:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.533+0000 7f108f7fe700 1 -- 172.21.15.49:0/2008908979 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10a00071d0 con 0x7f10a8159f60 2023-07-21T22:14:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.533+0000 7f108f7fe700 1 --2- 172.21.15.49:0/2008908979 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10940662f0 0x7f10940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.533+0000 7f108f7fe700 1 -- 172.21.15.49:0/2008908979 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f10a0083ce0 con 0x7f10a8159f60 2023-07-21T22:14:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.533+0000 7f10a6d9d700 1 --2- 172.21.15.49:0/2008908979 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10940662f0 0x7f10940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.537+0000 7f10a6d9d700 1 --2- 172.21.15.49:0/2008908979 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10940662f0 0x7f10940687a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1098000f60 tx=0x7f1098007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.537+0000 7f108f7fe700 1 -- 172.21.15.49:0/2008908979 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f10a0050f80 con 0x7f10a8159f60 2023-07-21T22:14:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.721+0000 7f10ad211700 1 -- 172.21.15.49:0/2008908979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f10a804dcb0 con 0x7f10a8159f60 2023-07-21T22:14:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.721+0000 7f108f7fe700 1 -- 172.21.15.49:0/2008908979 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v62) v1 ==== 80+0+0 (secure 0 0 0) 0x7f10a0017020 con 0x7f10a8159f60 2023-07-21T22:14:11.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.725+0000 7f10ad211700 1 -- 172.21.15.49:0/2008908979 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10940662f0 msgr2=0x7f10940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:11.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.725+0000 7f10ad211700 1 --2- 172.21.15.49:0/2008908979 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10940662f0 0x7f10940687a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1098000f60 tx=0x7f1098007e90 comp rx=0 tx=0).stop 2023-07-21T22:14:11.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.725+0000 7f10ad211700 1 -- 172.21.15.49:0/2008908979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a8159f60 msgr2=0x7f10a81561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.725+0000 7f10ad211700 1 --2- 172.21.15.49:0/2008908979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a8159f60 0x7f10a81561a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f10a000cbd0 tx=0x7f10a000cee0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.725+0000 7f10ad211700 1 -- 172.21.15.49:0/2008908979 shutdown_connections 2023-07-21T22:14:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.725+0000 7f10ad211700 1 --2- 172.21.15.49:0/2008908979 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f10940662f0 0x7f10940687a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.725+0000 7f10ad211700 1 --2- 172.21.15.49:0/2008908979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a8159f60 0x7f10a81561a0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.725+0000 7f10ad211700 1 --2- 172.21.15.49:0/2008908979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80b0160 0x7f10a8153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.725+0000 7f10ad211700 1 --2- 172.21.15.49:0/2008908979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a806d5d0 0x7f10a81fa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.725+0000 7f10ad211700 1 -- 172.21.15.49:0/2008908979 >> 172.21.15.49:0/2008908979 conn(0x7f10a806f5a0 msgr2=0x7f10a806bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.725+0000 7f10ad211700 1 -- 172.21.15.49:0/2008908979 shutdown_connections 2023-07-21T22:14:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.725+0000 7f10ad211700 1 -- 172.21.15.49:0/2008908979 wait complete. 2023-07-21T22:14:11.771 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:14:11.793 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:14:11.793 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:14:11.813 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:14:12.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.997+0000 7fd8cf59e700 1 Processor -- start 2023-07-21T22:14:12.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:11.997+0000 7fd8cf59e700 1 -- start start 2023-07-21T22:14:12.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.001+0000 7fd8cf59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8d0160370 0x7fd8d006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.001+0000 7fd8cf59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8d00c1470 0x7fd8d00c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.001+0000 7fd8cf59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d006e010 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.001+0000 7fd8cf59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d0160740 con 0x7fd8d00c1470 2023-07-21T22:14:12.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.001+0000 7fd8cf59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00ccc50 con 0x7fd8d0160370 2023-07-21T22:14:12.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.001+0000 7fd8c5d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8d00c1470 0x7fd8d00c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.001+0000 7fd8ce59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8d0160370 0x7fd8d006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.001+0000 7fd8ce59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8d0160370 0x7fd8d006d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:36628/0 (socket says 172.21.15.49:36628) 2023-07-21T22:14:12.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.001+0000 7fd8ce59c700 1 -- 172.21.15.49:0/3456786862 learned_addr learned my addr 172.21.15.49:0/3456786862 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:12.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.001+0000 7fd8ced9d700 1 --1- 172.21.15.49:0/3456786862 >> v1:172.21.15.150:6789/0 conn(0x7fd8d00ca2c0 0x7fd8d00caa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:59864/0 (socket says 172.21.15.49:59864) 2023-07-21T22:14:12.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8ce59c700 1 -- 172.21.15.49:0/3456786862 >> v2:172.21.15.150:3300/0 conn(0x7fd8d00c1470 msgr2=0x7fd8d00c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:12.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8ce59c700 1 --2- 172.21.15.49:0/3456786862 >> v2:172.21.15.150:3300/0 conn(0x7fd8d00c1470 0x7fd8d00c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8ce59c700 1 -- 172.21.15.49:0/3456786862 >> v1:172.21.15.150:6789/0 conn(0x7fd8d00ca2c0 legacy=0x7fd8d00caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8ce59c700 1 -- 172.21.15.49:0/3456786862 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d00afc90 con 0x7fd8d0160370 2023-07-21T22:14:12.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8cdd9b700 1 -- 172.21.15.49:0/3456786862 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295824686 0 0) 0x7fd8d006e010 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8ce59c700 1 --2- 172.21.15.49:0/3456786862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8d0160370 0x7fd8d006d7e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009e50 tx=0x7fd8c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22d5c99b77f7807b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:12.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8cdd9b700 1 -- 172.21.15.49:0/3456786862 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c000e070 con 0x7fd8d0160370 2023-07-21T22:14:12.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8cdd9b700 1 -- 172.21.15.49:0/3456786862 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c000b910 con 0x7fd8d0160370 2023-07-21T22:14:12.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8cdd9b700 1 -- 172.21.15.49:0/3456786862 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c000bcc0 con 0x7fd8d0160370 2023-07-21T22:14:12.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8cf59e700 1 -- 172.21.15.49:0/3456786862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8d0160370 msgr2=0x7fd8d006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8cf59e700 1 --2- 172.21.15.49:0/3456786862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8d0160370 0x7fd8d006d7e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009e50 tx=0x7fd8c000b330 comp rx=0 tx=0).stop 2023-07-21T22:14:12.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8cf59e700 1 -- 172.21.15.49:0/3456786862 shutdown_connections 2023-07-21T22:14:12.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8cf59e700 1 --2- 172.21.15.49:0/3456786862 >> v2:172.21.15.150:3300/0 conn(0x7fd8d00c1470 0x7fd8d00c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8cf59e700 1 --2- 172.21.15.49:0/3456786862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8d0160370 0x7fd8d006d7e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8cf59e700 1 -- 172.21.15.49:0/3456786862 >> 172.21.15.49:0/3456786862 conn(0x7fd8d0070450 msgr2=0x7fd8d0070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:12.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8cf59e700 1 -- 172.21.15.49:0/3456786862 shutdown_connections 2023-07-21T22:14:12.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.005+0000 7fd8cf59e700 1 -- 172.21.15.49:0/3456786862 wait complete. 2023-07-21T22:14:12.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.009+0000 7fd8cf59e700 1 Processor -- start 2023-07-21T22:14:12.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.009+0000 7fd8cf59e700 1 -- start start 2023-07-21T22:14:12.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.009+0000 7fd8cf59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8d00c1470 0x7fd8d01618d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.009+0000 7fd8cf59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8d00ca2c0 0x7fd8d00c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8cf59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8d0160370 0x7fd8d0152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8cf59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00c84b0 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8cf59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d01f59f0 con 0x7fd8d0160370 2023-07-21T22:14:12.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8cf59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d0152640 con 0x7fd8d00c1470 2023-07-21T22:14:12.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8c5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8d00ca2c0 0x7fd8d00c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8c5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8d00ca2c0 0x7fd8d00c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40404/0 (socket says 172.21.15.49:40404) 2023-07-21T22:14:12.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8c5d9b700 1 -- 172.21.15.49:0/2860084449 learned_addr learned my addr 172.21.15.49:0/2860084449 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:12.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8ce59c700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8d00c1470 0x7fd8d01618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8ced9d700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8d0160370 0x7fd8d0152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8c5d9b700 1 -- 172.21.15.49:0/2860084449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8d00c1470 msgr2=0x7fd8d01618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8c5d9b700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8d00c1470 0x7fd8d01618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8c5d9b700 1 -- 172.21.15.49:0/2860084449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8d0160370 msgr2=0x7fd8d0152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8c5d9b700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8d0160370 0x7fd8d0152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8c5d9b700 1 -- 172.21.15.49:0/2860084449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c0009b30 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8ce59c700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8d00c1470 0x7fd8d01618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:12.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8c5d9b700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8d00ca2c0 0x7fd8d00c7f70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800ea00 tx=0x7fd8b800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:12.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8c77fe700 1 -- 172.21.15.49:0/2860084449 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8009720 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8c77fe700 1 -- 172.21.15.49:0/2860084449 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b800c850 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8cf59e700 1 -- 172.21.15.49:0/2860084449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d0161fd0 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8c77fe700 1 -- 172.21.15.49:0/2860084449 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b800cbc0 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8cf59e700 1 -- 172.21.15.49:0/2860084449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d0162590 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.013+0000 7fd8cf59e700 1 -- 172.21.15.49:0/2860084449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d004dcb0 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.017+0000 7fd8c77fe700 1 -- 172.21.15.49:0/2860084449 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd8b800cd20 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.017+0000 7fd8c77fe700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd8b00662f0 0x7fd8b00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.021+0000 7fd8c77fe700 1 -- 172.21.15.49:0/2860084449 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd8b8083f50 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.021+0000 7fd8ce59c700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd8b00662f0 0x7fd8b00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.021+0000 7fd8ce59c700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd8b00662f0 0x7fd8b00687a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0000f80 tx=0x7fd8c0009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:12.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.025+0000 7fd8c77fe700 1 -- 172.21.15.49:0/2860084449 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd8b8054d10 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.201+0000 7fd8cf59e700 1 -- 172.21.15.49:0/2860084449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8d00ad7b0 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.205+0000 7fd8c77fe700 1 -- 172.21.15.49:0/2860084449 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+18462 (secure 0 0 0) 0x7fd8b8017090 con 0x7fd8d00ca2c0 2023-07-21T22:14:12.250 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:12.251 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":62,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:13:42.072628+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:13:38.569931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:13:39.558524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:14:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.209+0000 7fd8cf59e700 1 -- 172.21.15.49:0/2860084449 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd8b00662f0 msgr2=0x7fd8b00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.209+0000 7fd8cf59e700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd8b00662f0 0x7fd8b00687a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0000f80 tx=0x7fd8c0009000 comp rx=0 tx=0).stop 2023-07-21T22:14:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.209+0000 7fd8cf59e700 1 -- 172.21.15.49:0/2860084449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8d00ca2c0 msgr2=0x7fd8d00c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.209+0000 7fd8cf59e700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8d00ca2c0 0x7fd8d00c7f70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800ea00 tx=0x7fd8b800edc0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.209+0000 7fd8cf59e700 1 -- 172.21.15.49:0/2860084449 shutdown_connections 2023-07-21T22:14:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.209+0000 7fd8cf59e700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd8b00662f0 0x7fd8b00687a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.209+0000 7fd8cf59e700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8d00ca2c0 0x7fd8d00c7f70 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.209+0000 7fd8cf59e700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8d0160370 0x7fd8d0152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.209+0000 7fd8cf59e700 1 --2- 172.21.15.49:0/2860084449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8d00c1470 0x7fd8d01618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.209+0000 7fd8cf59e700 1 -- 172.21.15.49:0/2860084449 >> 172.21.15.49:0/2860084449 conn(0x7fd8d0070450 msgr2=0x7fd8d00adb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:12.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.209+0000 7fd8cf59e700 1 -- 172.21.15.49:0/2860084449 shutdown_connections 2023-07-21T22:14:12.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.209+0000 7fd8cf59e700 1 -- 172.21.15.49:0/2860084449 wait complete. 2023-07-21T22:14:12.278 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:13:38.569931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:13:39.558524+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:14:12.278 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:14:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.417+0000 7f7970c11700 1 Processor -- start 2023-07-21T22:14:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.417+0000 7f7970c11700 1 -- start start 2023-07-21T22:14:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f7970c11700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f796c159830 0x7f796c152d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f7970c11700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f796c065960 0x7f796c0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f7970c11700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c0c4350 con 0x7f796c0654c0 2023-07-21T22:14:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f7970c11700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796c153280 con 0x7f796c159830 2023-07-21T22:14:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f7970c11700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796c0b0840 con 0x7f796c065960 2023-07-21T22:14:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f796a59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f796c159830 0x7f796c152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f796a59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f796c159830 0x7f796c152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40410/0 (socket says 172.21.15.49:40410) 2023-07-21T22:14:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f796a59c700 1 -- 172.21.15.49:0/1090145773 learned_addr learned my addr 172.21.15.49:0/1090145773 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f796ad9d700 1 --2- 172.21.15.49:0/1090145773 >> v2:172.21.15.150:3300/0 conn(0x7f796c065960 0x7f796c0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f796a59c700 1 -- 172.21.15.49:0/1090145773 >> v2:172.21.15.150:3300/0 conn(0x7f796c065960 msgr2=0x7f796c0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f796a59c700 1 --2- 172.21.15.49:0/1090145773 >> v2:172.21.15.150:3300/0 conn(0x7f796c065960 0x7f796c0ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f796a59c700 1 -- 172.21.15.49:0/1090145773 >> v1:172.21.15.150:6789/0 conn(0x7f796c0654c0 legacy=0x7f796c0b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f796a59c700 1 -- 172.21.15.49:0/1090145773 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0c4b60 con 0x7f796c159830 2023-07-21T22:14:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f796a59c700 1 --2- 172.21.15.49:0/1090145773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f796c159830 0x7f796c152d40 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f796c06c690 tx=0x7f795c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f04f7106213493 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f796959a700 1 -- 172.21.15.49:0/1090145773 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c004230 con 0x7f796c159830 2023-07-21T22:14:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f796959a700 1 -- 172.21.15.49:0/1090145773 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c004390 con 0x7f796c159830 2023-07-21T22:14:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f796959a700 1 -- 172.21.15.49:0/1090145773 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c0036c0 con 0x7f796c159830 2023-07-21T22:14:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f7970c11700 1 -- 172.21.15.49:0/1090145773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f796c159830 msgr2=0x7f796c152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.421+0000 7f7970c11700 1 --2- 172.21.15.49:0/1090145773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f796c159830 0x7f796c152d40 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f796c06c690 tx=0x7f795c009bf0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.425+0000 7f7970c11700 1 -- 172.21.15.49:0/1090145773 shutdown_connections 2023-07-21T22:14:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.425+0000 7f7970c11700 1 --2- 172.21.15.49:0/1090145773 >> v2:172.21.15.150:3300/0 conn(0x7f796c065960 0x7f796c0ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.425+0000 7f7970c11700 1 --2- 172.21.15.49:0/1090145773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f796c159830 0x7f796c152d40 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.425+0000 7f7970c11700 1 -- 172.21.15.49:0/1090145773 >> 172.21.15.49:0/1090145773 conn(0x7f796c071050 msgr2=0x7f796c071420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:12.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.425+0000 7f7970c11700 1 -- 172.21.15.49:0/1090145773 shutdown_connections 2023-07-21T22:14:12.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.425+0000 7f7970c11700 1 -- 172.21.15.49:0/1090145773 wait complete. 2023-07-21T22:14:12.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.425+0000 7f7970c11700 1 Processor -- start 2023-07-21T22:14:12.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.425+0000 7f7970c11700 1 -- start start 2023-07-21T22:14:12.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.425+0000 7f7970c11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f796c0654c0 0x7f796c159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f7970c11700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f796c065960 0x7f796c1455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f7970c11700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f796c159830 0x7f796c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f7970c11700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c152020 con 0x7f796c0654c0 2023-07-21T22:14:12.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f7970c11700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1e6c70 con 0x7f796c159830 2023-07-21T22:14:12.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f7970c11700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1e6f50 con 0x7f796c065960 2023-07-21T22:14:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f796a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f796c0654c0 0x7f796c159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f796a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f796c0654c0 0x7f796c159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40424/0 (socket says 172.21.15.49:40424) 2023-07-21T22:14:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f796a59c700 1 -- 172.21.15.49:0/529935947 learned_addr learned my addr 172.21.15.49:0/529935947 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f796ad9d700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f796c159830 0x7f796c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f7969d9b700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f796c065960 0x7f796c1455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f796a59c700 1 -- 172.21.15.49:0/529935947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f796c065960 msgr2=0x7f796c1455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f796a59c700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f796c065960 0x7f796c1455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f796a59c700 1 -- 172.21.15.49:0/529935947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f796c159830 msgr2=0x7f796c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f796a59c700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f796c159830 0x7f796c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f796a59c700 1 -- 172.21.15.49:0/529935947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c009570 con 0x7f796c0654c0 2023-07-21T22:14:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f796ad9d700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f796c159830 0x7f796c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f796a59c700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f796c0654c0 0x7f796c159dd0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f795c004000 tx=0x7f795c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f795affd700 1 -- 172.21.15.49:0/529935947 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c003e60 con 0x7f796c0654c0 2023-07-21T22:14:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f795affd700 1 -- 172.21.15.49:0/529935947 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c01f070 con 0x7f796c0654c0 2023-07-21T22:14:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f7970c11700 1 -- 172.21.15.49:0/529935947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c1e21c0 con 0x7f796c0654c0 2023-07-21T22:14:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f795affd700 1 -- 172.21.15.49:0/529935947 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c00b8a0 con 0x7f796c0654c0 2023-07-21T22:14:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.429+0000 7f7970c11700 1 -- 172.21.15.49:0/529935947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c1e2780 con 0x7f796c0654c0 2023-07-21T22:14:12.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.433+0000 7f7970c11700 1 -- 172.21.15.49:0/529935947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c070270 con 0x7f796c0654c0 2023-07-21T22:14:12.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.433+0000 7f795affd700 1 -- 172.21.15.49:0/529935947 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f795c021030 con 0x7f796c0654c0 2023-07-21T22:14:12.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.433+0000 7f795affd700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f794c0662f0 0x7f794c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.433+0000 7f795affd700 1 -- 172.21.15.49:0/529935947 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f795c0854e0 con 0x7f796c0654c0 2023-07-21T22:14:12.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.433+0000 7f7969d9b700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f794c0662f0 0x7f794c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.437+0000 7f7969d9b700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f794c0662f0 0x7f794c0687a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f796c06d660 tx=0x7f7960008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:12.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.441+0000 7f795affd700 1 -- 172.21.15.49:0/529935947 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f795c052810 con 0x7f796c0654c0 2023-07-21T22:14:12.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.613+0000 7f7970c11700 1 -- 172.21.15.49:0/529935947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f796c070270 con 0x7f796c0654c0 2023-07-21T22:14:12.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.613+0000 7f795affd700 1 -- 172.21.15.49:0/529935947 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7f795c055e30 con 0x7f796c0654c0 2023-07-21T22:14:12.657 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:14:12.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.617+0000 7f7970c11700 1 -- 172.21.15.49:0/529935947 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f794c0662f0 msgr2=0x7f794c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.617+0000 7f7970c11700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f794c0662f0 0x7f794c0687a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f796c06d660 tx=0x7f7960008040 comp rx=0 tx=0).stop 2023-07-21T22:14:12.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.617+0000 7f7970c11700 1 -- 172.21.15.49:0/529935947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f796c0654c0 msgr2=0x7f796c159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.617+0000 7f7970c11700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f796c0654c0 0x7f796c159dd0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f795c004000 tx=0x7f795c004770 comp rx=0 tx=0).stop 2023-07-21T22:14:12.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.617+0000 7f7970c11700 1 -- 172.21.15.49:0/529935947 shutdown_connections 2023-07-21T22:14:12.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.617+0000 7f7970c11700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f794c0662f0 0x7f794c0687a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.617+0000 7f7970c11700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f796c159830 0x7f796c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.617+0000 7f7970c11700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f796c065960 0x7f796c1455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.617+0000 7f7970c11700 1 --2- 172.21.15.49:0/529935947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f796c0654c0 0x7f796c159dd0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.617+0000 7f7970c11700 1 -- 172.21.15.49:0/529935947 >> 172.21.15.49:0/529935947 conn(0x7f796c071050 msgr2=0x7f796c152480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:12.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.617+0000 7f7970c11700 1 -- 172.21.15.49:0/529935947 shutdown_connections 2023-07-21T22:14:12.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.617+0000 7f7970c11700 1 -- 172.21.15.49:0/529935947 wait complete. 2023-07-21T22:14:12.680 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:14:12.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.817+0000 7faac47dc700 1 Processor -- start 2023-07-21T22:14:12.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.817+0000 7faac47dc700 1 -- start start 2023-07-21T22:14:12.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.817+0000 7faac47dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faabc156b00 0x7faabc06cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.817+0000 7faac47dc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faabc0cb8f0 0x7faabc06d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.817+0000 7faac47dc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc06d9b0 con 0x7faabc0cb520 2023-07-21T22:14:12.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.817+0000 7faac47dc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc15d8b0 con 0x7faabc0cb8f0 2023-07-21T22:14:12.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.817+0000 7faac47dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc15ff30 con 0x7faabc156b00 2023-07-21T22:14:12.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac2d79700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faabc0cb8f0 0x7faabc06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac1d77700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faabc156b00 0x7faabc06cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac2578700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faabc0cb520 0x7faabc1563f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41864/0 (socket says 172.21.15.49:41864) 2023-07-21T22:14:12.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac2578700 1 -- 172.21.15.49:0/3552206707 learned_addr learned my addr 172.21.15.49:0/3552206707 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:12.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac2d79700 1 -- 172.21.15.49:0/3552206707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faabc156b00 msgr2=0x7faabc06cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:12.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac2d79700 1 --2- 172.21.15.49:0/3552206707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faabc156b00 0x7faabc06cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac2d79700 1 -- 172.21.15.49:0/3552206707 >> v1:172.21.15.49:6789/0 conn(0x7faabc0cb520 legacy=0x7faabc1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac1576700 1 -- 172.21.15.49:0/3552206707 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462032522 0 0) 0x7faabc06d9b0 con 0x7faabc0cb520 2023-07-21T22:14:12.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac2d79700 1 -- 172.21.15.49:0/3552206707 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc160210 con 0x7faabc0cb8f0 2023-07-21T22:14:12.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac1d77700 1 --2- 172.21.15.49:0/3552206707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faabc156b00 0x7faabc06cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:14:12.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac2d79700 1 --2- 172.21.15.49:0/3552206707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faabc0cb8f0 0x7faabc06d180 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7faab4009d90 tx=0x7faab400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5b814d43a0677f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:12.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac1576700 1 -- 172.21.15.49:0/3552206707 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab400e070 con 0x7faabc0cb8f0 2023-07-21T22:14:12.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac1576700 1 -- 172.21.15.49:0/3552206707 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab400bb20 con 0x7faabc0cb8f0 2023-07-21T22:14:12.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac1576700 1 -- 172.21.15.49:0/3552206707 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4012430 con 0x7faabc0cb8f0 2023-07-21T22:14:12.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac47dc700 1 -- 172.21.15.49:0/3552206707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faabc0cb8f0 msgr2=0x7faabc06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.821+0000 7faac47dc700 1 --2- 172.21.15.49:0/3552206707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faabc0cb8f0 0x7faabc06d180 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7faab4009d90 tx=0x7faab400b330 comp rx=0 tx=0).stop 2023-07-21T22:14:12.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.825+0000 7faac47dc700 1 -- 172.21.15.49:0/3552206707 shutdown_connections 2023-07-21T22:14:12.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.825+0000 7faac47dc700 1 --2- 172.21.15.49:0/3552206707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faabc0cb8f0 0x7faabc06d180 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.825+0000 7faac47dc700 1 --2- 172.21.15.49:0/3552206707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faabc156b00 0x7faabc06cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.825+0000 7faac47dc700 1 -- 172.21.15.49:0/3552206707 >> 172.21.15.49:0/3552206707 conn(0x7faabc071050 msgr2=0x7faabc071420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:12.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.825+0000 7faac47dc700 1 -- 172.21.15.49:0/3552206707 shutdown_connections 2023-07-21T22:14:12.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.825+0000 7faac47dc700 1 -- 172.21.15.49:0/3552206707 wait complete. 2023-07-21T22:14:12.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.825+0000 7faac47dc700 1 Processor -- start 2023-07-21T22:14:12.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.825+0000 7faac47dc700 1 -- start start 2023-07-21T22:14:12.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.825+0000 7faac47dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faabc0cb520 0x7faabc152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.825+0000 7faac47dc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faabc0cb8f0 0x7faabc14ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.825+0000 7faac47dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faabc156b00 0x7faabc157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.825+0000 7faac47dc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0cd3f0 con 0x7faabc156b00 2023-07-21T22:14:12.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.825+0000 7faac47dc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0cd6d0 con 0x7faabc0cb8f0 2023-07-21T22:14:12.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.825+0000 7faac47dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0cd9b0 con 0x7faabc0cb520 2023-07-21T22:14:12.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faac2d79700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faabc156b00 0x7faabc157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faac2d79700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faabc156b00 0x7faabc157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40438/0 (socket says 172.21.15.49:40438) 2023-07-21T22:14:12.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faac2d79700 1 -- 172.21.15.49:0/170246120 learned_addr learned my addr 172.21.15.49:0/170246120 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:12.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faac2578700 1 --2- 172.21.15.49:0/170246120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faabc0cb520 0x7faabc152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faac1d77700 1 --2- 172.21.15.49:0/170246120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faabc0cb8f0 0x7faabc14ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faac2d79700 1 -- 172.21.15.49:0/170246120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faabc0cb520 msgr2=0x7faabc152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faac2d79700 1 --2- 172.21.15.49:0/170246120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faabc0cb520 0x7faabc152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faac2d79700 1 -- 172.21.15.49:0/170246120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faabc0cb8f0 msgr2=0x7faabc14ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:12.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faac2d79700 1 --2- 172.21.15.49:0/170246120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faabc0cb8f0 0x7faabc14ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:12.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faac2d79700 1 -- 172.21.15.49:0/170246120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0094b0 con 0x7faabc156b00 2023-07-21T22:14:12.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faac2d79700 1 --2- 172.21.15.49:0/170246120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faabc156b00 0x7faabc157c10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7faab4014040 tx=0x7faab4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:12.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faab2ffd700 1 -- 172.21.15.49:0/170246120 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4012430 con 0x7faabc156b00 2023-07-21T22:14:12.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faac47dc700 1 -- 172.21.15.49:0/170246120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab4009a70 con 0x7faabc156b00 2023-07-21T22:14:12.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faab2ffd700 1 -- 172.21.15.49:0/170246120 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4020070 con 0x7faabc156b00 2023-07-21T22:14:12.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faab2ffd700 1 -- 172.21.15.49:0/170246120 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4004280 con 0x7faabc156b00 2023-07-21T22:14:12.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faac47dc700 1 -- 172.21.15.49:0/170246120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc0cdf70 con 0x7faabc156b00 2023-07-21T22:14:12.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.829+0000 7faac47dc700 1 -- 172.21.15.49:0/170246120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faabc04dd50 con 0x7faabc156b00 2023-07-21T22:14:12.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.833+0000 7faab2ffd700 1 -- 172.21.15.49:0/170246120 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faab40043e0 con 0x7faabc156b00 2023-07-21T22:14:12.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.833+0000 7faab2ffd700 1 --2- 172.21.15.49:0/170246120 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faaa00662f0 0x7faaa00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:12.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.833+0000 7faab2ffd700 1 -- 172.21.15.49:0/170246120 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faab4022070 con 0x7faabc156b00 2023-07-21T22:14:12.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.833+0000 7faac2578700 1 --2- 172.21.15.49:0/170246120 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faaa00662f0 0x7faaa00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:12.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.833+0000 7faac2578700 1 --2- 172.21.15.49:0/170246120 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faaa00662f0 0x7faaa00687a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7faab8000f60 tx=0x7faab8007cb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:12.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:12.841+0000 7faab2ffd700 1 -- 172.21.15.49:0/170246120 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faab4052f10 con 0x7faabc156b00 2023-07-21T22:14:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.013+0000 7faac47dc700 1 -- 172.21.15.49:0/170246120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faabc0ce130 con 0x7faabc156b00 2023-07-21T22:14:13.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.017+0000 7faab2ffd700 1 -- 172.21.15.49:0/170246120 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v62) v1 ==== 92+0+10 (secure 0 0 0) 0x7faab4056530 con 0x7faabc156b00 2023-07-21T22:14:13.060 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:14:13.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.017+0000 7faac47dc700 1 -- 172.21.15.49:0/170246120 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faaa00662f0 msgr2=0x7faaa00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:13.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.017+0000 7faac47dc700 1 --2- 172.21.15.49:0/170246120 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faaa00662f0 0x7faaa00687a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7faab8000f60 tx=0x7faab8007cb0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.017+0000 7faac47dc700 1 -- 172.21.15.49:0/170246120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faabc156b00 msgr2=0x7faabc157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:13.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.017+0000 7faac47dc700 1 --2- 172.21.15.49:0/170246120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faabc156b00 0x7faabc157c10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7faab4014040 tx=0x7faab4004af0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.017+0000 7faac47dc700 1 -- 172.21.15.49:0/170246120 shutdown_connections 2023-07-21T22:14:13.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.017+0000 7faac47dc700 1 --2- 172.21.15.49:0/170246120 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7faaa00662f0 0x7faaa00687a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.017+0000 7faac47dc700 1 --2- 172.21.15.49:0/170246120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faabc156b00 0x7faabc157c10 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.017+0000 7faac47dc700 1 --2- 172.21.15.49:0/170246120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faabc0cb8f0 0x7faabc14ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.017+0000 7faac47dc700 1 --2- 172.21.15.49:0/170246120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faabc0cb520 0x7faabc152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.017+0000 7faac47dc700 1 -- 172.21.15.49:0/170246120 >> 172.21.15.49:0/170246120 conn(0x7faabc071050 msgr2=0x7faabc154df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:13.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.017+0000 7faac47dc700 1 -- 172.21.15.49:0/170246120 shutdown_connections 2023-07-21T22:14:13.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.017+0000 7faac47dc700 1 -- 172.21.15.49:0/170246120 wait complete. 2023-07-21T22:14:13.084 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:14:13.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.225+0000 7f9f59a53700 1 Processor -- start 2023-07-21T22:14:13.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.229+0000 7f9f59a53700 1 -- start start 2023-07-21T22:14:13.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.229+0000 7f9f59a53700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f540cde80 0x7f9f540ce250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:13.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.229+0000 7f9f59a53700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f540afbf0 0x7f9f540ca900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:13.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.229+0000 7f9f59a53700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f540ce790 con 0x7f9f5415a2a0 2023-07-21T22:14:13.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.229+0000 7f9f59a53700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f540cea40 con 0x7f9f540afbf0 2023-07-21T22:14:13.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.229+0000 7f9f59a53700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f540b04f0 con 0x7f9f540cde80 2023-07-21T22:14:13.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.229+0000 7f9f53fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9f5415a2a0 0x7f9f540b1590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41870/0 (socket says 172.21.15.49:41870) 2023-07-21T22:14:13.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f53fff700 1 -- 172.21.15.49:0/3881807261 learned_addr learned my addr 172.21.15.49:0/3881807261 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:13.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f59252700 1 --2- 172.21.15.49:0/3881807261 >> v2:172.21.15.49:3300/0 conn(0x7f9f540afbf0 0x7f9f540ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:13.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f58a51700 1 --2- 172.21.15.49:0/3881807261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f540cde80 0x7f9f540ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:13.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f537fe700 1 -- 172.21.15.49:0/3881807261 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215689921 0 0) 0x7f9f540ce790 con 0x7f9f5415a2a0 2023-07-21T22:14:13.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f537fe700 1 -- 172.21.15.49:0/3881807261 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f440035d0 con 0x7f9f5415a2a0 2023-07-21T22:14:13.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f59252700 1 -- 172.21.15.49:0/3881807261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f540cde80 msgr2=0x7f9f540ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:13.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f59252700 1 --2- 172.21.15.49:0/3881807261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f540cde80 0x7f9f540ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f59252700 1 -- 172.21.15.49:0/3881807261 >> v1:172.21.15.49:6789/0 conn(0x7f9f5415a2a0 legacy=0x7f9f540b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:13.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f59252700 1 -- 172.21.15.49:0/3881807261 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f540b07d0 con 0x7f9f540afbf0 2023-07-21T22:14:13.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f59252700 1 --2- 172.21.15.49:0/3881807261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f540afbf0 0x7f9f540ca900 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009d90 tx=0x7f9f4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b9541bfb9e05b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:13.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f537fe700 1 -- 172.21.15.49:0/3881807261 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c00e070 con 0x7f9f540afbf0 2023-07-21T22:14:13.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f537fe700 1 -- 172.21.15.49:0/3881807261 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c00bb20 con 0x7f9f540afbf0 2023-07-21T22:14:13.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f537fe700 1 -- 172.21.15.49:0/3881807261 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c012430 con 0x7f9f540afbf0 2023-07-21T22:14:13.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f59a53700 1 -- 172.21.15.49:0/3881807261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f540afbf0 msgr2=0x7f9f540ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:13.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f59a53700 1 --2- 172.21.15.49:0/3881807261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f540afbf0 0x7f9f540ca900 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009d90 tx=0x7f9f4c00b330 comp rx=0 tx=0).stop 2023-07-21T22:14:13.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f59a53700 1 -- 172.21.15.49:0/3881807261 shutdown_connections 2023-07-21T22:14:13.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f59a53700 1 --2- 172.21.15.49:0/3881807261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f540afbf0 0x7f9f540ca900 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f59a53700 1 --2- 172.21.15.49:0/3881807261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f540cde80 0x7f9f540ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f59a53700 1 -- 172.21.15.49:0/3881807261 >> 172.21.15.49:0/3881807261 conn(0x7f9f54089fe0 msgr2=0x7f9f540d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:13.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f59a53700 1 -- 172.21.15.49:0/3881807261 shutdown_connections 2023-07-21T22:14:13.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.233+0000 7f9f59a53700 1 -- 172.21.15.49:0/3881807261 wait complete. 2023-07-21T22:14:13.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.237+0000 7f9f59a53700 1 Processor -- start 2023-07-21T22:14:13.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.237+0000 7f9f59a53700 1 -- start start 2023-07-21T22:14:13.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.237+0000 7f9f59a53700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f540afbf0 0x7f9f54071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:13.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.237+0000 7f9f59a53700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f540cde80 0x7f9f54070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:13.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.237+0000 7f9f59a53700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5415a2a0 0x7f9f5406fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:13.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.237+0000 7f9f59a53700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f540c7380 con 0x7f9f540cde80 2023-07-21T22:14:13.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.237+0000 7f9f59a53700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f54071ac0 con 0x7f9f5415a2a0 2023-07-21T22:14:13.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.237+0000 7f9f59a53700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f541f0b80 con 0x7f9f540afbf0 2023-07-21T22:14:13.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.237+0000 7f9f53fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f540cde80 0x7f9f54070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:13.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.237+0000 7f9f58a51700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f540afbf0 0x7f9f54071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:13.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.237+0000 7f9f53fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f540cde80 0x7f9f54070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40448/0 (socket says 172.21.15.49:40448) 2023-07-21T22:14:13.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.237+0000 7f9f58a51700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f540afbf0 0x7f9f54071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:36690/0 (socket says 172.21.15.49:36690) 2023-07-21T22:14:13.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.237+0000 7f9f53fff700 1 -- 172.21.15.49:0/2270404076 learned_addr learned my addr 172.21.15.49:0/2270404076 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:13.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.237+0000 7f9f59252700 1 --2- 172.21.15.49:0/2270404076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5415a2a0 0x7f9f5406fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:13.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.241+0000 7f9f53fff700 1 -- 172.21.15.49:0/2270404076 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f540afbf0 msgr2=0x7f9f54071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:13.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.241+0000 7f9f53fff700 1 --2- 172.21.15.49:0/2270404076 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f540afbf0 0x7f9f54071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.241+0000 7f9f53fff700 1 -- 172.21.15.49:0/2270404076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5415a2a0 msgr2=0x7f9f5406fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:13.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.241+0000 7f9f53fff700 1 --2- 172.21.15.49:0/2270404076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5415a2a0 0x7f9f5406fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.241+0000 7f9f53fff700 1 -- 172.21.15.49:0/2270404076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c009a70 con 0x7f9f540cde80 2023-07-21T22:14:13.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.241+0000 7f9f59252700 1 --2- 172.21.15.49:0/2270404076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5415a2a0 0x7f9f5406fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:13.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.241+0000 7f9f53fff700 1 --2- 172.21.15.49:0/2270404076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f540cde80 0x7f9f54070710 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9f4000c700 tx=0x7f9f4000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:13.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.241+0000 7f9f517fa700 1 -- 172.21.15.49:0/2270404076 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40005d90 con 0x7f9f540cde80 2023-07-21T22:14:13.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.241+0000 7f9f517fa700 1 -- 172.21.15.49:0/2270404076 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f400070d0 con 0x7f9f540cde80 2023-07-21T22:14:13.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.241+0000 7f9f517fa700 1 -- 172.21.15.49:0/2270404076 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40007480 con 0x7f9f540cde80 2023-07-21T22:14:13.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.241+0000 7f9f59a53700 1 -- 172.21.15.49:0/2270404076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f541f4ef0 con 0x7f9f540cde80 2023-07-21T22:14:13.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.241+0000 7f9f59a53700 1 -- 172.21.15.49:0/2270404076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f540c7870 con 0x7f9f540cde80 2023-07-21T22:14:13.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.241+0000 7f9f59a53700 1 -- 172.21.15.49:0/2270404076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f541f0d40 con 0x7f9f540cde80 2023-07-21T22:14:13.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.245+0000 7f9f517fa700 1 -- 172.21.15.49:0/2270404076 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9f400075e0 con 0x7f9f540cde80 2023-07-21T22:14:13.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.245+0000 7f9f517fa700 1 --2- 172.21.15.49:0/2270404076 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f380662f0 0x7f9f380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:13.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.245+0000 7f9f517fa700 1 -- 172.21.15.49:0/2270404076 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9f40083440 con 0x7f9f540cde80 2023-07-21T22:14:13.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.245+0000 7f9f58a51700 1 --2- 172.21.15.49:0/2270404076 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f380662f0 0x7f9f380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:13.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.245+0000 7f9f58a51700 1 --2- 172.21.15.49:0/2270404076 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f380662f0 0x7f9f380687a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9f540c32f0 tx=0x7f9f480091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:13.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.249+0000 7f9f517fa700 1 -- 172.21.15.49:0/2270404076 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9f400506f0 con 0x7f9f540cde80 2023-07-21T22:14:13.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.425+0000 7f9f59a53700 1 -- 172.21.15.49:0/2270404076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f5404dcb0 con 0x7f9f540cde80 2023-07-21T22:14:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.425+0000 7f9f517fa700 1 -- 172.21.15.49:0/2270404076 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v62) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9f40053d10 con 0x7f9f540cde80 2023-07-21T22:14:13.471 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:14:13.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.429+0000 7f9f59a53700 1 -- 172.21.15.49:0/2270404076 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f380662f0 msgr2=0x7f9f380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:13.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.429+0000 7f9f59a53700 1 --2- 172.21.15.49:0/2270404076 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f380662f0 0x7f9f380687a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9f540c32f0 tx=0x7f9f480091c0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.429+0000 7f9f59a53700 1 -- 172.21.15.49:0/2270404076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f540cde80 msgr2=0x7f9f54070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:13.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.429+0000 7f9f59a53700 1 --2- 172.21.15.49:0/2270404076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f540cde80 0x7f9f54070710 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9f4000c700 tx=0x7f9f4000ca10 comp rx=0 tx=0).stop 2023-07-21T22:14:13.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.433+0000 7f9f59a53700 1 -- 172.21.15.49:0/2270404076 shutdown_connections 2023-07-21T22:14:13.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.433+0000 7f9f59a53700 1 --2- 172.21.15.49:0/2270404076 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f380662f0 0x7f9f380687a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.433+0000 7f9f59a53700 1 --2- 172.21.15.49:0/2270404076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f540cde80 0x7f9f54070710 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.433+0000 7f9f59a53700 1 --2- 172.21.15.49:0/2270404076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5415a2a0 0x7f9f5406fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.433+0000 7f9f59a53700 1 --2- 172.21.15.49:0/2270404076 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f540afbf0 0x7f9f54071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.433+0000 7f9f59a53700 1 -- 172.21.15.49:0/2270404076 >> 172.21.15.49:0/2270404076 conn(0x7f9f54089fe0 msgr2=0x7f9f5406b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:13.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.433+0000 7f9f59a53700 1 -- 172.21.15.49:0/2270404076 shutdown_connections 2023-07-21T22:14:13.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.433+0000 7f9f59a53700 1 -- 172.21.15.49:0/2270404076 wait complete. 2023-07-21T22:14:13.499 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:14:13.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.641+0000 7fd80ffff700 1 Processor -- start 2023-07-21T22:14:13.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80ffff700 1 -- start start 2023-07-21T22:14:13.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd810159be0 0x7fd8100c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:13.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8100ca550 0x7fd81006d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:13.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80ffff700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8100c8b80 con 0x7fd81006d6d0 2023-07-21T22:14:13.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80ffff700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81006db90 con 0x7fd810159be0 2023-07-21T22:14:13.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80ffff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81006de70 con 0x7fd8100ca550 2023-07-21T22:14:13.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd810159be0 0x7fd8100c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:13.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd810159be0 0x7fd8100c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40464/0 (socket says 172.21.15.49:40464) 2023-07-21T22:14:13.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80effd700 1 -- 172.21.15.49:0/1187117204 learned_addr learned my addr 172.21.15.49:0/1187117204 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:13.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd807fff700 1 --2- 172.21.15.49:0/1187117204 >> v2:172.21.15.150:3300/0 conn(0x7fd8100ca550 0x7fd81006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:13.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80effd700 1 -- 172.21.15.49:0/1187117204 >> v2:172.21.15.150:3300/0 conn(0x7fd8100ca550 msgr2=0x7fd81006d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:13.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80effd700 1 --2- 172.21.15.49:0/1187117204 >> v2:172.21.15.150:3300/0 conn(0x7fd8100ca550 0x7fd81006d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80effd700 1 -- 172.21.15.49:0/1187117204 >> v1:172.21.15.49:6789/0 conn(0x7fd81006d6d0 legacy=0x7fd8100698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:13.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80effd700 1 -- 172.21.15.49:0/1187117204 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8100c8810 con 0x7fd810159be0 2023-07-21T22:14:13.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd807fff700 1 --2- 172.21.15.49:0/1187117204 >> v2:172.21.15.150:3300/0 conn(0x7fd8100ca550 0x7fd81006d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:13.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80effd700 1 --2- 172.21.15.49:0/1187117204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd810159be0 0x7fd8100c9010 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd81015d4d0 tx=0x7fd800009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e068b858f49e4b67 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:13.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80e7fc700 1 -- 172.21.15.49:0/1187117204 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000b8a0 con 0x7fd810159be0 2023-07-21T22:14:13.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80e7fc700 1 -- 172.21.15.49:0/1187117204 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80000ba00 con 0x7fd810159be0 2023-07-21T22:14:13.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.645+0000 7fd80e7fc700 1 -- 172.21.15.49:0/1187117204 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000bd90 con 0x7fd810159be0 2023-07-21T22:14:13.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.649+0000 7fd80ffff700 1 -- 172.21.15.49:0/1187117204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd810159be0 msgr2=0x7fd8100c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:13.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.649+0000 7fd80ffff700 1 --2- 172.21.15.49:0/1187117204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd810159be0 0x7fd8100c9010 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd81015d4d0 tx=0x7fd800009bf0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.649+0000 7fd80ffff700 1 -- 172.21.15.49:0/1187117204 shutdown_connections 2023-07-21T22:14:13.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.649+0000 7fd80ffff700 1 --2- 172.21.15.49:0/1187117204 >> v2:172.21.15.150:3300/0 conn(0x7fd8100ca550 0x7fd81006d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.649+0000 7fd80ffff700 1 --2- 172.21.15.49:0/1187117204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd810159be0 0x7fd8100c9010 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.649+0000 7fd80ffff700 1 -- 172.21.15.49:0/1187117204 >> 172.21.15.49:0/1187117204 conn(0x7fd8100ce0d0 msgr2=0x7fd8100ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:13.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.649+0000 7fd80ffff700 1 -- 172.21.15.49:0/1187117204 shutdown_connections 2023-07-21T22:14:13.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.649+0000 7fd80ffff700 1 -- 172.21.15.49:0/1187117204 wait complete. 2023-07-21T22:14:13.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.653+0000 7fd80ffff700 1 Processor -- start 2023-07-21T22:14:13.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.653+0000 7fd80ffff700 1 -- start start 2023-07-21T22:14:13.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.653+0000 7fd80ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd81006d6d0 0x7fd8100b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:13.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8100ca550 0x7fd8101525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:13.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd810159be0 0x7fd810152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:13.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80ffff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd810153050 con 0x7fd81006d6d0 2023-07-21T22:14:13.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80ffff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100c70c0 con 0x7fd810159be0 2023-07-21T22:14:13.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80ffff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100c73a0 con 0x7fd8100ca550 2023-07-21T22:14:13.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd81006d6d0 0x7fd8100b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:13.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd81006d6d0 0x7fd8100b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40476/0 (socket says 172.21.15.49:40476) 2023-07-21T22:14:13.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80effd700 1 -- 172.21.15.49:0/3426744682 learned_addr learned my addr 172.21.15.49:0/3426744682 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:13.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd807fff700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8100ca550 0x7fd8101525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:13.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80f7fe700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd810159be0 0x7fd810152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:13.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80effd700 1 -- 172.21.15.49:0/3426744682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8100ca550 msgr2=0x7fd8101525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:13.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80effd700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8100ca550 0x7fd8101525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80effd700 1 -- 172.21.15.49:0/3426744682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd810159be0 msgr2=0x7fd810152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:13.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80effd700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd810159be0 0x7fd810152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80effd700 1 -- 172.21.15.49:0/3426744682 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800009570 con 0x7fd81006d6d0 2023-07-21T22:14:13.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd807fff700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8100ca550 0x7fd8101525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:13.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80f7fe700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd810159be0 0x7fd810152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:13.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80effd700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd81006d6d0 0x7fd8100b1ba0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fd800000c00 tx=0x7fd800004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:13.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80cff9700 1 -- 172.21.15.49:0/3426744682 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000038c0 con 0x7fd81006d6d0 2023-07-21T22:14:13.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80cff9700 1 -- 172.21.15.49:0/3426744682 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800003a20 con 0x7fd81006d6d0 2023-07-21T22:14:13.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80ffff700 1 -- 172.21.15.49:0/3426744682 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8100c7680 con 0x7fd81006d6d0 2023-07-21T22:14:13.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80cff9700 1 -- 172.21.15.49:0/3426744682 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800003db0 con 0x7fd81006d6d0 2023-07-21T22:14:13.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80ffff700 1 -- 172.21.15.49:0/3426744682 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8100cc120 con 0x7fd81006d6d0 2023-07-21T22:14:13.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.657+0000 7fd80ffff700 1 -- 172.21.15.49:0/3426744682 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81004dcb0 con 0x7fd81006d6d0 2023-07-21T22:14:13.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.661+0000 7fd80cff9700 1 -- 172.21.15.49:0/3426744682 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd800011420 con 0x7fd81006d6d0 2023-07-21T22:14:13.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.661+0000 7fd80cff9700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd7f00662f0 0x7fd7f00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:13.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.661+0000 7fd80cff9700 1 -- 172.21.15.49:0/3426744682 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd800020030 con 0x7fd81006d6d0 2023-07-21T22:14:13.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.661+0000 7fd807fff700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd7f00662f0 0x7fd7f00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:13.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.665+0000 7fd807fff700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd7f00662f0 0x7fd7f00687a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd8100c4930 tx=0x7fd7f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:13.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.665+0000 7fd80cff9700 1 -- 172.21.15.49:0/3426744682 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd8000527f0 con 0x7fd81006d6d0 2023-07-21T22:14:13.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.841+0000 7fd80ffff700 1 -- 172.21.15.49:0/3426744682 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd810069f80 con 0x7fd81006d6d0 2023-07-21T22:14:13.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.841+0000 7fd80cff9700 1 -- 172.21.15.49:0/3426744682 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v62) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd800055e10 con 0x7fd81006d6d0 2023-07-21T22:14:13.887 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:14:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.845+0000 7fd80ffff700 1 -- 172.21.15.49:0/3426744682 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd7f00662f0 msgr2=0x7fd7f00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.845+0000 7fd80ffff700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd7f00662f0 0x7fd7f00687a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd8100c4930 tx=0x7fd7f8008040 comp rx=0 tx=0).stop 2023-07-21T22:14:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.845+0000 7fd80ffff700 1 -- 172.21.15.49:0/3426744682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd81006d6d0 msgr2=0x7fd8100b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.845+0000 7fd80ffff700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd81006d6d0 0x7fd8100b1ba0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fd800000c00 tx=0x7fd800004770 comp rx=0 tx=0).stop 2023-07-21T22:14:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.845+0000 7fd80ffff700 1 -- 172.21.15.49:0/3426744682 shutdown_connections 2023-07-21T22:14:13.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.845+0000 7fd80ffff700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd7f00662f0 0x7fd7f00687a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.845+0000 7fd80ffff700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd810159be0 0x7fd810152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.845+0000 7fd80ffff700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8100ca550 0x7fd8101525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.845+0000 7fd80ffff700 1 --2- 172.21.15.49:0/3426744682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd81006d6d0 0x7fd8100b1ba0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:13.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.845+0000 7fd80ffff700 1 -- 172.21.15.49:0/3426744682 >> 172.21.15.49:0/3426744682 conn(0x7fd8100ce0d0 msgr2=0x7fd810159fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:13.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.845+0000 7fd80ffff700 1 -- 172.21.15.49:0/3426744682 shutdown_connections 2023-07-21T22:14:13.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:13.845+0000 7fd80ffff700 1 -- 172.21.15.49:0/3426744682 wait complete. 2023-07-21T22:14:13.911 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:14:14.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.041+0000 7f28be093700 1 Processor -- start 2023-07-21T22:14:14.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.041+0000 7f28be093700 1 -- start start 2023-07-21T22:14:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28be093700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28b806d380 0x7f28b806d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28be093700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f28b8071c70 0x7f28b80b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28be093700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b80cab20 con 0x7f28b80b1400 2023-07-21T22:14:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28be093700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b80c9e80 con 0x7f28b8071c70 2023-07-21T22:14:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28be093700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80afeb0 con 0x7f28b806d380 2023-07-21T22:14:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28bc890700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f28b8071c70 0x7f28b80b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28bd892700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f28b80b1400 0x7f28b80cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:59876/0 (socket says 172.21.15.49:59876) 2023-07-21T22:14:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28bd892700 1 -- 172.21.15.49:0/1821215789 learned_addr learned my addr 172.21.15.49:0/1821215789 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28bd091700 1 --2- 172.21.15.49:0/1821215789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28b806d380 0x7f28b806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28affff700 1 -- 172.21.15.49:0/1821215789 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422998980 0 0) 0x7f28b80cab20 con 0x7f28b80b1400 2023-07-21T22:14:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28bc890700 1 -- 172.21.15.49:0/1821215789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28b806d380 msgr2=0x7f28b806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28bc890700 1 --2- 172.21.15.49:0/1821215789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28b806d380 0x7f28b806d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28bc890700 1 -- 172.21.15.49:0/1821215789 >> v1:172.21.15.150:6789/0 conn(0x7f28b80b1400 legacy=0x7f28b80cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28bc890700 1 -- 172.21.15.49:0/1821215789 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b806dc90 con 0x7f28b8071c70 2023-07-21T22:14:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28bc890700 1 --2- 172.21.15.49:0/1821215789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28b8071c70 0x7f28b80b0ec0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009850 tx=0x7f28a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5d35c8837766740 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28affff700 1 -- 172.21.15.49:0/1821215789 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a8011830 con 0x7f28b8071c70 2023-07-21T22:14:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28affff700 1 -- 172.21.15.49:0/1821215789 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a8011990 con 0x7f28b8071c70 2023-07-21T22:14:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.045+0000 7f28affff700 1 -- 172.21.15.49:0/1821215789 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a8011d40 con 0x7f28b8071c70 2023-07-21T22:14:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.049+0000 7f28be093700 1 -- 172.21.15.49:0/1821215789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28b8071c70 msgr2=0x7f28b80b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.049+0000 7f28be093700 1 --2- 172.21.15.49:0/1821215789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28b8071c70 0x7f28b80b0ec0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009850 tx=0x7f28a8009b60 comp rx=0 tx=0).stop 2023-07-21T22:14:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.049+0000 7f28be093700 1 -- 172.21.15.49:0/1821215789 shutdown_connections 2023-07-21T22:14:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.049+0000 7f28be093700 1 --2- 172.21.15.49:0/1821215789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28b8071c70 0x7f28b80b0ec0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.049+0000 7f28be093700 1 --2- 172.21.15.49:0/1821215789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28b806d380 0x7f28b806d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.049+0000 7f28be093700 1 -- 172.21.15.49:0/1821215789 >> 172.21.15.49:0/1821215789 conn(0x7f28b8070450 msgr2=0x7f28b8070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.049+0000 7f28be093700 1 -- 172.21.15.49:0/1821215789 shutdown_connections 2023-07-21T22:14:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.049+0000 7f28be093700 1 -- 172.21.15.49:0/1821215789 wait complete. 2023-07-21T22:14:14.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.053+0000 7f28be093700 1 Processor -- start 2023-07-21T22:14:14.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.053+0000 7f28be093700 1 -- start start 2023-07-21T22:14:14.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.053+0000 7f28be093700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28b806d380 0x7f28b8155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:14.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.053+0000 7f28be093700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28b8071c70 0x7f28b80c2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.053+0000 7f28be093700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80b1400 0x7f28b80aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.053+0000 7f28be093700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80c2ad0 con 0x7f28b80b1400 2023-07-21T22:14:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.053+0000 7f28be093700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8145ff0 con 0x7f28b8071c70 2023-07-21T22:14:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.053+0000 7f28be093700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80c38f0 con 0x7f28b806d380 2023-07-21T22:14:14.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.053+0000 7f28bd892700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80b1400 0x7f28b80aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:14.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.053+0000 7f28bd892700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80b1400 0x7f28b80aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40490/0 (socket says 172.21.15.49:40490) 2023-07-21T22:14:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.053+0000 7f28bd892700 1 -- 172.21.15.49:0/3173923780 learned_addr learned my addr 172.21.15.49:0/3173923780 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.057+0000 7f28bd091700 1 --2- 172.21.15.49:0/3173923780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28b806d380 0x7f28b8155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.057+0000 7f28bc890700 1 --2- 172.21.15.49:0/3173923780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28b8071c70 0x7f28b80c2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.057+0000 7f28bd892700 1 -- 172.21.15.49:0/3173923780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28b806d380 msgr2=0x7f28b8155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.057+0000 7f28bd892700 1 --2- 172.21.15.49:0/3173923780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28b806d380 0x7f28b8155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.057+0000 7f28bd892700 1 -- 172.21.15.49:0/3173923780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28b8071c70 msgr2=0x7f28b80c2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:14.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.057+0000 7f28bd892700 1 --2- 172.21.15.49:0/3173923780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28b8071c70 0x7f28b80c2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:14.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.057+0000 7f28bd892700 1 -- 172.21.15.49:0/3173923780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a80094b0 con 0x7f28b80b1400 2023-07-21T22:14:14.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.057+0000 7f28bd892700 1 --2- 172.21.15.49:0/3173923780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80b1400 0x7f28b80aee40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f28b000c490 tx=0x7f28b000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:14.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.057+0000 7f28adffb700 1 -- 172.21.15.49:0/3173923780 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0004ca0 con 0x7f28b80b1400 2023-07-21T22:14:14.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.057+0000 7f28adffb700 1 -- 172.21.15.49:0/3173923780 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b0004e20 con 0x7f28b80b1400 2023-07-21T22:14:14.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.057+0000 7f28adffb700 1 -- 172.21.15.49:0/3173923780 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0007310 con 0x7f28b80b1400 2023-07-21T22:14:14.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.057+0000 7f28be093700 1 -- 172.21.15.49:0/3173923780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b80c2ce0 con 0x7f28b80b1400 2023-07-21T22:14:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.057+0000 7f28be093700 1 -- 172.21.15.49:0/3173923780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b80c32a0 con 0x7f28b80b1400 2023-07-21T22:14:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.057+0000 7f28be093700 1 -- 172.21.15.49:0/3173923780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b806c580 con 0x7f28b80b1400 2023-07-21T22:14:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.061+0000 7f28adffb700 1 -- 172.21.15.49:0/3173923780 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28b0007470 con 0x7f28b80b1400 2023-07-21T22:14:14.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.061+0000 7f28adffb700 1 --2- 172.21.15.49:0/3173923780 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f289c0662f0 0x7f289c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:14.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.061+0000 7f28adffb700 1 -- 172.21.15.49:0/3173923780 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f28b0083b60 con 0x7f28b80b1400 2023-07-21T22:14:14.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.061+0000 7f28bd091700 1 --2- 172.21.15.49:0/3173923780 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f289c0662f0 0x7f289c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.065+0000 7f28bd091700 1 --2- 172.21.15.49:0/3173923780 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f289c0662f0 0x7f289c0687a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f28b40074a0 tx=0x7f28b400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:14.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.069+0000 7f28adffb700 1 -- 172.21.15.49:0/3173923780 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28b0050e90 con 0x7f28b80b1400 2023-07-21T22:14:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.257+0000 7f28be093700 1 -- 172.21.15.49:0/3173923780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f28b804dcb0 con 0x7f28b80b1400 2023-07-21T22:14:14.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.257+0000 7f28adffb700 1 -- 172.21.15.49:0/3173923780 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v62) v1 ==== 80+0+0 (secure 0 0 0) 0x7f28b0083020 con 0x7f28b80b1400 2023-07-21T22:14:14.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.261+0000 7f28be093700 1 -- 172.21.15.49:0/3173923780 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f289c0662f0 msgr2=0x7f289c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:14.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.261+0000 7f28be093700 1 --2- 172.21.15.49:0/3173923780 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f289c0662f0 0x7f289c0687a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f28b40074a0 tx=0x7f28b400b040 comp rx=0 tx=0).stop 2023-07-21T22:14:14.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.261+0000 7f28be093700 1 -- 172.21.15.49:0/3173923780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80b1400 msgr2=0x7f28b80aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:14.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.261+0000 7f28be093700 1 --2- 172.21.15.49:0/3173923780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80b1400 0x7f28b80aee40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f28b000c490 tx=0x7f28b000c850 comp rx=0 tx=0).stop 2023-07-21T22:14:14.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.265+0000 7f28be093700 1 -- 172.21.15.49:0/3173923780 shutdown_connections 2023-07-21T22:14:14.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.265+0000 7f28be093700 1 --2- 172.21.15.49:0/3173923780 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f289c0662f0 0x7f289c0687a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:14.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.265+0000 7f28be093700 1 --2- 172.21.15.49:0/3173923780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80b1400 0x7f28b80aee40 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:14.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.265+0000 7f28be093700 1 --2- 172.21.15.49:0/3173923780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28b8071c70 0x7f28b80c2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:14.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.265+0000 7f28be093700 1 --2- 172.21.15.49:0/3173923780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28b806d380 0x7f28b8155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:14.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.265+0000 7f28be093700 1 -- 172.21.15.49:0/3173923780 >> 172.21.15.49:0/3173923780 conn(0x7f28b8070450 msgr2=0x7f28b80b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:14.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.265+0000 7f28be093700 1 -- 172.21.15.49:0/3173923780 shutdown_connections 2023-07-21T22:14:14.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:14.265+0000 7f28be093700 1 -- 172.21.15.49:0/3173923780 wait complete. 2023-07-21T22:14:14.309 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:14:14.327 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2023-07-21T22:14:14.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:14.328 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:14.358 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[48834]: fuse finished with error 0 and tester_r 0 2023-07-21T22:14:14.361 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:14:20.463 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:14:20.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:20.464 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:14:20.493 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:14:20.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.668+0000 7fb03e653700 1 Processor -- start 2023-07-21T22:14:20.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.668+0000 7fb03e653700 1 -- start start 2023-07-21T22:14:20.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.672+0000 7fb03e653700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb038160370 0x7fb03806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:20.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.672+0000 7fb03e653700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03806e010 con 0x7fb0380ca490 2023-07-21T22:14:20.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.672+0000 7fb03e653700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb038160740 con 0x7fb0380c1470 2023-07-21T22:14:20.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.672+0000 7fb03e653700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0380ccc50 con 0x7fb038160370 2023-07-21T22:14:20.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.672+0000 7fb03d651700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb038160370 0x7fb03806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:20.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.672+0000 7fb03d651700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb038160370 0x7fb03806d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47872/0 (socket says 172.21.15.49:47872) 2023-07-21T22:14:20.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.672+0000 7fb03d651700 1 -- 172.21.15.49:0/4001888941 learned_addr learned my addr 172.21.15.49:0/4001888941 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:20.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.672+0000 7fb03d651700 1 -- 172.21.15.49:0/4001888941 >> v1:172.21.15.150:6789/0 conn(0x7fb0380c1470 legacy=0x7fb0380c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:20.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.672+0000 7fb03d651700 1 -- 172.21.15.49:0/4001888941 >> v1:172.21.15.49:6789/0 conn(0x7fb0380ca490 legacy=0x7fb038163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:20.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.672+0000 7fb03d651700 1 -- 172.21.15.49:0/4001888941 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0380afc90 con 0x7fb038160370 2023-07-21T22:14:20.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.672+0000 7fb03d651700 1 --2- 172.21.15.49:0/4001888941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb038160370 0x7fb03806d7e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb034009e50 tx=0x7fb03400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf8d99f775062e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:20.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.672+0000 7fb02ffff700 1 -- 172.21.15.49:0/4001888941 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03400e070 con 0x7fb038160370 2023-07-21T22:14:20.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.676+0000 7fb02ffff700 1 -- 172.21.15.49:0/4001888941 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb034003a40 con 0x7fb038160370 2023-07-21T22:14:20.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.676+0000 7fb02ffff700 1 -- 172.21.15.49:0/4001888941 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034003df0 con 0x7fb038160370 2023-07-21T22:14:20.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.676+0000 7fb03e653700 1 -- 172.21.15.49:0/4001888941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb038160370 msgr2=0x7fb03806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:20.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.676+0000 7fb03e653700 1 --2- 172.21.15.49:0/4001888941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb038160370 0x7fb03806d7e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb034009e50 tx=0x7fb03400b330 comp rx=0 tx=0).stop 2023-07-21T22:14:20.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.676+0000 7fb03e653700 1 -- 172.21.15.49:0/4001888941 shutdown_connections 2023-07-21T22:14:20.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.676+0000 7fb03e653700 1 --2- 172.21.15.49:0/4001888941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb038160370 0x7fb03806d7e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:20.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.676+0000 7fb03e653700 1 -- 172.21.15.49:0/4001888941 >> 172.21.15.49:0/4001888941 conn(0x7fb038070450 msgr2=0x7fb038070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:20.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.676+0000 7fb03e653700 1 -- 172.21.15.49:0/4001888941 shutdown_connections 2023-07-21T22:14:20.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.676+0000 7fb03e653700 1 -- 172.21.15.49:0/4001888941 wait complete. 2023-07-21T22:14:20.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.676+0000 7fb03e653700 1 Processor -- start 2023-07-21T22:14:20.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.676+0000 7fb03e653700 1 -- start start 2023-07-21T22:14:20.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03e653700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0380c1470 0x7fb0380c2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:20.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03e653700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0380ca490 0x7fb0380b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:20.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03e653700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb038160370 0x7fb0381f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:20.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03e653700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0380c2d50 con 0x7fb0380ca490 2023-07-21T22:14:20.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03e653700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0380c2a70 con 0x7fb038160370 2023-07-21T22:14:20.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03e653700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0380c3250 con 0x7fb0380c1470 2023-07-21T22:14:20.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03ce50700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0380ca490 0x7fb0380b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:20.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03ce50700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0380ca490 0x7fb0380b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47874/0 (socket says 172.21.15.49:47874) 2023-07-21T22:14:20.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03ce50700 1 -- 172.21.15.49:0/304587642 learned_addr learned my addr 172.21.15.49:0/304587642 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:20.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03d651700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0380c1470 0x7fb0380c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:20.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03ce50700 1 -- 172.21.15.49:0/304587642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0380c1470 msgr2=0x7fb0380c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:20.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03ce50700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0380c1470 0x7fb0380c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:20.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03ce50700 1 -- 172.21.15.49:0/304587642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb038160370 msgr2=0x7fb0381f6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:20.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03de52700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb038160370 0x7fb0381f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:20.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03ce50700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb038160370 0x7fb0381f6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:20.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03ce50700 1 -- 172.21.15.49:0/304587642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb034009b30 con 0x7fb0380ca490 2023-07-21T22:14:20.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03d651700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0380c1470 0x7fb0380c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:20.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03de52700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb038160370 0x7fb0381f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:20.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03ce50700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0380ca490 0x7fb0380b3980 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb02800b4a0 tx=0x7fb02800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:20.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb02dffb700 1 -- 172.21.15.49:0/304587642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028011830 con 0x7fb0380ca490 2023-07-21T22:14:20.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb02dffb700 1 -- 172.21.15.49:0/304587642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb028011990 con 0x7fb0380ca490 2023-07-21T22:14:20.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb02dffb700 1 -- 172.21.15.49:0/304587642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028011d40 con 0x7fb0380ca490 2023-07-21T22:14:20.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03e653700 1 -- 172.21.15.49:0/304587642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0380c3530 con 0x7fb0380ca490 2023-07-21T22:14:20.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.680+0000 7fb03e653700 1 -- 172.21.15.49:0/304587642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0381f69a0 con 0x7fb0380ca490 2023-07-21T22:14:20.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.684+0000 7fb03e653700 1 -- 172.21.15.49:0/304587642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0380c3a50 con 0x7fb0380ca490 2023-07-21T22:14:20.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.684+0000 7fb02dffb700 1 -- 172.21.15.49:0/304587642 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb02801a400 con 0x7fb0380ca490 2023-07-21T22:14:20.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.688+0000 7fb02dffb700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb01c0662f0 0x7fb01c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:20.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.688+0000 7fb02dffb700 1 -- 172.21.15.49:0/304587642 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fb028083b80 con 0x7fb0380ca490 2023-07-21T22:14:20.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.688+0000 7fb03d651700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb01c0662f0 0x7fb01c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:20.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.688+0000 7fb03d651700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb01c0662f0 0x7fb01c0687a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb0380cea20 tx=0x7fb034009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:20.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.692+0000 7fb02dffb700 1 -- 172.21.15.49:0/304587642 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0380c3a50 con 0x7fb0380ca490 2023-07-21T22:14:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.900+0000 7fb03e653700 1 -- 172.21.15.49:0/304587642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb0380c3a50 con 0x7fb0380ca490 2023-07-21T22:14:20.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.900+0000 7fb02dffb700 1 -- 172.21.15.49:0/304587642 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb0380c3a50 con 0x7fb0380ca490 2023-07-21T22:14:20.947 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:14:20.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.908+0000 7fb03e653700 1 -- 172.21.15.49:0/304587642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb01c0662f0 msgr2=0x7fb01c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.908+0000 7fb03e653700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb01c0662f0 0x7fb01c0687a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb0380cea20 tx=0x7fb034009000 comp rx=0 tx=0).stop 2023-07-21T22:14:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.908+0000 7fb03e653700 1 -- 172.21.15.49:0/304587642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0380ca490 msgr2=0x7fb0380b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.908+0000 7fb03e653700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0380ca490 0x7fb0380b3980 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb02800b4a0 tx=0x7fb02800b860 comp rx=0 tx=0).stop 2023-07-21T22:14:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.908+0000 7fb03e653700 1 -- 172.21.15.49:0/304587642 shutdown_connections 2023-07-21T22:14:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.908+0000 7fb03e653700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb01c0662f0 0x7fb01c0687a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.908+0000 7fb03e653700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0380ca490 0x7fb0380b3980 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.908+0000 7fb03e653700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb038160370 0x7fb0381f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.908+0000 7fb03e653700 1 --2- 172.21.15.49:0/304587642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0380c1470 0x7fb0380c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.908+0000 7fb03e653700 1 -- 172.21.15.49:0/304587642 >> 172.21.15.49:0/304587642 conn(0x7fb038070450 msgr2=0x7fb0380aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.908+0000 7fb03e653700 1 -- 172.21.15.49:0/304587642 shutdown_connections 2023-07-21T22:14:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:20.908+0000 7fb03e653700 1 -- 172.21.15.49:0/304587642 wait complete. 2023-07-21T22:14:20.973 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:14:20.974 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:14:20.974 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-07-21T22:14:20.975 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:14:20.975 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:20.975 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:14:20.975 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:14:20.976 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:14:20.976 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:14:20.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:20.977 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-07-21T22:14:20.995 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:14:20.996 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:14:20.996 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:14:20.996 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:20.996 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-07-21T22:14:20.996 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:20.996 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:14:20.997 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:14:20.997 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-07-21T22:14:20.997 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:14:20.997 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:14:20.997 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-07-21T22:14:20.997 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:14:20.997 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:14:20.997 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-07-21T22:14:20.998 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:14:20.998 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42093sec preferred_lft 42093sec 2023-07-21T22:14:20.998 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-07-21T22:14:20.998 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:20.998 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:14:20.998 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:14:20.998 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-07-21T22:14:20.999 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:14:20.999 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:19:e1:20:16 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:14:20.999 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:14:20.999 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:20.999 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:14:20.999 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether aa:11:6f:e1:a1:5e brd ff:ff:ff:ff:ff:ff 2023-07-21T22:14:20.999 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:14:20.999 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:21.000 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec43:77ff:fe1f:6f26/64 scope link 2023-07-21T22:14:21.000 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:21.000 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:14:21.000 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether aa:11:6f:e1:a1:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:14:21.000 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a811:6fff:fee1:a15e/64 scope link 2023-07-21T22:14:21.000 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:21.000 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:14:21.001 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether da:09:9c:11:2a:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:14:21.001 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::d809:9cff:fe11:2aa0/64 scope link 2023-07-21T22:14:21.001 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:14:21.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:21.002 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:14:21.081 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-07-21T22:14:21.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:21.085 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-07-21T22:14:21.149 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-07-21T22:14:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:14:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:14:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:14:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:14:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:14:21.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:21.151 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-07-21T22:14:21.151 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-07-21T22:14:21.151 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:14:21.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:14:21.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:14:21.152 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-07-21T22:14:21.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:21.293 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-07-21T22:14:21.309 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:14:21.310 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:14:21.311 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:14:21.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:21.311 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-07-21T22:14:21.395 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-21T22:14:21.396 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:14:21.396 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:21.461 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:14:21.461 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:14:21.461 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:21.525 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:14:21.608 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:14:21.609 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:14:21.689 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:14:21.691 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:14:21.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:21.693 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:14:21.756 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-21T22:14:21.757 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-21T22:14:21.806 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-07-21T22:14:21.843 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:14:21.843 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:14:21.921 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:14:21.923 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:14:21.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:21.924 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-07-21T22:14:21.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2023-07-21T22:14:21.912+0000 7fecad895640 -1 init, newargv = 0x55fb21690c30 newargc=15 2023-07-21T22:14:21.957 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[49300]: starting ceph client 2023-07-21T22:14:21.970 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[49300]: starting fuse 2023-07-21T22:14:21.972 INFO:teuthology.orchestra.run.smithi049.stdout:49 2023-07-21T22:14:21.972 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-07-21T22:14:21.972 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T22:14:21.973 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2023-07-21T22:14:21.973 DEBUG:teuthology.orchestra.run.smithi049:> import re 2023-07-21T22:14:21.974 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-07-21T22:14:21.974 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-07-21T22:14:21.975 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:14:21.975 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2023-07-21T22:14:21.975 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-21T22:14:21.975 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2023-07-21T22:14:21.976 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-21T22:14:21.976 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:14:21.976 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2023-07-21T22:14:21.977 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2023-07-21T22:14:21.977 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2023-07-21T22:14:21.977 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2023-07-21T22:14:21.978 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:14:21.978 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2023-07-21T22:14:21.978 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T22:14:21.979 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T22:14:21.979 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T22:14:21.979 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2023-07-21T22:14:21.979 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2023-07-21T22:14:21.980 DEBUG:teuthology.orchestra.run.smithi049:> return f 2023-07-21T22:14:21.980 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T22:14:21.980 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:14:21.981 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2023-07-21T22:14:21.981 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-07-21T22:14:22.132 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.49300.asok 2023-07-21T22:14:22.318 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49300.asok 2023-07-21T22:14:22.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:22.319 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49300.asok status 2023-07-21T22:14:22.520 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:14:22.520 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2023-07-21T22:14:22.520 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea", 2023-07-21T22:14:22.520 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:14:22.521 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2023-07-21T22:14:22.521 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2023-07-21T22:14:22.521 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-21T22:14:22.521 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "49300", 2023-07-21T22:14:22.521 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2023-07-21T22:14:22.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:14:22.521 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2023-07-21T22:14:22.522 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2023-07-21T22:14:22.522 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6801, 2023-07-21T22:14:22.522 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2023-07-21T22:14:22.522 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2023-07-21T22:14:22.522 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2023-07-21T22:14:22.522 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 6801 2023-07-21T22:14:22.522 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:14:22.523 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:14:22.523 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:14:22.523 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:14:22.523 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 3383961523 2023-07-21T22:14:22.523 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-07-21T22:14:22.523 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:14:22.523 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-07-21T22:14:22.524 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-07-21T22:14:22.524 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-07-21T22:14:22.524 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 3383961523 2023-07-21T22:14:22.524 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-07-21T22:14:22.524 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.6801 192.168.0.1:0/3383961523", 2023-07-21T22:14:22.524 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/3383961523", 2023-07-21T22:14:22.525 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2023-07-21T22:14:22.525 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 26, 2023-07-21T22:14:22.525 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 64, 2023-07-21T22:14:22.525 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2023-07-21T22:14:22.525 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2023-07-21T22:14:22.525 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2023-07-21T22:14:22.525 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:14:22.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:22.540 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2023-07-21T22:14:22.540 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:22.559 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2023-07-21T22:14:22.559 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:22.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:22.560 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:22.638 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T22:14:22.638 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-07-21T22:14:22.639 DEBUG:teuthology.orchestra.run.smithi049:> import errno 2023-07-21T22:14:22.639 DEBUG:teuthology.orchestra.run.smithi049:> 2023-07-21T22:14:22.640 DEBUG:teuthology.orchestra.run.smithi049:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-07-21T22:14:22.640 DEBUG:teuthology.orchestra.run.smithi049:> try: 2023-07-21T22:14:22.640 DEBUG:teuthology.orchestra.run.smithi049:> if True: 2023-07-21T22:14:22.640 DEBUG:teuthology.orchestra.run.smithi049:> ret = os.read(fd, 1024) 2023-07-21T22:14:22.641 DEBUG:teuthology.orchestra.run.smithi049:> else: 2023-07-21T22:14:22.641 DEBUG:teuthology.orchestra.run.smithi049:> os.write(fd, b'"'"'content'"'"') 2023-07-21T22:14:22.641 DEBUG:teuthology.orchestra.run.smithi049:> except OSError as e: 2023-07-21T22:14:22.642 DEBUG:teuthology.orchestra.run.smithi049:> if e.errno != errno.EPERM: 2023-07-21T22:14:22.642 DEBUG:teuthology.orchestra.run.smithi049:> raise 2023-07-21T22:14:22.642 DEBUG:teuthology.orchestra.run.smithi049:> else: 2023-07-21T22:14:22.642 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("client does not check permission of data pool") 2023-07-21T22:14:22.643 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-07-21T22:14:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:Traceback (most recent call last): 2023-07-21T22:14:22.782 INFO:teuthology.orchestra.run.smithi049.stderr: File "", line 15, in 2023-07-21T22:14:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:RuntimeError: client does not check permission of data pool 2023-07-21T22:14:22.951 INFO:teuthology.orchestra.run.smithi049.stderr:daemon-helper: command failed with exit status 1 2023-07-21T22:14:22.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:14:22.964 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2023-07-21T22:14:23.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.156+0000 7f612b59e700 1 Processor -- start 2023-07-21T22:14:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.156+0000 7f612b59e700 1 -- start start 2023-07-21T22:14:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f612c0cf100 0x7f612c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612b59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c0b5460 con 0x7f612c15bed0 2023-07-21T22:14:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c0d1030 con 0x7f612c0d07b0 2023-07-21T22:14:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612c0d1310 con 0x7f612c0cf100 2023-07-21T22:14:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612a59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f612c15bed0 0x7f612c0ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35468/0 (socket says 172.21.15.49:35468) 2023-07-21T22:14:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612a59c700 1 -- 172.21.15.49:0/2071049807 learned_addr learned my addr 172.21.15.49:0/2071049807 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:23.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f6129d9b700 1 --2- 172.21.15.49:0/2071049807 >> v2:172.21.15.150:3300/0 conn(0x7f612c0cf100 0x7f612c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:23.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 -- 172.21.15.49:0/2071049807 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960791749 0 0) 0x7f612c0b5460 con 0x7f612c15bed0 2023-07-21T22:14:23.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 -- 172.21.15.49:0/2071049807 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61140035d0 con 0x7f612c15bed0 2023-07-21T22:14:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 -- 172.21.15.49:0/2071049807 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2172144719 0 0) 0x7f61140035d0 con 0x7f612c15bed0 2023-07-21T22:14:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 -- 172.21.15.49:0/2071049807 >> v2:172.21.15.150:3300/0 conn(0x7f612c0cf100 msgr2=0x7f612c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 --2- 172.21.15.49:0/2071049807 >> v2:172.21.15.150:3300/0 conn(0x7f612c0cf100 0x7f612c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 -- 172.21.15.49:0/2071049807 >> v1:172.21.15.150:6789/0 conn(0x7f612c0d07b0 legacy=0x7f612c0b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 -- 172.21.15.49:0/2071049807 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c0d15f0 con 0x7f612c15bed0 2023-07-21T22:14:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 -- 172.21.15.49:0/2071049807 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f611c001670 con 0x7f612c15bed0 2023-07-21T22:14:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 -- 172.21.15.49:0/2071049807 >> v1:172.21.15.49:6789/0 conn(0x7f612c15bed0 legacy=0x7f612c0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 --2- 172.21.15.49:0/2071049807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6114003a20 0x7f6114003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 --2- 172.21.15.49:0/2071049807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6114004410 0x7f61140048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 --2- 172.21.15.49:0/2071049807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61140050d0 0x7f611400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 -- 172.21.15.49:0/2071049807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c0d1310 con 0x7f61140050d0 2023-07-21T22:14:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 -- 172.21.15.49:0/2071049807 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611400c020 con 0x7f6114003a20 2023-07-21T22:14:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.160+0000 7f612959a700 1 -- 172.21.15.49:0/2071049807 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611400c1e0 con 0x7f6114004410 2023-07-21T22:14:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612ad9d700 1 --2- 172.21.15.49:0/2071049807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61140050d0 0x7f611400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612a59c700 1 --2- 172.21.15.49:0/2071049807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6114003a20 0x7f6114003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f6129d9b700 1 --2- 172.21.15.49:0/2071049807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6114004410 0x7f61140048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612ad9d700 1 -- 172.21.15.49:0/2071049807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6114004410 msgr2=0x7f61140048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612ad9d700 1 --2- 172.21.15.49:0/2071049807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6114004410 0x7f61140048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612ad9d700 1 -- 172.21.15.49:0/2071049807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6114003a20 msgr2=0x7f6114003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612ad9d700 1 --2- 172.21.15.49:0/2071049807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6114003a20 0x7f6114003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612ad9d700 1 -- 172.21.15.49:0/2071049807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61140035d0 con 0x7f61140050d0 2023-07-21T22:14:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612ad9d700 1 -- 172.21.15.49:0/2071049807 reap_dead start 2023-07-21T22:14:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612ad9d700 1 --2- 172.21.15.49:0/2071049807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61140050d0 0x7f611400ba30 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f612400c290 tx=0x7f61140058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5e0afde6d08ed1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612959a700 1 -- 172.21.15.49:0/2071049807 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124001e70 con 0x7f61140050d0 2023-07-21T22:14:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612959a700 1 -- 172.21.15.49:0/2071049807 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612400ce70 con 0x7f61140050d0 2023-07-21T22:14:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612959a700 1 -- 172.21.15.49:0/2071049807 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124003c40 con 0x7f61140050d0 2023-07-21T22:14:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612b59e700 1 -- 172.21.15.49:0/2071049807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61140050d0 msgr2=0x7f611400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612b59e700 1 --2- 172.21.15.49:0/2071049807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61140050d0 0x7f611400ba30 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f612400c290 tx=0x7f61140058a0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612b59e700 1 -- 172.21.15.49:0/2071049807 shutdown_connections 2023-07-21T22:14:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612b59e700 1 --2- 172.21.15.49:0/2071049807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61140050d0 0x7f611400ba30 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612b59e700 1 -- 172.21.15.49:0/2071049807 >> 172.21.15.49:0/2071049807 conn(0x7f612c065af0 msgr2=0x7f612c06fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612b59e700 1 -- 172.21.15.49:0/2071049807 shutdown_connections 2023-07-21T22:14:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.164+0000 7f612b59e700 1 -- 172.21.15.49:0/2071049807 wait complete. 2023-07-21T22:14:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.168+0000 7f612b59e700 1 Processor -- start 2023-07-21T22:14:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.168+0000 7f612b59e700 1 -- start start 2023-07-21T22:14:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61140050d0 0x7f612c0b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f612c1553d0 0x7f612c0b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f612c0b2fa0 0x7f612c1f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612b59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c0b3410 con 0x7f612c0b2fa0 2023-07-21T22:14:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c0ca640 con 0x7f61140050d0 2023-07-21T22:14:23.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c155be0 con 0x7f612c1553d0 2023-07-21T22:14:23.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f612c0b2fa0 0x7f612c1f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:23.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f612c0b2fa0 0x7f612c1f4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47890/0 (socket says 172.21.15.49:47890) 2023-07-21T22:14:23.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612ad9d700 1 -- 172.21.15.49:0/357694430 learned_addr learned my addr 172.21.15.49:0/357694430 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:23.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612a59c700 1 --2- 172.21.15.49:0/357694430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61140050d0 0x7f612c0b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:23.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f6129d9b700 1 --2- 172.21.15.49:0/357694430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f612c1553d0 0x7f612c0b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612ad9d700 1 -- 172.21.15.49:0/357694430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f612c1553d0 msgr2=0x7f612c0b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612ad9d700 1 --2- 172.21.15.49:0/357694430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f612c1553d0 0x7f612c0b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612ad9d700 1 -- 172.21.15.49:0/357694430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61140050d0 msgr2=0x7f612c0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612ad9d700 1 --2- 172.21.15.49:0/357694430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61140050d0 0x7f612c0b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612ad9d700 1 -- 172.21.15.49:0/357694430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c0c9ac0 con 0x7f612c0b2fa0 2023-07-21T22:14:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612ad9d700 1 --2- 172.21.15.49:0/357694430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f612c0b2fa0 0x7f612c1f4720 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f612c0ccbf0 tx=0x7f61240015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f611affd700 1 -- 172.21.15.49:0/357694430 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124017070 con 0x7f612c0b2fa0 2023-07-21T22:14:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f611affd700 1 -- 172.21.15.49:0/357694430 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6124001250 con 0x7f612c0b2fa0 2023-07-21T22:14:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f611affd700 1 -- 172.21.15.49:0/357694430 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124004ea0 con 0x7f612c0b2fa0 2023-07-21T22:14:23.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612b59e700 1 -- 172.21.15.49:0/357694430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c0c9da0 con 0x7f612c0b2fa0 2023-07-21T22:14:23.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.172+0000 7f612b59e700 1 -- 172.21.15.49:0/357694430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c0ca360 con 0x7f612c0b2fa0 2023-07-21T22:14:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.176+0000 7f612b59e700 1 -- 172.21.15.49:0/357694430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c04dcb0 con 0x7f612c0b2fa0 2023-07-21T22:14:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.176+0000 7f611affd700 1 -- 172.21.15.49:0/357694430 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f61240054e0 con 0x7f612c0b2fa0 2023-07-21T22:14:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.180+0000 7f611affd700 1 --2- 172.21.15.49:0/357694430 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f610c066320 0x7f610c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.180+0000 7f611affd700 1 -- 172.21.15.49:0/357694430 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f612401a040 con 0x7f612c0b2fa0 2023-07-21T22:14:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.180+0000 7f612a59c700 1 --2- 172.21.15.49:0/357694430 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f610c066320 0x7f610c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.180+0000 7f612a59c700 1 --2- 172.21.15.49:0/357694430 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f610c066320 0x7f610c0687d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f611c001050 tx=0x7f611c001c30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:23.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.184+0000 7f611affd700 1 -- 172.21.15.49:0/357694430 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6124051ac0 con 0x7f612c0b2fa0 2023-07-21T22:14:23.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.416+0000 7f612b59e700 1 -- 172.21.15.49:0/357694430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f612c0b5660 con 0x7f612c0b2fa0 2023-07-21T22:14:23.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.424+0000 7f611affd700 1 -- 172.21.15.49:0/357694430 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 184+0+141 (secure 0 0 0) 0x7f61240550e0 con 0x7f612c0b2fa0 2023-07-21T22:14:23.470 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2023-07-21T22:14:23.470 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdArtkU5ZaIRAAchCJhuM71+rGOBHBlX77wA== 2023-07-21T22:14:23.471 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow" 2023-07-21T22:14:23.471 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2023-07-21T22:14:23.471 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw pool=cephfs_data" 2023-07-21T22:14:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.428+0000 7f612b59e700 1 -- 172.21.15.49:0/357694430 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f610c066320 msgr2=0x7f610c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.428+0000 7f612b59e700 1 --2- 172.21.15.49:0/357694430 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f610c066320 0x7f610c0687d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f611c001050 tx=0x7f611c001c30 comp rx=0 tx=0).stop 2023-07-21T22:14:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.428+0000 7f612b59e700 1 -- 172.21.15.49:0/357694430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f612c0b2fa0 msgr2=0x7f612c1f4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.428+0000 7f612b59e700 1 --2- 172.21.15.49:0/357694430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f612c0b2fa0 0x7f612c1f4720 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f612c0ccbf0 tx=0x7f61240015b0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.428+0000 7f612b59e700 1 -- 172.21.15.49:0/357694430 shutdown_connections 2023-07-21T22:14:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.428+0000 7f612b59e700 1 --2- 172.21.15.49:0/357694430 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f610c066320 0x7f610c0687d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.428+0000 7f612b59e700 1 --2- 172.21.15.49:0/357694430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f612c0b2fa0 0x7f612c1f4720 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.428+0000 7f612b59e700 1 --2- 172.21.15.49:0/357694430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f612c1553d0 0x7f612c0b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.428+0000 7f612b59e700 1 --2- 172.21.15.49:0/357694430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61140050d0 0x7f612c0b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.428+0000 7f612b59e700 1 -- 172.21.15.49:0/357694430 >> 172.21.15.49:0/357694430 conn(0x7f612c065af0 msgr2=0x7f612c0b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.428+0000 7f612b59e700 1 -- 172.21.15.49:0/357694430 shutdown_connections 2023-07-21T22:14:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.428+0000 7f612b59e700 1 -- 172.21.15.49:0/357694430 wait complete. 2023-07-21T22:14:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-07-21T22:14:23.499 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:14:23.501 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:14:23.544 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:14:23.589 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:14:23.589 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:14:23.589 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:14:23.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:14:23.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.788+0000 7fedb3476700 1 Processor -- start 2023-07-21T22:14:23.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.788+0000 7fedb3476700 1 -- start start 2023-07-21T22:14:23.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.788+0000 7fedb3476700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fedac1604c0 0x7fedac0afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:23.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.788+0000 7fedb3476700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac0b0530 con 0x7fedac0afc20 2023-07-21T22:14:23.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.788+0000 7fedb3476700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac163df0 con 0x7fedac0c8860 2023-07-21T22:14:23.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.788+0000 7fedb3476700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedac1640d0 con 0x7fedac1604c0 2023-07-21T22:14:23.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.788+0000 7fedb0a11700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fedac1604c0 0x7fedac0afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:23.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.788+0000 7fedb0a11700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fedac1604c0 0x7fedac0afff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47906/0 (socket says 172.21.15.49:47906) 2023-07-21T22:14:23.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.788+0000 7fedb0a11700 1 -- 172.21.15.49:0/2515490014 learned_addr learned my addr 172.21.15.49:0/2515490014 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:23.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.792+0000 7fedb0a11700 1 -- 172.21.15.49:0/2515490014 >> v1:172.21.15.150:6789/0 conn(0x7fedac0c8860 legacy=0x7fedac070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:23.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.792+0000 7fedb0a11700 1 -- 172.21.15.49:0/2515490014 >> v1:172.21.15.49:6789/0 conn(0x7fedac0afc20 legacy=0x7fedac0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:23.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.792+0000 7fedb0a11700 1 -- 172.21.15.49:0/2515490014 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac1643b0 con 0x7fedac1604c0 2023-07-21T22:14:23.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.792+0000 7fedb0a11700 1 --2- 172.21.15.49:0/2515490014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedac1604c0 0x7fedac0afff0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009910 tx=0x7fed9c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308df1b5abb87411 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:23.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.792+0000 7feda3fff700 1 -- 172.21.15.49:0/2515490014 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c004230 con 0x7fedac1604c0 2023-07-21T22:14:23.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.792+0000 7feda3fff700 1 -- 172.21.15.49:0/2515490014 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c004390 con 0x7fedac1604c0 2023-07-21T22:14:23.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.792+0000 7feda3fff700 1 -- 172.21.15.49:0/2515490014 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c009e60 con 0x7fedac1604c0 2023-07-21T22:14:23.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.792+0000 7fedb3476700 1 -- 172.21.15.49:0/2515490014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedac1604c0 msgr2=0x7fedac0afff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:23.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.792+0000 7fedb3476700 1 --2- 172.21.15.49:0/2515490014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedac1604c0 0x7fedac0afff0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009910 tx=0x7fed9c009c20 comp rx=0 tx=0).stop 2023-07-21T22:14:23.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.792+0000 7fedb3476700 1 -- 172.21.15.49:0/2515490014 shutdown_connections 2023-07-21T22:14:23.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.792+0000 7fedb3476700 1 --2- 172.21.15.49:0/2515490014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedac1604c0 0x7fedac0afff0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.792+0000 7fedb3476700 1 -- 172.21.15.49:0/2515490014 >> 172.21.15.49:0/2515490014 conn(0x7fedac06f5a0 msgr2=0x7fedac0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:23.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.792+0000 7fedb3476700 1 -- 172.21.15.49:0/2515490014 shutdown_connections 2023-07-21T22:14:23.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.792+0000 7fedb3476700 1 -- 172.21.15.49:0/2515490014 wait complete. 2023-07-21T22:14:23.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb3476700 1 Processor -- start 2023-07-21T22:14:23.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb3476700 1 -- start start 2023-07-21T22:14:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb3476700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedac0afc20 0x7fedac0c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb3476700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedac0c8860 0x7fedac06d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb3476700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedac1604c0 0x7fedac1524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb3476700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0c4b40 con 0x7fedac0afc20 2023-07-21T22:14:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb3476700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0b2760 con 0x7fedac0c8860 2023-07-21T22:14:23.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb3476700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0b2a40 con 0x7fedac1604c0 2023-07-21T22:14:23.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb1212700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedac0afc20 0x7fedac0c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:23.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb1212700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedac0afc20 0x7fedac0c4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47920/0 (socket says 172.21.15.49:47920) 2023-07-21T22:14:23.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb1212700 1 -- 172.21.15.49:0/3187804956 learned_addr learned my addr 172.21.15.49:0/3187804956 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:23.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb0a11700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedac0c8860 0x7fedac06d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:23.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb1a13700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedac1604c0 0x7fedac1524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:23.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb1212700 1 -- 172.21.15.49:0/3187804956 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedac1604c0 msgr2=0x7fedac1524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:23.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb1212700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedac1604c0 0x7fedac1524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb1212700 1 -- 172.21.15.49:0/3187804956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedac0c8860 msgr2=0x7fedac06d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:23.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb1212700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedac0c8860 0x7fedac06d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb1212700 1 -- 172.21.15.49:0/3187804956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c009570 con 0x7fedac0afc20 2023-07-21T22:14:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb0a11700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedac0c8860 0x7fedac06d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb1a13700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedac1604c0 0x7fedac1524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.796+0000 7fedb1212700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedac0afc20 0x7fedac0c4600 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7feda800c500 tx=0x7feda800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.800+0000 7feda1ffb700 1 -- 172.21.15.49:0/3187804956 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda80052d0 con 0x7fedac0afc20 2023-07-21T22:14:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.800+0000 7feda1ffb700 1 -- 172.21.15.49:0/3187804956 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda8005430 con 0x7fedac0afc20 2023-07-21T22:14:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.800+0000 7feda1ffb700 1 -- 172.21.15.49:0/3187804956 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda80055a0 con 0x7fedac0afc20 2023-07-21T22:14:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.800+0000 7fedb3476700 1 -- 172.21.15.49:0/3187804956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac0b2d20 con 0x7fedac0afc20 2023-07-21T22:14:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.800+0000 7fedb3476700 1 -- 172.21.15.49:0/3187804956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac0b32e0 con 0x7fedac0afc20 2023-07-21T22:14:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.800+0000 7fedb3476700 1 -- 172.21.15.49:0/3187804956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac04dcb0 con 0x7fedac0afc20 2023-07-21T22:14:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.800+0000 7feda1ffb700 1 -- 172.21.15.49:0/3187804956 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feda80038e0 con 0x7fedac0afc20 2023-07-21T22:14:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.804+0000 7feda1ffb700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fed900662f0 0x7fed900687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.804+0000 7feda1ffb700 1 -- 172.21.15.49:0/3187804956 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7feda8083510 con 0x7fedac0afc20 2023-07-21T22:14:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.804+0000 7fedb0a11700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fed900662f0 0x7fed900687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:23.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.804+0000 7fedb0a11700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fed900662f0 0x7fed900687a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009910 tx=0x7fed9c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:23.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.808+0000 7feda1ffb700 1 -- 172.21.15.49:0/3187804956 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feda8050690 con 0x7fedac0afc20 2023-07-21T22:14:24.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.984+0000 7fedb3476700 1 -- 172.21.15.49:0/3187804956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedac0c9420 con 0x7fedac0afc20 2023-07-21T22:14:24.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.988+0000 7feda1ffb700 1 -- 172.21.15.49:0/3187804956 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+18703 (secure 0 0 0) 0x7feda8053cb0 con 0x7fedac0afc20 2023-07-21T22:14:24.035 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:24.035 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:14:17.339840+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:13:38.569931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:13:39.558524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.15","mappings":[{"from":7,"to":2}]},{"pgid":"10.25","mappings":[{"from":4,"to":3}]},{"pgid":"10.2a","mappings":[{"from":7,"to":5}]},{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:14:24.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.992+0000 7fedb3476700 1 -- 172.21.15.49:0/3187804956 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fed900662f0 msgr2=0x7fed900687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.992+0000 7fedb3476700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fed900662f0 0x7fed900687a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009910 tx=0x7fed9c008030 comp rx=0 tx=0).stop 2023-07-21T22:14:24.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.992+0000 7fedb3476700 1 -- 172.21.15.49:0/3187804956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedac0afc20 msgr2=0x7fedac0c4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.992+0000 7fedb3476700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedac0afc20 0x7fedac0c4600 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7feda800c500 tx=0x7feda800c8c0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.992+0000 7fedb3476700 1 -- 172.21.15.49:0/3187804956 shutdown_connections 2023-07-21T22:14:24.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.992+0000 7fedb3476700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fed900662f0 0x7fed900687a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.992+0000 7fedb3476700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedac1604c0 0x7fedac1524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.992+0000 7fedb3476700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedac0c8860 0x7fedac06d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.992+0000 7fedb3476700 1 --2- 172.21.15.49:0/3187804956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedac0afc20 0x7fedac0c4600 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.992+0000 7fedb3476700 1 -- 172.21.15.49:0/3187804956 >> 172.21.15.49:0/3187804956 conn(0x7fedac06f5a0 msgr2=0x7fedac0af470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:24.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.992+0000 7fedb3476700 1 -- 172.21.15.49:0/3187804956 shutdown_connections 2023-07-21T22:14:24.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:23.992+0000 7fedb3476700 1 -- 172.21.15.49:0/3187804956 wait complete. 2023-07-21T22:14:24.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:13:38.569931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:13:39.558524+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:14:24.060 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:14:24.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.200+0000 7f881cab1700 1 Processor -- start 2023-07-21T22:14:24.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.200+0000 7f881cab1700 1 -- start start 2023-07-21T22:14:24.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.204+0000 7f881cab1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f88180b7af0 0x7f88180b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:24.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.204+0000 7f881cab1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88180d1e40 0x7f881815f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:24.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.204+0000 7f881cab1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88180b3e80 con 0x7f88180cee10 2023-07-21T22:14:24.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.204+0000 7f881cab1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88180cea00 con 0x7f88180b7af0 2023-07-21T22:14:24.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.204+0000 7f881cab1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88180ccbf0 con 0x7f88180d1e40 2023-07-21T22:14:24.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.204+0000 7f88177fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f88180b7af0 0x7f88180b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:24.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.204+0000 7f88177fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f88180b7af0 0x7f88180b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47926/0 (socket says 172.21.15.49:47926) 2023-07-21T22:14:24.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.204+0000 7f88177fe700 1 -- 172.21.15.49:0/1781642326 learned_addr learned my addr 172.21.15.49:0/1781642326 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:24.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.204+0000 7f8816ffd700 1 --2- 172.21.15.49:0/1781642326 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88180d1e40 0x7f881815f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:24.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f88177fe700 1 -- 172.21.15.49:0/1781642326 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88180d1e40 msgr2=0x7f881815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:24.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f88177fe700 1 --2- 172.21.15.49:0/1781642326 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88180d1e40 0x7f881815f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f88177fe700 1 -- 172.21.15.49:0/1781642326 >> v1:172.21.15.150:6789/0 conn(0x7f88180cee10 legacy=0x7f88180b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f88177fe700 1 -- 172.21.15.49:0/1781642326 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88180cced0 con 0x7f88180b7af0 2023-07-21T22:14:24.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f88177fe700 1 --2- 172.21.15.49:0/1781642326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88180b7af0 0x7f88180b1630 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f8808009910 tx=0x7f8808009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc88dab487a31d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:24.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f88167fc700 1 -- 172.21.15.49:0/1781642326 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808011830 con 0x7f88180b7af0 2023-07-21T22:14:24.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f88167fc700 1 -- 172.21.15.49:0/1781642326 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8808011990 con 0x7f88180b7af0 2023-07-21T22:14:24.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f88167fc700 1 -- 172.21.15.49:0/1781642326 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808011d40 con 0x7f88180b7af0 2023-07-21T22:14:24.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f881cab1700 1 -- 172.21.15.49:0/1781642326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88180b7af0 msgr2=0x7f88180b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f881cab1700 1 --2- 172.21.15.49:0/1781642326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88180b7af0 0x7f88180b1630 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f8808009910 tx=0x7f8808009c20 comp rx=0 tx=0).stop 2023-07-21T22:14:24.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f881cab1700 1 -- 172.21.15.49:0/1781642326 shutdown_connections 2023-07-21T22:14:24.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f881cab1700 1 --2- 172.21.15.49:0/1781642326 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88180d1e40 0x7f881815f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f881cab1700 1 --2- 172.21.15.49:0/1781642326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88180b7af0 0x7f88180b1630 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f881cab1700 1 -- 172.21.15.49:0/1781642326 >> 172.21.15.49:0/1781642326 conn(0x7f881806e960 msgr2=0x7f881806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:24.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f881cab1700 1 -- 172.21.15.49:0/1781642326 shutdown_connections 2023-07-21T22:14:24.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.208+0000 7f881cab1700 1 -- 172.21.15.49:0/1781642326 wait complete. 2023-07-21T22:14:24.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.212+0000 7f881cab1700 1 Processor -- start 2023-07-21T22:14:24.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.212+0000 7f881cab1700 1 -- start start 2023-07-21T22:14:24.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.212+0000 7f881cab1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88180b7af0 0x7f88181497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:24.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.212+0000 7f881cab1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88180cee10 0x7f88180c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:24.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.212+0000 7f881cab1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88180d1e40 0x7f88180ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:24.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.212+0000 7f881cab1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88181580a0 con 0x7f88180cee10 2023-07-21T22:14:24.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.212+0000 7f881cab1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88180cb740 con 0x7f88180b7af0 2023-07-21T22:14:24.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.212+0000 7f881cab1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88180cab30 con 0x7f88180d1e40 2023-07-21T22:14:24.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.212+0000 7f8816ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88180cee10 0x7f88180c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:24.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.212+0000 7f8816ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88180cee10 0x7f88180c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47942/0 (socket says 172.21.15.49:47942) 2023-07-21T22:14:24.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.212+0000 7f8816ffd700 1 -- 172.21.15.49:0/515195276 learned_addr learned my addr 172.21.15.49:0/515195276 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:24.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.212+0000 7f88177fe700 1 --2- 172.21.15.49:0/515195276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88180b7af0 0x7f88181497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:24.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.212+0000 7f8817fff700 1 --2- 172.21.15.49:0/515195276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88180d1e40 0x7f88180ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.216+0000 7f8816ffd700 1 -- 172.21.15.49:0/515195276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88180d1e40 msgr2=0x7f88180ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.216+0000 7f8816ffd700 1 --2- 172.21.15.49:0/515195276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88180d1e40 0x7f88180ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.216+0000 7f8816ffd700 1 -- 172.21.15.49:0/515195276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88180b7af0 msgr2=0x7f88181497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.216+0000 7f8816ffd700 1 --2- 172.21.15.49:0/515195276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88180b7af0 0x7f88181497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.216+0000 7f8816ffd700 1 -- 172.21.15.49:0/515195276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8808009570 con 0x7f88180cee10 2023-07-21T22:14:24.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.216+0000 7f8816ffd700 1 --2- 172.21.15.49:0/515195276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88180cee10 0x7f88180c9ee0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f880c00e840 tx=0x7f880c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:24.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.216+0000 7f87fffff700 1 -- 172.21.15.49:0/515195276 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0095a0 con 0x7f88180cee10 2023-07-21T22:14:24.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.216+0000 7f87fffff700 1 -- 172.21.15.49:0/515195276 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c013680 con 0x7f88180cee10 2023-07-21T22:14:24.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.216+0000 7f87fffff700 1 -- 172.21.15.49:0/515195276 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0139f0 con 0x7f88180cee10 2023-07-21T22:14:24.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.216+0000 7f881cab1700 1 -- 172.21.15.49:0/515195276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88180cae10 con 0x7f88180cee10 2023-07-21T22:14:24.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.216+0000 7f881cab1700 1 -- 172.21.15.49:0/515195276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88180cb3d0 con 0x7f88180cee10 2023-07-21T22:14:24.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.216+0000 7f881cab1700 1 -- 172.21.15.49:0/515195276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88180cb8b0 con 0x7f88180cee10 2023-07-21T22:14:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.220+0000 7f87fffff700 1 -- 172.21.15.49:0/515195276 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f880c013b50 con 0x7f88180cee10 2023-07-21T22:14:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.220+0000 7f87fffff700 1 --2- 172.21.15.49:0/515195276 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f88040662f0 0x7f88040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.220+0000 7f87fffff700 1 -- 172.21.15.49:0/515195276 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f880c083e80 con 0x7f88180cee10 2023-07-21T22:14:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.220+0000 7f88177fe700 1 --2- 172.21.15.49:0/515195276 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f88040662f0 0x7f88040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.224+0000 7f88177fe700 1 --2- 172.21.15.49:0/515195276 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f88040662f0 0x7f88040687a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8808000c00 tx=0x7f8808008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:24.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.228+0000 7f87fffff700 1 -- 172.21.15.49:0/515195276 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f880c054b20 con 0x7f88180cee10 2023-07-21T22:14:24.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.404+0000 7f881cab1700 1 -- 172.21.15.49:0/515195276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f881804dcb0 con 0x7f88180cee10 2023-07-21T22:14:24.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.408+0000 7f87fffff700 1 -- 172.21.15.49:0/515195276 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f880c017020 con 0x7f88180cee10 2023-07-21T22:14:24.452 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:14:24.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.408+0000 7f881cab1700 1 -- 172.21.15.49:0/515195276 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f88040662f0 msgr2=0x7f88040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.408+0000 7f881cab1700 1 --2- 172.21.15.49:0/515195276 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f88040662f0 0x7f88040687a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8808000c00 tx=0x7f8808008030 comp rx=0 tx=0).stop 2023-07-21T22:14:24.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.408+0000 7f881cab1700 1 -- 172.21.15.49:0/515195276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88180cee10 msgr2=0x7f88180c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.408+0000 7f881cab1700 1 --2- 172.21.15.49:0/515195276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88180cee10 0x7f88180c9ee0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f880c00e840 tx=0x7f880c00eb50 comp rx=0 tx=0).stop 2023-07-21T22:14:24.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.408+0000 7f881cab1700 1 -- 172.21.15.49:0/515195276 shutdown_connections 2023-07-21T22:14:24.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.408+0000 7f881cab1700 1 --2- 172.21.15.49:0/515195276 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f88040662f0 0x7f88040687a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.408+0000 7f881cab1700 1 --2- 172.21.15.49:0/515195276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88180cee10 0x7f88180c9ee0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.408+0000 7f881cab1700 1 --2- 172.21.15.49:0/515195276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88180d1e40 0x7f88180ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.408+0000 7f881cab1700 1 --2- 172.21.15.49:0/515195276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88180b7af0 0x7f88181497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.408+0000 7f881cab1700 1 -- 172.21.15.49:0/515195276 >> 172.21.15.49:0/515195276 conn(0x7f881806e960 msgr2=0x7f88180b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:24.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.408+0000 7f881cab1700 1 -- 172.21.15.49:0/515195276 shutdown_connections 2023-07-21T22:14:24.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.408+0000 7f881cab1700 1 -- 172.21.15.49:0/515195276 wait complete. 2023-07-21T22:14:24.479 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:14:24.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.620+0000 7f167e078700 1 Processor -- start 2023-07-21T22:14:24.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.620+0000 7f167e078700 1 -- start start 2023-07-21T22:14:24.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f167e078700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f167806e960 0x7f16780c3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:24.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f167e078700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f16780c3ec0 0x7f167815cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:24.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f167e078700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1678160cd0 con 0x7f1678156a80 2023-07-21T22:14:24.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f167e078700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16780c4340 con 0x7f16780c3ec0 2023-07-21T22:14:24.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f167e078700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167806edd0 con 0x7f167806e960 2023-07-21T22:14:24.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f1677fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f16780c3ec0 0x7f167815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:24.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f1677fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f16780c3ec0 0x7f167815cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54988/0 (socket says 172.21.15.49:54988) 2023-07-21T22:14:24.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f1677fff700 1 -- 172.21.15.49:0/4276893463 learned_addr learned my addr 172.21.15.49:0/4276893463 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:24.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f16777fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1678156a80 0x7f16780add80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40212/0 (socket says 172.21.15.49:40212) 2023-07-21T22:14:24.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f1676ffd700 1 --2- 172.21.15.49:0/4276893463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f167806e960 0x7f16780c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:24.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f1677fff700 1 -- 172.21.15.49:0/4276893463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f167806e960 msgr2=0x7f16780c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:24.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f1677fff700 1 --2- 172.21.15.49:0/4276893463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f167806e960 0x7f16780c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f1677fff700 1 -- 172.21.15.49:0/4276893463 >> v1:172.21.15.49:6789/0 conn(0x7f1678156a80 legacy=0x7f16780add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f16767fc700 1 -- 172.21.15.49:0/4276893463 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3733246959 0 0) 0x7f1678160cd0 con 0x7f1678156a80 2023-07-21T22:14:24.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f1677fff700 1 -- 172.21.15.49:0/4276893463 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16780ae490 con 0x7f16780c3ec0 2023-07-21T22:14:24.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f1677fff700 1 --2- 172.21.15.49:0/4276893463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16780c3ec0 0x7f167815cb70 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1670009e50 tx=0x7f167000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1353aefd68bca341 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:24.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f16767fc700 1 -- 172.21.15.49:0/4276893463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167000e070 con 0x7f16780c3ec0 2023-07-21T22:14:24.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f16767fc700 1 -- 172.21.15.49:0/4276893463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167000b910 con 0x7f16780c3ec0 2023-07-21T22:14:24.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.624+0000 7f16767fc700 1 -- 172.21.15.49:0/4276893463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167000bcc0 con 0x7f16780c3ec0 2023-07-21T22:14:24.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.628+0000 7f167e078700 1 -- 172.21.15.49:0/4276893463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16780c3ec0 msgr2=0x7f167815cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.628+0000 7f167e078700 1 --2- 172.21.15.49:0/4276893463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16780c3ec0 0x7f167815cb70 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1670009e50 tx=0x7f167000b330 comp rx=0 tx=0).stop 2023-07-21T22:14:24.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.628+0000 7f167e078700 1 -- 172.21.15.49:0/4276893463 shutdown_connections 2023-07-21T22:14:24.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.628+0000 7f167e078700 1 --2- 172.21.15.49:0/4276893463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16780c3ec0 0x7f167815cb70 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.628+0000 7f167e078700 1 --2- 172.21.15.49:0/4276893463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f167806e960 0x7f16780c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.628+0000 7f167e078700 1 -- 172.21.15.49:0/4276893463 >> 172.21.15.49:0/4276893463 conn(0x7f1678071050 msgr2=0x7f1678071420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:24.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.628+0000 7f167e078700 1 -- 172.21.15.49:0/4276893463 shutdown_connections 2023-07-21T22:14:24.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.628+0000 7f167e078700 1 -- 172.21.15.49:0/4276893463 wait complete. 2023-07-21T22:14:24.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f167e078700 1 Processor -- start 2023-07-21T22:14:24.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f167e078700 1 -- start start 2023-07-21T22:14:24.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f167e078700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f167806e960 0x7f16780ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:24.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f167e078700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16780c3ec0 0x7f16781f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:24.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f167e078700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1678156a80 0x7f16781f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:24.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f167e078700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16780cde60 con 0x7f167806e960 2023-07-21T22:14:24.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f167e078700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16780ce140 con 0x7f16780c3ec0 2023-07-21T22:14:24.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f167e078700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16780ce420 con 0x7f1678156a80 2023-07-21T22:14:24.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f16777fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f167806e960 0x7f16780ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:24.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f16777fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f167806e960 0x7f16780ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55004/0 (socket says 172.21.15.49:55004) 2023-07-21T22:14:24.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f16777fe700 1 -- 172.21.15.49:0/4288883520 learned_addr learned my addr 172.21.15.49:0/4288883520 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f1677fff700 1 --2- 172.21.15.49:0/4288883520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1678156a80 0x7f16781f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f1676ffd700 1 --2- 172.21.15.49:0/4288883520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16780c3ec0 0x7f16781f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f16777fe700 1 -- 172.21.15.49:0/4288883520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1678156a80 msgr2=0x7f16781f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f16777fe700 1 --2- 172.21.15.49:0/4288883520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1678156a80 0x7f16781f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f16777fe700 1 -- 172.21.15.49:0/4288883520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16780c3ec0 msgr2=0x7f16781f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f16777fe700 1 --2- 172.21.15.49:0/4288883520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16780c3ec0 0x7f16781f4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.632+0000 7f16777fe700 1 -- 172.21.15.49:0/4288883520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1670009b30 con 0x7f167806e960 2023-07-21T22:14:24.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.636+0000 7f16777fe700 1 --2- 172.21.15.49:0/4288883520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f167806e960 0x7f16780ae680 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f166800c580 tx=0x7f166800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:24.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.636+0000 7f165ffff700 1 -- 172.21.15.49:0/4288883520 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668004ca0 con 0x7f167806e960 2023-07-21T22:14:24.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.636+0000 7f165ffff700 1 -- 172.21.15.49:0/4288883520 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1668004e20 con 0x7f167806e960 2023-07-21T22:14:24.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.636+0000 7f165ffff700 1 -- 172.21.15.49:0/4288883520 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668007310 con 0x7f167806e960 2023-07-21T22:14:24.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.636+0000 7f167e078700 1 -- 172.21.15.49:0/4288883520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16780ce700 con 0x7f167806e960 2023-07-21T22:14:24.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.636+0000 7f167e078700 1 -- 172.21.15.49:0/4288883520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16781f5a70 con 0x7f167806e960 2023-07-21T22:14:24.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.636+0000 7f167e078700 1 -- 172.21.15.49:0/4288883520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16780cec20 con 0x7f167806e960 2023-07-21T22:14:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.640+0000 7f165ffff700 1 -- 172.21.15.49:0/4288883520 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1668007470 con 0x7f167806e960 2023-07-21T22:14:24.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.640+0000 7f165ffff700 1 --2- 172.21.15.49:0/4288883520 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f16640662f0 0x7f16640687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.640+0000 7f165ffff700 1 -- 172.21.15.49:0/4288883520 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f1668083bb0 con 0x7f167806e960 2023-07-21T22:14:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.640+0000 7f1676ffd700 1 --2- 172.21.15.49:0/4288883520 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f16640662f0 0x7f16640687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.640+0000 7f1676ffd700 1 --2- 172.21.15.49:0/4288883520 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f16640662f0 0x7f16640687a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f16780ae100 tx=0x7f166c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.648+0000 7f165ffff700 1 -- 172.21.15.49:0/4288883520 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16780cec20 con 0x7f167806e960 2023-07-21T22:14:24.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.832+0000 7f167e078700 1 -- 172.21.15.49:0/4288883520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f16780cec20 con 0x7f167806e960 2023-07-21T22:14:24.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.832+0000 7f165ffff700 1 -- 172.21.15.49:0/4288883520 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7f16780cec20 con 0x7f167806e960 2023-07-21T22:14:24.877 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:14:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.836+0000 7f167e078700 1 -- 172.21.15.49:0/4288883520 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f16640662f0 msgr2=0x7f16640687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.836+0000 7f167e078700 1 --2- 172.21.15.49:0/4288883520 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f16640662f0 0x7f16640687a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f16780ae100 tx=0x7f166c009240 comp rx=0 tx=0).stop 2023-07-21T22:14:24.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.836+0000 7f167e078700 1 -- 172.21.15.49:0/4288883520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f167806e960 msgr2=0x7f16780ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.836+0000 7f167e078700 1 --2- 172.21.15.49:0/4288883520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f167806e960 0x7f16780ae680 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f166800c580 tx=0x7f166800c890 comp rx=0 tx=0).stop 2023-07-21T22:14:24.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.836+0000 7f167e078700 1 -- 172.21.15.49:0/4288883520 shutdown_connections 2023-07-21T22:14:24.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.836+0000 7f167e078700 1 --2- 172.21.15.49:0/4288883520 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f16640662f0 0x7f16640687a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.836+0000 7f167e078700 1 --2- 172.21.15.49:0/4288883520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1678156a80 0x7f16781f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.836+0000 7f167e078700 1 --2- 172.21.15.49:0/4288883520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16780c3ec0 0x7f16781f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.836+0000 7f167e078700 1 --2- 172.21.15.49:0/4288883520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f167806e960 0x7f16780ae680 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.836+0000 7f167e078700 1 -- 172.21.15.49:0/4288883520 >> 172.21.15.49:0/4288883520 conn(0x7f1678071050 msgr2=0x7f16780ab8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.836+0000 7f167e078700 1 -- 172.21.15.49:0/4288883520 shutdown_connections 2023-07-21T22:14:24.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:24.836+0000 7f167e078700 1 -- 172.21.15.49:0/4288883520 wait complete. 2023-07-21T22:14:24.901 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:14:25.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.044+0000 7f8ac30dd700 1 Processor -- start 2023-07-21T22:14:25.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.044+0000 7f8ac30dd700 1 -- start start 2023-07-21T22:14:25.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8ac30dd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8abc0cb2f0 0x7f8abc0ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8ac30dd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8abc0b3a50 0x7f8abc0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8ac30dd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc0ca190 con 0x7f8abc15e380 2023-07-21T22:14:25.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8ac30dd700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc159fd0 con 0x7f8abc0cb2f0 2023-07-21T22:14:25.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8ac30dd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc15d6e0 con 0x7f8abc0b3a50 2023-07-21T22:14:25.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8abbfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8abc0cb2f0 0x7f8abc0ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8abbfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8abc0cb2f0 0x7f8abc0ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55010/0 (socket says 172.21.15.49:55010) 2023-07-21T22:14:25.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8abbfff700 1 -- 172.21.15.49:0/371332797 learned_addr learned my addr 172.21.15.49:0/371332797 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:25.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8ac167a700 1 --2- 172.21.15.49:0/371332797 >> v2:172.21.15.150:3300/0 conn(0x7f8abc0b3a50 0x7f8abc0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8abbfff700 1 -- 172.21.15.49:0/371332797 >> v2:172.21.15.150:3300/0 conn(0x7f8abc0b3a50 msgr2=0x7f8abc0ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:25.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8abbfff700 1 --2- 172.21.15.49:0/371332797 >> v2:172.21.15.150:3300/0 conn(0x7f8abc0b3a50 0x7f8abc0ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8abbfff700 1 -- 172.21.15.49:0/371332797 >> v1:172.21.15.150:6789/0 conn(0x7f8abc15e380 legacy=0x7f8abc0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8abbfff700 1 -- 172.21.15.49:0/371332797 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc0ca900 con 0x7f8abc0cb2f0 2023-07-21T22:14:25.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8ac167a700 1 --2- 172.21.15.49:0/371332797 >> v2:172.21.15.150:3300/0 conn(0x7f8abc0b3a50 0x7f8abc0ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:25.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8abbfff700 1 --2- 172.21.15.49:0/371332797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8abc0cb2f0 0x7f8abc0ce160 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0ce020 tx=0x7f8aa8009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f7cadc1e72f184 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:25.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8abb7fe700 1 -- 172.21.15.49:0/371332797 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800b8a0 con 0x7f8abc0cb2f0 2023-07-21T22:14:25.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8abb7fe700 1 -- 172.21.15.49:0/371332797 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa800ba00 con 0x7f8abc0cb2f0 2023-07-21T22:14:25.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.048+0000 7f8abb7fe700 1 -- 172.21.15.49:0/371332797 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800bd90 con 0x7f8abc0cb2f0 2023-07-21T22:14:25.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.052+0000 7f8ac30dd700 1 -- 172.21.15.49:0/371332797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8abc0cb2f0 msgr2=0x7f8abc0ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.052+0000 7f8ac30dd700 1 --2- 172.21.15.49:0/371332797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8abc0cb2f0 0x7f8abc0ce160 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0ce020 tx=0x7f8aa8009be0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.052+0000 7f8ac30dd700 1 -- 172.21.15.49:0/371332797 shutdown_connections 2023-07-21T22:14:25.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.052+0000 7f8ac30dd700 1 --2- 172.21.15.49:0/371332797 >> v2:172.21.15.150:3300/0 conn(0x7f8abc0b3a50 0x7f8abc0ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.052+0000 7f8ac30dd700 1 --2- 172.21.15.49:0/371332797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8abc0cb2f0 0x7f8abc0ce160 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.052+0000 7f8ac30dd700 1 -- 172.21.15.49:0/371332797 >> 172.21.15.49:0/371332797 conn(0x7f8abc06e960 msgr2=0x7f8abc06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:25.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.052+0000 7f8ac30dd700 1 -- 172.21.15.49:0/371332797 shutdown_connections 2023-07-21T22:14:25.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.052+0000 7f8ac30dd700 1 -- 172.21.15.49:0/371332797 wait complete. 2023-07-21T22:14:25.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac30dd700 1 Processor -- start 2023-07-21T22:14:25.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac30dd700 1 -- start start 2023-07-21T22:14:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac30dd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8abc0b3a50 0x7f8abc1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac30dd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8abc0cb2f0 0x7f8abc156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac30dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8abc15e380 0x7f8abc1574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac30dd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc15a110 con 0x7f8abc0b3a50 2023-07-21T22:14:25.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac30dd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc155c20 con 0x7f8abc0cb2f0 2023-07-21T22:14:25.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac30dd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0c8b40 con 0x7f8abc15e380 2023-07-21T22:14:25.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac0e79700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8abc0b3a50 0x7f8abc1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac0e79700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8abc0b3a50 0x7f8abc1556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55016/0 (socket says 172.21.15.49:55016) 2023-07-21T22:14:25.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac0e79700 1 -- 172.21.15.49:0/4207956672 learned_addr learned my addr 172.21.15.49:0/4207956672 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:25.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8abbfff700 1 --2- 172.21.15.49:0/4207956672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8abc0cb2f0 0x7f8abc156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac167a700 1 --2- 172.21.15.49:0/4207956672 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8abc15e380 0x7f8abc1574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac0e79700 1 -- 172.21.15.49:0/4207956672 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8abc15e380 msgr2=0x7f8abc1574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac0e79700 1 --2- 172.21.15.49:0/4207956672 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8abc15e380 0x7f8abc1574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac0e79700 1 -- 172.21.15.49:0/4207956672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8abc0cb2f0 msgr2=0x7f8abc156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac0e79700 1 --2- 172.21.15.49:0/4207956672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8abc0cb2f0 0x7f8abc156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.056+0000 7f8ac0e79700 1 -- 172.21.15.49:0/4207956672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa8009510 con 0x7f8abc0b3a50 2023-07-21T22:14:25.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.060+0000 7f8ac0e79700 1 --2- 172.21.15.49:0/4207956672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8abc0b3a50 0x7f8abc1556e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000c500 tx=0x7f8ab000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:25.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.060+0000 7f8ab97fa700 1 -- 172.21.15.49:0/4207956672 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00052d0 con 0x7f8abc0b3a50 2023-07-21T22:14:25.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.060+0000 7f8ab97fa700 1 -- 172.21.15.49:0/4207956672 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab0005430 con 0x7f8abc0b3a50 2023-07-21T22:14:25.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.060+0000 7f8ab97fa700 1 -- 172.21.15.49:0/4207956672 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00055a0 con 0x7f8abc0b3a50 2023-07-21T22:14:25.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.060+0000 7f8ac30dd700 1 -- 172.21.15.49:0/4207956672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc15a360 con 0x7f8abc0b3a50 2023-07-21T22:14:25.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.060+0000 7f8ac30dd700 1 -- 172.21.15.49:0/4207956672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc15a920 con 0x7f8abc0b3a50 2023-07-21T22:14:25.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.060+0000 7f8ac30dd700 1 -- 172.21.15.49:0/4207956672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc04dd50 con 0x7f8abc0b3a50 2023-07-21T22:14:25.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.064+0000 7f8ab97fa700 1 -- 172.21.15.49:0/4207956672 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ab00038e0 con 0x7f8abc0b3a50 2023-07-21T22:14:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.064+0000 7f8ab97fa700 1 --2- 172.21.15.49:0/4207956672 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8aa0066320 0x7f8aa00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.064+0000 7f8ab97fa700 1 -- 172.21.15.49:0/4207956672 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f8ab0083280 con 0x7f8abc0b3a50 2023-07-21T22:14:25.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.064+0000 7f8abbfff700 1 --2- 172.21.15.49:0/4207956672 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8aa0066320 0x7f8aa00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.064+0000 7f8abbfff700 1 --2- 172.21.15.49:0/4207956672 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8aa0066320 0x7f8aa00687d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009c20 tx=0x7f8aa8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:25.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.068+0000 7f8ab97fa700 1 -- 172.21.15.49:0/4207956672 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ab0050520 con 0x7f8abc0b3a50 2023-07-21T22:14:25.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.240+0000 7f8ac30dd700 1 -- 172.21.15.49:0/4207956672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8abc070e70 con 0x7f8abc0b3a50 2023-07-21T22:14:25.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.240+0000 7f8ab97fa700 1 -- 172.21.15.49:0/4207956672 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ab0053b40 con 0x7f8abc0b3a50 2023-07-21T22:14:25.287 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:14:25.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.244+0000 7f8ac30dd700 1 -- 172.21.15.49:0/4207956672 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8aa0066320 msgr2=0x7f8aa00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.244+0000 7f8ac30dd700 1 --2- 172.21.15.49:0/4207956672 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8aa0066320 0x7f8aa00687d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009c20 tx=0x7f8aa8008030 comp rx=0 tx=0).stop 2023-07-21T22:14:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.244+0000 7f8ac30dd700 1 -- 172.21.15.49:0/4207956672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8abc0b3a50 msgr2=0x7f8abc1556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.244+0000 7f8ac30dd700 1 --2- 172.21.15.49:0/4207956672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8abc0b3a50 0x7f8abc1556e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000c500 tx=0x7f8ab000c810 comp rx=0 tx=0).stop 2023-07-21T22:14:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.244+0000 7f8ac30dd700 1 -- 172.21.15.49:0/4207956672 shutdown_connections 2023-07-21T22:14:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.244+0000 7f8ac30dd700 1 --2- 172.21.15.49:0/4207956672 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8aa0066320 0x7f8aa00687d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.244+0000 7f8ac30dd700 1 --2- 172.21.15.49:0/4207956672 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8abc15e380 0x7f8abc1574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.244+0000 7f8ac30dd700 1 --2- 172.21.15.49:0/4207956672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8abc0cb2f0 0x7f8abc156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.244+0000 7f8ac30dd700 1 --2- 172.21.15.49:0/4207956672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8abc0b3a50 0x7f8abc1556e0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.244+0000 7f8ac30dd700 1 -- 172.21.15.49:0/4207956672 >> 172.21.15.49:0/4207956672 conn(0x7f8abc06e960 msgr2=0x7f8abc0cabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.244+0000 7f8ac30dd700 1 -- 172.21.15.49:0/4207956672 shutdown_connections 2023-07-21T22:14:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.244+0000 7f8ac30dd700 1 -- 172.21.15.49:0/4207956672 wait complete. 2023-07-21T22:14:25.313 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:14:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.452+0000 7fe52f293700 1 Processor -- start 2023-07-21T22:14:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.452+0000 7fe52f293700 1 -- start start 2023-07-21T22:14:25.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.456+0000 7fe52f293700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe528160010 0x7fe5280ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.456+0000 7fe52f293700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe5280ca680 0x7fe5280cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.456+0000 7fe52f293700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe528163ee0 con 0x7fe5281603e0 2023-07-21T22:14:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.456+0000 7fe52f293700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5280cdf70 con 0x7fe528160010 2023-07-21T22:14:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.456+0000 7fe52f293700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5280cd6d0 con 0x7fe5280ca680 2023-07-21T22:14:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.456+0000 7fe52e291700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe528160010 0x7fe5280ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.456+0000 7fe52e291700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe528160010 0x7fe5280ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55030/0 (socket says 172.21.15.49:55030) 2023-07-21T22:14:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.456+0000 7fe52ea92700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe5280ca680 0x7fe5280cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.456+0000 7fe52e291700 1 -- 172.21.15.49:0/1111371880 learned_addr learned my addr 172.21.15.49:0/1111371880 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:25.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.456+0000 7fe52e291700 1 -- 172.21.15.49:0/1111371880 >> v2:172.21.15.150:3300/0 conn(0x7fe5280ca680 msgr2=0x7fe5280cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:25.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.456+0000 7fe52e291700 1 --2- 172.21.15.49:0/1111371880 >> v2:172.21.15.150:3300/0 conn(0x7fe5280ca680 0x7fe5280cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.456+0000 7fe52e291700 1 -- 172.21.15.49:0/1111371880 >> v1:172.21.15.150:6789/0 conn(0x7fe5281603e0 legacy=0x7fe528164370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.456+0000 7fe52e291700 1 -- 172.21.15.49:0/1111371880 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5280cd9b0 con 0x7fe528160010 2023-07-21T22:14:25.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.456+0000 7fe52e291700 1 --2- 172.21.15.49:0/1111371880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe528160010 0x7fe5280ca140 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe5280709a0 tx=0x7fe524009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a0261fd3d0e147 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:25.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.460+0000 7fe52d28f700 1 -- 172.21.15.49:0/1111371880 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524011830 con 0x7fe528160010 2023-07-21T22:14:25.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.460+0000 7fe52d28f700 1 -- 172.21.15.49:0/1111371880 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe524011990 con 0x7fe528160010 2023-07-21T22:14:25.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.460+0000 7fe52d28f700 1 -- 172.21.15.49:0/1111371880 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524011d20 con 0x7fe528160010 2023-07-21T22:14:25.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.460+0000 7fe52f293700 1 -- 172.21.15.49:0/1111371880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe528160010 msgr2=0x7fe5280ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.460+0000 7fe52f293700 1 --2- 172.21.15.49:0/1111371880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe528160010 0x7fe5280ca140 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe5280709a0 tx=0x7fe524009bf0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.460+0000 7fe52f293700 1 -- 172.21.15.49:0/1111371880 shutdown_connections 2023-07-21T22:14:25.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.460+0000 7fe52f293700 1 --2- 172.21.15.49:0/1111371880 >> v2:172.21.15.150:3300/0 conn(0x7fe5280ca680 0x7fe5280cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.460+0000 7fe52f293700 1 --2- 172.21.15.49:0/1111371880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe528160010 0x7fe5280ca140 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.460+0000 7fe52f293700 1 -- 172.21.15.49:0/1111371880 >> 172.21.15.49:0/1111371880 conn(0x7fe5280ce0d0 msgr2=0x7fe5280ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.460+0000 7fe52f293700 1 -- 172.21.15.49:0/1111371880 shutdown_connections 2023-07-21T22:14:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.460+0000 7fe52f293700 1 -- 172.21.15.49:0/1111371880 wait complete. 2023-07-21T22:14:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.460+0000 7fe52f293700 1 Processor -- start 2023-07-21T22:14:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52f293700 1 -- start start 2023-07-21T22:14:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52f293700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5280ca680 0x7fe52815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52f293700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe528160010 0x7fe5280c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52f293700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5281603e0 0x7fe5280c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52f293700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5280c81d0 con 0x7fe5280ca680 2023-07-21T22:14:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52f293700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5280aec00 con 0x7fe528160010 2023-07-21T22:14:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52f293700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5280aee50 con 0x7fe5281603e0 2023-07-21T22:14:25.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52e291700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5280ca680 0x7fe52815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52e291700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5280ca680 0x7fe52815a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55036/0 (socket says 172.21.15.49:55036) 2023-07-21T22:14:25.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52e291700 1 -- 172.21.15.49:0/4101364316 learned_addr learned my addr 172.21.15.49:0/4101364316 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:25.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52da90700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe528160010 0x7fe5280c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52ea92700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5281603e0 0x7fe5280c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52e291700 1 -- 172.21.15.49:0/4101364316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5281603e0 msgr2=0x7fe5280c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52e291700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5281603e0 0x7fe5280c5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52e291700 1 -- 172.21.15.49:0/4101364316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe528160010 msgr2=0x7fe5280c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52e291700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe528160010 0x7fe5280c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52e291700 1 -- 172.21.15.49:0/4101364316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe524009570 con 0x7fe5280ca680 2023-07-21T22:14:25.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52da90700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe528160010 0x7fe5280c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:25.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52ea92700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5281603e0 0x7fe5280c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:25.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52e291700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5280ca680 0x7fe52815a5c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe528071ec0 tx=0x7fe524004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe51effd700 1 -- 172.21.15.49:0/4101364316 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524004550 con 0x7fe5280ca680 2023-07-21T22:14:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe51effd700 1 -- 172.21.15.49:0/4101364316 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52401f070 con 0x7fe5280ca680 2023-07-21T22:14:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52f293700 1 -- 172.21.15.49:0/4101364316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5280af130 con 0x7fe5280ca680 2023-07-21T22:14:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe51effd700 1 -- 172.21.15.49:0/4101364316 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524003900 con 0x7fe5280ca680 2023-07-21T22:14:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.464+0000 7fe52f293700 1 -- 172.21.15.49:0/4101364316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5280af6f0 con 0x7fe5280ca680 2023-07-21T22:14:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.468+0000 7fe52f293700 1 -- 172.21.15.49:0/4101364316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe528164a60 con 0x7fe5280ca680 2023-07-21T22:14:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.468+0000 7fe51effd700 1 -- 172.21.15.49:0/4101364316 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe524003a60 con 0x7fe5280ca680 2023-07-21T22:14:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.472+0000 7fe51effd700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe50c0662f0 0x7fe50c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.472+0000 7fe51effd700 1 -- 172.21.15.49:0/4101364316 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fe524021070 con 0x7fe5280ca680 2023-07-21T22:14:25.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.472+0000 7fe52da90700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe50c0662f0 0x7fe50c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.472+0000 7fe52da90700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe50c0662f0 0x7fe50c0687a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe5281f88d0 tx=0x7fe518009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:25.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.476+0000 7fe51effd700 1 -- 172.21.15.49:0/4101364316 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe528164a60 con 0x7fe5280ca680 2023-07-21T22:14:25.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.652+0000 7fe52f293700 1 -- 172.21.15.49:0/4101364316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe528164a40 con 0x7fe5280ca680 2023-07-21T22:14:25.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.652+0000 7fe51effd700 1 -- 172.21.15.49:0/4101364316 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe524052720 con 0x7fe5280ca680 2023-07-21T22:14:25.697 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:14:25.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.656+0000 7fe52f293700 1 -- 172.21.15.49:0/4101364316 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe50c0662f0 msgr2=0x7fe50c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.656+0000 7fe52f293700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe50c0662f0 0x7fe50c0687a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe5281f88d0 tx=0x7fe518009040 comp rx=0 tx=0).stop 2023-07-21T22:14:25.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.656+0000 7fe52f293700 1 -- 172.21.15.49:0/4101364316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5280ca680 msgr2=0x7fe52815a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.656+0000 7fe52f293700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5280ca680 0x7fe52815a5c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe528071ec0 tx=0x7fe524004770 comp rx=0 tx=0).stop 2023-07-21T22:14:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.656+0000 7fe52f293700 1 -- 172.21.15.49:0/4101364316 shutdown_connections 2023-07-21T22:14:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.656+0000 7fe52f293700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe50c0662f0 0x7fe50c0687a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.656+0000 7fe52f293700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5281603e0 0x7fe5280c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.656+0000 7fe52f293700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe528160010 0x7fe5280c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.656+0000 7fe52f293700 1 --2- 172.21.15.49:0/4101364316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5280ca680 0x7fe52815a5c0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.656+0000 7fe52f293700 1 -- 172.21.15.49:0/4101364316 >> 172.21.15.49:0/4101364316 conn(0x7fe5280ce0d0 msgr2=0x7fe52815f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:25.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.656+0000 7fe52f293700 1 -- 172.21.15.49:0/4101364316 shutdown_connections 2023-07-21T22:14:25.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.656+0000 7fe52f293700 1 -- 172.21.15.49:0/4101364316 wait complete. 2023-07-21T22:14:25.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:14:25.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.852+0000 7f47095f6700 1 Processor -- start 2023-07-21T22:14:25.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.852+0000 7f47095f6700 1 -- start start 2023-07-21T22:14:25.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47095f6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f47040d1e40 0x7f47040b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47095f6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47040cee10 0x7f47040cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47095f6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47040b3e80 con 0x7f47040b7af0 2023-07-21T22:14:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47095f6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47040cf7d0 con 0x7f47040d1e40 2023-07-21T22:14:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47095f6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470415fd40 con 0x7f47040cee10 2023-07-21T22:14:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47037fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f47040d1e40 0x7f47040b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47037fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f47040d1e40 0x7f47040b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55050/0 (socket says 172.21.15.49:55050) 2023-07-21T22:14:25.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47037fe700 1 -- 172.21.15.49:0/1495562442 learned_addr learned my addr 172.21.15.49:0/1495562442 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:25.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f4708df5700 1 --2- 172.21.15.49:0/1495562442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47040cee10 0x7f47040cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47037fe700 1 -- 172.21.15.49:0/1495562442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47040cee10 msgr2=0x7f47040cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:25.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47037fe700 1 --2- 172.21.15.49:0/1495562442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47040cee10 0x7f47040cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47037fe700 1 -- 172.21.15.49:0/1495562442 >> v1:172.21.15.150:6789/0 conn(0x7f47040b7af0 legacy=0x7f470415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:25.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47037fe700 1 -- 172.21.15.49:0/1495562442 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040cea00 con 0x7f47040d1e40 2023-07-21T22:14:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f4708df5700 1 --2- 172.21.15.49:0/1495562442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47040cee10 0x7f47040cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47037fe700 1 --2- 172.21.15.49:0/1495562442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47040d1e40 0x7f47040b1630 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009910 tx=0x7f46f8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88c4dbc8458a811 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f4702ffd700 1 -- 172.21.15.49:0/1495562442 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f800ba60 con 0x7f47040d1e40 2023-07-21T22:14:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f4702ffd700 1 -- 172.21.15.49:0/1495562442 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f800bbc0 con 0x7f47040d1e40 2023-07-21T22:14:25.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f4702ffd700 1 -- 172.21.15.49:0/1495562442 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8009e60 con 0x7f47040d1e40 2023-07-21T22:14:25.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47095f6700 1 -- 172.21.15.49:0/1495562442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47040d1e40 msgr2=0x7f47040b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47095f6700 1 --2- 172.21.15.49:0/1495562442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47040d1e40 0x7f47040b1630 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009910 tx=0x7f46f8009c20 comp rx=0 tx=0).stop 2023-07-21T22:14:25.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47095f6700 1 -- 172.21.15.49:0/1495562442 shutdown_connections 2023-07-21T22:14:25.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47095f6700 1 --2- 172.21.15.49:0/1495562442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47040cee10 0x7f47040cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47095f6700 1 --2- 172.21.15.49:0/1495562442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47040d1e40 0x7f47040b1630 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.856+0000 7f47095f6700 1 -- 172.21.15.49:0/1495562442 >> 172.21.15.49:0/1495562442 conn(0x7f470406e960 msgr2=0x7f470406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:25.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.860+0000 7f47095f6700 1 -- 172.21.15.49:0/1495562442 shutdown_connections 2023-07-21T22:14:25.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.860+0000 7f47095f6700 1 -- 172.21.15.49:0/1495562442 wait complete. 2023-07-21T22:14:25.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.860+0000 7f47095f6700 1 Processor -- start 2023-07-21T22:14:25.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47095f6700 1 -- start start 2023-07-21T22:14:25.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47095f6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47040b7af0 0x7f470414a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47095f6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47040cee10 0x7f4704147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47095f6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47040d1e40 0x7f4704148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47095f6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4704147bc0 con 0x7f47040cee10 2023-07-21T22:14:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47095f6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4704147df0 con 0x7f47040b7af0 2023-07-21T22:14:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47095f6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47041480d0 con 0x7f47040d1e40 2023-07-21T22:14:25.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47037fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47040cee10 0x7f4704147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47037fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47040cee10 0x7f4704147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55058/0 (socket says 172.21.15.49:55058) 2023-07-21T22:14:25.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47037fe700 1 -- 172.21.15.49:0/2779160543 learned_addr learned my addr 172.21.15.49:0/2779160543 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:25.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f4708df5700 1 --2- 172.21.15.49:0/2779160543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47040d1e40 0x7f4704148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f4703fff700 1 --2- 172.21.15.49:0/2779160543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47040b7af0 0x7f470414a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47037fe700 1 -- 172.21.15.49:0/2779160543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47040d1e40 msgr2=0x7f4704148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47037fe700 1 --2- 172.21.15.49:0/2779160543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47040d1e40 0x7f4704148e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47037fe700 1 -- 172.21.15.49:0/2779160543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47040b7af0 msgr2=0x7f470414a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:25.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47037fe700 1 --2- 172.21.15.49:0/2779160543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47040b7af0 0x7f470414a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:25.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47037fe700 1 -- 172.21.15.49:0/2779160543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f8009570 con 0x7f47040cee10 2023-07-21T22:14:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47037fe700 1 --2- 172.21.15.49:0/2779160543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47040cee10 0x7f4704147680 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f46f8000c00 tx=0x7f46f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f4700ff9700 1 -- 172.21.15.49:0/2779160543 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8004500 con 0x7f47040cee10 2023-07-21T22:14:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f4700ff9700 1 -- 172.21.15.49:0/2779160543 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f80036c0 con 0x7f47040cee10 2023-07-21T22:14:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f4700ff9700 1 -- 172.21.15.49:0/2779160543 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8003a50 con 0x7f47040cee10 2023-07-21T22:14:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.864+0000 7f47095f6700 1 -- 172.21.15.49:0/2779160543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47041483b0 con 0x7f47040cee10 2023-07-21T22:14:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.868+0000 7f47095f6700 1 -- 172.21.15.49:0/2779160543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4704148970 con 0x7f47040cee10 2023-07-21T22:14:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.868+0000 7f47095f6700 1 -- 172.21.15.49:0/2779160543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470404dcb0 con 0x7f47040cee10 2023-07-21T22:14:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.868+0000 7f4700ff9700 1 -- 172.21.15.49:0/2779160543 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f46f8003bb0 con 0x7f47040cee10 2023-07-21T22:14:25.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.872+0000 7f4700ff9700 1 --2- 172.21.15.49:0/2779160543 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f46f00662f0 0x7f46f00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.872+0000 7f4700ff9700 1 -- 172.21.15.49:0/2779160543 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f46f8021030 con 0x7f47040cee10 2023-07-21T22:14:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.872+0000 7f4703fff700 1 --2- 172.21.15.49:0/2779160543 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f46f00662f0 0x7f46f00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.872+0000 7f4703fff700 1 --2- 172.21.15.49:0/2779160543 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f46f00662f0 0x7f46f00687a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f46f4000f60 tx=0x7f46f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:25.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:25.876+0000 7f4700ff9700 1 -- 172.21.15.49:0/2779160543 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46f8052940 con 0x7f47040cee10 2023-07-21T22:14:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.064+0000 7f47095f6700 1 -- 172.21.15.49:0/2779160543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f47040729f0 con 0x7f47040cee10 2023-07-21T22:14:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.064+0000 7f4700ff9700 1 -- 172.21.15.49:0/2779160543 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) v1 ==== 80+0+0 (secure 0 0 0) 0x7f46f8003e60 con 0x7f47040cee10 2023-07-21T22:14:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.068+0000 7f47095f6700 1 -- 172.21.15.49:0/2779160543 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f46f00662f0 msgr2=0x7f46f00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.068+0000 7f47095f6700 1 --2- 172.21.15.49:0/2779160543 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f46f00662f0 0x7f46f00687a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f46f4000f60 tx=0x7f46f4009040 comp rx=0 tx=0).stop 2023-07-21T22:14:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.068+0000 7f47095f6700 1 -- 172.21.15.49:0/2779160543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47040cee10 msgr2=0x7f4704147680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.068+0000 7f47095f6700 1 --2- 172.21.15.49:0/2779160543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47040cee10 0x7f4704147680 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f46f8000c00 tx=0x7f46f8004770 comp rx=0 tx=0).stop 2023-07-21T22:14:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.068+0000 7f47095f6700 1 -- 172.21.15.49:0/2779160543 shutdown_connections 2023-07-21T22:14:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.068+0000 7f47095f6700 1 --2- 172.21.15.49:0/2779160543 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f46f00662f0 0x7f46f00687a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.068+0000 7f47095f6700 1 --2- 172.21.15.49:0/2779160543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47040cee10 0x7f4704147680 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.068+0000 7f47095f6700 1 --2- 172.21.15.49:0/2779160543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47040d1e40 0x7f4704148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.068+0000 7f47095f6700 1 --2- 172.21.15.49:0/2779160543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47040b7af0 0x7f470414a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.068+0000 7f47095f6700 1 -- 172.21.15.49:0/2779160543 >> 172.21.15.49:0/2779160543 conn(0x7f470406e960 msgr2=0x7f47040722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.068+0000 7f47095f6700 1 -- 172.21.15.49:0/2779160543 shutdown_connections 2023-07-21T22:14:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.068+0000 7f47095f6700 1 -- 172.21.15.49:0/2779160543 wait complete. 2023-07-21T22:14:26.117 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-07-21T22:14:26.137 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2023-07-21T22:14:26.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:26.138 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-21T22:14:26.168 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[49300]: fuse finished with error 0 and tester_r 0 2023-07-21T22:14:26.173 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:14:26.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:26.174 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:14:26.336 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:14:26.337 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:14:26.356 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352340k,nr_inodes=4088085,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2732 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:14:26.357 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:14:26.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:26.358 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-21T22:14:26.420 INFO:teuthology.orchestra.run.smithi150.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-21T22:14:26.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:14:26.422 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:14:26.422 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:14:26.441 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352276k,nr_inodes=4088069,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13711 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:14:26.442 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:14:26.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:26.442 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-21T22:14:26.505 INFO:teuthology.orchestra.run.smithi049.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-21T22:14:26.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:14:26.507 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:14:26.507 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:14:26.524 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352340k,nr_inodes=4088085,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2732 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:14:26.525 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:14:26.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:26.525 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-21T22:14:26.586 INFO:teuthology.orchestra.run.smithi150.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-21T22:14:26.587 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:14:26.588 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:14:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.728+0000 7fd6e0b2d700 1 Processor -- start 2023-07-21T22:14:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.728+0000 7fd6e0b2d700 1 -- start start 2023-07-21T22:14:26.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.728+0000 7fd6e0b2d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc159f60 0x7fd6dc0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:26.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.728+0000 7fd6e0b2d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6dc0b0600 con 0x7fd6dc0b0160 2023-07-21T22:14:26.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.728+0000 7fd6e0b2d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6dc15a470 con 0x7fd6dc06d5d0 2023-07-21T22:14:26.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.728+0000 7fd6e0b2d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc15a750 con 0x7fd6dc159f60 2023-07-21T22:14:26.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.728+0000 7fd6dad9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd6dc0b0160 0x7fd6dc15d780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40216/0 (socket says 172.21.15.49:40216) 2023-07-21T22:14:26.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.728+0000 7fd6dad9d700 1 -- 172.21.15.49:0/3492897646 learned_addr learned my addr 172.21.15.49:0/3492897646 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:26.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.728+0000 7fd6d1d9b700 1 --2- 172.21.15.49:0/3492897646 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc159f60 0x7fd6dc0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:26.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.728+0000 7fd6d9d9b700 1 -- 172.21.15.49:0/3492897646 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620652332 0 0) 0x7fd6dc0b0600 con 0x7fd6dc0b0160 2023-07-21T22:14:26.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.728+0000 7fd6d9d9b700 1 -- 172.21.15.49:0/3492897646 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c80035d0 con 0x7fd6dc0b0160 2023-07-21T22:14:26.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.728+0000 7fd6d9d9b700 1 -- 172.21.15.49:0/3492897646 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209119430 0 0) 0x7fd6dc15a470 con 0x7fd6dc06d5d0 2023-07-21T22:14:26.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.728+0000 7fd6d9d9b700 1 -- 172.21.15.49:0/3492897646 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6dc0b0600 con 0x7fd6dc06d5d0 2023-07-21T22:14:26.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.732+0000 7fd6d1d9b700 1 -- 172.21.15.49:0/3492897646 >> v1:172.21.15.150:6789/0 conn(0x7fd6dc06d5d0 legacy=0x7fd6dc06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:26.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.732+0000 7fd6d1d9b700 1 -- 172.21.15.49:0/3492897646 >> v1:172.21.15.49:6789/0 conn(0x7fd6dc0b0160 legacy=0x7fd6dc15d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:26.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.732+0000 7fd6d1d9b700 1 -- 172.21.15.49:0/3492897646 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc15aa30 con 0x7fd6dc159f60 2023-07-21T22:14:26.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.732+0000 7fd6d1d9b700 1 --2- 172.21.15.49:0/3492897646 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc159f60 0x7fd6dc0afc20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009880 tx=0x7fd6c4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3e434efa7109108 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:26.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.732+0000 7fd6d9d9b700 1 -- 172.21.15.49:0/3492897646 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4004230 con 0x7fd6dc159f60 2023-07-21T22:14:26.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.732+0000 7fd6d9d9b700 1 -- 172.21.15.49:0/3492897646 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c4004390 con 0x7fd6dc159f60 2023-07-21T22:14:26.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.732+0000 7fd6d9d9b700 1 -- 172.21.15.49:0/3492897646 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40036c0 con 0x7fd6dc159f60 2023-07-21T22:14:26.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.732+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/3492897646 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc159f60 msgr2=0x7fd6dc0afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:26.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.732+0000 7fd6e0b2d700 1 --2- 172.21.15.49:0/3492897646 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc159f60 0x7fd6dc0afc20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009880 tx=0x7fd6c4009b90 comp rx=0 tx=0).stop 2023-07-21T22:14:26.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.732+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/3492897646 shutdown_connections 2023-07-21T22:14:26.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.732+0000 7fd6e0b2d700 1 --2- 172.21.15.49:0/3492897646 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc159f60 0x7fd6dc0afc20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:26.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.732+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/3492897646 >> 172.21.15.49:0/3492897646 conn(0x7fd6dc06f5a0 msgr2=0x7fd6dc0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:26.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.732+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/3492897646 shutdown_connections 2023-07-21T22:14:26.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.732+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/3492897646 wait complete. 2023-07-21T22:14:26.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.736+0000 7fd6e0b2d700 1 Processor -- start 2023-07-21T22:14:26.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.736+0000 7fd6e0b2d700 1 -- start start 2023-07-21T22:14:26.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6e0b2d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc06d5d0 0x7fd6dc152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:26.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6e0b2d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6dc0b0160 0x7fd6dc0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:26.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6e0b2d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc159f60 0x7fd6dc0c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:26.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6e0b2d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0c6420 con 0x7fd6dc0b0160 2023-07-21T22:14:26.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6e0b2d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc153110 con 0x7fd6dc159f60 2023-07-21T22:14:26.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6e0b2d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0c66c0 con 0x7fd6dc06d5d0 2023-07-21T22:14:26.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6d1d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6dc0b0160 0x7fd6dc0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:26.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6d1d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6dc0b0160 0x7fd6dc0b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55068/0 (socket says 172.21.15.49:55068) 2023-07-21T22:14:26.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6d1d9b700 1 -- 172.21.15.49:0/2529052472 learned_addr learned my addr 172.21.15.49:0/2529052472 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:26.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6dad9d700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc159f60 0x7fd6dc0c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:26.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6da59c700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc06d5d0 0x7fd6dc152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:26.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6d1d9b700 1 -- 172.21.15.49:0/2529052472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc06d5d0 msgr2=0x7fd6dc152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:26.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6d1d9b700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc06d5d0 0x7fd6dc152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:26.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6d1d9b700 1 -- 172.21.15.49:0/2529052472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc159f60 msgr2=0x7fd6dc0c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:26.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6d1d9b700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc159f60 0x7fd6dc0c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:26.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6d1d9b700 1 -- 172.21.15.49:0/2529052472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c40094b0 con 0x7fd6dc0b0160 2023-07-21T22:14:26.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6da59c700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc06d5d0 0x7fd6dc152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:26.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6d1d9b700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6dc0b0160 0x7fd6dc0b0fd0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40090b0 tx=0x7fd6c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:26.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6d37fe700 1 -- 172.21.15.49:0/2529052472 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4006ea0 con 0x7fd6dc0b0160 2023-07-21T22:14:26.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6d37fe700 1 -- 172.21.15.49:0/2529052472 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c4011630 con 0x7fd6dc0b0160 2023-07-21T22:14:26.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/2529052472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc0c69a0 con 0x7fd6dc0b0160 2023-07-21T22:14:26.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6d37fe700 1 -- 172.21.15.49:0/2529052472 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40119c0 con 0x7fd6dc0b0160 2023-07-21T22:14:26.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.740+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/2529052472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc0c6f60 con 0x7fd6dc0b0160 2023-07-21T22:14:26.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.744+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/2529052472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6dc073130 con 0x7fd6dc0b0160 2023-07-21T22:14:26.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.744+0000 7fd6d37fe700 1 -- 172.21.15.49:0/2529052472 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6c4011b20 con 0x7fd6dc0b0160 2023-07-21T22:14:26.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.748+0000 7fd6d37fe700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd6bc066340 0x7fd6bc0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:26.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.748+0000 7fd6d37fe700 1 -- 172.21.15.49:0/2529052472 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fd6c4085540 con 0x7fd6dc0b0160 2023-07-21T22:14:26.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.748+0000 7fd6da59c700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd6bc066340 0x7fd6bc0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:26.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.748+0000 7fd6da59c700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd6bc066340 0x7fd6bc0687f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc1f4dc0 tx=0x7fd6cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:26.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.752+0000 7fd6d37fe700 1 -- 172.21.15.49:0/2529052472 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6c4052860 con 0x7fd6dc0b0160 2023-07-21T22:14:27.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.968+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/2529052472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6dc04dcb0 con 0x7fd6dc0b0160 2023-07-21T22:14:27.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.968+0000 7fd6d37fe700 1 -- 172.21.15.49:0/2529052472 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4678 (secure 0 0 0) 0x7fd6c4055e80 con 0x7fd6dc0b0160 2023-07-21T22:14:27.015 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:27.015 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3145882220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3145882220},{"type":"v1","addr":"172.21.15.150:6834","nonce":3145882220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5657,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2809854510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2809854510},{"type":"v1","addr":"172.21.15.150:6835","nonce":2809854510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1044407594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1044407594},{"type":"v1","addr":"172.21.15.49:6837","nonce":1044407594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:13:40.538282+0000","modified":"2023-07-21T22:13:44.115111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6396":{"gid":6396,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6836/4142505890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4142505890},{"type":"v1","addr":"172.21.15.49:6836","nonce":4142505890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T22:14:27.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.976+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/2529052472 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd6bc066340 msgr2=0x7fd6bc0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.976+0000 7fd6e0b2d700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd6bc066340 0x7fd6bc0687f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc1f4dc0 tx=0x7fd6cc009040 comp rx=0 tx=0).stop 2023-07-21T22:14:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.976+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/2529052472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6dc0b0160 msgr2=0x7fd6dc0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.976+0000 7fd6e0b2d700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6dc0b0160 0x7fd6dc0b0fd0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40090b0 tx=0x7fd6c4004770 comp rx=0 tx=0).stop 2023-07-21T22:14:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.976+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/2529052472 shutdown_connections 2023-07-21T22:14:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.976+0000 7fd6e0b2d700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fd6bc066340 0x7fd6bc0687f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.976+0000 7fd6e0b2d700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6dc0b0160 0x7fd6dc0b0fd0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.976+0000 7fd6e0b2d700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc159f60 0x7fd6dc0c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.976+0000 7fd6e0b2d700 1 --2- 172.21.15.49:0/2529052472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc06d5d0 0x7fd6dc152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.976+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/2529052472 >> 172.21.15.49:0/2529052472 conn(0x7fd6dc06f5a0 msgr2=0x7fd6dc06bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.976+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/2529052472 shutdown_connections 2023-07-21T22:14:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:26.976+0000 7fd6e0b2d700 1 -- 172.21.15.49:0/2529052472 wait complete. 2023-07-21T22:14:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2023-07-21T22:14:27.041 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:14:27.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.168+0000 7f9f2495f700 1 Processor -- start 2023-07-21T22:14:27.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.168+0000 7f9f2495f700 1 -- start start 2023-07-21T22:14:27.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.172+0000 7f9f2495f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9f2006d380 0x7f9f2006d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:27.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.172+0000 7f9f2495f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f20071c70 0x7f9f200b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:27.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.172+0000 7f9f2495f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f200cab20 con 0x7f9f200b1400 2023-07-21T22:14:27.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.172+0000 7f9f2495f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f200c9e80 con 0x7f9f2006d380 2023-07-21T22:14:27.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.172+0000 7f9f2495f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f200afeb0 con 0x7f9f20071c70 2023-07-21T22:14:27.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.172+0000 7f9f16ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f20071c70 0x7f9f200b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:27.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.172+0000 7f9f1f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9f2006d380 0x7f9f2006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:27.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.172+0000 7f9f16ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f20071c70 0x7f9f200b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:48712/0 (socket says 172.21.15.49:48712) 2023-07-21T22:14:27.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.172+0000 7f9f1f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9f2006d380 0x7f9f2006d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:49964/0 (socket says 172.21.15.49:49964) 2023-07-21T22:14:27.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.172+0000 7f9f16ffd700 1 -- 172.21.15.49:0/2361890193 learned_addr learned my addr 172.21.15.49:0/2361890193 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:27.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f16ffd700 1 -- 172.21.15.49:0/2361890193 >> v2:172.21.15.150:3300/0 conn(0x7f9f2006d380 msgr2=0x7f9f2006d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:27.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f16ffd700 1 --2- 172.21.15.49:0/2361890193 >> v2:172.21.15.150:3300/0 conn(0x7f9f2006d380 0x7f9f2006d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f16ffd700 1 -- 172.21.15.49:0/2361890193 >> v1:172.21.15.150:6789/0 conn(0x7f9f200b1400 legacy=0x7f9f200cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f16ffd700 1 -- 172.21.15.49:0/2361890193 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2006dc90 con 0x7f9f20071c70 2023-07-21T22:14:27.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f1f7fe700 1 --2- 172.21.15.49:0/2361890193 >> v2:172.21.15.150:3300/0 conn(0x7f9f2006d380 0x7f9f2006d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:14:27.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f16ffd700 1 --2- 172.21.15.49:0/2361890193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f20071c70 0x7f9f200b0ec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009910 tx=0x7f9f08009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a04c82d8fd154db2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:27.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f1effd700 1 -- 172.21.15.49:0/2361890193 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08011830 con 0x7f9f20071c70 2023-07-21T22:14:27.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f1effd700 1 -- 172.21.15.49:0/2361890193 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f08011990 con 0x7f9f20071c70 2023-07-21T22:14:27.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f1effd700 1 -- 172.21.15.49:0/2361890193 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08011d40 con 0x7f9f20071c70 2023-07-21T22:14:27.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f2495f700 1 -- 172.21.15.49:0/2361890193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f20071c70 msgr2=0x7f9f200b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f2495f700 1 --2- 172.21.15.49:0/2361890193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f20071c70 0x7f9f200b0ec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009910 tx=0x7f9f08009c20 comp rx=0 tx=0).stop 2023-07-21T22:14:27.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f2495f700 1 -- 172.21.15.49:0/2361890193 shutdown_connections 2023-07-21T22:14:27.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f2495f700 1 --2- 172.21.15.49:0/2361890193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f20071c70 0x7f9f200b0ec0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f2495f700 1 --2- 172.21.15.49:0/2361890193 >> v2:172.21.15.150:3300/0 conn(0x7f9f2006d380 0x7f9f2006d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f2495f700 1 -- 172.21.15.49:0/2361890193 >> 172.21.15.49:0/2361890193 conn(0x7f9f20070450 msgr2=0x7f9f20070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:27.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f2495f700 1 -- 172.21.15.49:0/2361890193 shutdown_connections 2023-07-21T22:14:27.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.176+0000 7f9f2495f700 1 -- 172.21.15.49:0/2361890193 wait complete. 2023-07-21T22:14:27.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.180+0000 7f9f2495f700 1 Processor -- start 2023-07-21T22:14:27.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.180+0000 7f9f2495f700 1 -- start start 2023-07-21T22:14:27.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.180+0000 7f9f2495f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f2006d380 0x7f9f20148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:27.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.180+0000 7f9f2495f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f20071c70 0x7f9f200c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:27.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.180+0000 7f9f2495f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f200b1400 0x7f9f200c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:27.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.180+0000 7f9f2495f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f20149420 con 0x7f9f20071c70 2023-07-21T22:14:27.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.180+0000 7f9f2495f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2014c800 con 0x7f9f2006d380 2023-07-21T22:14:27.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.180+0000 7f9f2495f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2015bb20 con 0x7f9f200b1400 2023-07-21T22:14:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f16ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f20071c70 0x7f9f200c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f16ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f20071c70 0x7f9f200c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55076/0 (socket says 172.21.15.49:55076) 2023-07-21T22:14:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f16ffd700 1 -- 172.21.15.49:0/4255919510 learned_addr learned my addr 172.21.15.49:0/4255919510 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f1f7fe700 1 --2- 172.21.15.49:0/4255919510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f2006d380 0x7f9f20148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f1ffff700 1 --2- 172.21.15.49:0/4255919510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f200b1400 0x7f9f200c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f16ffd700 1 -- 172.21.15.49:0/4255919510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f200b1400 msgr2=0x7f9f200c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f16ffd700 1 --2- 172.21.15.49:0/4255919510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f200b1400 0x7f9f200c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f16ffd700 1 -- 172.21.15.49:0/4255919510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f2006d380 msgr2=0x7f9f20148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f16ffd700 1 --2- 172.21.15.49:0/4255919510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f2006d380 0x7f9f20148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f16ffd700 1 -- 172.21.15.49:0/4255919510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f100094b0 con 0x7f9f20071c70 2023-07-21T22:14:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f16ffd700 1 --2- 172.21.15.49:0/4255919510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f20071c70 0x7f9f200c7e00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f9f2006ad10 tx=0x7f9f08004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f1cff9700 1 -- 172.21.15.49:0/4255919510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08004510 con 0x7f9f20071c70 2023-07-21T22:14:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f1cff9700 1 -- 172.21.15.49:0/4255919510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f080036c0 con 0x7f9f20071c70 2023-07-21T22:14:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f1cff9700 1 -- 172.21.15.49:0/4255919510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08003a70 con 0x7f9f20071c70 2023-07-21T22:14:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f2495f700 1 -- 172.21.15.49:0/4255919510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f08009570 con 0x7f9f20071c70 2023-07-21T22:14:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.184+0000 7f9f2495f700 1 -- 172.21.15.49:0/4255919510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2015c0e0 con 0x7f9f20071c70 2023-07-21T22:14:27.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.188+0000 7f9f2495f700 1 -- 172.21.15.49:0/4255919510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2004dcb0 con 0x7f9f20071c70 2023-07-21T22:14:27.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.188+0000 7f9f1cff9700 1 -- 172.21.15.49:0/4255919510 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9f08003bd0 con 0x7f9f20071c70 2023-07-21T22:14:27.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.192+0000 7f9f1cff9700 1 --2- 172.21.15.49:0/4255919510 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f000662f0 0x7f9f000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:27.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.192+0000 7f9f1cff9700 1 -- 172.21.15.49:0/4255919510 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f9f08021030 con 0x7f9f20071c70 2023-07-21T22:14:27.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.192+0000 7f9f1f7fe700 1 --2- 172.21.15.49:0/4255919510 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f000662f0 0x7f9f000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:27.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.192+0000 7f9f1f7fe700 1 --2- 172.21.15.49:0/4255919510 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f000662f0 0x7f9f000687a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009ce0 tx=0x7f9f10009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.196+0000 7f9f1cff9700 1 -- 172.21.15.49:0/4255919510 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9f080527a0 con 0x7f9f20071c70 2023-07-21T22:14:27.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.372+0000 7f9f2495f700 1 -- 172.21.15.49:0/4255919510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f200b3ff0 con 0x7f9f20071c70 2023-07-21T22:14:27.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.376+0000 7f9f1cff9700 1 -- 172.21.15.49:0/4255919510 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+18703 (secure 0 0 0) 0x7f9f08055dc0 con 0x7f9f20071c70 2023-07-21T22:14:27.420 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:27.421 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:14:17.339840+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:13:38.569931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:13:39.558524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.15","mappings":[{"from":7,"to":2}]},{"pgid":"10.25","mappings":[{"from":4,"to":3}]},{"pgid":"10.2a","mappings":[{"from":7,"to":5}]},{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:14:27.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.376+0000 7f9f2495f700 1 -- 172.21.15.49:0/4255919510 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f000662f0 msgr2=0x7f9f000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.376+0000 7f9f2495f700 1 --2- 172.21.15.49:0/4255919510 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f000662f0 0x7f9f000687a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009ce0 tx=0x7f9f10009240 comp rx=0 tx=0).stop 2023-07-21T22:14:27.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.376+0000 7f9f2495f700 1 -- 172.21.15.49:0/4255919510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f20071c70 msgr2=0x7f9f200c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.376+0000 7f9f2495f700 1 --2- 172.21.15.49:0/4255919510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f20071c70 0x7f9f200c7e00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f9f2006ad10 tx=0x7f9f08004770 comp rx=0 tx=0).stop 2023-07-21T22:14:27.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.376+0000 7f9f2495f700 1 -- 172.21.15.49:0/4255919510 shutdown_connections 2023-07-21T22:14:27.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.376+0000 7f9f2495f700 1 --2- 172.21.15.49:0/4255919510 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9f000662f0 0x7f9f000687a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.376+0000 7f9f2495f700 1 --2- 172.21.15.49:0/4255919510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f20071c70 0x7f9f200c7e00 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.376+0000 7f9f2495f700 1 --2- 172.21.15.49:0/4255919510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f200b1400 0x7f9f200c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.376+0000 7f9f2495f700 1 --2- 172.21.15.49:0/4255919510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f2006d380 0x7f9f20148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.376+0000 7f9f2495f700 1 -- 172.21.15.49:0/4255919510 >> 172.21.15.49:0/4255919510 conn(0x7f9f20070450 msgr2=0x7f9f200b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:27.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.376+0000 7f9f2495f700 1 -- 172.21.15.49:0/4255919510 shutdown_connections 2023-07-21T22:14:27.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.376+0000 7f9f2495f700 1 -- 172.21.15.49:0/4255919510 wait complete. 2023-07-21T22:14:27.446 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:10:22.385131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:10:27.862618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:13:38.569931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:13:39.558524+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:14:27.447 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:14:27.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.580+0000 7f2646715700 1 Processor -- start 2023-07-21T22:14:27.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.580+0000 7f2646715700 1 -- start start 2023-07-21T22:14:27.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.584+0000 7f2646715700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f26400b7af0 0x7f26400b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:27.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.584+0000 7f2646715700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26400b3e80 con 0x7f26400d1e40 2023-07-21T22:14:27.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.584+0000 7f2646715700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264015fd40 con 0x7f26400cee10 2023-07-21T22:14:27.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.584+0000 7f2646715700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26400cea00 con 0x7f26400b7af0 2023-07-21T22:14:27.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.584+0000 7f2644f12700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f26400d1e40 0x7f264015f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40226/0 (socket says 172.21.15.49:40226) 2023-07-21T22:14:27.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.584+0000 7f2644f12700 1 -- 172.21.15.49:0/2671469883 learned_addr learned my addr 172.21.15.49:0/2671469883 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:27.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.584+0000 7f2645713700 1 --2- 172.21.15.49:0/2671469883 >> v2:172.21.15.150:3300/0 conn(0x7f26400b7af0 0x7f26400b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:27.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2645713700 1 -- 172.21.15.49:0/2671469883 >> v1:172.21.15.150:6789/0 conn(0x7f26400cee10 legacy=0x7f26400b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2645713700 1 -- 172.21.15.49:0/2671469883 >> v1:172.21.15.49:6789/0 conn(0x7f26400d1e40 legacy=0x7f264015f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2645713700 1 -- 172.21.15.49:0/2671469883 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26400ccbf0 con 0x7f26400b7af0 2023-07-21T22:14:27.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2637fff700 1 -- 172.21.15.49:0/2671469883 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731726046 0 0) 0x7f26400b3e80 con 0x7f26400d1e40 2023-07-21T22:14:27.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2645713700 1 --2- 172.21.15.49:0/2671469883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400b7af0 0x7f26400b1630 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f263c009850 tx=0x7f263c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94da0abf1a893c70 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:27.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2637fff700 1 -- 172.21.15.49:0/2671469883 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c011830 con 0x7f26400b7af0 2023-07-21T22:14:27.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2637fff700 1 -- 172.21.15.49:0/2671469883 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c011990 con 0x7f26400b7af0 2023-07-21T22:14:27.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2637fff700 1 -- 172.21.15.49:0/2671469883 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c011d20 con 0x7f26400b7af0 2023-07-21T22:14:27.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2646715700 1 -- 172.21.15.49:0/2671469883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400b7af0 msgr2=0x7f26400b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2646715700 1 --2- 172.21.15.49:0/2671469883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400b7af0 0x7f26400b1630 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f263c009850 tx=0x7f263c009b60 comp rx=0 tx=0).stop 2023-07-21T22:14:27.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2646715700 1 -- 172.21.15.49:0/2671469883 shutdown_connections 2023-07-21T22:14:27.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2646715700 1 --2- 172.21.15.49:0/2671469883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400b7af0 0x7f26400b1630 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2646715700 1 -- 172.21.15.49:0/2671469883 >> 172.21.15.49:0/2671469883 conn(0x7f264006e960 msgr2=0x7f264006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:27.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2646715700 1 -- 172.21.15.49:0/2671469883 shutdown_connections 2023-07-21T22:14:27.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.588+0000 7f2646715700 1 -- 172.21.15.49:0/2671469883 wait complete. 2023-07-21T22:14:27.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.592+0000 7f2646715700 1 Processor -- start 2023-07-21T22:14:27.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.592+0000 7f2646715700 1 -- start start 2023-07-21T22:14:27.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.592+0000 7f2646715700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400b7af0 0x7f2640150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:27.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.592+0000 7f2646715700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400cee10 0x7f264015c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:27.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.592+0000 7f2646715700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26400d1e40 0x7f264015c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:27.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.592+0000 7f2646715700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264015d920 con 0x7f26400b7af0 2023-07-21T22:14:27.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.592+0000 7f2646715700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26400c6270 con 0x7f26400cee10 2023-07-21T22:14:27.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.592+0000 7f2646715700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264015cd10 con 0x7f26400d1e40 2023-07-21T22:14:27.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.592+0000 7f2645713700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400b7af0 0x7f2640150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:27.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.592+0000 7f2645713700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400b7af0 0x7f2640150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55084/0 (socket says 172.21.15.49:55084) 2023-07-21T22:14:27.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.592+0000 7f2645713700 1 -- 172.21.15.49:0/868039467 learned_addr learned my addr 172.21.15.49:0/868039467 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:27.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.592+0000 7f2645f14700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26400d1e40 0x7f264015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:27.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2645713700 1 -- 172.21.15.49:0/868039467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26400d1e40 msgr2=0x7f264015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2644f12700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400cee10 0x7f264015c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:27.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2645713700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26400d1e40 0x7f264015c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2645713700 1 -- 172.21.15.49:0/868039467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400cee10 msgr2=0x7f264015c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2645713700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400cee10 0x7f264015c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2645713700 1 -- 172.21.15.49:0/868039467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c0094b0 con 0x7f26400b7af0 2023-07-21T22:14:27.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2645f14700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26400d1e40 0x7f264015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:27.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2644f12700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400cee10 0x7f264015c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:27.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2645713700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400b7af0 0x7f2640150a80 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f264006f670 tx=0x7f263c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:27.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2635ffb700 1 -- 172.21.15.49:0/868039467 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c00bbd0 con 0x7f26400b7af0 2023-07-21T22:14:27.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2635ffb700 1 -- 172.21.15.49:0/868039467 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c01f070 con 0x7f26400b7af0 2023-07-21T22:14:27.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2646715700 1 -- 172.21.15.49:0/868039467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264015cff0 con 0x7f26400b7af0 2023-07-21T22:14:27.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2635ffb700 1 -- 172.21.15.49:0/868039467 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c01a430 con 0x7f26400b7af0 2023-07-21T22:14:27.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2646715700 1 -- 172.21.15.49:0/868039467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264015d5b0 con 0x7f26400b7af0 2023-07-21T22:14:27.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.596+0000 7f2646715700 1 -- 172.21.15.49:0/868039467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264004dcb0 con 0x7f26400b7af0 2023-07-21T22:14:27.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.600+0000 7f2635ffb700 1 -- 172.21.15.49:0/868039467 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f263c01a590 con 0x7f26400b7af0 2023-07-21T22:14:27.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.600+0000 7f2635ffb700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f26240662f0 0x7f26240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:27.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.600+0000 7f2635ffb700 1 -- 172.21.15.49:0/868039467 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f263c021070 con 0x7f26400b7af0 2023-07-21T22:14:27.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.600+0000 7f2644f12700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f26240662f0 0x7f26240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:27.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.604+0000 7f2644f12700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f26240662f0 0x7f26240687a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2630007fd0 tx=0x7f2630009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:27.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.608+0000 7f2635ffb700 1 -- 172.21.15.49:0/868039467 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f263c0529e0 con 0x7f26400b7af0 2023-07-21T22:14:27.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.780+0000 7f2646715700 1 -- 172.21.15.49:0/868039467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26400cfa30 con 0x7f26400b7af0 2023-07-21T22:14:27.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.784+0000 7f2635ffb700 1 -- 172.21.15.49:0/868039467 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f263c056000 con 0x7f26400b7af0 2023-07-21T22:14:27.828 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-07-21T22:14:27.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.784+0000 7f2646715700 1 -- 172.21.15.49:0/868039467 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f26240662f0 msgr2=0x7f26240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.784+0000 7f2646715700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f26240662f0 0x7f26240687a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2630007fd0 tx=0x7f2630009040 comp rx=0 tx=0).stop 2023-07-21T22:14:27.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.784+0000 7f2646715700 1 -- 172.21.15.49:0/868039467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400b7af0 msgr2=0x7f2640150a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:27.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.784+0000 7f2646715700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400b7af0 0x7f2640150a80 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f264006f670 tx=0x7f263c004770 comp rx=0 tx=0).stop 2023-07-21T22:14:27.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.784+0000 7f2646715700 1 -- 172.21.15.49:0/868039467 shutdown_connections 2023-07-21T22:14:27.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.784+0000 7f2646715700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f26240662f0 0x7f26240687a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.784+0000 7f2646715700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26400d1e40 0x7f264015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.784+0000 7f2646715700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400cee10 0x7f264015c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.784+0000 7f2646715700 1 --2- 172.21.15.49:0/868039467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400b7af0 0x7f2640150a80 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:27.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.784+0000 7f2646715700 1 -- 172.21.15.49:0/868039467 >> 172.21.15.49:0/868039467 conn(0x7f264006e960 msgr2=0x7f264015ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:27.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.784+0000 7f2646715700 1 -- 172.21.15.49:0/868039467 shutdown_connections 2023-07-21T22:14:27.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.784+0000 7f2646715700 1 -- 172.21.15.49:0/868039467 wait complete. 2023-07-21T22:14:27.852 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:14:28.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.988+0000 7fa388f5d700 1 Processor -- start 2023-07-21T22:14:28.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.988+0000 7fa388f5d700 1 -- start start 2023-07-21T22:14:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.992+0000 7fa388f5d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840ccc00 0x7fa3840cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.992+0000 7fa388f5d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa3840afbd0 0x7fa3840b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.992+0000 7fa388f5d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3840cc320 con 0x7fa38415bbd0 2023-07-21T22:14:28.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.992+0000 7fa388f5d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3840ccfd0 con 0x7fa3840afbd0 2023-07-21T22:14:28.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.992+0000 7fa388f5d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840b0590 con 0x7fa3840ccc00 2023-07-21T22:14:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.992+0000 7fa3837fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840ccc00 0x7fa3840cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.992+0000 7fa3837fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840ccc00 0x7fa3840cd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:48738/0 (socket says 172.21.15.49:48738) 2023-07-21T22:14:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.992+0000 7fa3837fe700 1 -- 172.21.15.49:0/2182225886 learned_addr learned my addr 172.21.15.49:0/2182225886 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.992+0000 7fa383fff700 1 --2- 172.21.15.49:0/2182225886 >> v2:172.21.15.150:3300/0 conn(0x7fa3840afbd0 0x7fa3840b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.992+0000 7fa3837fe700 1 -- 172.21.15.49:0/2182225886 >> v2:172.21.15.150:3300/0 conn(0x7fa3840afbd0 msgr2=0x7fa3840b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.992+0000 7fa3837fe700 1 --2- 172.21.15.49:0/2182225886 >> v2:172.21.15.150:3300/0 conn(0x7fa3840afbd0 0x7fa3840b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.992+0000 7fa3837fe700 1 -- 172.21.15.49:0/2182225886 >> v1:172.21.15.150:6789/0 conn(0x7fa38415bbd0 legacy=0x7fa3840cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.996+0000 7fa3837fe700 1 -- 172.21.15.49:0/2182225886 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38415c120 con 0x7fa3840ccc00 2023-07-21T22:14:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.996+0000 7fa3837fe700 1 --2- 172.21.15.49:0/2182225886 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840ccc00 0x7fa3840cd790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa374009910 tx=0x7fa374009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec8ce1f2785c2c60 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.996+0000 7fa3827fc700 1 -- 172.21.15.49:0/2182225886 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37400b830 con 0x7fa3840ccc00 2023-07-21T22:14:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.996+0000 7fa3827fc700 1 -- 172.21.15.49:0/2182225886 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37400b990 con 0x7fa3840ccc00 2023-07-21T22:14:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.996+0000 7fa3827fc700 1 -- 172.21.15.49:0/2182225886 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37400bd40 con 0x7fa3840ccc00 2023-07-21T22:14:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.996+0000 7fa388f5d700 1 -- 172.21.15.49:0/2182225886 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840ccc00 msgr2=0x7fa3840cd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.996+0000 7fa388f5d700 1 --2- 172.21.15.49:0/2182225886 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840ccc00 0x7fa3840cd790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa374009910 tx=0x7fa374009c20 comp rx=0 tx=0).stop 2023-07-21T22:14:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.996+0000 7fa388f5d700 1 -- 172.21.15.49:0/2182225886 shutdown_connections 2023-07-21T22:14:28.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.996+0000 7fa388f5d700 1 --2- 172.21.15.49:0/2182225886 >> v2:172.21.15.150:3300/0 conn(0x7fa3840afbd0 0x7fa3840b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.996+0000 7fa388f5d700 1 --2- 172.21.15.49:0/2182225886 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840ccc00 0x7fa3840cd790 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.996+0000 7fa388f5d700 1 -- 172.21.15.49:0/2182225886 >> 172.21.15.49:0/2182225886 conn(0x7fa3840ce0d0 msgr2=0x7fa3840ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:28.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.996+0000 7fa388f5d700 1 -- 172.21.15.49:0/2182225886 shutdown_connections 2023-07-21T22:14:28.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:27.996+0000 7fa388f5d700 1 -- 172.21.15.49:0/2182225886 wait complete. 2023-07-21T22:14:28.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.000+0000 7fa388f5d700 1 Processor -- start 2023-07-21T22:14:28.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.000+0000 7fa388f5d700 1 -- start start 2023-07-21T22:14:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.000+0000 7fa388f5d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3840afbd0 0x7fa3840ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.000+0000 7fa388f5d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3840ccc00 0x7fa3840ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.000+0000 7fa388f5d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa38415bbd0 0x7fa38414c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.000+0000 7fa388f5d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840b27f0 con 0x7fa3840ccc00 2023-07-21T22:14:28.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.000+0000 7fa388f5d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840af920 con 0x7fa3840afbd0 2023-07-21T22:14:28.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.000+0000 7fa388f5d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840acd10 con 0x7fa38415bbd0 2023-07-21T22:14:28.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.000+0000 7fa382ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3840ccc00 0x7fa3840ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.000+0000 7fa382ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3840ccc00 0x7fa3840ad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55098/0 (socket says 172.21.15.49:55098) 2023-07-21T22:14:28.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.000+0000 7fa382ffd700 1 -- 172.21.15.49:0/916021793 learned_addr learned my addr 172.21.15.49:0/916021793 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:28.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.000+0000 7fa3837fe700 1 --2- 172.21.15.49:0/916021793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3840afbd0 0x7fa3840ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.000+0000 7fa383fff700 1 --2- 172.21.15.49:0/916021793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa38415bbd0 0x7fa38414c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.004+0000 7fa382ffd700 1 -- 172.21.15.49:0/916021793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa38415bbd0 msgr2=0x7fa38414c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.004+0000 7fa382ffd700 1 --2- 172.21.15.49:0/916021793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa38415bbd0 0x7fa38414c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.004+0000 7fa382ffd700 1 -- 172.21.15.49:0/916021793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3840afbd0 msgr2=0x7fa3840ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.004+0000 7fa382ffd700 1 --2- 172.21.15.49:0/916021793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3840afbd0 0x7fa3840ac6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.004+0000 7fa382ffd700 1 -- 172.21.15.49:0/916021793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa374009570 con 0x7fa3840ccc00 2023-07-21T22:14:28.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.004+0000 7fa382ffd700 1 --2- 172.21.15.49:0/916021793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3840ccc00 0x7fa3840ad2a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa37800c500 tx=0x7fa37800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:28.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.004+0000 7fa36bfff700 1 -- 172.21.15.49:0/916021793 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780052d0 con 0x7fa3840ccc00 2023-07-21T22:14:28.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.004+0000 7fa36bfff700 1 -- 172.21.15.49:0/916021793 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa378005430 con 0x7fa3840ccc00 2023-07-21T22:14:28.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.004+0000 7fa388f5d700 1 -- 172.21.15.49:0/916021793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3840b2a40 con 0x7fa3840ccc00 2023-07-21T22:14:28.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.004+0000 7fa36bfff700 1 -- 172.21.15.49:0/916021793 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780055a0 con 0x7fa3840ccc00 2023-07-21T22:14:28.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.004+0000 7fa388f5d700 1 -- 172.21.15.49:0/916021793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3840b3000 con 0x7fa3840ccc00 2023-07-21T22:14:28.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.004+0000 7fa388f5d700 1 -- 172.21.15.49:0/916021793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38404dcb0 con 0x7fa3840ccc00 2023-07-21T22:14:28.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.008+0000 7fa36bfff700 1 -- 172.21.15.49:0/916021793 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa3780038e0 con 0x7fa3840ccc00 2023-07-21T22:14:28.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.008+0000 7fa36bfff700 1 --2- 172.21.15.49:0/916021793 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3700662f0 0x7fa3700687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.008+0000 7fa36bfff700 1 -- 172.21.15.49:0/916021793 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fa378083210 con 0x7fa3840ccc00 2023-07-21T22:14:28.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.008+0000 7fa3837fe700 1 --2- 172.21.15.49:0/916021793 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3700662f0 0x7fa3700687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.008+0000 7fa3837fe700 1 --2- 172.21.15.49:0/916021793 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3700662f0 0x7fa3700687a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa374000c00 tx=0x7fa37401b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:28.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.016+0000 7fa36bfff700 1 -- 172.21.15.49:0/916021793 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa378050420 con 0x7fa3840ccc00 2023-07-21T22:14:28.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.200+0000 7fa388f5d700 1 -- 172.21.15.49:0/916021793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa38406a560 con 0x7fa3840ccc00 2023-07-21T22:14:28.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.200+0000 7fa36bfff700 1 -- 172.21.15.49:0/916021793 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa378053a40 con 0x7fa3840ccc00 2023-07-21T22:14:28.245 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-07-21T22:14:28.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.204+0000 7fa388f5d700 1 -- 172.21.15.49:0/916021793 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3700662f0 msgr2=0x7fa3700687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.204+0000 7fa388f5d700 1 --2- 172.21.15.49:0/916021793 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3700662f0 0x7fa3700687a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa374000c00 tx=0x7fa37401b040 comp rx=0 tx=0).stop 2023-07-21T22:14:28.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.204+0000 7fa388f5d700 1 -- 172.21.15.49:0/916021793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3840ccc00 msgr2=0x7fa3840ad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.204+0000 7fa388f5d700 1 --2- 172.21.15.49:0/916021793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3840ccc00 0x7fa3840ad2a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa37800c500 tx=0x7fa37800c810 comp rx=0 tx=0).stop 2023-07-21T22:14:28.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.204+0000 7fa388f5d700 1 -- 172.21.15.49:0/916021793 shutdown_connections 2023-07-21T22:14:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.204+0000 7fa388f5d700 1 --2- 172.21.15.49:0/916021793 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa3700662f0 0x7fa3700687a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.204+0000 7fa388f5d700 1 --2- 172.21.15.49:0/916021793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3840ccc00 0x7fa3840ad2a0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.204+0000 7fa388f5d700 1 --2- 172.21.15.49:0/916021793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa38415bbd0 0x7fa38414c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.204+0000 7fa388f5d700 1 --2- 172.21.15.49:0/916021793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3840afbd0 0x7fa3840ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.204+0000 7fa388f5d700 1 -- 172.21.15.49:0/916021793 >> 172.21.15.49:0/916021793 conn(0x7fa3840ce0d0 msgr2=0x7fa38406d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:28.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.204+0000 7fa388f5d700 1 -- 172.21.15.49:0/916021793 shutdown_connections 2023-07-21T22:14:28.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.204+0000 7fa388f5d700 1 -- 172.21.15.49:0/916021793 wait complete. 2023-07-21T22:14:28.273 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:14:28.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.412+0000 7f6166e11700 1 Processor -- start 2023-07-21T22:14:28.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.412+0000 7f6166e11700 1 -- start start 2023-07-21T22:14:28.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.412+0000 7f6166e11700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61600b4040 0x7f61600cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.412+0000 7f6166e11700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f61600d0810 0x7f61600d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.412+0000 7f6166e11700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61600b8170 con 0x7f61600b4410 2023-07-21T22:14:28.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.412+0000 7f6166e11700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61600cfa20 con 0x7f61600d0810 2023-07-21T22:14:28.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.412+0000 7f6166e11700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61600d03c0 con 0x7f61600b4040 2023-07-21T22:14:28.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.412+0000 7f615ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f61600b4410 0x7f61600b4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40230/0 (socket says 172.21.15.49:40230) 2023-07-21T22:14:28.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.412+0000 7f615ffff700 1 -- 172.21.15.49:0/1898089246 learned_addr learned my addr 172.21.15.49:0/1898089246 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:28.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.412+0000 7f61653ae700 1 --2- 172.21.15.49:0/1898089246 >> v2:172.21.15.49:3300/0 conn(0x7f61600d0810 0x7f61600d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.412+0000 7f6164bad700 1 --2- 172.21.15.49:0/1898089246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61600b4040 0x7f61600cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.412+0000 7f615f7fe700 1 -- 172.21.15.49:0/1898089246 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064950042 0 0) 0x7f61600b8170 con 0x7f61600b4410 2023-07-21T22:14:28.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 -- 172.21.15.49:0/1898089246 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61500035d0 con 0x7f61600b4410 2023-07-21T22:14:28.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 -- 172.21.15.49:0/1898089246 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3007478524 0 0) 0x7f61500035d0 con 0x7f61600b4410 2023-07-21T22:14:28.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 -- 172.21.15.49:0/1898089246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61600b4040 msgr2=0x7f61600cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:28.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 --2- 172.21.15.49:0/1898089246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61600b4040 0x7f61600cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 -- 172.21.15.49:0/1898089246 >> v2:172.21.15.49:3300/0 conn(0x7f61600d0810 msgr2=0x7f61600d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:28.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 --2- 172.21.15.49:0/1898089246 >> v2:172.21.15.49:3300/0 conn(0x7f61600d0810 0x7f61600d0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 -- 172.21.15.49:0/1898089246 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61600d2350 con 0x7f61600b4410 2023-07-21T22:14:28.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 -- 172.21.15.49:0/1898089246 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f614c001670 con 0x7f61600b4410 2023-07-21T22:14:28.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f61653ae700 1 --2- 172.21.15.49:0/1898089246 >> v2:172.21.15.49:3300/0 conn(0x7f61600d0810 0x7f61600d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:28.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 -- 172.21.15.49:0/1898089246 >> v1:172.21.15.49:6789/0 conn(0x7f61600b4410 legacy=0x7f61600b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 --2- 172.21.15.49:0/1898089246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6150003a20 0x7f6150003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 --2- 172.21.15.49:0/1898089246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61600b4040 0x7f6150004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 --2- 172.21.15.49:0/1898089246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6150004db0 0x7f6150005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 -- 172.21.15.49:0/1898089246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61600d03c0 con 0x7f6150003a20 2023-07-21T22:14:28.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 -- 172.21.15.49:0/1898089246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615000ba30 con 0x7f6150004db0 2023-07-21T22:14:28.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 -- 172.21.15.49:0/1898089246 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615000bb70 con 0x7f61600b4040 2023-07-21T22:14:28.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f6164bad700 1 --2- 172.21.15.49:0/1898089246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6150003a20 0x7f6150003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615ffff700 1 --2- 172.21.15.49:0/1898089246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61600b4040 0x7f6150004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f61653ae700 1 --2- 172.21.15.49:0/1898089246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6150004db0 0x7f6150005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f6164bad700 1 -- 172.21.15.49:0/1898089246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61600b4040 msgr2=0x7f6150004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:28.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f6164bad700 1 --2- 172.21.15.49:0/1898089246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61600b4040 0x7f6150004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f6164bad700 1 -- 172.21.15.49:0/1898089246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6150004db0 msgr2=0x7f6150005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f6164bad700 1 --2- 172.21.15.49:0/1898089246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6150004db0 0x7f6150005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f6164bad700 1 -- 172.21.15.49:0/1898089246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61500035d0 con 0x7f6150003a20 2023-07-21T22:14:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f61653ae700 1 --2- 172.21.15.49:0/1898089246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6150004db0 0x7f6150005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f6164bad700 1 --2- 172.21.15.49:0/1898089246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6150003a20 0x7f6150003e30 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6154009fc0 tx=0x7f61500058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694529a2524da30d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 -- 172.21.15.49:0/1898089246 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400ec30 con 0x7f6150003a20 2023-07-21T22:14:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 -- 172.21.15.49:0/1898089246 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615400f040 con 0x7f6150003a20 2023-07-21T22:14:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.416+0000 7f615f7fe700 1 -- 172.21.15.49:0/1898089246 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154014480 con 0x7f6150003a20 2023-07-21T22:14:28.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.420+0000 7f6166e11700 1 -- 172.21.15.49:0/1898089246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6150003a20 msgr2=0x7f6150003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.420+0000 7f6166e11700 1 --2- 172.21.15.49:0/1898089246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6150003a20 0x7f6150003e30 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6154009fc0 tx=0x7f61500058a0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.420+0000 7f61653ae700 1 -- 172.21.15.49:0/1898089246 reap_dead start 2023-07-21T22:14:28.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.420+0000 7f6166e11700 1 -- 172.21.15.49:0/1898089246 shutdown_connections 2023-07-21T22:14:28.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.420+0000 7f6166e11700 1 -- 172.21.15.49:0/1898089246 >> 172.21.15.49:0/1898089246 conn(0x7f61600658e0 msgr2=0x7f616006fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:28.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.420+0000 7f6166e11700 1 -- 172.21.15.49:0/1898089246 shutdown_connections 2023-07-21T22:14:28.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.420+0000 7f6166e11700 1 -- 172.21.15.49:0/1898089246 wait complete. 2023-07-21T22:14:28.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.420+0000 7f6166e11700 1 Processor -- start 2023-07-21T22:14:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.420+0000 7f6166e11700 1 -- start start 2023-07-21T22:14:28.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f6166e11700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6150003a20 0x7f616015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f6166e11700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61600c9690 0x7f616014a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f6166e11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61600cc550 0x7f61600b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f6166e11700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616015eff0 con 0x7f61600cc550 2023-07-21T22:14:28.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f6166e11700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616015e370 con 0x7f6150003a20 2023-07-21T22:14:28.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f6166e11700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616015e650 con 0x7f61600c9690 2023-07-21T22:14:28.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f61653ae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61600cc550 0x7f61600b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f6164bad700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6150003a20 0x7f616015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f61653ae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61600cc550 0x7f61600b5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55126/0 (socket says 172.21.15.49:55126) 2023-07-21T22:14:28.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f61653ae700 1 -- 172.21.15.49:0/3747629021 learned_addr learned my addr 172.21.15.49:0/3747629021 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:28.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f615ffff700 1 --2- 172.21.15.49:0/3747629021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61600c9690 0x7f616014a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f61653ae700 1 -- 172.21.15.49:0/3747629021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61600c9690 msgr2=0x7f616014a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f61653ae700 1 --2- 172.21.15.49:0/3747629021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61600c9690 0x7f616014a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f61653ae700 1 -- 172.21.15.49:0/3747629021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6150003a20 msgr2=0x7f616015dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f61653ae700 1 --2- 172.21.15.49:0/3747629021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6150003a20 0x7f616015dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f61653ae700 1 -- 172.21.15.49:0/3747629021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616015e930 con 0x7f61600cc550 2023-07-21T22:14:28.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f61653ae700 1 --2- 172.21.15.49:0/3747629021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61600cc550 0x7f61600b5d20 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f61600d0be0 tx=0x7f615800f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:28.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f615d7fa700 1 -- 172.21.15.49:0/3747629021 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800fda0 con 0x7f61600cc550 2023-07-21T22:14:28.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f615d7fa700 1 -- 172.21.15.49:0/3747629021 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615800c070 con 0x7f61600cc550 2023-07-21T22:14:28.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f6166e11700 1 -- 172.21.15.49:0/3747629021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616015ec10 con 0x7f61600cc550 2023-07-21T22:14:28.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f615d7fa700 1 -- 172.21.15.49:0/3747629021 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158004270 con 0x7f61600cc550 2023-07-21T22:14:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.424+0000 7f6166e11700 1 -- 172.21.15.49:0/3747629021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61600cc9d0 con 0x7f61600cc550 2023-07-21T22:14:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.428+0000 7f6166e11700 1 -- 172.21.15.49:0/3747629021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616015f130 con 0x7f61600cc550 2023-07-21T22:14:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.428+0000 7f615d7fa700 1 -- 172.21.15.49:0/3747629021 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f61580043d0 con 0x7f61600cc550 2023-07-21T22:14:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.432+0000 7f615d7fa700 1 --2- 172.21.15.49:0/3747629021 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f61440662f0 0x7f61440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.432+0000 7f615d7fa700 1 -- 172.21.15.49:0/3747629021 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f61580839a0 con 0x7f61600cc550 2023-07-21T22:14:28.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.432+0000 7f6164bad700 1 --2- 172.21.15.49:0/3747629021 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f61440662f0 0x7f61440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.432+0000 7f6164bad700 1 --2- 172.21.15.49:0/3747629021 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f61440662f0 0x7f61440687a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6154000f80 tx=0x7f6154013000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:28.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.436+0000 7f615d7fa700 1 -- 172.21.15.49:0/3747629021 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f616015f130 con 0x7f61600cc550 2023-07-21T22:14:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.616+0000 7f6166e11700 1 -- 172.21.15.49:0/3747629021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f616015f130 con 0x7f61600cc550 2023-07-21T22:14:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.616+0000 7f615d7fa700 1 -- 172.21.15.49:0/3747629021 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7f616015f130 con 0x7f61600cc550 2023-07-21T22:14:28.661 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-07-21T22:14:28.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.620+0000 7f6166e11700 1 -- 172.21.15.49:0/3747629021 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f61440662f0 msgr2=0x7f61440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.620+0000 7f6166e11700 1 --2- 172.21.15.49:0/3747629021 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f61440662f0 0x7f61440687a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6154000f80 tx=0x7f6154013000 comp rx=0 tx=0).stop 2023-07-21T22:14:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.620+0000 7f6166e11700 1 -- 172.21.15.49:0/3747629021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61600cc550 msgr2=0x7f61600b5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.620+0000 7f6166e11700 1 --2- 172.21.15.49:0/3747629021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61600cc550 0x7f61600b5d20 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f61600d0be0 tx=0x7f615800f6f0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.620+0000 7f6166e11700 1 -- 172.21.15.49:0/3747629021 shutdown_connections 2023-07-21T22:14:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.620+0000 7f6166e11700 1 --2- 172.21.15.49:0/3747629021 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f61440662f0 0x7f61440687a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.620+0000 7f6166e11700 1 --2- 172.21.15.49:0/3747629021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61600cc550 0x7f61600b5d20 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.620+0000 7f6166e11700 1 --2- 172.21.15.49:0/3747629021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61600c9690 0x7f616014a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.620+0000 7f6166e11700 1 --2- 172.21.15.49:0/3747629021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6150003a20 0x7f616015dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.620+0000 7f6166e11700 1 -- 172.21.15.49:0/3747629021 >> 172.21.15.49:0/3747629021 conn(0x7f61600658e0 msgr2=0x7f616015b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:28.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.620+0000 7f6166e11700 1 -- 172.21.15.49:0/3747629021 shutdown_connections 2023-07-21T22:14:28.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.620+0000 7f6166e11700 1 -- 172.21.15.49:0/3747629021 wait complete. 2023-07-21T22:14:28.688 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:14:28.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.824+0000 7fc3a722f700 1 Processor -- start 2023-07-21T22:14:28.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.824+0000 7fc3a722f700 1 -- start start 2023-07-21T22:14:28.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.824+0000 7fc3a722f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc3a00698a0 0x7fc3a0069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.824+0000 7fc3a722f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3a00aba80 0x7fc3a00abf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.824+0000 7fc3a722f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a006a230 con 0x7fc3a00c9b80 2023-07-21T22:14:28.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.824+0000 7fc3a722f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a0160710 con 0x7fc3a00698a0 2023-07-21T22:14:28.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.824+0000 7fc3a722f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a015f880 con 0x7fc3a00aba80 2023-07-21T22:14:28.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.824+0000 7fc3a622d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc3a00c9b80 0x7fc3a00ad3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40232/0 (socket says 172.21.15.49:40232) 2023-07-21T22:14:28.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.824+0000 7fc3a622d700 1 -- 172.21.15.49:0/837722176 learned_addr learned my addr 172.21.15.49:0/837722176 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:28.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.824+0000 7fc3a5a2c700 1 --2- 172.21.15.49:0/837722176 >> v2:172.21.15.49:3300/0 conn(0x7fc3a00698a0 0x7fc3a0069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.824+0000 7fc3a6a2e700 1 --2- 172.21.15.49:0/837722176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3a00aba80 0x7fc3a00abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a522b700 1 -- 172.21.15.49:0/837722176 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100441718 0 0) 0x7fc390001110 con 0x7fc3a00c9b80 2023-07-21T22:14:28.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a522b700 1 -- 172.21.15.49:0/837722176 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3880035d0 con 0x7fc3a00c9b80 2023-07-21T22:14:28.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a5a2c700 1 -- 172.21.15.49:0/837722176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3a00aba80 msgr2=0x7fc3a00abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:28.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a5a2c700 1 --2- 172.21.15.49:0/837722176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3a00aba80 0x7fc3a00abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a5a2c700 1 -- 172.21.15.49:0/837722176 >> v1:172.21.15.49:6789/0 conn(0x7fc3a00c9b80 legacy=0x7fc3a00ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a5a2c700 1 -- 172.21.15.49:0/837722176 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a015fa90 con 0x7fc3a00698a0 2023-07-21T22:14:28.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a6a2e700 1 --2- 172.21.15.49:0/837722176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3a00aba80 0x7fc3a00abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:14:28.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a5a2c700 1 --2- 172.21.15.49:0/837722176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a00698a0 0x7fc3a0069cf0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc394009850 tx=0x7fc394009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb4bc4afe9c4088 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:28.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a522b700 1 -- 172.21.15.49:0/837722176 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394011830 con 0x7fc3a00698a0 2023-07-21T22:14:28.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a522b700 1 -- 172.21.15.49:0/837722176 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc394011990 con 0x7fc3a00698a0 2023-07-21T22:14:28.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a522b700 1 -- 172.21.15.49:0/837722176 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394011d40 con 0x7fc3a00698a0 2023-07-21T22:14:28.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a722f700 1 -- 172.21.15.49:0/837722176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a00698a0 msgr2=0x7fc3a0069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a722f700 1 --2- 172.21.15.49:0/837722176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a00698a0 0x7fc3a0069cf0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc394009850 tx=0x7fc394009b60 comp rx=0 tx=0).stop 2023-07-21T22:14:28.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a722f700 1 -- 172.21.15.49:0/837722176 shutdown_connections 2023-07-21T22:14:28.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a722f700 1 --2- 172.21.15.49:0/837722176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3a00aba80 0x7fc3a00abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a722f700 1 --2- 172.21.15.49:0/837722176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a00698a0 0x7fc3a0069cf0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a722f700 1 -- 172.21.15.49:0/837722176 >> 172.21.15.49:0/837722176 conn(0x7fc3a00ce0d0 msgr2=0x7fc3a00ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:28.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a722f700 1 -- 172.21.15.49:0/837722176 shutdown_connections 2023-07-21T22:14:28.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.828+0000 7fc3a722f700 1 -- 172.21.15.49:0/837722176 wait complete. 2023-07-21T22:14:28.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a722f700 1 Processor -- start 2023-07-21T22:14:28.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a722f700 1 -- start start 2023-07-21T22:14:28.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a722f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3a00698a0 0x7fc3a015c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a722f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a00aba80 0x7fc3a0153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a722f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3a00c9b80 0x7fc3a00ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a722f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a015d1d0 con 0x7fc3a00aba80 2023-07-21T22:14:28.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a722f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a00adbb0 con 0x7fc3a00698a0 2023-07-21T22:14:28.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a722f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a015c930 con 0x7fc3a00c9b80 2023-07-21T22:14:28.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a5a2c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a00aba80 0x7fc3a0153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a5a2c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a00aba80 0x7fc3a0153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55142/0 (socket says 172.21.15.49:55142) 2023-07-21T22:14:28.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a5a2c700 1 -- 172.21.15.49:0/1919128336 learned_addr learned my addr 172.21.15.49:0/1919128336 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:28.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a622d700 1 --2- 172.21.15.49:0/1919128336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3a00698a0 0x7fc3a015c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a5a2c700 1 -- 172.21.15.49:0/1919128336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3a00c9b80 msgr2=0x7fc3a00ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a5a2c700 1 --2- 172.21.15.49:0/1919128336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3a00c9b80 0x7fc3a00ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a5a2c700 1 -- 172.21.15.49:0/1919128336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3a00698a0 msgr2=0x7fc3a015c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:28.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a5a2c700 1 --2- 172.21.15.49:0/1919128336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3a00698a0 0x7fc3a015c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:28.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.832+0000 7fc3a5a2c700 1 -- 172.21.15.49:0/1919128336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc398009a70 con 0x7fc3a00aba80 2023-07-21T22:14:28.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.836+0000 7fc3a5a2c700 1 --2- 172.21.15.49:0/1919128336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a00aba80 0x7fc3a0153850 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc394014040 tx=0x7fc394004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:28.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.836+0000 7fc39effd700 1 -- 172.21.15.49:0/1919128336 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394004610 con 0x7fc3a00aba80 2023-07-21T22:14:28.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.836+0000 7fc39effd700 1 -- 172.21.15.49:0/1919128336 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39401e070 con 0x7fc3a00aba80 2023-07-21T22:14:28.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.836+0000 7fc3a722f700 1 -- 172.21.15.49:0/1919128336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3940094b0 con 0x7fc3a00aba80 2023-07-21T22:14:28.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.836+0000 7fc39effd700 1 -- 172.21.15.49:0/1919128336 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3940038e0 con 0x7fc3a00aba80 2023-07-21T22:14:28.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.836+0000 7fc3a722f700 1 -- 172.21.15.49:0/1919128336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a015cef0 con 0x7fc3a00aba80 2023-07-21T22:14:28.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.836+0000 7fc3a722f700 1 -- 172.21.15.49:0/1919128336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a004dcb0 con 0x7fc3a00aba80 2023-07-21T22:14:28.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.836+0000 7fc39effd700 1 -- 172.21.15.49:0/1919128336 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc394003a40 con 0x7fc3a00aba80 2023-07-21T22:14:28.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.840+0000 7fc39effd700 1 --2- 172.21.15.49:0/1919128336 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc38c0662f0 0x7fc38c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:28.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.840+0000 7fc39effd700 1 -- 172.21.15.49:0/1919128336 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fc394020070 con 0x7fc3a00aba80 2023-07-21T22:14:28.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.840+0000 7fc3a622d700 1 --2- 172.21.15.49:0/1919128336 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc38c0662f0 0x7fc38c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:28.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.840+0000 7fc3a622d700 1 --2- 172.21.15.49:0/1919128336 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc38c0662f0 0x7fc38c0687a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc390001370 tx=0x7fc390009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:28.848+0000 7fc39effd700 1 -- 172.21.15.49:0/1919128336 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc394056140 con 0x7fc3a00aba80 2023-07-21T22:14:29.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.020+0000 7fc3a722f700 1 -- 172.21.15.49:0/1919128336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3a00ca8c0 con 0x7fc3a00aba80 2023-07-21T22:14:29.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.020+0000 7fc39effd700 1 -- 172.21.15.49:0/1919128336 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc394006ce0 con 0x7fc3a00aba80 2023-07-21T22:14:29.066 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-07-21T22:14:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.024+0000 7fc3a722f700 1 -- 172.21.15.49:0/1919128336 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc38c0662f0 msgr2=0x7fc38c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.024+0000 7fc3a722f700 1 --2- 172.21.15.49:0/1919128336 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc38c0662f0 0x7fc38c0687a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc390001370 tx=0x7fc390009040 comp rx=0 tx=0).stop 2023-07-21T22:14:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.024+0000 7fc3a722f700 1 -- 172.21.15.49:0/1919128336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a00aba80 msgr2=0x7fc3a0153850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.024+0000 7fc3a722f700 1 --2- 172.21.15.49:0/1919128336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a00aba80 0x7fc3a0153850 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc394014040 tx=0x7fc394004770 comp rx=0 tx=0).stop 2023-07-21T22:14:29.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.024+0000 7fc3a722f700 1 -- 172.21.15.49:0/1919128336 shutdown_connections 2023-07-21T22:14:29.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.024+0000 7fc3a722f700 1 --2- 172.21.15.49:0/1919128336 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc38c0662f0 0x7fc38c0687a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.024+0000 7fc3a722f700 1 --2- 172.21.15.49:0/1919128336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a00aba80 0x7fc3a0153850 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.024+0000 7fc3a722f700 1 --2- 172.21.15.49:0/1919128336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3a00c9b80 0x7fc3a00ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.024+0000 7fc3a722f700 1 --2- 172.21.15.49:0/1919128336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3a00698a0 0x7fc3a015c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.024+0000 7fc3a722f700 1 -- 172.21.15.49:0/1919128336 >> 172.21.15.49:0/1919128336 conn(0x7fc3a00ce0d0 msgr2=0x7fc3a00cb230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:29.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.024+0000 7fc3a722f700 1 -- 172.21.15.49:0/1919128336 shutdown_connections 2023-07-21T22:14:29.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.024+0000 7fc3a722f700 1 -- 172.21.15.49:0/1919128336 wait complete. 2023-07-21T22:14:29.090 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:14:29.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.232+0000 7f3fdaa6d700 1 Processor -- start 2023-07-21T22:14:29.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.232+0000 7f3fdaa6d700 1 -- start start 2023-07-21T22:14:29.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.232+0000 7f3fdaa6d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3fd4158050 0x7f3fd40adc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:29.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.232+0000 7f3fdaa6d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fd40b05c0 0x7f3fd40b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:29.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.232+0000 7f3fdaa6d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3fd4070800 0x7f3fd4070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:29.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.232+0000 7f3fdaa6d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd40b0f50 con 0x7f3fd4158050 2023-07-21T22:14:29.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.232+0000 7f3fdaa6d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd415bbe0 con 0x7f3fd4070800 2023-07-21T22:14:29.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.232+0000 7f3fdaa6d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd415ca40 con 0x7f3fd40b05c0 2023-07-21T22:14:29.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.232+0000 7f3fd9a6b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3fd4158050 0x7f3fd40adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:29.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.232+0000 7f3fd9a6b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3fd4158050 0x7f3fd40adc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55156/0 (socket says 172.21.15.49:55156) 2023-07-21T22:14:29.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.232+0000 7f3fd9a6b700 1 -- 172.21.15.49:0/1998806929 learned_addr learned my addr 172.21.15.49:0/1998806929 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:29.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.232+0000 7f3fd926a700 1 --2- 172.21.15.49:0/1998806929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fd40b05c0 0x7f3fd40b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:29.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.232+0000 7f3fda26c700 1 --2- 172.21.15.49:0/1998806929 >> v2:172.21.15.150:3300/0 conn(0x7f3fd4070800 0x7f3fd4070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:29.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fd9a6b700 1 -- 172.21.15.49:0/1998806929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fd40b05c0 msgr2=0x7f3fd40b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:29.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fd9a6b700 1 --2- 172.21.15.49:0/1998806929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fd40b05c0 0x7f3fd40b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fd9a6b700 1 -- 172.21.15.49:0/1998806929 >> v2:172.21.15.150:3300/0 conn(0x7f3fd4070800 msgr2=0x7f3fd4070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:29.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fd9a6b700 1 --2- 172.21.15.49:0/1998806929 >> v2:172.21.15.150:3300/0 conn(0x7f3fd4070800 0x7f3fd4070c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fd9a6b700 1 -- 172.21.15.49:0/1998806929 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd415be30 con 0x7f3fd4158050 2023-07-21T22:14:29.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fd926a700 1 --2- 172.21.15.49:0/1998806929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fd40b05c0 0x7f3fd40b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:14:29.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fd9a6b700 1 --2- 172.21.15.49:0/1998806929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd4158050 0x7f3fd40adc70 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3fd406ce30 tx=0x7f3fd0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0d6ef3e5abad3b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:29.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fd8a69700 1 -- 172.21.15.49:0/1998806929 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0011830 con 0x7f3fd4158050 2023-07-21T22:14:29.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fd8a69700 1 -- 172.21.15.49:0/1998806929 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd0011990 con 0x7f3fd4158050 2023-07-21T22:14:29.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fd8a69700 1 -- 172.21.15.49:0/1998806929 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0011d20 con 0x7f3fd4158050 2023-07-21T22:14:29.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/1998806929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd4158050 msgr2=0x7f3fd40adc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:29.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fdaa6d700 1 --2- 172.21.15.49:0/1998806929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd4158050 0x7f3fd40adc70 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3fd406ce30 tx=0x7f3fd0009bf0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/1998806929 shutdown_connections 2023-07-21T22:14:29.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fdaa6d700 1 --2- 172.21.15.49:0/1998806929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fd40b05c0 0x7f3fd40b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fdaa6d700 1 --2- 172.21.15.49:0/1998806929 >> v2:172.21.15.150:3300/0 conn(0x7f3fd4070800 0x7f3fd4070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fdaa6d700 1 --2- 172.21.15.49:0/1998806929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd4158050 0x7f3fd40adc70 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/1998806929 >> 172.21.15.49:0/1998806929 conn(0x7f3fd40ce900 msgr2=0x7f3fd40cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:29.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/1998806929 shutdown_connections 2023-07-21T22:14:29.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.236+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/1998806929 wait complete. 2023-07-21T22:14:29.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.240+0000 7f3fdaa6d700 1 Processor -- start 2023-07-21T22:14:29.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.240+0000 7f3fdaa6d700 1 -- start start 2023-07-21T22:14:29.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fdaa6d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd4070800 0x7f3fd414ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:29.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fdaa6d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fd40b05c0 0x7f3fd414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:29.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fdaa6d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd4158050 0x7f3fd414a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:29.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fdaa6d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd4150b70 con 0x7f3fd4158050 2023-07-21T22:14:29.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fdaa6d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd4150dc0 con 0x7f3fd4070800 2023-07-21T22:14:29.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fdaa6d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd41510a0 con 0x7f3fd40b05c0 2023-07-21T22:14:29.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fda26c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd4158050 0x7f3fd414a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:29.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fda26c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd4158050 0x7f3fd414a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55170/0 (socket says 172.21.15.49:55170) 2023-07-21T22:14:29.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fda26c700 1 -- 172.21.15.49:0/2274352637 learned_addr learned my addr 172.21.15.49:0/2274352637 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:29.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fd9a6b700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd4070800 0x7f3fd414ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:29.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fd926a700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fd40b05c0 0x7f3fd414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:29.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fda26c700 1 -- 172.21.15.49:0/2274352637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fd40b05c0 msgr2=0x7f3fd414d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:29.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fda26c700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fd40b05c0 0x7f3fd414d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fda26c700 1 -- 172.21.15.49:0/2274352637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd4070800 msgr2=0x7f3fd414ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:29.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fda26c700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd4070800 0x7f3fd414ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fda26c700 1 -- 172.21.15.49:0/2274352637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc40094b0 con 0x7f3fd4158050 2023-07-21T22:14:29.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fd9a6b700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd4070800 0x7f3fd414ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:29.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fda26c700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd4158050 0x7f3fd414a910 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00efc0 tx=0x7f3fcc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:29.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fca7fc700 1 -- 172.21.15.49:0/2274352637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc009ea0 con 0x7f3fd4158050 2023-07-21T22:14:29.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fca7fc700 1 -- 172.21.15.49:0/2274352637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc00f040 con 0x7f3fd4158050 2023-07-21T22:14:29.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fca7fc700 1 -- 172.21.15.49:0/2274352637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc014480 con 0x7f3fd4158050 2023-07-21T22:14:29.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/2274352637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd0009570 con 0x7f3fd4158050 2023-07-21T22:14:29.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.244+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/2274352637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd4151660 con 0x7f3fd4158050 2023-07-21T22:14:29.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.248+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/2274352637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd4151880 con 0x7f3fd4158050 2023-07-21T22:14:29.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.248+0000 7f3fca7fc700 1 -- 172.21.15.49:0/2274352637 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3fcc0145e0 con 0x7f3fd4158050 2023-07-21T22:14:29.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.248+0000 7f3fca7fc700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fb80662f0 0x7f3fb80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:29.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.248+0000 7f3fca7fc700 1 -- 172.21.15.49:0/2274352637 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f3fcc084780 con 0x7f3fd4158050 2023-07-21T22:14:29.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.248+0000 7f3fd9a6b700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fb80662f0 0x7f3fb80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:29.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.252+0000 7f3fd9a6b700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fb80662f0 0x7f3fb80687a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0000c00 tx=0x7f3fd0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:29.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.256+0000 7f3fca7fc700 1 -- 172.21.15.49:0/2274352637 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3fcc051a20 con 0x7f3fd4158050 2023-07-21T22:14:29.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.464+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/2274352637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fd404dcb0 con 0x7f3fd4158050 2023-07-21T22:14:29.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.464+0000 7f3fca7fc700 1 -- 172.21.15.49:0/2274352637 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4678 (secure 0 0 0) 0x7f3fcc055040 con 0x7f3fd4158050 2023-07-21T22:14:29.511 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:29.512 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3145882220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3145882220},{"type":"v1","addr":"172.21.15.150:6834","nonce":3145882220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5657,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2809854510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2809854510},{"type":"v1","addr":"172.21.15.150:6835","nonce":2809854510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1044407594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1044407594},{"type":"v1","addr":"172.21.15.49:6837","nonce":1044407594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:13:40.538282+0000","modified":"2023-07-21T22:13:44.115111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6396":{"gid":6396,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6836/4142505890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4142505890},{"type":"v1","addr":"172.21.15.49:6836","nonce":4142505890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T22:14:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.468+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/2274352637 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fb80662f0 msgr2=0x7f3fb80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.468+0000 7f3fdaa6d700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fb80662f0 0x7f3fb80687a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0000c00 tx=0x7f3fd0008030 comp rx=0 tx=0).stop 2023-07-21T22:14:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.468+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/2274352637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd4158050 msgr2=0x7f3fd414a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.468+0000 7f3fdaa6d700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd4158050 0x7f3fd414a910 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00efc0 tx=0x7f3fcc00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.468+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/2274352637 shutdown_connections 2023-07-21T22:14:29.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.468+0000 7f3fdaa6d700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f3fb80662f0 0x7f3fb80687a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.468+0000 7f3fdaa6d700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd4158050 0x7f3fd414a910 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.468+0000 7f3fdaa6d700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fd40b05c0 0x7f3fd414d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.468+0000 7f3fdaa6d700 1 --2- 172.21.15.49:0/2274352637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd4070800 0x7f3fd414ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.468+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/2274352637 >> 172.21.15.49:0/2274352637 conn(0x7f3fd40ce900 msgr2=0x7f3fd4159760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:29.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.468+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/2274352637 shutdown_connections 2023-07-21T22:14:29.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.468+0000 7f3fdaa6d700 1 -- 172.21.15.49:0/2274352637 wait complete. 2023-07-21T22:14:29.516 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2023-07-21T22:14:29.533 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:14:29.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.664+0000 7fcd47b08700 1 Processor -- start 2023-07-21T22:14:29.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.664+0000 7fcd47b08700 1 -- start start 2023-07-21T22:14:29.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.664+0000 7fcd47b08700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd401604c0 0x7fcd400afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:29.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.664+0000 7fcd47b08700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd400c8860 0x7fcd40070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:29.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.664+0000 7fcd47b08700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd400b0530 con 0x7fcd400afc20 2023-07-21T22:14:29.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.664+0000 7fcd47b08700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd40163df0 con 0x7fcd401604c0 2023-07-21T22:14:29.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.664+0000 7fcd47b08700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd401640d0 con 0x7fcd400c8860 2023-07-21T22:14:29.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.664+0000 7fcd458a4700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcd400afc20 0x7fcd400cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40242/0 (socket says 172.21.15.49:40242) 2023-07-21T22:14:29.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.664+0000 7fcd458a4700 1 -- 172.21.15.49:0/587929982 learned_addr learned my addr 172.21.15.49:0/587929982 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:29.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.664+0000 7fcd450a3700 1 --2- 172.21.15.49:0/587929982 >> v2:172.21.15.49:3300/0 conn(0x7fcd401604c0 0x7fcd400afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:29.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.664+0000 7fcd460a5700 1 --2- 172.21.15.49:0/587929982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd400c8860 0x7fcd40070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:29.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.664+0000 7fcd448a2700 1 -- 172.21.15.49:0/587929982 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695335993 0 0) 0x7fcd400b0530 con 0x7fcd400afc20 2023-07-21T22:14:29.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.664+0000 7fcd448a2700 1 -- 172.21.15.49:0/587929982 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd2c0035d0 con 0x7fcd400afc20 2023-07-21T22:14:29.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd460a5700 1 -- 172.21.15.49:0/587929982 >> v2:172.21.15.49:3300/0 conn(0x7fcd401604c0 msgr2=0x7fcd400afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:29.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd460a5700 1 --2- 172.21.15.49:0/587929982 >> v2:172.21.15.49:3300/0 conn(0x7fcd401604c0 0x7fcd400afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd460a5700 1 -- 172.21.15.49:0/587929982 >> v1:172.21.15.49:6789/0 conn(0x7fcd400afc20 legacy=0x7fcd400cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd460a5700 1 -- 172.21.15.49:0/587929982 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd401643b0 con 0x7fcd400c8860 2023-07-21T22:14:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd450a3700 1 --2- 172.21.15.49:0/587929982 >> v2:172.21.15.49:3300/0 conn(0x7fcd401604c0 0x7fcd400afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:14:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd460a5700 1 --2- 172.21.15.49:0/587929982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd400c8860 0x7fcd40070600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009d90 tx=0x7fcd3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=341463727cc90f51 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:29.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd448a2700 1 -- 172.21.15.49:0/587929982 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800e070 con 0x7fcd400c8860 2023-07-21T22:14:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd448a2700 1 -- 172.21.15.49:0/587929982 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3800bb20 con 0x7fcd400c8860 2023-07-21T22:14:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd448a2700 1 -- 172.21.15.49:0/587929982 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38012430 con 0x7fcd400c8860 2023-07-21T22:14:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd47b08700 1 -- 172.21.15.49:0/587929982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd400c8860 msgr2=0x7fcd40070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd47b08700 1 --2- 172.21.15.49:0/587929982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd400c8860 0x7fcd40070600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009d90 tx=0x7fcd3800b330 comp rx=0 tx=0).stop 2023-07-21T22:14:29.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd47b08700 1 -- 172.21.15.49:0/587929982 shutdown_connections 2023-07-21T22:14:29.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd47b08700 1 --2- 172.21.15.49:0/587929982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd400c8860 0x7fcd40070600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd47b08700 1 --2- 172.21.15.49:0/587929982 >> v2:172.21.15.49:3300/0 conn(0x7fcd401604c0 0x7fcd400afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd47b08700 1 -- 172.21.15.49:0/587929982 >> 172.21.15.49:0/587929982 conn(0x7fcd4006f5a0 msgr2=0x7fcd400cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:29.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd47b08700 1 -- 172.21.15.49:0/587929982 shutdown_connections 2023-07-21T22:14:29.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.668+0000 7fcd47b08700 1 -- 172.21.15.49:0/587929982 wait complete. 2023-07-21T22:14:29.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.672+0000 7fcd47b08700 1 Processor -- start 2023-07-21T22:14:29.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.672+0000 7fcd47b08700 1 -- start start 2023-07-21T22:14:29.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd47b08700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd400afc20 0x7fcd400c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:29.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd47b08700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd400c8860 0x7fcd400b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:29.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd47b08700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd401604c0 0x7fcd400b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:29.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd47b08700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400c2f10 con 0x7fcd400c8860 2023-07-21T22:14:29.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd47b08700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd401f99e0 con 0x7fcd400afc20 2023-07-21T22:14:29.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd47b08700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400c2c30 con 0x7fcd401604c0 2023-07-21T22:14:29.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd450a3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd400c8860 0x7fcd400b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:29.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd450a3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd400c8860 0x7fcd400b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55188/0 (socket says 172.21.15.49:55188) 2023-07-21T22:14:29.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd450a3700 1 -- 172.21.15.49:0/3697161037 learned_addr learned my addr 172.21.15.49:0/3697161037 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:29.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd460a5700 1 --2- 172.21.15.49:0/3697161037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd401604c0 0x7fcd400b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:29.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd458a4700 1 --2- 172.21.15.49:0/3697161037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd400afc20 0x7fcd400c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:29.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd450a3700 1 -- 172.21.15.49:0/3697161037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd401604c0 msgr2=0x7fcd400b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:29.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd450a3700 1 --2- 172.21.15.49:0/3697161037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd401604c0 0x7fcd400b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd450a3700 1 -- 172.21.15.49:0/3697161037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd400afc20 msgr2=0x7fcd400c1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:29.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd450a3700 1 --2- 172.21.15.49:0/3697161037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd400afc20 0x7fcd400c1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd450a3700 1 -- 172.21.15.49:0/3697161037 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd300094b0 con 0x7fcd400c8860 2023-07-21T22:14:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd450a3700 1 --2- 172.21.15.49:0/3697161037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd400c8860 0x7fcd400b2b60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000ebe0 tx=0x7fcd3000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd367fc700 1 -- 172.21.15.49:0/3697161037 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000c850 con 0x7fcd400c8860 2023-07-21T22:14:29.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd367fc700 1 -- 172.21.15.49:0/3697161037 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3000c9b0 con 0x7fcd400c8860 2023-07-21T22:14:29.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd367fc700 1 -- 172.21.15.49:0/3697161037 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000cd40 con 0x7fcd400c8860 2023-07-21T22:14:29.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd47b08700 1 -- 172.21.15.49:0/3697161037 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd38009a70 con 0x7fcd400c8860 2023-07-21T22:14:29.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.676+0000 7fcd47b08700 1 -- 172.21.15.49:0/3697161037 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd401f9670 con 0x7fcd400c8860 2023-07-21T22:14:29.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.680+0000 7fcd47b08700 1 -- 172.21.15.49:0/3697161037 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd401f91f0 con 0x7fcd400c8860 2023-07-21T22:14:29.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.680+0000 7fcd367fc700 1 -- 172.21.15.49:0/3697161037 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcd30013470 con 0x7fcd400c8860 2023-07-21T22:14:29.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.684+0000 7fcd367fc700 1 --2- 172.21.15.49:0/3697161037 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd240662f0 0x7fcd240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:29.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.684+0000 7fcd367fc700 1 -- 172.21.15.49:0/3697161037 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fcd30083f40 con 0x7fcd400c8860 2023-07-21T22:14:29.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.684+0000 7fcd458a4700 1 --2- 172.21.15.49:0/3697161037 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd240662f0 0x7fcd240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:29.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.684+0000 7fcd458a4700 1 --2- 172.21.15.49:0/3697161037 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd240662f0 0x7fcd240687a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c007fd0 tx=0x7fcd3c007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.688+0000 7fcd367fc700 1 -- 172.21.15.49:0/3697161037 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd401f91f0 con 0x7fcd400c8860 2023-07-21T22:14:29.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.868+0000 7fcd47b08700 1 -- 172.21.15.49:0/3697161037 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd401f91f0 con 0x7fcd400c8860 2023-07-21T22:14:29.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.872+0000 7fcd367fc700 1 -- 172.21.15.49:0/3697161037 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+18703 (secure 0 0 0) 0x7fcd401f91f0 con 0x7fcd400c8860 2023-07-21T22:14:29.917 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:29.918 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:14:17.339840+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:13:38.569931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:13:39.558524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.15","mappings":[{"from":7,"to":2}]},{"pgid":"10.25","mappings":[{"from":4,"to":3}]},{"pgid":"10.2a","mappings":[{"from":7,"to":5}]},{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:14:29.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.872+0000 7fcd47b08700 1 -- 172.21.15.49:0/3697161037 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd240662f0 msgr2=0x7fcd240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.872+0000 7fcd47b08700 1 --2- 172.21.15.49:0/3697161037 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd240662f0 0x7fcd240687a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c007fd0 tx=0x7fcd3c007de0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.872+0000 7fcd47b08700 1 -- 172.21.15.49:0/3697161037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd400c8860 msgr2=0x7fcd400b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.872+0000 7fcd47b08700 1 --2- 172.21.15.49:0/3697161037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd400c8860 0x7fcd400b2b60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000ebe0 tx=0x7fcd3000eef0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.872+0000 7fcd47b08700 1 -- 172.21.15.49:0/3697161037 shutdown_connections 2023-07-21T22:14:29.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.872+0000 7fcd47b08700 1 --2- 172.21.15.49:0/3697161037 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcd240662f0 0x7fcd240687a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.872+0000 7fcd47b08700 1 --2- 172.21.15.49:0/3697161037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd400c8860 0x7fcd400b2b60 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.872+0000 7fcd47b08700 1 --2- 172.21.15.49:0/3697161037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd401604c0 0x7fcd400b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.872+0000 7fcd47b08700 1 --2- 172.21.15.49:0/3697161037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd400afc20 0x7fcd400c1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:29.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.872+0000 7fcd47b08700 1 -- 172.21.15.49:0/3697161037 >> 172.21.15.49:0/3697161037 conn(0x7fcd4006f5a0 msgr2=0x7fcd400adc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:29.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.876+0000 7fcd47b08700 1 -- 172.21.15.49:0/3697161037 shutdown_connections 2023-07-21T22:14:29.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:29.876+0000 7fcd47b08700 1 -- 172.21.15.49:0/3697161037 wait complete. 2023-07-21T22:14:29.943 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:14:29.943 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:14:30.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.080+0000 7f7064586700 1 Processor -- start 2023-07-21T22:14:30.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.080+0000 7f7064586700 1 -- start start 2023-07-21T22:14:30.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.084+0000 7f7064586700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f705c070600 0x7f705c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.084+0000 7f7064586700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c0cb5d0 0x7f705c159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.084+0000 7f7064586700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705c0cba20 con 0x7f705c0709d0 2023-07-21T22:14:30.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.084+0000 7f7064586700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c15a170 con 0x7f705c070600 2023-07-21T22:14:30.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.084+0000 7f7064586700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c06c780 con 0x7f705c0cb5d0 2023-07-21T22:14:30.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.084+0000 7f7062322700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f705c070600 0x7f705c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.084+0000 7f7061b21700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c0cb5d0 0x7f705c159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.084+0000 7f7062322700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f705c070600 0x7f705c06d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:50098/0 (socket says 172.21.15.49:50098) 2023-07-21T22:14:30.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.084+0000 7f7062322700 1 -- 172.21.15.49:0/3048891368 learned_addr learned my addr 172.21.15.49:0/3048891368 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:30.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7062322700 1 -- 172.21.15.49:0/3048891368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c0cb5d0 msgr2=0x7f705c159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:30.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7062322700 1 --2- 172.21.15.49:0/3048891368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c0cb5d0 0x7f705c159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7062322700 1 -- 172.21.15.49:0/3048891368 >> v1:172.21.15.150:6789/0 conn(0x7f705c0709d0 legacy=0x7f705c0c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7062322700 1 -- 172.21.15.49:0/3048891368 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c06ca60 con 0x7f705c070600 2023-07-21T22:14:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7062322700 1 --2- 172.21.15.49:0/3048891368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c070600 0x7f705c06d540 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7058009910 tx=0x7f7058009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75c03a0d6747716e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7061320700 1 -- 172.21.15.49:0/3048891368 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7058011830 con 0x7f705c070600 2023-07-21T22:14:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7061320700 1 -- 172.21.15.49:0/3048891368 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7058011990 con 0x7f705c070600 2023-07-21T22:14:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7061320700 1 -- 172.21.15.49:0/3048891368 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7058011d40 con 0x7f705c070600 2023-07-21T22:14:30.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7064586700 1 -- 172.21.15.49:0/3048891368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c070600 msgr2=0x7f705c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7064586700 1 --2- 172.21.15.49:0/3048891368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c070600 0x7f705c06d540 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7058009910 tx=0x7f7058009c20 comp rx=0 tx=0).stop 2023-07-21T22:14:30.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7064586700 1 -- 172.21.15.49:0/3048891368 shutdown_connections 2023-07-21T22:14:30.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7064586700 1 --2- 172.21.15.49:0/3048891368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c0cb5d0 0x7f705c159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7064586700 1 --2- 172.21.15.49:0/3048891368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c070600 0x7f705c06d540 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7064586700 1 -- 172.21.15.49:0/3048891368 >> 172.21.15.49:0/3048891368 conn(0x7f705c06f5a0 msgr2=0x7f705c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:30.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7064586700 1 -- 172.21.15.49:0/3048891368 shutdown_connections 2023-07-21T22:14:30.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.088+0000 7f7064586700 1 -- 172.21.15.49:0/3048891368 wait complete. 2023-07-21T22:14:30.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7064586700 1 Processor -- start 2023-07-21T22:14:30.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7064586700 1 -- start start 2023-07-21T22:14:30.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7064586700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c070600 0x7f705c14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7064586700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c0709d0 0x7f705c0ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7064586700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f705c0cb5d0 0x7f705c0aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7064586700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c15a2e0 con 0x7f705c0cb5d0 2023-07-21T22:14:30.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7064586700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0c2aa0 con 0x7f705c0709d0 2023-07-21T22:14:30.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7064586700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0ae450 con 0x7f705c070600 2023-07-21T22:14:30.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7061b21700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c0709d0 0x7f705c0ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7062322700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c070600 0x7f705c14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7061b21700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c0709d0 0x7f705c0ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:50112/0 (socket says 172.21.15.49:50112) 2023-07-21T22:14:30.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7061b21700 1 -- 172.21.15.49:0/3089648689 learned_addr learned my addr 172.21.15.49:0/3089648689 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:30.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7062b23700 1 --2- 172.21.15.49:0/3089648689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f705c0cb5d0 0x7f705c0aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7061b21700 1 -- 172.21.15.49:0/3089648689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c070600 msgr2=0x7f705c14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7061b21700 1 --2- 172.21.15.49:0/3089648689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c070600 0x7f705c14fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7061b21700 1 -- 172.21.15.49:0/3089648689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f705c0cb5d0 msgr2=0x7f705c0aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7061b21700 1 --2- 172.21.15.49:0/3089648689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f705c0cb5d0 0x7f705c0aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.092+0000 7f7061b21700 1 -- 172.21.15.49:0/3089648689 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7058009570 con 0x7f705c0709d0 2023-07-21T22:14:30.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.096+0000 7f7061b21700 1 --2- 172.21.15.49:0/3089648689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c0709d0 0x7f705c0ada00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f704c00e840 tx=0x7f704c00eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:30.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.096+0000 7f7052ffd700 1 -- 172.21.15.49:0/3089648689 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c0095a0 con 0x7f705c0709d0 2023-07-21T22:14:30.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.096+0000 7f7052ffd700 1 -- 172.21.15.49:0/3089648689 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c013680 con 0x7f705c0709d0 2023-07-21T22:14:30.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.096+0000 7f7052ffd700 1 -- 172.21.15.49:0/3089648689 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c0139f0 con 0x7f705c0709d0 2023-07-21T22:14:30.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.096+0000 7f7064586700 1 -- 172.21.15.49:0/3089648689 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705c0ae730 con 0x7f705c0709d0 2023-07-21T22:14:30.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.096+0000 7f7064586700 1 -- 172.21.15.49:0/3089648689 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c0c3000 con 0x7f705c0709d0 2023-07-21T22:14:30.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.096+0000 7f7064586700 1 -- 172.21.15.49:0/3089648689 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705c0ae950 con 0x7f705c0709d0 2023-07-21T22:14:30.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.100+0000 7f7052ffd700 1 -- 172.21.15.49:0/3089648689 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f704c03b080 con 0x7f705c0709d0 2023-07-21T22:14:30.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.100+0000 7f7052ffd700 1 --2- 172.21.15.49:0/3089648689 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f70400662f0 0x7f70400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.100+0000 7f7052ffd700 1 -- 172.21.15.49:0/3089648689 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f704c083f60 con 0x7f705c0709d0 2023-07-21T22:14:30.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.100+0000 7f7062322700 1 --2- 172.21.15.49:0/3089648689 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f70400662f0 0x7f70400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.100+0000 7f7062322700 1 --2- 172.21.15.49:0/3089648689 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f70400662f0 0x7f70400687a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7058000c00 tx=0x7f7058008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:30.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.104+0000 7f7052ffd700 1 -- 172.21.15.49:0/3089648689 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f704c054d10 con 0x7f705c0709d0 2023-07-21T22:14:30.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.312+0000 7f7064586700 1 -- 172.21.15.49:0/3089648689 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f705c1592d0 con 0x7f705c0709d0 2023-07-21T22:14:30.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.316+0000 7f7052ffd700 1 -- 172.21.15.49:0/3089648689 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4678 (secure 0 0 0) 0x7f704c017090 con 0x7f705c0709d0 2023-07-21T22:14:30.360 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:30.360 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3145882220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3145882220},{"type":"v1","addr":"172.21.15.150:6834","nonce":3145882220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5657,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2809854510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2809854510},{"type":"v1","addr":"172.21.15.150:6835","nonce":2809854510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1044407594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1044407594},{"type":"v1","addr":"172.21.15.49:6837","nonce":1044407594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:13:40.538282+0000","modified":"2023-07-21T22:13:44.115111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6396":{"gid":6396,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6836/4142505890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4142505890},{"type":"v1","addr":"172.21.15.49:6836","nonce":4142505890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T22:14:30.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.320+0000 7f7064586700 1 -- 172.21.15.49:0/3089648689 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f70400662f0 msgr2=0x7f70400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.320+0000 7f7064586700 1 --2- 172.21.15.49:0/3089648689 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f70400662f0 0x7f70400687a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7058000c00 tx=0x7f7058008030 comp rx=0 tx=0).stop 2023-07-21T22:14:30.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.320+0000 7f7064586700 1 -- 172.21.15.49:0/3089648689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c0709d0 msgr2=0x7f705c0ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.320+0000 7f7064586700 1 --2- 172.21.15.49:0/3089648689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c0709d0 0x7f705c0ada00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f704c00e840 tx=0x7f704c00eb50 comp rx=0 tx=0).stop 2023-07-21T22:14:30.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.320+0000 7f7064586700 1 -- 172.21.15.49:0/3089648689 shutdown_connections 2023-07-21T22:14:30.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.320+0000 7f7064586700 1 --2- 172.21.15.49:0/3089648689 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f70400662f0 0x7f70400687a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.320+0000 7f7064586700 1 --2- 172.21.15.49:0/3089648689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f705c0cb5d0 0x7f705c0aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.320+0000 7f7064586700 1 --2- 172.21.15.49:0/3089648689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c0709d0 0x7f705c0ada00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.320+0000 7f7064586700 1 --2- 172.21.15.49:0/3089648689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c070600 0x7f705c14fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.320+0000 7f7064586700 1 -- 172.21.15.49:0/3089648689 >> 172.21.15.49:0/3089648689 conn(0x7f705c06f5a0 msgr2=0x7f705c0b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:30.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.320+0000 7f7064586700 1 -- 172.21.15.49:0/3089648689 shutdown_connections 2023-07-21T22:14:30.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.320+0000 7f7064586700 1 -- 172.21.15.49:0/3089648689 wait complete. 2023-07-21T22:14:30.367 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2023-07-21T22:14:30.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:14:30.430 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:14:30.441 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:14:30.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.528+0000 7f7b695bf700 1 Processor -- start 2023-07-21T22:14:30.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.528+0000 7f7b695bf700 1 -- start start 2023-07-21T22:14:30.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.528+0000 7f7b695bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b640cdd50 0x7f7b640ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.528+0000 7f7b695bf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b640d0b80 0x7f7b640cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.528+0000 7f7b695bf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b640b8680 con 0x7f7b640ce790 2023-07-21T22:14:30.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.528+0000 7f7b695bf700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b640d3500 con 0x7f7b640d0b80 2023-07-21T22:14:30.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.528+0000 7f7b695bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b640d2fa0 con 0x7f7b640cdd50 2023-07-21T22:14:30.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b637fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b640d0b80 0x7f7b640cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b637fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b640d0b80 0x7f7b640cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55204/0 (socket says 172.21.15.49:55204) 2023-07-21T22:14:30.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b637fe700 1 -- 172.21.15.49:0/1826406703 learned_addr learned my addr 172.21.15.49:0/1826406703 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:30.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b62ffd700 1 --2- 172.21.15.49:0/1826406703 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b640cdd50 0x7f7b640ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b637fe700 1 -- 172.21.15.49:0/1826406703 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b640cdd50 msgr2=0x7f7b640ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:30.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b637fe700 1 --2- 172.21.15.49:0/1826406703 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b640cdd50 0x7f7b640ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b637fe700 1 -- 172.21.15.49:0/1826406703 >> v1:172.21.15.150:6789/0 conn(0x7f7b640ce790 legacy=0x7f7b640d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b637fe700 1 -- 172.21.15.49:0/1826406703 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b640b6290 con 0x7f7b640d0b80 2023-07-21T22:14:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b637fe700 1 --2- 172.21.15.49:0/1826406703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b640d0b80 0x7f7b640cf330 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c009e50 tx=0x7f7b5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57994bacc40b4ad server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b61ffb700 1 -- 172.21.15.49:0/1826406703 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c00e070 con 0x7f7b640d0b80 2023-07-21T22:14:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b61ffb700 1 -- 172.21.15.49:0/1826406703 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c00b910 con 0x7f7b640d0b80 2023-07-21T22:14:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b61ffb700 1 -- 172.21.15.49:0/1826406703 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c00bcc0 con 0x7f7b640d0b80 2023-07-21T22:14:30.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b695bf700 1 -- 172.21.15.49:0/1826406703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b640d0b80 msgr2=0x7f7b640cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b695bf700 1 --2- 172.21.15.49:0/1826406703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b640d0b80 0x7f7b640cf330 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c009e50 tx=0x7f7b5c00b330 comp rx=0 tx=0).stop 2023-07-21T22:14:30.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b695bf700 1 -- 172.21.15.49:0/1826406703 shutdown_connections 2023-07-21T22:14:30.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b695bf700 1 --2- 172.21.15.49:0/1826406703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b640d0b80 0x7f7b640cf330 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b695bf700 1 --2- 172.21.15.49:0/1826406703 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b640cdd50 0x7f7b640ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.532+0000 7f7b695bf700 1 -- 172.21.15.49:0/1826406703 >> 172.21.15.49:0/1826406703 conn(0x7f7b640b55e0 msgr2=0x7f7b640b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:30.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.536+0000 7f7b695bf700 1 -- 172.21.15.49:0/1826406703 shutdown_connections 2023-07-21T22:14:30.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.536+0000 7f7b695bf700 1 -- 172.21.15.49:0/1826406703 wait complete. 2023-07-21T22:14:30.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b695bf700 1 Processor -- start 2023-07-21T22:14:30.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b695bf700 1 -- start start 2023-07-21T22:14:30.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b695bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b640cdd50 0x7f7b641f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b695bf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b640ce790 0x7f7b640cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b695bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b640d0b80 0x7f7b640ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b695bf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b641f7a20 con 0x7f7b640d0b80 2023-07-21T22:14:30.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b695bf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b641f6e80 con 0x7f7b640ce790 2023-07-21T22:14:30.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b695bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b640c9eb0 con 0x7f7b640cdd50 2023-07-21T22:14:30.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b637fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b640d0b80 0x7f7b640ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b637fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b640d0b80 0x7f7b640ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55206/0 (socket says 172.21.15.49:55206) 2023-07-21T22:14:30.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b637fe700 1 -- 172.21.15.49:0/2174686672 learned_addr learned my addr 172.21.15.49:0/2174686672 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:30.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b627fc700 1 --2- 172.21.15.49:0/2174686672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b640ce790 0x7f7b640cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b62ffd700 1 --2- 172.21.15.49:0/2174686672 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b640cdd50 0x7f7b641f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b637fe700 1 -- 172.21.15.49:0/2174686672 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b640cdd50 msgr2=0x7f7b641f6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b637fe700 1 --2- 172.21.15.49:0/2174686672 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b640cdd50 0x7f7b641f6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b637fe700 1 -- 172.21.15.49:0/2174686672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b640ce790 msgr2=0x7f7b640cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b637fe700 1 --2- 172.21.15.49:0/2174686672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b640ce790 0x7f7b640cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b637fe700 1 -- 172.21.15.49:0/2174686672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c009b30 con 0x7f7b640d0b80 2023-07-21T22:14:30.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.540+0000 7f7b637fe700 1 --2- 172.21.15.49:0/2174686672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b640d0b80 0x7f7b640ccb50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00b680 tx=0x7f7b5c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:30.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.544+0000 7f7b4b7fe700 1 -- 172.21.15.49:0/2174686672 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c0047b0 con 0x7f7b640d0b80 2023-07-21T22:14:30.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.544+0000 7f7b4b7fe700 1 -- 172.21.15.49:0/2174686672 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c004930 con 0x7f7b640d0b80 2023-07-21T22:14:30.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.544+0000 7f7b695bf700 1 -- 172.21.15.49:0/2174686672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b641f70f0 con 0x7f7b640d0b80 2023-07-21T22:14:30.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.544+0000 7f7b4b7fe700 1 -- 172.21.15.49:0/2174686672 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c01c680 con 0x7f7b640d0b80 2023-07-21T22:14:30.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.544+0000 7f7b695bf700 1 -- 172.21.15.49:0/2174686672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b641f76b0 con 0x7f7b640d0b80 2023-07-21T22:14:30.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.544+0000 7f7b695bf700 1 -- 172.21.15.49:0/2174686672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b641f7bd0 con 0x7f7b640d0b80 2023-07-21T22:14:30.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.548+0000 7f7b4b7fe700 1 -- 172.21.15.49:0/2174686672 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7b5c01c7e0 con 0x7f7b640d0b80 2023-07-21T22:14:30.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.548+0000 7f7b4b7fe700 1 --2- 172.21.15.49:0/2174686672 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7b50066320 0x7f7b500687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.548+0000 7f7b4b7fe700 1 -- 172.21.15.49:0/2174686672 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f7b5c085930 con 0x7f7b640d0b80 2023-07-21T22:14:30.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.548+0000 7f7b62ffd700 1 --2- 172.21.15.49:0/2174686672 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7b50066320 0x7f7b500687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.552+0000 7f7b62ffd700 1 --2- 172.21.15.49:0/2174686672 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7b50066320 0x7f7b500687d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009be0 tx=0x7f7b540091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:30.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.556+0000 7f7b4b7fe700 1 -- 172.21.15.49:0/2174686672 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7b641f7bd0 con 0x7f7b640d0b80 2023-07-21T22:14:30.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.764+0000 7f7b695bf700 1 -- 172.21.15.49:0/2174686672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b641f7bd0 con 0x7f7b640d0b80 2023-07-21T22:14:30.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.764+0000 7f7b4b7fe700 1 -- 172.21.15.49:0/2174686672 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4678 (secure 0 0 0) 0x7f7b641f7bd0 con 0x7f7b640d0b80 2023-07-21T22:14:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:30.809 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3145882220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3145882220},{"type":"v1","addr":"172.21.15.150:6834","nonce":3145882220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5657,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2809854510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2809854510},{"type":"v1","addr":"172.21.15.150:6835","nonce":2809854510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1044407594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1044407594},{"type":"v1","addr":"172.21.15.49:6837","nonce":1044407594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:13:40.538282+0000","modified":"2023-07-21T22:13:44.115111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6396":{"gid":6396,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6836/4142505890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4142505890},{"type":"v1","addr":"172.21.15.49:6836","nonce":4142505890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T22:14:30.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.764+0000 7f7b695bf700 1 -- 172.21.15.49:0/2174686672 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7b50066320 msgr2=0x7f7b500687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.764+0000 7f7b695bf700 1 --2- 172.21.15.49:0/2174686672 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7b50066320 0x7f7b500687d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009be0 tx=0x7f7b540091c0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.764+0000 7f7b695bf700 1 -- 172.21.15.49:0/2174686672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b640d0b80 msgr2=0x7f7b640ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.764+0000 7f7b695bf700 1 --2- 172.21.15.49:0/2174686672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b640d0b80 0x7f7b640ccb50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00b680 tx=0x7f7b5c004af0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.768+0000 7f7b695bf700 1 -- 172.21.15.49:0/2174686672 shutdown_connections 2023-07-21T22:14:30.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.768+0000 7f7b695bf700 1 --2- 172.21.15.49:0/2174686672 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f7b50066320 0x7f7b500687d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.768+0000 7f7b695bf700 1 --2- 172.21.15.49:0/2174686672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b640d0b80 0x7f7b640ccb50 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.768+0000 7f7b695bf700 1 --2- 172.21.15.49:0/2174686672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b640ce790 0x7f7b640cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.768+0000 7f7b695bf700 1 --2- 172.21.15.49:0/2174686672 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b640cdd50 0x7f7b641f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.768+0000 7f7b695bf700 1 -- 172.21.15.49:0/2174686672 >> 172.21.15.49:0/2174686672 conn(0x7f7b640b55e0 msgr2=0x7f7b640c8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:30.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.768+0000 7f7b695bf700 1 -- 172.21.15.49:0/2174686672 shutdown_connections 2023-07-21T22:14:30.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.768+0000 7f7b695bf700 1 -- 172.21.15.49:0/2174686672 wait complete. 2023-07-21T22:14:30.814 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2023-07-21T22:14:30.833 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:14:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.968+0000 7fbfa9b7c700 1 Processor -- start 2023-07-21T22:14:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.968+0000 7fbfa9b7c700 1 -- start start 2023-07-21T22:14:31.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.968+0000 7fbfa9b7c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfa40c1470 0x7fbfa40c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbfa9b7c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbfa40ca2c0 0x7fbfa4163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbfa9b7c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa406e010 con 0x7fbfa4160370 2023-07-21T22:14:31.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbfa9b7c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa4160740 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbfa9b7c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40ccc50 con 0x7fbfa40c1470 2023-07-21T22:14:31.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbfa8b7a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbfa4160370 0x7fbfa406d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40252/0 (socket says 172.21.15.49:40252) 2023-07-21T22:14:31.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbfa8b7a700 1 -- 172.21.15.49:0/2284178647 learned_addr learned my addr 172.21.15.49:0/2284178647 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:31.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbfa937b700 1 --2- 172.21.15.49:0/2284178647 >> v2:172.21.15.150:3300/0 conn(0x7fbfa40ca2c0 0x7fbfa4163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbf9bfff700 1 --2- 172.21.15.49:0/2284178647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfa40c1470 0x7fbfa40c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbf9b7fe700 1 -- 172.21.15.49:0/2284178647 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184561349 0 0) 0x7fbfa406e010 con 0x7fbfa4160370 2023-07-21T22:14:31.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbf9b7fe700 1 -- 172.21.15.49:0/2284178647 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf8c0035d0 con 0x7fbfa4160370 2023-07-21T22:14:31.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbfa937b700 1 -- 172.21.15.49:0/2284178647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfa40c1470 msgr2=0x7fbfa40c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:31.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbfa937b700 1 --2- 172.21.15.49:0/2284178647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfa40c1470 0x7fbfa40c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbfa937b700 1 -- 172.21.15.49:0/2284178647 >> v1:172.21.15.49:6789/0 conn(0x7fbfa4160370 legacy=0x7fbfa406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbfa937b700 1 -- 172.21.15.49:0/2284178647 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa40afc90 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbfa937b700 1 --2- 172.21.15.49:0/2284178647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa40ca2c0 0x7fbfa4163ef0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009d90 tx=0x7fbf9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56afe5ad91618c2b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:31.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbf9b7fe700 1 -- 172.21.15.49:0/2284178647 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c00e070 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbf9b7fe700 1 -- 172.21.15.49:0/2284178647 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c00bb20 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbf9b7fe700 1 -- 172.21.15.49:0/2284178647 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c012430 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/2284178647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa40ca2c0 msgr2=0x7fbfa4163ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.972+0000 7fbfa9b7c700 1 --2- 172.21.15.49:0/2284178647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa40ca2c0 0x7fbfa4163ef0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009d90 tx=0x7fbf9c00b330 comp rx=0 tx=0).stop 2023-07-21T22:14:31.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.976+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/2284178647 shutdown_connections 2023-07-21T22:14:31.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.976+0000 7fbfa9b7c700 1 --2- 172.21.15.49:0/2284178647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa40ca2c0 0x7fbfa4163ef0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.976+0000 7fbfa9b7c700 1 --2- 172.21.15.49:0/2284178647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfa40c1470 0x7fbfa40c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.976+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/2284178647 >> 172.21.15.49:0/2284178647 conn(0x7fbfa4070450 msgr2=0x7fbfa4070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:31.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.976+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/2284178647 shutdown_connections 2023-07-21T22:14:31.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.976+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/2284178647 wait complete. 2023-07-21T22:14:31.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.976+0000 7fbfa9b7c700 1 Processor -- start 2023-07-21T22:14:31.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbfa9b7c700 1 -- start start 2023-07-21T22:14:31.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbfa9b7c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfa40c1470 0x7fbfa40cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbfa9b7c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa40ca2c0 0x7fbfa41f9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbfa9b7c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa4160370 0x7fbfa41f9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbfa9b7c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40b33e0 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbfa9b7c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40c5140 con 0x7fbfa4160370 2023-07-21T22:14:31.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbfa9b7c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40c4330 con 0x7fbfa40c1470 2023-07-21T22:14:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbf9bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa40ca2c0 0x7fbfa41f9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbf9bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa40ca2c0 0x7fbfa41f9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55222/0 (socket says 172.21.15.49:55222) 2023-07-21T22:14:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbf9bfff700 1 -- 172.21.15.49:0/490083290 learned_addr learned my addr 172.21.15.49:0/490083290 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbfa937b700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa4160370 0x7fbfa41f9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbfa8b7a700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfa40c1470 0x7fbfa40cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbf9bfff700 1 -- 172.21.15.49:0/490083290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfa40c1470 msgr2=0x7fbfa40cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbf9bfff700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfa40c1470 0x7fbfa40cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbf9bfff700 1 -- 172.21.15.49:0/490083290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa4160370 msgr2=0x7fbfa41f9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbf9bfff700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa4160370 0x7fbfa41f9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbf9bfff700 1 -- 172.21.15.49:0/490083290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c009a70 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.980+0000 7fbfa937b700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa4160370 0x7fbfa41f9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:14:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.984+0000 7fbf9bfff700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa40ca2c0 0x7fbfa41f9400 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400e9d0 tx=0x7fbf9400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.984+0000 7fbf997fa700 1 -- 172.21.15.49:0/490083290 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94009720 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.984+0000 7fbf997fa700 1 -- 172.21.15.49:0/490083290 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9400ee70 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.984+0000 7fbf997fa700 1 -- 172.21.15.49:0/490083290 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400ca50 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.984+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/490083290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa40c4610 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.984+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/490083290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa40c56e0 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.984+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/490083290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa40b0510 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.988+0000 7fbf997fa700 1 -- 172.21.15.49:0/490083290 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf9400cbb0 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.988+0000 7fbf997fa700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf900662f0 0x7fbf900687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.988+0000 7fbf997fa700 1 -- 172.21.15.49:0/490083290 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fbf94083ef0 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.988+0000 7fbfa8b7a700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf900662f0 0x7fbf900687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.988+0000 7fbfa8b7a700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf900662f0 0x7fbf900687a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0007fd0 tx=0x7fbfa0007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:31.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:30.996+0000 7fbf997fa700 1 -- 172.21.15.49:0/490083290 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbfa40b0510 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.176+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/490083290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfa40b0510 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.180+0000 7fbf997fa700 1 -- 172.21.15.49:0/490083290 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+18703 (secure 0 0 0) 0x7fbfa40b0510 con 0x7fbfa40ca2c0 2023-07-21T22:14:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:31.226 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:14:17.339840+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:13:38.569931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:13:39.558524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.15","mappings":[{"from":7,"to":2}]},{"pgid":"10.25","mappings":[{"from":4,"to":3}]},{"pgid":"10.2a","mappings":[{"from":7,"to":5}]},{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:14:31.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.184+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/490083290 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf900662f0 msgr2=0x7fbf900687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.184+0000 7fbfa9b7c700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf900662f0 0x7fbf900687a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0007fd0 tx=0x7fbfa0007de0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.184+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/490083290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa40ca2c0 msgr2=0x7fbfa41f9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.184+0000 7fbfa9b7c700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa40ca2c0 0x7fbfa41f9400 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400e9d0 tx=0x7fbf9400ece0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.184+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/490083290 shutdown_connections 2023-07-21T22:14:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.184+0000 7fbfa9b7c700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf900662f0 0x7fbf900687a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.184+0000 7fbfa9b7c700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa40ca2c0 0x7fbfa41f9400 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.184+0000 7fbfa9b7c700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa4160370 0x7fbfa41f9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.184+0000 7fbfa9b7c700 1 --2- 172.21.15.49:0/490083290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfa40c1470 0x7fbfa40cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.184+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/490083290 >> 172.21.15.49:0/490083290 conn(0x7fbfa4070450 msgr2=0x7fbfa4162890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:31.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.184+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/490083290 shutdown_connections 2023-07-21T22:14:31.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.184+0000 7fbfa9b7c700 1 -- 172.21.15.49:0/490083290 wait complete. 2023-07-21T22:14:31.252 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T22:14:31.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.388+0000 7f760bf5b700 1 Processor -- start 2023-07-21T22:14:31.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f760bf5b700 1 -- start start 2023-07-21T22:14:31.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f760bf5b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f76041604c0 0x7f76040afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f760bf5b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76040c8860 0x7f7604070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f760bf5b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76040b0530 con 0x7f76040afc20 2023-07-21T22:14:31.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f760bf5b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7604163df0 con 0x7f76040c8860 2023-07-21T22:14:31.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f760bf5b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76041640d0 con 0x7f76041604c0 2023-07-21T22:14:31.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f7609cf7700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f76040afc20 0x7f76040cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40256/0 (socket says 172.21.15.49:40256) 2023-07-21T22:14:31.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f7609cf7700 1 -- 172.21.15.49:0/2707804352 learned_addr learned my addr 172.21.15.49:0/2707804352 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:31.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f760a4f8700 1 --2- 172.21.15.49:0/2707804352 >> v2:172.21.15.49:3300/0 conn(0x7f76040c8860 0x7f7604070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f76094f6700 1 --2- 172.21.15.49:0/2707804352 >> v2:172.21.15.150:3300/0 conn(0x7f76041604c0 0x7f76040afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f7608cf5700 1 -- 172.21.15.49:0/2707804352 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863328685 0 0) 0x7f76040b0530 con 0x7f76040afc20 2023-07-21T22:14:31.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f7608cf5700 1 -- 172.21.15.49:0/2707804352 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75ec0035d0 con 0x7f76040afc20 2023-07-21T22:14:31.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f760a4f8700 1 -- 172.21.15.49:0/2707804352 >> v2:172.21.15.150:3300/0 conn(0x7f76041604c0 msgr2=0x7f76040afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:31.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f760a4f8700 1 --2- 172.21.15.49:0/2707804352 >> v2:172.21.15.150:3300/0 conn(0x7f76041604c0 0x7f76040afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f760a4f8700 1 -- 172.21.15.49:0/2707804352 >> v1:172.21.15.49:6789/0 conn(0x7f76040afc20 legacy=0x7f76040cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f760a4f8700 1 -- 172.21.15.49:0/2707804352 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76041643b0 con 0x7f76040c8860 2023-07-21T22:14:31.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.392+0000 7f760a4f8700 1 --2- 172.21.15.49:0/2707804352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76040c8860 0x7f7604070600 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f760406b920 tx=0x7f75fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200da7b840c9de8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:31.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.396+0000 7f7608cf5700 1 -- 172.21.15.49:0/2707804352 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00e070 con 0x7f76040c8860 2023-07-21T22:14:31.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.396+0000 7f7608cf5700 1 -- 172.21.15.49:0/2707804352 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc00bb20 con 0x7f76040c8860 2023-07-21T22:14:31.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.396+0000 7f7608cf5700 1 -- 172.21.15.49:0/2707804352 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc012430 con 0x7f76040c8860 2023-07-21T22:14:31.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.396+0000 7f760bf5b700 1 -- 172.21.15.49:0/2707804352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76040c8860 msgr2=0x7f7604070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.396+0000 7f760bf5b700 1 --2- 172.21.15.49:0/2707804352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76040c8860 0x7f7604070600 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f760406b920 tx=0x7f75fc00b330 comp rx=0 tx=0).stop 2023-07-21T22:14:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.396+0000 7f760bf5b700 1 -- 172.21.15.49:0/2707804352 shutdown_connections 2023-07-21T22:14:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.396+0000 7f760bf5b700 1 --2- 172.21.15.49:0/2707804352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76040c8860 0x7f7604070600 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.396+0000 7f760bf5b700 1 --2- 172.21.15.49:0/2707804352 >> v2:172.21.15.150:3300/0 conn(0x7f76041604c0 0x7f76040afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.396+0000 7f760bf5b700 1 -- 172.21.15.49:0/2707804352 >> 172.21.15.49:0/2707804352 conn(0x7f760406f5a0 msgr2=0x7f76040cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.396+0000 7f760bf5b700 1 -- 172.21.15.49:0/2707804352 shutdown_connections 2023-07-21T22:14:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.396+0000 7f760bf5b700 1 -- 172.21.15.49:0/2707804352 wait complete. 2023-07-21T22:14:31.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760bf5b700 1 Processor -- start 2023-07-21T22:14:31.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760bf5b700 1 -- start start 2023-07-21T22:14:31.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760bf5b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76040afc20 0x7f760415de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760bf5b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76040c8860 0x7f7604161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760bf5b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76041604c0 0x7f7604161870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760bf5b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7604162cb0 con 0x7f76041604c0 2023-07-21T22:14:31.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760bf5b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76041620a0 con 0x7f76040afc20 2023-07-21T22:14:31.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760bf5b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7604162380 con 0x7f76040c8860 2023-07-21T22:14:31.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760a4f8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76041604c0 0x7f7604161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760a4f8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76041604c0 0x7f7604161870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55232/0 (socket says 172.21.15.49:55232) 2023-07-21T22:14:31.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760a4f8700 1 -- 172.21.15.49:0/1218175564 learned_addr learned my addr 172.21.15.49:0/1218175564 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:31.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760a4f8700 1 -- 172.21.15.49:0/1218175564 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76040c8860 msgr2=0x7f7604161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760a4f8700 1 --2- 172.21.15.49:0/1218175564 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76040c8860 0x7f7604161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760a4f8700 1 -- 172.21.15.49:0/1218175564 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76040afc20 msgr2=0x7f760415de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760a4f8700 1 --2- 172.21.15.49:0/1218175564 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76040afc20 0x7f760415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760a4f8700 1 -- 172.21.15.49:0/1218175564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc009a70 con 0x7f76041604c0 2023-07-21T22:14:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760a4f8700 1 --2- 172.21.15.49:0/1218175564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76041604c0 0x7f7604161870 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f75fc014040 tx=0x7f75fc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f76027fc700 1 -- 172.21.15.49:0/1218175564 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc012430 con 0x7f76041604c0 2023-07-21T22:14:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f76027fc700 1 -- 172.21.15.49:0/1218175564 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc020070 con 0x7f76041604c0 2023-07-21T22:14:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f76027fc700 1 -- 172.21.15.49:0/1218175564 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc004280 con 0x7f76041604c0 2023-07-21T22:14:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.400+0000 7f760bf5b700 1 -- 172.21.15.49:0/1218175564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7604162660 con 0x7f76041604c0 2023-07-21T22:14:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.404+0000 7f760bf5b700 1 -- 172.21.15.49:0/1218175564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7604161db0 con 0x7f76041604c0 2023-07-21T22:14:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.404+0000 7f760bf5b700 1 -- 172.21.15.49:0/1218175564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76040c57c0 con 0x7f76041604c0 2023-07-21T22:14:31.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.404+0000 7f76027fc700 1 -- 172.21.15.49:0/1218175564 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75fc0043e0 con 0x7f76041604c0 2023-07-21T22:14:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.408+0000 7f76027fc700 1 --2- 172.21.15.49:0/1218175564 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75f00662f0 0x7f75f00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.408+0000 7f76027fc700 1 -- 172.21.15.49:0/1218175564 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f75fc022070 con 0x7f76041604c0 2023-07-21T22:14:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.408+0000 7f7609cf7700 1 --2- 172.21.15.49:0/1218175564 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75f00662f0 0x7f75f00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.408+0000 7f7609cf7700 1 --2- 172.21.15.49:0/1218175564 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75f00662f0 0x7f75f00687a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f75f40016d0 tx=0x7f75f40079e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:31.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.412+0000 7f76027fc700 1 -- 172.21.15.49:0/1218175564 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75fc052df0 con 0x7f76041604c0 2023-07-21T22:14:31.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.628+0000 7f760bf5b700 1 -- 172.21.15.49:0/1218175564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f760404dcb0 con 0x7f76041604c0 2023-07-21T22:14:31.673 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-07-21T22:14:31.628+0000 7fcc7a5f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T22:14:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.640+0000 7f76027fc700 1 -- 172.21.15.49:0/1218175564 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7f75fc02c090 con 0x7f76041604c0 2023-07-21T22:14:31.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.640+0000 7f760bf5b700 1 -- 172.21.15.49:0/1218175564 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75f00662f0 msgr2=0x7f75f00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.640+0000 7f760bf5b700 1 --2- 172.21.15.49:0/1218175564 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75f00662f0 0x7f75f00687a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f75f40016d0 tx=0x7f75f40079e0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.640+0000 7f760bf5b700 1 -- 172.21.15.49:0/1218175564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76041604c0 msgr2=0x7f7604161870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.640+0000 7f760bf5b700 1 --2- 172.21.15.49:0/1218175564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76041604c0 0x7f7604161870 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f75fc014040 tx=0x7f75fc004af0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.640+0000 7f760bf5b700 1 -- 172.21.15.49:0/1218175564 shutdown_connections 2023-07-21T22:14:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.640+0000 7f760bf5b700 1 --2- 172.21.15.49:0/1218175564 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f75f00662f0 0x7f75f00687a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.640+0000 7f760bf5b700 1 --2- 172.21.15.49:0/1218175564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76041604c0 0x7f7604161870 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.640+0000 7f760bf5b700 1 --2- 172.21.15.49:0/1218175564 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76040c8860 0x7f7604161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.640+0000 7f760bf5b700 1 --2- 172.21.15.49:0/1218175564 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76040afc20 0x7f760415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.640+0000 7f760bf5b700 1 -- 172.21.15.49:0/1218175564 >> 172.21.15.49:0/1218175564 conn(0x7f760406f5a0 msgr2=0x7f760415f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.640+0000 7f760bf5b700 1 -- 172.21.15.49:0/1218175564 shutdown_connections 2023-07-21T22:14:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.640+0000 7f760bf5b700 1 -- 172.21.15.49:0/1218175564 wait complete. 2023-07-21T22:14:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T22:14:31.690 INFO:tasks.ceph.mds.c.smithi049.stderr: -3159> 2023-07-21T22:13:45.545+0000 7f0ab56e1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:14:31.709 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T22:14:31.755 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-07-21T22:14:31.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.844+0000 7fe1f3251700 1 Processor -- start 2023-07-21T22:14:31.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.844+0000 7fe1f3251700 1 -- start start 2023-07-21T22:14:31.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1f3251700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1ec15e380 0x7fe1ec0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1f3251700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1ec0b3a50 0x7fe1ec0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1f3251700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ec0ca190 con 0x7fe1ec0c9cd0 2023-07-21T22:14:31.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1f3251700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ec159fd0 con 0x7fe1ec0b3a50 2023-07-21T22:14:31.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1f3251700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec15d6e0 con 0x7fe1ec15e380 2023-07-21T22:14:31.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1ebfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1ec0b3a50 0x7fe1ec0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1f17ee700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe1ec0c9cd0 0x7fe1ec0c8820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40268/0 (socket says 172.21.15.49:40268) 2023-07-21T22:14:31.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1f17ee700 1 -- 172.21.15.49:0/352196078 learned_addr learned my addr 172.21.15.49:0/352196078 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:31.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1f0fed700 1 --2- 172.21.15.49:0/352196078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1ec15e380 0x7fe1ec0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1ebfff700 1 -- 172.21.15.49:0/352196078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1ec15e380 msgr2=0x7fe1ec0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:31.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1ebfff700 1 --2- 172.21.15.49:0/352196078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1ec15e380 0x7fe1ec0cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1ebfff700 1 -- 172.21.15.49:0/352196078 >> v1:172.21.15.49:6789/0 conn(0x7fe1ec0c9cd0 legacy=0x7fe1ec0c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1ebfff700 1 -- 172.21.15.49:0/352196078 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec0ca900 con 0x7fe1ec0b3a50 2023-07-21T22:14:31.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1eb7fe700 1 -- 172.21.15.49:0/352196078 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83404316 0 0) 0x7fe1ec0ca190 con 0x7fe1ec0c9cd0 2023-07-21T22:14:31.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1ebfff700 1 --2- 172.21.15.49:0/352196078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ec0b3a50 0x7fe1ec0cb120 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009840 tx=0x7fe1d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf5a9878ac51f10 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:31.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1eb7fe700 1 -- 172.21.15.49:0/352196078 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8005e50 con 0x7fe1ec0b3a50 2023-07-21T22:14:31.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1eb7fe700 1 -- 172.21.15.49:0/352196078 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d8006030 con 0x7fe1ec0b3a50 2023-07-21T22:14:31.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.848+0000 7fe1eb7fe700 1 -- 172.21.15.49:0/352196078 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80063c0 con 0x7fe1ec0b3a50 2023-07-21T22:14:31.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.852+0000 7fe1f3251700 1 -- 172.21.15.49:0/352196078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ec0b3a50 msgr2=0x7fe1ec0cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.852+0000 7fe1f3251700 1 --2- 172.21.15.49:0/352196078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ec0b3a50 0x7fe1ec0cb120 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009840 tx=0x7fe1d8009b50 comp rx=0 tx=0).stop 2023-07-21T22:14:31.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.852+0000 7fe1f3251700 1 -- 172.21.15.49:0/352196078 shutdown_connections 2023-07-21T22:14:31.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.852+0000 7fe1f3251700 1 --2- 172.21.15.49:0/352196078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ec0b3a50 0x7fe1ec0cb120 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.852+0000 7fe1f3251700 1 --2- 172.21.15.49:0/352196078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1ec15e380 0x7fe1ec0cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.852+0000 7fe1f3251700 1 -- 172.21.15.49:0/352196078 >> 172.21.15.49:0/352196078 conn(0x7fe1ec06e960 msgr2=0x7fe1ec06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:31.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.852+0000 7fe1f3251700 1 -- 172.21.15.49:0/352196078 shutdown_connections 2023-07-21T22:14:31.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.852+0000 7fe1f3251700 1 -- 172.21.15.49:0/352196078 wait complete. 2023-07-21T22:14:31.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.852+0000 7fe1f3251700 1 Processor -- start 2023-07-21T22:14:31.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.852+0000 7fe1f3251700 1 -- start start 2023-07-21T22:14:31.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1f3251700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1ec0b3a50 0x7fe1ec1f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1f3251700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ec0c9cd0 0x7fe1ec14f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1f3251700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1ec15e380 0x7fe1ec0a9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1f3251700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec06c930 con 0x7fe1ec0c9cd0 2023-07-21T22:14:31.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1f3251700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec1f1720 con 0x7fe1ec15e380 2023-07-21T22:14:31.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1f3251700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec0a8de0 con 0x7fe1ec0b3a50 2023-07-21T22:14:31.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1ebfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ec0c9cd0 0x7fe1ec14f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1ebfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ec0c9cd0 0x7fe1ec14f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55270/0 (socket says 172.21.15.49:55270) 2023-07-21T22:14:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1ebfff700 1 -- 172.21.15.49:0/938372693 learned_addr learned my addr 172.21.15.49:0/938372693 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1f0fed700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1ec0b3a50 0x7fe1ec1f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1f17ee700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1ec15e380 0x7fe1ec0a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1ebfff700 1 -- 172.21.15.49:0/938372693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1ec0b3a50 msgr2=0x7fe1ec1f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1ebfff700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1ec0b3a50 0x7fe1ec1f11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1ebfff700 1 -- 172.21.15.49:0/938372693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1ec15e380 msgr2=0x7fe1ec0a9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1ebfff700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1ec15e380 0x7fe1ec0a9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1ebfff700 1 -- 172.21.15.49:0/938372693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d8009450 con 0x7fe1ec0c9cd0 2023-07-21T22:14:31.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1f17ee700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1ec15e380 0x7fe1ec0a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:31.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1ebfff700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ec0c9cd0 0x7fe1ec14f3c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8013040 tx=0x7fe1d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:31.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1e97fa700 1 -- 172.21.15.49:0/938372693 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8003ad0 con 0x7fe1ec0c9cd0 2023-07-21T22:14:31.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1e97fa700 1 -- 172.21.15.49:0/938372693 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d8003c30 con 0x7fe1ec0c9cd0 2023-07-21T22:14:31.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1f3251700 1 -- 172.21.15.49:0/938372693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ec0a8b00 con 0x7fe1ec0c9cd0 2023-07-21T22:14:31.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1e97fa700 1 -- 172.21.15.49:0/938372693 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80061a0 con 0x7fe1ec0c9cd0 2023-07-21T22:14:31.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.856+0000 7fe1f3251700 1 -- 172.21.15.49:0/938372693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ec15b600 con 0x7fe1ec0c9cd0 2023-07-21T22:14:31.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.860+0000 7fe1f3251700 1 -- 172.21.15.49:0/938372693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ec0cddd0 con 0x7fe1ec0c9cd0 2023-07-21T22:14:31.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.860+0000 7fe1e97fa700 1 -- 172.21.15.49:0/938372693 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1d8022070 con 0x7fe1ec0c9cd0 2023-07-21T22:14:31.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.864+0000 7fe1e97fa700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe1d00662f0 0x7fe1d00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.864+0000 7fe1e97fa700 1 -- 172.21.15.49:0/938372693 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6613+0+0 (secure 0 0 0) 0x7fe1d8085840 con 0x7fe1ec0c9cd0 2023-07-21T22:14:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.864+0000 7fe1f0fed700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe1d00662f0 0x7fe1d00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.864+0000 7fe1f0fed700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe1d00662f0 0x7fe1d00687a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009b50 tx=0x7fe1e0009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:31.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:31.868+0000 7fe1e97fa700 1 -- 172.21.15.49:0/938372693 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1d8052a80 con 0x7fe1ec0c9cd0 2023-07-21T22:14:32.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.076+0000 7fe1f3251700 1 -- 172.21.15.49:0/938372693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe1ec04dd50 con 0x7fe1ec0c9cd0 2023-07-21T22:14:32.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.640+0000 7fe1e97fa700 1 -- 172.21.15.49:0/938372693 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe1d80560a0 con 0x7fe1ec0c9cd0 2023-07-21T22:14:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.644+0000 7fe1f3251700 1 -- 172.21.15.49:0/938372693 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe1d00662f0 msgr2=0x7fe1d00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.644+0000 7fe1f3251700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe1d00662f0 0x7fe1d00687a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009b50 tx=0x7fe1e0009240 comp rx=0 tx=0).stop 2023-07-21T22:14:32.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.644+0000 7fe1f3251700 1 -- 172.21.15.49:0/938372693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ec0c9cd0 msgr2=0x7fe1ec14f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:32.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.644+0000 7fe1f3251700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ec0c9cd0 0x7fe1ec14f3c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8013040 tx=0x7fe1d8004770 comp rx=0 tx=0).stop 2023-07-21T22:14:32.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.648+0000 7fe1f3251700 1 -- 172.21.15.49:0/938372693 shutdown_connections 2023-07-21T22:14:32.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.648+0000 7fe1f3251700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe1d00662f0 0x7fe1d00687a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:32.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.648+0000 7fe1f3251700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ec0c9cd0 0x7fe1ec14f3c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:32.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.648+0000 7fe1f3251700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1ec15e380 0x7fe1ec0a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:32.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.648+0000 7fe1f3251700 1 --2- 172.21.15.49:0/938372693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1ec0b3a50 0x7fe1ec1f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.648+0000 7fe1f3251700 1 -- 172.21.15.49:0/938372693 >> 172.21.15.49:0/938372693 conn(0x7fe1ec06e960 msgr2=0x7fe1ec159680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.648+0000 7fe1f3251700 1 -- 172.21.15.49:0/938372693 shutdown_connections 2023-07-21T22:14:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.648+0000 7fe1f3251700 1 -- 172.21.15.49:0/938372693 wait complete. 2023-07-21T22:14:32.715 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T22:14:32.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.856+0000 7f986e786700 1 Processor -- start 2023-07-21T22:14:32.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.856+0000 7f986e786700 1 -- start start 2023-07-21T22:14:32.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.860+0000 7f986e786700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f98680cf6d0 0x7f9868160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:32.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.860+0000 7f986e786700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98680ccc30 con 0x7f986815bb80 2023-07-21T22:14:32.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.860+0000 7f986e786700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98680ce9a0 con 0x7f986815bf50 2023-07-21T22:14:32.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.860+0000 7f986e786700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986806f480 con 0x7f98680cf6d0 2023-07-21T22:14:32.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.860+0000 7f9867fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f986815bb80 0x7f98680cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40280/0 (socket says 172.21.15.49:40280) 2023-07-21T22:14:32.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.860+0000 7f9867fff700 1 -- 172.21.15.49:0/3057765698 learned_addr learned my addr 172.21.15.49:0/3057765698 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:32.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.860+0000 7f98677fe700 1 --2- 172.21.15.49:0/3057765698 >> v2:172.21.15.150:3300/0 conn(0x7f98680cf6d0 0x7f9868160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:32.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f9866ffd700 1 -- 172.21.15.49:0/3057765698 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983534416 0 0) 0x7f98680ce9a0 con 0x7f986815bf50 2023-07-21T22:14:32.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f9866ffd700 1 -- 172.21.15.49:0/3057765698 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98500035d0 con 0x7f986815bf50 2023-07-21T22:14:32.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f9866ffd700 1 -- 172.21.15.49:0/3057765698 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206818139 0 0) 0x7f98680ccc30 con 0x7f986815bb80 2023-07-21T22:14:32.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f9866ffd700 1 -- 172.21.15.49:0/3057765698 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98680ce9a0 con 0x7f986815bb80 2023-07-21T22:14:32.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f98677fe700 1 -- 172.21.15.49:0/3057765698 >> v1:172.21.15.150:6789/0 conn(0x7f986815bf50 legacy=0x7f98680d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:32.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f98677fe700 1 -- 172.21.15.49:0/3057765698 >> v1:172.21.15.49:6789/0 conn(0x7f986815bb80 legacy=0x7f98680cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:32.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f98677fe700 1 -- 172.21.15.49:0/3057765698 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98680cec40 con 0x7f98680cf6d0 2023-07-21T22:14:32.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f98677fe700 1 --2- 172.21.15.49:0/3057765698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98680cf6d0 0x7f9868160320 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f985c009850 tx=0x7f985c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bda7295ddc7fdee6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:32.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f9866ffd700 1 -- 172.21.15.49:0/3057765698 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c011830 con 0x7f98680cf6d0 2023-07-21T22:14:32.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f9866ffd700 1 -- 172.21.15.49:0/3057765698 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c011990 con 0x7f98680cf6d0 2023-07-21T22:14:32.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f9866ffd700 1 -- 172.21.15.49:0/3057765698 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c011d40 con 0x7f98680cf6d0 2023-07-21T22:14:32.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f986e786700 1 -- 172.21.15.49:0/3057765698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98680cf6d0 msgr2=0x7f9868160320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:32.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f986e786700 1 --2- 172.21.15.49:0/3057765698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98680cf6d0 0x7f9868160320 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f985c009850 tx=0x7f985c009b60 comp rx=0 tx=0).stop 2023-07-21T22:14:32.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f986e786700 1 -- 172.21.15.49:0/3057765698 shutdown_connections 2023-07-21T22:14:32.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f986e786700 1 --2- 172.21.15.49:0/3057765698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98680cf6d0 0x7f9868160320 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:32.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f986e786700 1 -- 172.21.15.49:0/3057765698 >> 172.21.15.49:0/3057765698 conn(0x7f986806fdc0 msgr2=0x7f9868070190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:32.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f986e786700 1 -- 172.21.15.49:0/3057765698 shutdown_connections 2023-07-21T22:14:32.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.864+0000 7f986e786700 1 -- 172.21.15.49:0/3057765698 wait complete. 2023-07-21T22:14:32.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.868+0000 7f986e786700 1 Processor -- start 2023-07-21T22:14:32.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.868+0000 7f986e786700 1 -- start start 2023-07-21T22:14:32.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986e786700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98680cf6d0 0x7f98680c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:32.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986e786700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f986815bb80 0x7f98680c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:32.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986e786700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f986815bf50 0x7f98680c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:32.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986e786700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9868158310 con 0x7f986815bf50 2023-07-21T22:14:32.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986e786700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9868157690 con 0x7f986815bb80 2023-07-21T22:14:32.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986e786700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9868157970 con 0x7f98680cf6d0 2023-07-21T22:14:32.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986cd23700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f986815bf50 0x7f98680c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:32.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986cd23700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f986815bf50 0x7f98680c6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55280/0 (socket says 172.21.15.49:55280) 2023-07-21T22:14:32.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986cd23700 1 -- 172.21.15.49:0/1982127459 learned_addr learned my addr 172.21.15.49:0/1982127459 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:32.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f9867fff700 1 --2- 172.21.15.49:0/1982127459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98680cf6d0 0x7f98680c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:32.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f98677fe700 1 --2- 172.21.15.49:0/1982127459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f986815bb80 0x7f98680c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:32.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986cd23700 1 -- 172.21.15.49:0/1982127459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98680cf6d0 msgr2=0x7f98680c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:32.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986cd23700 1 --2- 172.21.15.49:0/1982127459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98680cf6d0 0x7f98680c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:32.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986cd23700 1 -- 172.21.15.49:0/1982127459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f986815bb80 msgr2=0x7f98680c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:32.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986cd23700 1 --2- 172.21.15.49:0/1982127459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f986815bb80 0x7f98680c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:32.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986cd23700 1 -- 172.21.15.49:0/1982127459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c0094b0 con 0x7f986815bf50 2023-07-21T22:14:32.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986cd23700 1 --2- 172.21.15.49:0/1982127459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f986815bf50 0x7f98680c6650 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f986000cb90 tx=0x7f986000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:32.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f9864ff9700 1 -- 172.21.15.49:0/1982127459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860003c20 con 0x7f986815bf50 2023-07-21T22:14:32.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f9864ff9700 1 -- 172.21.15.49:0/1982127459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9860003d80 con 0x7f986815bf50 2023-07-21T22:14:32.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986e786700 1 -- 172.21.15.49:0/1982127459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9868157c50 con 0x7f986815bf50 2023-07-21T22:14:32.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f9864ff9700 1 -- 172.21.15.49:0/1982127459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986000aae0 con 0x7f986815bf50 2023-07-21T22:14:32.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.872+0000 7f986e786700 1 -- 172.21.15.49:0/1982127459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98681572b0 con 0x7f986815bf50 2023-07-21T22:14:32.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.876+0000 7f986e786700 1 -- 172.21.15.49:0/1982127459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9868158450 con 0x7f986815bf50 2023-07-21T22:14:32.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.876+0000 7f9864ff9700 1 -- 172.21.15.49:0/1982127459 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f986000ac40 con 0x7f986815bf50 2023-07-21T22:14:32.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.880+0000 7f9864ff9700 1 --2- 172.21.15.49:0/1982127459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f98540662f0 0x7f98540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:32.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.880+0000 7f9864ff9700 1 -- 172.21.15.49:0/1982127459 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f98600847d0 con 0x7f986815bf50 2023-07-21T22:14:32.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.880+0000 7f9867fff700 1 --2- 172.21.15.49:0/1982127459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f98540662f0 0x7f98540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:32.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.880+0000 7f9867fff700 1 --2- 172.21.15.49:0/1982127459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f98540662f0 0x7f98540687a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9858005930 tx=0x7f9858009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:32.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:32.884+0000 7f9864ff9700 1 -- 172.21.15.49:0/1982127459 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9860051a90 con 0x7f986815bf50 2023-07-21T22:14:33.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.060+0000 7f986e786700 1 -- 172.21.15.49:0/1982127459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9868158450 con 0x7f986815bf50 2023-07-21T22:14:33.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.648+0000 7f9864ff9700 1 -- 172.21.15.49:0/1982127459 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v66) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9868158450 con 0x7f986815bf50 2023-07-21T22:14:33.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.652+0000 7f986e786700 1 -- 172.21.15.49:0/1982127459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f98540662f0 msgr2=0x7f98540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:33.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.652+0000 7f986e786700 1 --2- 172.21.15.49:0/1982127459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f98540662f0 0x7f98540687a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9858005930 tx=0x7f9858009040 comp rx=0 tx=0).stop 2023-07-21T22:14:33.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.652+0000 7f986e786700 1 -- 172.21.15.49:0/1982127459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f986815bf50 msgr2=0x7f98680c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:33.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.652+0000 7f986e786700 1 --2- 172.21.15.49:0/1982127459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f986815bf50 0x7f98680c6650 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f986000cb90 tx=0x7f986000cea0 comp rx=0 tx=0).stop 2023-07-21T22:14:33.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.652+0000 7f986e786700 1 -- 172.21.15.49:0/1982127459 shutdown_connections 2023-07-21T22:14:33.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.652+0000 7f986e786700 1 --2- 172.21.15.49:0/1982127459 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f98540662f0 0x7f98540687a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:33.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.652+0000 7f986e786700 1 --2- 172.21.15.49:0/1982127459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f986815bf50 0x7f98680c6650 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:33.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.652+0000 7f986e786700 1 --2- 172.21.15.49:0/1982127459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f986815bb80 0x7f98680c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:33.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.652+0000 7f986e786700 1 --2- 172.21.15.49:0/1982127459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98680cf6d0 0x7f98680c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:33.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.652+0000 7f986e786700 1 -- 172.21.15.49:0/1982127459 >> 172.21.15.49:0/1982127459 conn(0x7f986806fdc0 msgr2=0x7f98680cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:33.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.652+0000 7f986e786700 1 -- 172.21.15.49:0/1982127459 shutdown_connections 2023-07-21T22:14:33.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.652+0000 7f986e786700 1 -- 172.21.15.49:0/1982127459 wait complete. 2023-07-21T22:14:33.701 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-07-21T22:14:33.721 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T22:14:33.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.860+0000 7feca2625700 1 Processor -- start 2023-07-21T22:14:33.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7feca2625700 1 -- start start 2023-07-21T22:14:33.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7feca2625700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec9c159ea0 0x7fec9c0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:33.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7feca2625700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec9c0b03f0 0x7fec9c15e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:33.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7feca2625700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9c15d8a0 con 0x7fec9c0cb8a0 2023-07-21T22:14:33.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7feca2625700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9c0ca640 con 0x7fec9c159ea0 2023-07-21T22:14:33.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7feca2625700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0ca920 con 0x7fec9c0b03f0 2023-07-21T22:14:33.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7fec9bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec9c159ea0 0x7fec9c0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:33.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7fec937fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fec9c0cb8a0 0x7fec9c0afce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40282/0 (socket says 172.21.15.49:40282) 2023-07-21T22:14:33.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7fec937fe700 1 -- 172.21.15.49:0/1273947628 learned_addr learned my addr 172.21.15.49:0/1273947628 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:33.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7feca0bc2700 1 --2- 172.21.15.49:0/1273947628 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec9c0b03f0 0x7fec9c15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:33.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7fec9bfff700 1 -- 172.21.15.49:0/1273947628 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec9c0b03f0 msgr2=0x7fec9c15e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:33.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7fec9bfff700 1 --2- 172.21.15.49:0/1273947628 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec9c0b03f0 0x7fec9c15e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:33.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7fec9bfff700 1 -- 172.21.15.49:0/1273947628 >> v1:172.21.15.49:6789/0 conn(0x7fec9c0cb8a0 legacy=0x7fec9c0afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:33.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7fec9bfff700 1 -- 172.21.15.49:0/1273947628 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c15db40 con 0x7fec9c159ea0 2023-07-21T22:14:33.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.864+0000 7fec9bfff700 1 --2- 172.21.15.49:0/1273947628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec9c159ea0 0x7fec9c0c9c60 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009850 tx=0x7fec8c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c40761a474d5f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:33.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.868+0000 7fec9b7fe700 1 -- 172.21.15.49:0/1273947628 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c011830 con 0x7fec9c159ea0 2023-07-21T22:14:33.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.868+0000 7fec9b7fe700 1 -- 172.21.15.49:0/1273947628 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c011990 con 0x7fec9c159ea0 2023-07-21T22:14:33.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.868+0000 7fec9b7fe700 1 -- 172.21.15.49:0/1273947628 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c011d40 con 0x7fec9c159ea0 2023-07-21T22:14:33.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.868+0000 7feca2625700 1 -- 172.21.15.49:0/1273947628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec9c159ea0 msgr2=0x7fec9c0c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:33.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.868+0000 7feca2625700 1 --2- 172.21.15.49:0/1273947628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec9c159ea0 0x7fec9c0c9c60 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009850 tx=0x7fec8c009b60 comp rx=0 tx=0).stop 2023-07-21T22:14:33.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.868+0000 7feca2625700 1 -- 172.21.15.49:0/1273947628 shutdown_connections 2023-07-21T22:14:33.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.868+0000 7feca2625700 1 --2- 172.21.15.49:0/1273947628 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec9c0b03f0 0x7fec9c15e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:33.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.868+0000 7feca2625700 1 --2- 172.21.15.49:0/1273947628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec9c159ea0 0x7fec9c0c9c60 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:33.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.868+0000 7feca2625700 1 -- 172.21.15.49:0/1273947628 >> 172.21.15.49:0/1273947628 conn(0x7fec9c0cace0 msgr2=0x7fec9c0cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:33.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.868+0000 7feca2625700 1 -- 172.21.15.49:0/1273947628 shutdown_connections 2023-07-21T22:14:33.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.868+0000 7feca2625700 1 -- 172.21.15.49:0/1273947628 wait complete. 2023-07-21T22:14:33.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.872+0000 7feca2625700 1 Processor -- start 2023-07-21T22:14:33.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.872+0000 7feca2625700 1 -- start start 2023-07-21T22:14:33.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.872+0000 7feca2625700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec9c0b03f0 0x7fec9c1519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:33.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.872+0000 7feca2625700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec9c0cb8a0 0x7fec9c0afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:33.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.872+0000 7feca2625700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec9c159ea0 0x7fec9c0b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:33.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.872+0000 7feca2625700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c15b3f0 con 0x7fec9c0b03f0 2023-07-21T22:14:33.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.872+0000 7feca2625700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c151f10 con 0x7fec9c159ea0 2023-07-21T22:14:33.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.872+0000 7feca2625700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0b0030 con 0x7fec9c0cb8a0 2023-07-21T22:14:33.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.872+0000 7fec9bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec9c0b03f0 0x7fec9c1519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:33.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.872+0000 7fec9bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec9c0b03f0 0x7fec9c1519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55296/0 (socket says 172.21.15.49:55296) 2023-07-21T22:14:33.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.872+0000 7fec9bfff700 1 -- 172.21.15.49:0/3538456849 learned_addr learned my addr 172.21.15.49:0/3538456849 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:33.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.872+0000 7feca0bc2700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec9c159ea0 0x7fec9c0b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:33.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.872+0000 7fec937fe700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec9c0cb8a0 0x7fec9c0afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:33.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.876+0000 7fec9bfff700 1 -- 172.21.15.49:0/3538456849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec9c0cb8a0 msgr2=0x7fec9c0afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:33.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.876+0000 7fec9bfff700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec9c0cb8a0 0x7fec9c0afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:33.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.876+0000 7fec9bfff700 1 -- 172.21.15.49:0/3538456849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec9c159ea0 msgr2=0x7fec9c0b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:33.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.876+0000 7fec9bfff700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec9c159ea0 0x7fec9c0b2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:33.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.876+0000 7fec9bfff700 1 -- 172.21.15.49:0/3538456849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c0094b0 con 0x7fec9c0b03f0 2023-07-21T22:14:33.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.876+0000 7feca0bc2700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec9c159ea0 0x7fec9c0b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:33.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.876+0000 7fec9bfff700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec9c0b03f0 0x7fec9c1519d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fec8c014040 tx=0x7fec8c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:33.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.876+0000 7fec997fa700 1 -- 172.21.15.49:0/3538456849 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0038c0 con 0x7fec9c0b03f0 2023-07-21T22:14:33.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.876+0000 7fec997fa700 1 -- 172.21.15.49:0/3538456849 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c01e070 con 0x7fec9c0b03f0 2023-07-21T22:14:33.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.876+0000 7fec997fa700 1 -- 172.21.15.49:0/3538456849 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c003c80 con 0x7fec9c0b03f0 2023-07-21T22:14:33.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.876+0000 7feca2625700 1 -- 172.21.15.49:0/3538456849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9c0b1c20 con 0x7fec9c0b03f0 2023-07-21T22:14:33.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.876+0000 7feca2625700 1 -- 172.21.15.49:0/3538456849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9c0b21e0 con 0x7fec9c0b03f0 2023-07-21T22:14:33.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.876+0000 7feca2625700 1 -- 172.21.15.49:0/3538456849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9c06e1a0 con 0x7fec9c0b03f0 2023-07-21T22:14:33.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.876+0000 7fec997fa700 1 -- 172.21.15.49:0/3538456849 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec8c01a420 con 0x7fec9c0b03f0 2023-07-21T22:14:33.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.880+0000 7fec997fa700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec7c066320 0x7fec7c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:33.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.880+0000 7fec997fa700 1 -- 172.21.15.49:0/3538456849 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6146+0+0 (secure 0 0 0) 0x7fec8c020070 con 0x7fec9c0b03f0 2023-07-21T22:14:33.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.880+0000 7fec937fe700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec7c066320 0x7fec7c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.880+0000 7fec937fe700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec7c066320 0x7fec7c0687d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0adc40 tx=0x7fec84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:33.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:33.888+0000 7fec997fa700 1 -- 172.21.15.49:0/3538456849 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec8c052780 con 0x7fec9c0b03f0 2023-07-21T22:14:34.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.064+0000 7feca2625700 1 -- 172.21.15.49:0/3538456849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fec9c072950 con 0x7fec9c0b03f0 2023-07-21T22:14:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.652+0000 7fec997fa700 1 -- 172.21.15.49:0/3538456849 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v67) v1 ==== 169+0+0 (secure 0 0 0) 0x7fec8c055da0 con 0x7fec9c0b03f0 2023-07-21T22:14:34.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.656+0000 7feca2625700 1 -- 172.21.15.49:0/3538456849 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec7c066320 msgr2=0x7fec7c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:34.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.656+0000 7feca2625700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec7c066320 0x7fec7c0687d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0adc40 tx=0x7fec84009040 comp rx=0 tx=0).stop 2023-07-21T22:14:34.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.656+0000 7feca2625700 1 -- 172.21.15.49:0/3538456849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec9c0b03f0 msgr2=0x7fec9c1519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:34.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.656+0000 7feca2625700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec9c0b03f0 0x7fec9c1519d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fec8c014040 tx=0x7fec8c004770 comp rx=0 tx=0).stop 2023-07-21T22:14:34.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.656+0000 7feca2625700 1 -- 172.21.15.49:0/3538456849 shutdown_connections 2023-07-21T22:14:34.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.656+0000 7feca2625700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fec7c066320 0x7fec7c0687d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:34.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.656+0000 7feca2625700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec9c159ea0 0x7fec9c0b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:34.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.656+0000 7feca2625700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec9c0cb8a0 0x7fec9c0afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:34.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.656+0000 7feca2625700 1 --2- 172.21.15.49:0/3538456849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec9c0b03f0 0x7fec9c1519d0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:34.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.656+0000 7feca2625700 1 -- 172.21.15.49:0/3538456849 >> 172.21.15.49:0/3538456849 conn(0x7fec9c0cace0 msgr2=0x7fec9c070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:34.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.656+0000 7feca2625700 1 -- 172.21.15.49:0/3538456849 shutdown_connections 2023-07-21T22:14:34.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.660+0000 7feca2625700 1 -- 172.21.15.49:0/3538456849 wait complete. 2023-07-21T22:14:34.705 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-07-21T22:14:34.726 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-21T22:14:34.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.860+0000 7fa8eef86700 1 Processor -- start 2023-07-21T22:14:34.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.860+0000 7fa8eef86700 1 -- start start 2023-07-21T22:14:34.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.864+0000 7fa8eef86700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8e81564c0 0x7fa8e80cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:34.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.864+0000 7fa8eef86700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa8e80c9990 0x7fa8e80ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:34.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.864+0000 7fa8eef86700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e80c8bd0 con 0x7fa8e815c890 2023-07-21T22:14:34.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.864+0000 7fa8eef86700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e80c9570 con 0x7fa8e80c9990 2023-07-21T22:14:34.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.864+0000 7fa8eef86700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e815d420 con 0x7fa8e81564c0 2023-07-21T22:14:34.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.864+0000 7fa8ed523700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa8e815c890 0x7fa8e815cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48002/0 (socket says 172.21.15.49:48002) 2023-07-21T22:14:34.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.864+0000 7fa8ed523700 1 -- 172.21.15.49:0/412896283 learned_addr learned my addr 172.21.15.49:0/412896283 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:34.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.864+0000 7fa8e7fff700 1 --2- 172.21.15.49:0/412896283 >> v2:172.21.15.49:3300/0 conn(0x7fa8e80c9990 0x7fa8e80ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:34.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.864+0000 7fa8ecd22700 1 --2- 172.21.15.49:0/412896283 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8e81564c0 0x7fa8e80cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:34.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.864+0000 7fa8e77fe700 1 -- 172.21.15.49:0/412896283 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126197923 0 0) 0x7fa8e80c8bd0 con 0x7fa8e815c890 2023-07-21T22:14:34.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8e77fe700 1 -- 172.21.15.49:0/412896283 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d80035d0 con 0x7fa8e815c890 2023-07-21T22:14:34.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8e7fff700 1 -- 172.21.15.49:0/412896283 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8e81564c0 msgr2=0x7fa8e80cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:34.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8e7fff700 1 --2- 172.21.15.49:0/412896283 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8e81564c0 0x7fa8e80cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:34.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8e7fff700 1 -- 172.21.15.49:0/412896283 >> v1:172.21.15.49:6789/0 conn(0x7fa8e815c890 legacy=0x7fa8e815cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:34.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8e7fff700 1 -- 172.21.15.49:0/412896283 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e80c8eb0 con 0x7fa8e80c9990 2023-07-21T22:14:34.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8e7fff700 1 --2- 172.21.15.49:0/412896283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8e80c9990 0x7fa8e80ce480 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009840 tx=0x7fa8d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2a99d3310872a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:34.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8e77fe700 1 -- 172.21.15.49:0/412896283 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4011830 con 0x7fa8e80c9990 2023-07-21T22:14:34.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8e77fe700 1 -- 172.21.15.49:0/412896283 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d4011990 con 0x7fa8e80c9990 2023-07-21T22:14:34.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8e77fe700 1 -- 172.21.15.49:0/412896283 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4011d20 con 0x7fa8e80c9990 2023-07-21T22:14:34.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8eef86700 1 -- 172.21.15.49:0/412896283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8e80c9990 msgr2=0x7fa8e80ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:34.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8eef86700 1 --2- 172.21.15.49:0/412896283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8e80c9990 0x7fa8e80ce480 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009840 tx=0x7fa8d4009b50 comp rx=0 tx=0).stop 2023-07-21T22:14:34.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8eef86700 1 -- 172.21.15.49:0/412896283 shutdown_connections 2023-07-21T22:14:34.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8eef86700 1 --2- 172.21.15.49:0/412896283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8e80c9990 0x7fa8e80ce480 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:34.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8eef86700 1 --2- 172.21.15.49:0/412896283 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8e81564c0 0x7fa8e80cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:34.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8eef86700 1 -- 172.21.15.49:0/412896283 >> 172.21.15.49:0/412896283 conn(0x7fa8e806e960 msgr2=0x7fa8e806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:34.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8eef86700 1 -- 172.21.15.49:0/412896283 shutdown_connections 2023-07-21T22:14:34.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.868+0000 7fa8eef86700 1 -- 172.21.15.49:0/412896283 wait complete. 2023-07-21T22:14:34.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.872+0000 7fa8eef86700 1 Processor -- start 2023-07-21T22:14:34.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.872+0000 7fa8eef86700 1 -- start start 2023-07-21T22:14:34.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8eef86700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8e80c9990 0x7fa8e8157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:34.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8eef86700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8e81564c0 0x7fa8e8165070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:34.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8eef86700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8e815c890 0x7fa8e81427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:34.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8eef86700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e81655b0 con 0x7fa8e80c9990 2023-07-21T22:14:34.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8eef86700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e81457f0 con 0x7fa8e815c890 2023-07-21T22:14:34.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8eef86700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e8142d10 con 0x7fa8e81564c0 2023-07-21T22:14:34.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8ecd22700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8e80c9990 0x7fa8e8157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:34.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8ecd22700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8e80c9990 0x7fa8e8157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58704/0 (socket says 172.21.15.49:58704) 2023-07-21T22:14:34.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8ecd22700 1 -- 172.21.15.49:0/3040224152 learned_addr learned my addr 172.21.15.49:0/3040224152 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8e7fff700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8e81564c0 0x7fa8e8165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8ed523700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8e815c890 0x7fa8e81427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8ecd22700 1 -- 172.21.15.49:0/3040224152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8e81564c0 msgr2=0x7fa8e8165070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8ecd22700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8e81564c0 0x7fa8e8165070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8ecd22700 1 -- 172.21.15.49:0/3040224152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8e815c890 msgr2=0x7fa8e81427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8ecd22700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8e815c890 0x7fa8e81427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8ecd22700 1 -- 172.21.15.49:0/3040224152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4009450 con 0x7fa8e80c9990 2023-07-21T22:14:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8e7fff700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8e81564c0 0x7fa8e8165070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8ed523700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8e815c890 0x7fa8e81427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8ecd22700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8e80c9990 0x7fa8e8157b70 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00e9d0 tx=0x7fa8dc00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8e57fa700 1 -- 172.21.15.49:0/3040224152 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc009720 con 0x7fa8e80c9990 2023-07-21T22:14:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8e57fa700 1 -- 172.21.15.49:0/3040224152 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8dc00c850 con 0x7fa8e80c9990 2023-07-21T22:14:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8eef86700 1 -- 172.21.15.49:0/3040224152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e8165800 con 0x7fa8e80c9990 2023-07-21T22:14:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8e57fa700 1 -- 172.21.15.49:0/3040224152 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc00cbc0 con 0x7fa8e80c9990 2023-07-21T22:14:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8eef86700 1 -- 172.21.15.49:0/3040224152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e8165dc0 con 0x7fa8e80c9990 2023-07-21T22:14:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.876+0000 7fa8eef86700 1 -- 172.21.15.49:0/3040224152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e804dd50 con 0x7fa8e80c9990 2023-07-21T22:14:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.880+0000 7fa8e57fa700 1 -- 172.21.15.49:0/3040224152 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa8dc00cd20 con 0x7fa8e80c9990 2023-07-21T22:14:34.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.880+0000 7fa8e57fa700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa8cc0662f0 0x7fa8cc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.880+0000 7fa8e57fa700 1 -- 172.21.15.49:0/3040224152 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fa8dc083ca0 con 0x7fa8e80c9990 2023-07-21T22:14:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.880+0000 7fa8e7fff700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa8cc0662f0 0x7fa8cc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:34.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.884+0000 7fa8e7fff700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa8cc0662f0 0x7fa8cc0687a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009fd0 tx=0x7fa8d4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:34.888+0000 7fa8e57fa700 1 -- 172.21.15.49:0/3040224152 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8dc054d80 con 0x7fa8e80c9990 2023-07-21T22:14:35.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.064+0000 7fa8eef86700 1 -- 172.21.15.49:0/3040224152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa8e815bfe0 con 0x7fa8e80c9990 2023-07-21T22:14:35.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.076+0000 7fa8e57fa700 1 -- 172.21.15.49:0/3040224152 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa8dc054910 con 0x7fa8e80c9990 2023-07-21T22:14:35.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.080+0000 7fa8eef86700 1 -- 172.21.15.49:0/3040224152 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa8cc0662f0 msgr2=0x7fa8cc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:35.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.080+0000 7fa8eef86700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa8cc0662f0 0x7fa8cc0687a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009fd0 tx=0x7fa8d4008030 comp rx=0 tx=0).stop 2023-07-21T22:14:35.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.080+0000 7fa8eef86700 1 -- 172.21.15.49:0/3040224152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8e80c9990 msgr2=0x7fa8e8157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:35.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.080+0000 7fa8eef86700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8e80c9990 0x7fa8e8157b70 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00e9d0 tx=0x7fa8dc00ed90 comp rx=0 tx=0).stop 2023-07-21T22:14:35.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.080+0000 7fa8eef86700 1 -- 172.21.15.49:0/3040224152 shutdown_connections 2023-07-21T22:14:35.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.080+0000 7fa8eef86700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa8cc0662f0 0x7fa8cc0687a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:35.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.080+0000 7fa8eef86700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8e815c890 0x7fa8e81427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:35.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.080+0000 7fa8eef86700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8e81564c0 0x7fa8e8165070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:35.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.080+0000 7fa8eef86700 1 --2- 172.21.15.49:0/3040224152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8e80c9990 0x7fa8e8157b70 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:35.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.080+0000 7fa8eef86700 1 -- 172.21.15.49:0/3040224152 >> 172.21.15.49:0/3040224152 conn(0x7fa8e806e960 msgr2=0x7fa8e806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:35.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.080+0000 7fa8eef86700 1 -- 172.21.15.49:0/3040224152 shutdown_connections 2023-07-21T22:14:35.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.080+0000 7fa8eef86700 1 -- 172.21.15.49:0/3040224152 wait complete. 2023-07-21T22:14:35.148 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-07-21T22:14:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.280+0000 7fbe4dd15700 1 Processor -- start 2023-07-21T22:14:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.280+0000 7fbe4dd15700 1 -- start start 2023-07-21T22:14:35.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe4dd15700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbe48160370 0x7fbe4806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:35.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe4dd15700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe480c1470 0x7fbe480c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:35.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe4dd15700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4806e010 con 0x7fbe480ca2c0 2023-07-21T22:14:35.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe4dd15700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe48160740 con 0x7fbe480c1470 2023-07-21T22:14:35.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe4dd15700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe480ccc50 con 0x7fbe48160370 2023-07-21T22:14:35.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe47fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe480c1470 0x7fbe480c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:35.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe4cd13700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbe48160370 0x7fbe4806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:35.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe4cd13700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbe48160370 0x7fbe4806d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:51406/0 (socket says 172.21.15.49:51406) 2023-07-21T22:14:35.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe4cd13700 1 -- 172.21.15.49:0/57360673 learned_addr learned my addr 172.21.15.49:0/57360673 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:35.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe4d514700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fbe480ca2c0 0x7fbe480caa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:54926/0 (socket says 172.21.15.49:54926) 2023-07-21T22:14:35.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe4cd13700 1 -- 172.21.15.49:0/57360673 >> v2:172.21.15.49:3300/0 conn(0x7fbe480c1470 msgr2=0x7fbe480c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:35.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe4cd13700 1 --2- 172.21.15.49:0/57360673 >> v2:172.21.15.49:3300/0 conn(0x7fbe480c1470 0x7fbe480c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:35.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe4cd13700 1 -- 172.21.15.49:0/57360673 >> v1:172.21.15.150:6789/0 conn(0x7fbe480ca2c0 legacy=0x7fbe480caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:35.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe4cd13700 1 -- 172.21.15.49:0/57360673 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe480afc90 con 0x7fbe48160370 2023-07-21T22:14:35.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.284+0000 7fbe477fe700 1 -- 172.21.15.49:0/57360673 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108098355 0 0) 0x7fbe4806e010 con 0x7fbe480ca2c0 2023-07-21T22:14:35.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.288+0000 7fbe4cd13700 1 --2- 172.21.15.49:0/57360673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe48160370 0x7fbe4806d7e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbe480cbbc0 tx=0x7fbe3c009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c7a8a55f0742b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:35.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.288+0000 7fbe477fe700 1 -- 172.21.15.49:0/57360673 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c011830 con 0x7fbe48160370 2023-07-21T22:14:35.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.288+0000 7fbe477fe700 1 -- 172.21.15.49:0/57360673 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c011990 con 0x7fbe48160370 2023-07-21T22:14:35.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.288+0000 7fbe477fe700 1 -- 172.21.15.49:0/57360673 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c011d20 con 0x7fbe48160370 2023-07-21T22:14:35.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.288+0000 7fbe4dd15700 1 -- 172.21.15.49:0/57360673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe48160370 msgr2=0x7fbe4806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:35.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.288+0000 7fbe4dd15700 1 --2- 172.21.15.49:0/57360673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe48160370 0x7fbe4806d7e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbe480cbbc0 tx=0x7fbe3c009bf0 comp rx=0 tx=0).stop 2023-07-21T22:14:35.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.288+0000 7fbe4dd15700 1 -- 172.21.15.49:0/57360673 shutdown_connections 2023-07-21T22:14:35.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.288+0000 7fbe4dd15700 1 --2- 172.21.15.49:0/57360673 >> v2:172.21.15.49:3300/0 conn(0x7fbe480c1470 0x7fbe480c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:35.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.288+0000 7fbe4dd15700 1 --2- 172.21.15.49:0/57360673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe48160370 0x7fbe4806d7e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:35.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.288+0000 7fbe4dd15700 1 -- 172.21.15.49:0/57360673 >> 172.21.15.49:0/57360673 conn(0x7fbe48070450 msgr2=0x7fbe48070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:35.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.288+0000 7fbe4dd15700 1 -- 172.21.15.49:0/57360673 shutdown_connections 2023-07-21T22:14:35.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.288+0000 7fbe4dd15700 1 -- 172.21.15.49:0/57360673 wait complete. 2023-07-21T22:14:35.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4dd15700 1 Processor -- start 2023-07-21T22:14:35.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4dd15700 1 -- start start 2023-07-21T22:14:35.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4dd15700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe480c1470 0x7fbe4814eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:35.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4dd15700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe480ca2c0 0x7fbe480b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:35.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4dd15700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe48160370 0x7fbe48151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:35.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4dd15700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4814f3e0 con 0x7fbe480c1470 2023-07-21T22:14:35.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4dd15700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480b28d0 con 0x7fbe480ca2c0 2023-07-21T22:14:35.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4dd15700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480b2bb0 con 0x7fbe48160370 2023-07-21T22:14:35.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4cd13700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe480c1470 0x7fbe4814eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:35.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4cd13700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe480c1470 0x7fbe4814eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58728/0 (socket says 172.21.15.49:58728) 2023-07-21T22:14:35.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4cd13700 1 -- 172.21.15.49:0/2154014252 learned_addr learned my addr 172.21.15.49:0/2154014252 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:35.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4d514700 1 --2- 172.21.15.49:0/2154014252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe48160370 0x7fbe48151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:35.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe47fff700 1 --2- 172.21.15.49:0/2154014252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe480ca2c0 0x7fbe480b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:35.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4cd13700 1 -- 172.21.15.49:0/2154014252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe48160370 msgr2=0x7fbe48151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4cd13700 1 --2- 172.21.15.49:0/2154014252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe48160370 0x7fbe48151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4cd13700 1 -- 172.21.15.49:0/2154014252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe480ca2c0 msgr2=0x7fbe480b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4cd13700 1 --2- 172.21.15.49:0/2154014252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe480ca2c0 0x7fbe480b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.292+0000 7fbe4cd13700 1 -- 172.21.15.49:0/2154014252 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c009570 con 0x7fbe480c1470 2023-07-21T22:14:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.296+0000 7fbe4cd13700 1 --2- 172.21.15.49:0/2154014252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe480c1470 0x7fbe4814eea0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c000c00 tx=0x7fbe3c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.296+0000 7fbe457fa700 1 -- 172.21.15.49:0/2154014252 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c004610 con 0x7fbe480c1470 2023-07-21T22:14:35.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.296+0000 7fbe457fa700 1 -- 172.21.15.49:0/2154014252 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c01e070 con 0x7fbe480c1470 2023-07-21T22:14:35.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.296+0000 7fbe4dd15700 1 -- 172.21.15.49:0/2154014252 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe480b2e90 con 0x7fbe480c1470 2023-07-21T22:14:35.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.296+0000 7fbe457fa700 1 -- 172.21.15.49:0/2154014252 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c0038e0 con 0x7fbe480c1470 2023-07-21T22:14:35.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.296+0000 7fbe4dd15700 1 -- 172.21.15.49:0/2154014252 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe480b3450 con 0x7fbe480c1470 2023-07-21T22:14:35.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.296+0000 7fbe4dd15700 1 -- 172.21.15.49:0/2154014252 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe480b3640 con 0x7fbe480c1470 2023-07-21T22:14:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.296+0000 7fbe457fa700 1 -- 172.21.15.49:0/2154014252 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbe3c003a40 con 0x7fbe480c1470 2023-07-21T22:14:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.300+0000 7fbe457fa700 1 --2- 172.21.15.49:0/2154014252 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbe2c0662f0 0x7fbe2c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:35.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.300+0000 7fbe457fa700 1 -- 172.21.15.49:0/2154014252 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fbe3c0846e0 con 0x7fbe480c1470 2023-07-21T22:14:35.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.300+0000 7fbe47fff700 1 --2- 172.21.15.49:0/2154014252 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbe2c0662f0 0x7fbe2c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:35.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.300+0000 7fbe47fff700 1 --2- 172.21.15.49:0/2154014252 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbe2c0662f0 0x7fbe2c0687a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbe34009b80 tx=0x7fbe34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:35.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.308+0000 7fbe457fa700 1 -- 172.21.15.49:0/2154014252 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbe3c051ed0 con 0x7fbe480c1470 2023-07-21T22:14:35.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.544+0000 7fbe4dd15700 1 -- 172.21.15.49:0/2154014252 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7fbe480aff40 con 0x7fbe480c1470 2023-07-21T22:14:35.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.652+0000 7fbe457fa700 1 -- 172.21.15.49:0/2154014252 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v239) v1 ==== 134+0+0 (secure 0 0 0) 0x7fbe3c02b350 con 0x7fbe480c1470 2023-07-21T22:14:35.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.656+0000 7fbe4dd15700 1 -- 172.21.15.49:0/2154014252 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbe2c0662f0 msgr2=0x7fbe2c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:35.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.656+0000 7fbe4dd15700 1 --2- 172.21.15.49:0/2154014252 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbe2c0662f0 0x7fbe2c0687a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbe34009b80 tx=0x7fbe34008040 comp rx=0 tx=0).stop 2023-07-21T22:14:35.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.656+0000 7fbe4dd15700 1 -- 172.21.15.49:0/2154014252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe480c1470 msgr2=0x7fbe4814eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:35.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.656+0000 7fbe4dd15700 1 --2- 172.21.15.49:0/2154014252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe480c1470 0x7fbe4814eea0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c000c00 tx=0x7fbe3c004770 comp rx=0 tx=0).stop 2023-07-21T22:14:35.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.656+0000 7fbe4dd15700 1 -- 172.21.15.49:0/2154014252 shutdown_connections 2023-07-21T22:14:35.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.656+0000 7fbe4dd15700 1 --2- 172.21.15.49:0/2154014252 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbe2c0662f0 0x7fbe2c0687a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:35.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.656+0000 7fbe4dd15700 1 --2- 172.21.15.49:0/2154014252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe48160370 0x7fbe48151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:35.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.656+0000 7fbe4dd15700 1 --2- 172.21.15.49:0/2154014252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe480ca2c0 0x7fbe480b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:35.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.656+0000 7fbe4dd15700 1 --2- 172.21.15.49:0/2154014252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe480c1470 0x7fbe4814eea0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:35.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.656+0000 7fbe4dd15700 1 -- 172.21.15.49:0/2154014252 >> 172.21.15.49:0/2154014252 conn(0x7fbe48070450 msgr2=0x7fbe480ada60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:35.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.656+0000 7fbe4dd15700 1 -- 172.21.15.49:0/2154014252 shutdown_connections 2023-07-21T22:14:35.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:35.656+0000 7fbe4dd15700 1 -- 172.21.15.49:0/2154014252 wait complete. 2023-07-21T22:14:35.723 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ERROR 2023-07-21T22:14:35.723 INFO:tasks.cephfs_test_runner: 2023-07-21T22:14:35.724 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-21T22:14:35.724 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-07-21T22:14:35.724 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-21T22:14:35.724 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-21T22:14:35.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2023-07-21T22:14:35.725 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2023-07-21T22:14:35.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/cephfs/mount.py", line 771, in run_python 2023-07-21T22:14:35.725 INFO:tasks.cephfs_test_runner: p.wait() 2023-07-21T22:14:35.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 161, in wait 2023-07-21T22:14:35.726 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-07-21T22:14:35.726 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-07-21T22:14:35.726 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-07-21T22:14:35.726 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi049 with status 1: 'adjust-ulimits daemon-helper kill python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2023-07-21T22:14:35.726 INFO:tasks.cephfs_test_runner: 2023-07-21T22:14:35.727 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-21T22:14:35.727 INFO:tasks.cephfs_test_runner:Ran 2 tests in 177.342s 2023-07-21T22:14:35.727 INFO:tasks.cephfs_test_runner: 2023-07-21T22:14:35.727 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-07-21T22:14:35.727 INFO:tasks.cephfs_test_runner: 2023-07-21T22:14:35.728 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-21T22:14:35.728 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-07-21T22:14:35.728 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-21T22:14:35.728 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-21T22:14:35.729 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2023-07-21T22:14:35.729 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2023-07-21T22:14:35.729 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/cephfs/mount.py", line 771, in run_python 2023-07-21T22:14:35.729 INFO:tasks.cephfs_test_runner: p.wait() 2023-07-21T22:14:35.729 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 161, in wait 2023-07-21T22:14:35.730 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-07-21T22:14:35.730 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-07-21T22:14:35.730 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-07-21T22:14:35.730 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi049 with status 1: 'adjust-ulimits daemon-helper kill python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2023-07-21T22:14:35.730 INFO:tasks.cephfs_test_runner: 2023-07-21T22:14:35.731 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-07-21T22:14:35.791 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8b1cbdcf96434237880612fbe97d8047 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-07-21T22:14:35.793 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-07-21T22:14:35.848 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-07-21T22:14:35.856 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-07-21T22:14:35.857 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:14:35.857 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:14:40.882 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352276k,nr_inodes=4088069,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13711 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:14:40.882 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-07-21T22:14:40.883 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:14:40.941 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352276k,nr_inodes=4088069,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13711 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:14:40.941 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:14:40.942 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:14:40.959 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352340k,nr_inodes=4088085,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2732 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:14:40.959 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-07-21T22:14:40.959 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:14:41.018 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352340k,nr_inodes=4088085,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2732 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:14:41.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:41.020 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-07-21T22:14:41.079 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-21T22:14:41.079 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-21T22:14:41.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:41.080 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-21T22:14:41.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:41.158 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-21T22:14:41.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:41.263 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2023-07-21T22:14:41.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:41.437 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-07-21T22:14:41.456 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:14:41.457 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:14:41.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:41.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:14:41.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:41.535 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:14:41.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:14:41.637 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2023-07-21T22:14:41.791 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-21T22:14:41.801 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-21T22:14:41.802 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:14:41.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.944+0000 7fbf7f107700 1 Processor -- start 2023-07-21T22:14:41.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.944+0000 7fbf7f107700 1 -- start start 2023-07-21T22:14:41.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.944+0000 7fbf7f107700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf78071c70 0x7fbf780b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:41.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.944+0000 7fbf7f107700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf780b1400 0x7fbf780cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:41.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.944+0000 7fbf7f107700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf780cab20 con 0x7fbf7806d380 2023-07-21T22:14:41.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.944+0000 7fbf7f107700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf780c9e80 con 0x7fbf780b1400 2023-07-21T22:14:41.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.944+0000 7fbf7f107700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780afeb0 con 0x7fbf78071c70 2023-07-21T22:14:41.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.944+0000 7fbf7e906700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf780b1400 0x7fbf780cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:41.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.944+0000 7fbf7e906700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf780b1400 0x7fbf780cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58744/0 (socket says 172.21.15.49:58744) 2023-07-21T22:14:41.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.944+0000 7fbf7e906700 1 -- 172.21.15.49:0/1770147360 learned_addr learned my addr 172.21.15.49:0/1770147360 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:41.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.944+0000 7fbf7d904700 1 --2- 172.21.15.49:0/1770147360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf78071c70 0x7fbf780b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:41.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7e906700 1 -- 172.21.15.49:0/1770147360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf78071c70 msgr2=0x7fbf780b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:41.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7e906700 1 --2- 172.21.15.49:0/1770147360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf78071c70 0x7fbf780b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:41.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7e906700 1 -- 172.21.15.49:0/1770147360 >> v1:172.21.15.49:6789/0 conn(0x7fbf7806d380 legacy=0x7fbf7806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:41.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7e906700 1 -- 172.21.15.49:0/1770147360 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780ca1f0 con 0x7fbf780b1400 2023-07-21T22:14:41.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7d904700 1 --2- 172.21.15.49:0/1770147360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf78071c70 0x7fbf780b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:41.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7e906700 1 --2- 172.21.15.49:0/1770147360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf780b1400 0x7fbf780cafb0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009e50 tx=0x7fbf7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e677a493d7f63c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:42.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7d103700 1 -- 172.21.15.49:0/1770147360 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7000e070 con 0x7fbf780b1400 2023-07-21T22:14:42.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7d103700 1 -- 172.21.15.49:0/1770147360 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7000b9c0 con 0x7fbf780b1400 2023-07-21T22:14:42.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7d103700 1 -- 172.21.15.49:0/1770147360 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7000bd70 con 0x7fbf780b1400 2023-07-21T22:14:42.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7f107700 1 -- 172.21.15.49:0/1770147360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf780b1400 msgr2=0x7fbf780cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7f107700 1 --2- 172.21.15.49:0/1770147360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf780b1400 0x7fbf780cafb0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009e50 tx=0x7fbf7000b330 comp rx=0 tx=0).stop 2023-07-21T22:14:42.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7f107700 1 -- 172.21.15.49:0/1770147360 shutdown_connections 2023-07-21T22:14:42.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7f107700 1 --2- 172.21.15.49:0/1770147360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf780b1400 0x7fbf780cafb0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7f107700 1 --2- 172.21.15.49:0/1770147360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf78071c70 0x7fbf780b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7f107700 1 -- 172.21.15.49:0/1770147360 >> 172.21.15.49:0/1770147360 conn(0x7fbf78070450 msgr2=0x7fbf78070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:42.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7f107700 1 -- 172.21.15.49:0/1770147360 shutdown_connections 2023-07-21T22:14:42.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.948+0000 7fbf7f107700 1 -- 172.21.15.49:0/1770147360 wait complete. 2023-07-21T22:14:42.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7f107700 1 Processor -- start 2023-07-21T22:14:42.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7f107700 1 -- start start 2023-07-21T22:14:42.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7f107700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf7806d380 0x7fbf780c2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7f107700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf78071c70 0x7fbf78157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7f107700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf780b1400 0x7fbf781f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7f107700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780c19b0 con 0x7fbf78071c70 2023-07-21T22:14:42.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7f107700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf781f58c0 con 0x7fbf7806d380 2023-07-21T22:14:42.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7f107700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf781f5ba0 con 0x7fbf780b1400 2023-07-21T22:14:42.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7d904700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf78071c70 0x7fbf78157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7d904700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf78071c70 0x7fbf78157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58754/0 (socket says 172.21.15.49:58754) 2023-07-21T22:14:42.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7d904700 1 -- 172.21.15.49:0/114142968 learned_addr learned my addr 172.21.15.49:0/114142968 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:42.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7e105700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf7806d380 0x7fbf780c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7e906700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf780b1400 0x7fbf781f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7d904700 1 -- 172.21.15.49:0/114142968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf780b1400 msgr2=0x7fbf781f4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7d904700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf780b1400 0x7fbf781f4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7d904700 1 -- 172.21.15.49:0/114142968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf7806d380 msgr2=0x7fbf780c2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7d904700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf7806d380 0x7fbf780c2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7d904700 1 -- 172.21.15.49:0/114142968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf70009b30 con 0x7fbf78071c70 2023-07-21T22:14:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7e906700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf780b1400 0x7fbf781f4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.952+0000 7fbf7d904700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf78071c70 0x7fbf78157f00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800c770 tx=0x7fbf6800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:42.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.956+0000 7fbf6effd700 1 -- 172.21.15.49:0/114142968 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf68011800 con 0x7fbf78071c70 2023-07-21T22:14:42.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.956+0000 7fbf6effd700 1 -- 172.21.15.49:0/114142968 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf68011960 con 0x7fbf78071c70 2023-07-21T22:14:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.956+0000 7fbf6effd700 1 -- 172.21.15.49:0/114142968 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf68011d10 con 0x7fbf78071c70 2023-07-21T22:14:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.956+0000 7fbf7f107700 1 -- 172.21.15.49:0/114142968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf780c1c00 con 0x7fbf78071c70 2023-07-21T22:14:42.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.956+0000 7fbf7f107700 1 -- 172.21.15.49:0/114142968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf780c2940 con 0x7fbf78071c70 2023-07-21T22:14:42.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.956+0000 7fbf7f107700 1 -- 172.21.15.49:0/114142968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf780c2120 con 0x7fbf78071c70 2023-07-21T22:14:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.956+0000 7fbf6effd700 1 -- 172.21.15.49:0/114142968 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf68018360 con 0x7fbf78071c70 2023-07-21T22:14:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.960+0000 7fbf6effd700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf5c0662f0 0x7fbf5c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.960+0000 7fbf6effd700 1 -- 172.21.15.49:0/114142968 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fbf68083c30 con 0x7fbf78071c70 2023-07-21T22:14:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.960+0000 7fbf7e105700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf5c0662f0 0x7fbf5c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.960+0000 7fbf7e105700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf5c0662f0 0x7fbf5c0687a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbf74000f60 tx=0x7fbf74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:42.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:41.964+0000 7fbf6effd700 1 -- 172.21.15.49:0/114142968 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf780c2120 con 0x7fbf78071c70 2023-07-21T22:14:42.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.136+0000 7fbf7f107700 1 -- 172.21.15.49:0/114142968 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf780ca7b0 con 0x7fbf5c0662f0 2023-07-21T22:14:42.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.136+0000 7fbf6effd700 1 -- 172.21.15.49:0/114142968 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70461 (secure 0 0 0) 0x7fbf740050d0 con 0x7fbf5c0662f0 2023-07-21T22:14:42.184 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:42.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.140+0000 7fbf7f107700 1 -- 172.21.15.49:0/114142968 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf5c0662f0 msgr2=0x7fbf5c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.140+0000 7fbf7f107700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf5c0662f0 0x7fbf5c0687a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbf74000f60 tx=0x7fbf74009040 comp rx=0 tx=0).stop 2023-07-21T22:14:42.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.140+0000 7fbf7f107700 1 -- 172.21.15.49:0/114142968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf78071c70 msgr2=0x7fbf78157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.140+0000 7fbf7f107700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf78071c70 0x7fbf78157f00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800c770 tx=0x7fbf6800cb30 comp rx=0 tx=0).stop 2023-07-21T22:14:42.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.140+0000 7fbf7f107700 1 -- 172.21.15.49:0/114142968 shutdown_connections 2023-07-21T22:14:42.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.140+0000 7fbf7f107700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fbf5c0662f0 0x7fbf5c0687a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.140+0000 7fbf7f107700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf78071c70 0x7fbf78157f00 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.140+0000 7fbf7f107700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf780b1400 0x7fbf781f4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.140+0000 7fbf7f107700 1 --2- 172.21.15.49:0/114142968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf7806d380 0x7fbf780c2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.140+0000 7fbf7f107700 1 -- 172.21.15.49:0/114142968 >> 172.21.15.49:0/114142968 conn(0x7fbf78070450 msgr2=0x7fbf780cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:42.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.140+0000 7fbf7f107700 1 -- 172.21.15.49:0/114142968 shutdown_connections 2023-07-21T22:14:42.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.140+0000 7fbf7f107700 1 -- 172.21.15.49:0/114142968 wait complete. 2023-07-21T22:14:42.189 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:14:42.209 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2023-07-21T22:14:40.392689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":251692,"kb_used_data":7404,"kb_used_omap":0,"kb_used_meta":244224,"kb_avail":754723028,"statfs":{"total":773094113280,"available":772836380672,"internally_reserved":0,"allocated":7581696,"data_stored":4178207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":250085376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16523,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-72,"num_write_kb":-40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-90,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002525"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.606443+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:14:35.606443+0000","last_peered":"2023-07-21T22:14:35.606443+0000","last_clean":"2023-07-21T22:14:35.606443+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:14:35.606443+0000","last_undegraded":"2023-07-21T22:14:35.606443+0000","last_fullsized":"2023-07-21T22:14:35.606443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:46.212083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-21T22:14:34.234991+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:14:34.234991+0000","last_peered":"2023-07-21T22:14:34.234991+0000","last_clean":"2023-07-21T22:14:34.234991+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:14:34.234991+0000","last_undegraded":"2023-07-21T22:14:34.234991+0000","last_fullsized":"2023-07-21T22:14:34.234991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:00:19.307255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.606977+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:14:35.606977+0000","last_peered":"2023-07-21T22:14:35.606977+0000","last_clean":"2023-07-21T22:14:35.606977+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:14:35.606977+0000","last_undegraded":"2023-07-21T22:14:35.606977+0000","last_fullsized":"2023-07-21T22:14:35.606977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:13:04.979273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-21T22:14:34.237084+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:14:34.237084+0000","last_peered":"2023-07-21T22:14:34.237084+0000","last_clean":"2023-07-21T22:14:34.237084+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:14:34.237084+0000","last_undegraded":"2023-07-21T22:14:34.237084+0000","last_fullsized":"2023-07-21T22:14:34.237084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:48:37.490972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:34.655460+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:14:34.655460+0000","last_peered":"2023-07-21T22:14:34.655460+0000","last_clean":"2023-07-21T22:14:34.655460+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:14:34.655460+0000","last_undegraded":"2023-07-21T22:14:34.655460+0000","last_fullsized":"2023-07-21T22:14:34.655460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:50:35.167252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.603869+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:14:35.603869+0000","last_peered":"2023-07-21T22:14:35.603869+0000","last_clean":"2023-07-21T22:14:35.603869+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:14:35.603869+0000","last_undegraded":"2023-07-21T22:14:35.603869+0000","last_fullsized":"2023-07-21T22:14:35.603869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:07:15.704727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.604241+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:14:35.604241+0000","last_peered":"2023-07-21T22:14:35.604241+0000","last_clean":"2023-07-21T22:14:35.604241+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:14:35.604241+0000","last_undegraded":"2023-07-21T22:14:35.604241+0000","last_fullsized":"2023-07-21T22:14:35.604241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:46:30.446720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:34.658467+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:14:34.658467+0000","last_peered":"2023-07-21T22:14:34.658467+0000","last_clean":"2023-07-21T22:14:34.658467+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:14:34.658467+0000","last_undegraded":"2023-07-21T22:14:34.658467+0000","last_fullsized":"2023-07-21T22:14:34.658467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:21.733748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":247,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.604482+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:14:35.604482+0000","last_peered":"2023-07-21T22:14:35.604482+0000","last_clean":"2023-07-21T22:14:35.604482+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:14:35.604482+0000","last_undegraded":"2023-07-21T22:14:35.604482+0000","last_fullsized":"2023-07-21T22:14:35.604482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:09:04.332487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1400832,"data_stored":968271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.75900000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4810000000000001,"5min":2.218,"15min":2.218},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2589999999999999,"15min":1.3029999999999999},"min":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.736,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1739999999999999,"15min":1.2110000000000001},"min":{"1min":0.77300000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4870000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.099},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.2,"15min":1.2609999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.645,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":0.91800000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.1850000000000001,"15min":1.2170000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.349,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2430000000000001,"15min":1.2889999999999999},"min":{"1min":0.77200000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.534,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.996}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.256,"15min":1.286},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5069999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3129999999999999,"15min":1.4019999999999999},"min":{"1min":0.753,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6899999999999999,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.28}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1830000000000001,"15min":1.2230000000000001},"min":{"1min":0.80600000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.514,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2749999999999999,"15min":1.3240000000000001},"min":{"1min":0.75700000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.53,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.83499999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3380000000000001,"15min":1.3620000000000001},"min":{"1min":0.65400000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.9930000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.347},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3009999999999999,"15min":1.365},"min":{"1min":0.72699999999999998,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7849999999999999,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.97099999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.421,"15min":1.486},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.8280000000000001,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.046},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.377,"15min":1.415},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.7370000000000001,"5min":2.476,"15min":2.476},"last":1.3169999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509496,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0980000000000001,"15min":1.1160000000000001},"min":{"1min":0.69099999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.502,"5min":1.657,"15min":1.657},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.109,"15min":1.1399999999999999},"min":{"1min":0.73999999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4390000000000001,"5min":2.802,"15min":2.802},"last":1.454}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.204,"15min":1.242},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.194,"15min":1.244},"min":{"1min":0.82499999999999996,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.548,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.0269999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2250000000000001,"15min":1.2649999999999999},"min":{"1min":0.97599999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6299999999999999,"5min":2.911,"15min":2.911},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2589999999999999,"15min":1.345},"min":{"1min":0.76100000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.0590000000000002,"5min":2.379,"15min":2.379},"last":1.1160000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3320000000000001,"15min":1.411},"min":{"1min":0.92800000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9710000000000001,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.319,"15min":1.393},"min":{"1min":0.97799999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6200000000000001,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":1.1850000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2729999999999999},"min":{"1min":0.85699999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.8049999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3180000000000001,"15min":1.375},"min":{"1min":0.88200000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6719999999999999,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.23}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.355,"15min":1.3899999999999999},"min":{"1min":0.79200000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.161,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.369},{"interface":"front","average":{"1min":1.357,"5min":1.415,"15min":1.4450000000000001},"min":{"1min":1.004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9139999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.4770000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.411,"15min":1.4370000000000001},"min":{"1min":1.115,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9359999999999999,"5min":4.194,"15min":4.194},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.456,"5min":1.502,"15min":1.5429999999999999},"min":{"1min":0.91600000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.1139999999999999,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.417}]}]},{"osd":5,"up_from":15,"seq":64424509495,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.63200000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.171},{"interface":"front","average":{"1min":1.081,"5min":1.115,"15min":1.1359999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.478,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.502}]},{"osd":1,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1599999999999999,"15min":1.1990000000000001},"min":{"1min":0.92100000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.089},{"interface":"front","average":{"1min":1.181,"5min":1.157,"15min":1.1830000000000001},"min":{"1min":0.85399999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":3.4820000000000002,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":1.2709999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.161,"15min":1.1659999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.556,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.218},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.2450000000000001,"15min":1.296},"min":{"1min":0.76500000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.724,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.0009999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.218,"15min":1.2470000000000001},"min":{"1min":0.752,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.3600000000000001,"15min":1.3979999999999999},"min":{"1min":1.056,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.6679999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.3260000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.274,"15min":1.3260000000000001},"min":{"1min":0.86399999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.577,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.288,"15min":1.3029999999999999},"min":{"1min":0.93300000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5720000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.3700000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.2210000000000001,"15min":1.2709999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.498,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.224,"5min":1.2889999999999999,"15min":1.3300000000000001},"min":{"1min":0.88800000000000001,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.536,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.79700000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.266,"15min":1.298},"min":{"1min":0.88900000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7589999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.448,"15min":1.506},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.623,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.429}]}]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.105,"15min":1.101},"min":{"1min":0.54900000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.546,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.302},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.169},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5720000000000001,"5min":1.617,"15min":1.617},"last":1.716}]},{"osd":1,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2210000000000001,"15min":1.234},"min":{"1min":0.77800000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.661,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.476},{"interface":"front","average":{"1min":1.274,"5min":1.2090000000000001,"15min":1.2010000000000001},"min":{"1min":0.79800000000000004,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.6879999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.129,"15min":1.135},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.3240000000000001,"5min":1.609,"15min":1.609},"last":1.208},{"interface":"front","average":{"1min":1.288,"5min":1.2749999999999999,"15min":1.2989999999999999},"min":{"1min":1.002,"5min":0.621,"15min":0.621},"max":{"1min":1.637,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.0349999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.258,"15min":1.302},"min":{"1min":0.93799999999999994,"5min":0.745,"15min":0.745},"max":{"1min":1.833,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.2270000000000001,"15min":1.23},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.51,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.7969999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.246,"15min":1.294},"min":{"1min":0.82899999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.573,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.385},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.254,"15min":1.24},"min":{"1min":0.89400000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.643,"5min":1.794,"15min":1.794},"last":1.5389999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1899999999999999,"15min":1.1970000000000001},"min":{"1min":0.80700000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8160000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.591},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.369,"15min":1.417},"min":{"1min":0.90400000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6879999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.78}]},{"osd":7,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3999999999999999,"15min":1.3740000000000001},"min":{"1min":0.999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.7450000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4019999999999999,"15min":1.4059999999999999},"min":{"1min":1.0169999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6100000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":2.077}]}]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":790528,"data_stored":371597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.90600000000000003,"15min":0.92600000000000005},"min":{"1min":0.64300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.484,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60099999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.9830000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.409}]},{"osd":1,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90400000000000003,"15min":0.93899999999999995},"min":{"1min":0.66100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6000000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.998,"5min":1.05,"15min":1.1180000000000001},"min":{"1min":0.65200000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5249999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.5249999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.109,"15min":1.113},"min":{"1min":0.69999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.52,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.206,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.82199999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.0389999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":1.0029999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.679,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.294},{"interface":"front","average":{"1min":1.286,"5min":1.276,"15min":1.329},"min":{"1min":0.90100000000000002,"5min":0.751,"15min":0.751},"max":{"1min":1.9350000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.1659999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.294,"15min":1.3360000000000001},"min":{"1min":1.028,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.651,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.413,"15min":1.4590000000000001},"min":{"1min":0.92000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.6890000000000001,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.22}]},{"osd":6,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.337,"15min":1.367},"min":{"1min":1.032,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0379999999999998,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.577},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.3959999999999999,"15min":1.444},"min":{"1min":0.92500000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.7709999999999999,"5min":2.161,"15min":2.161},"last":1.7709999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4370000000000001,"15min":1.4990000000000001},"min":{"1min":1.0249999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7789999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.631},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4890000000000001,"15min":1.5469999999999999},"min":{"1min":1.196,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.6399999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.365}]}]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":778240,"data_stored":364762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85999999999999999,"15min":0.876},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.222,"5min":1.0589999999999999,"15min":1.044},"min":{"1min":0.70999999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":7.0300000000000002,"5min":7.0300000000000002,"15min":7.0300000000000002},"last":1.371}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.94599999999999995,"15min":0.95899999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.109,"15min":1.121},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":0.71899999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1299999999999999,"15min":1.1399999999999999},"min":{"1min":0.76400000000000001,"5min":0.501,"15min":0.501},"max":{"1min":3.5070000000000001,"5min":3.5070000000000001,"15min":3.5070000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.147,"15min":1.161},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":0.88900000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.391,"15min":1.4179999999999999},"min":{"1min":1.0580000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1840000000000002,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.008},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.45,"15min":1.5009999999999999},"min":{"1min":1.026,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.516,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.2689999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.486,"15min":1.5089999999999999},"min":{"1min":1.1060000000000001,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":3.0870000000000002,"5min":3.331,"15min":3.331},"last":1.135},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5069999999999999,"15min":1.5509999999999999},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":3.238,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.1799999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4370000000000001,"15min":1.4570000000000001},"min":{"1min":1.0669999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.399,"5min":2.633,"15min":2.633},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.427,"15min":1.46},"min":{"1min":1.0900000000000001,"5min":0.878,"15min":0.878},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.3160000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.4550000000000001,"15min":1.482},"min":{"1min":1.121,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.137,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.583,"5min":1.534,"15min":1.5640000000000001},"min":{"1min":1.095,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.4020000000000001,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.232}]}]},{"osd":0,"up_from":15,"seq":64424509494,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1400832,"data_stored":968271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.871,"15min":0.88600000000000001},"min":{"1min":0.57199999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.94899999999999995,"15min":0.97399999999999998},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.397,"5min":1.496,"15min":1.496},"last":1.3680000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.96499999999999997,"15min":0.94199999999999995},"min":{"1min":0.68200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4319999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.0449999999999999,"15min":1.0309999999999999},"min":{"1min":0.65800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.617,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.038}]},{"osd":3,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.68000000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3560000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1719999999999999,"15min":1.173},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.7050000000000001,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":1.3300000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.2410000000000001,"15min":1.2529999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.464,"5min":3.1779999999999999,"15min":3.1779999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3859999999999999,"15min":1.3899999999999999},"min":{"1min":1.0209999999999999,"5min":1,"15min":1},"max":{"1min":1.8100000000000001,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.2370000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.403,"15min":1.478},"min":{"1min":1.038,"5min":0.872,"15min":0.872},"max":{"1min":1.716,"5min":2.419,"15min":2.419},"last":1.512},{"interface":"front","average":{"1min":1.276,"5min":1.355,"15min":1.395},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.6359999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.3959999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4590000000000001,"15min":1.5129999999999999},"min":{"1min":1.069,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.919,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.581},{"interface":"front","average":{"1min":1.464,"5min":1.462,"15min":1.514},"min":{"1min":1.2010000000000001,"5min":1.038,"15min":1.038},"max":{"1min":1.895,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.6499999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4750000000000001,"15min":1.532},"min":{"1min":1.085,"5min":0.999,"15min":0.999},"max":{"1min":1.964,"5min":2.504,"15min":2.504},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.4379999999999999,"15min":1.494},"min":{"1min":1.0489999999999999,"5min":0.872,"15min":0.872},"max":{"1min":1.8520000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.6890000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542199,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":790528,"data_stored":371597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.872,"15min":0.89100000000000001},"min":{"1min":0.54100000000000004,"5min":0.247,"15min":0.247},"max":{"1min":1.2250000000000001,"5min":2.113,"15min":2.113},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":0.92900000000000005},"min":{"1min":0.629,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1180000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.72099999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.89400000000000002,"15min":0.89800000000000002},"min":{"1min":0.58699999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3819999999999999,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0660000000000001,"15min":1.1120000000000001},"min":{"1min":0.71399999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.4730000000000001,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":0.871}]},{"osd":3,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.2410000000000001,"15min":1.367},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.385,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.1359999999999999,"15min":1.234},"min":{"1min":0.76400000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.446,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":1.2909999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2689999999999999,"15min":1.306},"min":{"1min":0.89500000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5169999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.147},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2490000000000001,"15min":1.294},"min":{"1min":0.92600000000000005,"5min":0.377,"15min":0.377},"max":{"1min":1.607,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.2150000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.292,"15min":1.3520000000000001},"min":{"1min":0.85399999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.867,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3999999999999999,"15min":1.4730000000000001},"min":{"1min":1.0669999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.631,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.552}]},{"osd":6,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3680000000000001,"15min":1.4199999999999999},"min":{"1min":1.0089999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8360000000000001,"5min":2.238,"15min":2.238},"last":1.603},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3919999999999999,"15min":1.4359999999999999},"min":{"1min":0.89200000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.752,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.7909999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.4950000000000001,"15min":1.546},"min":{"1min":1.0449999999999999,"5min":0.624,"15min":0.624},"max":{"1min":1.788,"5min":4.391,"15min":4.391},"last":1.75},{"interface":"front","average":{"1min":1.361,"5min":1.448,"15min":1.506},"min":{"1min":1.0940000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.9099999999999999,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.3819999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:14:42.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:14:42.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.344+0000 7f46f1a00700 1 Processor -- start 2023-07-21T22:14:42.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.344+0000 7f46f1a00700 1 -- start start 2023-07-21T22:14:42.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46f1a00700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f46ec15bc50 0x7f46ec06bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46f1a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46ec0b5830 0x7f46ec0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46f1a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ec0b3630 con 0x7f46ec0b31b0 2023-07-21T22:14:42.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46f1a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec0d2d80 con 0x7f46ec0b5830 2023-07-21T22:14:42.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46f1a00700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec0b61f0 con 0x7f46ec15bc50 2023-07-21T22:14:42.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46ebfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46ec0b5830 0x7f46ec0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46ea7fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f46ec0b31b0 0x7f46ec15f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48024/0 (socket says 172.21.15.49:48024) 2023-07-21T22:14:42.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46ea7fc700 1 -- 172.21.15.49:0/111526291 learned_addr learned my addr 172.21.15.49:0/111526291 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46eaffd700 1 --2- 172.21.15.49:0/111526291 >> v2:172.21.15.150:3300/0 conn(0x7f46ec15bc50 0x7f46ec06bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46e9ffb700 1 -- 172.21.15.49:0/111526291 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101121021 0 0) 0x7f46ec0b3630 con 0x7f46ec0b31b0 2023-07-21T22:14:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46ebfff700 1 -- 172.21.15.49:0/111526291 >> v2:172.21.15.150:3300/0 conn(0x7f46ec15bc50 msgr2=0x7f46ec06bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46ebfff700 1 --2- 172.21.15.49:0/111526291 >> v2:172.21.15.150:3300/0 conn(0x7f46ec15bc50 0x7f46ec06bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46ebfff700 1 -- 172.21.15.49:0/111526291 >> v1:172.21.15.49:6789/0 conn(0x7f46ec0b31b0 legacy=0x7f46ec15f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46ebfff700 1 -- 172.21.15.49:0/111526291 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec0d2f90 con 0x7f46ec0b5830 2023-07-21T22:14:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.348+0000 7f46ebfff700 1 --2- 172.21.15.49:0/111526291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec0b5830 0x7f46ec0b5cb0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0d3d10 tx=0x7f46e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f089523dccef714 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.352+0000 7f46e9ffb700 1 -- 172.21.15.49:0/111526291 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e400e070 con 0x7f46ec0b5830 2023-07-21T22:14:42.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.352+0000 7f46e9ffb700 1 -- 172.21.15.49:0/111526291 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e400bb20 con 0x7f46ec0b5830 2023-07-21T22:14:42.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.352+0000 7f46e9ffb700 1 -- 172.21.15.49:0/111526291 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4012430 con 0x7f46ec0b5830 2023-07-21T22:14:42.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.352+0000 7f46f1a00700 1 -- 172.21.15.49:0/111526291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec0b5830 msgr2=0x7f46ec0b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.352+0000 7f46f1a00700 1 --2- 172.21.15.49:0/111526291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec0b5830 0x7f46ec0b5cb0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0d3d10 tx=0x7f46e400b330 comp rx=0 tx=0).stop 2023-07-21T22:14:42.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.352+0000 7f46f1a00700 1 -- 172.21.15.49:0/111526291 shutdown_connections 2023-07-21T22:14:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.352+0000 7f46f1a00700 1 --2- 172.21.15.49:0/111526291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec0b5830 0x7f46ec0b5cb0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.352+0000 7f46f1a00700 1 --2- 172.21.15.49:0/111526291 >> v2:172.21.15.150:3300/0 conn(0x7f46ec15bc50 0x7f46ec06bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.352+0000 7f46f1a00700 1 -- 172.21.15.49:0/111526291 >> 172.21.15.49:0/111526291 conn(0x7f46ec0d0830 msgr2=0x7f46ec0d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.352+0000 7f46f1a00700 1 -- 172.21.15.49:0/111526291 shutdown_connections 2023-07-21T22:14:42.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.352+0000 7f46f1a00700 1 -- 172.21.15.49:0/111526291 wait complete. 2023-07-21T22:14:42.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46f1a00700 1 Processor -- start 2023-07-21T22:14:42.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46f1a00700 1 -- start start 2023-07-21T22:14:42.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46f1a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec0b31b0 0x7f46ec06db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46f1a00700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46ec0b5830 0x7f46ec06e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46f1a00700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46ec15bc50 0x7f46ec0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46f1a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0cd8f0 con 0x7f46ec0b31b0 2023-07-21T22:14:42.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46f1a00700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0ca8e0 con 0x7f46ec15bc50 2023-07-21T22:14:42.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46f1a00700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0ccc70 con 0x7f46ec0b5830 2023-07-21T22:14:42.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46eaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec0b31b0 0x7f46ec06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46eaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec0b31b0 0x7f46ec06db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58762/0 (socket says 172.21.15.49:58762) 2023-07-21T22:14:42.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46eaffd700 1 -- 172.21.15.49:0/2719241351 learned_addr learned my addr 172.21.15.49:0/2719241351 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:42.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46ebfff700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46ec15bc50 0x7f46ec0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46ea7fc700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46ec0b5830 0x7f46ec06e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46eaffd700 1 -- 172.21.15.49:0/2719241351 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46ec0b5830 msgr2=0x7f46ec06e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46eaffd700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46ec0b5830 0x7f46ec06e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46eaffd700 1 -- 172.21.15.49:0/2719241351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46ec15bc50 msgr2=0x7f46ec0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46eaffd700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46ec15bc50 0x7f46ec0cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46eaffd700 1 -- 172.21.15.49:0/2719241351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e4009a70 con 0x7f46ec0b31b0 2023-07-21T22:14:42.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46ebfff700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46ec15bc50 0x7f46ec0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:42.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46eaffd700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec0b31b0 0x7f46ec06db10 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00e840 tx=0x7f46dc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:42.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46d3fff700 1 -- 172.21.15.49:0/2719241351 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0095a0 con 0x7f46ec0b31b0 2023-07-21T22:14:42.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46d3fff700 1 -- 172.21.15.49:0/2719241351 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc00c690 con 0x7f46ec0b31b0 2023-07-21T22:14:42.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46d3fff700 1 -- 172.21.15.49:0/2719241351 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00ca00 con 0x7f46ec0b31b0 2023-07-21T22:14:42.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.356+0000 7f46f1a00700 1 -- 172.21.15.49:0/2719241351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ec0ccf50 con 0x7f46ec0b31b0 2023-07-21T22:14:42.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.360+0000 7f46f1a00700 1 -- 172.21.15.49:0/2719241351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec0cd510 con 0x7f46ec0b31b0 2023-07-21T22:14:42.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.360+0000 7f46f1a00700 1 -- 172.21.15.49:0/2719241351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ec04dcb0 con 0x7f46ec0b31b0 2023-07-21T22:14:42.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.360+0000 7f46d3fff700 1 -- 172.21.15.49:0/2719241351 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f46dc00cb60 con 0x7f46ec0b31b0 2023-07-21T22:14:42.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.364+0000 7f46d3fff700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f46d80662f0 0x7f46d80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.364+0000 7f46d3fff700 1 -- 172.21.15.49:0/2719241351 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f46dc083ab0 con 0x7f46ec0b31b0 2023-07-21T22:14:42.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.364+0000 7f46ea7fc700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f46d80662f0 0x7f46d80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.364+0000 7f46ea7fc700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f46d80662f0 0x7f46d80687a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0b60e0 tx=0x7f46e0007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:42.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.368+0000 7f46d3fff700 1 -- 172.21.15.49:0/2719241351 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46dc054b80 con 0x7f46ec0b31b0 2023-07-21T22:14:42.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.540+0000 7f46f1a00700 1 -- 172.21.15.49:0/2719241351 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46ec0d3550 con 0x7f46d80662f0 2023-07-21T22:14:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.544+0000 7f46d3fff700 1 -- 172.21.15.49:0/2719241351 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70345 (secure 0 0 0) 0x7f46e00012b0 con 0x7f46d80662f0 2023-07-21T22:14:42.591 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:42.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.548+0000 7f46f1a00700 1 -- 172.21.15.49:0/2719241351 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f46d80662f0 msgr2=0x7f46d80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.548+0000 7f46f1a00700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f46d80662f0 0x7f46d80687a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0b60e0 tx=0x7f46e0007c00 comp rx=0 tx=0).stop 2023-07-21T22:14:42.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.548+0000 7f46f1a00700 1 -- 172.21.15.49:0/2719241351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec0b31b0 msgr2=0x7f46ec06db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.548+0000 7f46f1a00700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec0b31b0 0x7f46ec06db10 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00e840 tx=0x7f46dc00ec00 comp rx=0 tx=0).stop 2023-07-21T22:14:42.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.548+0000 7f46f1a00700 1 -- 172.21.15.49:0/2719241351 shutdown_connections 2023-07-21T22:14:42.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.548+0000 7f46f1a00700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f46d80662f0 0x7f46d80687a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.548+0000 7f46f1a00700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46ec15bc50 0x7f46ec0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.548+0000 7f46f1a00700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46ec0b5830 0x7f46ec06e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.548+0000 7f46f1a00700 1 --2- 172.21.15.49:0/2719241351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec0b31b0 0x7f46ec06db10 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.548+0000 7f46f1a00700 1 -- 172.21.15.49:0/2719241351 >> 172.21.15.49:0/2719241351 conn(0x7f46ec0d0830 msgr2=0x7f46ec15a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:42.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.548+0000 7f46f1a00700 1 -- 172.21.15.49:0/2719241351 shutdown_connections 2023-07-21T22:14:42.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.548+0000 7f46f1a00700 1 -- 172.21.15.49:0/2719241351 wait complete. 2023-07-21T22:14:42.595 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:14:42.618 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2023-07-21T22:14:42.393204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":251752,"kb_used_data":7464,"kb_used_omap":0,"kb_used_meta":244224,"kb_avail":754722968,"statfs":{"total":773094113280,"available":772836319232,"internally_reserved":0,"allocated":7643136,"data_stored":4203960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":250085376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.745925"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.606443+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:14:35.606443+0000","last_peered":"2023-07-21T22:14:35.606443+0000","last_clean":"2023-07-21T22:14:35.606443+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:14:35.606443+0000","last_undegraded":"2023-07-21T22:14:35.606443+0000","last_fullsized":"2023-07-21T22:14:35.606443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:46.212083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.608261+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:14:35.608261+0000","last_peered":"2023-07-21T22:14:35.608261+0000","last_clean":"2023-07-21T22:14:35.608261+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:14:35.608261+0000","last_undegraded":"2023-07-21T22:14:35.608261+0000","last_fullsized":"2023-07-21T22:14:35.608261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:24.157963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.607030+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:14:35.607030+0000","last_peered":"2023-07-21T22:14:35.607030+0000","last_clean":"2023-07-21T22:14:35.607030+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:14:35.607030+0000","last_undegraded":"2023-07-21T22:14:35.607030+0000","last_fullsized":"2023-07-21T22:14:35.607030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:13:04.979273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.607477+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:14:35.607477+0000","last_peered":"2023-07-21T22:14:35.607477+0000","last_clean":"2023-07-21T22:14:35.607477+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:14:35.607477+0000","last_undegraded":"2023-07-21T22:14:35.607477+0000","last_fullsized":"2023-07-21T22:14:35.607477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:08:34.202110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:34.655553+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:14:34.655553+0000","last_peered":"2023-07-21T22:14:34.655553+0000","last_clean":"2023-07-21T22:14:34.655553+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:14:34.655553+0000","last_undegraded":"2023-07-21T22:14:34.655553+0000","last_fullsized":"2023-07-21T22:14:34.655553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:50:35.167252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.603950+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:14:35.603950+0000","last_peered":"2023-07-21T22:14:35.603950+0000","last_clean":"2023-07-21T22:14:35.603950+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:14:35.603950+0000","last_undegraded":"2023-07-21T22:14:35.603950+0000","last_fullsized":"2023-07-21T22:14:35.603950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:07:15.704727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.604241+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:14:35.604241+0000","last_peered":"2023-07-21T22:14:35.604241+0000","last_clean":"2023-07-21T22:14:35.604241+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:14:35.604241+0000","last_undegraded":"2023-07-21T22:14:35.604241+0000","last_fullsized":"2023-07-21T22:14:35.604241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:46:30.446720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:34.658520+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:14:34.658520+0000","last_peered":"2023-07-21T22:14:34.658520+0000","last_clean":"2023-07-21T22:14:34.658520+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:14:34.658520+0000","last_undegraded":"2023-07-21T22:14:34.658520+0000","last_fullsized":"2023-07-21T22:14:34.658520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:21.733748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":247,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.604482+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:14:35.604482+0000","last_peered":"2023-07-21T22:14:35.604482+0000","last_clean":"2023-07-21T22:14:35.604482+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:14:35.604482+0000","last_undegraded":"2023-07-21T22:14:35.604482+0000","last_fullsized":"2023-07-21T22:14:35.604482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:09:04.332487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1400832,"data_stored":968271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.75900000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4810000000000001,"5min":2.218,"15min":2.218},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2589999999999999,"15min":1.3029999999999999},"min":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.736,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.3879999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1739999999999999,"15min":1.2110000000000001},"min":{"1min":0.77300000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4870000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.2,"15min":1.2609999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.645,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.081}]},{"osd":2,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.1850000000000001,"15min":1.2170000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.349,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2430000000000001,"15min":1.2889999999999999},"min":{"1min":0.77200000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.534,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.2410000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.256,"15min":1.286},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5069999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.329},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3129999999999999,"15min":1.4019999999999999},"min":{"1min":0.753,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6899999999999999,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.355}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1830000000000001,"15min":1.2230000000000001},"min":{"1min":0.80600000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.514,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.157},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2749999999999999,"15min":1.3240000000000001},"min":{"1min":0.75700000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.53,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.1950000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3380000000000001,"15min":1.3620000000000001},"min":{"1min":0.65400000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.9930000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3009999999999999,"15min":1.365},"min":{"1min":0.72699999999999998,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7849999999999999,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.4510000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.421,"15min":1.486},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.8280000000000001,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.377,"15min":1.415},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.7370000000000001,"5min":2.476,"15min":2.476},"last":1.2729999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0980000000000001,"15min":1.1160000000000001},"min":{"1min":0.69099999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.502,"5min":1.657,"15min":1.657},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.109,"15min":1.1399999999999999},"min":{"1min":0.73999999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4390000000000001,"5min":2.802,"15min":2.802},"last":1.3200000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.204,"15min":1.242},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.194,"15min":1.244},"min":{"1min":0.82499999999999996,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.548,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.423}]},{"osd":2,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2250000000000001,"15min":1.2649999999999999},"min":{"1min":0.97599999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6299999999999999,"5min":2.911,"15min":2.911},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2589999999999999,"15min":1.345},"min":{"1min":0.76100000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.0590000000000002,"5min":2.379,"15min":2.379},"last":1.5}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3320000000000001,"15min":1.411},"min":{"1min":0.92800000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9710000000000001,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.28},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.319,"15min":1.393},"min":{"1min":0.97799999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6200000000000001,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":1.1319999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2729999999999999},"min":{"1min":0.85699999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.8049999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3180000000000001,"15min":1.375},"min":{"1min":0.88200000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6719999999999999,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.456}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.355,"15min":1.3899999999999999},"min":{"1min":0.79200000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.161,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.415,"15min":1.4450000000000001},"min":{"1min":1.004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9139999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.256}]},{"osd":7,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.411,"15min":1.4370000000000001},"min":{"1min":1.115,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9359999999999999,"5min":4.194,"15min":4.194},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.502,"15min":1.5429999999999999},"min":{"1min":0.91600000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.1139999999999999,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.599}]}]},{"osd":5,"up_from":15,"seq":64424509496,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.63200000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.302},{"interface":"front","average":{"1min":1.081,"5min":1.115,"15min":1.1359999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.478,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.206}]},{"osd":1,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1599999999999999,"15min":1.1990000000000001},"min":{"1min":0.92100000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.157,"15min":1.1830000000000001},"min":{"1min":0.85399999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":3.4820000000000002,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":1.0449999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.161,"15min":1.1659999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.556,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.2450000000000001,"15min":1.296},"min":{"1min":0.76500000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.724,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.595}]},{"osd":3,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.218,"15min":1.2470000000000001},"min":{"1min":0.752,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.359,"5min":1.3600000000000001,"15min":1.3979999999999999},"min":{"1min":1.056,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.6679999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.4890000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.274,"15min":1.3260000000000001},"min":{"1min":0.86399999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.577,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.087},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.288,"15min":1.3029999999999999},"min":{"1min":0.93300000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5720000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.254}]},{"osd":6,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.2210000000000001,"15min":1.2709999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.498,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.2889999999999999,"15min":1.3300000000000001},"min":{"1min":0.88800000000000001,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.536,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.5349999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.266,"15min":1.298},"min":{"1min":0.88900000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7589999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.448,"15min":1.506},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.623,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.6399999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.105,"15min":1.101},"min":{"1min":0.54900000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.546,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.169},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5720000000000001,"5min":1.617,"15min":1.617},"last":1.2070000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2210000000000001,"15min":1.234},"min":{"1min":0.77800000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.661,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.2090000000000001,"15min":1.2010000000000001},"min":{"1min":0.79800000000000004,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.0169999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.129,"15min":1.135},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.3240000000000001,"5min":1.609,"15min":1.609},"last":1.05},{"interface":"front","average":{"1min":1.288,"5min":1.2749999999999999,"15min":1.2989999999999999},"min":{"1min":1.002,"5min":0.621,"15min":0.621},"max":{"1min":1.637,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.272}]},{"osd":3,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.258,"15min":1.302},"min":{"1min":0.93799999999999994,"5min":0.745,"15min":0.745},"max":{"1min":1.833,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.095},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.2270000000000001,"15min":1.23},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.51,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.244}]},{"osd":5,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.246,"15min":1.294},"min":{"1min":0.82899999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.573,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.254,"15min":1.24},"min":{"1min":0.89400000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.643,"5min":1.794,"15min":1.794},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1899999999999999,"15min":1.1970000000000001},"min":{"1min":0.80700000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8160000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.369,"15min":1.417},"min":{"1min":0.90400000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6879999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.123}]},{"osd":7,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3999999999999999,"15min":1.3740000000000001},"min":{"1min":0.999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4019999999999999,"15min":1.4059999999999999},"min":{"1min":1.0169999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6100000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.3009999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.90600000000000003,"15min":0.92600000000000005},"min":{"1min":0.64300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.484,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60099999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.9830000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.998}]},{"osd":1,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90400000000000003,"15min":0.93899999999999995},"min":{"1min":0.66100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6000000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.998,"5min":1.05,"15min":1.1180000000000001},"min":{"1min":0.65200000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5249999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.92900000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.109,"15min":1.113},"min":{"1min":0.69999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.52,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.345},{"interface":"front","average":{"1min":1.206,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.82199999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.077}]},{"osd":4,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":1.0029999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.679,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.212},{"interface":"front","average":{"1min":1.286,"5min":1.276,"15min":1.329},"min":{"1min":0.90100000000000002,"5min":0.751,"15min":0.751},"max":{"1min":1.9350000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.405}]},{"osd":5,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.294,"15min":1.3360000000000001},"min":{"1min":1.028,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.651,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.413,"15min":1.4590000000000001},"min":{"1min":0.92000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.6890000000000001,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.4490000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.337,"15min":1.367},"min":{"1min":1.032,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0379999999999998,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.29},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.3959999999999999,"15min":1.444},"min":{"1min":0.92500000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.7709999999999999,"5min":2.161,"15min":2.161},"last":1.25}]},{"osd":7,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4370000000000001,"15min":1.4990000000000001},"min":{"1min":1.0249999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7789999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4890000000000001,"15min":1.5469999999999999},"min":{"1min":1.196,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.6399999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.506}]}]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85999999999999999,"15min":0.876},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.222,"5min":1.0589999999999999,"15min":1.044},"min":{"1min":0.70999999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":7.0300000000000002,"5min":7.0300000000000002,"15min":7.0300000000000002},"last":0.88600000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.94599999999999995,"15min":0.95899999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.109,"15min":1.121},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.3009999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1299999999999999,"15min":1.1399999999999999},"min":{"1min":0.76400000000000001,"5min":0.501,"15min":0.501},"max":{"1min":3.5070000000000001,"5min":3.5070000000000001,"15min":3.5070000000000001},"last":1.032},{"interface":"front","average":{"1min":1.254,"5min":1.147,"15min":1.161},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":1.0780000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.391,"15min":1.4179999999999999},"min":{"1min":1.0580000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1840000000000002,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.45,"15min":1.5009999999999999},"min":{"1min":1.026,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.516,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.171}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.486,"15min":1.5089999999999999},"min":{"1min":1.1060000000000001,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":3.0870000000000002,"5min":3.331,"15min":3.331},"last":1.23},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5069999999999999,"15min":1.5509999999999999},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":3.238,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.2490000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4370000000000001,"15min":1.4570000000000001},"min":{"1min":1.0669999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.399,"5min":2.633,"15min":2.633},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.427,"15min":1.46},"min":{"1min":1.0900000000000001,"5min":0.878,"15min":0.878},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.401}]},{"osd":7,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.4550000000000001,"15min":1.482},"min":{"1min":1.121,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.137,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.353},{"interface":"front","average":{"1min":1.583,"5min":1.534,"15min":1.5640000000000001},"min":{"1min":1.095,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.4020000000000001,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.3680000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1400832,"data_stored":968271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.871,"15min":0.88600000000000001},"min":{"1min":0.57199999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.94899999999999995,"15min":0.97399999999999998},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.397,"5min":1.496,"15min":1.496},"last":1.3680000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.96499999999999997,"15min":0.94199999999999995},"min":{"1min":0.68200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4319999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.0449999999999999,"15min":1.0309999999999999},"min":{"1min":0.65800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.617,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.038}]},{"osd":3,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.68000000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3560000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1719999999999999,"15min":1.173},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.7050000000000001,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":1.3300000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.2410000000000001,"15min":1.2529999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.464,"5min":3.1779999999999999,"15min":3.1779999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3859999999999999,"15min":1.3899999999999999},"min":{"1min":1.0209999999999999,"5min":1,"15min":1},"max":{"1min":1.8100000000000001,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.2370000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.403,"15min":1.478},"min":{"1min":1.038,"5min":0.872,"15min":0.872},"max":{"1min":1.716,"5min":2.419,"15min":2.419},"last":1.512},{"interface":"front","average":{"1min":1.276,"5min":1.355,"15min":1.395},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.6359999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.3959999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4590000000000001,"15min":1.5129999999999999},"min":{"1min":1.069,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.919,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.581},{"interface":"front","average":{"1min":1.464,"5min":1.462,"15min":1.514},"min":{"1min":1.2010000000000001,"5min":1.038,"15min":1.038},"max":{"1min":1.895,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.6499999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4750000000000001,"15min":1.532},"min":{"1min":1.085,"5min":0.999,"15min":0.999},"max":{"1min":1.964,"5min":2.504,"15min":2.504},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.4379999999999999,"15min":1.494},"min":{"1min":1.0489999999999999,"5min":0.872,"15min":0.872},"max":{"1min":1.8520000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.6890000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542200,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.872,"15min":0.89100000000000001},"min":{"1min":0.54100000000000004,"5min":0.247,"15min":0.247},"max":{"1min":1.2250000000000001,"5min":2.113,"15min":2.113},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":0.92900000000000005},"min":{"1min":0.629,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1180000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.91700000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.89400000000000002,"15min":0.89800000000000002},"min":{"1min":0.58699999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3819999999999999,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0660000000000001,"15min":1.1120000000000001},"min":{"1min":0.71399999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.4730000000000001,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.2909999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.2410000000000001,"15min":1.367},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.385,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.1359999999999999,"15min":1.234},"min":{"1min":0.76400000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.446,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":1.1519999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2689999999999999,"15min":1.306},"min":{"1min":0.89500000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5169999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.403},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2490000000000001,"15min":1.294},"min":{"1min":0.92600000000000005,"5min":0.377,"15min":0.377},"max":{"1min":1.607,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.0389999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.292,"15min":1.3520000000000001},"min":{"1min":0.85399999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.867,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3999999999999999,"15min":1.4730000000000001},"min":{"1min":1.0669999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.631,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.5169999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3680000000000001,"15min":1.4199999999999999},"min":{"1min":1.0089999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8360000000000001,"5min":2.238,"15min":2.238},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3919999999999999,"15min":1.4359999999999999},"min":{"1min":0.89200000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.752,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.359}]},{"osd":7,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.4950000000000001,"15min":1.546},"min":{"1min":1.0449999999999999,"5min":0.624,"15min":0.624},"max":{"1min":1.788,"5min":4.391,"15min":4.391},"last":1.595},{"interface":"front","average":{"1min":1.361,"5min":1.448,"15min":1.506},"min":{"1min":1.0940000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.9099999999999999,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.486}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:14:42.620 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-21T22:14:42.621 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:14:42.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.748+0000 7f8ed3040700 1 Processor -- start 2023-07-21T22:14:42.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.748+0000 7f8ed3040700 1 -- start start 2023-07-21T22:14:42.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.748+0000 7f8ed3040700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ecc0b7af0 0x7f8ecc0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.748+0000 7f8ed3040700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ecc0cee10 0x7f8ecc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.748+0000 7f8ed3040700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc0b3e80 con 0x7f8ecc0d1e40 2023-07-21T22:14:42.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.748+0000 7f8ed3040700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ecc0cf7d0 con 0x7f8ecc0cee10 2023-07-21T22:14:42.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.748+0000 7f8ed3040700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc15fd40 con 0x7f8ecc0b7af0 2023-07-21T22:14:42.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.748+0000 7f8ed183d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8ecc0d1e40 0x7f8ecc15f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48040/0 (socket says 172.21.15.49:48040) 2023-07-21T22:14:42.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.748+0000 7f8ed183d700 1 -- 172.21.15.49:0/1646178065 learned_addr learned my addr 172.21.15.49:0/1646178065 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:42.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed283f700 1 --2- 172.21.15.49:0/1646178065 >> v2:172.21.15.150:3300/0 conn(0x7f8ecc0cee10 0x7f8ecc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed203e700 1 --2- 172.21.15.49:0/1646178065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ecc0b7af0 0x7f8ecc0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 -- 172.21.15.49:0/1646178065 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278080689 0 0) 0x7f8ecc0b3e80 con 0x7f8ecc0d1e40 2023-07-21T22:14:42.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 -- 172.21.15.49:0/1646178065 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eb80035d0 con 0x7f8ecc0d1e40 2023-07-21T22:14:42.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 -- 172.21.15.49:0/1646178065 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3431416331 0 0) 0x7f8eb80035d0 con 0x7f8ecc0d1e40 2023-07-21T22:14:42.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 -- 172.21.15.49:0/1646178065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ecc0b7af0 msgr2=0x7f8ecc0b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:42.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 --2- 172.21.15.49:0/1646178065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ecc0b7af0 0x7f8ecc0b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 -- 172.21.15.49:0/1646178065 >> v2:172.21.15.150:3300/0 conn(0x7f8ecc0cee10 msgr2=0x7f8ecc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:42.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 --2- 172.21.15.49:0/1646178065 >> v2:172.21.15.150:3300/0 conn(0x7f8ecc0cee10 0x7f8ecc0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 -- 172.21.15.49:0/1646178065 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc0cea00 con 0x7f8ecc0d1e40 2023-07-21T22:14:42.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 -- 172.21.15.49:0/1646178065 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2282489806 0 0) 0x7f8ebc001670 con 0x7f8ecc0d1e40 2023-07-21T22:14:42.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 -- 172.21.15.49:0/1646178065 >> v1:172.21.15.49:6789/0 conn(0x7f8ecc0d1e40 legacy=0x7f8ecc15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 --2- 172.21.15.49:0/1646178065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb8003a20 0x7f8eb8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 --2- 172.21.15.49:0/1646178065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb8004870 0x7f8eb8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 --2- 172.21.15.49:0/1646178065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ecc0b7af0 0x7f8eb8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 -- 172.21.15.49:0/1646178065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0cf7d0 con 0x7f8eb8003a20 2023-07-21T22:14:42.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 -- 172.21.15.49:0/1646178065 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc15fd40 con 0x7f8eb8004870 2023-07-21T22:14:42.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed103c700 1 -- 172.21.15.49:0/1646178065 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb800ba30 con 0x7f8ecc0b7af0 2023-07-21T22:14:42.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed203e700 1 --2- 172.21.15.49:0/1646178065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb8003a20 0x7f8eb8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed183d700 1 --2- 172.21.15.49:0/1646178065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb8004870 0x7f8eb8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed283f700 1 --2- 172.21.15.49:0/1646178065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ecc0b7af0 0x7f8eb8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed203e700 1 -- 172.21.15.49:0/1646178065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ecc0b7af0 msgr2=0x7f8eb8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed203e700 1 --2- 172.21.15.49:0/1646178065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ecc0b7af0 0x7f8eb8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed203e700 1 -- 172.21.15.49:0/1646178065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb8004870 msgr2=0x7f8eb8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed203e700 1 --2- 172.21.15.49:0/1646178065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb8004870 0x7f8eb8004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed203e700 1 -- 172.21.15.49:0/1646178065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb80035d0 con 0x7f8eb8003a20 2023-07-21T22:14:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.752+0000 7f8ed203e700 1 --2- 172.21.15.49:0/1646178065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb8003a20 0x7f8eb8003e30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009ba0 tx=0x7f8eb80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2f037d7461c0d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.756+0000 7f8ed103c700 1 -- 172.21.15.49:0/1646178065 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800e6c0 con 0x7f8eb8003a20 2023-07-21T22:14:42.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.756+0000 7f8ed103c700 1 -- 172.21.15.49:0/1646178065 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec800e820 con 0x7f8eb8003a20 2023-07-21T22:14:42.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.756+0000 7f8ed103c700 1 -- 172.21.15.49:0/1646178065 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800eb90 con 0x7f8eb8003a20 2023-07-21T22:14:42.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.756+0000 7f8ed3040700 1 -- 172.21.15.49:0/1646178065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb8003a20 msgr2=0x7f8eb8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.756+0000 7f8ed3040700 1 --2- 172.21.15.49:0/1646178065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb8003a20 0x7f8eb8003e30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009ba0 tx=0x7f8eb80058a0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.756+0000 7f8ed283f700 1 -- 172.21.15.49:0/1646178065 reap_dead start 2023-07-21T22:14:42.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.756+0000 7f8ed3040700 1 -- 172.21.15.49:0/1646178065 shutdown_connections 2023-07-21T22:14:42.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.756+0000 7f8ed3040700 1 -- 172.21.15.49:0/1646178065 >> 172.21.15.49:0/1646178065 conn(0x7f8ecc06e960 msgr2=0x7f8ecc06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:42.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.756+0000 7f8ed3040700 1 -- 172.21.15.49:0/1646178065 shutdown_connections 2023-07-21T22:14:42.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.756+0000 7f8ed3040700 1 -- 172.21.15.49:0/1646178065 wait complete. 2023-07-21T22:14:42.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.756+0000 7f8ed3040700 1 Processor -- start 2023-07-21T22:14:42.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed3040700 1 -- start start 2023-07-21T22:14:42.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed3040700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8eb8003a20 0x7f8ecc0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed3040700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ecc0b4160 0x7f8ecc0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed3040700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ecc15c220 0x7f8ecc15c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed3040700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0b4b10 con 0x7f8ecc0b4160 2023-07-21T22:14:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed3040700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0cc200 con 0x7f8ecc15c220 2023-07-21T22:14:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed3040700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0cb5f0 con 0x7f8eb8003a20 2023-07-21T22:14:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed183d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ecc0b4160 0x7f8ecc0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed183d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ecc0b4160 0x7f8ecc0b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58786/0 (socket says 172.21.15.49:58786) 2023-07-21T22:14:42.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed183d700 1 -- 172.21.15.49:0/253662332 learned_addr learned my addr 172.21.15.49:0/253662332 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:42.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed283f700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ecc15c220 0x7f8ecc15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed203e700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8eb8003a20 0x7f8ecc0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed183d700 1 -- 172.21.15.49:0/253662332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8eb8003a20 msgr2=0x7f8ecc0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed183d700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8eb8003a20 0x7f8ecc0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed183d700 1 -- 172.21.15.49:0/253662332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ecc15c220 msgr2=0x7f8ecc15c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:42.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed183d700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ecc15c220 0x7f8ecc15c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:42.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed183d700 1 -- 172.21.15.49:0/253662332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc0cb8d0 con 0x7f8ecc0b4160 2023-07-21T22:14:42.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed283f700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ecc15c220 0x7f8ecc15c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:42.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed183d700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ecc0b4160 0x7f8ecc0b45d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc000c00 tx=0x7f8ebc0075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:42.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ec2ffd700 1 -- 172.21.15.49:0/253662332 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc011580 con 0x7f8ecc0b4160 2023-07-21T22:14:42.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ec2ffd700 1 -- 172.21.15.49:0/253662332 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc011700 con 0x7f8ecc0b4160 2023-07-21T22:14:42.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed3040700 1 -- 172.21.15.49:0/253662332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc0cbbb0 con 0x7f8ecc0b4160 2023-07-21T22:14:42.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ec2ffd700 1 -- 172.21.15.49:0/253662332 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc011ab0 con 0x7f8ecc0b4160 2023-07-21T22:14:42.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.760+0000 7f8ed3040700 1 -- 172.21.15.49:0/253662332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc0b0b20 con 0x7f8ecc0b4160 2023-07-21T22:14:42.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.764+0000 7f8ed3040700 1 -- 172.21.15.49:0/253662332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc04dcb0 con 0x7f8ecc0b4160 2023-07-21T22:14:42.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.764+0000 7f8ec2ffd700 1 -- 172.21.15.49:0/253662332 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ebc011c10 con 0x7f8ecc0b4160 2023-07-21T22:14:42.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.768+0000 7f8ec2ffd700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8eb00662f0 0x7f8eb00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:42.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.768+0000 7f8ec2ffd700 1 -- 172.21.15.49:0/253662332 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f8ebc083bf0 con 0x7f8ecc0b4160 2023-07-21T22:14:42.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.768+0000 7f8ed203e700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8eb00662f0 0x7f8eb00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:42.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.768+0000 7f8ed203e700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8eb00662f0 0x7f8eb00687a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80090b0 tx=0x7f8ec8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:42.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.772+0000 7f8ec2ffd700 1 -- 172.21.15.49:0/253662332 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ebc051230 con 0x7f8ecc0b4160 2023-07-21T22:14:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.944+0000 7f8ed3040700 1 -- 172.21.15.49:0/253662332 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ecc0cced0 con 0x7f8eb00662f0 2023-07-21T22:14:42.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.948+0000 7f8ec2ffd700 1 -- 172.21.15.49:0/253662332 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70345 (secure 0 0 0) 0x7f8ec8022040 con 0x7f8eb00662f0 2023-07-21T22:14:42.996 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:43.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.956+0000 7f8ed3040700 1 -- 172.21.15.49:0/253662332 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8eb00662f0 msgr2=0x7f8eb00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:43.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.956+0000 7f8ed3040700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8eb00662f0 0x7f8eb00687a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80090b0 tx=0x7f8ec8008030 comp rx=0 tx=0).stop 2023-07-21T22:14:43.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.956+0000 7f8ed3040700 1 -- 172.21.15.49:0/253662332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ecc0b4160 msgr2=0x7f8ecc0b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:43.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.956+0000 7f8ed3040700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ecc0b4160 0x7f8ecc0b45d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc000c00 tx=0x7f8ebc0075f0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.956+0000 7f8ed3040700 1 -- 172.21.15.49:0/253662332 shutdown_connections 2023-07-21T22:14:43.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.956+0000 7f8ed3040700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f8eb00662f0 0x7f8eb00687a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.956+0000 7f8ed3040700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ecc0b4160 0x7f8ecc0b45d0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.956+0000 7f8ed3040700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ecc15c220 0x7f8ecc15c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.956+0000 7f8ed3040700 1 --2- 172.21.15.49:0/253662332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8eb8003a20 0x7f8ecc0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.956+0000 7f8ed3040700 1 -- 172.21.15.49:0/253662332 >> 172.21.15.49:0/253662332 conn(0x7f8ecc06e960 msgr2=0x7f8ecc15ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:43.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.956+0000 7f8ed3040700 1 -- 172.21.15.49:0/253662332 shutdown_connections 2023-07-21T22:14:43.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:42.956+0000 7f8ed3040700 1 -- 172.21.15.49:0/253662332 wait complete. 2023-07-21T22:14:43.003 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:14:43.024 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2023-07-21T22:14:42.393204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":251752,"kb_used_data":7464,"kb_used_omap":0,"kb_used_meta":244224,"kb_avail":754722968,"statfs":{"total":773094113280,"available":772836319232,"internally_reserved":0,"allocated":7643136,"data_stored":4203960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":250085376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.745925"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.606443+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:14:35.606443+0000","last_peered":"2023-07-21T22:14:35.606443+0000","last_clean":"2023-07-21T22:14:35.606443+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:14:35.606443+0000","last_undegraded":"2023-07-21T22:14:35.606443+0000","last_fullsized":"2023-07-21T22:14:35.606443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:46.212083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.608261+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:14:35.608261+0000","last_peered":"2023-07-21T22:14:35.608261+0000","last_clean":"2023-07-21T22:14:35.608261+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:14:35.608261+0000","last_undegraded":"2023-07-21T22:14:35.608261+0000","last_fullsized":"2023-07-21T22:14:35.608261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:24.157963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.607030+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:14:35.607030+0000","last_peered":"2023-07-21T22:14:35.607030+0000","last_clean":"2023-07-21T22:14:35.607030+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:14:35.607030+0000","last_undegraded":"2023-07-21T22:14:35.607030+0000","last_fullsized":"2023-07-21T22:14:35.607030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:13:04.979273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.607477+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:14:35.607477+0000","last_peered":"2023-07-21T22:14:35.607477+0000","last_clean":"2023-07-21T22:14:35.607477+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:14:35.607477+0000","last_undegraded":"2023-07-21T22:14:35.607477+0000","last_fullsized":"2023-07-21T22:14:35.607477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:08:34.202110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:34.655553+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:14:34.655553+0000","last_peered":"2023-07-21T22:14:34.655553+0000","last_clean":"2023-07-21T22:14:34.655553+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:14:34.655553+0000","last_undegraded":"2023-07-21T22:14:34.655553+0000","last_fullsized":"2023-07-21T22:14:34.655553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:50:35.167252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.603950+0000","last_change":"2023-07-21T22:10:29.508780+0000","last_active":"2023-07-21T22:14:35.603950+0000","last_peered":"2023-07-21T22:14:35.603950+0000","last_clean":"2023-07-21T22:14:35.603950+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:14:35.603950+0000","last_undegraded":"2023-07-21T22:14:35.603950+0000","last_fullsized":"2023-07-21T22:14:35.603950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:07:15.704727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.604241+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:14:35.604241+0000","last_peered":"2023-07-21T22:14:35.604241+0000","last_clean":"2023-07-21T22:14:35.604241+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:14:35.604241+0000","last_undegraded":"2023-07-21T22:14:35.604241+0000","last_fullsized":"2023-07-21T22:14:35.604241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:46:30.446720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:34.658520+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:14:34.658520+0000","last_peered":"2023-07-21T22:14:34.658520+0000","last_clean":"2023-07-21T22:14:34.658520+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:14:34.658520+0000","last_undegraded":"2023-07-21T22:14:34.658520+0000","last_fullsized":"2023-07-21T22:14:34.658520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:21.733748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":247,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.604482+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:14:35.604482+0000","last_peered":"2023-07-21T22:14:35.604482+0000","last_clean":"2023-07-21T22:14:35.604482+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:14:35.604482+0000","last_undegraded":"2023-07-21T22:14:35.604482+0000","last_fullsized":"2023-07-21T22:14:35.604482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:09:04.332487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1400832,"data_stored":968271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.75900000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4810000000000001,"5min":2.218,"15min":2.218},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2589999999999999,"15min":1.3029999999999999},"min":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.736,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.3879999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1739999999999999,"15min":1.2110000000000001},"min":{"1min":0.77300000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4870000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.2,"15min":1.2609999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.645,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.081}]},{"osd":2,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.1850000000000001,"15min":1.2170000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.349,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2430000000000001,"15min":1.2889999999999999},"min":{"1min":0.77200000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.534,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.2410000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.256,"15min":1.286},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5069999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.329},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3129999999999999,"15min":1.4019999999999999},"min":{"1min":0.753,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6899999999999999,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.355}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1830000000000001,"15min":1.2230000000000001},"min":{"1min":0.80600000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.514,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.157},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2749999999999999,"15min":1.3240000000000001},"min":{"1min":0.75700000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.53,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.1950000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3380000000000001,"15min":1.3620000000000001},"min":{"1min":0.65400000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.9930000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3009999999999999,"15min":1.365},"min":{"1min":0.72699999999999998,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7849999999999999,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.4510000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.421,"15min":1.486},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.8280000000000001,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.377,"15min":1.415},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.7370000000000001,"5min":2.476,"15min":2.476},"last":1.2729999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0980000000000001,"15min":1.1160000000000001},"min":{"1min":0.69099999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.502,"5min":1.657,"15min":1.657},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.109,"15min":1.1399999999999999},"min":{"1min":0.73999999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4390000000000001,"5min":2.802,"15min":2.802},"last":1.3200000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.204,"15min":1.242},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.194,"15min":1.244},"min":{"1min":0.82499999999999996,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.548,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.423}]},{"osd":2,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2250000000000001,"15min":1.2649999999999999},"min":{"1min":0.97599999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6299999999999999,"5min":2.911,"15min":2.911},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2589999999999999,"15min":1.345},"min":{"1min":0.76100000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.0590000000000002,"5min":2.379,"15min":2.379},"last":1.5}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3320000000000001,"15min":1.411},"min":{"1min":0.92800000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9710000000000001,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.28},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.319,"15min":1.393},"min":{"1min":0.97799999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6200000000000001,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":1.1319999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2729999999999999},"min":{"1min":0.85699999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.8049999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3180000000000001,"15min":1.375},"min":{"1min":0.88200000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6719999999999999,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.456}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.355,"15min":1.3899999999999999},"min":{"1min":0.79200000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.161,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.415,"15min":1.4450000000000001},"min":{"1min":1.004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9139999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.256}]},{"osd":7,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.411,"15min":1.4370000000000001},"min":{"1min":1.115,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9359999999999999,"5min":4.194,"15min":4.194},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.502,"15min":1.5429999999999999},"min":{"1min":0.91600000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.1139999999999999,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.599}]}]},{"osd":5,"up_from":15,"seq":64424509496,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.63200000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.302},{"interface":"front","average":{"1min":1.081,"5min":1.115,"15min":1.1359999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.478,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.206}]},{"osd":1,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1599999999999999,"15min":1.1990000000000001},"min":{"1min":0.92100000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.157,"15min":1.1830000000000001},"min":{"1min":0.85399999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":3.4820000000000002,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":1.0449999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.161,"15min":1.1659999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.556,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.2450000000000001,"15min":1.296},"min":{"1min":0.76500000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.724,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.595}]},{"osd":3,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.218,"15min":1.2470000000000001},"min":{"1min":0.752,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.359,"5min":1.3600000000000001,"15min":1.3979999999999999},"min":{"1min":1.056,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.6679999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.4890000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.274,"15min":1.3260000000000001},"min":{"1min":0.86399999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.577,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.087},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.288,"15min":1.3029999999999999},"min":{"1min":0.93300000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5720000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.254}]},{"osd":6,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.2210000000000001,"15min":1.2709999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.498,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.2889999999999999,"15min":1.3300000000000001},"min":{"1min":0.88800000000000001,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.536,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.5349999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.266,"15min":1.298},"min":{"1min":0.88900000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7589999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.448,"15min":1.506},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.623,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.6399999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.105,"15min":1.101},"min":{"1min":0.54900000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.546,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.169},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5720000000000001,"5min":1.617,"15min":1.617},"last":1.2070000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2210000000000001,"15min":1.234},"min":{"1min":0.77800000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.661,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.2090000000000001,"15min":1.2010000000000001},"min":{"1min":0.79800000000000004,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.0169999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.129,"15min":1.135},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.3240000000000001,"5min":1.609,"15min":1.609},"last":1.05},{"interface":"front","average":{"1min":1.288,"5min":1.2749999999999999,"15min":1.2989999999999999},"min":{"1min":1.002,"5min":0.621,"15min":0.621},"max":{"1min":1.637,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.272}]},{"osd":3,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.258,"15min":1.302},"min":{"1min":0.93799999999999994,"5min":0.745,"15min":0.745},"max":{"1min":1.833,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.095},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.2270000000000001,"15min":1.23},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.51,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.244}]},{"osd":5,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.246,"15min":1.294},"min":{"1min":0.82899999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.573,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.254,"15min":1.24},"min":{"1min":0.89400000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.643,"5min":1.794,"15min":1.794},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1899999999999999,"15min":1.1970000000000001},"min":{"1min":0.80700000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8160000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.369,"15min":1.417},"min":{"1min":0.90400000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6879999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.123}]},{"osd":7,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3999999999999999,"15min":1.3740000000000001},"min":{"1min":0.999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4019999999999999,"15min":1.4059999999999999},"min":{"1min":1.0169999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6100000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.3009999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.90600000000000003,"15min":0.92600000000000005},"min":{"1min":0.64300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.484,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60099999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.9830000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.998}]},{"osd":1,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90400000000000003,"15min":0.93899999999999995},"min":{"1min":0.66100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6000000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.998,"5min":1.05,"15min":1.1180000000000001},"min":{"1min":0.65200000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5249999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.92900000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.109,"15min":1.113},"min":{"1min":0.69999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.52,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.345},{"interface":"front","average":{"1min":1.206,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.82199999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.077}]},{"osd":4,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":1.0029999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.679,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.212},{"interface":"front","average":{"1min":1.286,"5min":1.276,"15min":1.329},"min":{"1min":0.90100000000000002,"5min":0.751,"15min":0.751},"max":{"1min":1.9350000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.405}]},{"osd":5,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.294,"15min":1.3360000000000001},"min":{"1min":1.028,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.651,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.413,"15min":1.4590000000000001},"min":{"1min":0.92000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.6890000000000001,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.4490000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.337,"15min":1.367},"min":{"1min":1.032,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0379999999999998,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.29},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.3959999999999999,"15min":1.444},"min":{"1min":0.92500000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.7709999999999999,"5min":2.161,"15min":2.161},"last":1.25}]},{"osd":7,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4370000000000001,"15min":1.4990000000000001},"min":{"1min":1.0249999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7789999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4890000000000001,"15min":1.5469999999999999},"min":{"1min":1.196,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.6399999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.506}]}]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85999999999999999,"15min":0.876},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.222,"5min":1.0589999999999999,"15min":1.044},"min":{"1min":0.70999999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":7.0300000000000002,"5min":7.0300000000000002,"15min":7.0300000000000002},"last":0.88600000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.94599999999999995,"15min":0.95899999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.109,"15min":1.121},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.3009999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1299999999999999,"15min":1.1399999999999999},"min":{"1min":0.76400000000000001,"5min":0.501,"15min":0.501},"max":{"1min":3.5070000000000001,"5min":3.5070000000000001,"15min":3.5070000000000001},"last":1.032},{"interface":"front","average":{"1min":1.254,"5min":1.147,"15min":1.161},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":1.0780000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.391,"15min":1.4179999999999999},"min":{"1min":1.0580000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1840000000000002,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.45,"15min":1.5009999999999999},"min":{"1min":1.026,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.516,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.171}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.486,"15min":1.5089999999999999},"min":{"1min":1.1060000000000001,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":3.0870000000000002,"5min":3.331,"15min":3.331},"last":1.23},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5069999999999999,"15min":1.5509999999999999},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":3.238,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.2490000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4370000000000001,"15min":1.4570000000000001},"min":{"1min":1.0669999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.399,"5min":2.633,"15min":2.633},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.427,"15min":1.46},"min":{"1min":1.0900000000000001,"5min":0.878,"15min":0.878},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.401}]},{"osd":7,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.4550000000000001,"15min":1.482},"min":{"1min":1.121,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.137,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.353},{"interface":"front","average":{"1min":1.583,"5min":1.534,"15min":1.5640000000000001},"min":{"1min":1.095,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.4020000000000001,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.3680000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1400832,"data_stored":968271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.871,"15min":0.88600000000000001},"min":{"1min":0.57199999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.94899999999999995,"15min":0.97399999999999998},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.397,"5min":1.496,"15min":1.496},"last":1.3680000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.96499999999999997,"15min":0.94199999999999995},"min":{"1min":0.68200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4319999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.0449999999999999,"15min":1.0309999999999999},"min":{"1min":0.65800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.617,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.038}]},{"osd":3,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.68000000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3560000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1719999999999999,"15min":1.173},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.7050000000000001,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":1.3300000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.2410000000000001,"15min":1.2529999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.464,"5min":3.1779999999999999,"15min":3.1779999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3859999999999999,"15min":1.3899999999999999},"min":{"1min":1.0209999999999999,"5min":1,"15min":1},"max":{"1min":1.8100000000000001,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.2370000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.403,"15min":1.478},"min":{"1min":1.038,"5min":0.872,"15min":0.872},"max":{"1min":1.716,"5min":2.419,"15min":2.419},"last":1.512},{"interface":"front","average":{"1min":1.276,"5min":1.355,"15min":1.395},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.6359999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.3959999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4590000000000001,"15min":1.5129999999999999},"min":{"1min":1.069,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.919,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.581},{"interface":"front","average":{"1min":1.464,"5min":1.462,"15min":1.514},"min":{"1min":1.2010000000000001,"5min":1.038,"15min":1.038},"max":{"1min":1.895,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.6499999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4750000000000001,"15min":1.532},"min":{"1min":1.085,"5min":0.999,"15min":0.999},"max":{"1min":1.964,"5min":2.504,"15min":2.504},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.4379999999999999,"15min":1.494},"min":{"1min":1.0489999999999999,"5min":0.872,"15min":0.872},"max":{"1min":1.8520000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.6890000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542200,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.872,"15min":0.89100000000000001},"min":{"1min":0.54100000000000004,"5min":0.247,"15min":0.247},"max":{"1min":1.2250000000000001,"5min":2.113,"15min":2.113},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":0.92900000000000005},"min":{"1min":0.629,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1180000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.91700000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.89400000000000002,"15min":0.89800000000000002},"min":{"1min":0.58699999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3819999999999999,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0660000000000001,"15min":1.1120000000000001},"min":{"1min":0.71399999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.4730000000000001,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.2909999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.2410000000000001,"15min":1.367},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.385,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.1359999999999999,"15min":1.234},"min":{"1min":0.76400000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.446,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":1.1519999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2689999999999999,"15min":1.306},"min":{"1min":0.89500000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5169999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.403},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2490000000000001,"15min":1.294},"min":{"1min":0.92600000000000005,"5min":0.377,"15min":0.377},"max":{"1min":1.607,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.0389999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.292,"15min":1.3520000000000001},"min":{"1min":0.85399999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.867,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3999999999999999,"15min":1.4730000000000001},"min":{"1min":1.0669999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.631,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.5169999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3680000000000001,"15min":1.4199999999999999},"min":{"1min":1.0089999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8360000000000001,"5min":2.238,"15min":2.238},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3919999999999999,"15min":1.4359999999999999},"min":{"1min":0.89200000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.752,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.359}]},{"osd":7,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.4950000000000001,"15min":1.546},"min":{"1min":1.0449999999999999,"5min":0.624,"15min":0.624},"max":{"1min":1.788,"5min":4.391,"15min":4.391},"last":1.595},{"interface":"front","average":{"1min":1.361,"5min":1.448,"15min":1.506},"min":{"1min":1.0940000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.9099999999999999,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.486}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:14:43.027 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:14:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.164+0000 7f2cd21e6700 1 Processor -- start 2023-07-21T22:14:43.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.168+0000 7f2cd21e6700 1 -- start start 2023-07-21T22:14:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.168+0000 7f2cd21e6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ccc0cdd50 0x7f2ccc0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:43.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.168+0000 7f2cd21e6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2ccc0ce790 0x7f2ccc0d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:43.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.168+0000 7f2cd21e6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ccc0b8680 con 0x7f2ccc0ce240 2023-07-21T22:14:43.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.168+0000 7f2cd21e6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ccc0d3500 con 0x7f2ccc0ce790 2023-07-21T22:14:43.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.168+0000 7f2cd21e6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0d2fa0 con 0x7f2ccc0cdd50 2023-07-21T22:14:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.168+0000 7f2ccaffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2ccc0ce790 0x7f2ccc0d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.168+0000 7f2ccaffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2ccc0ce790 0x7f2ccc0d0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58792/0 (socket says 172.21.15.49:58792) 2023-07-21T22:14:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.168+0000 7f2ccaffd700 1 -- 172.21.15.49:0/4263484281 learned_addr learned my addr 172.21.15.49:0/4263484281 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.168+0000 7f2ccb7fe700 1 --2- 172.21.15.49:0/4263484281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ccc0cdd50 0x7f2ccc0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2ccaffd700 1 -- 172.21.15.49:0/4263484281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ccc0cdd50 msgr2=0x7f2ccc0ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2cca7fc700 1 -- 172.21.15.49:0/4263484281 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3842182088 0 0) 0x7f2ccc0b8680 con 0x7f2ccc0ce240 2023-07-21T22:14:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2ccaffd700 1 --2- 172.21.15.49:0/4263484281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ccc0cdd50 0x7f2ccc0ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2ccaffd700 1 -- 172.21.15.49:0/4263484281 >> v1:172.21.15.150:6789/0 conn(0x7f2ccc0ce240 legacy=0x7f2ccc0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2ccaffd700 1 -- 172.21.15.49:0/4263484281 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc0b6290 con 0x7f2ccc0ce790 2023-07-21T22:14:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2ccb7fe700 1 --2- 172.21.15.49:0/4263484281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ccc0cdd50 0x7f2ccc0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:14:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2ccaffd700 1 --2- 172.21.15.49:0/4263484281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0ce790 0x7f2ccc0d0470 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009910 tx=0x7f2cc0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c095966039030f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2cca7fc700 1 -- 172.21.15.49:0/4263484281 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0011830 con 0x7f2ccc0ce790 2023-07-21T22:14:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2cca7fc700 1 -- 172.21.15.49:0/4263484281 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc0011990 con 0x7f2ccc0ce790 2023-07-21T22:14:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2cca7fc700 1 -- 172.21.15.49:0/4263484281 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0011d40 con 0x7f2ccc0ce790 2023-07-21T22:14:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2cd21e6700 1 -- 172.21.15.49:0/4263484281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0ce790 msgr2=0x7f2ccc0d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2cd21e6700 1 --2- 172.21.15.49:0/4263484281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0ce790 0x7f2ccc0d0470 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009910 tx=0x7f2cc0009c20 comp rx=0 tx=0).stop 2023-07-21T22:14:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2cd21e6700 1 -- 172.21.15.49:0/4263484281 shutdown_connections 2023-07-21T22:14:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2cd21e6700 1 --2- 172.21.15.49:0/4263484281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0ce790 0x7f2ccc0d0470 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2cd21e6700 1 --2- 172.21.15.49:0/4263484281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ccc0cdd50 0x7f2ccc0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2cd21e6700 1 -- 172.21.15.49:0/4263484281 >> 172.21.15.49:0/4263484281 conn(0x7f2ccc0b55e0 msgr2=0x7f2ccc0b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2cd21e6700 1 -- 172.21.15.49:0/4263484281 shutdown_connections 2023-07-21T22:14:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.172+0000 7f2cd21e6700 1 -- 172.21.15.49:0/4263484281 wait complete. 2023-07-21T22:14:43.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.176+0000 7f2cd21e6700 1 Processor -- start 2023-07-21T22:14:43.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.176+0000 7f2cd21e6700 1 -- start start 2023-07-21T22:14:43.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.176+0000 7f2cd21e6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0cdd50 0x7f2ccc1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:43.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.176+0000 7f2cd21e6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ccc0ce240 0x7f2ccc070990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:43.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.176+0000 7f2cd21e6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ccc0ce790 0x7f2ccc070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:43.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.176+0000 7f2cd21e6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc15de30 con 0x7f2ccc0cdd50 2023-07-21T22:14:43.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.176+0000 7f2cd21e6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc15e110 con 0x7f2ccc0ce240 2023-07-21T22:14:43.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.176+0000 7f2cd21e6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc15e3f0 con 0x7f2ccc0ce790 2023-07-21T22:14:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2ccb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0cdd50 0x7f2ccc1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2ccb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0cdd50 0x7f2ccc1510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58806/0 (socket says 172.21.15.49:58806) 2023-07-21T22:14:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2ccb7fe700 1 -- 172.21.15.49:0/1661340602 learned_addr learned my addr 172.21.15.49:0/1661340602 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2ccaffd700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ccc0ce240 0x7f2ccc070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2ccbfff700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ccc0ce790 0x7f2ccc070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2ccb7fe700 1 -- 172.21.15.49:0/1661340602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ccc0ce790 msgr2=0x7f2ccc070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2ccb7fe700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ccc0ce790 0x7f2ccc070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2ccb7fe700 1 -- 172.21.15.49:0/1661340602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ccc0ce240 msgr2=0x7f2ccc070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2ccb7fe700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ccc0ce240 0x7f2ccc070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2ccb7fe700 1 -- 172.21.15.49:0/1661340602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc009450 con 0x7f2ccc0cdd50 2023-07-21T22:14:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2ccaffd700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ccc0ce240 0x7f2ccc070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2ccb7fe700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0cdd50 0x7f2ccc1510d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00ebe0 tx=0x7f2cbc009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:43.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2cb3fff700 1 -- 172.21.15.49:0/1661340602 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc005a40 con 0x7f2ccc0cdd50 2023-07-21T22:14:43.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2cb3fff700 1 -- 172.21.15.49:0/1661340602 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc005ba0 con 0x7f2ccc0cdd50 2023-07-21T22:14:43.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2cb3fff700 1 -- 172.21.15.49:0/1661340602 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc00c910 con 0x7f2ccc0cdd50 2023-07-21T22:14:43.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2cd21e6700 1 -- 172.21.15.49:0/1661340602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc0009570 con 0x7f2ccc0cdd50 2023-07-21T22:14:43.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.180+0000 7f2cd21e6700 1 -- 172.21.15.49:0/1661340602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ccc15e9b0 con 0x7f2ccc0cdd50 2023-07-21T22:14:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.184+0000 7f2cd21e6700 1 -- 172.21.15.49:0/1661340602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ccc04dcb0 con 0x7f2ccc0cdd50 2023-07-21T22:14:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.184+0000 7f2cb3fff700 1 -- 172.21.15.49:0/1661340602 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2cbc00ca70 con 0x7f2ccc0cdd50 2023-07-21T22:14:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.184+0000 7f2cb3fff700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2cb80662f0 0x7f2cb80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.184+0000 7f2cb3fff700 1 -- 172.21.15.49:0/1661340602 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f2cbc083f30 con 0x7f2ccc0cdd50 2023-07-21T22:14:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.188+0000 7f2ccaffd700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2cb80662f0 0x7f2cb80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:43.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.188+0000 7f2ccaffd700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2cb80662f0 0x7f2cb80687a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0014040 tx=0x7f2cc0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:43.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.192+0000 7f2cb3fff700 1 -- 172.21.15.49:0/1661340602 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2cbc055010 con 0x7f2ccc0cdd50 2023-07-21T22:14:43.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.380+0000 7f2cd21e6700 1 -- 172.21.15.49:0/1661340602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ccc1e6b40 con 0x7f2ccc0cdd50 2023-07-21T22:14:43.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.380+0000 7f2cb3fff700 1 -- 172.21.15.49:0/1661340602 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+14938 (secure 0 0 0) 0x7f2cbc020090 con 0x7f2ccc0cdd50 2023-07-21T22:14:43.427 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:43.427 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":67,"fsid":"c1346180-e695-42c2-8f5b-b72be8101116","created":"2023-07-21T22:10:08.188471+0000","modified":"2023-07-21T22:14:34.644578+0000","last_up_change":"2023-07-21T22:10:20.892406+0000","last_in_change":"2023-07-21T22:10:11.490984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:10:22.385131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:10:27.862618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e8ae3f3-eb66-441d-911f-afef828ff0b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6801","nonce":5206931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6803","nonce":5206931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6807","nonce":5206931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":5206931},{"type":"v1","addr":"172.21.15.49:6805","nonce":5206931}]},"public_addr":"172.21.15.49:6801/5206931","cluster_addr":"172.21.15.49:6803/5206931","heartbeat_back_addr":"172.21.15.49:6807/5206931","heartbeat_front_addr":"172.21.15.49:6805/5206931","state":["exists","up"]},{"osd":1,"uuid":"eb981216-329e-438e-b4ba-1fce054d11b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6809","nonce":2983717007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6811","nonce":2983717007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6815","nonce":2983717007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2983717007},{"type":"v1","addr":"172.21.15.49:6813","nonce":2983717007}]},"public_addr":"172.21.15.49:6809/2983717007","cluster_addr":"172.21.15.49:6811/2983717007","heartbeat_back_addr":"172.21.15.49:6815/2983717007","heartbeat_front_addr":"172.21.15.49:6813/2983717007","state":["exists","up"]},{"osd":2,"uuid":"36326d9d-4157-4bd4-adc3-d0ae7ea8efc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6825","nonce":3193969798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6827","nonce":3193969798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6831","nonce":3193969798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3193969798},{"type":"v1","addr":"172.21.15.49:6829","nonce":3193969798}]},"public_addr":"172.21.15.49:6825/3193969798","cluster_addr":"172.21.15.49:6827/3193969798","heartbeat_back_addr":"172.21.15.49:6831/3193969798","heartbeat_front_addr":"172.21.15.49:6829/3193969798","state":["exists","up"]},{"osd":3,"uuid":"d1ed415c-a80f-44cc-b4a4-06a83702729e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6817","nonce":3284520698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6819","nonce":3284520698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6823","nonce":3284520698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3284520698},{"type":"v1","addr":"172.21.15.49:6821","nonce":3284520698}]},"public_addr":"172.21.15.49:6817/3284520698","cluster_addr":"172.21.15.49:6819/3284520698","heartbeat_back_addr":"172.21.15.49:6823/3284520698","heartbeat_front_addr":"172.21.15.49:6821/3284520698","state":["exists","up"]},{"osd":4,"uuid":"12a53eb6-e926-42f2-9360-9e526861f31e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6801","nonce":3591224217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6803","nonce":3591224217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6808","nonce":3591224217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":3591224217},{"type":"v1","addr":"172.21.15.150:6805","nonce":3591224217}]},"public_addr":"172.21.15.150:6801/3591224217","cluster_addr":"172.21.15.150:6803/3591224217","heartbeat_back_addr":"172.21.15.150:6808/3591224217","heartbeat_front_addr":"172.21.15.150:6805/3591224217","state":["exists","up"]},{"osd":5,"uuid":"59f4e49d-6615-4da9-a799-fa5d9c461811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6809","nonce":3465358811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6813","nonce":3465358811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6822","nonce":3465358811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":3465358811},{"type":"v1","addr":"172.21.15.150:6817","nonce":3465358811}]},"public_addr":"172.21.15.150:6809/3465358811","cluster_addr":"172.21.15.150:6813/3465358811","heartbeat_back_addr":"172.21.15.150:6822/3465358811","heartbeat_front_addr":"172.21.15.150:6817/3465358811","state":["exists","up"]},{"osd":6,"uuid":"b3bd569d-7c03-4108-86fd-c48b7e07ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6825","nonce":2641155494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6827","nonce":2641155494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6831","nonce":2641155494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2641155494},{"type":"v1","addr":"172.21.15.150:6829","nonce":2641155494}]},"public_addr":"172.21.15.150:6825/2641155494","cluster_addr":"172.21.15.150:6827/2641155494","heartbeat_back_addr":"172.21.15.150:6831/2641155494","heartbeat_front_addr":"172.21.15.150:6829/2641155494","state":["exists","up"]},{"osd":7,"uuid":"5017ca1a-9754-46bb-a882-c288c82a420b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6812","nonce":597032017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6816","nonce":597032017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6823","nonce":597032017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":597032017},{"type":"v1","addr":"172.21.15.150:6819","nonce":597032017}]},"public_addr":"172.21.15.150:6812/597032017","cluster_addr":"172.21.15.150:6816/597032017","heartbeat_back_addr":"172.21.15.150:6823/597032017","heartbeat_front_addr":"172.21.15.150:6819/597032017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.454718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.178420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.559275+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.491204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.229195+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.159107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:17.197530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:10:16.989438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6836/4142505890":"2023-07-22T22:14:31.632079+0000","172.21.15.49:6834/4142505890":"2023-07-22T22:14:31.632079+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:14:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.384+0000 7f2cd21e6700 1 -- 172.21.15.49:0/1661340602 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2cb80662f0 msgr2=0x7f2cb80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.384+0000 7f2cd21e6700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2cb80662f0 0x7f2cb80687a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0014040 tx=0x7f2cc0008030 comp rx=0 tx=0).stop 2023-07-21T22:14:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.384+0000 7f2cd21e6700 1 -- 172.21.15.49:0/1661340602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0cdd50 msgr2=0x7f2ccc1510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.384+0000 7f2cd21e6700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0cdd50 0x7f2ccc1510d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00ebe0 tx=0x7f2cbc009ec0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.384+0000 7f2cd21e6700 1 -- 172.21.15.49:0/1661340602 shutdown_connections 2023-07-21T22:14:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.384+0000 7f2cd21e6700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2cb80662f0 0x7f2cb80687a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.384+0000 7f2cd21e6700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ccc0ce790 0x7f2ccc070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.384+0000 7f2cd21e6700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ccc0ce240 0x7f2ccc070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.384+0000 7f2cd21e6700 1 --2- 172.21.15.49:0/1661340602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0cdd50 0x7f2ccc1510d0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:43.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.384+0000 7f2cd21e6700 1 -- 172.21.15.49:0/1661340602 >> 172.21.15.49:0/1661340602 conn(0x7f2ccc0b55e0 msgr2=0x7f2ccc0700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:43.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.388+0000 7f2cd21e6700 1 -- 172.21.15.49:0/1661340602 shutdown_connections 2023-07-21T22:14:43.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:43.388+0000 7f2cd21e6700 1 -- 172.21.15.49:0/1661340602 wait complete. 2023-07-21T22:14:44.455 INFO:tasks.ceph:Scrubbing osd.0 2023-07-21T22:14:44.456 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:14:44.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f7019395700 1 Processor -- start 2023-07-21T22:14:44.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f7019395700 1 -- start start 2023-07-21T22:14:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f7019395700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f701406ebd0 0x7f70140b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f7019395700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f701406efa0 0x7f70140cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f7019395700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70140cf7d0 con 0x7f701415ba40 2023-07-21T22:14:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f7019395700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70140d0150 con 0x7f701406efa0 2023-07-21T22:14:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f7019395700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70140ccc20 con 0x7f701406ebd0 2023-07-21T22:14:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f70137fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f701406efa0 0x7f70140cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f70137fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f701406efa0 0x7f70140cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57266/0 (socket says 172.21.15.49:57266) 2023-07-21T22:14:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f70137fe700 1 -- 172.21.15.49:0/3163697210 learned_addr learned my addr 172.21.15.49:0/3163697210 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f7013fff700 1 --2- 172.21.15.49:0/3163697210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f701406ebd0 0x7f70140b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f70137fe700 1 -- 172.21.15.49:0/3163697210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f701406ebd0 msgr2=0x7f70140b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f70137fe700 1 --2- 172.21.15.49:0/3163697210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f701406ebd0 0x7f70140b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f70137fe700 1 -- 172.21.15.49:0/3163697210 >> v1:172.21.15.150:6789/0 conn(0x7f701415ba40 legacy=0x7f701415bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f70137fe700 1 -- 172.21.15.49:0/3163697210 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140ccf00 con 0x7f701406efa0 2023-07-21T22:14:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.596+0000 7f7013fff700 1 --2- 172.21.15.49:0/3163697210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f701406ebd0 0x7f70140b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.600+0000 7f70137fe700 1 --2- 172.21.15.49:0/3163697210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701406efa0 0x7f70140cf290 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f7008009910 tx=0x7f7008009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b15047df576e63 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.600+0000 7f7012ffd700 1 -- 172.21.15.49:0/3163697210 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008004230 con 0x7f701406efa0 2023-07-21T22:14:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.600+0000 7f7012ffd700 1 -- 172.21.15.49:0/3163697210 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7008004390 con 0x7f701406efa0 2023-07-21T22:14:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.600+0000 7f7012ffd700 1 -- 172.21.15.49:0/3163697210 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008009e60 con 0x7f701406efa0 2023-07-21T22:14:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.600+0000 7f7019395700 1 -- 172.21.15.49:0/3163697210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701406efa0 msgr2=0x7f70140cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.600+0000 7f7019395700 1 --2- 172.21.15.49:0/3163697210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701406efa0 0x7f70140cf290 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f7008009910 tx=0x7f7008009c20 comp rx=0 tx=0).stop 2023-07-21T22:14:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.600+0000 7f7019395700 1 -- 172.21.15.49:0/3163697210 shutdown_connections 2023-07-21T22:14:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.600+0000 7f7019395700 1 --2- 172.21.15.49:0/3163697210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701406efa0 0x7f70140cf290 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.600+0000 7f7019395700 1 --2- 172.21.15.49:0/3163697210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f701406ebd0 0x7f70140b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.600+0000 7f7019395700 1 -- 172.21.15.49:0/3163697210 >> 172.21.15.49:0/3163697210 conn(0x7f7014070a80 msgr2=0x7f70140b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.600+0000 7f7019395700 1 -- 172.21.15.49:0/3163697210 shutdown_connections 2023-07-21T22:14:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.600+0000 7f7019395700 1 -- 172.21.15.49:0/3163697210 wait complete. 2023-07-21T22:14:44.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7019395700 1 Processor -- start 2023-07-21T22:14:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7019395700 1 -- start start 2023-07-21T22:14:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7019395700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701406ebd0 0x7f701414f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7019395700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f701406efa0 0x7f70140b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7019395700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f701415ba40 0x7f70140cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7019395700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70140cb020 con 0x7f701406ebd0 2023-07-21T22:14:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7019395700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701415cab0 con 0x7f701415ba40 2023-07-21T22:14:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7019395700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701414f780 con 0x7f701406efa0 2023-07-21T22:14:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7013fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701406ebd0 0x7f701414f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7013fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701406ebd0 0x7f701414f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57274/0 (socket says 172.21.15.49:57274) 2023-07-21T22:14:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7013fff700 1 -- 172.21.15.49:0/3435743073 learned_addr learned my addr 172.21.15.49:0/3435743073 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f70137fe700 1 --2- 172.21.15.49:0/3435743073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f701406efa0 0x7f70140b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7018b94700 1 --2- 172.21.15.49:0/3435743073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f701415ba40 0x7f70140cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7013fff700 1 -- 172.21.15.49:0/3435743073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f701406efa0 msgr2=0x7f70140b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7013fff700 1 --2- 172.21.15.49:0/3435743073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f701406efa0 0x7f70140b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7013fff700 1 -- 172.21.15.49:0/3435743073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f701415ba40 msgr2=0x7f70140cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:44.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7013fff700 1 --2- 172.21.15.49:0/3435743073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f701415ba40 0x7f70140cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:44.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7013fff700 1 -- 172.21.15.49:0/3435743073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7008009570 con 0x7f701406ebd0 2023-07-21T22:14:44.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7013fff700 1 --2- 172.21.15.49:0/3435743073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701406ebd0 0x7f701414f240 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f700400cf60 tx=0x7f700400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:44.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7010ff9700 1 -- 172.21.15.49:0/3435743073 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004015440 con 0x7f701406ebd0 2023-07-21T22:14:44.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7010ff9700 1 -- 172.21.15.49:0/3435743073 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70040155a0 con 0x7f701406ebd0 2023-07-21T22:14:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7019395700 1 -- 172.21.15.49:0/3435743073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70140ca4a0 con 0x7f701406ebd0 2023-07-21T22:14:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.604+0000 7f7010ff9700 1 -- 172.21.15.49:0/3435743073 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004015930 con 0x7f701406ebd0 2023-07-21T22:14:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.608+0000 7f7019395700 1 -- 172.21.15.49:0/3435743073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70140caa60 con 0x7f701406ebd0 2023-07-21T22:14:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.608+0000 7f7019395700 1 -- 172.21.15.49:0/3435743073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70140d05a0 con 0x7f701406ebd0 2023-07-21T22:14:44.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.608+0000 7f7010ff9700 1 -- 172.21.15.49:0/3435743073 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7004015a90 con 0x7f701406ebd0 2023-07-21T22:14:44.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.612+0000 7f7010ff9700 1 --2- 172.21.15.49:0/3435743073 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f70000662f0 0x7f70000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:44.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.612+0000 7f7010ff9700 1 -- 172.21.15.49:0/3435743073 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f70040840d0 con 0x7f701406ebd0 2023-07-21T22:14:44.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.612+0000 7f70137fe700 1 --2- 172.21.15.49:0/3435743073 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f70000662f0 0x7f70000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:44.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.612+0000 7f7010ff9700 1 --2- 172.21.15.49:0/3435743073 >> [v2:172.21.15.49:6800/5206931,v1:172.21.15.49:6801/5206931] conn(0x7f700006cc00 0x7f700006f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:44.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.612+0000 7f7010ff9700 1 -- 172.21.15.49:0/3435743073 --> [v2:172.21.15.49:6800/5206931,v1:172.21.15.49:6801/5206931] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f700006f700 con 0x7f700006cc00 2023-07-21T22:14:44.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.612+0000 7f7010ff9700 1 -- 172.21.15.49:0/3435743073 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70040866b0 con 0x7f701406ebd0 2023-07-21T22:14:44.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.612+0000 7f7018b94700 1 --2- 172.21.15.49:0/3435743073 >> [v2:172.21.15.49:6800/5206931,v1:172.21.15.49:6801/5206931] conn(0x7f700006cc00 0x7f700006f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:44.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.612+0000 7f70137fe700 1 --2- 172.21.15.49:0/3435743073 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f70000662f0 0x7f70000687a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7008009910 tx=0x7f7008008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:44.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.612+0000 7f7018b94700 1 --2- 172.21.15.49:0/3435743073 >> [v2:172.21.15.49:6800/5206931,v1:172.21.15.49:6801/5206931] conn(0x7f700006cc00 0x7f700006f030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:44.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.612+0000 7f7010ff9700 1 -- 172.21.15.49:0/3435743073 <== osd.0 v2:172.21.15.49:6800/5206931 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f700006f700 con 0x7f700006cc00 2023-07-21T22:14:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.632+0000 7f7019395700 1 -- 172.21.15.49:0/3435743073 --> [v2:172.21.15.49:6800/5206931,v1:172.21.15.49:6801/5206931] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f701415cc70 con 0x7f700006cc00 2023-07-21T22:14:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.632+0000 7f7010ff9700 1 -- 172.21.15.49:0/3435743073 <== osd.0 v2:172.21.15.49:6800/5206931 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f701415cc70 con 0x7f700006cc00 2023-07-21T22:14:44.677 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:14:44.677 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:14:44.677 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:14:44.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.632+0000 7f7019395700 1 -- 172.21.15.49:0/3435743073 >> [v2:172.21.15.49:6800/5206931,v1:172.21.15.49:6801/5206931] conn(0x7f700006cc00 msgr2=0x7f700006f030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:44.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.632+0000 7f7019395700 1 --2- 172.21.15.49:0/3435743073 >> [v2:172.21.15.49:6800/5206931,v1:172.21.15.49:6801/5206931] conn(0x7f700006cc00 0x7f700006f030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:44.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.632+0000 7f7019395700 1 -- 172.21.15.49:0/3435743073 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f70000662f0 msgr2=0x7f70000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:44.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.632+0000 7f7019395700 1 --2- 172.21.15.49:0/3435743073 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f70000662f0 0x7f70000687a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7008009910 tx=0x7f7008008030 comp rx=0 tx=0).stop 2023-07-21T22:14:44.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.632+0000 7f7019395700 1 -- 172.21.15.49:0/3435743073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701406ebd0 msgr2=0x7f701414f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:44.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.632+0000 7f7019395700 1 --2- 172.21.15.49:0/3435743073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701406ebd0 0x7f701414f240 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f700400cf60 tx=0x7f700400cf90 comp rx=0 tx=0).stop 2023-07-21T22:14:44.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.632+0000 7f7018b94700 1 -- 172.21.15.49:0/3435743073 reap_dead start 2023-07-21T22:14:44.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.632+0000 7f7019395700 1 -- 172.21.15.49:0/3435743073 shutdown_connections 2023-07-21T22:14:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.632+0000 7f7019395700 1 -- 172.21.15.49:0/3435743073 >> 172.21.15.49:0/3435743073 conn(0x7f7014070a80 msgr2=0x7f70140ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.632+0000 7f7019395700 1 -- 172.21.15.49:0/3435743073 shutdown_connections 2023-07-21T22:14:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.632+0000 7f7019395700 1 -- 172.21.15.49:0/3435743073 wait complete. 2023-07-21T22:14:44.705 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-21T22:14:44.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.844+0000 7fcf25a7d700 1 Processor -- start 2023-07-21T22:14:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.844+0000 7fcf25a7d700 1 -- start start 2023-07-21T22:14:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.844+0000 7fcf25a7d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf20160370 0x7fcf2006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.844+0000 7fcf25a7d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf200ca490 0x7fcf20163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.844+0000 7fcf25a7d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2006e010 con 0x7fcf200c1470 2023-07-21T22:14:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.844+0000 7fcf25a7d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf20160740 con 0x7fcf200ca490 2023-07-21T22:14:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf25a7d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200ccc50 con 0x7fcf20160370 2023-07-21T22:14:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf17fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcf200c1470 0x7fcf200c9d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52386/0 (socket says 172.21.15.49:52386) 2023-07-21T22:14:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf17fff700 1 -- 172.21.15.49:0/1904796822 learned_addr learned my addr 172.21.15.49:0/1904796822 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf2527c700 1 --2- 172.21.15.49:0/1904796822 >> v2:172.21.15.49:3300/0 conn(0x7fcf200ca490 0x7fcf20163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf2527c700 1 -- 172.21.15.49:0/1904796822 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf20160370 msgr2=0x7fcf2006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf24a7b700 1 --2- 172.21.15.49:0/1904796822 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf20160370 0x7fcf2006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf177fe700 1 -- 172.21.15.49:0/1904796822 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005774289 0 0) 0x7fcf2006e010 con 0x7fcf200c1470 2023-07-21T22:14:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf2527c700 1 --2- 172.21.15.49:0/1904796822 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf20160370 0x7fcf2006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:44.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf2527c700 1 -- 172.21.15.49:0/1904796822 >> v1:172.21.15.49:6789/0 conn(0x7fcf200c1470 legacy=0x7fcf200c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:44.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf2527c700 1 -- 172.21.15.49:0/1904796822 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf200afc90 con 0x7fcf200ca490 2023-07-21T22:14:44.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf24a7b700 1 --2- 172.21.15.49:0/1904796822 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf20160370 0x7fcf2006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:14:44.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf2527c700 1 --2- 172.21.15.49:0/1904796822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf200ca490 0x7fcf20163ef0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009d90 tx=0x7fcf1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02c66f5e5890b22 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:44.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf177fe700 1 -- 172.21.15.49:0/1904796822 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800e070 con 0x7fcf200ca490 2023-07-21T22:14:44.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf177fe700 1 -- 172.21.15.49:0/1904796822 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1800bbd0 con 0x7fcf200ca490 2023-07-21T22:14:44.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf177fe700 1 -- 172.21.15.49:0/1904796822 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18012430 con 0x7fcf200ca490 2023-07-21T22:14:44.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf25a7d700 1 -- 172.21.15.49:0/1904796822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf200ca490 msgr2=0x7fcf20163ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:44.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf25a7d700 1 --2- 172.21.15.49:0/1904796822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf200ca490 0x7fcf20163ef0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009d90 tx=0x7fcf1800b330 comp rx=0 tx=0).stop 2023-07-21T22:14:44.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf25a7d700 1 -- 172.21.15.49:0/1904796822 shutdown_connections 2023-07-21T22:14:44.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf25a7d700 1 --2- 172.21.15.49:0/1904796822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf200ca490 0x7fcf20163ef0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:44.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf25a7d700 1 --2- 172.21.15.49:0/1904796822 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf20160370 0x7fcf2006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:44.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf25a7d700 1 -- 172.21.15.49:0/1904796822 >> 172.21.15.49:0/1904796822 conn(0x7fcf20070450 msgr2=0x7fcf20070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:44.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf25a7d700 1 -- 172.21.15.49:0/1904796822 shutdown_connections 2023-07-21T22:14:44.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.848+0000 7fcf25a7d700 1 -- 172.21.15.49:0/1904796822 wait complete. 2023-07-21T22:14:44.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.852+0000 7fcf25a7d700 1 Processor -- start 2023-07-21T22:14:44.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.852+0000 7fcf25a7d700 1 -- start start 2023-07-21T22:14:44.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.852+0000 7fcf25a7d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf200c1470 0x7fcf200c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:44.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.852+0000 7fcf25a7d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf200ca490 0x7fcf20155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:44.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.852+0000 7fcf25a7d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf20160370 0x7fcf200b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:44.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.852+0000 7fcf25a7d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200c5140 con 0x7fcf200ca490 2023-07-21T22:14:44.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.852+0000 7fcf25a7d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200c5700 con 0x7fcf200c1470 2023-07-21T22:14:44.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.852+0000 7fcf25a7d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200af630 con 0x7fcf20160370 2023-07-21T22:14:44.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.852+0000 7fcf17fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf200ca490 0x7fcf20155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:44.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.852+0000 7fcf17fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf200ca490 0x7fcf20155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57288/0 (socket says 172.21.15.49:57288) 2023-07-21T22:14:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.852+0000 7fcf17fff700 1 -- 172.21.15.49:0/148832486 learned_addr learned my addr 172.21.15.49:0/148832486 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.852+0000 7fcf24a7b700 1 --2- 172.21.15.49:0/148832486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf200c1470 0x7fcf200c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.852+0000 7fcf2527c700 1 --2- 172.21.15.49:0/148832486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf20160370 0x7fcf200b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.856+0000 7fcf17fff700 1 -- 172.21.15.49:0/148832486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf20160370 msgr2=0x7fcf200b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.856+0000 7fcf17fff700 1 --2- 172.21.15.49:0/148832486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf20160370 0x7fcf200b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:44.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.856+0000 7fcf17fff700 1 -- 172.21.15.49:0/148832486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf200c1470 msgr2=0x7fcf200c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:44.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.856+0000 7fcf17fff700 1 --2- 172.21.15.49:0/148832486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf200c1470 0x7fcf200c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:44.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.856+0000 7fcf17fff700 1 -- 172.21.15.49:0/148832486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18009a70 con 0x7fcf200ca490 2023-07-21T22:14:44.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.856+0000 7fcf17fff700 1 --2- 172.21.15.49:0/148832486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf200ca490 0x7fcf20155460 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000c5b0 tx=0x7fcf1000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.856+0000 7fcf157fa700 1 -- 172.21.15.49:0/148832486 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10004ca0 con 0x7fcf200ca490 2023-07-21T22:14:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.856+0000 7fcf157fa700 1 -- 172.21.15.49:0/148832486 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf10004e20 con 0x7fcf200ca490 2023-07-21T22:14:44.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.856+0000 7fcf25a7d700 1 -- 172.21.15.49:0/148832486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf200af910 con 0x7fcf200ca490 2023-07-21T22:14:44.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.856+0000 7fcf157fa700 1 -- 172.21.15.49:0/148832486 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10007310 con 0x7fcf200ca490 2023-07-21T22:14:44.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.856+0000 7fcf25a7d700 1 -- 172.21.15.49:0/148832486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf200c8370 con 0x7fcf200ca490 2023-07-21T22:14:44.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.856+0000 7fcf25a7d700 1 -- 172.21.15.49:0/148832486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2004dcb0 con 0x7fcf200ca490 2023-07-21T22:14:44.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.860+0000 7fcf157fa700 1 -- 172.21.15.49:0/148832486 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf10007470 con 0x7fcf200ca490 2023-07-21T22:14:44.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.860+0000 7fcf157fa700 1 --2- 172.21.15.49:0/148832486 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcf0c066320 0x7fcf0c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:44.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.860+0000 7fcf157fa700 1 -- 172.21.15.49:0/148832486 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fcf10083750 con 0x7fcf200ca490 2023-07-21T22:14:44.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.860+0000 7fcf24a7b700 1 --2- 172.21.15.49:0/148832486 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcf0c066320 0x7fcf0c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:44.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.864+0000 7fcf24a7b700 1 --2- 172.21.15.49:0/148832486 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcf0c066320 0x7fcf0c0687d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00ab60 tx=0x7fcf1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:44.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:44.864+0000 7fcf157fa700 1 -- 172.21.15.49:0/148832486 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf10050da0 con 0x7fcf200ca490 2023-07-21T22:14:45.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.044+0000 7fcf25a7d700 1 -- 172.21.15.49:0/148832486 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf200b0250 con 0x7fcf0c066320 2023-07-21T22:14:45.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.044+0000 7fcf157fa700 1 -- 172.21.15.49:0/148832486 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcf1c00c040 con 0x7fcf0c066320 2023-07-21T22:14:45.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.048+0000 7fcf25a7d700 1 -- 172.21.15.49:0/148832486 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcf0c066320 msgr2=0x7fcf0c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.048+0000 7fcf25a7d700 1 --2- 172.21.15.49:0/148832486 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcf0c066320 0x7fcf0c0687d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00ab60 tx=0x7fcf1c008040 comp rx=0 tx=0).stop 2023-07-21T22:14:45.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.048+0000 7fcf25a7d700 1 -- 172.21.15.49:0/148832486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf200ca490 msgr2=0x7fcf20155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.048+0000 7fcf25a7d700 1 --2- 172.21.15.49:0/148832486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf200ca490 0x7fcf20155460 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000c5b0 tx=0x7fcf1000c8c0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.048+0000 7fcf25a7d700 1 -- 172.21.15.49:0/148832486 shutdown_connections 2023-07-21T22:14:45.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.048+0000 7fcf25a7d700 1 --2- 172.21.15.49:0/148832486 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fcf0c066320 0x7fcf0c0687d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.048+0000 7fcf25a7d700 1 --2- 172.21.15.49:0/148832486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf200ca490 0x7fcf20155460 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.048+0000 7fcf25a7d700 1 --2- 172.21.15.49:0/148832486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf20160370 0x7fcf200b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.048+0000 7fcf25a7d700 1 --2- 172.21.15.49:0/148832486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf200c1470 0x7fcf200c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.048+0000 7fcf25a7d700 1 -- 172.21.15.49:0/148832486 >> 172.21.15.49:0/148832486 conn(0x7fcf20070450 msgr2=0x7fcf200ce880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:45.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.048+0000 7fcf25a7d700 1 -- 172.21.15.49:0/148832486 shutdown_connections 2023-07-21T22:14:45.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.048+0000 7fcf25a7d700 1 -- 172.21.15.49:0/148832486 wait complete. 2023-07-21T22:14:45.096 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 0 to deep-scrub 2023-07-21T22:14:45.115 INFO:tasks.ceph:Scrubbing osd.1 2023-07-21T22:14:45.116 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:14:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.256+0000 7f15d27bf700 1 Processor -- start 2023-07-21T22:14:45.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.256+0000 7f15d27bf700 1 -- start start 2023-07-21T22:14:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15d27bf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15cc0d0b80 0x7f15cc0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15d27bf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f15cc0ce790 0x7f15cc0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15d27bf700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15cc0b8680 con 0x7f15cc0cdd50 2023-07-21T22:14:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15d27bf700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15cc0d3500 con 0x7f15cc0d0b80 2023-07-21T22:14:45.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15d27bf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15cc0d2fa0 con 0x7f15cc0ce790 2023-07-21T22:14:45.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15cbfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f15cc0cdd50 0x7f15cc0d0470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52402/0 (socket says 172.21.15.49:52402) 2023-07-21T22:14:45.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15cbfff700 1 -- 172.21.15.49:0/1736049041 learned_addr learned my addr 172.21.15.49:0/1736049041 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:45.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15c37fe700 1 --2- 172.21.15.49:0/1736049041 >> v2:172.21.15.49:3300/0 conn(0x7f15cc0d0b80 0x7f15cc0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15d0d5c700 1 --2- 172.21.15.49:0/1736049041 >> v2:172.21.15.150:3300/0 conn(0x7f15cc0ce790 0x7f15cc0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15cb7fe700 1 -- 172.21.15.49:0/1736049041 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018107733 0 0) 0x7f15cc0b8680 con 0x7f15cc0cdd50 2023-07-21T22:14:45.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15cb7fe700 1 -- 172.21.15.49:0/1736049041 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15b80035d0 con 0x7f15cc0cdd50 2023-07-21T22:14:45.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15c37fe700 1 -- 172.21.15.49:0/1736049041 >> v2:172.21.15.150:3300/0 conn(0x7f15cc0ce790 msgr2=0x7f15cc0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:45.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15c37fe700 1 --2- 172.21.15.49:0/1736049041 >> v2:172.21.15.150:3300/0 conn(0x7f15cc0ce790 0x7f15cc0cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15c37fe700 1 -- 172.21.15.49:0/1736049041 >> v1:172.21.15.49:6789/0 conn(0x7f15cc0cdd50 legacy=0x7f15cc0d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.260+0000 7f15c37fe700 1 -- 172.21.15.49:0/1736049041 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc0b6290 con 0x7f15cc0d0b80 2023-07-21T22:14:45.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.264+0000 7f15c37fe700 1 --2- 172.21.15.49:0/1736049041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15cc0d0b80 0x7f15cc0ccce0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f15cc08cb40 tx=0x7f15b4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5182d3bb82bb5e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.264+0000 7f15cb7fe700 1 -- 172.21.15.49:0/1736049041 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4011830 con 0x7f15cc0d0b80 2023-07-21T22:14:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.264+0000 7f15cb7fe700 1 -- 172.21.15.49:0/1736049041 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b4011990 con 0x7f15cc0d0b80 2023-07-21T22:14:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.264+0000 7f15cb7fe700 1 -- 172.21.15.49:0/1736049041 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4011d20 con 0x7f15cc0d0b80 2023-07-21T22:14:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.264+0000 7f15d27bf700 1 -- 172.21.15.49:0/1736049041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15cc0d0b80 msgr2=0x7f15cc0ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.264+0000 7f15d27bf700 1 --2- 172.21.15.49:0/1736049041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15cc0d0b80 0x7f15cc0ccce0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f15cc08cb40 tx=0x7f15b4009b30 comp rx=0 tx=0).stop 2023-07-21T22:14:45.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.264+0000 7f15d27bf700 1 -- 172.21.15.49:0/1736049041 shutdown_connections 2023-07-21T22:14:45.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.264+0000 7f15d27bf700 1 --2- 172.21.15.49:0/1736049041 >> v2:172.21.15.150:3300/0 conn(0x7f15cc0ce790 0x7f15cc0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.264+0000 7f15d27bf700 1 --2- 172.21.15.49:0/1736049041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15cc0d0b80 0x7f15cc0ccce0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.264+0000 7f15d27bf700 1 -- 172.21.15.49:0/1736049041 >> 172.21.15.49:0/1736049041 conn(0x7f15cc0b55e0 msgr2=0x7f15cc0b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:45.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.264+0000 7f15d27bf700 1 -- 172.21.15.49:0/1736049041 shutdown_connections 2023-07-21T22:14:45.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.264+0000 7f15d27bf700 1 -- 172.21.15.49:0/1736049041 wait complete. 2023-07-21T22:14:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.264+0000 7f15d27bf700 1 Processor -- start 2023-07-21T22:14:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15d27bf700 1 -- start start 2023-07-21T22:14:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15d27bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15cc0cdd50 0x7f15cc071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15d27bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15cc0ce790 0x7f15cc1f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15d27bf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15cc0d0b80 0x7f15cc1f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15d27bf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc070270 con 0x7f15cc0ce790 2023-07-21T22:14:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15d27bf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc0c9030 con 0x7f15cc0d0b80 2023-07-21T22:14:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15d27bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc06f6f0 con 0x7f15cc0cdd50 2023-07-21T22:14:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15c37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15cc0ce790 0x7f15cc1f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15c37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15cc0ce790 0x7f15cc1f1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57308/0 (socket says 172.21.15.49:57308) 2023-07-21T22:14:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15c37fe700 1 -- 172.21.15.49:0/2587174630 learned_addr learned my addr 172.21.15.49:0/2587174630 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15cbfff700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15cc0cdd50 0x7f15cc071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15d0d5c700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15cc0d0b80 0x7f15cc1f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15c37fe700 1 -- 172.21.15.49:0/2587174630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15cc0cdd50 msgr2=0x7f15cc071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15c37fe700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15cc0cdd50 0x7f15cc071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15c37fe700 1 -- 172.21.15.49:0/2587174630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15cc0d0b80 msgr2=0x7f15cc1f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15c37fe700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15cc0d0b80 0x7f15cc1f18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15c37fe700 1 -- 172.21.15.49:0/2587174630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b40094b0 con 0x7f15cc0ce790 2023-07-21T22:14:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15cbfff700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15cc0cdd50 0x7f15cc071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15c37fe700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15cc0ce790 0x7f15cc1f1370 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f15b4014040 tx=0x7f15b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15c97fa700 1 -- 172.21.15.49:0/2587174630 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4004610 con 0x7f15cc0ce790 2023-07-21T22:14:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15c97fa700 1 -- 172.21.15.49:0/2587174630 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b401e070 con 0x7f15cc0ce790 2023-07-21T22:14:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15c97fa700 1 -- 172.21.15.49:0/2587174630 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40038e0 con 0x7f15cc0ce790 2023-07-21T22:14:45.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15d27bf700 1 -- 172.21.15.49:0/2587174630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15cc06f9d0 con 0x7f15cc0ce790 2023-07-21T22:14:45.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.268+0000 7f15d27bf700 1 -- 172.21.15.49:0/2587174630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15cc06ff90 con 0x7f15cc0ce790 2023-07-21T22:14:45.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.272+0000 7f15d27bf700 1 -- 172.21.15.49:0/2587174630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15cc0cee10 con 0x7f15cc0ce790 2023-07-21T22:14:45.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.272+0000 7f15c97fa700 1 -- 172.21.15.49:0/2587174630 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f15b4003a40 con 0x7f15cc0ce790 2023-07-21T22:14:45.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.276+0000 7f15c97fa700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f15ac0662f0 0x7f15ac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.276+0000 7f15c97fa700 1 -- 172.21.15.49:0/2587174630 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f15b4084a80 con 0x7f15cc0ce790 2023-07-21T22:14:45.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.276+0000 7f15cbfff700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f15ac0662f0 0x7f15ac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.276+0000 7f15c97fa700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.49:6808/2983717007,v1:172.21.15.49:6809/2983717007] conn(0x7f15ac06cc00 0x7f15ac06f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.276+0000 7f15c97fa700 1 -- 172.21.15.49:0/2587174630 --> [v2:172.21.15.49:6808/2983717007,v1:172.21.15.49:6809/2983717007] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15ac06f700 con 0x7f15ac06cc00 2023-07-21T22:14:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.276+0000 7f15c97fa700 1 -- 172.21.15.49:0/2587174630 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15b4086ea0 con 0x7f15cc0ce790 2023-07-21T22:14:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.276+0000 7f15d0d5c700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.49:6808/2983717007,v1:172.21.15.49:6809/2983717007] conn(0x7f15ac06cc00 0x7f15ac06f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.276+0000 7f15cbfff700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f15ac0662f0 0x7f15ac0687a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f15bc001460 tx=0x7f15bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.276+0000 7f15d0d5c700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.49:6808/2983717007,v1:172.21.15.49:6809/2983717007] conn(0x7f15ac06cc00 0x7f15ac06f030 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:45.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.276+0000 7f15c97fa700 1 -- 172.21.15.49:0/2587174630 <== osd.1 v2:172.21.15.49:6808/2983717007 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f15ac06f700 con 0x7f15ac06cc00 2023-07-21T22:14:45.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.296+0000 7f15d27bf700 1 -- 172.21.15.49:0/2587174630 --> [v2:172.21.15.49:6808/2983717007,v1:172.21.15.49:6809/2983717007] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f15cc0d3220 con 0x7f15ac06cc00 2023-07-21T22:14:45.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.296+0000 7f15c97fa700 1 -- 172.21.15.49:0/2587174630 <== osd.1 v2:172.21.15.49:6808/2983717007 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f15c40098b0 con 0x7f15ac06cc00 2023-07-21T22:14:45.341 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:14:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:14:45.342 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:14:45.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.296+0000 7f15d27bf700 1 -- 172.21.15.49:0/2587174630 >> [v2:172.21.15.49:6808/2983717007,v1:172.21.15.49:6809/2983717007] conn(0x7f15ac06cc00 msgr2=0x7f15ac06f030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.296+0000 7f15d27bf700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.49:6808/2983717007,v1:172.21.15.49:6809/2983717007] conn(0x7f15ac06cc00 0x7f15ac06f030 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.296+0000 7f15d27bf700 1 -- 172.21.15.49:0/2587174630 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f15ac0662f0 msgr2=0x7f15ac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.296+0000 7f15d27bf700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f15ac0662f0 0x7f15ac0687a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f15bc001460 tx=0x7f15bc009040 comp rx=0 tx=0).stop 2023-07-21T22:14:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.296+0000 7f15d27bf700 1 -- 172.21.15.49:0/2587174630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15cc0ce790 msgr2=0x7f15cc1f1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.296+0000 7f15d27bf700 1 --2- 172.21.15.49:0/2587174630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15cc0ce790 0x7f15cc1f1370 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f15b4014040 tx=0x7f15b4004770 comp rx=0 tx=0).stop 2023-07-21T22:14:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.296+0000 7f15d0d5c700 1 -- 172.21.15.49:0/2587174630 reap_dead start 2023-07-21T22:14:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.296+0000 7f15d27bf700 1 -- 172.21.15.49:0/2587174630 shutdown_connections 2023-07-21T22:14:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.296+0000 7f15d27bf700 1 -- 172.21.15.49:0/2587174630 >> 172.21.15.49:0/2587174630 conn(0x7f15cc0b55e0 msgr2=0x7f15cc0b6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.296+0000 7f15d27bf700 1 -- 172.21.15.49:0/2587174630 shutdown_connections 2023-07-21T22:14:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.296+0000 7f15d27bf700 1 -- 172.21.15.49:0/2587174630 wait complete. 2023-07-21T22:14:45.363 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-21T22:14:45.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.496+0000 7f02195ca700 1 Processor -- start 2023-07-21T22:14:45.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.496+0000 7f02195ca700 1 -- start start 2023-07-21T22:14:45.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.500+0000 7f02195ca700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f02140cbc40 0x7f02140ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.500+0000 7f02195ca700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02140cb270 con 0x7f021415bf30 2023-07-21T22:14:45.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.500+0000 7f02195ca700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02140acac0 con 0x7f02140b0200 2023-07-21T22:14:45.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.500+0000 7f02195ca700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021415c300 con 0x7f02140cbc40 2023-07-21T22:14:45.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.500+0000 7f0218dc9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f02140cbc40 0x7f02140ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.500+0000 7f0213fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f021415bf30 0x7f02140afaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52410/0 (socket says 172.21.15.49:52410) 2023-07-21T22:14:45.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.500+0000 7f0213fff700 1 -- 172.21.15.49:0/1287336776 learned_addr learned my addr 172.21.15.49:0/1287336776 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:45.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.500+0000 7f0218dc9700 1 -- 172.21.15.49:0/1287336776 >> v1:172.21.15.150:6789/0 conn(0x7f02140b0200 legacy=0x7f02140ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.500+0000 7f0218dc9700 1 -- 172.21.15.49:0/1287336776 >> v1:172.21.15.49:6789/0 conn(0x7f021415bf30 legacy=0x7f02140afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.500+0000 7f02137fe700 1 -- 172.21.15.49:0/1287336776 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406886873 0 0) 0x7f02140cb270 con 0x7f021415bf30 2023-07-21T22:14:45.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.500+0000 7f0218dc9700 1 -- 172.21.15.49:0/1287336776 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021406f740 con 0x7f02140cbc40 2023-07-21T22:14:45.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.500+0000 7f0218dc9700 1 --2- 172.21.15.49:0/1287336776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02140cbc40 0x7f02140ad350 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f020c009850 tx=0x7f020c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9482444496992d2d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:45.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.504+0000 7f02137fe700 1 -- 172.21.15.49:0/1287336776 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c011830 con 0x7f02140cbc40 2023-07-21T22:14:45.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.504+0000 7f02137fe700 1 -- 172.21.15.49:0/1287336776 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c011990 con 0x7f02140cbc40 2023-07-21T22:14:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.504+0000 7f02137fe700 1 -- 172.21.15.49:0/1287336776 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c011d20 con 0x7f02140cbc40 2023-07-21T22:14:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.504+0000 7f02195ca700 1 -- 172.21.15.49:0/1287336776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02140cbc40 msgr2=0x7f02140ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.504+0000 7f02195ca700 1 --2- 172.21.15.49:0/1287336776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02140cbc40 0x7f02140ad350 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f020c009850 tx=0x7f020c009b60 comp rx=0 tx=0).stop 2023-07-21T22:14:45.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.504+0000 7f02195ca700 1 -- 172.21.15.49:0/1287336776 shutdown_connections 2023-07-21T22:14:45.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.504+0000 7f02195ca700 1 --2- 172.21.15.49:0/1287336776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02140cbc40 0x7f02140ad350 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.504+0000 7f02195ca700 1 -- 172.21.15.49:0/1287336776 >> 172.21.15.49:0/1287336776 conn(0x7f0214070450 msgr2=0x7f0214070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:45.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.504+0000 7f02195ca700 1 -- 172.21.15.49:0/1287336776 shutdown_connections 2023-07-21T22:14:45.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.504+0000 7f02195ca700 1 -- 172.21.15.49:0/1287336776 wait complete. 2023-07-21T22:14:45.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.504+0000 7f02195ca700 1 Processor -- start 2023-07-21T22:14:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.504+0000 7f02195ca700 1 -- start start 2023-07-21T22:14:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f02195ca700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02140b0200 0x7f02140c2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f02195ca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02140cbc40 0x7f02140ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f02195ca700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f021415bf30 0x7f02140adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f02195ca700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021415fb60 con 0x7f02140cbc40 2023-07-21T22:14:45.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f02195ca700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021415db60 con 0x7f02140b0200 2023-07-21T22:14:45.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f02195ca700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021415ef90 con 0x7f021415bf30 2023-07-21T22:14:45.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f020b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02140cbc40 0x7f02140ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f020b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02140cbc40 0x7f02140ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57314/0 (socket says 172.21.15.49:57314) 2023-07-21T22:14:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f020b7fe700 1 -- 172.21.15.49:0/4014427315 learned_addr learned my addr 172.21.15.49:0/4014427315 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f0213fff700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02140b0200 0x7f02140c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f0218dc9700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f021415bf30 0x7f02140adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f020b7fe700 1 -- 172.21.15.49:0/4014427315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f021415bf30 msgr2=0x7f02140adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f020b7fe700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f021415bf30 0x7f02140adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f020b7fe700 1 -- 172.21.15.49:0/4014427315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02140b0200 msgr2=0x7f02140c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f020b7fe700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02140b0200 0x7f02140c2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f020b7fe700 1 -- 172.21.15.49:0/4014427315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c0094b0 con 0x7f02140cbc40 2023-07-21T22:14:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f0213fff700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02140b0200 0x7f02140c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:45.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f020b7fe700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02140cbc40 0x7f02140ada70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00c4d0 tx=0x7f01fc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:45.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f02117fa700 1 -- 172.21.15.49:0/4014427315 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0052d0 con 0x7f02140cbc40 2023-07-21T22:14:45.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f02117fa700 1 -- 172.21.15.49:0/4014427315 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc005430 con 0x7f02140cbc40 2023-07-21T22:14:45.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f02117fa700 1 -- 172.21.15.49:0/4014427315 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0055a0 con 0x7f02140cbc40 2023-07-21T22:14:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f02195ca700 1 -- 172.21.15.49:0/4014427315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021415f230 con 0x7f02140cbc40 2023-07-21T22:14:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f02195ca700 1 -- 172.21.15.49:0/4014427315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021415f7f0 con 0x7f02140cbc40 2023-07-21T22:14:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.508+0000 7f02195ca700 1 -- 172.21.15.49:0/4014427315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021404dcb0 con 0x7f02140cbc40 2023-07-21T22:14:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.512+0000 7f02117fa700 1 -- 172.21.15.49:0/4014427315 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01fc0038c0 con 0x7f02140cbc40 2023-07-21T22:14:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.512+0000 7f02117fa700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01f40662f0 0x7f01f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.512+0000 7f02117fa700 1 -- 172.21.15.49:0/4014427315 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f01fc082f30 con 0x7f02140cbc40 2023-07-21T22:14:45.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.512+0000 7f0213fff700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01f40662f0 0x7f01f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.516+0000 7f0213fff700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01f40662f0 0x7f01f40687a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f02040012e0 tx=0x7f0204001a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:45.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.520+0000 7f02117fa700 1 -- 172.21.15.49:0/4014427315 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01fc0504f0 con 0x7f02140cbc40 2023-07-21T22:14:45.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.696+0000 7f02195ca700 1 -- 172.21.15.49:0/4014427315 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f02140cb7f0 con 0x7f01f40662f0 2023-07-21T22:14:45.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.696+0000 7f02117fa700 1 -- 172.21.15.49:0/4014427315 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0204001fe0 con 0x7f01f40662f0 2023-07-21T22:14:45.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.700+0000 7f02195ca700 1 -- 172.21.15.49:0/4014427315 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01f40662f0 msgr2=0x7f01f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.700+0000 7f02195ca700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01f40662f0 0x7f01f40687a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f02040012e0 tx=0x7f0204001a90 comp rx=0 tx=0).stop 2023-07-21T22:14:45.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.700+0000 7f02195ca700 1 -- 172.21.15.49:0/4014427315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02140cbc40 msgr2=0x7f02140ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.700+0000 7f02195ca700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02140cbc40 0x7f02140ada70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00c4d0 tx=0x7f01fc00c7e0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.700+0000 7f02195ca700 1 -- 172.21.15.49:0/4014427315 shutdown_connections 2023-07-21T22:14:45.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.700+0000 7f02195ca700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f01f40662f0 0x7f01f40687a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.700+0000 7f02195ca700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02140cbc40 0x7f02140ada70 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.700+0000 7f02195ca700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f021415bf30 0x7f02140adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.700+0000 7f02195ca700 1 --2- 172.21.15.49:0/4014427315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02140b0200 0x7f02140c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.700+0000 7f02195ca700 1 -- 172.21.15.49:0/4014427315 >> 172.21.15.49:0/4014427315 conn(0x7f0214070450 msgr2=0x7f02140ca2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:45.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.700+0000 7f02195ca700 1 -- 172.21.15.49:0/4014427315 shutdown_connections 2023-07-21T22:14:45.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.700+0000 7f02195ca700 1 -- 172.21.15.49:0/4014427315 wait complete. 2023-07-21T22:14:45.747 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 1 to deep-scrub 2023-07-21T22:14:45.766 INFO:tasks.ceph:Scrubbing osd.2 2023-07-21T22:14:45.766 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:14:45.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.904+0000 7f65f5c2f700 1 Processor -- start 2023-07-21T22:14:45.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.904+0000 7f65f5c2f700 1 -- start start 2023-07-21T22:14:45.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65f5c2f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65f006ebd0 0x7f65f00b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65f5c2f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f65f015ba40 0x7f65f015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65f5c2f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f015c400 con 0x7f65f006efa0 2023-07-21T22:14:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65f5c2f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f00d0150 con 0x7f65f015ba40 2023-07-21T22:14:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65f5c2f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00ccc20 con 0x7f65f006ebd0 2023-07-21T22:14:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65effff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f65f006efa0 0x7f65f00cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52412/0 (socket says 172.21.15.49:52412) 2023-07-21T22:14:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65effff700 1 -- 172.21.15.49:0/520871276 learned_addr learned my addr 172.21.15.49:0/520871276 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65f542e700 1 --2- 172.21.15.49:0/520871276 >> v2:172.21.15.150:3300/0 conn(0x7f65f015ba40 0x7f65f015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65f4c2d700 1 --2- 172.21.15.49:0/520871276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65f006ebd0 0x7f65f00b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65ef7fe700 1 -- 172.21.15.49:0/520871276 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641160418 0 0) 0x7f65f015c400 con 0x7f65f006efa0 2023-07-21T22:14:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65ef7fe700 1 -- 172.21.15.49:0/520871276 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65e00035d0 con 0x7f65f006efa0 2023-07-21T22:14:45.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65f542e700 1 -- 172.21.15.49:0/520871276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65f006ebd0 msgr2=0x7f65f00b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:45.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65f542e700 1 --2- 172.21.15.49:0/520871276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65f006ebd0 0x7f65f00b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65f542e700 1 -- 172.21.15.49:0/520871276 >> v1:172.21.15.49:6789/0 conn(0x7f65f006efa0 legacy=0x7f65f00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65f542e700 1 -- 172.21.15.49:0/520871276 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00ccf00 con 0x7f65f015ba40 2023-07-21T22:14:45.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.908+0000 7f65f542e700 1 --2- 172.21.15.49:0/520871276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65f015ba40 0x7f65f015bec0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009d90 tx=0x7f65e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c075de9df30047ee server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:45.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.912+0000 7f65ef7fe700 1 -- 172.21.15.49:0/520871276 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e800e070 con 0x7f65f015ba40 2023-07-21T22:14:45.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.912+0000 7f65ef7fe700 1 -- 172.21.15.49:0/520871276 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e800bb20 con 0x7f65f015ba40 2023-07-21T22:14:45.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.912+0000 7f65ef7fe700 1 -- 172.21.15.49:0/520871276 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8012430 con 0x7f65f015ba40 2023-07-21T22:14:45.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.912+0000 7f65f5c2f700 1 -- 172.21.15.49:0/520871276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65f015ba40 msgr2=0x7f65f015bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.912+0000 7f65f5c2f700 1 --2- 172.21.15.49:0/520871276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65f015ba40 0x7f65f015bec0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009d90 tx=0x7f65e800b330 comp rx=0 tx=0).stop 2023-07-21T22:14:45.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.912+0000 7f65f5c2f700 1 -- 172.21.15.49:0/520871276 shutdown_connections 2023-07-21T22:14:45.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.912+0000 7f65f5c2f700 1 --2- 172.21.15.49:0/520871276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65f015ba40 0x7f65f015bec0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.912+0000 7f65f5c2f700 1 --2- 172.21.15.49:0/520871276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65f006ebd0 0x7f65f00b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.912+0000 7f65f5c2f700 1 -- 172.21.15.49:0/520871276 >> 172.21.15.49:0/520871276 conn(0x7f65f0070a80 msgr2=0x7f65f00b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:45.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.912+0000 7f65f5c2f700 1 -- 172.21.15.49:0/520871276 shutdown_connections 2023-07-21T22:14:45.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.912+0000 7f65f5c2f700 1 -- 172.21.15.49:0/520871276 wait complete. 2023-07-21T22:14:45.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.912+0000 7f65f5c2f700 1 Processor -- start 2023-07-21T22:14:45.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.912+0000 7f65f5c2f700 1 -- start start 2023-07-21T22:14:45.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f5c2f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65f006ebd0 0x7f65f014a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f5c2f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65f006efa0 0x7f65f00b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f5c2f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65f015ba40 0x7f65f00b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f5c2f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f014ad40 con 0x7f65f015ba40 2023-07-21T22:14:45.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f5c2f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00cb0b0 con 0x7f65f006efa0 2023-07-21T22:14:45.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f5c2f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00cb540 con 0x7f65f006ebd0 2023-07-21T22:14:45.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f542e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65f015ba40 0x7f65f00b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f542e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65f015ba40 0x7f65f00b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57322/0 (socket says 172.21.15.49:57322) 2023-07-21T22:14:45.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f542e700 1 -- 172.21.15.49:0/1172722497 learned_addr learned my addr 172.21.15.49:0/1172722497 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:45.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65effff700 1 --2- 172.21.15.49:0/1172722497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65f006efa0 0x7f65f00b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f4c2d700 1 --2- 172.21.15.49:0/1172722497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65f006ebd0 0x7f65f014a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f542e700 1 -- 172.21.15.49:0/1172722497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65f006ebd0 msgr2=0x7f65f014a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f542e700 1 --2- 172.21.15.49:0/1172722497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65f006ebd0 0x7f65f014a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f542e700 1 -- 172.21.15.49:0/1172722497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65f006efa0 msgr2=0x7f65f00b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f542e700 1 --2- 172.21.15.49:0/1172722497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65f006efa0 0x7f65f00b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f542e700 1 -- 172.21.15.49:0/1172722497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e8009a70 con 0x7f65f015ba40 2023-07-21T22:14:45.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65f542e700 1 --2- 172.21.15.49:0/1172722497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65f015ba40 0x7f65f00b2970 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f65e800b370 tx=0x7f65e8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:45.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65ed7fa700 1 -- 172.21.15.49:0/1172722497 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8012430 con 0x7f65f015ba40 2023-07-21T22:14:45.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.916+0000 7f65ed7fa700 1 -- 172.21.15.49:0/1172722497 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e8020070 con 0x7f65f015ba40 2023-07-21T22:14:45.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.920+0000 7f65ed7fa700 1 -- 172.21.15.49:0/1172722497 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8004280 con 0x7f65f015ba40 2023-07-21T22:14:45.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.920+0000 7f65f5c2f700 1 -- 172.21.15.49:0/1172722497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f00ca4a0 con 0x7f65f015ba40 2023-07-21T22:14:45.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.920+0000 7f65f5c2f700 1 -- 172.21.15.49:0/1172722497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f00caa60 con 0x7f65f015ba40 2023-07-21T22:14:45.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.920+0000 7f65f5c2f700 1 -- 172.21.15.49:0/1172722497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65f00d05a0 con 0x7f65f015ba40 2023-07-21T22:14:45.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.920+0000 7f65ed7fa700 1 -- 172.21.15.49:0/1172722497 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f65e80043e0 con 0x7f65f015ba40 2023-07-21T22:14:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.924+0000 7f65ed7fa700 1 --2- 172.21.15.49:0/1172722497 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65d4066320 0x7f65d40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.924+0000 7f65ed7fa700 1 -- 172.21.15.49:0/1172722497 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f65e8022070 con 0x7f65f015ba40 2023-07-21T22:14:45.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.924+0000 7f65f4c2d700 1 --2- 172.21.15.49:0/1172722497 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65d4066320 0x7f65d40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.924+0000 7f65ed7fa700 1 --2- 172.21.15.49:0/1172722497 >> [v2:172.21.15.49:6824/3193969798,v1:172.21.15.49:6825/3193969798] conn(0x7f65d406cc30 0x7f65d406f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:45.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.924+0000 7f65ed7fa700 1 -- 172.21.15.49:0/1172722497 --> [v2:172.21.15.49:6824/3193969798,v1:172.21.15.49:6825/3193969798] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65d406f730 con 0x7f65d406cc30 2023-07-21T22:14:45.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.924+0000 7f65ed7fa700 1 -- 172.21.15.49:0/1172722497 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65e8087d50 con 0x7f65f015ba40 2023-07-21T22:14:45.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.924+0000 7f65effff700 1 --2- 172.21.15.49:0/1172722497 >> [v2:172.21.15.49:6824/3193969798,v1:172.21.15.49:6825/3193969798] conn(0x7f65d406cc30 0x7f65d406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:45.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.924+0000 7f65f4c2d700 1 --2- 172.21.15.49:0/1172722497 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65d4066320 0x7f65d40687d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009b80 tx=0x7f65e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.924+0000 7f65effff700 1 --2- 172.21.15.49:0/1172722497 >> [v2:172.21.15.49:6824/3193969798,v1:172.21.15.49:6825/3193969798] conn(0x7f65d406cc30 0x7f65d406f060 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.924+0000 7f65ed7fa700 1 -- 172.21.15.49:0/1172722497 <== osd.2 v2:172.21.15.49:6824/3193969798 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f65d406f730 con 0x7f65d406cc30 2023-07-21T22:14:45.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.940+0000 7f65f5c2f700 1 -- 172.21.15.49:0/1172722497 --> [v2:172.21.15.49:6824/3193969798,v1:172.21.15.49:6825/3193969798] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f65f015d9d0 con 0x7f65d406cc30 2023-07-21T22:14:45.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.944+0000 7f65ed7fa700 1 -- 172.21.15.49:0/1172722497 <== osd.2 v2:172.21.15.49:6824/3193969798 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f65dc0018b0 con 0x7f65d406cc30 2023-07-21T22:14:45.988 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:14:45.988 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:14:45.988 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:14:45.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.944+0000 7f65f5c2f700 1 -- 172.21.15.49:0/1172722497 >> [v2:172.21.15.49:6824/3193969798,v1:172.21.15.49:6825/3193969798] conn(0x7f65d406cc30 msgr2=0x7f65d406f060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.944+0000 7f65f5c2f700 1 --2- 172.21.15.49:0/1172722497 >> [v2:172.21.15.49:6824/3193969798,v1:172.21.15.49:6825/3193969798] conn(0x7f65d406cc30 0x7f65d406f060 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.944+0000 7f65f5c2f700 1 -- 172.21.15.49:0/1172722497 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65d4066320 msgr2=0x7f65d40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.944+0000 7f65f5c2f700 1 --2- 172.21.15.49:0/1172722497 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f65d4066320 0x7f65d40687d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009b80 tx=0x7f65e4008040 comp rx=0 tx=0).stop 2023-07-21T22:14:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.944+0000 7f65f5c2f700 1 -- 172.21.15.49:0/1172722497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65f015ba40 msgr2=0x7f65f00b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.944+0000 7f65f5c2f700 1 --2- 172.21.15.49:0/1172722497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65f015ba40 0x7f65f00b2970 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f65e800b370 tx=0x7f65e8004af0 comp rx=0 tx=0).stop 2023-07-21T22:14:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.944+0000 7f65f542e700 1 -- 172.21.15.49:0/1172722497 reap_dead start 2023-07-21T22:14:45.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.944+0000 7f65f5c2f700 1 -- 172.21.15.49:0/1172722497 shutdown_connections 2023-07-21T22:14:45.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.944+0000 7f65f5c2f700 1 -- 172.21.15.49:0/1172722497 >> 172.21.15.49:0/1172722497 conn(0x7f65f0070a80 msgr2=0x7f65f01600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:45.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.944+0000 7f65f5c2f700 1 -- 172.21.15.49:0/1172722497 shutdown_connections 2023-07-21T22:14:45.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:45.944+0000 7f65f5c2f700 1 -- 172.21.15.49:0/1172722497 wait complete. 2023-07-21T22:14:46.010 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-21T22:14:46.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.152+0000 7fc0453ef700 1 Processor -- start 2023-07-21T22:14:46.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.152+0000 7fc0453ef700 1 -- start start 2023-07-21T22:14:46.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc0453ef700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc0400b7af0 0x7fc0400b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc0453ef700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc0400d1e40 0x7fc04015f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc0453ef700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0400b3e80 con 0x7fc0400cee10 2023-07-21T22:14:46.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc0453ef700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0400cea00 con 0x7fc0400d1e40 2023-07-21T22:14:46.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc0453ef700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0400ccbf0 con 0x7fc0400b7af0 2023-07-21T22:14:46.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc044bee700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc0400cee10 0x7fc0400b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52418/0 (socket says 172.21.15.49:52418) 2023-07-21T22:14:46.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc044bee700 1 -- 172.21.15.49:0/2059625520 learned_addr learned my addr 172.21.15.49:0/2059625520 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:46.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc03f7fe700 1 --2- 172.21.15.49:0/2059625520 >> v2:172.21.15.49:3300/0 conn(0x7fc0400d1e40 0x7fc04015f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc03ffff700 1 --2- 172.21.15.49:0/2059625520 >> v2:172.21.15.150:3300/0 conn(0x7fc0400b7af0 0x7fc0400b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc03effd700 1 -- 172.21.15.49:0/2059625520 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580651357 0 0) 0x7fc0400b3e80 con 0x7fc0400cee10 2023-07-21T22:14:46.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc03effd700 1 -- 172.21.15.49:0/2059625520 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0280035d0 con 0x7fc0400cee10 2023-07-21T22:14:46.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc03ffff700 1 -- 172.21.15.49:0/2059625520 >> v2:172.21.15.49:3300/0 conn(0x7fc0400d1e40 msgr2=0x7fc04015f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:46.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc03ffff700 1 --2- 172.21.15.49:0/2059625520 >> v2:172.21.15.49:3300/0 conn(0x7fc0400d1e40 0x7fc04015f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc03ffff700 1 -- 172.21.15.49:0/2059625520 >> v1:172.21.15.49:6789/0 conn(0x7fc0400cee10 legacy=0x7fc0400b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc03effd700 1 -- 172.21.15.49:0/2059625520 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4168568934 0 0) 0x7fc0280035d0 con 0x7fc0400cee10 2023-07-21T22:14:46.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc03ffff700 1 -- 172.21.15.49:0/2059625520 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400cced0 con 0x7fc0400b7af0 2023-07-21T22:14:46.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.156+0000 7fc03ffff700 1 --2- 172.21.15.49:0/2059625520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0400b7af0 0x7fc0400b1630 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc0400cede0 tx=0x7fc030009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b19075dc4014aa91 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:46.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.160+0000 7fc03effd700 1 -- 172.21.15.49:0/2059625520 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038001a40 con 0x7fc0400b7af0 2023-07-21T22:14:46.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.160+0000 7fc03effd700 1 -- 172.21.15.49:0/2059625520 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc030004030 con 0x7fc0400b7af0 2023-07-21T22:14:46.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.160+0000 7fc03effd700 1 -- 172.21.15.49:0/2059625520 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0300043c0 con 0x7fc0400b7af0 2023-07-21T22:14:46.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.160+0000 7fc0453ef700 1 -- 172.21.15.49:0/2059625520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0400b7af0 msgr2=0x7fc0400b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.160+0000 7fc0453ef700 1 --2- 172.21.15.49:0/2059625520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0400b7af0 0x7fc0400b1630 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc0400cede0 tx=0x7fc030009b30 comp rx=0 tx=0).stop 2023-07-21T22:14:46.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.160+0000 7fc0453ef700 1 -- 172.21.15.49:0/2059625520 shutdown_connections 2023-07-21T22:14:46.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.160+0000 7fc0453ef700 1 --2- 172.21.15.49:0/2059625520 >> v2:172.21.15.49:3300/0 conn(0x7fc0400d1e40 0x7fc04015f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.160+0000 7fc0453ef700 1 --2- 172.21.15.49:0/2059625520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0400b7af0 0x7fc0400b1630 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.160+0000 7fc0453ef700 1 -- 172.21.15.49:0/2059625520 >> 172.21.15.49:0/2059625520 conn(0x7fc04006e960 msgr2=0x7fc04006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:46.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.160+0000 7fc0453ef700 1 -- 172.21.15.49:0/2059625520 shutdown_connections 2023-07-21T22:14:46.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.160+0000 7fc0453ef700 1 -- 172.21.15.49:0/2059625520 wait complete. 2023-07-21T22:14:46.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.164+0000 7fc0453ef700 1 Processor -- start 2023-07-21T22:14:46.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.164+0000 7fc0453ef700 1 -- start start 2023-07-21T22:14:46.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.164+0000 7fc0453ef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0400b7af0 0x7fc04015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.164+0000 7fc0453ef700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0400cee10 0x7fc0400cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.164+0000 7fc0453ef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0400d1e40 0x7fc0400ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.164+0000 7fc0453ef700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04015a750 con 0x7fc0400b7af0 2023-07-21T22:14:46.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.164+0000 7fc0453ef700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400cca40 con 0x7fc0400cee10 2023-07-21T22:14:46.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.164+0000 7fc0453ef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0401f63a0 con 0x7fc0400d1e40 2023-07-21T22:14:46.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.164+0000 7fc03ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0400b7af0 0x7fc04015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.164+0000 7fc03ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0400b7af0 0x7fc04015a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57344/0 (socket says 172.21.15.49:57344) 2023-07-21T22:14:46.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.164+0000 7fc03ffff700 1 -- 172.21.15.49:0/2854122406 learned_addr learned my addr 172.21.15.49:0/2854122406 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:46.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.164+0000 7fc044bee700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0400d1e40 0x7fc0400ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.164+0000 7fc03f7fe700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0400cee10 0x7fc0400cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.168+0000 7fc03ffff700 1 -- 172.21.15.49:0/2854122406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0400d1e40 msgr2=0x7fc0400ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.168+0000 7fc03ffff700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0400d1e40 0x7fc0400ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.168+0000 7fc03ffff700 1 -- 172.21.15.49:0/2854122406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0400cee10 msgr2=0x7fc0400cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.168+0000 7fc03ffff700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0400cee10 0x7fc0400cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.168+0000 7fc03ffff700 1 -- 172.21.15.49:0/2854122406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0300094b0 con 0x7fc0400b7af0 2023-07-21T22:14:46.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.168+0000 7fc03f7fe700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0400cee10 0x7fc0400cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:46.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.168+0000 7fc03ffff700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0400b7af0 0x7fc04015a210 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fc0300090b0 tx=0x7fc030004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:46.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.168+0000 7fc03cff9700 1 -- 172.21.15.49:0/2854122406 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030003d40 con 0x7fc0400b7af0 2023-07-21T22:14:46.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.168+0000 7fc0453ef700 1 -- 172.21.15.49:0/2854122406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0401f6680 con 0x7fc0400b7af0 2023-07-21T22:14:46.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.168+0000 7fc03cff9700 1 -- 172.21.15.49:0/2854122406 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03001f070 con 0x7fc0400b7af0 2023-07-21T22:14:46.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.168+0000 7fc03cff9700 1 -- 172.21.15.49:0/2854122406 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030011870 con 0x7fc0400b7af0 2023-07-21T22:14:46.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.168+0000 7fc0453ef700 1 -- 172.21.15.49:0/2854122406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0401f6c40 con 0x7fc0400b7af0 2023-07-21T22:14:46.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.168+0000 7fc0453ef700 1 -- 172.21.15.49:0/2854122406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04004dcb0 con 0x7fc0400b7af0 2023-07-21T22:14:46.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.172+0000 7fc03cff9700 1 -- 172.21.15.49:0/2854122406 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc0300119d0 con 0x7fc0400b7af0 2023-07-21T22:14:46.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.172+0000 7fc03cff9700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc02c0662f0 0x7fc02c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.172+0000 7fc03cff9700 1 -- 172.21.15.49:0/2854122406 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fc030021070 con 0x7fc0400b7af0 2023-07-21T22:14:46.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.172+0000 7fc03f7fe700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc02c0662f0 0x7fc02c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.176+0000 7fc03f7fe700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc02c0662f0 0x7fc02c0687a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc04006dc80 tx=0x7fc034008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:46.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.180+0000 7fc03cff9700 1 -- 172.21.15.49:0/2854122406 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc030052ab0 con 0x7fc0400b7af0 2023-07-21T22:14:46.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.352+0000 7fc0453ef700 1 -- 172.21.15.49:0/2854122406 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0400b7ec0 con 0x7fc02c0662f0 2023-07-21T22:14:46.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.352+0000 7fc03cff9700 1 -- 172.21.15.49:0/2854122406 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc034004030 con 0x7fc02c0662f0 2023-07-21T22:14:46.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.356+0000 7fc0453ef700 1 -- 172.21.15.49:0/2854122406 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc02c0662f0 msgr2=0x7fc02c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.356+0000 7fc0453ef700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc02c0662f0 0x7fc02c0687a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc04006dc80 tx=0x7fc034008040 comp rx=0 tx=0).stop 2023-07-21T22:14:46.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.356+0000 7fc0453ef700 1 -- 172.21.15.49:0/2854122406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0400b7af0 msgr2=0x7fc04015a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.356+0000 7fc0453ef700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0400b7af0 0x7fc04015a210 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fc0300090b0 tx=0x7fc030004770 comp rx=0 tx=0).stop 2023-07-21T22:14:46.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.360+0000 7fc0453ef700 1 -- 172.21.15.49:0/2854122406 shutdown_connections 2023-07-21T22:14:46.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.360+0000 7fc0453ef700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc02c0662f0 0x7fc02c0687a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.360+0000 7fc0453ef700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0400d1e40 0x7fc0400ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.360+0000 7fc0453ef700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0400cee10 0x7fc0400cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.360+0000 7fc0453ef700 1 --2- 172.21.15.49:0/2854122406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0400b7af0 0x7fc04015a210 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.360+0000 7fc0453ef700 1 -- 172.21.15.49:0/2854122406 >> 172.21.15.49:0/2854122406 conn(0x7fc04006e960 msgr2=0x7fc0400b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.360+0000 7fc0453ef700 1 -- 172.21.15.49:0/2854122406 shutdown_connections 2023-07-21T22:14:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.360+0000 7fc0453ef700 1 -- 172.21.15.49:0/2854122406 wait complete. 2023-07-21T22:14:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 2 to deep-scrub 2023-07-21T22:14:46.425 INFO:tasks.ceph:Scrubbing osd.3 2023-07-21T22:14:46.426 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:14:46.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.568+0000 7fc347725700 1 Processor -- start 2023-07-21T22:14:46.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.572+0000 7fc347725700 1 -- start start 2023-07-21T22:14:46.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.572+0000 7fc347725700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc3400ce790 0x7fc3400ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.572+0000 7fc347725700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3400b8680 con 0x7fc3400d0b80 2023-07-21T22:14:46.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.572+0000 7fc347725700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3400d3500 con 0x7fc3400cdd50 2023-07-21T22:14:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.572+0000 7fc344cc0700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc3400d0b80 0x7fc3400cf330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52434/0 (socket says 172.21.15.49:52434) 2023-07-21T22:14:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.572+0000 7fc347725700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3400d2fa0 con 0x7fc3400ce790 2023-07-21T22:14:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.572+0000 7fc344cc0700 1 -- 172.21.15.49:0/1341222356 learned_addr learned my addr 172.21.15.49:0/1341222356 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc345cc2700 1 --2- 172.21.15.49:0/1341222356 >> v2:172.21.15.150:3300/0 conn(0x7fc3400ce790 0x7fc3400ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc337fff700 1 -- 172.21.15.49:0/1341222356 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460614903 0 0) 0x7fc3400b8680 con 0x7fc3400d0b80 2023-07-21T22:14:46.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc337fff700 1 -- 172.21.15.49:0/1341222356 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc32c0035d0 con 0x7fc3400d0b80 2023-07-21T22:14:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc337fff700 1 -- 172.21.15.49:0/1341222356 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408944601 0 0) 0x7fc3400d3500 con 0x7fc3400cdd50 2023-07-21T22:14:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc337fff700 1 -- 172.21.15.49:0/1341222356 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3400b8680 con 0x7fc3400cdd50 2023-07-21T22:14:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc345cc2700 1 -- 172.21.15.49:0/1341222356 >> v1:172.21.15.150:6789/0 conn(0x7fc3400cdd50 legacy=0x7fc3400d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc345cc2700 1 -- 172.21.15.49:0/1341222356 >> v1:172.21.15.49:6789/0 conn(0x7fc3400d0b80 legacy=0x7fc3400cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc345cc2700 1 -- 172.21.15.49:0/1341222356 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3400b6290 con 0x7fc3400ce790 2023-07-21T22:14:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc337fff700 1 -- 172.21.15.49:0/1341222356 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2606965809 0 0) 0x7fc32c0035d0 con 0x7fc3400d0b80 2023-07-21T22:14:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc345cc2700 1 --2- 172.21.15.49:0/1341222356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3400ce790 0x7fc3400ccce0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc338009d90 tx=0x7fc33800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=385377ecfe7fae95 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:46.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc337fff700 1 -- 172.21.15.49:0/1341222356 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33800e070 con 0x7fc3400ce790 2023-07-21T22:14:46.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc337fff700 1 -- 172.21.15.49:0/1341222356 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33800bb20 con 0x7fc3400ce790 2023-07-21T22:14:46.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc337fff700 1 -- 172.21.15.49:0/1341222356 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33800bed0 con 0x7fc3400ce790 2023-07-21T22:14:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc347725700 1 -- 172.21.15.49:0/1341222356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3400ce790 msgr2=0x7fc3400ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.576+0000 7fc347725700 1 --2- 172.21.15.49:0/1341222356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3400ce790 0x7fc3400ccce0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc338009d90 tx=0x7fc33800b330 comp rx=0 tx=0).stop 2023-07-21T22:14:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.580+0000 7fc347725700 1 -- 172.21.15.49:0/1341222356 shutdown_connections 2023-07-21T22:14:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.580+0000 7fc347725700 1 --2- 172.21.15.49:0/1341222356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3400ce790 0x7fc3400ccce0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.580+0000 7fc347725700 1 -- 172.21.15.49:0/1341222356 >> 172.21.15.49:0/1341222356 conn(0x7fc3400b55e0 msgr2=0x7fc3400b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.580+0000 7fc347725700 1 -- 172.21.15.49:0/1341222356 shutdown_connections 2023-07-21T22:14:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.580+0000 7fc347725700 1 -- 172.21.15.49:0/1341222356 wait complete. 2023-07-21T22:14:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.580+0000 7fc347725700 1 Processor -- start 2023-07-21T22:14:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.580+0000 7fc347725700 1 -- start start 2023-07-21T22:14:46.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc347725700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3400cdd50 0x7fc34015a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc347725700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3400ce790 0x7fc3401f1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc347725700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3400d0b80 0x7fc3400711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc347725700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34009c2f0 con 0x7fc3400d0b80 2023-07-21T22:14:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc347725700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400c61b0 con 0x7fc3400cdd50 2023-07-21T22:14:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc347725700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400c6490 con 0x7fc3400ce790 2023-07-21T22:14:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc345cc2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3400d0b80 0x7fc3400711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc345cc2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3400d0b80 0x7fc3400711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57358/0 (socket says 172.21.15.49:57358) 2023-07-21T22:14:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc345cc2700 1 -- 172.21.15.49:0/3998801484 learned_addr learned my addr 172.21.15.49:0/3998801484 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc3454c1700 1 --2- 172.21.15.49:0/3998801484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3400cdd50 0x7fc34015a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc344cc0700 1 --2- 172.21.15.49:0/3998801484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3400ce790 0x7fc3401f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc345cc2700 1 -- 172.21.15.49:0/3998801484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3400ce790 msgr2=0x7fc3401f1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc345cc2700 1 --2- 172.21.15.49:0/3998801484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3400ce790 0x7fc3401f1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc345cc2700 1 -- 172.21.15.49:0/3998801484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3400cdd50 msgr2=0x7fc34015a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc345cc2700 1 --2- 172.21.15.49:0/3998801484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3400cdd50 0x7fc34015a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc345cc2700 1 -- 172.21.15.49:0/3998801484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338009a70 con 0x7fc3400d0b80 2023-07-21T22:14:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc345cc2700 1 --2- 172.21.15.49:0/3998801484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3400d0b80 0x7fc3400711a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc338014040 tx=0x7fc338004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc335ffb700 1 -- 172.21.15.49:0/3998801484 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33801b810 con 0x7fc3400d0b80 2023-07-21T22:14:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc335ffb700 1 -- 172.21.15.49:0/3998801484 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc338020070 con 0x7fc3400d0b80 2023-07-21T22:14:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc347725700 1 -- 172.21.15.49:0/3998801484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3400c6770 con 0x7fc3400d0b80 2023-07-21T22:14:46.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc335ffb700 1 -- 172.21.15.49:0/3998801484 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33801bbd0 con 0x7fc3400d0b80 2023-07-21T22:14:46.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.584+0000 7fc347725700 1 -- 172.21.15.49:0/3998801484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3400c6d30 con 0x7fc3400d0b80 2023-07-21T22:14:46.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.588+0000 7fc347725700 1 -- 172.21.15.49:0/3998801484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3400cee10 con 0x7fc3400d0b80 2023-07-21T22:14:46.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.588+0000 7fc335ffb700 1 -- 172.21.15.49:0/3998801484 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc33801bd30 con 0x7fc3400d0b80 2023-07-21T22:14:46.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.592+0000 7fc335ffb700 1 --2- 172.21.15.49:0/3998801484 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc3240662f0 0x7fc3240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.592+0000 7fc335ffb700 1 -- 172.21.15.49:0/3998801484 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fc338022070 con 0x7fc3400d0b80 2023-07-21T22:14:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.592+0000 7fc3454c1700 1 --2- 172.21.15.49:0/3998801484 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc3240662f0 0x7fc3240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.592+0000 7fc335ffb700 1 --2- 172.21.15.49:0/3998801484 >> [v2:172.21.15.49:6816/3284520698,v1:172.21.15.49:6817/3284520698] conn(0x7fc32406cc00 0x7fc32406f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.592+0000 7fc335ffb700 1 -- 172.21.15.49:0/3998801484 --> [v2:172.21.15.49:6816/3284520698,v1:172.21.15.49:6817/3284520698] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc32406f700 con 0x7fc32406cc00 2023-07-21T22:14:46.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.592+0000 7fc335ffb700 1 -- 172.21.15.49:0/3998801484 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc33808a2a0 con 0x7fc3400d0b80 2023-07-21T22:14:46.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.592+0000 7fc344cc0700 1 --2- 172.21.15.49:0/3998801484 >> [v2:172.21.15.49:6816/3284520698,v1:172.21.15.49:6817/3284520698] conn(0x7fc32406cc00 0x7fc32406f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.592+0000 7fc3454c1700 1 --2- 172.21.15.49:0/3998801484 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc3240662f0 0x7fc3240687a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc33c001250 tx=0x7fc33c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:46.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.592+0000 7fc344cc0700 1 --2- 172.21.15.49:0/3998801484 >> [v2:172.21.15.49:6816/3284520698,v1:172.21.15.49:6817/3284520698] conn(0x7fc32406cc00 0x7fc32406f030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:46.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.596+0000 7fc335ffb700 1 -- 172.21.15.49:0/3998801484 <== osd.3 v2:172.21.15.49:6816/3284520698 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc32406f700 con 0x7fc32406cc00 2023-07-21T22:14:46.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.616+0000 7fc347725700 1 -- 172.21.15.49:0/3998801484 --> [v2:172.21.15.49:6816/3284520698,v1:172.21.15.49:6817/3284520698] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc3400d3220 con 0x7fc32406cc00 2023-07-21T22:14:46.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.616+0000 7fc335ffb700 1 -- 172.21.15.49:0/3998801484 <== osd.3 v2:172.21.15.49:6816/3284520698 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc330001550 con 0x7fc32406cc00 2023-07-21T22:14:46.661 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:14:46.661 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:14:46.661 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:14:46.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.616+0000 7fc347725700 1 -- 172.21.15.49:0/3998801484 >> [v2:172.21.15.49:6816/3284520698,v1:172.21.15.49:6817/3284520698] conn(0x7fc32406cc00 msgr2=0x7fc32406f030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.616+0000 7fc347725700 1 --2- 172.21.15.49:0/3998801484 >> [v2:172.21.15.49:6816/3284520698,v1:172.21.15.49:6817/3284520698] conn(0x7fc32406cc00 0x7fc32406f030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.616+0000 7fc347725700 1 -- 172.21.15.49:0/3998801484 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc3240662f0 msgr2=0x7fc3240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.616+0000 7fc347725700 1 --2- 172.21.15.49:0/3998801484 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fc3240662f0 0x7fc3240687a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc33c001250 tx=0x7fc33c009040 comp rx=0 tx=0).stop 2023-07-21T22:14:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.616+0000 7fc347725700 1 -- 172.21.15.49:0/3998801484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3400d0b80 msgr2=0x7fc3400711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.616+0000 7fc347725700 1 --2- 172.21.15.49:0/3998801484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3400d0b80 0x7fc3400711a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc338014040 tx=0x7fc338004af0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.616+0000 7fc345cc2700 1 -- 172.21.15.49:0/3998801484 reap_dead start 2023-07-21T22:14:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.616+0000 7fc347725700 1 -- 172.21.15.49:0/3998801484 shutdown_connections 2023-07-21T22:14:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.616+0000 7fc347725700 1 -- 172.21.15.49:0/3998801484 >> 172.21.15.49:0/3998801484 conn(0x7fc3400b55e0 msgr2=0x7fc3400b04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.616+0000 7fc347725700 1 -- 172.21.15.49:0/3998801484 shutdown_connections 2023-07-21T22:14:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.616+0000 7fc347725700 1 -- 172.21.15.49:0/3998801484 wait complete. 2023-07-21T22:14:46.685 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-21T22:14:46.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.820+0000 7fe819e85700 1 Processor -- start 2023-07-21T22:14:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.820+0000 7fe819e85700 1 -- start start 2023-07-21T22:14:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.820+0000 7fe819e85700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe814158c00 0x7fe81415d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.820+0000 7fe819e85700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe81406da70 0x7fe81406c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.820+0000 7fe819e85700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe814158fd0 con 0x7fe8140c90d0 2023-07-21T22:14:46.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.820+0000 7fe819e85700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81406d650 con 0x7fe81406da70 2023-07-21T22:14:46.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.820+0000 7fe819e85700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81406c9d0 con 0x7fe814158c00 2023-07-21T22:14:46.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe819684700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe8140c90d0 0x7fe8140cbc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52450/0 (socket says 172.21.15.49:52450) 2023-07-21T22:14:46.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe819684700 1 -- 172.21.15.49:0/2692889994 learned_addr learned my addr 172.21.15.49:0/2692889994 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:46.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe818e83700 1 --2- 172.21.15.49:0/2692889994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe814158c00 0x7fe81415d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe813fff700 1 --2- 172.21.15.49:0/2692889994 >> v2:172.21.15.49:3300/0 conn(0x7fe81406da70 0x7fe81406c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe818e83700 1 -- 172.21.15.49:0/2692889994 >> v2:172.21.15.49:3300/0 conn(0x7fe81406da70 msgr2=0x7fe81406c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:46.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe818e83700 1 --2- 172.21.15.49:0/2692889994 >> v2:172.21.15.49:3300/0 conn(0x7fe81406da70 0x7fe81406c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe818e83700 1 -- 172.21.15.49:0/2692889994 >> v1:172.21.15.49:6789/0 conn(0x7fe8140c90d0 legacy=0x7fe8140cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe8137fe700 1 -- 172.21.15.49:0/2692889994 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205728324 0 0) 0x7fe814158fd0 con 0x7fe8140c90d0 2023-07-21T22:14:46.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe818e83700 1 -- 172.21.15.49:0/2692889994 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81406ccb0 con 0x7fe814158c00 2023-07-21T22:14:46.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe818e83700 1 --2- 172.21.15.49:0/2692889994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe814158c00 0x7fe81415d180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe808009850 tx=0x7fe808009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=236169be13457283 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:46.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe8137fe700 1 -- 172.21.15.49:0/2692889994 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808011830 con 0x7fe814158c00 2023-07-21T22:14:46.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe8137fe700 1 -- 172.21.15.49:0/2692889994 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe808011990 con 0x7fe814158c00 2023-07-21T22:14:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe8137fe700 1 -- 172.21.15.49:0/2692889994 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808011d40 con 0x7fe814158c00 2023-07-21T22:14:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe819e85700 1 -- 172.21.15.49:0/2692889994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe814158c00 msgr2=0x7fe81415d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe819e85700 1 --2- 172.21.15.49:0/2692889994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe814158c00 0x7fe81415d180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe808009850 tx=0x7fe808009b60 comp rx=0 tx=0).stop 2023-07-21T22:14:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe819e85700 1 -- 172.21.15.49:0/2692889994 shutdown_connections 2023-07-21T22:14:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe819e85700 1 --2- 172.21.15.49:0/2692889994 >> v2:172.21.15.49:3300/0 conn(0x7fe81406da70 0x7fe81406c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe819e85700 1 --2- 172.21.15.49:0/2692889994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe814158c00 0x7fe81415d180 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe819e85700 1 -- 172.21.15.49:0/2692889994 >> 172.21.15.49:0/2692889994 conn(0x7fe814070450 msgr2=0x7fe814070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe819e85700 1 -- 172.21.15.49:0/2692889994 shutdown_connections 2023-07-21T22:14:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.824+0000 7fe819e85700 1 -- 172.21.15.49:0/2692889994 wait complete. 2023-07-21T22:14:46.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.828+0000 7fe819e85700 1 Processor -- start 2023-07-21T22:14:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.828+0000 7fe819e85700 1 -- start start 2023-07-21T22:14:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.828+0000 7fe819e85700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe81406da70 0x7fe8141f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.828+0000 7fe819e85700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8140c90d0 0x7fe8141542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.828+0000 7fe819e85700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe814158c00 0x7fe8141547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.828+0000 7fe819e85700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8141f4d20 con 0x7fe814158c00 2023-07-21T22:14:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.828+0000 7fe819e85700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe814154040 con 0x7fe81406da70 2023-07-21T22:14:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.828+0000 7fe819e85700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8141f4f70 con 0x7fe8140c90d0 2023-07-21T22:14:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.828+0000 7fe819684700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe814158c00 0x7fe8141547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.828+0000 7fe819684700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe814158c00 0x7fe8141547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57374/0 (socket says 172.21.15.49:57374) 2023-07-21T22:14:46.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.828+0000 7fe813fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8140c90d0 0x7fe8141542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.828+0000 7fe819684700 1 -- 172.21.15.49:0/1089436758 learned_addr learned my addr 172.21.15.49:0/1089436758 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:46.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.832+0000 7fe818e83700 1 --2- 172.21.15.49:0/1089436758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe81406da70 0x7fe8141f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.832+0000 7fe819684700 1 -- 172.21.15.49:0/1089436758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8140c90d0 msgr2=0x7fe8141542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.832+0000 7fe819684700 1 --2- 172.21.15.49:0/1089436758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8140c90d0 0x7fe8141542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.832+0000 7fe819684700 1 -- 172.21.15.49:0/1089436758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe81406da70 msgr2=0x7fe8141f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:46.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.832+0000 7fe819684700 1 --2- 172.21.15.49:0/1089436758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe81406da70 0x7fe8141f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:46.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.832+0000 7fe819684700 1 -- 172.21.15.49:0/1089436758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8080094b0 con 0x7fe814158c00 2023-07-21T22:14:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.832+0000 7fe819684700 1 --2- 172.21.15.49:0/1089436758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe814158c00 0x7fe8141547f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00cba0 tx=0x7fe80c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.832+0000 7fe8117fa700 1 -- 172.21.15.49:0/1089436758 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c00aaa0 con 0x7fe814158c00 2023-07-21T22:14:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.832+0000 7fe8117fa700 1 -- 172.21.15.49:0/1089436758 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c00ac20 con 0x7fe814158c00 2023-07-21T22:14:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.832+0000 7fe8117fa700 1 -- 172.21.15.49:0/1089436758 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0070d0 con 0x7fe814158c00 2023-07-21T22:14:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.832+0000 7fe819e85700 1 -- 172.21.15.49:0/1089436758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8141f5250 con 0x7fe814158c00 2023-07-21T22:14:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.832+0000 7fe819e85700 1 -- 172.21.15.49:0/1089436758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8141f5810 con 0x7fe814158c00 2023-07-21T22:14:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.832+0000 7fe819e85700 1 -- 172.21.15.49:0/1089436758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81404dcb0 con 0x7fe814158c00 2023-07-21T22:14:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.836+0000 7fe8117fa700 1 -- 172.21.15.49:0/1089436758 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe80c007230 con 0x7fe814158c00 2023-07-21T22:14:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.836+0000 7fe8117fa700 1 --2- 172.21.15.49:0/1089436758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe7f80662f0 0x7fe7f80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.836+0000 7fe8117fa700 1 -- 172.21.15.49:0/1089436758 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe80c083620 con 0x7fe814158c00 2023-07-21T22:14:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.836+0000 7fe818e83700 1 --2- 172.21.15.49:0/1089436758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe7f80662f0 0x7fe7f80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:46.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.840+0000 7fe818e83700 1 --2- 172.21.15.49:0/1089436758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe7f80662f0 0x7fe7f80687a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe8080090b0 tx=0x7fe80801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:46.844+0000 7fe8117fa700 1 -- 172.21.15.49:0/1089436758 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe80c050be0 con 0x7fe814158c00 2023-07-21T22:14:47.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.020+0000 7fe819e85700 1 -- 172.21.15.49:0/1089436758 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe81406d270 con 0x7fe7f80662f0 2023-07-21T22:14:47.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.020+0000 7fe8117fa700 1 -- 172.21.15.49:0/1089436758 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe808011b80 con 0x7fe7f80662f0 2023-07-21T22:14:47.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.024+0000 7fe819e85700 1 -- 172.21.15.49:0/1089436758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe7f80662f0 msgr2=0x7fe7f80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.024+0000 7fe819e85700 1 --2- 172.21.15.49:0/1089436758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe7f80662f0 0x7fe7f80687a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe8080090b0 tx=0x7fe80801c040 comp rx=0 tx=0).stop 2023-07-21T22:14:47.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.024+0000 7fe819e85700 1 -- 172.21.15.49:0/1089436758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe814158c00 msgr2=0x7fe8141547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.024+0000 7fe819e85700 1 --2- 172.21.15.49:0/1089436758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe814158c00 0x7fe8141547f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00cba0 tx=0x7fe80c00ceb0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.024+0000 7fe819e85700 1 -- 172.21.15.49:0/1089436758 shutdown_connections 2023-07-21T22:14:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.024+0000 7fe819e85700 1 --2- 172.21.15.49:0/1089436758 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fe7f80662f0 0x7fe7f80687a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.024+0000 7fe819e85700 1 --2- 172.21.15.49:0/1089436758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe814158c00 0x7fe8141547f0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.024+0000 7fe819e85700 1 --2- 172.21.15.49:0/1089436758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8140c90d0 0x7fe8141542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.024+0000 7fe819e85700 1 --2- 172.21.15.49:0/1089436758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe81406da70 0x7fe8141f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.024+0000 7fe819e85700 1 -- 172.21.15.49:0/1089436758 >> 172.21.15.49:0/1089436758 conn(0x7fe814070450 msgr2=0x7fe81415a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:47.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.024+0000 7fe819e85700 1 -- 172.21.15.49:0/1089436758 shutdown_connections 2023-07-21T22:14:47.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.024+0000 7fe819e85700 1 -- 172.21.15.49:0/1089436758 wait complete. 2023-07-21T22:14:47.073 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 3 to deep-scrub 2023-07-21T22:14:47.090 INFO:tasks.ceph:Scrubbing osd.4 2023-07-21T22:14:47.091 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:14:47.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.228+0000 7f4d9ba91700 1 Processor -- start 2023-07-21T22:14:47.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.228+0000 7f4d9ba91700 1 -- start start 2023-07-21T22:14:47.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9ba91700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d940aff50 0x7f4d940ad500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9ba91700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4d940b0320 0x7f4d94160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9ba91700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d94071610 con 0x7f4d940cbe30 2023-07-21T22:14:47.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9ba91700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9415d5d0 con 0x7f4d940aff50 2023-07-21T22:14:47.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9ba91700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d940cdda0 con 0x7f4d940b0320 2023-07-21T22:14:47.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9982d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d940aff50 0x7f4d940ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9982d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d940aff50 0x7f4d940ad500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57386/0 (socket says 172.21.15.49:57386) 2023-07-21T22:14:47.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9982d700 1 -- 172.21.15.49:0/3498665946 learned_addr learned my addr 172.21.15.49:0/3498665946 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:47.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9982d700 1 -- 172.21.15.49:0/3498665946 >> v2:172.21.15.150:3300/0 conn(0x7f4d940b0320 msgr2=0x7f4d94160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:47.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9982d700 1 --2- 172.21.15.49:0/3498665946 >> v2:172.21.15.150:3300/0 conn(0x7f4d940b0320 0x7f4d94160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9982d700 1 -- 172.21.15.49:0/3498665946 >> v1:172.21.15.150:6789/0 conn(0x7f4d940cbe30 legacy=0x7f4d9415fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:47.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9982d700 1 -- 172.21.15.49:0/3498665946 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d940caae0 con 0x7f4d940aff50 2023-07-21T22:14:47.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9982d700 1 --2- 172.21.15.49:0/3498665946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d940aff50 0x7f4d940ad500 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4d9406be70 tx=0x7f4d9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1347120470c3d83a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:47.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9882b700 1 -- 172.21.15.49:0/3498665946 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000e070 con 0x7f4d940aff50 2023-07-21T22:14:47.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9882b700 1 -- 172.21.15.49:0/3498665946 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d90003a40 con 0x7f4d940aff50 2023-07-21T22:14:47.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9882b700 1 -- 172.21.15.49:0/3498665946 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90003df0 con 0x7f4d940aff50 2023-07-21T22:14:47.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9ba91700 1 -- 172.21.15.49:0/3498665946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d940aff50 msgr2=0x7f4d940ad500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9ba91700 1 --2- 172.21.15.49:0/3498665946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d940aff50 0x7f4d940ad500 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4d9406be70 tx=0x7f4d9000b330 comp rx=0 tx=0).stop 2023-07-21T22:14:47.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9ba91700 1 -- 172.21.15.49:0/3498665946 shutdown_connections 2023-07-21T22:14:47.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9ba91700 1 --2- 172.21.15.49:0/3498665946 >> v2:172.21.15.150:3300/0 conn(0x7f4d940b0320 0x7f4d94160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9ba91700 1 --2- 172.21.15.49:0/3498665946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d940aff50 0x7f4d940ad500 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9ba91700 1 -- 172.21.15.49:0/3498665946 >> 172.21.15.49:0/3498665946 conn(0x7f4d940cace0 msgr2=0x7f4d940cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:47.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9ba91700 1 -- 172.21.15.49:0/3498665946 shutdown_connections 2023-07-21T22:14:47.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.232+0000 7f4d9ba91700 1 -- 172.21.15.49:0/3498665946 wait complete. 2023-07-21T22:14:47.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.236+0000 7f4d9ba91700 1 Processor -- start 2023-07-21T22:14:47.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.236+0000 7f4d9ba91700 1 -- start start 2023-07-21T22:14:47.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.236+0000 7f4d9ba91700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d940aff50 0x7f4d940c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.236+0000 7f4d9ba91700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d940b0320 0x7f4d940c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.236+0000 7f4d9ba91700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d940cbe30 0x7f4d94152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.236+0000 7f4d9ba91700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d940c53d0 con 0x7f4d940aff50 2023-07-21T22:14:47.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.236+0000 7f4d9ba91700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d940c5640 con 0x7f4d940cbe30 2023-07-21T22:14:47.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.236+0000 7f4d9ba91700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d940c5920 con 0x7f4d940b0320 2023-07-21T22:14:47.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.236+0000 7f4d9982d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d940aff50 0x7f4d940c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.236+0000 7f4d9982d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d940aff50 0x7f4d940c79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57398/0 (socket says 172.21.15.49:57398) 2023-07-21T22:14:47.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.236+0000 7f4d9982d700 1 -- 172.21.15.49:0/147021422 learned_addr learned my addr 172.21.15.49:0/147021422 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:47.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.240+0000 7f4d9902c700 1 --2- 172.21.15.49:0/147021422 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d940b0320 0x7f4d940c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.240+0000 7f4d9a02e700 1 --2- 172.21.15.49:0/147021422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d940cbe30 0x7f4d94152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.240+0000 7f4d9982d700 1 -- 172.21.15.49:0/147021422 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d940b0320 msgr2=0x7f4d940c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.240+0000 7f4d9982d700 1 --2- 172.21.15.49:0/147021422 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d940b0320 0x7f4d940c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.240+0000 7f4d9982d700 1 -- 172.21.15.49:0/147021422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d940cbe30 msgr2=0x7f4d94152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.240+0000 7f4d9982d700 1 --2- 172.21.15.49:0/147021422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d940cbe30 0x7f4d94152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.240+0000 7f4d9982d700 1 -- 172.21.15.49:0/147021422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d90009b30 con 0x7f4d940aff50 2023-07-21T22:14:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.240+0000 7f4d9982d700 1 --2- 172.21.15.49:0/147021422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d940aff50 0x7f4d940c79e0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f4d94066cd0 tx=0x7f4d90004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.240+0000 7f4d8a7fc700 1 -- 172.21.15.49:0/147021422 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90004300 con 0x7f4d940aff50 2023-07-21T22:14:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.240+0000 7f4d8a7fc700 1 -- 172.21.15.49:0/147021422 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d90004460 con 0x7f4d940aff50 2023-07-21T22:14:47.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.240+0000 7f4d9ba91700 1 -- 172.21.15.49:0/147021422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d940c5c00 con 0x7f4d940aff50 2023-07-21T22:14:47.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.240+0000 7f4d8a7fc700 1 -- 172.21.15.49:0/147021422 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90004810 con 0x7f4d940aff50 2023-07-21T22:14:47.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.240+0000 7f4d9ba91700 1 -- 172.21.15.49:0/147021422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d940c8260 con 0x7f4d940aff50 2023-07-21T22:14:47.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.240+0000 7f4d9ba91700 1 -- 172.21.15.49:0/147021422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d940c57b0 con 0x7f4d940aff50 2023-07-21T22:14:47.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.244+0000 7f4d8a7fc700 1 -- 172.21.15.49:0/147021422 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4d90019070 con 0x7f4d940aff50 2023-07-21T22:14:47.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.244+0000 7f4d8a7fc700 1 --2- 172.21.15.49:0/147021422 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4d780662f0 0x7f4d780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.244+0000 7f4d8a7fc700 1 -- 172.21.15.49:0/147021422 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f4d90085160 con 0x7f4d940aff50 2023-07-21T22:14:47.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.244+0000 7f4d8a7fc700 1 --2- 172.21.15.49:0/147021422 >> [v2:172.21.15.150:6800/3591224217,v1:172.21.15.150:6801/3591224217] conn(0x7f4d7806cc00 0x7f4d7806f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.244+0000 7f4d8a7fc700 1 -- 172.21.15.49:0/147021422 --> [v2:172.21.15.150:6800/3591224217,v1:172.21.15.150:6801/3591224217] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d7806f700 con 0x7f4d7806cc00 2023-07-21T22:14:47.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.244+0000 7f4d8a7fc700 1 -- 172.21.15.49:0/147021422 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d900854d0 con 0x7f4d940aff50 2023-07-21T22:14:47.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.244+0000 7f4d9902c700 1 --2- 172.21.15.49:0/147021422 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4d780662f0 0x7f4d780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.244+0000 7f4d9a02e700 1 --2- 172.21.15.49:0/147021422 >> [v2:172.21.15.150:6800/3591224217,v1:172.21.15.150:6801/3591224217] conn(0x7f4d7806cc00 0x7f4d7806f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.244+0000 7f4d9902c700 1 --2- 172.21.15.49:0/147021422 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4d780662f0 0x7f4d780687a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4d940aeb50 tx=0x7f4d84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:47.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.248+0000 7f4d9a02e700 1 --2- 172.21.15.49:0/147021422 >> [v2:172.21.15.150:6800/3591224217,v1:172.21.15.150:6801/3591224217] conn(0x7f4d7806cc00 0x7f4d7806f030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:47.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.248+0000 7f4d8a7fc700 1 -- 172.21.15.49:0/147021422 <== osd.4 v2:172.21.15.150:6800/3591224217 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4d7806f700 con 0x7f4d7806cc00 2023-07-21T22:14:47.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.268+0000 7f4d9ba91700 1 -- 172.21.15.49:0/147021422 --> [v2:172.21.15.150:6800/3591224217,v1:172.21.15.150:6801/3591224217] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4d9415c3c0 con 0x7f4d7806cc00 2023-07-21T22:14:47.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.268+0000 7f4d8a7fc700 1 -- 172.21.15.49:0/147021422 <== osd.4 v2:172.21.15.150:6800/3591224217 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4d8c009580 con 0x7f4d7806cc00 2023-07-21T22:14:47.313 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:14:47.313 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:14:47.313 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:14:47.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.268+0000 7f4d9ba91700 1 -- 172.21.15.49:0/147021422 >> [v2:172.21.15.150:6800/3591224217,v1:172.21.15.150:6801/3591224217] conn(0x7f4d7806cc00 msgr2=0x7f4d7806f030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.268+0000 7f4d9ba91700 1 --2- 172.21.15.49:0/147021422 >> [v2:172.21.15.150:6800/3591224217,v1:172.21.15.150:6801/3591224217] conn(0x7f4d7806cc00 0x7f4d7806f030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.268+0000 7f4d9ba91700 1 -- 172.21.15.49:0/147021422 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4d780662f0 msgr2=0x7f4d780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.268+0000 7f4d9ba91700 1 --2- 172.21.15.49:0/147021422 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f4d780662f0 0x7f4d780687a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4d940aeb50 tx=0x7f4d84008040 comp rx=0 tx=0).stop 2023-07-21T22:14:47.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.268+0000 7f4d9ba91700 1 -- 172.21.15.49:0/147021422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d940aff50 msgr2=0x7f4d940c79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.268+0000 7f4d9ba91700 1 --2- 172.21.15.49:0/147021422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d940aff50 0x7f4d940c79e0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f4d94066cd0 tx=0x7f4d90004af0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.268+0000 7f4d9a02e700 1 -- 172.21.15.49:0/147021422 reap_dead start 2023-07-21T22:14:47.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.268+0000 7f4d9ba91700 1 -- 172.21.15.49:0/147021422 shutdown_connections 2023-07-21T22:14:47.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.268+0000 7f4d9ba91700 1 -- 172.21.15.49:0/147021422 >> 172.21.15.49:0/147021422 conn(0x7f4d940cace0 msgr2=0x7f4d940c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:47.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.268+0000 7f4d9ba91700 1 -- 172.21.15.49:0/147021422 shutdown_connections 2023-07-21T22:14:47.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.268+0000 7f4d9ba91700 1 -- 172.21.15.49:0/147021422 wait complete. 2023-07-21T22:14:47.335 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-21T22:14:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.468+0000 7f22da79e700 1 Processor -- start 2023-07-21T22:14:47.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.468+0000 7f22da79e700 1 -- start start 2023-07-21T22:14:47.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22da79e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4160370 0x7f22d406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22da79e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f22d40ca490 0x7f22d4163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22da79e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d406e010 con 0x7f22d40c1470 2023-07-21T22:14:47.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22da79e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d4160740 con 0x7f22d40ca490 2023-07-21T22:14:47.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22da79e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d40ccc50 con 0x7f22d4160370 2023-07-21T22:14:47.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22d9f9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f22d40ca490 0x7f22d4163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22d979c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4160370 0x7f22d406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22d979c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4160370 0x7f22d406d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.49:35034/0 (socket says 172.21.15.49:35034) 2023-07-21T22:14:47.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22d979c700 1 -- 172.21.15.49:0/3036963743 learned_addr learned my addr 172.21.15.49:0/3036963743 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:47.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22d9f9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f22d40ca490 0x7f22d4163ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:52836/0 (socket says 172.21.15.49:52836) 2023-07-21T22:14:47.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22d8f9b700 1 --1- 172.21.15.49:0/3036963743 >> v1:172.21.15.150:6789/0 conn(0x7f22d40c1470 0x7f22d40c9d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:34304/0 (socket says 172.21.15.49:34304) 2023-07-21T22:14:47.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22d9f9d700 1 -- 172.21.15.49:0/3036963743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4160370 msgr2=0x7f22d406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:47.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22d9f9d700 1 --2- 172.21.15.49:0/3036963743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4160370 0x7f22d406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22d9f9d700 1 -- 172.21.15.49:0/3036963743 >> v1:172.21.15.150:6789/0 conn(0x7f22d40c1470 legacy=0x7f22d40c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22cbfff700 1 -- 172.21.15.49:0/3036963743 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30841263 0 0) 0x7f22d406e010 con 0x7f22d40c1470 2023-07-21T22:14:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22d9f9d700 1 -- 172.21.15.49:0/3036963743 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d40afc90 con 0x7f22d40ca490 2023-07-21T22:14:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.472+0000 7f22d979c700 1 --2- 172.21.15.49:0/3036963743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4160370 0x7f22d406d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:14:47.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.476+0000 7f22d9f9d700 1 --2- 172.21.15.49:0/3036963743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22d40ca490 0x7f22d4163ef0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009d90 tx=0x7f22cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3928eb0a761b0e77 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:47.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.476+0000 7f22cbfff700 1 -- 172.21.15.49:0/3036963743 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc00e070 con 0x7f22d40ca490 2023-07-21T22:14:47.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.476+0000 7f22cbfff700 1 -- 172.21.15.49:0/3036963743 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22cc00bb20 con 0x7f22d40ca490 2023-07-21T22:14:47.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.476+0000 7f22cbfff700 1 -- 172.21.15.49:0/3036963743 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc012430 con 0x7f22d40ca490 2023-07-21T22:14:47.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.476+0000 7f22da79e700 1 -- 172.21.15.49:0/3036963743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22d40ca490 msgr2=0x7f22d4163ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.476+0000 7f22da79e700 1 --2- 172.21.15.49:0/3036963743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22d40ca490 0x7f22d4163ef0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009d90 tx=0x7f22cc00b330 comp rx=0 tx=0).stop 2023-07-21T22:14:47.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.476+0000 7f22da79e700 1 -- 172.21.15.49:0/3036963743 shutdown_connections 2023-07-21T22:14:47.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.476+0000 7f22da79e700 1 --2- 172.21.15.49:0/3036963743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22d40ca490 0x7f22d4163ef0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.476+0000 7f22da79e700 1 --2- 172.21.15.49:0/3036963743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4160370 0x7f22d406d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.476+0000 7f22da79e700 1 -- 172.21.15.49:0/3036963743 >> 172.21.15.49:0/3036963743 conn(0x7f22d4070450 msgr2=0x7f22d4070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:47.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.476+0000 7f22da79e700 1 -- 172.21.15.49:0/3036963743 shutdown_connections 2023-07-21T22:14:47.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.476+0000 7f22da79e700 1 -- 172.21.15.49:0/3036963743 wait complete. 2023-07-21T22:14:47.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.480+0000 7f22da79e700 1 Processor -- start 2023-07-21T22:14:47.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.480+0000 7f22da79e700 1 -- start start 2023-07-21T22:14:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.480+0000 7f22da79e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d40c1470 0x7f22d40c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.480+0000 7f22da79e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22d40ca490 0x7f22d41554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.480+0000 7f22da79e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4160370 0x7f22d40b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.480+0000 7f22da79e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d40c5140 con 0x7f22d40c1470 2023-07-21T22:14:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.480+0000 7f22da79e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d40c5700 con 0x7f22d40ca490 2023-07-21T22:14:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.480+0000 7f22da79e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d40af630 con 0x7f22d4160370 2023-07-21T22:14:47.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.480+0000 7f22d979c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d40c1470 0x7f22d40c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22d979c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d40c1470 0x7f22d40c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57404/0 (socket says 172.21.15.49:57404) 2023-07-21T22:14:47.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22d979c700 1 -- 172.21.15.49:0/456319976 learned_addr learned my addr 172.21.15.49:0/456319976 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:47.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22d8f9b700 1 --2- 172.21.15.49:0/456319976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22d40ca490 0x7f22d41554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22d9f9d700 1 --2- 172.21.15.49:0/456319976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4160370 0x7f22d40b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22d979c700 1 -- 172.21.15.49:0/456319976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4160370 msgr2=0x7f22d40b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22d979c700 1 --2- 172.21.15.49:0/456319976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4160370 0x7f22d40b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22d979c700 1 -- 172.21.15.49:0/456319976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22d40ca490 msgr2=0x7f22d41554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22d979c700 1 --2- 172.21.15.49:0/456319976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22d40ca490 0x7f22d41554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22d979c700 1 -- 172.21.15.49:0/456319976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d0009570 con 0x7f22d40c1470 2023-07-21T22:14:47.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22d979c700 1 --2- 172.21.15.49:0/456319976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d40c1470 0x7f22d40c7e30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f22d000ea00 tx=0x7f22d000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:47.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22c9ffb700 1 -- 172.21.15.49:0/456319976 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d000eea0 con 0x7f22d40c1470 2023-07-21T22:14:47.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22c9ffb700 1 -- 172.21.15.49:0/456319976 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d000c850 con 0x7f22d40c1470 2023-07-21T22:14:47.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22da79e700 1 -- 172.21.15.49:0/456319976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc009a70 con 0x7f22d40c1470 2023-07-21T22:14:47.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22c9ffb700 1 -- 172.21.15.49:0/456319976 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d000cbc0 con 0x7f22d40c1470 2023-07-21T22:14:47.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22da79e700 1 -- 172.21.15.49:0/456319976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d40c5390 con 0x7f22d40c1470 2023-07-21T22:14:47.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.484+0000 7f22da79e700 1 -- 172.21.15.49:0/456319976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d404dcb0 con 0x7f22d40c1470 2023-07-21T22:14:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.488+0000 7f22c9ffb700 1 -- 172.21.15.49:0/456319976 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f22d000cd20 con 0x7f22d40c1470 2023-07-21T22:14:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.488+0000 7f22c9ffb700 1 --2- 172.21.15.49:0/456319976 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f22b8066320 0x7f22b80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.488+0000 7f22c9ffb700 1 -- 172.21.15.49:0/456319976 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f22d0083b20 con 0x7f22d40c1470 2023-07-21T22:14:47.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.488+0000 7f22d8f9b700 1 --2- 172.21.15.49:0/456319976 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f22b8066320 0x7f22b80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.488+0000 7f22d8f9b700 1 --2- 172.21.15.49:0/456319976 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f22b8066320 0x7f22b80687d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f22d40c75a0 tx=0x7f22c4007e00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:47.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.496+0000 7f22c9ffb700 1 -- 172.21.15.49:0/456319976 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22d00510f0 con 0x7f22d40c1470 2023-07-21T22:14:47.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.672+0000 7f22da79e700 1 -- 172.21.15.49:0/456319976 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f22d40b0250 con 0x7f22b8066320 2023-07-21T22:14:47.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.672+0000 7f22c9ffb700 1 -- 172.21.15.49:0/456319976 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f22c4001370 con 0x7f22b8066320 2023-07-21T22:14:47.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.676+0000 7f22da79e700 1 -- 172.21.15.49:0/456319976 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f22b8066320 msgr2=0x7f22b80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.676+0000 7f22da79e700 1 --2- 172.21.15.49:0/456319976 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f22b8066320 0x7f22b80687d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f22d40c75a0 tx=0x7f22c4007e00 comp rx=0 tx=0).stop 2023-07-21T22:14:47.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.676+0000 7f22da79e700 1 -- 172.21.15.49:0/456319976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d40c1470 msgr2=0x7f22d40c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.676+0000 7f22da79e700 1 --2- 172.21.15.49:0/456319976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d40c1470 0x7f22d40c7e30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f22d000ea00 tx=0x7f22d000ed10 comp rx=0 tx=0).stop 2023-07-21T22:14:47.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.676+0000 7f22da79e700 1 -- 172.21.15.49:0/456319976 shutdown_connections 2023-07-21T22:14:47.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.676+0000 7f22da79e700 1 --2- 172.21.15.49:0/456319976 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f22b8066320 0x7f22b80687d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.676+0000 7f22da79e700 1 --2- 172.21.15.49:0/456319976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4160370 0x7f22d40b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.676+0000 7f22da79e700 1 --2- 172.21.15.49:0/456319976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22d40ca490 0x7f22d41554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.676+0000 7f22da79e700 1 --2- 172.21.15.49:0/456319976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d40c1470 0x7f22d40c7e30 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.676+0000 7f22da79e700 1 -- 172.21.15.49:0/456319976 >> 172.21.15.49:0/456319976 conn(0x7f22d4070450 msgr2=0x7f22d40ce880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:47.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.676+0000 7f22da79e700 1 -- 172.21.15.49:0/456319976 shutdown_connections 2023-07-21T22:14:47.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.676+0000 7f22da79e700 1 -- 172.21.15.49:0/456319976 wait complete. 2023-07-21T22:14:47.725 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 4 to deep-scrub 2023-07-21T22:14:47.745 INFO:tasks.ceph:Scrubbing osd.5 2023-07-21T22:14:47.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:14:47.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.888+0000 7fb17e5a7700 1 Processor -- start 2023-07-21T22:14:47.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.888+0000 7fb17e5a7700 1 -- start start 2023-07-21T22:14:47.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.892+0000 7fb17e5a7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb1780cdd50 0x7fb1780ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.892+0000 7fb17e5a7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1780b8680 con 0x7fb1780d0b80 2023-07-21T22:14:47.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.892+0000 7fb17e5a7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1780d3500 con 0x7fb1780ce790 2023-07-21T22:14:47.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.892+0000 7fb17e5a7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1780d2fa0 con 0x7fb1780cdd50 2023-07-21T22:14:47.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.892+0000 7fb17cb44700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb1780d0b80 0x7fb1780cf330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52460/0 (socket says 172.21.15.49:52460) 2023-07-21T22:14:47.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.892+0000 7fb17cb44700 1 -- 172.21.15.49:0/1296351819 learned_addr learned my addr 172.21.15.49:0/1296351819 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:47.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.892+0000 7fb177fff700 1 --2- 172.21.15.49:0/1296351819 >> v2:172.21.15.49:3300/0 conn(0x7fb1780cdd50 0x7fb1780ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.892+0000 7fb1777fe700 1 -- 172.21.15.49:0/1296351819 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660588199 0 0) 0x7fb1780b8680 con 0x7fb1780d0b80 2023-07-21T22:14:47.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.892+0000 7fb1777fe700 1 -- 172.21.15.49:0/1296351819 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1640035d0 con 0x7fb1780d0b80 2023-07-21T22:14:47.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.892+0000 7fb1777fe700 1 -- 172.21.15.49:0/1296351819 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011653461 0 0) 0x7fb1780d3500 con 0x7fb1780ce790 2023-07-21T22:14:47.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.892+0000 7fb1777fe700 1 -- 172.21.15.49:0/1296351819 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1780b8680 con 0x7fb1780ce790 2023-07-21T22:14:47.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.896+0000 7fb177fff700 1 -- 172.21.15.49:0/1296351819 >> v1:172.21.15.150:6789/0 conn(0x7fb1780ce790 legacy=0x7fb1780d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.896+0000 7fb177fff700 1 -- 172.21.15.49:0/1296351819 >> v1:172.21.15.49:6789/0 conn(0x7fb1780d0b80 legacy=0x7fb1780cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.896+0000 7fb177fff700 1 -- 172.21.15.49:0/1296351819 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780b6290 con 0x7fb1780cdd50 2023-07-21T22:14:47.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.896+0000 7fb177fff700 1 --2- 172.21.15.49:0/1296351819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1780cdd50 0x7fb1780ccce0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb168009840 tx=0x7fb168009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5586d2a8ba76f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:47.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.896+0000 7fb1777fe700 1 -- 172.21.15.49:0/1296351819 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168005e50 con 0x7fb1780cdd50 2023-07-21T22:14:47.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.896+0000 7fb1777fe700 1 -- 172.21.15.49:0/1296351819 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb168006030 con 0x7fb1780cdd50 2023-07-21T22:14:47.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.896+0000 7fb1777fe700 1 -- 172.21.15.49:0/1296351819 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1680063c0 con 0x7fb1780cdd50 2023-07-21T22:14:47.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.896+0000 7fb17e5a7700 1 -- 172.21.15.49:0/1296351819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1780cdd50 msgr2=0x7fb1780ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.896+0000 7fb17e5a7700 1 --2- 172.21.15.49:0/1296351819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1780cdd50 0x7fb1780ccce0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb168009840 tx=0x7fb168009b50 comp rx=0 tx=0).stop 2023-07-21T22:14:47.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.896+0000 7fb17e5a7700 1 -- 172.21.15.49:0/1296351819 shutdown_connections 2023-07-21T22:14:47.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.896+0000 7fb17e5a7700 1 --2- 172.21.15.49:0/1296351819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1780cdd50 0x7fb1780ccce0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.896+0000 7fb17e5a7700 1 -- 172.21.15.49:0/1296351819 >> 172.21.15.49:0/1296351819 conn(0x7fb1780b55e0 msgr2=0x7fb1780b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:47.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.896+0000 7fb17e5a7700 1 -- 172.21.15.49:0/1296351819 shutdown_connections 2023-07-21T22:14:47.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.896+0000 7fb17e5a7700 1 -- 172.21.15.49:0/1296351819 wait complete. 2023-07-21T22:14:47.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.900+0000 7fb17e5a7700 1 Processor -- start 2023-07-21T22:14:47.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.900+0000 7fb17e5a7700 1 -- start start 2023-07-21T22:14:47.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.900+0000 7fb17e5a7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1780cdd50 0x7fb1780b7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.900+0000 7fb17e5a7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1780ce790 0x7fb17814f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.900+0000 7fb17e5a7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1780d0b80 0x7fb17814fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.900+0000 7fb17e5a7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb178159750 con 0x7fb1780d0b80 2023-07-21T22:14:47.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.900+0000 7fb17e5a7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780b3f20 con 0x7fb1780ce790 2023-07-21T22:14:47.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.900+0000 7fb17e5a7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780b4200 con 0x7fb1780cdd50 2023-07-21T22:14:47.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb17cb44700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1780d0b80 0x7fb17814fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb17cb44700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1780d0b80 0x7fb17814fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57412/0 (socket says 172.21.15.49:57412) 2023-07-21T22:14:47.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb17cb44700 1 -- 172.21.15.49:0/2829436793 learned_addr learned my addr 172.21.15.49:0/2829436793 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:47.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb177fff700 1 --2- 172.21.15.49:0/2829436793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1780cdd50 0x7fb1780b7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb16f7fe700 1 --2- 172.21.15.49:0/2829436793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1780ce790 0x7fb17814f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb17cb44700 1 -- 172.21.15.49:0/2829436793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1780cdd50 msgr2=0x7fb1780b7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb17cb44700 1 --2- 172.21.15.49:0/2829436793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1780cdd50 0x7fb1780b7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb17cb44700 1 -- 172.21.15.49:0/2829436793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1780ce790 msgr2=0x7fb17814f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb17cb44700 1 --2- 172.21.15.49:0/2829436793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1780ce790 0x7fb17814f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb17cb44700 1 -- 172.21.15.49:0/2829436793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168009450 con 0x7fb1780d0b80 2023-07-21T22:14:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb17cb44700 1 --2- 172.21.15.49:0/2829436793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1780d0b80 0x7fb17814fd40 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fb17000c420 tx=0x7fb17000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb1757fa700 1 -- 172.21.15.49:0/2829436793 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170005d90 con 0x7fb1780d0b80 2023-07-21T22:14:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb1757fa700 1 -- 172.21.15.49:0/2829436793 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1700070d0 con 0x7fb1780d0b80 2023-07-21T22:14:47.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb17e5a7700 1 -- 172.21.15.49:0/2829436793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1780b44e0 con 0x7fb1780d0b80 2023-07-21T22:14:47.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb1757fa700 1 -- 172.21.15.49:0/2829436793 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170007460 con 0x7fb1780d0b80 2023-07-21T22:14:47.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb17e5a7700 1 -- 172.21.15.49:0/2829436793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1780b76a0 con 0x7fb1780d0b80 2023-07-21T22:14:47.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.904+0000 7fb17e5a7700 1 -- 172.21.15.49:0/2829436793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1780cee10 con 0x7fb1780d0b80 2023-07-21T22:14:47.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.908+0000 7fb1757fa700 1 -- 172.21.15.49:0/2829436793 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb1700075c0 con 0x7fb1780d0b80 2023-07-21T22:14:47.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.908+0000 7fb1757fa700 1 --2- 172.21.15.49:0/2829436793 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb1580662f0 0x7fb1580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.908+0000 7fb1757fa700 1 -- 172.21.15.49:0/2829436793 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb170082fb0 con 0x7fb1780d0b80 2023-07-21T22:14:47.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.908+0000 7fb177fff700 1 --2- 172.21.15.49:0/2829436793 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb1580662f0 0x7fb1580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.908+0000 7fb1757fa700 1 --2- 172.21.15.49:0/2829436793 >> [v2:172.21.15.150:6807/3465358811,v1:172.21.15.150:6809/3465358811] conn(0x7fb15806cc00 0x7fb15806f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:47.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.908+0000 7fb1757fa700 1 -- 172.21.15.49:0/2829436793 --> [v2:172.21.15.150:6807/3465358811,v1:172.21.15.150:6809/3465358811] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb15806f700 con 0x7fb15806cc00 2023-07-21T22:14:47.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.908+0000 7fb1757fa700 1 -- 172.21.15.49:0/2829436793 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb170085590 con 0x7fb1780d0b80 2023-07-21T22:14:47.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.908+0000 7fb16f7fe700 1 --2- 172.21.15.49:0/2829436793 >> [v2:172.21.15.150:6807/3465358811,v1:172.21.15.150:6809/3465358811] conn(0x7fb15806cc00 0x7fb15806f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:47.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.908+0000 7fb177fff700 1 --2- 172.21.15.49:0/2829436793 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb1580662f0 0x7fb1580687a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb168013040 tx=0x7fb168008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:47.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.912+0000 7fb16f7fe700 1 --2- 172.21.15.49:0/2829436793 >> [v2:172.21.15.150:6807/3465358811,v1:172.21.15.150:6809/3465358811] conn(0x7fb15806cc00 0x7fb15806f030 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:47.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.912+0000 7fb1757fa700 1 -- 172.21.15.49:0/2829436793 <== osd.5 v2:172.21.15.150:6807/3465358811 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb15806f700 con 0x7fb15806cc00 2023-07-21T22:14:47.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.932+0000 7fb17e5a7700 1 -- 172.21.15.49:0/2829436793 --> [v2:172.21.15.150:6807/3465358811,v1:172.21.15.150:6809/3465358811] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb1780d3220 con 0x7fb15806cc00 2023-07-21T22:14:47.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.932+0000 7fb1757fa700 1 -- 172.21.15.49:0/2829436793 <== osd.5 v2:172.21.15.150:6807/3465358811 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb160003a20 con 0x7fb15806cc00 2023-07-21T22:14:47.977 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:14:47.977 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:14:47.978 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:14:47.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.932+0000 7fb17e5a7700 1 -- 172.21.15.49:0/2829436793 >> [v2:172.21.15.150:6807/3465358811,v1:172.21.15.150:6809/3465358811] conn(0x7fb15806cc00 msgr2=0x7fb15806f030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.932+0000 7fb17e5a7700 1 --2- 172.21.15.49:0/2829436793 >> [v2:172.21.15.150:6807/3465358811,v1:172.21.15.150:6809/3465358811] conn(0x7fb15806cc00 0x7fb15806f030 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.932+0000 7fb17e5a7700 1 -- 172.21.15.49:0/2829436793 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb1580662f0 msgr2=0x7fb1580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.932+0000 7fb17e5a7700 1 --2- 172.21.15.49:0/2829436793 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb1580662f0 0x7fb1580687a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb168013040 tx=0x7fb168008070 comp rx=0 tx=0).stop 2023-07-21T22:14:47.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.932+0000 7fb17e5a7700 1 -- 172.21.15.49:0/2829436793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1780d0b80 msgr2=0x7fb17814fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:47.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.932+0000 7fb17e5a7700 1 --2- 172.21.15.49:0/2829436793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1780d0b80 0x7fb17814fd40 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fb17000c420 tx=0x7fb17000c7e0 comp rx=0 tx=0).stop 2023-07-21T22:14:47.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.932+0000 7fb17cb44700 1 -- 172.21.15.49:0/2829436793 reap_dead start 2023-07-21T22:14:47.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.932+0000 7fb17e5a7700 1 -- 172.21.15.49:0/2829436793 shutdown_connections 2023-07-21T22:14:47.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.932+0000 7fb17e5a7700 1 -- 172.21.15.49:0/2829436793 >> 172.21.15.49:0/2829436793 conn(0x7fb1780b55e0 msgr2=0x7fb17806e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:47.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.932+0000 7fb17e5a7700 1 -- 172.21.15.49:0/2829436793 shutdown_connections 2023-07-21T22:14:47.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:47.932+0000 7fb17e5a7700 1 -- 172.21.15.49:0/2829436793 wait complete. 2023-07-21T22:14:47.998 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-21T22:14:48.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.128+0000 7fb46507b700 1 Processor -- start 2023-07-21T22:14:48.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.128+0000 7fb46507b700 1 -- start start 2023-07-21T22:14:48.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb46507b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb4600d1e40 0x7fb4600b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb46507b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4600b3e80 con 0x7fb4600cee10 2023-07-21T22:14:48.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb46507b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46015fd40 con 0x7fb4600b7af0 2023-07-21T22:14:48.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb46507b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4600cea00 con 0x7fb4600d1e40 2023-07-21T22:14:48.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb45ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb4600b7af0 0x7fb46015f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.49:34324/0 (socket says 172.21.15.49:34324) 2023-07-21T22:14:48.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb45ffff700 1 -- 172.21.15.49:0/2501373907 learned_addr learned my addr 172.21.15.49:0/2501373907 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:48.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb45f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb4600d1e40 0x7fb4600b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb45effd700 1 -- 172.21.15.49:0/2501373907 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208810255 0 0) 0x7fb46015fd40 con 0x7fb4600b7af0 2023-07-21T22:14:48.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb45effd700 1 -- 172.21.15.49:0/2501373907 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4480035d0 con 0x7fb4600b7af0 2023-07-21T22:14:48.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb45f7fe700 1 -- 172.21.15.49:0/2501373907 >> v1:172.21.15.150:6789/0 conn(0x7fb4600b7af0 legacy=0x7fb46015f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb45f7fe700 1 -- 172.21.15.49:0/2501373907 >> v1:172.21.15.49:6789/0 conn(0x7fb4600cee10 legacy=0x7fb4600b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb45effd700 1 -- 172.21.15.49:0/2501373907 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570051616 0 0) 0x7fb4600b3e80 con 0x7fb4600cee10 2023-07-21T22:14:48.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb45f7fe700 1 -- 172.21.15.49:0/2501373907 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4600ccbf0 con 0x7fb4600d1e40 2023-07-21T22:14:48.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb45f7fe700 1 --2- 172.21.15.49:0/2501373907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4600d1e40 0x7fb4600b1630 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb454009850 tx=0x7fb454009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=498ca84fbccaa785 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb45effd700 1 -- 172.21.15.49:0/2501373907 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454011830 con 0x7fb4600d1e40 2023-07-21T22:14:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb45effd700 1 -- 172.21.15.49:0/2501373907 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb454011990 con 0x7fb4600d1e40 2023-07-21T22:14:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.132+0000 7fb45effd700 1 -- 172.21.15.49:0/2501373907 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454011d40 con 0x7fb4600d1e40 2023-07-21T22:14:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.136+0000 7fb46507b700 1 -- 172.21.15.49:0/2501373907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4600d1e40 msgr2=0x7fb4600b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.136+0000 7fb46507b700 1 --2- 172.21.15.49:0/2501373907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4600d1e40 0x7fb4600b1630 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb454009850 tx=0x7fb454009b60 comp rx=0 tx=0).stop 2023-07-21T22:14:48.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.136+0000 7fb46507b700 1 -- 172.21.15.49:0/2501373907 shutdown_connections 2023-07-21T22:14:48.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.136+0000 7fb46507b700 1 --2- 172.21.15.49:0/2501373907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4600d1e40 0x7fb4600b1630 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.136+0000 7fb46507b700 1 -- 172.21.15.49:0/2501373907 >> 172.21.15.49:0/2501373907 conn(0x7fb46006e960 msgr2=0x7fb46006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:48.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.136+0000 7fb46507b700 1 -- 172.21.15.49:0/2501373907 shutdown_connections 2023-07-21T22:14:48.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.136+0000 7fb46507b700 1 -- 172.21.15.49:0/2501373907 wait complete. 2023-07-21T22:14:48.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb46507b700 1 Processor -- start 2023-07-21T22:14:48.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb46507b700 1 -- start start 2023-07-21T22:14:48.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb46507b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4600b7af0 0x7fb46015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb46507b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4600cee10 0x7fb46015d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb46507b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4600d1e40 0x7fb4601f1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb46507b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46015daf0 con 0x7fb4600b7af0 2023-07-21T22:14:48.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb46507b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4601f1ec0 con 0x7fb4600d1e40 2023-07-21T22:14:48.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb46507b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4601f53c0 con 0x7fb4600cee10 2023-07-21T22:14:48.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb45ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4600b7af0 0x7fb46015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb45ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4600b7af0 0x7fb46015c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57428/0 (socket says 172.21.15.49:57428) 2023-07-21T22:14:48.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb45ffff700 1 -- 172.21.15.49:0/940390893 learned_addr learned my addr 172.21.15.49:0/940390893 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:48.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb46487a700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4600d1e40 0x7fb4601f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb45f7fe700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4600cee10 0x7fb46015d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb45ffff700 1 -- 172.21.15.49:0/940390893 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4600cee10 msgr2=0x7fb46015d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb45ffff700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4600cee10 0x7fb46015d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb45ffff700 1 -- 172.21.15.49:0/940390893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4600d1e40 msgr2=0x7fb4601f1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb45ffff700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4600d1e40 0x7fb4601f1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb45ffff700 1 -- 172.21.15.49:0/940390893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540094b0 con 0x7fb4600b7af0 2023-07-21T22:14:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb46487a700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4600d1e40 0x7fb4601f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb45ffff700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4600b7af0 0x7fb46015c890 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb45000c700 tx=0x7fb45000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.140+0000 7fb45cff9700 1 -- 172.21.15.49:0/940390893 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450005d90 con 0x7fb4600b7af0 2023-07-21T22:14:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.144+0000 7fb45cff9700 1 -- 172.21.15.49:0/940390893 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4500070d0 con 0x7fb4600b7af0 2023-07-21T22:14:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.144+0000 7fb45cff9700 1 -- 172.21.15.49:0/940390893 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450007480 con 0x7fb4600b7af0 2023-07-21T22:14:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.144+0000 7fb46507b700 1 -- 172.21.15.49:0/940390893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4601f4840 con 0x7fb4600b7af0 2023-07-21T22:14:48.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.144+0000 7fb46507b700 1 -- 172.21.15.49:0/940390893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4601f4e00 con 0x7fb4600b7af0 2023-07-21T22:14:48.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.144+0000 7fb46507b700 1 -- 172.21.15.49:0/940390893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4600b6e40 con 0x7fb4600b7af0 2023-07-21T22:14:48.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.148+0000 7fb45cff9700 1 -- 172.21.15.49:0/940390893 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb4500075e0 con 0x7fb4600b7af0 2023-07-21T22:14:48.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.148+0000 7fb45cff9700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb44c0662f0 0x7fb44c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.148+0000 7fb45cff9700 1 -- 172.21.15.49:0/940390893 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb4500831b0 con 0x7fb4600b7af0 2023-07-21T22:14:48.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.148+0000 7fb45f7fe700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb44c0662f0 0x7fb44c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.148+0000 7fb45f7fe700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb44c0662f0 0x7fb44c0687a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb4540090b0 tx=0x7fb45401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:48.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.156+0000 7fb45cff9700 1 -- 172.21.15.49:0/940390893 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb450050800 con 0x7fb4600b7af0 2023-07-21T22:14:48.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.332+0000 7fb46507b700 1 -- 172.21.15.49:0/940390893 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4600b7ec0 con 0x7fb44c0662f0 2023-07-21T22:14:48.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.332+0000 7fb45cff9700 1 -- 172.21.15.49:0/940390893 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb454011c00 con 0x7fb44c0662f0 2023-07-21T22:14:48.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.336+0000 7fb46507b700 1 -- 172.21.15.49:0/940390893 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb44c0662f0 msgr2=0x7fb44c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.336+0000 7fb46507b700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb44c0662f0 0x7fb44c0687a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb4540090b0 tx=0x7fb45401c040 comp rx=0 tx=0).stop 2023-07-21T22:14:48.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.336+0000 7fb46507b700 1 -- 172.21.15.49:0/940390893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4600b7af0 msgr2=0x7fb46015c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.336+0000 7fb46507b700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4600b7af0 0x7fb46015c890 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb45000c700 tx=0x7fb45000cac0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.336+0000 7fb46507b700 1 -- 172.21.15.49:0/940390893 shutdown_connections 2023-07-21T22:14:48.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.336+0000 7fb46507b700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fb44c0662f0 0x7fb44c0687a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.336+0000 7fb46507b700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4600d1e40 0x7fb4601f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.336+0000 7fb46507b700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4600cee10 0x7fb46015d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.336+0000 7fb46507b700 1 --2- 172.21.15.49:0/940390893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4600b7af0 0x7fb46015c890 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.336+0000 7fb46507b700 1 -- 172.21.15.49:0/940390893 >> 172.21.15.49:0/940390893 conn(0x7fb46006e960 msgr2=0x7fb46015f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:48.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.336+0000 7fb46507b700 1 -- 172.21.15.49:0/940390893 shutdown_connections 2023-07-21T22:14:48.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.336+0000 7fb46507b700 1 -- 172.21.15.49:0/940390893 wait complete. 2023-07-21T22:14:48.383 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 5 to deep-scrub 2023-07-21T22:14:48.401 INFO:tasks.ceph:Scrubbing osd.6 2023-07-21T22:14:48.402 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:14:48.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.540+0000 7f2576a40700 1 Processor -- start 2023-07-21T22:14:48.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.540+0000 7f2576a40700 1 -- start start 2023-07-21T22:14:48.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2576a40700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f257015bd80 0x7f25700cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2576a40700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257015ceb0 0x7f25700cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2576a40700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700cb990 con 0x7f25700afaf0 2023-07-21T22:14:48.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2576a40700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257015c410 con 0x7f257015bd80 2023-07-21T22:14:48.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2576a40700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257015c150 con 0x7f257015ceb0 2023-07-21T22:14:48.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f257623f700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f25700afaf0 0x7f257015f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52482/0 (socket says 172.21.15.49:52482) 2023-07-21T22:14:48.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f257623f700 1 -- 172.21.15.49:0/1114316897 learned_addr learned my addr 172.21.15.49:0/1114316897 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:48.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2575a3e700 1 --2- 172.21.15.49:0/1114316897 >> v2:172.21.15.49:3300/0 conn(0x7f257015bd80 0x7f25700cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f257523d700 1 --2- 172.21.15.49:0/1114316897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257015ceb0 0x7f25700cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2574a3c700 1 -- 172.21.15.49:0/1114316897 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612528176 0 0) 0x7f25700cb990 con 0x7f25700afaf0 2023-07-21T22:14:48.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2574a3c700 1 -- 172.21.15.49:0/1114316897 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f255c0035d0 con 0x7f25700afaf0 2023-07-21T22:14:48.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2574a3c700 1 -- 172.21.15.49:0/1114316897 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3714483519 0 0) 0x7f255c0035d0 con 0x7f25700afaf0 2023-07-21T22:14:48.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2575a3e700 1 -- 172.21.15.49:0/1114316897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257015ceb0 msgr2=0x7f25700cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:48.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2575a3e700 1 --2- 172.21.15.49:0/1114316897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257015ceb0 0x7f25700cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2575a3e700 1 -- 172.21.15.49:0/1114316897 >> v1:172.21.15.49:6789/0 conn(0x7f25700afaf0 legacy=0x7f257015f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2575a3e700 1 -- 172.21.15.49:0/1114316897 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25700cb6b0 con 0x7f257015bd80 2023-07-21T22:14:48.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2575a3e700 1 --2- 172.21.15.49:0/1114316897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257015bd80 0x7f25700cab60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f256c009850 tx=0x7f256c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9a04f4b51108d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:48.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2574a3c700 1 -- 172.21.15.49:0/1114316897 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25680019f0 con 0x7f257015bd80 2023-07-21T22:14:48.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2574a3c700 1 -- 172.21.15.49:0/1114316897 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c004030 con 0x7f257015bd80 2023-07-21T22:14:48.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.544+0000 7f2574a3c700 1 -- 172.21.15.49:0/1114316897 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c0043a0 con 0x7f257015bd80 2023-07-21T22:14:48.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.548+0000 7f2576a40700 1 -- 172.21.15.49:0/1114316897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257015bd80 msgr2=0x7f25700cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.548+0000 7f2576a40700 1 --2- 172.21.15.49:0/1114316897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257015bd80 0x7f25700cab60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f256c009850 tx=0x7f256c009b60 comp rx=0 tx=0).stop 2023-07-21T22:14:48.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.548+0000 7f2576a40700 1 -- 172.21.15.49:0/1114316897 shutdown_connections 2023-07-21T22:14:48.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.548+0000 7f2576a40700 1 --2- 172.21.15.49:0/1114316897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257015ceb0 0x7f25700cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.548+0000 7f2576a40700 1 --2- 172.21.15.49:0/1114316897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257015bd80 0x7f25700cab60 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.548+0000 7f2576a40700 1 -- 172.21.15.49:0/1114316897 >> 172.21.15.49:0/1114316897 conn(0x7f257006e960 msgr2=0x7f257006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:48.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.548+0000 7f2576a40700 1 -- 172.21.15.49:0/1114316897 shutdown_connections 2023-07-21T22:14:48.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.548+0000 7f2576a40700 1 -- 172.21.15.49:0/1114316897 wait complete. 2023-07-21T22:14:48.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.548+0000 7f2576a40700 1 Processor -- start 2023-07-21T22:14:48.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2576a40700 1 -- start start 2023-07-21T22:14:48.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2576a40700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25700afaf0 0x7f257006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2576a40700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257015bd80 0x7f2570154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2576a40700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257015ceb0 0x7f25701f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2576a40700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257006ce10 con 0x7f257015bd80 2023-07-21T22:14:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2576a40700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25701552e0 con 0x7f25700afaf0 2023-07-21T22:14:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2576a40700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25701f27e0 con 0x7f257015ceb0 2023-07-21T22:14:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f257523d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257015bd80 0x7f2570154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2575a3e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25700afaf0 0x7f257006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2575a3e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25700afaf0 0x7f257006d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:52878/0 (socket says 172.21.15.49:52878) 2023-07-21T22:14:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f257623f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257015ceb0 0x7f25701f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2575a3e700 1 -- 172.21.15.49:0/873124224 learned_addr learned my addr 172.21.15.49:0/873124224 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:48.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2575a3e700 1 -- 172.21.15.49:0/873124224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257015ceb0 msgr2=0x7f25701f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2575a3e700 1 --2- 172.21.15.49:0/873124224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257015ceb0 0x7f25701f22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2575a3e700 1 -- 172.21.15.49:0/873124224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257015bd80 msgr2=0x7f2570154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2575a3e700 1 --2- 172.21.15.49:0/873124224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257015bd80 0x7f2570154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2575a3e700 1 -- 172.21.15.49:0/873124224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c0094b0 con 0x7f25700afaf0 2023-07-21T22:14:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f257623f700 1 --2- 172.21.15.49:0/873124224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257015ceb0 0x7f25701f22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:14:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.552+0000 7f2575a3e700 1 --2- 172.21.15.49:0/873124224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25700afaf0 0x7f257006d2a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f256c0090b0 tx=0x7f256c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:48.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.556+0000 7f25667fc700 1 -- 172.21.15.49:0/873124224 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c003cd0 con 0x7f25700afaf0 2023-07-21T22:14:48.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.556+0000 7f25667fc700 1 -- 172.21.15.49:0/873124224 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c01f070 con 0x7f25700afaf0 2023-07-21T22:14:48.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.556+0000 7f25667fc700 1 -- 172.21.15.49:0/873124224 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c011870 con 0x7f25700afaf0 2023-07-21T22:14:48.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.556+0000 7f2576a40700 1 -- 172.21.15.49:0/873124224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257006c200 con 0x7f25700afaf0 2023-07-21T22:14:48.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.556+0000 7f2576a40700 1 -- 172.21.15.49:0/873124224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257006c7c0 con 0x7f25700afaf0 2023-07-21T22:14:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.556+0000 7f2576a40700 1 -- 172.21.15.49:0/873124224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f257015c990 con 0x7f25700afaf0 2023-07-21T22:14:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.560+0000 7f25667fc700 1 -- 172.21.15.49:0/873124224 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f256c0119d0 con 0x7f25700afaf0 2023-07-21T22:14:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.560+0000 7f25667fc700 1 --2- 172.21.15.49:0/873124224 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2554066370 0x7f2554068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.560+0000 7f25667fc700 1 -- 172.21.15.49:0/873124224 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f256c021070 con 0x7f25700afaf0 2023-07-21T22:14:48.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.560+0000 7f25667fc700 1 --2- 172.21.15.49:0/873124224 >> [v2:172.21.15.150:6824/2641155494,v1:172.21.15.150:6825/2641155494] conn(0x7f255406cd00 0x7f255406f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.560+0000 7f25667fc700 1 -- 172.21.15.49:0/873124224 --> [v2:172.21.15.150:6824/2641155494,v1:172.21.15.150:6825/2641155494] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f255406f800 con 0x7f255406cd00 2023-07-21T22:14:48.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.560+0000 7f25667fc700 1 -- 172.21.15.49:0/873124224 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f256c085970 con 0x7f25700afaf0 2023-07-21T22:14:48.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.560+0000 7f257523d700 1 --2- 172.21.15.49:0/873124224 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2554066370 0x7f2554068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.560+0000 7f257623f700 1 --2- 172.21.15.49:0/873124224 >> [v2:172.21.15.150:6824/2641155494,v1:172.21.15.150:6825/2641155494] conn(0x7f255406cd00 0x7f255406f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.560+0000 7f257523d700 1 --2- 172.21.15.49:0/873124224 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2554066370 0x7f2554068820 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f25700b13d0 tx=0x7f2560009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.564+0000 7f257623f700 1 --2- 172.21.15.49:0/873124224 >> [v2:172.21.15.150:6824/2641155494,v1:172.21.15.150:6825/2641155494] conn(0x7f255406cd00 0x7f255406f130 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:48.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.564+0000 7f25667fc700 1 -- 172.21.15.49:0/873124224 <== osd.6 v2:172.21.15.150:6824/2641155494 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f255406f800 con 0x7f255406cd00 2023-07-21T22:14:48.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.584+0000 7f2576a40700 1 -- 172.21.15.49:0/873124224 --> [v2:172.21.15.150:6824/2641155494,v1:172.21.15.150:6825/2641155494] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f257015c6b0 con 0x7f255406cd00 2023-07-21T22:14:48.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.584+0000 7f25667fc700 1 -- 172.21.15.49:0/873124224 <== osd.6 v2:172.21.15.150:6824/2641155494 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f25680075a0 con 0x7f255406cd00 2023-07-21T22:14:48.629 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:14:48.630 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:14:48.630 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:14:48.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.584+0000 7f2576a40700 1 -- 172.21.15.49:0/873124224 >> [v2:172.21.15.150:6824/2641155494,v1:172.21.15.150:6825/2641155494] conn(0x7f255406cd00 msgr2=0x7f255406f130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.584+0000 7f2576a40700 1 --2- 172.21.15.49:0/873124224 >> [v2:172.21.15.150:6824/2641155494,v1:172.21.15.150:6825/2641155494] conn(0x7f255406cd00 0x7f255406f130 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.584+0000 7f2576a40700 1 -- 172.21.15.49:0/873124224 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2554066370 msgr2=0x7f2554068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.584+0000 7f2576a40700 1 --2- 172.21.15.49:0/873124224 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f2554066370 0x7f2554068820 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f25700b13d0 tx=0x7f2560009240 comp rx=0 tx=0).stop 2023-07-21T22:14:48.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.584+0000 7f2576a40700 1 -- 172.21.15.49:0/873124224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25700afaf0 msgr2=0x7f257006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.584+0000 7f2576a40700 1 --2- 172.21.15.49:0/873124224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25700afaf0 0x7f257006d2a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f256c0090b0 tx=0x7f256c004770 comp rx=0 tx=0).stop 2023-07-21T22:14:48.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.584+0000 7f257623f700 1 -- 172.21.15.49:0/873124224 reap_dead start 2023-07-21T22:14:48.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.584+0000 7f2576a40700 1 -- 172.21.15.49:0/873124224 shutdown_connections 2023-07-21T22:14:48.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.584+0000 7f2576a40700 1 -- 172.21.15.49:0/873124224 >> 172.21.15.49:0/873124224 conn(0x7f257006e960 msgr2=0x7f25701601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:48.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.584+0000 7f2576a40700 1 -- 172.21.15.49:0/873124224 shutdown_connections 2023-07-21T22:14:48.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.584+0000 7f2576a40700 1 -- 172.21.15.49:0/873124224 wait complete. 2023-07-21T22:14:48.652 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-21T22:14:48.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.792+0000 7fe01299e700 1 Processor -- start 2023-07-21T22:14:48.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.792+0000 7fe01299e700 1 -- start start 2023-07-21T22:14:48.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.792+0000 7fe01299e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe00c0c1470 0x7fe00c0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.792+0000 7fe01299e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe00c0ca2c0 0x7fe00c163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01299e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00c06e010 con 0x7fe00c160370 2023-07-21T22:14:48.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01299e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00c160740 con 0x7fe00c0ca2c0 2023-07-21T22:14:48.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01299e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00c0ccc50 con 0x7fe00c0c1470 2023-07-21T22:14:48.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01219d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe00c0ca2c0 0x7fe00c163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01219d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe00c0ca2c0 0x7fe00c163ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57462/0 (socket says 172.21.15.49:57462) 2023-07-21T22:14:48.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01219d700 1 -- 172.21.15.49:0/702310300 learned_addr learned my addr 172.21.15.49:0/702310300 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:48.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01119b700 1 --2- 172.21.15.49:0/702310300 >> v2:172.21.15.150:3300/0 conn(0x7fe00c0c1470 0x7fe00c0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01219d700 1 -- 172.21.15.49:0/702310300 >> v2:172.21.15.150:3300/0 conn(0x7fe00c0c1470 msgr2=0x7fe00c0c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:48.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01219d700 1 --2- 172.21.15.49:0/702310300 >> v2:172.21.15.150:3300/0 conn(0x7fe00c0c1470 0x7fe00c0c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01219d700 1 -- 172.21.15.49:0/702310300 >> v1:172.21.15.150:6789/0 conn(0x7fe00c160370 legacy=0x7fe00c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:48.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01219d700 1 -- 172.21.15.49:0/702310300 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c0afc90 con 0x7fe00c0ca2c0 2023-07-21T22:14:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01219d700 1 --2- 172.21.15.49:0/702310300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c0ca2c0 0x7fe00c163ef0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0c9a80 tx=0x7fe00400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1550b522763f4f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:48.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01099a700 1 -- 172.21.15.49:0/702310300 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00400e070 con 0x7fe00c0ca2c0 2023-07-21T22:14:48.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01099a700 1 -- 172.21.15.49:0/702310300 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe004003a40 con 0x7fe00c0ca2c0 2023-07-21T22:14:48.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01099a700 1 -- 172.21.15.49:0/702310300 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004003df0 con 0x7fe00c0ca2c0 2023-07-21T22:14:48.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01299e700 1 -- 172.21.15.49:0/702310300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c0ca2c0 msgr2=0x7fe00c163ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01299e700 1 --2- 172.21.15.49:0/702310300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c0ca2c0 0x7fe00c163ef0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0c9a80 tx=0x7fe00400b330 comp rx=0 tx=0).stop 2023-07-21T22:14:48.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01299e700 1 -- 172.21.15.49:0/702310300 shutdown_connections 2023-07-21T22:14:48.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01299e700 1 --2- 172.21.15.49:0/702310300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c0ca2c0 0x7fe00c163ef0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01299e700 1 --2- 172.21.15.49:0/702310300 >> v2:172.21.15.150:3300/0 conn(0x7fe00c0c1470 0x7fe00c0c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01299e700 1 -- 172.21.15.49:0/702310300 >> 172.21.15.49:0/702310300 conn(0x7fe00c070450 msgr2=0x7fe00c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:48.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.796+0000 7fe01299e700 1 -- 172.21.15.49:0/702310300 shutdown_connections 2023-07-21T22:14:48.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.800+0000 7fe01299e700 1 -- 172.21.15.49:0/702310300 wait complete. 2023-07-21T22:14:48.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.800+0000 7fe01299e700 1 Processor -- start 2023-07-21T22:14:48.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.800+0000 7fe01299e700 1 -- start start 2023-07-21T22:14:48.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.800+0000 7fe01299e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c0c1470 0x7fe00c15ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.800+0000 7fe01299e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00c0ca2c0 0x7fe00c0c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.800+0000 7fe01299e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c160370 0x7fe00c0c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01299e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c1e8b70 con 0x7fe00c0c1470 2023-07-21T22:14:48.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01299e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0c79e0 con 0x7fe00c0ca2c0 2023-07-21T22:14:48.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01299e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0b27c0 con 0x7fe00c160370 2023-07-21T22:14:48.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01199c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c0c1470 0x7fe00c15ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01199c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c0c1470 0x7fe00c15ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57468/0 (socket says 172.21.15.49:57468) 2023-07-21T22:14:48.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01199c700 1 -- 172.21.15.49:0/2530402784 learned_addr learned my addr 172.21.15.49:0/2530402784 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:48.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01119b700 1 --2- 172.21.15.49:0/2530402784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00c0ca2c0 0x7fe00c0c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01219d700 1 --2- 172.21.15.49:0/2530402784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c160370 0x7fe00c0c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01199c700 1 -- 172.21.15.49:0/2530402784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c160370 msgr2=0x7fe00c0c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01199c700 1 --2- 172.21.15.49:0/2530402784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c160370 0x7fe00c0c22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01199c700 1 -- 172.21.15.49:0/2530402784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00c0ca2c0 msgr2=0x7fe00c0c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:48.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01199c700 1 --2- 172.21.15.49:0/2530402784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00c0ca2c0 0x7fe00c0c6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:48.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01199c700 1 -- 172.21.15.49:0/2530402784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004009b30 con 0x7fe00c0c1470 2023-07-21T22:14:48.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01199c700 1 --2- 172.21.15.49:0/2530402784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c0c1470 0x7fe00c15ec60 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fe00800b4d0 tx=0x7fe00800b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:48.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe0027fc700 1 -- 172.21.15.49:0/2530402784 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800bea0 con 0x7fe00c0c1470 2023-07-21T22:14:48.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe0027fc700 1 -- 172.21.15.49:0/2530402784 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe008011830 con 0x7fe00c0c1470 2023-07-21T22:14:48.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe0027fc700 1 -- 172.21.15.49:0/2530402784 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe008011be0 con 0x7fe00c0c1470 2023-07-21T22:14:48.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01299e700 1 -- 172.21.15.49:0/2530402784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00c0c7700 con 0x7fe00c0c1470 2023-07-21T22:14:48.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01299e700 1 -- 172.21.15.49:0/2530402784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00c0b2450 con 0x7fe00c0c1470 2023-07-21T22:14:48.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.804+0000 7fe01299e700 1 -- 172.21.15.49:0/2530402784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00c0aff50 con 0x7fe00c0c1470 2023-07-21T22:14:48.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.808+0000 7fe0027fc700 1 -- 172.21.15.49:0/2530402784 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe008011d40 con 0x7fe00c0c1470 2023-07-21T22:14:48.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.808+0000 7fe0027fc700 1 --2- 172.21.15.49:0/2530402784 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdff0066320 0x7fdff00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:48.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.808+0000 7fe0027fc700 1 -- 172.21.15.49:0/2530402784 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe0080836d0 con 0x7fe00c0c1470 2023-07-21T22:14:48.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.808+0000 7fe01119b700 1 --2- 172.21.15.49:0/2530402784 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdff0066320 0x7fdff00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.812+0000 7fe01119b700 1 --2- 172.21.15.49:0/2530402784 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdff0066320 0x7fdff00687d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0ce2e0 tx=0x7fdffc009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:48.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.816+0000 7fe0027fc700 1 -- 172.21.15.49:0/2530402784 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe00c0aff50 con 0x7fe00c0c1470 2023-07-21T22:14:49.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.988+0000 7fe01299e700 1 -- 172.21.15.49:0/2530402784 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fe00c0b0250 con 0x7fdff0066320 2023-07-21T22:14:49.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.988+0000 7fe0027fc700 1 -- 172.21.15.49:0/2530402784 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdffc004020 con 0x7fdff0066320 2023-07-21T22:14:49.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.992+0000 7fe01299e700 1 -- 172.21.15.49:0/2530402784 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdff0066320 msgr2=0x7fdff00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.992+0000 7fe01299e700 1 --2- 172.21.15.49:0/2530402784 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdff0066320 0x7fdff00687d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0ce2e0 tx=0x7fdffc009240 comp rx=0 tx=0).stop 2023-07-21T22:14:49.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.992+0000 7fe01299e700 1 -- 172.21.15.49:0/2530402784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c0c1470 msgr2=0x7fe00c15ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.992+0000 7fe01299e700 1 --2- 172.21.15.49:0/2530402784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c0c1470 0x7fe00c15ec60 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fe00800b4d0 tx=0x7fe00800b7e0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.992+0000 7fe01299e700 1 -- 172.21.15.49:0/2530402784 shutdown_connections 2023-07-21T22:14:49.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.992+0000 7fe01299e700 1 --2- 172.21.15.49:0/2530402784 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fdff0066320 0x7fdff00687d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.992+0000 7fe01299e700 1 --2- 172.21.15.49:0/2530402784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe00c160370 0x7fe00c0c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.992+0000 7fe01299e700 1 --2- 172.21.15.49:0/2530402784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00c0ca2c0 0x7fe00c0c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.992+0000 7fe01299e700 1 --2- 172.21.15.49:0/2530402784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe00c0c1470 0x7fe00c15ec60 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.996+0000 7fe01299e700 1 -- 172.21.15.49:0/2530402784 >> 172.21.15.49:0/2530402784 conn(0x7fe00c070450 msgr2=0x7fe00c0ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.996+0000 7fe01299e700 1 -- 172.21.15.49:0/2530402784 shutdown_connections 2023-07-21T22:14:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:48.996+0000 7fe01299e700 1 -- 172.21.15.49:0/2530402784 wait complete. 2023-07-21T22:14:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 6 to deep-scrub 2023-07-21T22:14:49.061 INFO:tasks.ceph:Scrubbing osd.7 2023-07-21T22:14:49.061 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:14:49.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.208+0000 7faeb6bac700 1 Processor -- start 2023-07-21T22:14:49.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.208+0000 7faeb6bac700 1 -- start start 2023-07-21T22:14:49.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.208+0000 7faeb6bac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeb00cdd50 0x7faeb00ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.208+0000 7faeb6bac700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faeb00ce790 0x7faeb00d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.208+0000 7faeb6bac700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb00b8680 con 0x7faeb00ce240 2023-07-21T22:14:49.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.208+0000 7faeb6bac700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb00d3500 con 0x7faeb00ce790 2023-07-21T22:14:49.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.208+0000 7faeb6bac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb00d2fa0 con 0x7faeb00cdd50 2023-07-21T22:14:49.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.212+0000 7faeb5149700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faeb00ce240 0x7faeb00cf330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52496/0 (socket says 172.21.15.49:52496) 2023-07-21T22:14:49.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.212+0000 7faeb5149700 1 -- 172.21.15.49:0/2367363137 learned_addr learned my addr 172.21.15.49:0/2367363137 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:49.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.212+0000 7faeb4948700 1 --2- 172.21.15.49:0/2367363137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeb00cdd50 0x7faeb00ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.212+0000 7faeaffff700 1 --2- 172.21.15.49:0/2367363137 >> v2:172.21.15.150:3300/0 conn(0x7faeb00ce790 0x7faeb00d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.212+0000 7faeb4948700 1 -- 172.21.15.49:0/2367363137 >> v2:172.21.15.150:3300/0 conn(0x7faeb00ce790 msgr2=0x7faeb00d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.212+0000 7faeaf7fe700 1 -- 172.21.15.49:0/2367363137 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667149314 0 0) 0x7faeb00b8680 con 0x7faeb00ce240 2023-07-21T22:14:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.212+0000 7faeb4948700 1 --2- 172.21.15.49:0/2367363137 >> v2:172.21.15.150:3300/0 conn(0x7faeb00ce790 0x7faeb00d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.212+0000 7faeb4948700 1 -- 172.21.15.49:0/2367363137 >> v1:172.21.15.49:6789/0 conn(0x7faeb00ce240 legacy=0x7faeb00cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.212+0000 7faeb4948700 1 -- 172.21.15.49:0/2367363137 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb00b6290 con 0x7faeb00cdd50 2023-07-21T22:14:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.212+0000 7faeaffff700 1 --2- 172.21.15.49:0/2367363137 >> v2:172.21.15.150:3300/0 conn(0x7faeb00ce790 0x7faeb00d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:14:49.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.212+0000 7faeb4948700 1 --2- 172.21.15.49:0/2367363137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeb00cdd50 0x7faeb00ccce0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faea4009840 tx=0x7faea4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f344ed8c977f5bc8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:49.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.212+0000 7faeaf7fe700 1 -- 172.21.15.49:0/2367363137 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4005e50 con 0x7faeb00cdd50 2023-07-21T22:14:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.212+0000 7faeaf7fe700 1 -- 172.21.15.49:0/2367363137 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea4006030 con 0x7faeb00cdd50 2023-07-21T22:14:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.212+0000 7faeaf7fe700 1 -- 172.21.15.49:0/2367363137 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea40063c0 con 0x7faeb00cdd50 2023-07-21T22:14:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.216+0000 7faeb6bac700 1 -- 172.21.15.49:0/2367363137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeb00cdd50 msgr2=0x7faeb00ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.216+0000 7faeb6bac700 1 --2- 172.21.15.49:0/2367363137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeb00cdd50 0x7faeb00ccce0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faea4009840 tx=0x7faea4009b50 comp rx=0 tx=0).stop 2023-07-21T22:14:49.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.216+0000 7faeb6bac700 1 -- 172.21.15.49:0/2367363137 shutdown_connections 2023-07-21T22:14:49.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.216+0000 7faeb6bac700 1 --2- 172.21.15.49:0/2367363137 >> v2:172.21.15.150:3300/0 conn(0x7faeb00ce790 0x7faeb00d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.216+0000 7faeb6bac700 1 --2- 172.21.15.49:0/2367363137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeb00cdd50 0x7faeb00ccce0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.216+0000 7faeb6bac700 1 -- 172.21.15.49:0/2367363137 >> 172.21.15.49:0/2367363137 conn(0x7faeb00b55e0 msgr2=0x7faeb00b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:49.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.216+0000 7faeb6bac700 1 -- 172.21.15.49:0/2367363137 shutdown_connections 2023-07-21T22:14:49.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.216+0000 7faeb6bac700 1 -- 172.21.15.49:0/2367363137 wait complete. 2023-07-21T22:14:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeb6bac700 1 Processor -- start 2023-07-21T22:14:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeb6bac700 1 -- start start 2023-07-21T22:14:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeb6bac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faeb00cdd50 0x7faeb015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeb6bac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeb00ce240 0x7faeb014dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeb6bac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeb00ce790 0x7faeb0070250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeb6bac700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb00c6410 con 0x7faeb00ce240 2023-07-21T22:14:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeb6bac700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb015f2a0 con 0x7faeb00cdd50 2023-07-21T22:14:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeb6bac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb00c5dc0 con 0x7faeb00ce790 2023-07-21T22:14:49.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeaffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeb00ce240 0x7faeb014dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeaffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeb00ce240 0x7faeb014dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57470/0 (socket says 172.21.15.49:57470) 2023-07-21T22:14:49.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeaffff700 1 -- 172.21.15.49:0/1232378686 learned_addr learned my addr 172.21.15.49:0/1232378686 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeb5149700 1 --2- 172.21.15.49:0/1232378686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeb00ce790 0x7faeb0070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeb4948700 1 --2- 172.21.15.49:0/1232378686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faeb00cdd50 0x7faeb015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeaffff700 1 -- 172.21.15.49:0/1232378686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeb00ce790 msgr2=0x7faeb0070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeaffff700 1 --2- 172.21.15.49:0/1232378686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeb00ce790 0x7faeb0070250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeaffff700 1 -- 172.21.15.49:0/1232378686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faeb00cdd50 msgr2=0x7faeb015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeaffff700 1 --2- 172.21.15.49:0/1232378686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faeb00cdd50 0x7faeb015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.220+0000 7faeaffff700 1 -- 172.21.15.49:0/1232378686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea00094b0 con 0x7faeb00ce240 2023-07-21T22:14:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.224+0000 7faeaffff700 1 --2- 172.21.15.49:0/1232378686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeb00ce240 0x7faeb014dbc0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7faea000ebe0 tx=0x7faea000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.224+0000 7faead7fa700 1 -- 172.21.15.49:0/1232378686 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0009770 con 0x7faeb00ce240 2023-07-21T22:14:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.224+0000 7faead7fa700 1 -- 172.21.15.49:0/1232378686 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea000c850 con 0x7faeb00ce240 2023-07-21T22:14:49.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.224+0000 7faeb6bac700 1 -- 172.21.15.49:0/1232378686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea4009450 con 0x7faeb00ce240 2023-07-21T22:14:49.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.224+0000 7faead7fa700 1 -- 172.21.15.49:0/1232378686 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea000cbe0 con 0x7faeb00ce240 2023-07-21T22:14:49.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.224+0000 7faeb6bac700 1 -- 172.21.15.49:0/1232378686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb015f580 con 0x7faeb00ce240 2023-07-21T22:14:49.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.224+0000 7faeb6bac700 1 -- 172.21.15.49:0/1232378686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faeb00cee10 con 0x7faeb00ce240 2023-07-21T22:14:49.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.224+0000 7faead7fa700 1 -- 172.21.15.49:0/1232378686 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faea000cd40 con 0x7faeb00ce240 2023-07-21T22:14:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.228+0000 7faead7fa700 1 --2- 172.21.15.49:0/1232378686 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fae9c0662f0 0x7fae9c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.228+0000 7faead7fa700 1 -- 172.21.15.49:0/1232378686 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7faea0083bd0 con 0x7faeb00ce240 2023-07-21T22:14:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.228+0000 7faeb4948700 1 --2- 172.21.15.49:0/1232378686 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fae9c0662f0 0x7fae9c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.228+0000 7faead7fa700 1 --2- 172.21.15.49:0/1232378686 >> [v2:172.21.15.150:6810/597032017,v1:172.21.15.150:6812/597032017] conn(0x7fae9c06cc00 0x7fae9c06f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.228+0000 7faead7fa700 1 -- 172.21.15.49:0/1232378686 --> [v2:172.21.15.150:6810/597032017,v1:172.21.15.150:6812/597032017] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae9c06f700 con 0x7fae9c06cc00 2023-07-21T22:14:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.228+0000 7faead7fa700 1 -- 172.21.15.49:0/1232378686 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7faea00882a0 con 0x7faeb00ce240 2023-07-21T22:14:49.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.228+0000 7faeb5149700 1 --2- 172.21.15.49:0/1232378686 >> [v2:172.21.15.150:6810/597032017,v1:172.21.15.150:6812/597032017] conn(0x7fae9c06cc00 0x7fae9c06f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.228+0000 7faeb4948700 1 --2- 172.21.15.49:0/1232378686 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fae9c0662f0 0x7fae9c0687a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faea4009b90 tx=0x7faea4008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:49.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.232+0000 7faeb5149700 1 --2- 172.21.15.49:0/1232378686 >> [v2:172.21.15.150:6810/597032017,v1:172.21.15.150:6812/597032017] conn(0x7fae9c06cc00 0x7fae9c06f030 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:49.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.232+0000 7faead7fa700 1 -- 172.21.15.49:0/1232378686 <== osd.7 v2:172.21.15.150:6810/597032017 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fae9c06f700 con 0x7fae9c06cc00 2023-07-21T22:14:49.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.248+0000 7faeb6bac700 1 -- 172.21.15.49:0/1232378686 --> [v2:172.21.15.150:6810/597032017,v1:172.21.15.150:6812/597032017] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faeb00d3220 con 0x7fae9c06cc00 2023-07-21T22:14:49.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.252+0000 7faead7fa700 1 -- 172.21.15.49:0/1232378686 <== osd.7 v2:172.21.15.150:6810/597032017 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7faea8007240 con 0x7fae9c06cc00 2023-07-21T22:14:49.296 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-07-21T22:14:49.297 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:14:49.297 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-07-21T22:14:49.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.252+0000 7faeb6bac700 1 -- 172.21.15.49:0/1232378686 >> [v2:172.21.15.150:6810/597032017,v1:172.21.15.150:6812/597032017] conn(0x7fae9c06cc00 msgr2=0x7fae9c06f030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.252+0000 7faeb6bac700 1 --2- 172.21.15.49:0/1232378686 >> [v2:172.21.15.150:6810/597032017,v1:172.21.15.150:6812/597032017] conn(0x7fae9c06cc00 0x7fae9c06f030 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.252+0000 7faeb6bac700 1 -- 172.21.15.49:0/1232378686 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fae9c0662f0 msgr2=0x7fae9c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.252+0000 7faeb6bac700 1 --2- 172.21.15.49:0/1232378686 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fae9c0662f0 0x7fae9c0687a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faea4009b90 tx=0x7faea4008070 comp rx=0 tx=0).stop 2023-07-21T22:14:49.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.252+0000 7faeb6bac700 1 -- 172.21.15.49:0/1232378686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeb00ce240 msgr2=0x7faeb014dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.252+0000 7faeb6bac700 1 --2- 172.21.15.49:0/1232378686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeb00ce240 0x7faeb014dbc0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7faea000ebe0 tx=0x7faea000eef0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.252+0000 7faeb5149700 1 -- 172.21.15.49:0/1232378686 reap_dead start 2023-07-21T22:14:49.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.252+0000 7faeb6bac700 1 -- 172.21.15.49:0/1232378686 shutdown_connections 2023-07-21T22:14:49.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.252+0000 7faeb6bac700 1 -- 172.21.15.49:0/1232378686 >> 172.21.15.49:0/1232378686 conn(0x7faeb00b55e0 msgr2=0x7faeb015be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:49.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.252+0000 7faeb6bac700 1 -- 172.21.15.49:0/1232378686 shutdown_connections 2023-07-21T22:14:49.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.252+0000 7faeb6bac700 1 -- 172.21.15.49:0/1232378686 wait complete. 2023-07-21T22:14:49.319 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-21T22:14:49.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.448+0000 7f07210e0700 1 Processor -- start 2023-07-21T22:14:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.448+0000 7f07210e0700 1 -- start start 2023-07-21T22:14:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.448+0000 7f07210e0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f071c159f60 0x7f071c0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f07210e0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071c0b0600 con 0x7f071c0b0160 2023-07-21T22:14:49.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f07210e0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071c15a470 con 0x7f071c06d5d0 2023-07-21T22:14:49.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f07210e0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071c15a750 con 0x7f071c159f60 2023-07-21T22:14:49.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f071b59e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f071c0b0160 0x7f071c15d780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52510/0 (socket says 172.21.15.49:52510) 2023-07-21T22:14:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f071b59e700 1 -- 172.21.15.49:0/3971189663 learned_addr learned my addr 172.21.15.49:0/3971189663 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:14:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f0713fff700 1 --2- 172.21.15.49:0/3971189663 >> v2:172.21.15.49:3300/0 conn(0x7f071c159f60 0x7f071c0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f071a59c700 1 -- 172.21.15.49:0/3971189663 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632279424 0 0) 0x7f071c0b0600 con 0x7f071c0b0160 2023-07-21T22:14:49.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f071a59c700 1 -- 172.21.15.49:0/3971189663 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07080035d0 con 0x7f071c0b0160 2023-07-21T22:14:49.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f0713fff700 1 -- 172.21.15.49:0/3971189663 >> v1:172.21.15.150:6789/0 conn(0x7f071c06d5d0 legacy=0x7f071c06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f0713fff700 1 -- 172.21.15.49:0/3971189663 >> v1:172.21.15.49:6789/0 conn(0x7f071c0b0160 legacy=0x7f071c15d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f0713fff700 1 -- 172.21.15.49:0/3971189663 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c15aa30 con 0x7f071c159f60 2023-07-21T22:14:49.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f0713fff700 1 --2- 172.21.15.49:0/3971189663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071c159f60 0x7f071c0afc20 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f0704009850 tx=0x7f0704009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b331ad2137f6f52f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:49.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f071a59c700 1 -- 172.21.15.49:0/3971189663 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704011830 con 0x7f071c159f60 2023-07-21T22:14:49.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f071a59c700 1 -- 172.21.15.49:0/3971189663 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0704011990 con 0x7f071c159f60 2023-07-21T22:14:49.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f071a59c700 1 -- 172.21.15.49:0/3971189663 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704011d00 con 0x7f071c159f60 2023-07-21T22:14:49.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f07210e0700 1 -- 172.21.15.49:0/3971189663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071c159f60 msgr2=0x7f071c0afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.452+0000 7f07210e0700 1 --2- 172.21.15.49:0/3971189663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071c159f60 0x7f071c0afc20 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f0704009850 tx=0x7f0704009b60 comp rx=0 tx=0).stop 2023-07-21T22:14:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.456+0000 7f07210e0700 1 -- 172.21.15.49:0/3971189663 shutdown_connections 2023-07-21T22:14:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.456+0000 7f07210e0700 1 --2- 172.21.15.49:0/3971189663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071c159f60 0x7f071c0afc20 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.456+0000 7f07210e0700 1 -- 172.21.15.49:0/3971189663 >> 172.21.15.49:0/3971189663 conn(0x7f071c06f5a0 msgr2=0x7f071c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.456+0000 7f07210e0700 1 -- 172.21.15.49:0/3971189663 shutdown_connections 2023-07-21T22:14:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.456+0000 7f07210e0700 1 -- 172.21.15.49:0/3971189663 wait complete. 2023-07-21T22:14:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.456+0000 7f07210e0700 1 Processor -- start 2023-07-21T22:14:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.456+0000 7f07210e0700 1 -- start start 2023-07-21T22:14:49.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.456+0000 7f07210e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c06d5d0 0x7f071c0c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f07210e0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f071c0b0160 0x7f071c1f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f07210e0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071c159f60 0x7f071c0b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f07210e0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c0c6760 con 0x7f071c159f60 2023-07-21T22:14:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f07210e0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c0c5b50 con 0x7f071c0b0160 2023-07-21T22:14:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f07210e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071c0c5e30 con 0x7f071c06d5d0 2023-07-21T22:14:49.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f071b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071c159f60 0x7f071c0b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f071b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071c159f60 0x7f071c0b3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57480/0 (socket says 172.21.15.49:57480) 2023-07-21T22:14:49.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f0713fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f071c0b0160 0x7f071c1f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f071b59e700 1 -- 172.21.15.49:0/1115538665 learned_addr learned my addr 172.21.15.49:0/1115538665 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:49.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f071ad9d700 1 --2- 172.21.15.49:0/1115538665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c06d5d0 0x7f071c0c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f071b59e700 1 -- 172.21.15.49:0/1115538665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c06d5d0 msgr2=0x7f071c0c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f071b59e700 1 --2- 172.21.15.49:0/1115538665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c06d5d0 0x7f071c0c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f071b59e700 1 -- 172.21.15.49:0/1115538665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f071c0b0160 msgr2=0x7f071c1f08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f071b59e700 1 --2- 172.21.15.49:0/1115538665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f071c0b0160 0x7f071c1f08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f071b59e700 1 -- 172.21.15.49:0/1115538665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040094b0 con 0x7f071c159f60 2023-07-21T22:14:49.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f0713fff700 1 --2- 172.21.15.49:0/1115538665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f071c0b0160 0x7f071c1f08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:49.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f071b59e700 1 --2- 172.21.15.49:0/1115538665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071c159f60 0x7f071c0b3450 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f071400cbb0 tx=0x7f071400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:49.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f07137fe700 1 -- 172.21.15.49:0/1115538665 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071400a9e0 con 0x7f071c159f60 2023-07-21T22:14:49.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f07137fe700 1 -- 172.21.15.49:0/1115538665 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071400ab40 con 0x7f071c159f60 2023-07-21T22:14:49.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f07137fe700 1 -- 172.21.15.49:0/1115538665 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071400ce70 con 0x7f071c159f60 2023-07-21T22:14:49.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f07210e0700 1 -- 172.21.15.49:0/1115538665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071c0c6110 con 0x7f071c159f60 2023-07-21T22:14:49.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.460+0000 7f07210e0700 1 -- 172.21.15.49:0/1115538665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071c0c57b0 con 0x7f071c159f60 2023-07-21T22:14:49.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.464+0000 7f07210e0700 1 -- 172.21.15.49:0/1115538665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071c073130 con 0x7f071c159f60 2023-07-21T22:14:49.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.464+0000 7f07137fe700 1 -- 172.21.15.49:0/1115538665 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0714012400 con 0x7f071c159f60 2023-07-21T22:14:49.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.464+0000 7f07137fe700 1 --2- 172.21.15.49:0/1115538665 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06fc066320 0x7f06fc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.464+0000 7f07137fe700 1 -- 172.21.15.49:0/1115538665 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0714083470 con 0x7f071c159f60 2023-07-21T22:14:49.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.464+0000 7f071ad9d700 1 --2- 172.21.15.49:0/1115538665 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06fc066320 0x7f06fc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.468+0000 7f071ad9d700 1 --2- 172.21.15.49:0/1115538665 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06fc066320 0x7f06fc0687d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f070c001640 tx=0x7f070c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:49.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.472+0000 7f07137fe700 1 -- 172.21.15.49:0/1115538665 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0714050b60 con 0x7f071c159f60 2023-07-21T22:14:49.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.648+0000 7f07210e0700 1 -- 172.21.15.49:0/1115538665 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f071c15af50 con 0x7f06fc066320 2023-07-21T22:14:49.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.648+0000 7f07137fe700 1 -- 172.21.15.49:0/1115538665 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f070c001330 con 0x7f06fc066320 2023-07-21T22:14:49.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.648+0000 7f07210e0700 1 -- 172.21.15.49:0/1115538665 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06fc066320 msgr2=0x7f06fc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.648+0000 7f07210e0700 1 --2- 172.21.15.49:0/1115538665 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06fc066320 0x7f06fc0687d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f070c001640 tx=0x7f070c009040 comp rx=0 tx=0).stop 2023-07-21T22:14:49.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.648+0000 7f07210e0700 1 -- 172.21.15.49:0/1115538665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071c159f60 msgr2=0x7f071c0b3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.648+0000 7f07210e0700 1 --2- 172.21.15.49:0/1115538665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071c159f60 0x7f071c0b3450 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f071400cbb0 tx=0x7f071400cc90 comp rx=0 tx=0).stop 2023-07-21T22:14:49.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.648+0000 7f07210e0700 1 -- 172.21.15.49:0/1115538665 shutdown_connections 2023-07-21T22:14:49.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.648+0000 7f07210e0700 1 --2- 172.21.15.49:0/1115538665 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f06fc066320 0x7f06fc0687d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.648+0000 7f07210e0700 1 --2- 172.21.15.49:0/1115538665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071c159f60 0x7f071c0b3450 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.648+0000 7f07210e0700 1 --2- 172.21.15.49:0/1115538665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f071c0b0160 0x7f071c1f08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.648+0000 7f07210e0700 1 --2- 172.21.15.49:0/1115538665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c06d5d0 0x7f071c0c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.648+0000 7f07210e0700 1 -- 172.21.15.49:0/1115538665 >> 172.21.15.49:0/1115538665 conn(0x7f071c06f5a0 msgr2=0x7f071c06bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:49.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.648+0000 7f07210e0700 1 -- 172.21.15.49:0/1115538665 shutdown_connections 2023-07-21T22:14:49.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.648+0000 7f07210e0700 1 -- 172.21.15.49:0/1115538665 wait complete. 2023-07-21T22:14:49.699 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 7 to deep-scrub 2023-07-21T22:14:49.718 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:14:49.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.864+0000 7fa015648700 1 Processor -- start 2023-07-21T22:14:49.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.864+0000 7fa015648700 1 -- start start 2023-07-21T22:14:49.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa015648700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa01006d380 0x7fa01006d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa015648700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa010071c70 0x7fa0100b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa015648700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa0100b1400 0x7fa0100cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa015648700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0100c9e80 con 0x7fa010071c70 2023-07-21T22:14:49.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa015648700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0100afeb0 con 0x7fa0100b1400 2023-07-21T22:14:49.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa015648700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0100cab20 con 0x7fa01006d380 2023-07-21T22:14:49.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa0077fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa010071c70 0x7fa0100b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa0077fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa010071c70 0x7fa0100b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57486/0 (socket says 172.21.15.49:57486) 2023-07-21T22:14:49.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa0077fe700 1 -- 172.21.15.49:0/3454719475 learned_addr learned my addr 172.21.15.49:0/3454719475 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:49.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa00ffff700 1 --2- 172.21.15.49:0/3454719475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa01006d380 0x7fa01006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa014e47700 1 --2- 172.21.15.49:0/3454719475 >> v2:172.21.15.150:3300/0 conn(0x7fa0100b1400 0x7fa0100cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa0077fe700 1 -- 172.21.15.49:0/3454719475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa01006d380 msgr2=0x7fa01006d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:49.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa0077fe700 1 --2- 172.21.15.49:0/3454719475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa01006d380 0x7fa01006d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa0077fe700 1 -- 172.21.15.49:0/3454719475 >> v2:172.21.15.150:3300/0 conn(0x7fa0100b1400 msgr2=0x7fa0100cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:14:49.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa0077fe700 1 --2- 172.21.15.49:0/3454719475 >> v2:172.21.15.150:3300/0 conn(0x7fa0100b1400 0x7fa0100cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa0077fe700 1 -- 172.21.15.49:0/3454719475 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01006dc90 con 0x7fa010071c70 2023-07-21T22:14:49.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa0077fe700 1 --2- 172.21.15.49:0/3454719475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa010071c70 0x7fa0100b0ec0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa0100c1940 tx=0x7f9ff8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7fb4225419119e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:49.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa00f7fe700 1 -- 172.21.15.49:0/3454719475 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8011830 con 0x7fa010071c70 2023-07-21T22:14:49.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa00f7fe700 1 -- 172.21.15.49:0/3454719475 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff8011990 con 0x7fa010071c70 2023-07-21T22:14:49.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.868+0000 7fa00f7fe700 1 -- 172.21.15.49:0/3454719475 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8011d20 con 0x7fa010071c70 2023-07-21T22:14:49.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.872+0000 7fa015648700 1 -- 172.21.15.49:0/3454719475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa010071c70 msgr2=0x7fa0100b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.872+0000 7fa015648700 1 --2- 172.21.15.49:0/3454719475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa010071c70 0x7fa0100b0ec0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa0100c1940 tx=0x7f9ff8009bf0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.872+0000 7fa015648700 1 -- 172.21.15.49:0/3454719475 shutdown_connections 2023-07-21T22:14:49.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.872+0000 7fa015648700 1 --2- 172.21.15.49:0/3454719475 >> v2:172.21.15.150:3300/0 conn(0x7fa0100b1400 0x7fa0100cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.872+0000 7fa015648700 1 --2- 172.21.15.49:0/3454719475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa010071c70 0x7fa0100b0ec0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.872+0000 7fa015648700 1 --2- 172.21.15.49:0/3454719475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa01006d380 0x7fa01006d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.872+0000 7fa015648700 1 -- 172.21.15.49:0/3454719475 >> 172.21.15.49:0/3454719475 conn(0x7fa010070450 msgr2=0x7fa010070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:49.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.872+0000 7fa015648700 1 -- 172.21.15.49:0/3454719475 shutdown_connections 2023-07-21T22:14:49.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.872+0000 7fa015648700 1 -- 172.21.15.49:0/3454719475 wait complete. 2023-07-21T22:14:49.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.872+0000 7fa015648700 1 Processor -- start 2023-07-21T22:14:49.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.872+0000 7fa015648700 1 -- start start 2023-07-21T22:14:49.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa015648700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa01006d380 0x7fa010153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa015648700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa010071c70 0x7fa01015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa015648700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0100b1400 0x7fa01015bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa015648700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01015b850 con 0x7fa0100b1400 2023-07-21T22:14:49.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa015648700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0101f10e0 con 0x7fa01006d380 2023-07-21T22:14:49.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa015648700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01015ac40 con 0x7fa010071c70 2023-07-21T22:14:49.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa014e47700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0100b1400 0x7fa01015bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa00ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa01006d380 0x7fa010153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa00ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa01006d380 0x7fa010153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:52960/0 (socket says 172.21.15.49:52960) 2023-07-21T22:14:49.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa00ffff700 1 -- 172.21.15.49:0/2004820238 learned_addr learned my addr 172.21.15.49:0/2004820238 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:14:49.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa0077fe700 1 --2- 172.21.15.49:0/2004820238 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa010071c70 0x7fa01015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa00ffff700 1 -- 172.21.15.49:0/2004820238 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa010071c70 msgr2=0x7fa01015bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa00ffff700 1 --2- 172.21.15.49:0/2004820238 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa010071c70 0x7fa01015bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa00ffff700 1 -- 172.21.15.49:0/2004820238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0100b1400 msgr2=0x7fa01015bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:49.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa00ffff700 1 --2- 172.21.15.49:0/2004820238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0100b1400 0x7fa01015bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:49.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa00ffff700 1 -- 172.21.15.49:0/2004820238 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8009570 con 0x7fa01006d380 2023-07-21T22:14:49.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa00ffff700 1 --2- 172.21.15.49:0/2004820238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa01006d380 0x7fa010153110 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa00000e870 tx=0x7fa00000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:49.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa00d7fa700 1 -- 172.21.15.49:0/2004820238 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000013680 con 0x7fa01006d380 2023-07-21T22:14:49.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa00d7fa700 1 -- 172.21.15.49:0/2004820238 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0000137e0 con 0x7fa01006d380 2023-07-21T22:14:49.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa00d7fa700 1 -- 172.21.15.49:0/2004820238 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000013b90 con 0x7fa01006d380 2023-07-21T22:14:49.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa015648700 1 -- 172.21.15.49:0/2004820238 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01015af20 con 0x7fa01006d380 2023-07-21T22:14:49.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.876+0000 7fa015648700 1 -- 172.21.15.49:0/2004820238 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01015b4e0 con 0x7fa01006d380 2023-07-21T22:14:49.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.880+0000 7fa015648700 1 -- 172.21.15.49:0/2004820238 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01004dcb0 con 0x7fa01006d380 2023-07-21T22:14:49.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.880+0000 7fa00d7fa700 1 -- 172.21.15.49:0/2004820238 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa000013cf0 con 0x7fa01006d380 2023-07-21T22:14:49.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.884+0000 7fa00d7fa700 1 --2- 172.21.15.49:0/2004820238 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ff00662f0 0x7f9ff00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:49.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.884+0000 7fa00d7fa700 1 -- 172.21.15.49:0/2004820238 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fa000083a10 con 0x7fa01006d380 2023-07-21T22:14:49.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.884+0000 7fa0077fe700 1 --2- 172.21.15.49:0/2004820238 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ff00662f0 0x7f9ff00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:49.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.884+0000 7fa0077fe700 1 --2- 172.21.15.49:0/2004820238 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ff00662f0 0x7f9ff00687a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8000c00 tx=0x7f9ff8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:49.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:49.888+0000 7fa00d7fa700 1 -- 172.21.15.49:0/2004820238 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa000050fe0 con 0x7fa01006d380 2023-07-21T22:14:50.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:50.060+0000 7fa015648700 1 -- 172.21.15.49:0/2004820238 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0100ca4d0 con 0x7f9ff00662f0 2023-07-21T22:14:50.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:50.064+0000 7fa00d7fa700 1 -- 172.21.15.49:0/2004820238 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70298 (secure 0 0 0) 0x7f9ff8011b00 con 0x7f9ff00662f0 2023-07-21T22:14:50.110 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:14:50.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:50.068+0000 7fa015648700 1 -- 172.21.15.49:0/2004820238 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ff00662f0 msgr2=0x7f9ff00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:50.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:50.068+0000 7fa015648700 1 --2- 172.21.15.49:0/2004820238 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ff00662f0 0x7f9ff00687a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8000c00 tx=0x7f9ff8008030 comp rx=0 tx=0).stop 2023-07-21T22:14:50.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:50.068+0000 7fa015648700 1 -- 172.21.15.49:0/2004820238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa01006d380 msgr2=0x7fa010153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:50.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:50.068+0000 7fa015648700 1 --2- 172.21.15.49:0/2004820238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa01006d380 0x7fa010153110 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa00000e870 tx=0x7fa00000eb80 comp rx=0 tx=0).stop 2023-07-21T22:14:50.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:50.068+0000 7fa015648700 1 -- 172.21.15.49:0/2004820238 shutdown_connections 2023-07-21T22:14:50.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:50.068+0000 7fa015648700 1 --2- 172.21.15.49:0/2004820238 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ff00662f0 0x7f9ff00687a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:50.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:50.068+0000 7fa015648700 1 --2- 172.21.15.49:0/2004820238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0100b1400 0x7fa01015bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:50.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:50.068+0000 7fa015648700 1 --2- 172.21.15.49:0/2004820238 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa010071c70 0x7fa01015bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:50.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:50.068+0000 7fa015648700 1 --2- 172.21.15.49:0/2004820238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa01006d380 0x7fa010153110 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:50.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:50.068+0000 7fa015648700 1 -- 172.21.15.49:0/2004820238 >> 172.21.15.49:0/2004820238 conn(0x7fa010070450 msgr2=0x7fa0100b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:50.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:50.068+0000 7fa015648700 1 -- 172.21.15.49:0/2004820238 shutdown_connections 2023-07-21T22:14:50.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:14:50.068+0000 7fa015648700 1 -- 172.21.15.49:0/2004820238 wait complete. 2023-07-21T22:14:50.116 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:14:50.134 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2023-07-21T22:14:48.394940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":251752,"kb_used_data":7464,"kb_used_omap":0,"kb_used_meta":244224,"kb_avail":754722968,"statfs":{"total":773094113280,"available":772836319232,"internally_reserved":0,"allocated":7643136,"data_stored":4203960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":250085376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003538"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.606443+0000","last_change":"2023-07-21T22:10:29.120774+0000","last_active":"2023-07-21T22:14:35.606443+0000","last_peered":"2023-07-21T22:14:35.606443+0000","last_clean":"2023-07-21T22:14:35.606443+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:14:35.606443+0000","last_undegraded":"2023-07-21T22:14:35.606443+0000","last_fullsized":"2023-07-21T22:14:35.606443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:46.212083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.608261+0000","last_change":"2023-07-21T22:10:29.121324+0000","last_active":"2023-07-21T22:14:35.608261+0000","last_peered":"2023-07-21T22:14:35.608261+0000","last_clean":"2023-07-21T22:14:35.608261+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:14:35.608261+0000","last_undegraded":"2023-07-21T22:14:35.608261+0000","last_fullsized":"2023-07-21T22:14:35.608261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:24.157963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.607030+0000","last_change":"2023-07-21T22:10:29.446198+0000","last_active":"2023-07-21T22:14:35.607030+0000","last_peered":"2023-07-21T22:14:35.607030+0000","last_clean":"2023-07-21T22:14:35.607030+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:14:35.607030+0000","last_undegraded":"2023-07-21T22:14:35.607030+0000","last_fullsized":"2023-07-21T22:14:35.607030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:13:04.979273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.607477+0000","last_change":"2023-07-21T22:10:29.446939+0000","last_active":"2023-07-21T22:14:35.607477+0000","last_peered":"2023-07-21T22:14:35.607477+0000","last_clean":"2023-07-21T22:14:35.607477+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:14:35.607477+0000","last_undegraded":"2023-07-21T22:14:35.607477+0000","last_fullsized":"2023-07-21T22:14:35.607477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:08:34.202110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:34.655553+0000","last_change":"2023-07-21T22:10:29.115879+0000","last_active":"2023-07-21T22:14:34.655553+0000","last_peered":"2023-07-21T22:14:34.655553+0000","last_clean":"2023-07-21T22:14:34.655553+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:14:34.655553+0000","last_undegraded":"2023-07-21T22:14:34.655553+0000","last_fullsized":"2023-07-21T22:14:34.655553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:50:35.167252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean+scrubbing+deep","last_fresh":"2023-07-21T22:14:46.358728+0000","last_change":"2023-07-21T22:14:46.427169+0000","last_active":"2023-07-21T22:14:46.358728+0000","last_peered":"2023-07-21T22:14:46.358728+0000","last_clean":"2023-07-21T22:14:46.358728+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:14:46.358728+0000","last_undegraded":"2023-07-21T22:14:46.358728+0000","last_fullsized":"2023-07-21T22:14:46.358728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.604241+0000","last_change":"2023-07-21T22:10:29.119291+0000","last_active":"2023-07-21T22:14:35.604241+0000","last_peered":"2023-07-21T22:14:35.604241+0000","last_clean":"2023-07-21T22:14:35.604241+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:14:35.604241+0000","last_undegraded":"2023-07-21T22:14:35.604241+0000","last_fullsized":"2023-07-21T22:14:35.604241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:46:30.446720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:34.658520+0000","last_change":"2023-07-21T22:10:29.115042+0000","last_active":"2023-07-21T22:14:34.658520+0000","last_peered":"2023-07-21T22:14:34.658520+0000","last_clean":"2023-07-21T22:14:34.658520+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:14:34.658520+0000","last_undegraded":"2023-07-21T22:14:34.658520+0000","last_fullsized":"2023-07-21T22:14:34.658520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:28.077965+0000","last_clean_scrub_stamp":"2023-07-21T22:10:28.077965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:21.733748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":247,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:35.604482+0000","last_change":"2023-07-21T22:10:24.442606+0000","last_active":"2023-07-21T22:14:35.604482+0000","last_peered":"2023-07-21T22:14:35.604482+0000","last_clean":"2023-07-21T22:14:35.604482+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:14:35.604482+0000","last_undegraded":"2023-07-21T22:14:35.604482+0000","last_fullsized":"2023-07-21T22:14:35.604482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:10:22.924727+0000","last_clean_scrub_stamp":"2023-07-21T22:10:22.924727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:09:04.332487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1400832,"data_stored":968271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.75900000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4810000000000001,"5min":2.218,"15min":2.218},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2589999999999999,"15min":1.3029999999999999},"min":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.736,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.355}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1739999999999999,"15min":1.2110000000000001},"min":{"1min":0.77300000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4870000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.2,"15min":1.2609999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.645,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":0.88}]},{"osd":2,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.1850000000000001,"15min":1.2170000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.349,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2430000000000001,"15min":1.2889999999999999},"min":{"1min":0.77200000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.534,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.52}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.256,"15min":1.286},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5069999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3129999999999999,"15min":1.4019999999999999},"min":{"1min":0.753,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6899999999999999,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.409}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1830000000000001,"15min":1.2230000000000001},"min":{"1min":0.80600000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.514,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2749999999999999,"15min":1.3240000000000001},"min":{"1min":0.75700000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.53,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.306}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3380000000000001,"15min":1.3620000000000001},"min":{"1min":0.65400000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.9930000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3009999999999999,"15min":1.365},"min":{"1min":0.72699999999999998,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7849999999999999,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.5660000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.421,"15min":1.486},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.8280000000000001,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.377,"15min":1.415},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.7370000000000001,"5min":2.476,"15min":2.476},"last":1.496}]}]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0980000000000001,"15min":1.1160000000000001},"min":{"1min":0.69099999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.502,"5min":1.657,"15min":1.657},"last":1.012},{"interface":"front","average":{"1min":1.141,"5min":1.109,"15min":1.1399999999999999},"min":{"1min":0.73999999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4390000000000001,"5min":2.802,"15min":2.802},"last":1.2769999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.204,"15min":1.242},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.179,"5min":1.194,"15min":1.244},"min":{"1min":0.82499999999999996,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.548,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.3540000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2250000000000001,"15min":1.2649999999999999},"min":{"1min":0.97599999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6299999999999999,"5min":2.911,"15min":2.911},"last":1.397},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2589999999999999,"15min":1.345},"min":{"1min":0.76100000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.0590000000000002,"5min":2.379,"15min":2.379},"last":1.0529999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3320000000000001,"15min":1.411},"min":{"1min":0.92800000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9710000000000001,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.224},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.319,"15min":1.393},"min":{"1min":0.97799999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6200000000000001,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.79000000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2729999999999999},"min":{"1min":0.85699999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.8049999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3180000000000001,"15min":1.375},"min":{"1min":0.88200000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6719999999999999,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.101}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.355,"15min":1.3899999999999999},"min":{"1min":0.79200000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.161,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.415,"15min":1.4450000000000001},"min":{"1min":1.004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9139999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.496}]},{"osd":7,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.411,"15min":1.4370000000000001},"min":{"1min":1.115,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9359999999999999,"5min":4.194,"15min":4.194},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.456,"5min":1.502,"15min":1.5429999999999999},"min":{"1min":0.91600000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.1139999999999999,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.427}]}]},{"osd":5,"up_from":15,"seq":64424509497,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.63200000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.115,"15min":1.1359999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.478,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.86799999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1599999999999999,"15min":1.1990000000000001},"min":{"1min":0.92100000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.337},{"interface":"front","average":{"1min":1.181,"5min":1.157,"15min":1.1830000000000001},"min":{"1min":0.85399999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":3.4820000000000002,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":1.1819999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.161,"15min":1.1659999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.556,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.2450000000000001,"15min":1.296},"min":{"1min":0.76500000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.724,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.93200000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.218,"15min":1.2470000000000001},"min":{"1min":0.752,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.3600000000000001,"15min":1.3979999999999999},"min":{"1min":1.056,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.6679999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.3120000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.274,"15min":1.3260000000000001},"min":{"1min":0.86399999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.577,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.288,"15min":1.3029999999999999},"min":{"1min":0.93300000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5720000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.2749999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.2210000000000001,"15min":1.2709999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.498,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.2889999999999999,"15min":1.3300000000000001},"min":{"1min":0.88800000000000001,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.536,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.1479999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.266,"15min":1.298},"min":{"1min":0.88900000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7589999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.448,"15min":1.506},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.623,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.1180000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.105,"15min":1.101},"min":{"1min":0.54900000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.546,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.27},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.169},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5720000000000001,"5min":1.617,"15min":1.617},"last":1.0309999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2210000000000001,"15min":1.234},"min":{"1min":0.77800000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.661,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.746},{"interface":"front","average":{"1min":1.274,"5min":1.2090000000000001,"15min":1.2010000000000001},"min":{"1min":0.79800000000000004,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.429}]},{"osd":2,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.129,"15min":1.135},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.3240000000000001,"5min":1.609,"15min":1.609},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.2749999999999999,"15min":1.2989999999999999},"min":{"1min":1.002,"5min":0.621,"15min":0.621},"max":{"1min":1.637,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.1200000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.258,"15min":1.302},"min":{"1min":0.93799999999999994,"5min":0.745,"15min":0.745},"max":{"1min":1.833,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.371},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.2270000000000001,"15min":1.23},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.51,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1879999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.246,"15min":1.294},"min":{"1min":0.82899999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.573,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.254,"15min":1.24},"min":{"1min":0.89400000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.643,"5min":1.794,"15min":1.794},"last":1.484}]},{"osd":6,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1899999999999999,"15min":1.1970000000000001},"min":{"1min":0.80700000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8160000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.369,"15min":1.417},"min":{"1min":0.90400000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6879999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.3080000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3999999999999999,"15min":1.3740000000000001},"min":{"1min":0.999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.53},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4019999999999999,"15min":1.4059999999999999},"min":{"1min":1.0169999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6100000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.407}]}]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.90600000000000003,"15min":0.92600000000000005},"min":{"1min":0.64300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.484,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60099999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.9830000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.92600000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90400000000000003,"15min":0.93899999999999995},"min":{"1min":0.66100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6000000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.038},{"interface":"front","average":{"1min":0.998,"5min":1.05,"15min":1.1180000000000001},"min":{"1min":0.65200000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5249999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.248}]},{"osd":2,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.109,"15min":1.113},"min":{"1min":0.69999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.52,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.125},{"interface":"front","average":{"1min":1.206,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.82199999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.327}]},{"osd":4,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":1.0029999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.679,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.286,"5min":1.276,"15min":1.329},"min":{"1min":0.90100000000000002,"5min":0.751,"15min":0.751},"max":{"1min":1.9350000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.0940000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.294,"15min":1.3360000000000001},"min":{"1min":1.028,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.651,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.496},{"interface":"front","average":{"1min":1.367,"5min":1.413,"15min":1.4590000000000001},"min":{"1min":0.92000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.6890000000000001,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.4259999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.337,"15min":1.367},"min":{"1min":1.032,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0379999999999998,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.218},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.3959999999999999,"15min":1.444},"min":{"1min":0.92500000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.7709999999999999,"5min":2.161,"15min":2.161},"last":1.4379999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4370000000000001,"15min":1.4990000000000001},"min":{"1min":1.0249999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7789999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.391},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4890000000000001,"15min":1.5469999999999999},"min":{"1min":1.196,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.6399999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.532}]}]},{"osd":2,"up_from":15,"seq":64424509495,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85999999999999999,"15min":0.876},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.222,"5min":1.0589999999999999,"15min":1.044},"min":{"1min":0.70999999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":7.0300000000000002,"5min":7.0300000000000002,"15min":7.0300000000000002},"last":0.73399999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.94599999999999995,"15min":0.95899999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.109,"15min":1.121},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1299999999999999,"15min":1.1399999999999999},"min":{"1min":0.76400000000000001,"5min":0.501,"15min":0.501},"max":{"1min":3.5070000000000001,"5min":3.5070000000000001,"15min":3.5070000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.147,"15min":1.161},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.391,"15min":1.4179999999999999},"min":{"1min":1.0580000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1840000000000002,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.143},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.45,"15min":1.5009999999999999},"min":{"1min":1.026,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.516,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.2410000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.486,"15min":1.5089999999999999},"min":{"1min":1.1060000000000001,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":3.0870000000000002,"5min":3.331,"15min":3.331},"last":1.177},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5069999999999999,"15min":1.5509999999999999},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":3.238,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.2010000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4370000000000001,"15min":1.4570000000000001},"min":{"1min":1.0669999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.399,"5min":2.633,"15min":2.633},"last":1.298},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.427,"15min":1.46},"min":{"1min":1.0900000000000001,"5min":0.878,"15min":0.878},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1}]},{"osd":7,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.4550000000000001,"15min":1.482},"min":{"1min":1.121,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.137,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.583,"5min":1.534,"15min":1.5640000000000001},"min":{"1min":1.095,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.4020000000000001,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.0409999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509496,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1400832,"data_stored":968271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.871,"15min":0.88600000000000001},"min":{"1min":0.57199999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.272},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.94899999999999995,"15min":0.97399999999999998},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.397,"5min":1.496,"15min":1.496},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.96499999999999997,"15min":0.94199999999999995},"min":{"1min":0.68200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4319999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.089,"5min":1.0449999999999999,"15min":1.0309999999999999},"min":{"1min":0.65800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.617,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.68000000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3560000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.6879999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1719999999999999,"15min":1.173},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.7050000000000001,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":1.659}]},{"osd":4,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.2410000000000001,"15min":1.2529999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.464,"5min":3.1779999999999999,"15min":3.1779999999999999},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3859999999999999,"15min":1.3899999999999999},"min":{"1min":1.0209999999999999,"5min":1,"15min":1},"max":{"1min":1.8100000000000001,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.4570000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.403,"15min":1.478},"min":{"1min":1.038,"5min":0.872,"15min":0.872},"max":{"1min":1.716,"5min":2.419,"15min":2.419},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.276,"5min":1.355,"15min":1.395},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.6359999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.6140000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4590000000000001,"15min":1.5129999999999999},"min":{"1min":1.069,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.919,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.464,"5min":1.462,"15min":1.514},"min":{"1min":1.2010000000000001,"5min":1.038,"15min":1.038},"max":{"1min":1.895,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.498}]},{"osd":7,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4750000000000001,"15min":1.532},"min":{"1min":1.085,"5min":0.999,"15min":0.999},"max":{"1min":1.964,"5min":2.504,"15min":2.504},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.4379999999999999,"15min":1.494},"min":{"1min":1.0489999999999999,"5min":0.872,"15min":0.872},"max":{"1min":1.8520000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.534}]}]},{"osd":1,"up_from":14,"seq":60129542201,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.872,"15min":0.89100000000000001},"min":{"1min":0.54100000000000004,"5min":0.247,"15min":0.247},"max":{"1min":1.2250000000000001,"5min":2.113,"15min":2.113},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":0.92900000000000005},"min":{"1min":0.629,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1180000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.89400000000000002,"15min":0.89800000000000002},"min":{"1min":0.58699999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3819999999999999,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0660000000000001,"15min":1.1120000000000001},"min":{"1min":0.71399999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.4730000000000001,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.028}]},{"osd":3,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.2410000000000001,"15min":1.367},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.385,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.1359999999999999,"15min":1.234},"min":{"1min":0.76400000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.446,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":0.876}]},{"osd":4,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2689999999999999,"15min":1.306},"min":{"1min":0.89500000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5169999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.008},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2490000000000001,"15min":1.294},"min":{"1min":0.92600000000000005,"5min":0.377,"15min":0.377},"max":{"1min":1.607,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.278}]},{"osd":5,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.292,"15min":1.3520000000000001},"min":{"1min":0.85399999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.867,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3999999999999999,"15min":1.4730000000000001},"min":{"1min":1.0669999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.631,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.502}]},{"osd":6,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3680000000000001,"15min":1.4199999999999999},"min":{"1min":1.0089999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8360000000000001,"5min":2.238,"15min":2.238},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3919999999999999,"15min":1.4359999999999999},"min":{"1min":0.89200000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.752,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.1719999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.4950000000000001,"15min":1.546},"min":{"1min":1.0449999999999999,"5min":0.624,"15min":0.624},"max":{"1min":1.788,"5min":4.391,"15min":4.391},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.448,"15min":1.506},"min":{"1min":1.0940000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.9099999999999999,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.381}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:14:50.141 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-07-21T22:10:28.077965+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=10, tm_sec=28, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=14, tm_sec=43, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:14:50.141 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-07-21T22:10:28.077965+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=10, tm_sec=28, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=14, tm_sec=43, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:14:50.141 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-07-21T22:10:28.077965+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=10, tm_sec=28, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=14, tm_sec=43, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:14:50.142 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-07-21T22:10:28.077965+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=10, tm_sec=28, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=14, tm_sec=43, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:14:50.142 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-21T22:10:28.077965+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=10, tm_sec=28, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=14, tm_sec=43, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:14:50.142 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-07-21T22:10:28.077965+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=10, tm_sec=28, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=14, tm_sec=43, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:14:50.142 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-21T22:10:28.077965+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=10, tm_sec=28, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=14, tm_sec=43, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:14:50.143 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-21T22:10:28.077965+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=10, tm_sec=28, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=14, tm_sec=43, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:14:50.143 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-21T22:10:22.924727+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=10, tm_sec=22, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=14, tm_sec=43, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:14:50.143 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-21T22:15:00.531 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:15:00.539 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:15:10.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:15:10.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.283+0000 7ff18d61d700 1 Processor -- start 2023-07-21T22:15:10.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.283+0000 7ff18d61d700 1 -- start start 2023-07-21T22:15:10.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff18d61d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1881561a0 0x7ff1880cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:10.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff18d61d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff1880afc20 0x7ff1880b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:10.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff18d61d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1880b0580 con 0x7ff188155dd0 2023-07-21T22:15:10.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff18d61d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18815bf50 con 0x7ff1880afc20 2023-07-21T22:15:10.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff18d61d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18815c230 con 0x7ff1881561a0 2023-07-21T22:15:10.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff186ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff188155dd0 0x7ff1880cd8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52710/0 (socket says 172.21.15.49:52710) 2023-07-21T22:15:10.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff186ffd700 1 -- 172.21.15.49:0/2596396234 learned_addr learned my addr 172.21.15.49:0/2596396234 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:15:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff1877fe700 1 --2- 172.21.15.49:0/2596396234 >> v2:172.21.15.49:3300/0 conn(0x7ff1880afc20 0x7ff1880b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff1867fc700 1 --2- 172.21.15.49:0/2596396234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1881561a0 0x7ff1880cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff185ffb700 1 -- 172.21.15.49:0/2596396234 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514568690 0 0) 0x7ff1880b0580 con 0x7ff188155dd0 2023-07-21T22:15:10.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff185ffb700 1 -- 172.21.15.49:0/2596396234 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1700035d0 con 0x7ff188155dd0 2023-07-21T22:15:10.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff185ffb700 1 -- 172.21.15.49:0/2596396234 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3588792075 0 0) 0x7ff1700035d0 con 0x7ff188155dd0 2023-07-21T22:15:10.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff1877fe700 1 -- 172.21.15.49:0/2596396234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1881561a0 msgr2=0x7ff1880cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:15:10.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff1877fe700 1 --2- 172.21.15.49:0/2596396234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1881561a0 0x7ff1880cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff1877fe700 1 -- 172.21.15.49:0/2596396234 >> v1:172.21.15.49:6789/0 conn(0x7ff188155dd0 legacy=0x7ff1880cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:10.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff1877fe700 1 -- 172.21.15.49:0/2596396234 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18815c510 con 0x7ff1880afc20 2023-07-21T22:15:10.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff1877fe700 1 --2- 172.21.15.49:0/2596396234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1880afc20 0x7ff1880b0040 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff18000aea0 tx=0x7ff18000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a32d986b80800b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:15:10.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff185ffb700 1 -- 172.21.15.49:0/2596396234 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178001670 con 0x7ff1880afc20 2023-07-21T22:15:10.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff185ffb700 1 -- 172.21.15.49:0/2596396234 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18000a2e0 con 0x7ff1880afc20 2023-07-21T22:15:10.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.287+0000 7ff185ffb700 1 -- 172.21.15.49:0/2596396234 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff180003c40 con 0x7ff1880afc20 2023-07-21T22:15:10.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.291+0000 7ff18d61d700 1 -- 172.21.15.49:0/2596396234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1880afc20 msgr2=0x7ff1880b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:10.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.291+0000 7ff18d61d700 1 --2- 172.21.15.49:0/2596396234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1880afc20 0x7ff1880b0040 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff18000aea0 tx=0x7ff18000c330 comp rx=0 tx=0).stop 2023-07-21T22:15:10.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.291+0000 7ff18d61d700 1 -- 172.21.15.49:0/2596396234 shutdown_connections 2023-07-21T22:15:10.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.291+0000 7ff18d61d700 1 --2- 172.21.15.49:0/2596396234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1880afc20 0x7ff1880b0040 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.291+0000 7ff18d61d700 1 --2- 172.21.15.49:0/2596396234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1881561a0 0x7ff1880cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.291+0000 7ff18d61d700 1 -- 172.21.15.49:0/2596396234 >> 172.21.15.49:0/2596396234 conn(0x7ff18806f5a0 msgr2=0x7ff1880cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:15:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.291+0000 7ff18d61d700 1 -- 172.21.15.49:0/2596396234 shutdown_connections 2023-07-21T22:15:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.291+0000 7ff18d61d700 1 -- 172.21.15.49:0/2596396234 wait complete. 2023-07-21T22:15:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.291+0000 7ff18d61d700 1 Processor -- start 2023-07-21T22:15:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.291+0000 7ff18d61d700 1 -- start start 2023-07-21T22:15:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff18d61d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1880afc20 0x7ff188155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff18d61d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff188155dd0 0x7ff1880b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff18d61d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1880c35b0 0x7ff1881e2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff18d61d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1880c4b00 con 0x7ff1880c35b0 2023-07-21T22:15:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff18d61d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff188155b60 con 0x7ff188155dd0 2023-07-21T22:15:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff18d61d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1880c3a60 con 0x7ff1880afc20 2023-07-21T22:15:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff1877fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1880c35b0 0x7ff1881e2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff1877fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1880c35b0 0x7ff1881e2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39762/0 (socket says 172.21.15.49:39762) 2023-07-21T22:15:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff1877fe700 1 -- 172.21.15.49:0/819238519 learned_addr learned my addr 172.21.15.49:0/819238519 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:15:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff186ffd700 1 --2- 172.21.15.49:0/819238519 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1880afc20 0x7ff188155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff1867fc700 1 --2- 172.21.15.49:0/819238519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff188155dd0 0x7ff1880b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff1877fe700 1 -- 172.21.15.49:0/819238519 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1880afc20 msgr2=0x7ff188155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff1877fe700 1 --2- 172.21.15.49:0/819238519 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1880afc20 0x7ff188155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff1877fe700 1 -- 172.21.15.49:0/819238519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff188155dd0 msgr2=0x7ff1880b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff1877fe700 1 --2- 172.21.15.49:0/819238519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff188155dd0 0x7ff1880b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff1877fe700 1 -- 172.21.15.49:0/819238519 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18000ab80 con 0x7ff1880c35b0 2023-07-21T22:15:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff1877fe700 1 --2- 172.21.15.49:0/819238519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1880c35b0 0x7ff1881e2dc0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff18000c370 tx=0x7ff180004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:15:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff16f7fe700 1 -- 172.21.15.49:0/819238519 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff180020070 con 0x7ff1880c35b0 2023-07-21T22:15:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff16f7fe700 1 -- 172.21.15.49:0/819238519 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff180004030 con 0x7ff1880c35b0 2023-07-21T22:15:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff16f7fe700 1 -- 172.21.15.49:0/819238519 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1800043a0 con 0x7ff1880c35b0 2023-07-21T22:15:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff18d61d700 1 -- 172.21.15.49:0/819238519 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1880c3d40 con 0x7ff1880c35b0 2023-07-21T22:15:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.295+0000 7ff18d61d700 1 -- 172.21.15.49:0/819238519 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1880c4300 con 0x7ff1880c35b0 2023-07-21T22:15:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.299+0000 7ff18d61d700 1 -- 172.21.15.49:0/819238519 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff188073130 con 0x7ff1880c35b0 2023-07-21T22:15:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.299+0000 7ff16f7fe700 1 -- 172.21.15.49:0/819238519 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff180004500 con 0x7ff1880c35b0 2023-07-21T22:15:10.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.303+0000 7ff16f7fe700 1 --2- 172.21.15.49:0/819238519 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff1740662f0 0x7ff1740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:10.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.303+0000 7ff16f7fe700 1 -- 172.21.15.49:0/819238519 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7ff180086fd0 con 0x7ff1880c35b0 2023-07-21T22:15:10.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.303+0000 7ff186ffd700 1 --2- 172.21.15.49:0/819238519 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff1740662f0 0x7ff1740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:10.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.303+0000 7ff186ffd700 1 --2- 172.21.15.49:0/819238519 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff1740662f0 0x7ff1740687a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff1780011e0 tx=0x7ff178001550 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:15:10.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.311+0000 7ff16f7fe700 1 -- 172.21.15.49:0/819238519 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff180054740 con 0x7ff1880c35b0 2023-07-21T22:15:10.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.483+0000 7ff18d61d700 1 -- 172.21.15.49:0/819238519 --> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff18815cad0 con 0x7ff1740662f0 2023-07-21T22:15:10.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.491+0000 7ff16f7fe700 1 -- 172.21.15.49:0/819238519 <== mgr.4101 v2:172.21.15.49:6832/1334330893 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70591 (secure 0 0 0) 0x7ff178001c80 con 0x7ff1740662f0 2023-07-21T22:15:10.538 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:15:10.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.495+0000 7ff18d61d700 1 -- 172.21.15.49:0/819238519 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff1740662f0 msgr2=0x7ff1740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:10.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.495+0000 7ff18d61d700 1 --2- 172.21.15.49:0/819238519 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff1740662f0 0x7ff1740687a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff1780011e0 tx=0x7ff178001550 comp rx=0 tx=0).stop 2023-07-21T22:15:10.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.495+0000 7ff18d61d700 1 -- 172.21.15.49:0/819238519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1880c35b0 msgr2=0x7ff1881e2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:10.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.495+0000 7ff18d61d700 1 --2- 172.21.15.49:0/819238519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1880c35b0 0x7ff1881e2dc0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff18000c370 tx=0x7ff180004af0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.495+0000 7ff18d61d700 1 -- 172.21.15.49:0/819238519 shutdown_connections 2023-07-21T22:15:10.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.495+0000 7ff18d61d700 1 --2- 172.21.15.49:0/819238519 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7ff1740662f0 0x7ff1740687a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.495+0000 7ff18d61d700 1 --2- 172.21.15.49:0/819238519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1880c35b0 0x7ff1881e2dc0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.495+0000 7ff18d61d700 1 --2- 172.21.15.49:0/819238519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff188155dd0 0x7ff1880b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.495+0000 7ff18d61d700 1 --2- 172.21.15.49:0/819238519 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1880afc20 0x7ff188155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.495+0000 7ff18d61d700 1 -- 172.21.15.49:0/819238519 >> 172.21.15.49:0/819238519 conn(0x7ff18806f5a0 msgr2=0x7ff188157020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:15:10.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.495+0000 7ff18d61d700 1 -- 172.21.15.49:0/819238519 shutdown_connections 2023-07-21T22:15:10.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.495+0000 7ff18d61d700 1 -- 172.21.15.49:0/819238519 wait complete. 2023-07-21T22:15:10.545 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-07-21T22:15:10.565 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2023-07-21T22:15:10.402552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":251752,"kb_used_data":7464,"kb_used_omap":0,"kb_used_meta":244224,"kb_avail":754722968,"statfs":{"total":773094113280,"available":772836319232,"internally_reserved":0,"allocated":7643136,"data_stored":4203960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":250085376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004038"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":104,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:56.082754+0000","last_change":"2023-07-21T22:14:56.082865+0000","last_active":"2023-07-21T22:14:56.082754+0000","last_peered":"2023-07-21T22:14:56.082754+0000","last_clean":"2023-07-21T22:14:56.082754+0000","last_became_active":"2023-07-21T22:10:29.120273+0000","last_became_peered":"2023-07-21T22:10:29.120273+0000","last_unstale":"2023-07-21T22:14:56.082754+0000","last_undegraded":"2023-07-21T22:14:56.082754+0000","last_fullsized":"2023-07-21T22:14:56.082754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:14:56.082556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:14:56.082556+0000","last_clean_scrub_stamp":"2023-07-21T22:14:56.082556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:10:38.550018+0000","scrub_duration":0.0043777360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:46.055148+0000","last_change":"2023-07-21T22:14:46.055148+0000","last_active":"2023-07-21T22:14:46.055148+0000","last_peered":"2023-07-21T22:14:46.055148+0000","last_clean":"2023-07-21T22:14:46.055148+0000","last_became_active":"2023-07-21T22:10:29.121038+0000","last_became_peered":"2023-07-21T22:10:29.121038+0000","last_unstale":"2023-07-21T22:14:46.055148+0000","last_undegraded":"2023-07-21T22:14:46.055148+0000","last_fullsized":"2023-07-21T22:14:46.055148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:14:46.054840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:14:46.054840+0000","last_clean_scrub_stamp":"2023-07-21T22:14:46.054840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:28:24.993602+0000","scrub_duration":0.0052236139999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:59.217998+0000","last_change":"2023-07-21T22:14:59.218048+0000","last_active":"2023-07-21T22:14:59.217998+0000","last_peered":"2023-07-21T22:14:59.217998+0000","last_clean":"2023-07-21T22:14:59.217998+0000","last_became_active":"2023-07-21T22:10:29.445477+0000","last_became_peered":"2023-07-21T22:10:29.445477+0000","last_unstale":"2023-07-21T22:14:59.217998+0000","last_undegraded":"2023-07-21T22:14:59.217998+0000","last_fullsized":"2023-07-21T22:14:59.217998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:14:59.217899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:14:59.217899+0000","last_clean_scrub_stamp":"2023-07-21T22:14:59.217899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:37:56.062942+0000","scrub_duration":0.0043796460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:49.103211+0000","last_change":"2023-07-21T22:14:49.103273+0000","last_active":"2023-07-21T22:14:49.103211+0000","last_peered":"2023-07-21T22:14:49.103211+0000","last_clean":"2023-07-21T22:14:49.103211+0000","last_became_active":"2023-07-21T22:10:29.446016+0000","last_became_peered":"2023-07-21T22:10:29.446016+0000","last_unstale":"2023-07-21T22:14:49.103211+0000","last_undegraded":"2023-07-21T22:14:49.103211+0000","last_fullsized":"2023-07-21T22:14:49.103211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:14:49.103057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:14:49.103057+0000","last_clean_scrub_stamp":"2023-07-21T22:14:49.103057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:23:02.864974+0000","scrub_duration":0.0049698320000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:54.217095+0000","last_change":"2023-07-21T22:14:54.217201+0000","last_active":"2023-07-21T22:14:54.217095+0000","last_peered":"2023-07-21T22:14:54.217095+0000","last_clean":"2023-07-21T22:14:54.217095+0000","last_became_active":"2023-07-21T22:10:29.115078+0000","last_became_peered":"2023-07-21T22:10:29.115078+0000","last_unstale":"2023-07-21T22:14:54.217095+0000","last_undegraded":"2023-07-21T22:14:54.217095+0000","last_fullsized":"2023-07-21T22:14:54.217095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:14:54.216897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:14:54.216897+0000","last_clean_scrub_stamp":"2023-07-21T22:14:54.216897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:41:07.419142+0000","scrub_duration":0.0048544349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:46.431413+0000","last_change":"2023-07-21T22:14:46.431522+0000","last_active":"2023-07-21T22:14:46.431413+0000","last_peered":"2023-07-21T22:14:46.431413+0000","last_clean":"2023-07-21T22:14:46.431413+0000","last_became_active":"2023-07-21T22:10:29.507944+0000","last_became_peered":"2023-07-21T22:10:29.507944+0000","last_unstale":"2023-07-21T22:14:46.431413+0000","last_undegraded":"2023-07-21T22:14:46.431413+0000","last_fullsized":"2023-07-21T22:14:46.431413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:14:46.431218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:14:46.431218+0000","last_clean_scrub_stamp":"2023-07-21T22:14:46.431218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:44.069422+0000","scrub_duration":0.0038681499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:55.222493+0000","last_change":"2023-07-21T22:14:55.222561+0000","last_active":"2023-07-21T22:14:55.222493+0000","last_peered":"2023-07-21T22:14:55.222493+0000","last_clean":"2023-07-21T22:14:55.222493+0000","last_became_active":"2023-07-21T22:10:29.118987+0000","last_became_peered":"2023-07-21T22:10:29.118987+0000","last_unstale":"2023-07-21T22:14:55.222493+0000","last_undegraded":"2023-07-21T22:14:55.222493+0000","last_fullsized":"2023-07-21T22:14:55.222493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:14:55.222366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:14:55.222366+0000","last_clean_scrub_stamp":"2023-07-21T22:14:55.222366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:19:12.920469+0000","scrub_duration":0.0049397970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:49.151937+0000","last_change":"2023-07-21T22:14:49.152025+0000","last_active":"2023-07-21T22:14:49.151937+0000","last_peered":"2023-07-21T22:14:49.151937+0000","last_clean":"2023-07-21T22:14:49.151937+0000","last_became_active":"2023-07-21T22:10:29.114625+0000","last_became_peered":"2023-07-21T22:10:29.114625+0000","last_unstale":"2023-07-21T22:14:49.151937+0000","last_undegraded":"2023-07-21T22:14:49.151937+0000","last_fullsized":"2023-07-21T22:14:49.151937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:14:49.151782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:14:49.151782+0000","last_clean_scrub_stamp":"2023-07-21T22:14:49.151782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:19:06.849885+0000","scrub_duration":0.0040843579999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"67'119","reported_seq":258,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:14:51.150723+0000","last_change":"2023-07-21T22:14:51.150853+0000","last_active":"2023-07-21T22:14:51.150723+0000","last_peered":"2023-07-21T22:14:51.150723+0000","last_clean":"2023-07-21T22:14:51.150723+0000","last_became_active":"2023-07-21T22:10:24.439838+0000","last_became_peered":"2023-07-21T22:10:24.439838+0000","last_unstale":"2023-07-21T22:14:51.150723+0000","last_undegraded":"2023-07-21T22:14:51.150723+0000","last_fullsized":"2023-07-21T22:14:51.150723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'119","last_scrub_stamp":"2023-07-21T22:14:51.150574+0000","last_deep_scrub":"67'119","last_deep_scrub_stamp":"2023-07-21T22:14:51.150574+0000","last_clean_scrub_stamp":"2023-07-21T22:14:51.150574+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:57:21.019441+0000","scrub_duration":0.011039358000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1400832,"data_stored":968271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.75900000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4810000000000001,"5min":2.218,"15min":2.218},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2589999999999999,"15min":1.3029999999999999},"min":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.736,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.4239999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1739999999999999,"15min":1.2110000000000001},"min":{"1min":0.77300000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4870000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.2,"15min":1.2609999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.645,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.2490000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.1850000000000001,"15min":1.2170000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.349,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.288},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2430000000000001,"15min":1.2889999999999999},"min":{"1min":0.77200000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.534,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.1020000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.256,"15min":1.286},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5069999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.194},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3129999999999999,"15min":1.4019999999999999},"min":{"1min":0.753,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6899999999999999,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.0189999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1830000000000001,"15min":1.2230000000000001},"min":{"1min":0.80600000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.514,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2749999999999999,"15min":1.3240000000000001},"min":{"1min":0.75700000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.53,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.0620000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3380000000000001,"15min":1.3620000000000001},"min":{"1min":0.65400000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.9930000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3009999999999999,"15min":1.365},"min":{"1min":0.72699999999999998,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7849999999999999,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.1299999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.421,"15min":1.486},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.8280000000000001,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.377,"15min":1.415},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.7370000000000001,"5min":2.476,"15min":2.476},"last":0.95199999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509502,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0980000000000001,"15min":1.1160000000000001},"min":{"1min":0.69099999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.502,"5min":1.657,"15min":1.657},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.141,"5min":1.109,"15min":1.1399999999999999},"min":{"1min":0.73999999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4390000000000001,"5min":2.802,"15min":2.802},"last":1.24}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.204,"15min":1.242},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":1.097},{"interface":"front","average":{"1min":1.179,"5min":1.194,"15min":1.244},"min":{"1min":0.82499999999999996,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.548,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.1579999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2250000000000001,"15min":1.2649999999999999},"min":{"1min":0.97599999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6299999999999999,"5min":2.911,"15min":2.911},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2589999999999999,"15min":1.345},"min":{"1min":0.76100000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.0590000000000002,"5min":2.379,"15min":2.379},"last":1.5449999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3320000000000001,"15min":1.411},"min":{"1min":0.92800000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9710000000000001,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.383},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.319,"15min":1.393},"min":{"1min":0.97799999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6200000000000001,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":1.325}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2729999999999999},"min":{"1min":0.85699999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.8049999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3180000000000001,"15min":1.375},"min":{"1min":0.88200000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6719999999999999,"5min":4.2779999999999996,"15min":4.2779999999999996},"last":1.3620000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.355,"15min":1.3899999999999999},"min":{"1min":0.79200000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.161,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.415,"15min":1.4450000000000001},"min":{"1min":1.004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9139999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.581}]},{"osd":7,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.411,"15min":1.4370000000000001},"min":{"1min":1.115,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9359999999999999,"5min":4.194,"15min":4.194},"last":1.514},{"interface":"front","average":{"1min":1.456,"5min":1.502,"15min":1.5429999999999999},"min":{"1min":0.91600000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.1139999999999999,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.6419999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509501,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.63200000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.115,"15min":1.1359999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.478,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.1910000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1599999999999999,"15min":1.1990000000000001},"min":{"1min":0.92100000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.157,"15min":1.1830000000000001},"min":{"1min":0.85399999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":3.4820000000000002,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":1.2949999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.161,"15min":1.1659999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.556,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.2450000000000001,"15min":1.296},"min":{"1min":0.76500000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.724,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.327}]},{"osd":3,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.218,"15min":1.2470000000000001},"min":{"1min":0.752,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.3600000000000001,"15min":1.3979999999999999},"min":{"1min":1.056,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.6679999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.365}]},{"osd":4,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.274,"15min":1.3260000000000001},"min":{"1min":0.86399999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.577,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.232},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.288,"15min":1.3029999999999999},"min":{"1min":0.93300000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5720000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.4510000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.2210000000000001,"15min":1.2709999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.498,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.224,"5min":1.2889999999999999,"15min":1.3300000000000001},"min":{"1min":0.88800000000000001,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.536,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.1379999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:14:25 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.266,"15min":1.298},"min":{"1min":0.88900000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7589999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.107},{"interface":"front","average":{"1min":1.341,"5min":1.448,"15min":1.506},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.623,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.2589999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.105,"15min":1.101},"min":{"1min":0.54900000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.546,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.169},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5720000000000001,"5min":1.617,"15min":1.617},"last":1.018}]},{"osd":1,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2210000000000001,"15min":1.234},"min":{"1min":0.77800000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.661,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.2090000000000001,"15min":1.2010000000000001},"min":{"1min":0.79800000000000004,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.282}]},{"osd":2,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.129,"15min":1.135},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.3240000000000001,"5min":1.609,"15min":1.609},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.2749999999999999,"15min":1.2989999999999999},"min":{"1min":1.002,"5min":0.621,"15min":0.621},"max":{"1min":1.637,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.1040000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.258,"15min":1.302},"min":{"1min":0.93799999999999994,"5min":0.745,"15min":0.745},"max":{"1min":1.833,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.335},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.2270000000000001,"15min":1.23},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.51,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.353}]},{"osd":5,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.246,"15min":1.294},"min":{"1min":0.82899999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.573,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.254,"15min":1.24},"min":{"1min":0.89400000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.643,"5min":1.794,"15min":1.794},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1899999999999999,"15min":1.1970000000000001},"min":{"1min":0.80700000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8160000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.369,"15min":1.417},"min":{"1min":0.90400000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6879999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.306}]},{"osd":7,"last update":"Fri Jul 21 22:14:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3999999999999999,"15min":1.3740000000000001},"min":{"1min":0.999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4019999999999999,"15min":1.4059999999999999},"min":{"1min":1.0169999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6100000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.419}]}]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.90600000000000003,"15min":0.92600000000000005},"min":{"1min":0.64300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.484,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60099999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.9830000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.89900000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90400000000000003,"15min":0.93899999999999995},"min":{"1min":0.66100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6000000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.05,"15min":1.1180000000000001},"min":{"1min":0.65200000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5249999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.82399999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.109,"15min":1.113},"min":{"1min":0.69999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.52,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.82199999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.85199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":1.0029999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.679,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.113},{"interface":"front","average":{"1min":1.286,"5min":1.276,"15min":1.329},"min":{"1min":0.90100000000000002,"5min":0.751,"15min":0.751},"max":{"1min":1.9350000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.1739999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.294,"15min":1.3360000000000001},"min":{"1min":1.028,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.651,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.413,"15min":1.4590000000000001},"min":{"1min":0.92000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.6890000000000001,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.2869999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.337,"15min":1.367},"min":{"1min":1.032,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0379999999999998,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.3959999999999999,"15min":1.444},"min":{"1min":0.92500000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.7709999999999999,"5min":2.161,"15min":2.161},"last":1.246}]},{"osd":7,"last update":"Fri Jul 21 22:14:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4370000000000001,"15min":1.4990000000000001},"min":{"1min":1.0249999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7789999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.462},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4890000000000001,"15min":1.5469999999999999},"min":{"1min":1.196,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.6399999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.4199999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85999999999999999,"15min":0.876},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.222,"5min":1.0589999999999999,"15min":1.044},"min":{"1min":0.70999999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":7.0300000000000002,"5min":7.0300000000000002,"15min":7.0300000000000002},"last":0.85899999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.94599999999999995,"15min":0.95899999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.109,"15min":1.121},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.016}]},{"osd":3,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1299999999999999,"15min":1.1399999999999999},"min":{"1min":0.76400000000000001,"5min":0.501,"15min":0.501},"max":{"1min":3.5070000000000001,"5min":3.5070000000000001,"15min":3.5070000000000001},"last":1.117},{"interface":"front","average":{"1min":1.254,"5min":1.147,"15min":1.161},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":0.80200000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.391,"15min":1.4179999999999999},"min":{"1min":1.0580000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1840000000000002,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.089},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.45,"15min":1.5009999999999999},"min":{"1min":1.026,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.516,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.288}]},{"osd":5,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.486,"15min":1.5089999999999999},"min":{"1min":1.1060000000000001,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":3.0870000000000002,"5min":3.331,"15min":3.331},"last":1.367},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5069999999999999,"15min":1.5509999999999999},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":3.238,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.254}]},{"osd":6,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4370000000000001,"15min":1.4570000000000001},"min":{"1min":1.0669999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.399,"5min":2.633,"15min":2.633},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.427,"15min":1.46},"min":{"1min":1.0900000000000001,"5min":0.878,"15min":0.878},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.93400000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.4550000000000001,"15min":1.482},"min":{"1min":1.121,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.137,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.583,"5min":1.534,"15min":1.5640000000000001},"min":{"1min":1.095,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.4020000000000001,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.3959999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1400832,"data_stored":968271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.871,"15min":0.88600000000000001},"min":{"1min":0.57199999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.94899999999999995,"15min":0.97399999999999998},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.397,"5min":1.496,"15min":1.496},"last":1.0409999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.96499999999999997,"15min":0.94199999999999995},"min":{"1min":0.68200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4319999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.175},{"interface":"front","average":{"1min":1.089,"5min":1.0449999999999999,"15min":1.0309999999999999},"min":{"1min":0.65800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.617,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.68000000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3560000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1719999999999999,"15min":1.173},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.7050000000000001,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":1.3069999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.2410000000000001,"15min":1.2529999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.464,"5min":3.1779999999999999,"15min":3.1779999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3859999999999999,"15min":1.3899999999999999},"min":{"1min":1.0209999999999999,"5min":1,"15min":1},"max":{"1min":1.8100000000000001,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.4790000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.403,"15min":1.478},"min":{"1min":1.038,"5min":0.872,"15min":0.872},"max":{"1min":1.716,"5min":2.419,"15min":2.419},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.355,"15min":1.395},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.6359999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.2230000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4590000000000001,"15min":1.5129999999999999},"min":{"1min":1.069,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.919,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.462,"15min":1.514},"min":{"1min":1.2010000000000001,"5min":1.038,"15min":1.038},"max":{"1min":1.895,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.448}]},{"osd":7,"last update":"Fri Jul 21 22:14:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4750000000000001,"15min":1.532},"min":{"1min":1.085,"5min":0.999,"15min":0.999},"max":{"1min":1.964,"5min":2.504,"15min":2.504},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.4379999999999999,"15min":1.494},"min":{"1min":1.0489999999999999,"5min":0.872,"15min":0.872},"max":{"1min":1.8520000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.117}]}]},{"osd":1,"up_from":14,"seq":60129542205,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":377903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.872,"15min":0.89100000000000001},"min":{"1min":0.54100000000000004,"5min":0.247,"15min":0.247},"max":{"1min":1.2250000000000001,"5min":2.113,"15min":2.113},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":0.92900000000000005},"min":{"1min":0.629,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1180000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.89400000000000002,"15min":0.89800000000000002},"min":{"1min":0.58699999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3819999999999999,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0660000000000001,"15min":1.1120000000000001},"min":{"1min":0.71399999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.4730000000000001,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":0.95799999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.2410000000000001,"15min":1.367},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.385,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.079},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.1359999999999999,"15min":1.234},"min":{"1min":0.76400000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.446,"5min":6.2240000000000002,"15min":6.2240000000000002},"last":1.1679999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2689999999999999,"15min":1.306},"min":{"1min":0.89500000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5169999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.413},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2490000000000001,"15min":1.294},"min":{"1min":0.92600000000000005,"5min":0.377,"15min":0.377},"max":{"1min":1.607,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.2270000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.292,"15min":1.3520000000000001},"min":{"1min":0.85399999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.867,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3999999999999999,"15min":1.4730000000000001},"min":{"1min":1.0669999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.631,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.3100000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3680000000000001,"15min":1.4199999999999999},"min":{"1min":1.0089999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8360000000000001,"5min":2.238,"15min":2.238},"last":1.508},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3919999999999999,"15min":1.4359999999999999},"min":{"1min":0.89200000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.752,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.3600000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:14:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.4950000000000001,"15min":1.546},"min":{"1min":1.0449999999999999,"5min":0.624,"15min":0.624},"max":{"1min":1.788,"5min":4.391,"15min":4.391},"last":1.391},{"interface":"front","average":{"1min":1.361,"5min":1.448,"15min":1.506},"min":{"1min":1.0940000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.9099999999999999,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.571}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:15:10.570 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-21T22:15:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.699+0000 7f9dfb59e700 1 Processor -- start 2023-07-21T22:15:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.699+0000 7f9dfb59e700 1 -- start start 2023-07-21T22:15:10.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.703+0000 7f9dfb59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9dfc0d1e40 0x7f9dfc0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:10.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.703+0000 7f9dfb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9dfc0cee10 0x7f9dfc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:10.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.703+0000 7f9dfb59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc0b3e80 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.703+0000 7f9dfb59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc0cf7d0 con 0x7f9dfc0d1e40 2023-07-21T22:15:10.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.703+0000 7f9dfb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc15fd40 con 0x7f9dfc0cee10 2023-07-21T22:15:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.703+0000 7f9dfa59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9dfc0b7af0 0x7f9dfc15f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52716/0 (socket says 172.21.15.49:52716) 2023-07-21T22:15:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.703+0000 7f9dfa59c700 1 -- 172.21.15.49:0/276504339 learned_addr learned my addr 172.21.15.49:0/276504339 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-07-21T22:15:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.703+0000 7f9dfad9d700 1 --2- 172.21.15.49:0/276504339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9dfc0cee10 0x7f9dfc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.703+0000 7f9df9d9b700 1 --2- 172.21.15.49:0/276504339 >> v2:172.21.15.150:3300/0 conn(0x7f9dfc0d1e40 0x7f9dfc0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9df959a700 1 -- 172.21.15.49:0/276504339 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881838644 0 0) 0x7f9dfc0b3e80 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9df959a700 1 -- 172.21.15.49:0/276504339 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9de40035d0 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9dfad9d700 1 -- 172.21.15.49:0/276504339 >> v2:172.21.15.150:3300/0 conn(0x7f9dfc0d1e40 msgr2=0x7f9dfc0b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:15:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9dfad9d700 1 --2- 172.21.15.49:0/276504339 >> v2:172.21.15.150:3300/0 conn(0x7f9dfc0d1e40 0x7f9dfc0b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9dfad9d700 1 -- 172.21.15.49:0/276504339 >> v1:172.21.15.49:6789/0 conn(0x7f9dfc0b7af0 legacy=0x7f9dfc15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:10.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9dfad9d700 1 -- 172.21.15.49:0/276504339 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc0cea00 con 0x7f9dfc0cee10 2023-07-21T22:15:10.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9dfad9d700 1 --2- 172.21.15.49:0/276504339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9dfc0cee10 0x7f9dfc0cf290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009d90 tx=0x7f9df400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5844e103430f36a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:15:10.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9df959a700 1 -- 172.21.15.49:0/276504339 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df400e070 con 0x7f9dfc0cee10 2023-07-21T22:15:10.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9df959a700 1 -- 172.21.15.49:0/276504339 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df400bb20 con 0x7f9dfc0cee10 2023-07-21T22:15:10.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9df959a700 1 -- 172.21.15.49:0/276504339 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4012430 con 0x7f9dfc0cee10 2023-07-21T22:15:10.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9dfb59e700 1 -- 172.21.15.49:0/276504339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9dfc0cee10 msgr2=0x7f9dfc0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:10.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9dfb59e700 1 --2- 172.21.15.49:0/276504339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9dfc0cee10 0x7f9dfc0cf290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009d90 tx=0x7f9df400b330 comp rx=0 tx=0).stop 2023-07-21T22:15:10.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9dfb59e700 1 -- 172.21.15.49:0/276504339 shutdown_connections 2023-07-21T22:15:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9dfb59e700 1 --2- 172.21.15.49:0/276504339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9dfc0cee10 0x7f9dfc0cf290 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9dfb59e700 1 --2- 172.21.15.49:0/276504339 >> v2:172.21.15.150:3300/0 conn(0x7f9dfc0d1e40 0x7f9dfc0b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9dfb59e700 1 -- 172.21.15.49:0/276504339 >> 172.21.15.49:0/276504339 conn(0x7f9dfc06e960 msgr2=0x7f9dfc06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:15:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9dfb59e700 1 -- 172.21.15.49:0/276504339 shutdown_connections 2023-07-21T22:15:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.707+0000 7f9dfb59e700 1 -- 172.21.15.49:0/276504339 wait complete. 2023-07-21T22:15:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.711+0000 7f9dfb59e700 1 Processor -- start 2023-07-21T22:15:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.711+0000 7f9dfb59e700 1 -- start start 2023-07-21T22:15:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.711+0000 7f9dfb59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9dfc0b7af0 0x7f9dfc153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.711+0000 7f9dfb59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dfc0cee10 0x7f9dfc15c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.711+0000 7f9dfb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9dfc0d1e40 0x7f9dfc15b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.711+0000 7f9dfb59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0c8d50 con 0x7f9dfc0cee10 2023-07-21T22:15:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.711+0000 7f9dfb59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0b2be0 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.711+0000 7f9dfb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0b2ec0 con 0x7f9dfc0d1e40 2023-07-21T22:15:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.711+0000 7f9df9d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dfc0cee10 0x7f9dfc15c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.711+0000 7f9dfa59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9dfc0b7af0 0x7f9dfc153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.711+0000 7f9dfa59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9dfc0b7af0 0x7f9dfc153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.49:44698/0 (socket says 172.21.15.49:44698) 2023-07-21T22:15:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.711+0000 7f9dfa59c700 1 -- 172.21.15.49:0/620065910 learned_addr learned my addr 172.21.15.49:0/620065910 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:15:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.711+0000 7f9df9d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dfc0cee10 0x7f9dfc15c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39764/0 (socket says 172.21.15.49:39764) 2023-07-21T22:15:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.711+0000 7f9dfad9d700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9dfc0d1e40 0x7f9dfc15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:10.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.715+0000 7f9dfa59c700 1 -- 172.21.15.49:0/620065910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9dfc0d1e40 msgr2=0x7f9dfc15b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:10.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.715+0000 7f9dfa59c700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9dfc0d1e40 0x7f9dfc15b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.715+0000 7f9dfa59c700 1 -- 172.21.15.49:0/620065910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dfc0cee10 msgr2=0x7f9dfc15c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:10.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.715+0000 7f9dfa59c700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dfc0cee10 0x7f9dfc15c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.715+0000 7f9dfa59c700 1 -- 172.21.15.49:0/620065910 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4009a70 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.715+0000 7f9df9d9b700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dfc0cee10 0x7f9dfc15c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:15:10.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.715+0000 7f9dfad9d700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9dfc0d1e40 0x7f9dfc15b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:15:10.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.715+0000 7f9dfa59c700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9dfc0b7af0 0x7f9dfc153d90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00c4d0 tx=0x7f9dec00c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:15:10.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.715+0000 7f9deaffd700 1 -- 172.21.15.49:0/620065910 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec005d90 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.715+0000 7f9deaffd700 1 -- 172.21.15.49:0/620065910 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec0070d0 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.715+0000 7f9dfb59e700 1 -- 172.21.15.49:0/620065910 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc0c8790 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.715+0000 7f9deaffd700 1 -- 172.21.15.49:0/620065910 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec007480 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.715+0000 7f9dfb59e700 1 -- 172.21.15.49:0/620065910 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc15d800 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.715+0000 7f9dfb59e700 1 -- 172.21.15.49:0/620065910 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc04dcb0 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.719+0000 7f9deaffd700 1 -- 172.21.15.49:0/620065910 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9dec0075e0 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.719+0000 7f9deaffd700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ddc0662f0 0x7f9ddc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:10.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.719+0000 7f9deaffd700 1 -- 172.21.15.49:0/620065910 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f9dec082fe0 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.719+0000 7f9df9d9b700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ddc0662f0 0x7f9ddc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:10.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.719+0000 7f9df9d9b700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ddc0662f0 0x7f9ddc0687a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc1f4390 tx=0x7f9df0009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:15:10.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.727+0000 7f9deaffd700 1 -- 172.21.15.49:0/620065910 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9dec0505a0 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.903+0000 7f9dfb59e700 1 -- 172.21.15.49:0/620065910 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f9dfc0ce570 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.919+0000 7f9deaffd700 1 -- 172.21.15.49:0/620065910 <== mon.1 v2:172.21.15.150:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9dec001250 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.919+0000 7f9deaffd700 1 -- 172.21.15.49:0/620065910 <== mon.1 v2:172.21.15.150:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9dec053bc0 con 0x7f9dfc0b7af0 2023-07-21T22:15:10.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.923+0000 7f9dfb59e700 1 -- 172.21.15.49:0/620065910 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ddc0662f0 msgr2=0x7f9ddc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:10.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.923+0000 7f9dfb59e700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ddc0662f0 0x7f9ddc0687a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc1f4390 tx=0x7f9df0009240 comp rx=0 tx=0).stop 2023-07-21T22:15:10.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.923+0000 7f9dfb59e700 1 -- 172.21.15.49:0/620065910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9dfc0b7af0 msgr2=0x7f9dfc153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:10.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.923+0000 7f9dfb59e700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9dfc0b7af0 0x7f9dfc153d90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00c4d0 tx=0x7f9dec00c7e0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.923+0000 7f9dfb59e700 1 -- 172.21.15.49:0/620065910 shutdown_connections 2023-07-21T22:15:10.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.923+0000 7f9dfb59e700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7f9ddc0662f0 0x7f9ddc0687a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.923+0000 7f9dfb59e700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dfc0cee10 0x7f9dfc15c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.923+0000 7f9dfb59e700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9dfc0d1e40 0x7f9dfc15b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.923+0000 7f9dfb59e700 1 --2- 172.21.15.49:0/620065910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9dfc0b7af0 0x7f9dfc153d90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:10.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.923+0000 7f9dfb59e700 1 -- 172.21.15.49:0/620065910 >> 172.21.15.49:0/620065910 conn(0x7f9dfc06e960 msgr2=0x7f9dfc0d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:15:10.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.923+0000 7f9dfb59e700 1 -- 172.21.15.49:0/620065910 shutdown_connections 2023-07-21T22:15:10.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:10.923+0000 7f9dfb59e700 1 -- 172.21.15.49:0/620065910 wait complete. 2023-07-21T22:15:10.989 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:15:10.990 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:15:11.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.119+0000 7fa33f381700 1 Processor -- start 2023-07-21T22:15:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.119+0000 7fa33f381700 1 -- start start 2023-07-21T22:15:11.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.119+0000 7fa33f381700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3381604c0 0x7fa3380afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:11.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.119+0000 7fa33f381700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3380c8860 0x7fa338070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:11.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.119+0000 7fa33f381700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3380b0530 con 0x7fa3380afc20 2023-07-21T22:15:11.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.119+0000 7fa33f381700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa338163df0 con 0x7fa3380c8860 2023-07-21T22:15:11.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.119+0000 7fa33f381700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3381640d0 con 0x7fa3381604c0 2023-07-21T22:15:11.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33d91e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3380c8860 0x7fa338070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:11.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33d91e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3380c8860 0x7fa338070600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39778/0 (socket says 172.21.15.49:39778) 2023-07-21T22:15:11.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33d91e700 1 -- 172.21.15.49:0/2390233178 learned_addr learned my addr 172.21.15.49:0/2390233178 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:15:11.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33c91c700 1 --2- 172.21.15.49:0/2390233178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3381604c0 0x7fa3380afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:11.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33d91e700 1 -- 172.21.15.49:0/2390233178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3381604c0 msgr2=0x7fa3380afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:15:11.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33d91e700 1 --2- 172.21.15.49:0/2390233178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3381604c0 0x7fa3380afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:11.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33d91e700 1 -- 172.21.15.49:0/2390233178 >> v1:172.21.15.49:6789/0 conn(0x7fa3380afc20 legacy=0x7fa3380cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:11.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33d91e700 1 -- 172.21.15.49:0/2390233178 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3381643b0 con 0x7fa3380c8860 2023-07-21T22:15:11.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa32ffff700 1 -- 172.21.15.49:0/2390233178 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877929713 0 0) 0x7fa3380b0530 con 0x7fa3380afc20 2023-07-21T22:15:11.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33d91e700 1 --2- 172.21.15.49:0/2390233178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380c8860 0x7fa338070600 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa330009e50 tx=0x7fa33000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f849663b549695c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:15:11.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa32ffff700 1 -- 172.21.15.49:0/2390233178 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000e070 con 0x7fa3380c8860 2023-07-21T22:15:11.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa32ffff700 1 -- 172.21.15.49:0/2390233178 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa33000b910 con 0x7fa3380c8860 2023-07-21T22:15:11.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa32ffff700 1 -- 172.21.15.49:0/2390233178 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000bce0 con 0x7fa3380c8860 2023-07-21T22:15:11.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33f381700 1 -- 172.21.15.49:0/2390233178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380c8860 msgr2=0x7fa338070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:11.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33f381700 1 --2- 172.21.15.49:0/2390233178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380c8860 0x7fa338070600 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa330009e50 tx=0x7fa33000b330 comp rx=0 tx=0).stop 2023-07-21T22:15:11.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33f381700 1 -- 172.21.15.49:0/2390233178 shutdown_connections 2023-07-21T22:15:11.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33f381700 1 --2- 172.21.15.49:0/2390233178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380c8860 0x7fa338070600 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:11.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33f381700 1 --2- 172.21.15.49:0/2390233178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3381604c0 0x7fa3380afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:11.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33f381700 1 -- 172.21.15.49:0/2390233178 >> 172.21.15.49:0/2390233178 conn(0x7fa33806f5a0 msgr2=0x7fa3380cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:15:11.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33f381700 1 -- 172.21.15.49:0/2390233178 shutdown_connections 2023-07-21T22:15:11.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.123+0000 7fa33f381700 1 -- 172.21.15.49:0/2390233178 wait complete. 2023-07-21T22:15:11.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.127+0000 7fa33f381700 1 Processor -- start 2023-07-21T22:15:11.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.127+0000 7fa33f381700 1 -- start start 2023-07-21T22:15:11.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.127+0000 7fa33f381700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3380afc20 0x7fa3381f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:11.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.127+0000 7fa33f381700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380c8860 0x7fa3380b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:11.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.127+0000 7fa33f381700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3381604c0 0x7fa33815c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:11.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.127+0000 7fa33f381700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa338161c80 con 0x7fa3380c8860 2023-07-21T22:15:11.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.127+0000 7fa33f381700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380b0fd0 con 0x7fa3380afc20 2023-07-21T22:15:11.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.127+0000 7fa33f381700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3381f6ce0 con 0x7fa3381604c0 2023-07-21T22:15:11.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.127+0000 7fa33c91c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380c8860 0x7fa3380b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:11.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa33c91c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380c8860 0x7fa3380b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39780/0 (socket says 172.21.15.49:39780) 2023-07-21T22:15:11.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa33c91c700 1 -- 172.21.15.49:0/611171859 learned_addr learned my addr 172.21.15.49:0/611171859 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-07-21T22:15:11.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa33d11d700 1 --2- 172.21.15.49:0/611171859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3380afc20 0x7fa3381f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:11.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa33d91e700 1 --2- 172.21.15.49:0/611171859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3381604c0 0x7fa33815c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:11.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa33c91c700 1 -- 172.21.15.49:0/611171859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3381604c0 msgr2=0x7fa33815c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa33c91c700 1 --2- 172.21.15.49:0/611171859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3381604c0 0x7fa33815c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa33c91c700 1 -- 172.21.15.49:0/611171859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3380afc20 msgr2=0x7fa3381f67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa33c91c700 1 --2- 172.21.15.49:0/611171859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3380afc20 0x7fa3381f67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa33c91c700 1 -- 172.21.15.49:0/611171859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330009b30 con 0x7fa3380c8860 2023-07-21T22:15:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa33c91c700 1 --2- 172.21.15.49:0/611171859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380c8860 0x7fa3380b2640 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa32800e840 tx=0x7fa32800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:15:11.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa32dffb700 1 -- 172.21.15.49:0/611171859 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280095a0 con 0x7fa3380c8860 2023-07-21T22:15:11.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa32dffb700 1 -- 172.21.15.49:0/611171859 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa328013680 con 0x7fa3380c8860 2023-07-21T22:15:11.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa32dffb700 1 -- 172.21.15.49:0/611171859 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328013a10 con 0x7fa3380c8860 2023-07-21T22:15:11.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa33f381700 1 -- 172.21.15.49:0/611171859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3381f9810 con 0x7fa3380c8860 2023-07-21T22:15:11.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa33f381700 1 -- 172.21.15.49:0/611171859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3381f9dd0 con 0x7fa3380c8860 2023-07-21T22:15:11.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.131+0000 7fa33f381700 1 -- 172.21.15.49:0/611171859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33804dcb0 con 0x7fa3380c8860 2023-07-21T22:15:11.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.135+0000 7fa32dffb700 1 -- 172.21.15.49:0/611171859 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa328013b70 con 0x7fa3380c8860 2023-07-21T22:15:11.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.135+0000 7fa32dffb700 1 --2- 172.21.15.49:0/611171859 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa31c0662f0 0x7fa31c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:11.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.135+0000 7fa32dffb700 1 -- 172.21.15.49:0/611171859 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fa328083a40 con 0x7fa3380c8860 2023-07-21T22:15:11.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.135+0000 7fa33d11d700 1 --2- 172.21.15.49:0/611171859 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa31c0662f0 0x7fa31c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:11.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.135+0000 7fa33d11d700 1 --2- 172.21.15.49:0/611171859 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa31c0662f0 0x7fa31c0687a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa334007fd0 tx=0x7fa334009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:15:11.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.139+0000 7fa32dffb700 1 -- 172.21.15.49:0/611171859 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa328054a90 con 0x7fa3380c8860 2023-07-21T22:15:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.351+0000 7fa33f381700 1 -- 172.21.15.49:0/611171859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3380c4fe0 con 0x7fa3380c8860 2023-07-21T22:15:11.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.355+0000 7fa32dffb700 1 -- 172.21.15.49:0/611171859 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fa328017de0 con 0x7fa3380c8860 2023-07-21T22:15:11.400 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-07-21T22:15:11.400 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3145882220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3145882220},{"type":"v1","addr":"172.21.15.150:6834","nonce":3145882220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5657,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2809854510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2809854510},{"type":"v1","addr":"172.21.15.150:6835","nonce":2809854510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1044407594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1044407594},{"type":"v1","addr":"172.21.15.49:6837","nonce":1044407594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6933,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1669359288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1669359288},{"type":"v1","addr":"172.21.15.49:6836","nonce":1669359288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[]} 2023-07-21T22:15:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.355+0000 7fa33f381700 1 -- 172.21.15.49:0/611171859 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa31c0662f0 msgr2=0x7fa31c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.355+0000 7fa33f381700 1 --2- 172.21.15.49:0/611171859 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa31c0662f0 0x7fa31c0687a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa334007fd0 tx=0x7fa334009040 comp rx=0 tx=0).stop 2023-07-21T22:15:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.355+0000 7fa33f381700 1 -- 172.21.15.49:0/611171859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380c8860 msgr2=0x7fa3380b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.355+0000 7fa33f381700 1 --2- 172.21.15.49:0/611171859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380c8860 0x7fa3380b2640 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa32800e840 tx=0x7fa32800eb50 comp rx=0 tx=0).stop 2023-07-21T22:15:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.355+0000 7fa33f381700 1 -- 172.21.15.49:0/611171859 shutdown_connections 2023-07-21T22:15:11.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.355+0000 7fa33f381700 1 --2- 172.21.15.49:0/611171859 >> [v2:172.21.15.49:6832/1334330893,v1:172.21.15.49:6833/1334330893] conn(0x7fa31c0662f0 0x7fa31c0687a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:11.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.355+0000 7fa33f381700 1 --2- 172.21.15.49:0/611171859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3380c8860 0x7fa3380b2640 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:11.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.355+0000 7fa33f381700 1 --2- 172.21.15.49:0/611171859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3381604c0 0x7fa33815c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:11.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.355+0000 7fa33f381700 1 --2- 172.21.15.49:0/611171859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3380afc20 0x7fa3381f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:11.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.355+0000 7fa33f381700 1 -- 172.21.15.49:0/611171859 >> 172.21.15.49:0/611171859 conn(0x7fa33806f5a0 msgr2=0x7fa3380ae530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:15:11.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.355+0000 7fa33f381700 1 -- 172.21.15.49:0/611171859 shutdown_connections 2023-07-21T22:15:11.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-07-21T22:15:11.355+0000 7fa33f381700 1 -- 172.21.15.49:0/611171859 wait complete. 2023-07-21T22:15:11.405 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 28 2023-07-21T22:15:11.423 DEBUG:tasks.cephfs.filesystem:already dead... 2023-07-21T22:15:11.423 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-21T22:15:11.424 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T22:15:11.424 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:11.448 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T22:15:11.448 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T22:15:11.448 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:11.515 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T22:15:11.515 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T22:15:11.516 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:11.539 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T22:15:11.540 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T22:15:11.540 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:11.609 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T22:15:11.610 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-21T22:15:11.610 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-21T22:15:11.611 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:15.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-07-21T22:15:17.713 INFO:tasks.ceph.osd.0:Stopped 2023-07-21T22:15:17.714 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-21T22:15:17.714 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:17.807 INFO:tasks.ceph.osd.1:Stopped 2023-07-21T22:15:17.808 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-21T22:15:17.808 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:21.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-07-21T22:15:21.646 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-07-21T22:15:23.910 INFO:tasks.ceph.osd.2:Stopped 2023-07-21T22:15:23.910 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-21T22:15:23.911 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:23.983 INFO:tasks.ceph.osd.3:Stopped 2023-07-21T22:15:23.984 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-21T22:15:23.984 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:24.066 INFO:tasks.ceph.osd.4:Stopped 2023-07-21T22:15:24.067 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-21T22:15:24.067 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:27.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-07-21T22:15:27.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-07-21T22:15:30.169 INFO:tasks.ceph.osd.5:Stopped 2023-07-21T22:15:30.169 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-21T22:15:30.170 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:30.254 INFO:tasks.ceph.osd.6:Stopped 2023-07-21T22:15:30.255 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-21T22:15:30.255 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:30.633 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:15:30.641 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:15:32.857 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-07-21T22:15:32.857 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-07-21T22:15:36.356 INFO:tasks.ceph.osd.7:Stopped 2023-07-21T22:15:36.357 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-21T22:15:36.358 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-21T22:15:36.358 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:36.422 INFO:tasks.ceph.mgr.y:Stopped 2023-07-21T22:15:36.422 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-21T22:15:36.423 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:36.481 INFO:tasks.ceph.mgr.x:Stopped 2023-07-21T22:15:36.482 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-21T22:15:36.482 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-21T22:15:36.482 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:36.519 INFO:tasks.ceph.mon.a:Stopped 2023-07-21T22:15:36.519 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-21T22:15:36.520 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:36.549 INFO:tasks.ceph.mon.b:Stopped 2023-07-21T22:15:36.549 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-21T22:15:36.550 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:15:36.626 INFO:tasks.ceph.mon.c:Stopped 2023-07-21T22:15:36.626 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-21T22:15:36.627 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-21T22:15:36.676 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:15:36.677 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-21T22:15:37.361 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:15:37.362 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-21T22:15:37.800 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:15:37.800 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-21T22:15:37.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-07-21T22:15:38.360 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:15:38.360 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-21T22:15:38.808 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:15:38.808 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-21T22:15:39.210 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:15:39.211 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-21T22:15:39.573 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:15:39.573 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-21T22:15:40.010 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:15:40.010 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-21T22:15:40.378 INFO:tasks.ceph:Archiving mon data... 2023-07-21T22:15:40.379 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719/data/mon.a.tgz 2023-07-21T22:15:40.380 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2023-07-21T22:15:40.398 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.csugfRnT2m 2023-07-21T22:15:40.398 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.csugfRnT2m 2023-07-21T22:15:40.582 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.csugfRnT2m 2023-07-21T22:15:40.682 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.csugfRnT2m is 407KB 2023-07-21T22:15:40.754 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.csugfRnT2m 2023-07-21T22:15:40.772 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719/data/mon.b.tgz 2023-07-21T22:15:40.773 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2023-07-21T22:15:40.790 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.4IAgwoC1ts 2023-07-21T22:15:40.791 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.4IAgwoC1ts 2023-07-21T22:15:40.998 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.4IAgwoC1ts 2023-07-21T22:15:41.092 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.4IAgwoC1ts is 530KB 2023-07-21T22:15:41.125 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.4IAgwoC1ts 2023-07-21T22:15:41.139 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719/data/mon.c.tgz 2023-07-21T22:15:41.140 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2023-07-21T22:15:41.201 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.fy3412oF0y 2023-07-21T22:15:41.202 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.fy3412oF0y 2023-07-21T22:15:41.414 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.fy3412oF0y 2023-07-21T22:15:41.506 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.fy3412oF0y is 530KB 2023-07-21T22:15:41.537 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.fy3412oF0y 2023-07-21T22:15:41.552 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-21T22:15:41.552 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-21T22:15:41.560 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-21T22:15:41.626 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-21T22:15:41.628 DEBUG:teuthology.orchestra.run.smithi049:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-21T22:15:41.638 DEBUG:teuthology.orchestra.run.smithi150:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-21T22:15:41.682 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-21T22:15:41.730 INFO:teuthology.orchestra.run.smithi150.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-21T22:15:41.743 INFO:tasks.ceph:Archiving crash dumps... 2023-07-21T22:15:41.744 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719/remote/smithi049/crash 2023-07-21T22:15:41.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-21T22:15:41.783 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719/remote/smithi150/crash 2023-07-21T22:15:41.784 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-21T22:15:41.820 INFO:tasks.ceph:Shutting down logrotate 2023-07-21T22:15:41.821 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:15:41.838 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:15:41.959 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-21T22:15:41.994 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-21T22:15:42.028 INFO:tasks.ceph:Compressing logs... 2023-07-21T22:15:42.029 DEBUG:teuthology.orchestra.run.smithi049:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-21T22:15:42.046 DEBUG:teuthology.orchestra.run.smithi150:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-21T22:15:42.087 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39822.log 2023-07-21T22:15:42.089 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46860.log 2023-07-21T22:15:42.091 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44504.log 2023-07-21T22:15:42.092 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39822.log.gz 2023-07-21T22:15:42.093 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40338.log 2023-07-21T22:15:42.094 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46860.log.gz 2023-07-21T22:15:42.095 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46365.log 2023-07-21T22:15:42.096 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44504.log.gz 2023-07-21T22:15:42.097 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38654.log 2023-07-21T22:15:42.097 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40338.log.gz 2023-07-21T22:15:42.098 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46365.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46365.log.gz 2023-07-21T22:15:42.099 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46338.log 2023-07-21T22:15:42.100 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44080.log 2023-07-21T22:15:42.101 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38654.log.gz 2023-07-21T22:15:42.102 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46338.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46338.log.gz 2023-07-21T22:15:42.102 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40526.log 2023-07-21T22:15:42.105 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48152.log 2023-07-21T22:15:42.105 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44080.log.gz 2023-07-21T22:15:42.106 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40526.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40526.log.gz 2023-07-21T22:15:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48098.log 2023-07-21T22:15:42.108 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41120.log 2023-07-21T22:15:42.109 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48152.log.gz 2023-07-21T22:15:42.109 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48098.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48098.log.gz 2023-07-21T22:15:42.110 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47173.log 2023-07-21T22:15:42.112 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41120.log: gzip 88.6%-5 -- replaced with /var/log/ceph/ceph-client.admin.41120.log.gz--verbose 2023-07-21T22:15:42.113 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.49438.log 2023-07-21T22:15:42.113 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47173.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47173.log.gz 2023-07-21T22:15:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44296.log 2023-07-21T22:15:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40331.log 2023-07-21T22:15:42.115 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49438.log.gz 2023-07-21T22:15:42.117 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44296.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44296.log.gz 2023-07-21T22:15:42.117 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47907.log 2023-07-21T22:15:42.118 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-07-21T22:15:42.119 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-07-21T22:15:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40331.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40331.log.gz 2023-07-21T22:15:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39516.log 2023-07-21T22:15:42.120 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35090.log 2023-07-21T22:15:42.121 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41439.log 2023-07-21T22:15:42.121 INFO:teuthology.orchestra.run.smithi049.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47907.log.gz 2023-07-21T22:15:42.122 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39516.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39516.log.gz 2023-07-21T22:15:42.122 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35008.log 2023-07-21T22:15:42.122 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47679.log 2023-07-21T22:15:42.123 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34980.log 2023-07-21T22:15:42.124 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.41439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42881.log 2023-07-21T22:15:42.124 INFO:teuthology.orchestra.run.smithi049.stderr: 91.1%/var/log/ceph/ceph-client.admin.47679.log: -- replaced with /var/log/ceph/ceph-client.0.41439.log.gz 2023-07-21T22:15:42.125 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.35090.log: /var/log/ceph/ceph-client.admin.35008.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35008.log.gz 2023-07-21T22:15:42.126 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47679.log.gz 2023-07-21T22:15:42.126 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-07-21T22:15:42.127 INFO:teuthology.orchestra.run.smithi150.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35090.log.gz 2023-07-21T22:15:42.127 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-07-21T22:15:42.127 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.34980.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34980.log.gz 2023-07-21T22:15:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42881.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42881.log.gz 2023-07-21T22:15:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44896.log 2023-07-21T22:15:42.129 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-07-21T22:15:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49880.log 2023-07-21T22:15:42.130 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-07-21T22:15:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44896.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44896.log.gz 2023-07-21T22:15:42.132 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40850.log 2023-07-21T22:15:42.133 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35144.log 2023-07-21T22:15:42.134 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49880.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49880.log.gz 2023-07-21T22:15:42.134 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41618.log 2023-07-21T22:15:42.135 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40850.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40850.log.gz 2023-07-21T22:15:42.135 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-21T22:15:42.136 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43972.log 2023-07-21T22:15:42.136 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41618.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41618.log.gz 2023-07-21T22:15:42.137 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41678.log 2023-07-21T22:15:42.138 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.35144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35035.log 2023-07-21T22:15:42.138 INFO:teuthology.orchestra.run.smithi150.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35144.log.gz 2023-07-21T22:15:42.139 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43972.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43972.log.gz 2023-07-21T22:15:42.139 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42389.log 2023-07-21T22:15:42.140 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.40481.log 93.8% 2023-07-21T22:15:42.141 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-07-21T22:15:42.141 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41678.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41678.log.gz 2023-07-21T22:15:42.141 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48445.log 2023-07-21T22:15:42.142 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.35035.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-07-21T22:15:42.142 INFO:teuthology.orchestra.run.smithi150.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35035.log.gz 2023-07-21T22:15:42.143 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42389.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42389.log.gz 2023-07-21T22:15:42.143 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46919.log 2023-07-21T22:15:42.143 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48445.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48445.log.gz 2023-07-21T22:15:42.144 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45600.log 2023-07-21T22:15:42.145 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.3.40481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34954.log 2023-07-21T22:15:42.145 INFO:teuthology.orchestra.run.smithi150.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-21T22:15:42.145 INFO:teuthology.orchestra.run.smithi150.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.3.40481.log.gz 2023-07-21T22:15:42.145 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35063.log 2023-07-21T22:15:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46919.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.46919.log.gz 2023-07-21T22:15:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.46833.log 2023-07-21T22:15:42.147 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.34954.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-07-21T22:15:42.147 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34954.log.gz 2023-07-21T22:15:42.147 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.35063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40366.log 2023-07-21T22:15:42.148 INFO:teuthology.orchestra.run.smithi150.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35063.log.gz 2023-07-21T22:15:42.148 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47706.log 2023-07-21T22:15:42.149 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45600.log.gz 2023-07-21T22:15:42.150 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35117.log 2023-07-21T22:15:42.150 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46833.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46833.log.gz 2023-07-21T22:15:42.150 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50133.log 2023-07-21T22:15:42.152 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.1.40366.log: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-21T22:15:42.152 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-07-21T22:15:42.152 INFO:teuthology.orchestra.run.smithi150.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.1.40366.log.gz 2023-07-21T22:15:42.152 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.35117.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-07-21T22:15:42.154 INFO:teuthology.orchestra.run.smithi150.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35117.log.gz 2023-07-21T22:15:42.154 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-07-21T22:15:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49212.log 2023-07-21T22:15:42.154 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47706.log.gz 2023-07-21T22:15:42.155 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50133.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50133.log.gz 2023-07-21T22:15:42.155 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43999.log 2023-07-21T22:15:42.155 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50268.log 2023-07-21T22:15:42.157 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-osd.7.log: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-21T22:15:42.157 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49212.log.gz 2023-07-21T22:15:42.157 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46697.log 2023-07-21T22:15:42.157 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43999.log.gz 2023-07-21T22:15:42.158 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40552.log 2023-07-21T22:15:42.159 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50268.log.gz 2023-07-21T22:15:42.160 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46697.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46697.log.gz 2023-07-21T22:15:42.160 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40013.log 2023-07-21T22:15:42.161 INFO:teuthology.orchestra.run.smithi150.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-07-21T22:15:42.162 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40552.log: gzip 88.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.40552.log.gz--verbose 2023-07-21T22:15:42.162 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.42328.log 2023-07-21T22:15:42.163 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40013.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-07-21T22:15:42.163 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40013.log.gz 2023-07-21T22:15:42.164 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44161.log 2023-07-21T22:15:42.165 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42328.log.gz 2023-07-21T22:15:42.166 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42058.log 2023-07-21T22:15:42.168 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50295.log 2023-07-21T22:15:42.168 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44161.log.gz 2023-07-21T22:15:42.169 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42058.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42058.log.gz 2023-07-21T22:15:42.170 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42193.log 2023-07-21T22:15:42.171 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43565.log 2023-07-21T22:15:42.172 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50295.log.gz 2023-07-21T22:15:42.173 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42193.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42193.log.gz 2023-07-21T22:15:42.174 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42301.log 2023-07-21T22:15:42.175 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48609.log 2023-07-21T22:15:42.176 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43565.log.gz 2023-07-21T22:15:42.177 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42301.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42301.log.gz 2023-07-21T22:15:42.177 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46230.log 2023-07-21T22:15:42.179 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48017.log 2023-07-21T22:15:42.179 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48609.log.gz 2023-07-21T22:15:42.180 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46230.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46230.log.gz 2023-07-21T22:15:42.180 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39014.log 2023-07-21T22:15:42.182 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50187.log 87.7% 2023-07-21T22:15:42.182 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48017.log.gz 2023-07-21T22:15:42.183 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40318.log 2023-07-21T22:15:42.183 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39014.log.gz 2023-07-21T22:15:42.184 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39122.log 2023-07-21T22:15:42.184 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50187.log.gz 2023-07-21T22:15:42.185 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40318.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40318.log.gz 2023-07-21T22:15:42.186 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45377.log 2023-07-21T22:15:42.187 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39122.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39122.log.gz 2023-07-21T22:15:42.187 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43702.log 2023-07-21T22:15:42.188 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-07-21T22:15:42.188 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46147.log 2023-07-21T22:15:42.189 INFO:teuthology.orchestra.run.smithi049.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45377.log.gz 2023-07-21T22:15:42.190 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43702.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43702.log.gzgzip 2023-07-21T22:15:42.190 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.43592.log 2023-07-21T22:15:42.191 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46147.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-07-21T22:15:42.192 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46147.log.gz 2023-07-21T22:15:42.192 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43592.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43592.log.gz 2023-07-21T22:15:42.193 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42112.log 2023-07-21T22:15:42.193 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45763.log 2023-07-21T22:15:42.195 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49022.log 2023-07-21T22:15:42.195 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42112.log.gz 2023-07-21T22:15:42.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45763.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45763.log.gz 2023-07-21T22:15:42.197 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42908.log 2023-07-21T22:15:42.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49022.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49022.log.gz 2023-07-21T22:15:42.198 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45736.log 2023-07-21T22:15:42.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42908.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42908.log.gz 2023-07-21T22:15:42.200 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40742.log 2023-07-21T22:15:42.201 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47410.log 88.7% 2023-07-21T22:15:42.202 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45736.log.gz 2023-07-21T22:15:42.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41012.log 2023-07-21T22:15:42.203 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40742.log.gz 2023-07-21T22:15:42.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47410.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47410.log.gz 2023-07-21T22:15:42.205 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50376.log 2023-07-21T22:15:42.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43370.log 2023-07-21T22:15:42.206 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41012.log.gz 2023-07-21T22:15:42.207 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50376.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50376.log.gz 2023-07-21T22:15:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39905.log 2023-07-21T22:15:42.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44666.log 2023-07-21T22:15:42.209 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43370.log.gz 2023-07-21T22:15:42.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50511.log 2023-07-21T22:15:42.210 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39905.log.gz 2023-07-21T22:15:42.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44666.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44666.log.gz 2023-07-21T22:15:42.212 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49158.log 2023-07-21T22:15:42.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40541.log 2023-07-21T22:15:42.213 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50511.log.gz 2023-07-21T22:15:42.214 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49158.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49158.log.gz 2023-07-21T22:15:42.214 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48044.log 2023-07-21T22:15:42.215 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41869.log 2023-07-21T22:15:42.215 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40541.log.gz 2023-07-21T22:15:42.216 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42773.log 2023-07-21T22:15:42.217 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48044.log.gz 2023-07-21T22:15:42.217 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41869.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.41869.log.gz 2023-07-21T22:15:42.218 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.50079.log 2023-07-21T22:15:42.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42773.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42773.log.gz 2023-07-21T22:15:42.219 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-07-21T22:15:42.220 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44977.log 2023-07-21T22:15:42.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46203.log 2023-07-21T22:15:42.221 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50079.log.gz 2023-07-21T22:15:42.222 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45681.log 2023-07-21T22:15:42.222 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44977.log.gz 2023-07-21T22:15:42.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46203.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46203.log.gz 2023-07-21T22:15:42.223 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47119.log 2023-07-21T22:15:42.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45681.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45681.log.gz 2023-07-21T22:15:42.225 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43234.log 2023-07-21T22:15:42.226 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38931.log 2023-07-21T22:15:42.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47119.log: /var/log/ceph/ceph-client.admin.43234.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47119.log.gz 2023-07-21T22:15:42.227 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48499.log 2023-07-21T22:15:42.227 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43234.log.gz 2023-07-21T22:15:42.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39149.log 2023-07-21T22:15:42.229 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48499.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38931.log.gz 2023-07-21T22:15:42.229 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48499.log.gz 2023-07-21T22:15:42.230 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41039.log 2023-07-21T22:15:42.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49608.log 2023-07-21T22:15:42.232 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39149.log.gz 2023-07-21T22:15:42.233 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41039.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41039.log.gz 2023-07-21T22:15:42.233 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46957.log 2023-07-21T22:15:42.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49185.log 2023-07-21T22:15:42.235 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49608.log.gz 2023-07-21T22:15:42.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46957.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46957.log.gz 2023-07-21T22:15:42.236 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45112.log 2023-07-21T22:15:42.238 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44215.log 2023-07-21T22:15:42.238 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49185.log.gz 2023-07-21T22:15:42.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45112.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45112.log.gz 2023-07-21T22:15:42.239 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40823.log 2023-07-21T22:15:42.240 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49492.log 2023-07-21T22:15:42.241 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44215.log.gz 2023-07-21T22:15:42.241 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40823.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40823.log.gz 2023-07-21T22:15:42.242 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39706.log 2023-07-21T22:15:42.243 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49492.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49492.log.gz 2023-07-21T22:15:42.243 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40337.log 2023-07-21T22:15:42.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39706.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39706.log.gz 2023-07-21T22:15:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40113.log 2023-07-21T22:15:42.246 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38434.log 2023-07-21T22:15:42.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40113.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40337.log.gz 2023-07-21T22:15:42.248 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40113.log.gz 2023-07-21T22:15:42.248 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45573.log 2023-07-21T22:15:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38434.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-07-21T22:15:42.251 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38434.log.gz 2023-07-21T22:15:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45573.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45573.log.gz 2023-07-21T22:15:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41645.log 2023-07-21T22:15:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42606.log 2023-07-21T22:15:42.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47227.log 2023-07-21T22:15:42.256 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41645.log.gz 2023-07-21T22:15:42.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42606.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42606.log.gz 2023-07-21T22:15:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45195.log 2023-07-21T22:15:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43288.log 2023-07-21T22:15:42.259 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47227.log.gz 2023-07-21T22:15:42.261 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45195.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45195.log.gz 2023-07-21T22:15:42.262 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44693.log 2023-07-21T22:15:42.263 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47281.log 2023-07-21T22:15:42.263 INFO:teuthology.orchestra.run.smithi049.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43288.log.gz 2023-07-21T22:15:42.264 INFO:teuthology.orchestra.run.smithi150.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-07-21T22:15:42.265 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44693.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44693.log.gz 2023-07-21T22:15:42.265 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49581.log 2023-07-21T22:15:42.266 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40040.log 2023-07-21T22:15:42.267 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47281.log: /var/log/ceph/ceph-client.admin.49581.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49581.log.gz 2023-07-21T22:15:42.268 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39878.log 2023-07-21T22:15:42.268 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47281.log.gz 2023-07-21T22:15:42.269 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38738.log 2023-07-21T22:15:42.269 INFO:teuthology.orchestra.run.smithi049.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40040.log.gz 2023-07-21T22:15:42.270 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39878.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39878.log.gz 2023-07-21T22:15:42.270 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47518.log 2023-07-21T22:15:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40122.log 2023-07-21T22:15:42.272 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38738.log.gz 2023-07-21T22:15:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47518.log: gzip -5 88.3%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.47518.log.gz 2023-07-21T22:15:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44475.log 2023-07-21T22:15:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40122.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40122.log.gz 2023-07-21T22:15:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40325.log 2023-07-21T22:15:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44475.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44475.log.gz 2023-07-21T22:15:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39625.log 2023-07-21T22:15:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40769.log 2023-07-21T22:15:42.279 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40325.log.gz 2023-07-21T22:15:42.280 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39625.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39625.log.gz 2023-07-21T22:15:42.280 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42854.log 2023-07-21T22:15:42.280 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46284.log 2023-07-21T22:15:42.281 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40769.log.gz 2023-07-21T22:15:42.282 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42854.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42854.log.gz 2023-07-21T22:15:42.283 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48071.log 2023-07-21T22:15:42.283 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43945.log 2023-07-21T22:15:42.284 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46284.log: /var/log/ceph/ceph-client.admin.48071.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46284.log.gz 2023-07-21T22:15:42.285 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48071.log.gz 2023-07-21T22:15:42.285 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48260.log 2023-07-21T22:15:42.287 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50050.log 2023-07-21T22:15:42.288 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43945.log.gz 2023-07-21T22:15:42.288 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43619.log 2023-07-21T22:15:42.288 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48260.log.gz 2023-07-21T22:15:42.290 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50050.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50050.log.gz 2023-07-21T22:15:42.290 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43207.log 2023-07-21T22:15:42.291 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43619.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43619.log.gz 2023-07-21T22:15:42.291 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45004.log 2023-07-21T22:15:42.293 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40538.log 2023-07-21T22:15:42.293 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43207.log.gz 2023-07-21T22:15:42.294 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45004.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45004.log.gz 2023-07-21T22:15:42.294 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34735.log 2023-07-21T22:15:42.295 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40538.log: gzip -5 88.6%--verbose -- replaced with /var/log/ceph/ceph-client.admin.40538.log.gz 2023-07-21T22:15:42.296 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.44720.log 2023-07-21T22:15:42.296 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34735.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34735.log.gz 2023-07-21T22:15:42.298 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44950.log 2023-07-21T22:15:42.298 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45406.log 2023-07-21T22:15:42.298 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44720.log.gz 2023-07-21T22:15:42.300 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38846.log 2023-07-21T22:15:42.301 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44950.log.gz 2023-07-21T22:15:42.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48717.log 2023-07-21T22:15:42.302 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45406.log.gz 2023-07-21T22:15:42.303 INFO:teuthology.orchestra.run.smithi150.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-07-21T22:15:42.305 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38846.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38846.log.gzgzip 2023-07-21T22:15:42.305 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.40931.log 2023-07-21T22:15:42.305 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45844.log 2023-07-21T22:15:42.306 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48717.log.gz 2023-07-21T22:15:42.306 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48472.log 2023-07-21T22:15:42.307 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40931.log.gz 2023-07-21T22:15:42.307 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45844.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45844.log.gz 2023-07-21T22:15:42.309 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45058.log 2023-07-21T22:15:42.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48472.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48472.log.gz 2023-07-21T22:15:42.310 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46257.log 2023-07-21T22:15:42.310 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44269.log 2023-07-21T22:15:42.311 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45058.log.gz 2023-07-21T22:15:42.312 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46257.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46257.log.gz 2023-07-21T22:15:42.313 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42470.log 2023-07-21T22:15:42.313 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50677.log 2023-07-21T22:15:42.313 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44269.log.gz 2023-07-21T22:15:42.315 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41788.log 2023-07-21T22:15:42.316 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42470.log.gz 2023-07-21T22:15:42.316 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50677.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50677.log.gz 2023-07-21T22:15:42.316 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48690.log 2023-07-21T22:15:42.319 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50241.log 2023-07-21T22:15:42.319 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41788.log.gz 2023-07-21T22:15:42.319 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48690.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48690.log.gz 2023-07-21T22:15:42.320 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47437.log 2023-07-21T22:15:42.320 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45903.log 2023-07-21T22:15:42.321 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50241.log.gz 2023-07-21T22:15:42.324 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47437.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47437.log.gz 2023-07-21T22:15:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49384.log 2023-07-21T22:15:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45903.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-07-21T22:15:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44107.log 2023-07-21T22:15:42.326 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45903.log.gz 2023-07-21T22:15:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50430.log 2023-07-21T22:15:42.326 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49384.log.gz 2023-07-21T22:15:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47585.log 2023-07-21T22:15:42.327 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44107.log.gz 2023-07-21T22:15:42.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50430.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50430.log.gz 2023-07-21T22:15:42.328 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41950.log 2023-07-21T22:15:42.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47585.log: gzip 88.7%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.47585.log.gz-- 2023-07-21T22:15:42.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.audit.log 2023-07-21T22:15:42.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41950.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41950.log.gz 2023-07-21T22:15:42.329 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40958.log 2023-07-21T22:15:42.330 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44134.log 2023-07-21T22:15:42.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.40958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49411.log 2023-07-21T22:15:42.331 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40958.log.gz 2023-07-21T22:15:42.331 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49635.log 2023-07-21T22:15:42.332 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44134.log.gz 2023-07-21T22:15:42.333 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49411.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-21T22:15:42.333 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49411.log.gz 2023-07-21T22:15:42.333 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42551.log 2023-07-21T22:15:42.334 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42247.log 2023-07-21T22:15:42.334 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49635.log.gz 2023-07-21T22:15:42.335 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42551.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42551.log.gz 2023-07-21T22:15:42.335 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49716.log 2023-07-21T22:15:42.336 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42247.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42247.log.gz 2023-07-21T22:15:42.337 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46535.log 2023-07-21T22:15:42.338 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49716.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49716.log.gz 2023-07-21T22:15:42.338 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44350.log 2023-07-21T22:15:42.339 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46535.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.46535.log.gz 2023-07-21T22:15:42.339 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.44585.log 2023-07-21T22:15:42.340 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44350.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44350.log.gz 2023-07-21T22:15:42.340 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40120.log 2023-07-21T22:15:42.341 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44585.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44585.log.gz 2023-07-21T22:15:42.342 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45031.log 2023-07-21T22:15:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40120.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40120.log.gz 2023-07-21T22:15:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38765.log 2023-07-21T22:15:42.344 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45031.log: gzip -5 --verbose 87.7%-- -- replaced with /var/log/ceph/ceph-client.admin.45031.log.gz 2023-07-21T22:15:42.344 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47963.log 2023-07-21T22:15:42.345 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38765.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38765.log.gz 2023-07-21T22:15:42.345 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48367.log 2023-07-21T22:15:42.346 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45519.log 2023-07-21T22:15:42.347 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47963.log.gz 2023-07-21T22:15:42.348 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.48367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44383.log 2023-07-21T22:15:42.348 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45519.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.48367.log.gz 2023-07-21T22:15:42.349 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45519.log.gz 2023-07-21T22:15:42.349 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39851.log 2023-07-21T22:15:42.351 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42579.log 2023-07-21T22:15:42.352 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39851.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44383.log.gz 2023-07-21T22:15:42.352 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39851.log.gz 2023-07-21T22:15:42.353 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49465.log 2023-07-21T22:15:42.354 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40109.log 2023-07-21T22:15:42.354 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42579.log.gz 2023-07-21T22:15:42.355 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49465.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49465.log.gz 2023-07-21T22:15:42.356 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42443.log 2023-07-21T22:15:42.358 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40109.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.40109.log.gz 2023-07-21T22:15:42.358 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2023-07-21T22:15:42.359 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44053.log 2023-07-21T22:15:42.359 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42443.log.gz 2023-07-21T22:15:42.360 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46887.log: gzip -5 88.6%--verbose -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz-- 2023-07-21T22:15:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47200.log 2023-07-21T22:15:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40877.log 2023-07-21T22:15:42.363 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44053.log.gz 2023-07-21T22:15:42.364 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47200.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47200.log.gz 2023-07-21T22:15:42.365 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39408.log 2023-07-21T22:15:42.367 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46120.log 2023-07-21T22:15:42.367 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40877.log.gz 2023-07-21T22:15:42.368 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49853.log 2023-07-21T22:15:42.368 INFO:teuthology.orchestra.run.smithi049.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39408.log.gz 2023-07-21T22:15:42.369 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46120.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46120.log.gz 2023-07-21T22:15:42.370 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41896.log 2023-07-21T22:15:42.371 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40119.log 2023-07-21T22:15:42.372 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49853.log.gz 2023-07-21T22:15:42.372 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41896.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41896.log.gz 2023-07-21T22:15:42.372 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46174.log 2023-07-21T22:15:42.373 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40119.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40119.log.gz 2023-07-21T22:15:42.373 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46643.log 2023-07-21T22:15:42.374 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40336.log 2023-07-21T22:15:42.376 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46174.log: /var/log/ceph/ceph-client.admin.46643.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46174.log.gz 2023-07-21T22:15:42.376 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46643.log.gz 2023-07-21T22:15:42.376 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49300.log 2023-07-21T22:15:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38502.log 2023-07-21T22:15:42.378 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40336.log.gz 2023-07-21T22:15:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.49300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43097.log 2023-07-21T22:15:42.380 INFO:teuthology.orchestra.run.smithi049.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.49300.log.gz 2023-07-21T22:15:42.381 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46039.log 2023-07-21T22:15:42.381 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38502.log.gz 2023-07-21T22:15:42.382 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43097.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43097.log.gz 2023-07-21T22:15:42.382 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41759.log 2023-07-21T22:15:42.383 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44639.log 2023-07-21T22:15:42.384 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46039.log.gz 2023-07-21T22:15:42.385 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41759.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41759.log.gz 2023-07-21T22:15:42.385 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42741.log 2023-07-21T22:15:42.386 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42524.log 2023-07-21T22:15:42.386 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44639.log.gz 2023-07-21T22:15:42.387 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42741.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42741.log.gz 2023-07-21T22:15:42.388 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49519.log 2023-07-21T22:15:42.389 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42524.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42524.log.gz 2023-07-21T22:15:42.390 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46012.log 2023-07-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49519.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49519.log.gz 2023-07-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43315.log 2023-07-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41842.log 2023-07-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46012.log.gz 2023-07-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43315.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43315.log.gz 2023-07-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38528.log 2023-07-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39932.log 2023-07-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41842.log.gz 2023-07-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38528.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38528.log.gz 2023-07-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47880.log 2023-07-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41482.log 2023-07-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39932.log.gz 2023-07-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47816.log 2023-07-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47880.log.gz 2023-07-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41482.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41482.log.gz 2023-07-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40067.log 2023-07-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47816.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47816.log.gz 2023-07-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48417.log 2023-07-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40067.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40067.log.gz 2023-07-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45959.log 2023-07-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48417.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48417.log.gz 2023-07-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43837.log 2023-07-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.45959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39760.log 2023-07-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43837.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.45959.log.gz 2023-07-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43837.log.gz 2023-07-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45085.log 2023-07-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39760.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39760.log.gz 2023-07-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38958.log 2023-07-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41705.log 2023-07-21T22:15:42.412 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50403.log /var/log/ceph/ceph-client.admin.38958.log: 2023-07-21T22:15:42.412 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45085.log.gz 2023-07-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38958.log.gz 2023-07-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41705.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41705.log.gz 2023-07-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38711.log 2023-07-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50403.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50403.log.gz 2023-07-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46482.log 2023-07-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42989.log 2023-07-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38711.log.gz 2023-07-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.46482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42827.log 2023-07-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42989.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-07-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi049.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.46482.log.gz 2023-07-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42827.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42989.log.gz 2023-07-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42827.log.gz 2023-07-21T22:15:42.421 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41147.log 2023-07-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43864.log 2023-07-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41147.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41147.log.gz 2023-07-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46562.log 2023-07-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47652.log 2023-07-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43864.log.gz 2023-07-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46562.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46562.log.gz 2023-07-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46399.log 2023-07-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43538.log 2023-07-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47652.log.gz 2023-07-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46399.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46399.log.gz 2023-07-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41317.log 2023-07-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39227.log 2023-07-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43538.log.gz 2023-07-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41317.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.41317.log.gz 2023-07-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43506.log 2023-07-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38904.log 2023-07-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39227.log.gz 2023-07-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43506.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43506.log.gz 2023-07-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29924.log 2023-07-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38904.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38904.log.gz 2023-07-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39489.log 2023-07-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43016.log 2023-07-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.tmp-client.admin.29924.log: /var/log/ceph/ceph-client.admin.39489.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29924.log.gz 2023-07-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39489.log.gz 2023-07-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39435.log 2023-07-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41174.log 2023-07-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43016.log.gz 2023-07-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39435.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39435.log.gz 2023-07-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34972.log 2023-07-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41201.log 2023-07-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41174.log.gz 2023-07-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34972.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34972.log.gz 2023-07-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48744.log 2023-07-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50625.log 2023-07-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41201.log.gz 2023-07-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48744.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48744.log.gz 2023-07-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39354.log 2023-07-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45627.log 2023-07-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50625.log.gz 2023-07-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43124.log 2023-07-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45627.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.39354.log.gz 2023-07-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41255.log 2023-07-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45627.log.gz 2023-07-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45491.log 2023-07-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43124.log.gz 2023-07-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44776.log 2023-07-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi049.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41255.log.gz 2023-07-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45491.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45491.log.gz 2023-07-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46779.log 2023-07-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44776.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44776.log.gz 2023-07-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.41575.log 2023-07-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46779.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46779.log.gz 2023-07-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45273.log 2023-07-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.2.41575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50592.log 2023-07-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi049.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.2.41575.log.gz 2023-07-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49743.log 2023-07-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45273.log.gz 2023-07-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50592.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50592.log.gz 2023-07-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42497.log 2023-07-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39462.log 2023-07-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49743.log.gz 2023-07-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43451.log 2023-07-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42497.log.gz 2023-07-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39679.log 2023-07-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39462.log.gz 2023-07-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43451.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43451.log.gz 2023-07-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44869.log 2023-07-21T22:15:42.470 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48913.log 2023-07-21T22:15:42.470 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39679.log.gz 2023-07-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44869.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.44869.log.gz-5 2023-07-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:--verbose -- /var/log/ceph/ceph-client.admin.42714.log 2023-07-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48967.log 2023-07-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48913.log.gz 2023-07-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42714.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42714.log.gz 2023-07-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40121.log 2023-07-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47845.log 2023-07-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48967.log.gz 2023-07-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40121.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40121.log.gz 2023-07-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48311.log 2023-07-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47990.log 2023-07-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47845.log.gz 2023-07-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48311.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48311.log.gz 2023-07-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48834.log 2023-07-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47990.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47990.log.gz 2023-07-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46589.log 2023-07-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.48834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39795.log 2023-07-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46589.log: 90.2% -- replaced with /var/log/ceph/ceph-client.0.48834.log.gz 2023-07-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46589.log.gz 2023-07-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46426.log 2023-07-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39795.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39795.log.gz 2023-07-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48636.log 2023-07-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46426.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46426.log.gz 2023-07-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46806.log 2023-07-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48636.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48636.log.gz 2023-07-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49797.log 2023-07-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46806.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46806.log.gz 2023-07-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41228.log 2023-07-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49797.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49797.log.gz 2023-07-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44448.log 2023-07-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41228.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41228.log.gz 2023-07-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43891.log 2023-07-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44448.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44448.log.gz 2023-07-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47760.log 2023-07-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43891.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43891.log.gz 2023-07-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45790.log 2023-07-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47760.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47760.log.gz 2023-07-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-07-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43153.log 2023-07-21T22:15:42.495 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45790.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45790.log.gz 2023-07-21T22:15:42.495 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47038.log 2023-07-21T22:15:42.496 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43675.log 2023-07-21T22:15:42.496 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43153.log.gz 2023-07-21T22:15:42.497 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47038.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47038.log.gz 2023-07-21T22:15:42.497 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50322.log 2023-07-21T22:15:42.498 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43675.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43675.log.gz 2023-07-21T22:15:42.498 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48553.log 2023-07-21T22:15:42.499 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50322.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50322.log.gz 2023-07-21T22:15:42.500 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45871.log 2023-07-21T22:15:42.501 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49662.log 2023-07-21T22:15:42.502 INFO:teuthology.orchestra.run.smithi049.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48553.log.gz 2023-07-21T22:15:42.503 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45871.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45871.log.gz 2023-07-21T22:15:42.504 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47146.log 2023-07-21T22:15:42.504 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47552.log 2023-07-21T22:15:42.505 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49662.log.gz 2023-07-21T22:15:42.506 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47146.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47146.log.gz 2023-07-21T22:15:42.506 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40904.log 2023-07-21T22:15:42.507 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47552.log: gzip -5 --verbose -- 89.2%/var/log/ceph/ceph-client.admin.47308.log 2023-07-21T22:15:42.508 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47552.log.gz 2023-07-21T22:15:42.509 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40904.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40904.log.gzgzip 2023-07-21T22:15:42.509 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.45433.log 2023-07-21T22:15:42.510 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49826.log 2023-07-21T22:15:42.511 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47308.log: /var/log/ceph/ceph-client.admin.45433.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47308.log.gz 2023-07-21T22:15:42.512 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45433.log.gz 2023-07-21T22:15:42.513 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47354.log 2023-07-21T22:15:42.513 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49826.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49826.log.gz 2023-07-21T22:15:42.514 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44923.log 2023-07-21T22:15:42.515 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47354.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47354.log.gz 2023-07-21T22:15:42.516 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42085.log 2023-07-21T22:15:42.517 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44923.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44923.log.gz 2023-07-21T22:15:42.517 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44323.log 2023-07-21T22:15:42.518 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38588.log 2023-07-21T22:15:42.519 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42085.log.gz 2023-07-21T22:15:42.520 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44323.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44323.log.gz 2023-07-21T22:15:42.520 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50457.log 2023-07-21T22:15:42.521 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49926.log 2023-07-21T22:15:42.521 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38588.log.gz 2023-07-21T22:15:42.522 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43810.log 2023-07-21T22:15:42.522 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50457.log.gz 2023-07-21T22:15:42.523 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39041.log 2023-07-21T22:15:42.523 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49926.log.gz 2023-07-21T22:15:42.524 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43810.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43810.log.gz 2023-07-21T22:15:42.525 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38683.log 2023-07-21T22:15:42.526 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42416.log 2023-07-21T22:15:42.526 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38683.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39041.log.gz 2023-07-21T22:15:42.527 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38683.log.gz 2023-07-21T22:15:42.527 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40114.log 2023-07-21T22:15:42.529 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44612.log 2023-07-21T22:15:42.529 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42416.log.gz 2023-07-21T22:15:42.530 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40114.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40114.log.gz 2023-07-21T22:15:42.531 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45546.log 2023-07-21T22:15:42.532 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42166.log 2023-07-21T22:15:42.532 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44612.log.gz 2023-07-21T22:15:42.533 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48125.log 2023-07-21T22:15:42.534 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45546.log.gz 2023-07-21T22:15:42.534 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42166.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42166.log.gz 2023-07-21T22:15:42.535 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46725.log 2023-07-21T22:15:42.537 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48125.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48125.log.gz 2023-07-21T22:15:42.537 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42355.log 2023-07-21T22:15:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47787.log 2023-07-21T22:15:42.539 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46725.log.gz 2023-07-21T22:15:42.540 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42355.log: gzip -5 87.6%--verbose -- replaced with /var/log/ceph/ceph-client.admin.42355.log.gz-- 2023-07-21T22:15:42.540 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43783.log 2023-07-21T22:15:42.542 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46984.log 2023-07-21T22:15:42.542 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47787.log.gz 2023-07-21T22:15:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43783.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43783.log.gz 2023-07-21T22:15:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47254.log 2023-07-21T22:15:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39068.log 2023-07-21T22:15:42.545 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46984.log.gz 2023-07-21T22:15:42.545 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47254.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47254.log.gz 2023-07-21T22:15:42.546 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46752.log 2023-07-21T22:15:42.547 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47381.log 2023-07-21T22:15:42.547 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39068.log.gz 2023-07-21T22:15:42.548 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46752.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46752.log.gz 2023-07-21T22:15:42.549 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42687.log 2023-07-21T22:15:42.550 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39176.log 2023-07-21T22:15:42.551 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47381.log.gz 2023-07-21T22:15:42.551 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42687.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42687.log.gz 2023-07-21T22:15:42.552 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42139.log 2023-07-21T22:15:42.553 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48233.log 2023-07-21T22:15:42.554 INFO:teuthology.orchestra.run.smithi049.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.39176.log.gz 2023-07-21T22:15:42.554 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42139.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42139.log.gz 2023-07-21T22:15:42.555 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46093.log 2023-07-21T22:15:42.556 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48233.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48233.log.gz 2023-07-21T22:15:42.557 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42633.log 2023-07-21T22:15:42.559 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47065.log 2023-07-21T22:15:42.560 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46093.log: /var/log/ceph/ceph-client.admin.42633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47491.log 2023-07-21T22:15:42.560 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46093.log.gz 2023-07-21T22:15:42.560 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42633.log.gz 2023-07-21T22:15:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47065.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47065.log.gz 2023-07-21T22:15:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42962.log 2023-07-21T22:15:42.562 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47491.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47491.log.gz 2023-07-21T22:15:42.563 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49554.log 2023-07-21T22:15:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40796.log 2023-07-21T22:15:42.565 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42962.log.gz 2023-07-21T22:15:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45329.log 2023-07-21T22:15:42.567 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49554.log.gz 2023-07-21T22:15:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40796.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40796.log.gz 2023-07-21T22:15:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39986.log 2023-07-21T22:15:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.45329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45709.log 2023-07-21T22:15:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39986.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39986.log.gz 2023-07-21T22:15:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49244.log 2023-07-21T22:15:42.572 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45709.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45709.log.gz 2023-07-21T22:15:42.573 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43261.log 2023-07-21T22:15:42.573 INFO:teuthology.orchestra.run.smithi049.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.45329.log.gz 2023-07-21T22:15:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49244.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49244.log.gz 2023-07-21T22:15:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41977.log 2023-07-21T22:15:42.575 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43261.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.43261.log.gz 2023-07-21T22:15:42.576 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49953.log 2023-07-21T22:15:42.577 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50565.log 2023-07-21T22:15:42.578 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41977.log.gz 2023-07-21T22:15:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47092.log 2023-07-21T22:15:42.580 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49953.log.gz 2023-07-21T22:15:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50565.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50565.log.gz 2023-07-21T22:15:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43918.log 2023-07-21T22:15:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46311.log 2023-07-21T22:15:42.583 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47092.log.gz 2023-07-21T22:15:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43479.log 2023-07-21T22:15:42.584 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43918.log.gz 2023-07-21T22:15:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47011.log 2023-07-21T22:15:42.585 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46311.log.gz 2023-07-21T22:15:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49980.log 2023-07-21T22:15:42.585 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43479.log.gz 2023-07-21T22:15:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47011.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47011.log.gz 2023-07-21T22:15:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44805.log 2023-07-21T22:15:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49980.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49980.log.gz 2023-07-21T22:15:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34867.log 2023-07-21T22:15:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44805.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-21T22:15:42.589 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44805.log.gz 2023-07-21T22:15:42.590 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34867.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34867.log.gz 2023-07-21T22:15:42.590 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43424.log 2023-07-21T22:15:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.log: 86.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-21T22:15:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42220.log 2023-07-21T22:15:42.592 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40554.log 2023-07-21T22:15:42.593 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42220.log: /var/log/ceph/ceph-client.admin.43424.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42220.log.gz 2023-07-21T22:15:42.594 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45168.log 2023-07-21T22:15:42.594 INFO:teuthology.orchestra.run.smithi049.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43424.log.gz 2023-07-21T22:15:42.595 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49104.log 2023-07-21T22:15:42.596 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45168.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40554.log.gz 2023-07-21T22:15:42.597 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45168.log.gz 2023-07-21T22:15:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38555.log 2023-07-21T22:15:42.598 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49104.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49104.log.gz 2023-07-21T22:15:42.598 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42004.log 2023-07-21T22:15:42.599 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38555.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38555.log.gz 2023-07-21T22:15:42.600 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43397.log 2023-07-21T22:15:42.601 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42004.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42004.log.gz 2023-07-21T22:15:42.601 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38987.log 2023-07-21T22:15:42.602 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43397.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43397.log.gz 2023-07-21T22:15:42.602 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41066.log 2023-07-21T22:15:42.603 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38987.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38987.log.gz 2023-07-21T22:15:42.603 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40553.log 2023-07-21T22:15:42.604 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41066.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41066.log.gz 2023-07-21T22:15:42.605 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47464.log 2023-07-21T22:15:42.607 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42031.log 2023-07-21T22:15:42.607 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40553.log: /var/log/ceph/ceph-client.admin.47464.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40553.log.gz 2023-07-21T22:15:42.608 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47464.log.gz 2023-07-21T22:15:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-07-21T22:15:42.610 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48526.log 2023-07-21T22:15:42.611 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42031.log.gz 2023-07-21T22:15:42.612 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43180.log 2023-07-21T22:15:42.613 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48526.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48526.log.gz 2023-07-21T22:15:42.613 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42800.log 2023-07-21T22:15:42.615 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42660.log 2023-07-21T22:15:42.615 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43180.log.gz 2023-07-21T22:15:42.617 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42800.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42800.log.gz 2023-07-21T22:15:42.617 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44531.log 2023-07-21T22:15:42.619 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45141.log 2023-07-21T22:15:42.619 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42660.log.gz 2023-07-21T22:15:42.620 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44531.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44531.log.gz 2023-07-21T22:15:42.621 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43729.log 2023-07-21T22:15:42.621 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40103.log 2023-07-21T22:15:42.622 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45141.log.gz 2023-07-21T22:15:42.623 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43729.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43729.log.gz 2023-07-21T22:15:42.623 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48179.log 2023-07-21T22:15:42.625 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45654.log 2023-07-21T22:15:42.625 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40103.log.gz 2023-07-21T22:15:42.626 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48179.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48179.log.gz 2023-07-21T22:15:42.626 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39959.log 2023-07-21T22:15:42.628 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45654.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45654.log.gz 2023-07-21T22:15:42.628 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50650.log 2023-07-21T22:15:42.629 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46670.log 2023-07-21T22:15:42.629 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39959.log.gz 2023-07-21T22:15:42.630 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42274.log 2023-07-21T22:15:42.630 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50650.log.gz 2023-07-21T22:15:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46670.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46670.log.gz 2023-07-21T22:15:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2023-07-21T22:15:42.633 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38819.log 2023-07-21T22:15:42.633 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42274.log.gz 2023-07-21T22:15:42.634 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41732.log 2023-07-21T22:15:42.634 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2023-07-21T22:15:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50007.log 2023-07-21T22:15:42.635 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38819.log.gz 2023-07-21T22:15:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43646.log 2023-07-21T22:15:42.636 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41732.log.gz 2023-07-21T22:15:42.638 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44558.log 2023-07-21T22:15:42.638 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50007.log.gz 2023-07-21T22:15:42.639 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43646.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.43646.log.gz 2023-07-21T22:15:42.639 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.47733.log 2023-07-21T22:15:42.640 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44558.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44558.log.gz 2023-07-21T22:15:42.640 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40540.log 2023-07-21T22:15:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43343.log 2023-07-21T22:15:42.641 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47733.log.gz 2023-07-21T22:15:42.642 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38875.log 2023-07-21T22:15:42.642 INFO:teuthology.orchestra.run.smithi049.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40540.log.gz 2023-07-21T22:15:42.643 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43343.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43343.log.gz 2023-07-21T22:15:42.644 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48994.log 2023-07-21T22:15:42.644 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50106.log 2023-07-21T22:15:42.645 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38875.log.gz 2023-07-21T22:15:42.645 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48994.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.48994.log.gz 2023-07-21T22:15:42.646 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.48663.log 2023-07-21T22:15:42.647 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49077.log 2023-07-21T22:15:42.647 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50106.log.gz 2023-07-21T22:15:42.648 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48663.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48663.log.gz 2023-07-21T22:15:42.648 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50484.log 2023-07-21T22:15:42.649 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45460.log 2023-07-21T22:15:42.650 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49077.log.gz 2023-07-21T22:15:42.650 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50484.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.50484.log.gz 2023-07-21T22:15:42.650 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.49351.log 2023-07-21T22:15:42.651 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50160.log 2023-07-21T22:15:42.652 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45460.log.gz 2023-07-21T22:15:42.653 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49351.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49351.log.gz 2023-07-21T22:15:42.653 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39598.log 2023-07-21T22:15:42.654 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39543.log 2023-07-21T22:15:42.654 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50160.log.gz 2023-07-21T22:15:42.655 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44026.log 2023-07-21T22:15:42.656 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39598.log.gz 2023-07-21T22:15:42.657 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43756.log 2023-07-21T22:15:42.657 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39543.log.gz 2023-07-21T22:15:42.658 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49689.log 2023-07-21T22:15:42.658 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44026.log.gz 2023-07-21T22:15:42.659 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43756.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43756.log.gz 2023-07-21T22:15:42.659 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46616.log 2023-07-21T22:15:42.660 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49689.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49689.log.gz 2023-07-21T22:15:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39095.log 2023-07-21T22:15:42.662 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48885.log 2023-07-21T22:15:42.662 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46616.log.gz 2023-07-21T22:15:42.663 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39095.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39095.log.gz 2023-07-21T22:15:42.663 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-07-21T22:15:42.664 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50214.log 2023-07-21T22:15:42.665 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48885.log.gz 2023-07-21T22:15:42.665 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44747.log 2023-07-21T22:15:42.666 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50214.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50214.log.gz 2023-07-21T22:15:42.667 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40328.log 2023-07-21T22:15:42.669 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41093.log 2023-07-21T22:15:42.669 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44747.log.gz 2023-07-21T22:15:42.670 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40328.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40328.log.gz 2023-07-21T22:15:42.671 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39570.log 2023-07-21T22:15:42.672 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49131.log 2023-07-21T22:15:42.673 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41093.log.gz 2023-07-21T22:15:42.673 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39570.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39570.log.gz 2023-07-21T22:15:42.674 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45817.log 2023-07-21T22:15:42.675 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40542.log 2023-07-21T22:15:42.675 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49131.log.gz 2023-07-21T22:15:42.675 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45817.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45817.log.gz 2023-07-21T22:15:42.675 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40332.log 2023-07-21T22:15:42.676 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50349.log 2023-07-21T22:15:42.677 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40542.log.gz 2023-07-21T22:15:42.677 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40332.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40332.log.gz 2023-07-21T22:15:42.678 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42935.log 2023-07-21T22:15:42.678 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48940.log 2023-07-21T22:15:42.679 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50349.log.gz 2023-07-21T22:15:42.680 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42935.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42935.log.gz 2023-07-21T22:15:42.680 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46066.log 2023-07-21T22:15:42.681 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log 2023-07-21T22:15:42.681 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48940.log.gz 2023-07-21T22:15:42.682 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46066.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46066.log.gz 2023-07-21T22:15:42.683 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45222.log 2023-07-21T22:15:42.684 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39733.log 2023-07-21T22:15:42.684 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40985.log.gz 2023-07-21T22:15:42.685 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49049.log 2023-07-21T22:15:42.686 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45222.log.gz 2023-07-21T22:15:42.686 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49770.log 2023-07-21T22:15:42.687 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39733.log.gz 2023-07-21T22:15:42.688 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49049.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49049.log.gz 2023-07-21T22:15:42.688 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43070.log 2023-07-21T22:15:42.689 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41923.log 2023-07-21T22:15:42.690 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49770.log.gz 2023-07-21T22:15:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43070.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43070.log.gz 2023-07-21T22:15:42.691 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48206.log 2023-07-21T22:15:42.692 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47934.log 2023-07-21T22:15:42.692 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41923.log.gz 2023-07-21T22:15:42.693 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48206.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48206.log.gz 2023-07-21T22:15:42.694 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41815.log 2023-07-21T22:15:42.694 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39652.log 2023-07-21T22:15:42.695 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47934.log.gz 2023-07-21T22:15:42.695 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41815.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41815.log.gz 2023-07-21T22:15:42.696 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38792.log 2023-07-21T22:15:42.697 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44840.log 2023-07-21T22:15:42.697 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39652.log.gz 2023-07-21T22:15:42.698 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38792.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38792.log.gz 2023-07-21T22:15:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48581.log 2023-07-21T22:15:42.700 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48778.log 2023-07-21T22:15:42.700 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44840.log.gz 2023-07-21T22:15:42.701 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48581.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48581.log.gz 2023-07-21T22:15:42.701 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-07-21T22:15:42.702 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43043.log 2023-07-21T22:15:42.703 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48778.log.gz 2023-07-21T22:15:42.704 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44242.log 2023-07-21T22:15:42.705 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43043.log: gzip -5 --verbose -- 88.0%/var/log/ceph/ceph-client.admin.50538.log -- replaced with /var/log/ceph/ceph-client.admin.43043.log.gz 2023-07-21T22:15:42.706 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-07-21T22:15:42.707 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44242.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44242.log.gz 2023-07-21T22:15:42.708 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50538.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50538.log.gz 2023-07-21T22:15:43.013 INFO:teuthology.orchestra.run.smithi150.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-07-21T22:15:43.055 INFO:teuthology.orchestra.run.smithi150.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-07-21T22:15:43.086 INFO:teuthology.orchestra.run.smithi150.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-07-21T22:15:43.135 INFO:teuthology.orchestra.run.smithi150.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-07-21T22:15:43.139 INFO:teuthology.orchestra.run.smithi150.stderr: 2023-07-21T22:15:43.139 INFO:teuthology.orchestra.run.smithi150.stderr:real 0m1.055s 2023-07-21T22:15:43.139 INFO:teuthology.orchestra.run.smithi150.stderr:user 0m3.781s 2023-07-21T22:15:43.140 INFO:teuthology.orchestra.run.smithi150.stderr:sys 0m0.416s 2023-07-21T22:15:43.281 INFO:teuthology.orchestra.run.smithi049.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-07-21T22:15:43.474 INFO:teuthology.orchestra.run.smithi049.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-07-21T22:15:43.511 INFO:teuthology.orchestra.run.smithi049.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-07-21T22:15:43.511 INFO:teuthology.orchestra.run.smithi049.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-07-21T22:15:43.513 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-07-21T22:15:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:real 0m1.459s 2023-07-21T22:15:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:user 0m4.045s 2023-07-21T22:15:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:sys 0m1.202s 2023-07-21T22:15:43.514 INFO:tasks.ceph:Archiving logs... 2023-07-21T22:15:43.515 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719/remote/smithi049/log 2023-07-21T22:15:43.516 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-21T22:15:44.312 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719/remote/smithi150/log 2023-07-21T22:15:44.313 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-21T22:15:44.764 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-21T22:15:44.773 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-21T22:15:44.773 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-21T22:15:44.781 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-21T22:15:49.893 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-21T22:15:49.903 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-21T22:15:49.904 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T22:15:49.911 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T22:15:49.946 INFO:teuthology.orchestra.run.smithi049.stdout: remote refid st t when poll reach delay offset jitter 2023-07-21T22:15:49.947 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================== 2023-07-21T22:15:49.947 INFO:teuthology.orchestra.run.smithi049.stdout:+hv01.front.sepi 44.4.53.2 2 u 58 64 377 0.103 -0.189 0.927 2023-07-21T22:15:49.947 INFO:teuthology.orchestra.run.smithi049.stdout:*hv02.front.sepi 63.231.80.2 3 u 55 64 377 0.109 -0.225 0.452 2023-07-21T22:15:49.948 INFO:teuthology.orchestra.run.smithi049.stdout:+hv03.front.sepi 74.6.168.72 3 u 58 64 377 0.106 -0.728 0.901 2023-07-21T22:15:49.948 INFO:teuthology.orchestra.run.smithi049.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2023-07-21T22:15:49.949 INFO:teuthology.orchestra.run.smithi150.stdout: remote refid st t when poll reach delay offset jitter 2023-07-21T22:15:49.949 INFO:teuthology.orchestra.run.smithi150.stdout:============================================================================== 2023-07-21T22:15:49.950 INFO:teuthology.orchestra.run.smithi150.stdout:*hv01.front.sepi 44.4.53.2 2 u 50 64 377 0.102 0.361 1.213 2023-07-21T22:15:49.950 INFO:teuthology.orchestra.run.smithi150.stdout:+hv02.front.sepi 63.231.80.2 3 u 51 64 377 0.125 0.788 0.803 2023-07-21T22:15:49.950 INFO:teuthology.orchestra.run.smithi150.stdout:+hv03.front.sepi 74.6.168.72 3 u 52 64 377 0.103 -0.662 0.612 2023-07-21T22:15:49.950 INFO:teuthology.orchestra.run.smithi150.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2023-07-21T22:15:49.951 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-21T22:15:49.960 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-21T22:15:49.961 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-21T22:15:49.991 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-21T22:15:50.041 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-21T22:15:50.091 INFO:teuthology.task.internal:Duration was 1123.930820 seconds 2023-07-21T22:15:50.092 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-21T22:15:50.148 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-21T22:15:50.148 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-21T22:15:50.155 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-21T22:15:50.308 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-21T22:15:50.309 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2023-07-21T22:15:50.309 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-21T22:15:50.347 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2023-07-21T22:15:50.348 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-21T22:15:50.385 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-21T22:15:50.386 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-21T22:15:50.402 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-21T22:15:50.489 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-21T22:15:50.490 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-21T22:15:50.496 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-21T22:15:50.601 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-21T22:15:50.612 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-21T22:15:50.612 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-21T22:15:50.646 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-21T22:15:50.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-21T22:15:50.694 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-21T22:15:50.702 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-21T22:15:50.731 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2023-07-21T22:15:50.761 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2023-07-21T22:15:50.797 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-21T22:15:50.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:15:50.828 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-21T22:15:50.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:15:50.858 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-21T22:15:50.868 INFO:teuthology.task.internal:Transferring archived files... 2023-07-21T22:15:50.869 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719/remote/smithi049 2023-07-21T22:15:50.870 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-21T22:15:50.916 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719/remote/smithi150 2023-07-21T22:15:50.917 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-21T22:15:50.958 INFO:teuthology.task.internal:Removing archive directory... 2023-07-21T22:15:50.959 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-21T22:15:50.966 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-21T22:15:51.017 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-21T22:15:51.029 INFO:teuthology.task.internal:Not uploading archives. 2023-07-21T22:15:51.029 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-21T22:15:51.060 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-21T22:15:51.061 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-21T22:15:51.068 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-21T22:15:51.083 INFO:teuthology.orchestra.run.smithi049.stdout: 1048609 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 21 22:15 /home/ubuntu/cephtest 2023-07-21T22:15:51.091 INFO:teuthology.orchestra.run.smithi150.stdout: 1048617 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 21 22:15 /home/ubuntu/cephtest 2023-07-21T22:15:51.097 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-21T22:15:51.108 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-21T22:15:51.210 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T22:15:51.239 DEBUG:teuthology.nuke:shortname: smithi049 2023-07-21T22:15:51.239 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T22:15:51.267 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:37:25.916606', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-21T22:15:51.270 DEBUG:teuthology.nuke:shortname: smithi150 2023-07-21T22:15:51.270 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T22:15:51.297 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347719', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:37:25.914676', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-07-21T22:15:51.327 INFO:teuthology.orchestra.console:Power off smithi049 2023-07-21T22:15:51.329 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T22:15:51.355 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:15:51.380 INFO:teuthology.orchestra.console:Power off smithi150 2023-07-21T22:15:51.381 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T22:15:51.405 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:15:55.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:15:55.429 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:15:59.512 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:15:59.544 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:15:59.755 INFO:teuthology.orchestra.console:Power off for smithi150 completed 2023-07-21T22:16:03.628 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:16:08.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:16:13.856 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:16:18.967 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:16:24.079 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:16:24.292 INFO:teuthology.orchestra.console:Power off for smithi049 completed 2023-07-21T22:16:24.397 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} duration: 1123.9308197498322 failure_reason: 'Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm)' flavor: default mon.a-kernel-sha1: c685da6f56cc77f2cfb9c4221be3960522616caf mon.b-kernel-sha1: c685da6f56cc77f2cfb9c4221be3960522616caf owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=8b1cbdcf96434237880612fbe97d8047 status: fail success: false 2023-07-21T22:16:24.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:16:29.501 INFO:teuthology.run:FAIL